Skip to content

[Merged by Bors] - reduce reprocess queue/channel sizes#3239

Closed
divagant-martian wants to merge 2 commits intosigp:unstablefrom
divagant-martian:reduce-reprocessing-queue-size
Closed

[Merged by Bors] - reduce reprocess queue/channel sizes#3239
divagant-martian wants to merge 2 commits intosigp:unstablefrom
divagant-martian:reduce-reprocessing-queue-size

Conversation

@divagant-martian
Copy link
Copy Markdown
Contributor

Issue Addressed

Reduces the effect of late blocks on overall node buildup

Proposed Changes

change the capacity of the channels used to send work for reprocessing in the beacon processor, and to send back to the main processor task, to be 75% of the capacity of the channel for receiving new events

Additional Info

The issues we've seen suggest we should still evaluate node performance under stress, with late blocks being a big factor.
Other changes that could help:

  1. right now we have a cap for queued attestations for reprocessing that applies to the sum of aggregated and unaggregated attestations. We could consider adding a separate cap that favors aggregated ones.
  2. solving Bound the network channel #2848

@michaelsproul michaelsproul added the ready-for-review The code is ready for review label Jun 6, 2022
Copy link
Copy Markdown
Member

@michaelsproul michaelsproul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This change seems sensible to me!

@michaelsproul michaelsproul added ready-for-merge This PR is ready to merge. and removed ready-for-review The code is ready for review labels Jun 6, 2022
@michaelsproul
Copy link
Copy Markdown
Member

bors r+

bors bot pushed a commit that referenced this pull request Jun 6, 2022
## Issue Addressed

Reduces the effect of late blocks on overall node buildup

## Proposed Changes

change the capacity of the channels used to send work for reprocessing in the beacon processor, and to send back to the main processor task, to be 75% of the capacity of the channel for receiving new events

## Additional Info

The issues we've seen suggest we should still evaluate node performance under stress, with late blocks being a big factor. 
Other changes that could help: 
1. right now we have a cap for queued attestations for reprocessing that applies to the sum of aggregated and unaggregated attestations. We could consider adding a separate cap that favors aggregated ones.
2. solving #2848
@bors bors bot changed the title reduce reprocess queue/channel sizes [Merged by Bors] - reduce reprocess queue/channel sizes Jun 7, 2022
@bors bors bot closed this Jun 7, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Networking ready-for-merge This PR is ready to merge.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants