added rate limiting to address biased trie cache preloading#2029
added rate limiting to address biased trie cache preloading#2029pratikspatil024 merged 7 commits intodevelopfrom
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## develop #2029 +/- ##
===========================================
+ Coverage 49.57% 49.61% +0.03%
===========================================
Files 873 873
Lines 150507 150679 +172
===========================================
+ Hits 74615 74759 +144
- Misses 70860 70887 +27
- Partials 5032 5033 +1
... and 30 files with indirect coverage changes
🚀 New features to boost your workflow:
|
cffls
left a comment
There was a problem hiding this comment.
Looks good overall! What long does it take to preload mainnet with the default throttling setting?
@cffls - with I think this |
72cb861 to
faf031c
Compare
Code ReviewIssue found: Documentation discrepancy in The comments say This is a 10x difference that could cause confusion for users configuring the node. Suggested fix: Update the comments to say Checked for bugs and CLAUDE.md compliance. |
|
@claude addressed your comments. |
|
Claude finished @pratikspatil024's task in 1m 6s —— View job Re-reviewing PR
Review SummaryThe previous documentation discrepancy has been fixed. The PR now consistently uses 1MB/s as the default rate limit across all files:
Code Quality AssessmentStrengths:
Implementation Details:
No issues found in this re-review. |
lucca30
left a comment
There was a problem hiding this comment.
Looks good to me, just proposed a small change if makes sense in comparison to nodeData which I'm not sure what is the size.
|
* added rate limiting to address biased trie cache preloading * updated default limit to 512KB/sec and a small update in limiter * added unit tests * updated default to 1MB/s and updated comments * reduced code duplication * triedb/pathdb: skip the node in preloading if it's size is > burst size



Description
Please provide a detailed description of what was done in this PR
Changes
Breaking changes
Please complete this section if any breaking changes have been made, otherwise delete it
Nodes audience
In case this PR includes changes that must be applied only to a subset of nodes, please specify how you handled it (e.g. by adding a flag with a default value...)
Checklist
Cross repository changes
Testing
Manual tests
Please complete this section with the steps you performed if you ran manual tests for this functionality, otherwise delete it
Additional comments
Please post additional comments in this section if you have them, otherwise delete it