Skip to content

Add the ascending bootstrap client#4158

Merged
clemahieu merged 5 commits intonanocurrency:developfrom
clemahieu:bootstrap_ascending_client
Mar 14, 2023
Merged

Add the ascending bootstrap client#4158
clemahieu merged 5 commits intonanocurrency:developfrom
clemahieu:bootstrap_ascending_client

Conversation

@clemahieu
Copy link
Copy Markdown
Contributor

@clemahieu clemahieu commented Feb 27, 2023 •
edited
Loading

This branch adds the ascending bootstrap client to the nano node. The associated server components and network messages were added in V24.

The client is an improvement in several categories compared to the legacy version.

  • Uses smaller message bundles instead of streams which reduces socket usage
  • Pulls blocks in an ascending manner rather than descending which lightens the burden on the "unchecked" table.
  • Reduce database deletes since now the unchecked table can exist entirely in memory.
  • Reduces bandwidth consumption from more efficient retry logic.
  • Simplifies and isolates bootstrap logic from the rest of the node

The client uses a priority-weighted tracing algorithm to pull successive iterations of blocks from peers.

The overall time from 0 blocks to a full block count has been significantly reduced.

@clemahieu clemahieu force-pushed the bootstrap_ascending_client branch from 8901ab5 to a29e4b2 Compare March 1, 2023 12:31
@clemahieu clemahieu mentioned this pull request Mar 3, 2023
Merged
@clemahieu clemahieu force-pushed the bootstrap_ascending_client branch 6 times, most recently from 0ae674f to 077538e Compare March 6, 2023 10:54
@thsfs thsfs added this to the V25.0 milestone Mar 6, 2023
@thsfs thsfs added the major This item indicates the need for or supplies a major or notable change label Mar 6, 2023
@clemahieu clemahieu force-pushed the bootstrap_ascending_client branch from 077538e to 822e90a Compare March 8, 2023 02:13
@clemahieu clemahieu force-pushed the bootstrap_ascending_client branch 5 times, most recently from 7d55ced to 095df2c Compare March 14, 2023 22:04
clemahieu and others added 5 commits March 14, 2023 22:19
@clemahieu @pwojcikdev @gr0vity-dev
Disables disk usage from the unchecked_map class.
196198e 
With the ascending bootstrap process the number of blocks needing to be tracked can be limited and remain in memory.

The maximum number of blocks is set to 64k though typically far fewer are actually needed.

Co-authored-by: Piotr Wójcik <3044353+pwojcikdev@users.noreply.github.com>
Co-authored-by: gr0vity-dev <85646666+gr0vity-dev@users.noreply.github.com>
@clemahieu @pwojcikdev @gr0vity-dev
This adds the ascending bootstrap client functionality.
d8d4657 
- Pulls blocks in an ascending order making use of network messages added in v24.
- Since blocks need to be inserted in an ascending order, this greatly decreases the number of unchecked blocks needing to be tracked.
- The client uses a priority-weighted tracing algorithm to pull successive iterations of blocks from peers.

Co-authored-by: Piotr Wójcik <3044353+pwojcikdev@users.noreply.github.com>
Co-authored-by: gr0vity-dev <85646666+gr0vity-dev@users.noreply.github.com>
@clemahieu @pwojcikdev @gr0vity-dev
Connecting ascending bootstrap client to node.
1d1d152 
Co-authored-by: Piotr Wójcik <3044353+pwojcikdev@users.noreply.github.com>
Co-authored-by: gr0vity-dev <85646666+gr0vity-dev@users.noreply.github.com>
@clemahieu @pwojcikdev @gr0vity-dev
Enabling ascending bootstrap.
87f61d8 
Co-authored-by: Piotr Wójcik <3044353+pwojcikdev@users.noreply.github.com>
Co-authored-by: gr0vity-dev <85646666+gr0vity-dev@users.noreply.github.com>
@clemahieu @pwojcikdev @gr0vity-dev
Lowering requests_limit to 128 from 4096
2807cee 
Co-authored-by: Piotr Wójcik <3044353+pwojcikdev@users.noreply.github.com>
Co-authored-by: gr0vity-dev <85646666+gr0vity-dev@users.noreply.github.com>
@clemahieu clemahieu force-pushed the bootstrap_ascending_client branch from 095df2c to 2807cee Compare March 14, 2023 22:28
@clemahieu clemahieu merged commit 022a10f into nanocurrency:develop Mar 14, 2023
@thsfs thsfs added the documentation This item indicates the need for or supplies updated or expanded documentation label May 22, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

documentation This item indicates the need for or supplies updated or expanded documentation major This item indicates the need for or supplies a major or notable change

Projects

None yet

Milestone

V25.0

Development

Successfully merging this pull request may close these issues.

2 participants

@clemahieu @thsfs