Skip to content

eth, trie/triedb/pathdb: pbss patches#1955

Merged
brilliant-lx merged 4 commits intodevelopfrom
pbss_fix
Nov 6, 2023
Merged

eth, trie/triedb/pathdb: pbss patches#1955
brilliant-lx merged 4 commits intodevelopfrom
pbss_fix

Conversation

@joey0612
Copy link
Copy Markdown
Contributor

@joey0612 joey0612 commented Oct 31, 2023

Description

This PR fixes the stability and performance of PBSS, opt the add asyncnodebuffer option for flushing disk(it non-block state commit), fix rewind root hash mismatch.

Rationale

Example

--pathdb.sync use the origin nodebuffer, the defaulte use the asyncnodebuffer.

Changes

Notable changes:

  • trie/triedb/pathdb
  • core

@joey0612 joey0612 added the wip work in process label Oct 31, 2023
@joey0612 joey0612 changed the title Pbss fix [Testing] Oct 31, 2023
@joey0612 joey0612 force-pushed the pbss_fix branch 4 times, most recently from d8a631f to cea8fa4 Compare October 31, 2023 10:20
@joey0612 joey0612 changed the title [Testing] eth, trie/triedb/pathdb: pbss patches Oct 31, 2023
@joey0612 joey0612 added r4r ready for review and removed wip work in process labels Oct 31, 2023
@brilliant-lx
Copy link
Copy Markdown
Contributor

1.DefaultDirtyBufferSize 64MB, it is conflicted with the current cache allocation, which allocate 25% cache to dirty cache by default.

@joey0612
Copy link
Copy Markdown
Contributor Author

joey0612 commented Nov 3, 2023

1.DefaultDirtyBufferSize 64MB, it is conflicted with the current cache allocation, which allocate 25% cache to dirty cache by default.

PBSS nodebuffer will aggregate the nodes of multiple difflayers together, so the nodebuffer will be written in one batch, so it should not be too large. MaxDirtyBufferSize and DefaultDirtyBufferSize are both verified and considered values.

@joey0612 joey0612 force-pushed the pbss_fix branch 3 times, most recently from 4c80518 to becbe8f Compare November 6, 2023 03:03
Copy link
Copy Markdown

@RenRick RenRick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@buddh0 buddh0 added duplicate This issue or pull request already exists and removed duplicate This issue or pull request already exists labels Nov 6, 2023
@brilliant-lx brilliant-lx merged commit 53559fc into develop Nov 6, 2023
@joey0612 joey0612 deleted the pbss_fix branch November 7, 2023 03:34
whw188 pushed a commit to tylerteea/mev-bsc that referenced this pull request Dec 6, 2023
* fix: use the top root hash for rewinding under path schema

* feat: add async flush nodebuffer in path schema

* chore: add prun-block param suffix check

* fix: code review comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

r4r ready for review

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants