feat: cache wallet and dust state; improve ledger state deserialization performance#820
Closed
mpskowron wants to merge 13 commits into
Closed
feat: cache wallet and dust state; improve ledger state deserialization performance#820mpskowron wants to merge 13 commits into
mpskowron wants to merge 13 commits into
Conversation
0ad87ab to
b0f000b
Compare
Contributor
|
KICS version: v2.1.19
|
bdaa58d to
531b9a1
Compare
a00eb47 to
65f7244
Compare
14 tasks
github-merge-queue Bot
pushed a commit
that referenced
this pull request
Mar 18, 2026
* feat: cache wallet and dust state; improve ledger state deserialization performance * feat: separate ledger and wallet caches * feat: use file based cache for wallets and ledger state * fix: greatly improve performance of ledger state gc * feat: improve performance and toolkit new command * perf: event batching when replaying blocks * refactor: remove some unnecessary code * fix: fail gracefully if not enough DUST * feat: better conccurrency for tx generation * feat: add cmd line param to control ryon concurrency * fix: bson encoding * docs: add change files * test: verify trusted deserialization matches upstream Adds a round-trip test that deserializes a LedgerState via both the standard (two-pass verified) and trusted (single-pass) paths, then asserts they produce identical serialized output. Catches silent divergence if upstream changes its hash function or format. * feat: return built txs from batch_single_tx instead of writing to files Use ordered `buffered` stream, collect results into SerializedTxBatches, support inline --transfers JSON arg alongside --transfers-file, and extract transfer spec parsing into BatchSingleTxArgs::get_transfer_specs. This brings `batch_single_tx` in-line with the other toolkit builders * fix: tweak cache dir creation for better UX * docs: update PR links in change files * docs: tweak comment * chore: demote [perf] timing logs from info to debug * feat: use postcard instead of bson * fix: fix toolkit tests (compile errors + logs) * refactor: split build_fork_aware_context_cached into separate functions * feat: add --seeds flag to `fetch` subcommand * build: fix error in toolkit dockerfile * docs: add change file documenting default cache change * build: fix npm audit error * refactor: vec to array and method extraction * fix: apply events between ledger7 and 8 correctly * fix: some of file_backend data races * refactor: remove dead code and improve some comments * test: fix compile errors in local-env tests * fix: lint warning * refactor: small tests simplification * refactor: reuse single_tx command in batch_single_tx; make cached_context tests faster and more useful * fix: file_backend now uses unique temp files to avoid data races on write; correct changefiles content * refactor: small comments revert and refine * tweak: check states do not diverge Signed-off-by: Giles Cope <gilescope@gmail.com> * docs: improve comments for wallet_state_cache --------- Signed-off-by: Giles Cope <gilescope@gmail.com> Co-authored-by: Michał Skowron <michal.skowron@iohk.io> Co-authored-by: Giles Cope <gilescope@gmail.com>
gilescope
pushed a commit
that referenced
this pull request
Apr 8, 2026
Contributor
Author
|
This one was merged within #939 |
m2ux
added a commit
that referenced
this pull request
Apr 23, 2026
Signed-off-by: Mike Clay <mike.clay@shielded.io>
m2ux
added a commit
that referenced
this pull request
Apr 23, 2026
Signed-off-by: Mike Clay <mike.clay@shielded.io>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
EARLY DRAFT
🗹 TODO before merging
📌 Submission Checklist
🧪 Testing Evidence
Please describe any additional testing aside from CI:
🔱 Fork Strategy
Links