Skip to content

perf: replace Vec allocation with lazy iterator in find_hash_placeholders#8703

Merged
graphite-app[bot] merged 1 commit intomainfrom
perf/lazy-hash-placeholder-iterator
Mar 15, 2026
Merged

perf: replace Vec allocation with lazy iterator in find_hash_placeholders#8703
graphite-app[bot] merged 1 commit intomainfrom
perf/lazy-hash-placeholder-iterator

Conversation

@Boshen
Copy link
Copy Markdown
Member

@Boshen Boshen commented Mar 15, 2026

Summary

  • Replace Vec::with_capacity(s.len() / 11) pre-allocation in find_hash_placeholders with a zero-allocation HashPlaceholderIter that yields matches lazily — eliminates ~29 MB heap allocation per 10 MB input
  • Bound the }~ search to MAX_HASH_SIZE + HASH_PLACEHOLDER_OVERHEAD bytes after each !~{ match instead of scanning the entire remaining string
  • Update callers in rolldown_plugin_chunk_import_map to use .peekable() and .filter().collect() instead of .is_empty() / .retain()

🤖 Generated with Claude Code

Copilot AI review requested due to automatic review settings March 15, 2026 08:04
@netlify
Copy link
Copy Markdown

netlify bot commented Mar 15, 2026

Deploy Preview for rolldown-rs canceled.

Name Link
🔨 Latest commit 9f506cc
🔍 Latest deploy log https://app.netlify.com/projects/rolldown-rs/deploys/69b6d7d3d1048f0008259936

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Replaces eager Vec allocation in find_hash_placeholders with a lazy HashPlaceholderIter, eliminating unnecessary heap allocation. Also bounds the }~ search window and updates callers accordingly.

Changes:

  • Introduce HashPlaceholderIter struct implementing Iterator to yield hash placeholder matches lazily
  • Bound the closing }~ search to MAX_HASH_SIZE + HASH_PLACEHOLDER_OVERHEAD bytes after each !~{ match
  • Update callers to use .peekable(), .filter().collect(), and .collect() instead of Vec-based APIs

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
crates/rolldown_utils/src/hash_placeholder.rs Replace Vec-returning function with lazy iterator struct; update internal callers and tests
crates/rolldown_plugin_chunk_import_map/src/lib.rs Adapt to iterator API using .peekable() and .filter().collect()

You can also share your feedback on Copilot code review. Take the survey.

Copy link
Copy Markdown

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 629a24662b

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks Rust

  • target: main(df3188d)
  • pr: perf/lazy-hash-placeholder-iterator(11b4f8e)
group                                                        pr                                     target
-----                                                        --                                     ------
bundle/bundle@multi-duplicated-top-level-symbol              1.03     65.1±1.81ms        ? ?/sec    1.00     63.2±1.45ms        ? ?/sec
bundle/bundle@multi-duplicated-top-level-symbol-sourcemap    1.03     73.9±2.83ms        ? ?/sec    1.00     71.6±1.06ms        ? ?/sec
bundle/bundle@rome_ts                                        1.00    136.9±3.77ms        ? ?/sec    1.02    139.5±5.92ms        ? ?/sec
bundle/bundle@rome_ts-sourcemap                              1.00    155.7±2.78ms        ? ?/sec    1.02    159.4±3.94ms        ? ?/sec
bundle/bundle@threejs                                        1.00     60.9±2.57ms        ? ?/sec    1.00     60.8±2.47ms        ? ?/sec
bundle/bundle@threejs-sourcemap                              1.00     71.5±1.95ms        ? ?/sec    1.00     71.4±2.26ms        ? ?/sec
bundle/bundle@threejs10x                                     1.01   723.3±12.23ms        ? ?/sec    1.00   716.2±10.12ms        ? ?/sec
bundle/bundle@threejs10x-sourcemap                           1.01   825.5±16.50ms        ? ?/sec    1.00   817.1±10.83ms        ? ?/sec

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Mar 15, 2026

Merging this PR will not alter performance

✅ 6 untouched benchmarks
⏩ 8 skipped benchmarks1


Comparing perf/lazy-hash-placeholder-iterator (11b4f8e) with main (f8be84a)2

Open in CodSpeed

Footnotes

  1. 8 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. No successful run was found on main (df3188d) during the generation of this report, so f8be84a was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@Boshen Boshen requested a review from hyf0 March 15, 2026 08:36
@Boshen Boshen assigned hyf0 and unassigned Boshen Mar 15, 2026
Copy link
Copy Markdown
Member

@hyf0 hyf0 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Copy Markdown
Member Author

Boshen commented Mar 15, 2026

Merge activity

  • Mar 15, 4:00 PM UTC: The merge label 'graphite: merge-when-ready' was detected. This PR will be added to the Graphite merge queue once it meets the requirements.
  • Mar 15, 4:00 PM UTC: Boshen added this pull request to the Graphite merge queue.
  • Mar 15, 4:05 PM UTC: Merged by the Graphite merge queue.

…ders (#8703)

## Summary

- Replace `Vec::with_capacity(s.len() / 11)` pre-allocation in `find_hash_placeholders` with a zero-allocation `HashPlaceholderIter` that yields matches lazily — eliminates ~29 MB heap allocation per 10 MB input
- Bound the `}~` search to `MAX_HASH_SIZE + HASH_PLACEHOLDER_OVERHEAD` bytes after each `!~{` match instead of scanning the entire remaining string
- Update callers in `rolldown_plugin_chunk_import_map` to use `.peekable()` and `.filter().collect()` instead of `.is_empty()` / `.retain()`

🤖 Generated with [Claude Code](https://claude.com/claude-code)
@graphite-app graphite-app bot force-pushed the perf/lazy-hash-placeholder-iterator branch from 11b4f8e to 9f506cc Compare March 15, 2026 16:01
@graphite-app graphite-app bot merged commit 9f506cc into main Mar 15, 2026
32 checks passed
This was referenced Mar 18, 2026
shulaoda added a commit that referenced this pull request Mar 18, 2026
## [1.0.0-rc.10] - 2026-03-18

### 🚀 Features

- add indentExclusionRanges property to MagicString (#8746) by @IWANABETHATGUY
- expose `oxcRuntimePlugin` (#8654) by @sapphi-red
- rust: make bundler generic over FileSystem for in-memory benchmarks (#8652) by @Boshen

### 🐛 Bug Fixes

- rolldown_plugin_vite_dynamic_import_vars: align dynamic import fast check with Vite (#8760) by @shulaoda
- renamer: handle existing bindings in nested scopes when finding unique names (#8741) by @drewolson
- pass `yarn_pnp` option where needed (#8736) by @sapphi-red
- preserve optional chaining in namespace member expr rewrite (#8712) by @Copilot
- correct UTF-16 index handling in native MagicString (#8693) by @IWANABETHATGUY
- mark failing doctests as ignore (#8700) by @Boshen
- prevent may_partial_namespace from leaking through include_module (#8682) by @IWANABETHATGUY
- ci: bump native-build cache key to invalidate stale napi-rs artifacts (#8678) by @Boshen
- `comments.annotation: false` breaking tree-shaking (#8657) by @IWANABETHATGUY
- validate filenames for NUL bytes from chunkFileNames/entryFileNames (#8644) by @IWANABETHATGUY
- dce-only minify should not set NODE_ENV to production (#8651) by @IWANABETHATGUY

### 🚜 Refactor

- rust: remove dead `CrossModuleOptimizationConfig::side_effects_free_function_optimization` (#8673) by @Dunqing
- rust: simplify `cross_module_optimization` by removing redundant scope tracking (#8672) by @Dunqing
- simplify string repeat in guess_indentor (#8753) by @IWANABETHATGUY
- consolidate custom magic-string tests into one file (#8696) by @IWANABETHATGUY
- extract CJS bailout checks from include_symbol (#8683) by @IWANABETHATGUY
- rust: remove `BindingIdentifierExt` to use `BindingIdentifier::symbol_id()` instead (#8667) by @Dunqing
- bench: add bench_preset helper and inline presets (#8658) by @Boshen
- rust: filter external modules from entries instead of mapping bit positions (#8637) by @Dunqing

### 📚 Documentation

- clarify watch mode behavior and its limitations (#8751) by @sapphi-red
- add external link icon to GitHub button in Hero section (#8731) by @thisisnkc
- guide: clarify that `inject` option is only conceptually similar to esbuild's one (#8743) by @sapphi-red
- meta/design: add `devtools.md` (#8663) by @hyf0
- add viteplus alpha announcement banner (#8668) by @shulaoda

### ⚡ Performance

- rolldown: some minor perf optimization found by autoresearch (#8730) by @Brooooooklyn
- replace Vec allocation with lazy iterator in find_hash_placeholders (#8703) by @Boshen
- replace TypedDashMap with TypedMap in CustomField (#8708) by @Boshen
- bench: remove scan benchmark binary to halve LTO link time (#8694) by @Boshen

### 🧪 Testing

- watch: increase timeout for error output (#8766) by @sapphi-red
- vite-tests: remove JS plugin tests (#8767) by @sapphi-red
- watch: add CLI exit code test (#8752) by @sapphi-red
- normalize paths on Windows even if `resolve.symlinks` is false (#8483) by @sapphi-red

### ⚙️ Miscellaneous Tasks

- correct comment in bundle-analyzer-plugin.ts (#8770) by @origami-z
- upgrade oxc to 0.120.0 (#8764) by @Boshen
- enable all test for `reset` category in MagicString.test.ts (#8749) by @IWANABETHATGUY
- deps: update test262 submodule for tests (#8742) by @sapphi-red
- deps: update oxc apps (#8734) by @renovate[bot]
- deps: update softprops/action-gh-release action to v2.6.1 (#8724) by @renovate[bot]
- deps: update npm packages (major) (#8722) by @renovate[bot]
- deps: update github-actions (major) (#8721) by @renovate[bot]
- deps: update softprops/action-gh-release action to v2.6.0 (#8720) by @renovate[bot]
- deps: update npm packages (#8718) by @renovate[bot]
- deps: update rust crates (#8717) by @renovate[bot]
- deps: update github-actions (#8716) by @renovate[bot]
- deps: update dependency oxlint-tsgolint to v0.17.0 (#8713) by @renovate[bot]
- deps: bump cargo-shear to v1.11.2 (#8711) by @Boshen
- use org level `CODE_OF_CONDUCT.md` (#8706) by @sapphi-red
- fix cache key mismatch and remove redundant cache saves (#8695) by @Boshen
- deps: update oxc apps (#8692) by @renovate[bot]
- deps: update oxc apps (#8649) by @renovate[bot]
- should do matrix out side of reusable workflows 2 (#8691) by @hyf0
- should do matrix out side of reusable workflows (#8690) by @hyf0
- deps: update dependency rolldown-plugin-dts to v0.22.5 (#8689) by @renovate[bot]
- upgrade oxc to 0.119.0 and oxc_resolver to 11.19.1 (#8686) by @Boshen
- correct if condition of `type-check` job (#8677) by @hyf0
- Gate CI type-check job on node changes (#8669) by @Copilot
- benchmark: improve codspeed build (#8665) by @Boshen
- deps: update oxc to v0.118.0 (#8650) by @renovate[bot]
- deps: update crate-ci/typos action to v1.44.0 (#8647) by @renovate[bot]
- deps: update oxc resolver to v11.19.1 (#8646) by @renovate[bot]
- deps: update dependency rust to v1.94.0 (#8648) by @renovate[bot]
- deps: update dependency rolldown-plugin-dts to v0.22.4 (#8645) by @renovate[bot]

### ◀️ Revert

- Revert "ci: Gate CI type-check job on node changes" (#8674) by @hyf0
- "chore(deps): update dependency rust to v1.94.0 (#8648)" (#8660) by @shulaoda

### ❤️ New Contributors

* @origami-z made their first contribution in [#8770](#8770)
* @drewolson made their first contribution in [#8741](#8741)
* @thisisnkc made their first contribution in [#8731](#8731)

Co-authored-by: shulaoda <165626830+shulaoda@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants