Skip to content

chore: refresh benchmarks for v1.6.2#467

Merged
jdx merged 1 commit intomainfrom
bench-refresh
May 2, 2026
Merged

chore: refresh benchmarks for v1.6.2#467
jdx merged 1 commit intomainfrom
bench-refresh

Conversation

@mise-en-dev
Copy link
Copy Markdown
Collaborator

@mise-en-dev mise-en-dev commented May 2, 2026

🤖 Refreshed benchmarks

benchmarks/results.json was pinned to aube 1.5.2; the workspace is now 1.6.2. Re-ran mise run bench:bump on the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regenerated benchmarks/results.json plus the README BENCH_RATIOS block. The benchmark matrix pins aube's GVS mode via npm_config_enable_global_virtual_store=true|false (the auto-synthesized env alias for the enableGlobalVirtualStore setting), so GitHub Actions' inherited CI=true environment does not change whether aube runs with GVS enabled or disabled.

Benchmark changes

Versions:

  • aube: 1.5.2 -> 1.6.2

Public ratios: warm installs vs Bun 6x -> 4x; warm installs vs pnpm 10x -> 9x; repeat test vs Bun 4x -> 5x; repeat test vs pnpm 35x -> 33x.

Benchmark aube bun pnpm npm yarn
Fresh install (warm cache) 230ms -> 246ms (+7%) 1488ms -> 1011ms (-32%) 2367ms -> 2227ms (-6%) 6416ms -> 6091ms (-5%) 13963ms -> 11193ms (-20%)
Fresh install (cold cache) 6047ms -> 4595ms (-24%) 4333ms -> 4517ms (+4%) 4723ms -> 4982ms (+5%) 8154ms -> 7588ms (-7%) 26771ms -> 24904ms (-7%)
CI install (warm cache, GVS disabled) 564ms -> 1174ms (+108%) 1295ms -> 1530ms (+18%) 2361ms -> 2049ms (-13%) 6616ms -> 6287ms (-5%) 13860ms -> 11538ms (-17%)
CI install (cold cache, GVS disabled) 5800ms -> 4273ms (-26%) 4278ms -> 4034ms (-6%) 4823ms -> 4940ms (+2%) 7794ms -> 7701ms (-1%) 26621ms -> 25067ms (-6%)
npm install && npm run test 9ms -> 9ms (0%) 40ms -> 41ms (+3%) 318ms -> 300ms (-6%) 686ms -> 678ms (-1%) 375ms -> 364ms (-3%)
Add dependency 476ms -> 696ms (+46%) 935ms -> 1052ms (+13%) 2500ms -> 2343ms (-6%) 6214ms -> 6725ms (+8%) 12967ms -> 12943ms (0%)

Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.

Once merged to main, the updated bench results flow into the next release-plz-pr run automatically.

Generated by the bench-refresh workflow.

@greptile-apps
Copy link
Copy Markdown

greptile-apps Bot commented May 2, 2026

Greptile Summary

Refreshes benchmark data from aube 1.5.2 → 1.6.2: updates benchmarks/results.json with new timings and regenerates the BENCH_RATIOS block in README.md. All values integers match stats.mean rounded to milliseconds, and the README ratios are arithmetically consistent with the JSON data. The +108% regression in the ci-warm aube scenario (564 ms → 1174 ms) and +46% in add (476 ms → 696 ms) are the most notable changes and are called out in the PR description.

Confidence Score: 5/5

Safe to merge — purely a data refresh with no logic changes and internally consistent numbers

Both changed files are data/documentation only. All integer values in results.json match their stats.mean rounded to ms, and the README ratios correctly reflect the new JSON figures. No code logic was modified.

No files require special attention beyond confirming the ci-warm aube regression (+108%) is expected for v1.6.2

Important Files Changed

Filename Overview
README.md Updated BENCH_RATIOS block — warm install ratios (6x→4x vs Bun, 10x→9x vs pnpm) and repeat test ratios (4x→5x vs Bun, 35x→33x vs pnpm) correctly match the new results.json means
benchmarks/results.json Benchmark data refreshed for aube 1.6.2; all integer values fields match the corresponding stats.mean rounded to ms; internal consistency verified across all six scenarios

Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 2, 2026

Benchmark changes

Versions:

  • aube: 1.5.2 -> 1.6.2

Public ratios: warm installs vs Bun 6x -> 7x; warm installs vs pnpm 10x -> 11x.

Benchmark aube bun pnpm
Fresh install (warm cache) 230ms -> 306ms (+33%) 1488ms -> 2007ms (+35%) 2367ms -> 3256ms (+38%)
CI install (warm cache, GVS disabled) 564ms -> 778ms (+38%) 1295ms -> 1988ms (+54%) 2361ms -> 2303ms (-2%)
CI install (cold cache, GVS disabled) 5800ms -> 3928ms (-32%) 4278ms -> 4272ms (0%) 4823ms -> 5884ms (+22%)

da33e91 vs e7b8989 | aube/bun/pnpm | 3 scenarios | 3 runs | 500mbit/50ms | generated by Codex.

@jdx jdx merged commit 3b58f07 into main May 2, 2026
17 checks passed
@jdx jdx deleted the bench-refresh branch May 2, 2026 07:47
@greptile-apps greptile-apps Bot mentioned this pull request May 2, 2026
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@mise-en-dev @jdx