chore: refresh benchmarks for v1.17.1 by mise-en-dev · Pull Request #820 · jdx/aube

mise-en-dev · 2026-06-01T10:37:08Z

🤖 Refreshed benchmarks

benchmarks/results.json was pinned to aube 1.16.1; the workspace is now 1.17.1. Re-ran mise run bench:bump on the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regenerated benchmarks/results.json plus the README BENCH_RATIOS block. The benchmark matrix pins aube's GVS mode via npm_config_enable_global_virtual_store=true|false (the auto-synthesized env alias for the enableGlobalVirtualStore setting), so GitHub Actions' inherited CI=true environment does not change whether aube runs with GVS enabled or disabled.

Benchmark changes

Versions:

aube: 1.16.1 -> 1.17.1
pnpm: 11.4.0 -> 11.5.0

Public ratios: warm installs vs Bun 3x -> 5x; warm installs vs pnpm 5x -> 9x; repeat test vs Bun 4x -> 5x; repeat test vs pnpm 30x -> 38x.

Benchmark	aube	bun	deno	pnpm	npm	yarn
Fresh install (warm cache)	552ms -> 300ms (-46%)	1408ms -> 1483ms (+5%)	1648ms -> 1702ms (+3%)	2817ms -> 2628ms (-7%)	8090ms -> 6946ms (-14%)	9401ms -> 8003ms (-15%)
Fresh install (cold cache)	7028ms -> 6861ms (-2%)	5295ms -> 4896ms (-8%)	8086ms -> 7167ms (-11%)	16292ms -> 16439ms (+1%)	9718ms -> 9171ms (-6%)	12514ms -> 11806ms (-6%)
npm install && npm run test	11ms -> 9ms (-18%)	42ms -> 43ms (+2%)	77ms -> 78ms (+1%)	328ms -> 340ms (+4%)	692ms -> 701ms (+1%)	1197ms -> 1222ms (+2%)

Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.

Once merged to main, the updated bench results flow into the next release-plz-pr run automatically.

Generated by the bench-refresh workflow.

Summary by CodeRabbit

Documentation
- Updated benchmark results and performance metrics in README
- Updated tool version information (pnpm 11.5.0)
- Updated benchmark measurement data with latest statistics

coderabbitai · 2026-06-01T10:37:21Z

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro Plus

Run ID: 6f77cfb2-b91b-4c85-a688-ea703381ad5e

📥 Commits

Reviewing files that changed from the base of the PR and between 60fdeb8 and 0d351ea.

📒 Files selected for processing (2)

README.md
benchmarks/results.json

📝 Walkthrough

Walkthrough

This PR updates benchmark measurements by refreshing test results with new performance data, updating the pnpm tool version from 11.4.0 to 11.5.0, and syncing the README to report the newly measured speedup multipliers.

Changes

Benchmark Results Update

Layer / File(s)	Summary
Benchmark measurements update `benchmarks/results.json`	Timestamp updated to 2026-06-01, pnpm version advanced to 11.5.0, and all performance measurements for gvs-warm, gvs-cold, and install-test scenarios were refreshed with new timing and statistical data.
README documentation sync `README.md`	Benchmark section metrics updated to reflect the new warm-install speedup (~9x vs pnpm, ~5x vs Bun) and repeat-command speedup (up to 38x vs pnpm, up to 5x vs Bun) measurements.

🎯 1 (Trivial) | ⏱️ ~3 minutes

🐰 Fresh benchmarks hop in with pace so fleet,
Nine times warmer, cold runs beat,
pnpm marches to 11.5's beat,
Speedup numbers looking sweet! 🚀

🚥 Pre-merge checks | ✅ 5

✅ Passed checks (5 passed)

Check name	Status	Explanation
Description Check	✅ Passed	Check skipped - CodeRabbit’s high-level summary is enabled.
Title check	✅ Passed	The title clearly and specifically summarizes the main change: refreshing benchmark results for version v1.17.1, which matches the primary objective of updating benchmarks/results.json and README benchmark data.
Docstring Coverage	✅ Passed	No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check	✅ Passed	Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check	✅ Passed	Check skipped because no linked issues were found for this pull request.

_{✏️ Tip: You can configure your own custom pre-merge checks in the settings.}

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch bench-refresh

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

greptile-apps · 2026-06-01T10:38:46Z

Greptile Summary

Refreshes benchmarks/results.json and the README BENCH_RATIOS block for aube 1.17.1 (from 1.16.1) and pnpm 11.5.0 (from 11.4.0).

The warm-cache install improvement for aube is significant (552ms → 300ms, −46%); all integer values, text labels, mean/stddev, and min/max fields are internally consistent, and the README ratios (9x vs pnpm, 5x vs Bun, 38x/5x repeat test) are arithmetically correct against the new means.
No other logic, schema, or structural changes are present; this is a pure data refresh generated by the bench-refresh workflow.

Confidence Score: 5/5

Safe to merge — changes are limited to benchmark data and marketing copy, with no logic or functional code touched.

Both files are data-only. The integer values, statistical text labels, mean/stddev fields, and README ratios are all arithmetically consistent with each other. The warm-cache aube improvement (−46%) is notable but falls within what a significant release optimisation could produce, and the PR description explicitly flags it for human review before merge.

No files require special attention.

Important Files Changed

Filename	Overview
README.md	Updates BENCH_RATIOS marketing copy to reflect new benchmark results; ratios (9x vs pnpm, 5x vs Bun warm; 38x/5x repeat test) are arithmetically consistent with the new benchmark data.
benchmarks/results.json	Refreshes all benchmark measurements for aube 1.17.1 / pnpm 11.5.0; integer values, text labels, mean/stddev stats, and min/max bounds are all internally consistent across every benchmark scenario.

_{Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile}

chore: refresh benchmarks

0d351ea

jdx merged commit 62d8687 into main Jun 1, 2026
18 checks passed

jdx deleted the bench-refresh branch June 1, 2026 11:37

greptile-apps Bot mentioned this pull request Jun 1, 2026

chore: release v1.18.0 #821

Merged

BrewTestBot mentioned this pull request Jun 4, 2026

aube 1.18.0 Homebrew/homebrew-core#286316

Merged

This was referenced Jun 5, 2026

chore: refresh benchmarks for v1.18.0 #841

Merged

chore: refresh benchmarks for v1.19.0 #866

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

chore: refresh benchmarks for v1.17.1#820

chore: refresh benchmarks for v1.17.1#820
jdx merged 1 commit into
mainfrom
bench-refresh

mise-en-dev commented Jun 1, 2026 •

edited by coderabbitai Bot

Loading

Uh oh!

coderabbitai Bot commented Jun 1, 2026 •

edited

Loading

Walkthrough

Changes

Uh oh!

greptile-apps Bot commented Jun 1, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

mise-en-dev commented Jun 1, 2026 • edited by coderabbitai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🤖 Refreshed benchmarks

Benchmark changes

Summary by CodeRabbit

Uh oh!

coderabbitai Bot commented Jun 1, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Walkthrough

Changes

Uh oh!

greptile-apps Bot commented Jun 1, 2026

Greptile Summary

Confidence Score: 5/5

Important Files Changed

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

mise-en-dev commented Jun 1, 2026 •

edited by coderabbitai Bot

Loading

coderabbitai Bot commented Jun 1, 2026 •

edited

Loading