chore: refresh benchmarks for v1.16.1#808
Conversation
Greptile SummaryThis PR refreshes benchmark data from aube 1.16.0 to 1.16.1, also picking up deno 2.8.1 and pnpm 11.4.0, and updates the
Confidence Score: 4/5Safe to merge after deciding whether to round the Bun warm-install ratio to 2.5× or keep 3×; benchmark JSON data is internally consistent. The only discrepancy is that the README still claims "about 3× faster than Bun" for warm installs when the actual measured ratio has slipped to ~2.55×. Everything else — version strings, integer values, and underlying stats — cross-checks correctly. README.md — specifically the BENCH_RATIOS Bun warm-install ratio claim. Important Files Changed
Reviews (1): Last reviewed commit: "chore: refresh benchmarks" | Re-trigger Greptile |
|
|
||
| <!-- BENCH_RATIOS:START --> | ||
| **[Fast installs](https://aube.en.dev/benchmarks).** Warm installs are about 7x faster than pnpm and about 3x faster than Bun in the current benchmarks. Repeat test commands run up to 32x faster than pnpm and up to 4x faster than Bun. | ||
| **[Fast installs](https://aube.en.dev/benchmarks).** Warm installs are about 5x faster than pnpm and about 3x faster than Bun in the current benchmarks. Repeat test commands run up to 30x faster than pnpm and up to 4x faster than Bun. |
There was a problem hiding this comment.
The new warm-install ratio against Bun is 1408 / 552 ≈ 2.55×, which rounds more naturally to "about 2.5×" or "almost 3×". The previous run (1384 / 420 ≈ 3.3×) genuinely rounded to "3×", but keeping "about 3×" at 2.55× overstates the advantage by roughly 18%.
| **[Fast installs](https://aube.en.dev/benchmarks).** Warm installs are about 5x faster than pnpm and about 3x faster than Bun in the current benchmarks. Repeat test commands run up to 30x faster than pnpm and up to 4x faster than Bun. | |
| **[Fast installs](https://aube.en.dev/benchmarks).** Warm installs are about 5x faster than pnpm and about 2.5x faster than Bun in the current benchmarks. Repeat test commands run up to 30x faster than pnpm and up to 4x faster than Bun. |
Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!
🤖 Refreshed benchmarks
benchmarks/results.jsonwas pinned to aube1.16.0; the workspace is now1.16.1. Re-ranmise run bench:bumpon the hermetic Verdaccio registry (500mbit / 50ms per the mise task) and regeneratedbenchmarks/results.jsonplus the READMEBENCH_RATIOSblock. The benchmark matrix pins aube's GVS mode vianpm_config_enable_global_virtual_store=true|false(the auto-synthesized env alias for theenableGlobalVirtualStoresetting), so GitHub Actions' inheritedCI=trueenvironment does not change whether aube runs with GVS enabled or disabled.Benchmark changes
Versions:
Public ratios: warm installs vs Bun 3x -> 3x; warm installs vs pnpm 7x -> 5x; repeat test vs Bun 4x -> 4x; repeat test vs pnpm 32x -> 30x.
Review the numbers before merging — if anything looks wildly off vs. the previous release, investigate before landing. Hermetic proxy jitter or an npmjs uplink hiccup can occasionally skew results.
Once merged to main, the updated bench results flow into the next
release-plz-prrun automatically.Generated by the
bench-refreshworkflow.