Conversation
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 711ab79fbb
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
There was a problem hiding this comment.
Pull request overview
This PR aims to validate uv immediately after it’s installed/downloaded so that runtime incompatibility (e.g., libc / dynamic loader mismatches) is detected early and reported with a clearer error.
Changes:
- Adds a post-install validation step to ensure the installed
uvbinary is executable and within the required version range. - Expands the inline comment and user-facing error message to better explain runtime incompatibility causes.
📦 Cargo Bloat ComparisonBinary size change: +0.00% (24.8 MiB → 24.8 MiB) Expand for cargo-bloat outputHead Branch ResultsBase Branch Results |
⚡️ Hyperfine BenchmarksSummary: 0 regressions, 0 improvements above the 10% threshold. Environment
CLI CommandsBenchmarking basic commands in the main repo:
|
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base --version |
2.5 ± 0.1 | 2.3 | 2.9 | 1.01 ± 0.06 |
prek-head --version |
2.5 ± 0.1 | 2.3 | 3.0 | 1.00 |
prek list
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base list |
9.2 ± 0.1 | 9.0 | 9.7 | 1.00 |
prek-head list |
9.4 ± 0.2 | 9.1 | 10.0 | 1.02 ± 0.02 |
prek validate-config .pre-commit-config.yaml
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base validate-config .pre-commit-config.yaml |
3.2 ± 0.1 | 3.1 | 3.4 | 1.02 ± 0.03 |
prek-head validate-config .pre-commit-config.yaml |
3.2 ± 0.1 | 3.1 | 3.3 | 1.00 |
prek sample-config
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base sample-config |
3.0 ± 0.3 | 2.7 | 3.5 | 1.07 ± 0.12 |
prek-head sample-config |
2.8 ± 0.2 | 2.6 | 3.4 | 1.00 |
Cold vs Warm Runs
Comparing first run (cold) vs subsequent runs (warm cache):
prek run --all-files (cold - no cache)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run --all-files |
161.3 ± 1.8 | 158.7 | 164.6 | 1.00 |
prek-head run --all-files |
164.4 ± 3.6 | 159.7 | 170.7 | 1.02 ± 0.02 |
prek run --all-files (warm - with cache)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run --all-files |
160.2 ± 3.6 | 155.1 | 167.0 | 1.00 |
prek-head run --all-files |
162.6 ± 3.8 | 156.7 | 171.0 | 1.02 ± 0.03 |
Full Hook Suite
Running the builtin hook suite on the benchmark workspace:
prek run --all-files (full builtin hook suite)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run --all-files |
162.9 ± 3.7 | 157.8 | 175.5 | 1.00 |
prek-head run --all-files |
168.7 ± 21.7 | 158.2 | 303.9 | 1.04 ± 0.14 |
Individual Hook Performance
Benchmarking each hook individually on the test repo:
prek run trailing-whitespace --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run trailing-whitespace --all-files |
23.4 ± 0.4 | 22.5 | 24.4 | 1.01 ± 0.03 |
prek-head run trailing-whitespace --all-files |
23.3 ± 0.6 | 22.4 | 25.3 | 1.00 |
prek run end-of-file-fixer --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run end-of-file-fixer --all-files |
30.2 ± 2.2 | 26.8 | 34.2 | 1.00 |
prek-head run end-of-file-fixer --all-files |
30.4 ± 2.1 | 27.0 | 35.3 | 1.01 ± 0.10 |
prek run check-json --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-json --all-files |
13.2 ± 0.5 | 12.3 | 14.2 | 1.04 ± 0.05 |
prek-head run check-json --all-files |
12.6 ± 0.3 | 12.1 | 13.3 | 1.00 |
prek run check-yaml --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-yaml --all-files |
12.7 ± 0.3 | 12.2 | 13.8 | 1.01 ± 0.03 |
prek-head run check-yaml --all-files |
12.6 ± 0.3 | 12.1 | 13.2 | 1.00 |
prek run check-toml --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-toml --all-files |
12.9 ± 0.4 | 12.2 | 13.8 | 1.00 |
prek-head run check-toml --all-files |
13.0 ± 0.3 | 12.5 | 13.6 | 1.00 ± 0.04 |
prek run check-xml --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-xml --all-files |
13.1 ± 0.4 | 12.4 | 14.2 | 1.01 ± 0.04 |
prek-head run check-xml --all-files |
13.0 ± 0.3 | 12.5 | 13.8 | 1.00 |
prek run detect-private-key --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run detect-private-key --all-files |
20.4 ± 1.8 | 18.1 | 26.1 | 1.02 ± 0.12 |
prek-head run detect-private-key --all-files |
20.1 ± 1.6 | 17.6 | 23.2 | 1.00 |
prek run fix-byte-order-marker --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run fix-byte-order-marker --all-files |
26.1 ± 1.8 | 22.8 | 29.3 | 1.02 ± 0.11 |
prek-head run fix-byte-order-marker --all-files |
25.5 ± 2.0 | 22.0 | 29.1 | 1.00 |
Installation Performance
Benchmarking hook installation (fast path hooks skip Python setup):
prek install-hooks (cold - no cache)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base install-hooks |
5.2 ± 0.1 | 5.1 | 5.3 | 1.01 ± 0.02 |
prek-head install-hooks |
5.1 ± 0.1 | 5.0 | 5.2 | 1.00 |
prek install-hooks (warm - with cache)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base install-hooks |
5.1 ± 0.1 | 5.0 | 5.1 | 1.00 |
prek-head install-hooks |
5.2 ± 0.1 | 5.1 | 5.3 | 1.03 ± 0.02 |
File Filtering/Scoping Performance
Testing different file selection modes:
prek run (staged files only)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run |
54.6 ± 1.0 | 53.3 | 56.4 | 1.00 |
prek-head run |
55.6 ± 1.3 | 53.7 | 58.2 | 1.02 ± 0.03 |
prek run --files '*.json' (specific file type)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run --files '*.json' |
9.6 ± 0.1 | 9.4 | 9.9 | 1.00 ± 0.02 |
prek-head run --files '*.json' |
9.6 ± 0.1 | 9.4 | 9.7 | 1.00 |
Workspace Discovery & Initialization
Benchmarking hook discovery and initialization overhead:
prek run --dry-run --all-files (measures init overhead)
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run --dry-run --all-files |
15.0 ± 0.2 | 14.6 | 15.6 | 1.00 |
prek-head run --dry-run --all-files |
15.4 ± 1.7 | 14.6 | 22.6 | 1.02 ± 0.12 |
Meta Hooks Performance
Benchmarking meta hooks separately:
prek run check-hooks-apply --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-hooks-apply --all-files |
15.0 ± 0.3 | 14.6 | 15.8 | 1.10 ± 0.06 |
prek-head run check-hooks-apply --all-files |
13.6 ± 0.6 | 13.1 | 14.8 | 1.00 |
prek run check-useless-excludes --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run check-useless-excludes --all-files |
13.2 ± 0.2 | 12.9 | 13.5 | 1.00 |
prek-head run check-useless-excludes --all-files |
13.3 ± 0.3 | 12.9 | 13.7 | 1.00 ± 0.02 |
prek run identity --all-files
| Command | Mean [ms] | Min [ms] | Max [ms] | Relative |
|---|---|---|---|---|
prek-base run identity --all-files |
11.5 ± 0.1 | 11.3 | 11.7 | 1.00 |
prek-head run identity --all-files |
11.6 ± 0.3 | 11.2 | 12.4 | 1.01 ± 0.03 |
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## master #1825 +/- ##
==========================================
- Coverage 91.72% 91.71% -0.01%
==========================================
Files 98 98
Lines 20063 20067 +4
==========================================
+ Hits 18403 18405 +2
- Misses 1660 1662 +2 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Pull request overview
This PR improves the Python/uv toolchain bootstrap in prek by validating the managed uv binary immediately after installation, so incompatibilities (e.g., libc/loader mismatches) fail early with a clearer, actionable error message (addresses #1707).
Changes:
- Validate the managed
uvbinary right after installation and emit a detailed failure message if it can’t execute or doesn’t meet the version range. - Minor refactor in platform-tag conversion (
ToString::to_string).
uv binary after download
Validate downloaded or installed uv binaries immediately after installation, to surface a clear message early.
For #1707