Skip to content

Scope benchmark threshold diff to Thresholds/ directory#3529

Merged
rnro merged 2 commits intoapple:mainfrom
rnro:benchmarks_diff_only_thresholds
Feb 27, 2026
Merged

Scope benchmark threshold diff to Thresholds/ directory#3529
rnro merged 2 commits intoapple:mainfrom
rnro:benchmarks_diff_only_thresholds

Conversation

@rnro
Copy link
Copy Markdown
Contributor

@rnro rnro commented Feb 27, 2026

Motivation

  • check_benchmark_thresholds.sh runs git add --intent-to-add . and git diff HEAD to show updated threshold files when benchmarks regress.
  • The unscoped . caused the diff to include everything in the working tree, including the .build directory, producing noisy output.

Modifications

  • Pass ${benchmark_package_path}/Thresholds/ to both git add --intent-to-add and git diff HEAD -- so only threshold files appear in the diff.

Result

  • The diff printed on benchmark failure shows only threshold file changes.

Motivation

* `check_benchmark_thresholds.sh` runs `git add --intent-to-add .` and
`git diff HEAD` to show updated threshold files when benchmarks regress.
* The unscoped `.` caused the diff to include everything in the working
tree, including the `.build` directory, producing noisy output.

Modifications

* Pass `${benchmark_package_path}/Thresholds/` to both
`git add --intent-to-add` and `git diff HEAD --` so only threshold
files appear in the diff.

Result

* The diff printed on benchmark failure shows only threshold file changes.
@rnro rnro added the semver/none No version bump required. label Feb 27, 2026
@rnro rnro enabled auto-merge (squash) February 27, 2026 15:00
@rnro rnro merged commit 7940495 into apple:main Feb 27, 2026
54 of 55 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

semver/none No version bump required.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants