Skip to content

[red-knot] preparse builtins in without_parse benchmark#12395

Merged
MichaReiser merged 2 commits intomainfrom
cjm/bench-preparse-builtins
Jul 19, 2024
Merged

[red-knot] preparse builtins in without_parse benchmark#12395
MichaReiser merged 2 commits intomainfrom
cjm/bench-preparse-builtins

Conversation

@carljm
Copy link
Copy Markdown
Contributor

@carljm carljm commented Jul 18, 2024

In preparation for adding builtins support in #12390, we should pre-parse builtins also in the without_parse benchmark, so the builtins-parsing time is not included.

The "cold" benchmark should include everything, so it doesn't need to be modified.

The "incremental" benchmark should already exclude parsing builtins (unless we have a bug that causes it to be re-parsed even when it hasn't changed, which we'd want this benchmark to catch.)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jul 18, 2024

ruff-ecosystem results

Linter (stable)

✅ ecosystem check detected no linter changes.

Linter (preview)

✅ ecosystem check detected no linter changes.

@MichaReiser MichaReiser enabled auto-merge (squash) July 19, 2024 05:58
@MichaReiser MichaReiser merged commit a62e2d2 into main Jul 19, 2024
@MichaReiser MichaReiser deleted the cjm/bench-preparse-builtins branch July 19, 2024 05:58
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Jul 19, 2024

CodSpeed Performance Report

Merging #12395 will not alter performance

Comparing cjm/bench-preparse-builtins (95404a4) with cjm/bench-preparse-builtins (93cf6b5)

Summary

✅ 31 untouched benchmarks

🆕 2 new benchmarks
⁉️ 2 dropped benchmarks

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Benchmarks breakdown

Benchmark cjm/bench-preparse-builtins cjm/bench-preparse-builtins Change
🆕 red_knot_check_file[cold] N/A 346.4 µs N/A
⁉️ red_knot_check_file[without_parse] 257 µs N/A N/A
⁉️ red_knot_check_file[cold] 343.9 µs N/A N/A
🆕 red_knot_check_file[without_parse] N/A 257.3 µs N/A

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ty Multi-file analysis & type inference

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants