Skip to content

gc before warming up benchmarking#159670

Closed
aorenste wants to merge 1 commit intogh/aorenste/238/basefrom
gh/aorenste/238/head
Closed

gc before warming up benchmarking#159670
aorenste wants to merge 1 commit intogh/aorenste/238/basefrom
gh/aorenste/238/head

Conversation

@aorenste
Copy link
Contributor

@aorenste aorenste commented Aug 1, 2025

#158649 turned off automatic GCs during cudagraph recording. This is causing a small uptick in some internal benchmark numbers because of memory the benchmark is leaving around before the benchmark starts - so GC before warming up the model.

Stack from ghstack (oldest at bottom):

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang @amjames @Lucaskabela

[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Aug 1, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/159670

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit 1db924a with merge base 8ea86a6 (image):

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

aorenste added a commit that referenced this pull request Aug 1, 2025
ghstack-source-id: b432825
Pull Request resolved: #159670
@aorenste aorenste added the topic: not user facing topic category label Aug 1, 2025
@aorenste aorenste changed the title gc before benchmarking gc before warming up benchmarking Aug 1, 2025
@aorenste aorenste marked this pull request as ready for review August 2, 2025 16:25
@aorenste
Copy link
Contributor Author

aorenste commented Aug 2, 2025

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Aug 2, 2025
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

facebook-github-bot pushed a commit to pytorch/benchmark that referenced this pull request Aug 4, 2025
Summary:
#158649 turned off automatic GCs during cudagraph recording. This is causing a small uptick in some internal benchmark numbers because of memory the benchmark is leaving around before the benchmark starts - so GC before warming up the model.

X-link: pytorch/pytorch#159670
Approved by: https://github.com/oulgen

Reviewed By: izaitsevfb, yangw-dev

Differential Revision: D79534767

fbshipit-source-id: 2eee7562810be2082e7d11cb4104557903a8e1a8
@github-actions github-actions bot deleted the gh/aorenste/238/head branch September 2, 2025 02:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants