Skip to content

don't error out in empty_cache under mempool context#158180

Merged
huydhn merged 1 commit intorelease/2.8from
cherry-pick-158152-by-pytorch_bot_bot_
Jul 14, 2025
Merged

don't error out in empty_cache under mempool context#158180
huydhn merged 1 commit intorelease/2.8from
cherry-pick-158152-by-pytorch_bot_bot_

Conversation

@pytorchbot
Copy link
Collaborator

Now instead of erroring out on empty_cache call during graph capture or under mempool context, we will just silently do nothing. This used to be the behavior for mempools, cudagraphs used to error out, but it's fine to just ignore the call.

Now instead of erroring out on `empty_cache` call during graph capture or under mempool context, we will just silently do nothing. This used to be the behavior for mempools, cudagraphs used to error out, but it's fine to just ignore the call.

Pull Request resolved: #158152
Approved by: https://github.com/zou3519, https://github.com/eqy

(cherry picked from commit 9056279)
@pytorch-bot
Copy link

pytorch-bot bot commented Jul 12, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/158180

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit f9720fb with merge base 3a7ff82 (image):

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@huydhn huydhn merged commit bd17a45 into release/2.8 Jul 14, 2025
104 of 105 checks passed
@huydhn
Copy link
Contributor

huydhn commented Aug 6, 2025

Note: This can be verified by running HF_HUB_DISABLE_XET=1 VLLM_WORKER_MULTIPROC_METHOD=spawn pytest -v -s basic_correctness/test_cumem.py on vLLM and the test should pass

@github-actions github-actions bot deleted the cherry-pick-158152-by-pytorch_bot_bot_ branch September 6, 2025 02:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants