Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/157147
Note: Links to docs will display an error until the docs builds have been completed. ✅ You can merge normally! (2 Unrelated Failures)As of commit e60eb70 with merge base 8a88c6e ( FLAKY - The following job failed but was likely due to flakiness present on trunk:
UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
|
cc @kwen2501 |
|
good catch! there are 2 usage of pin_memory(device=) in fully_shard. Is it possible to remove another as well? pytorch/torch/distributed/fsdp/_fully_shard/_fsdp_param.py Lines 379 to 381 in 20e4049 note to myself: now it throws warnings if using device argument https://github.com/pytorch/pytorch/blame/20e40492b046b9287726d3ec656117e4dc38f0e2/aten/src/ATen/native/Memory.cpp#L45-L49 |
|
cc @jeejakp12 as we remove device from |
|
there is a chance of breaking 3rd party device. but according to #126376, even 3rd party device should avoid using pin_memory(device) as there are other ways in that PR |
|
approved. but probably need to wait for CI (linter etc) |
|
@pytorchmergebot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Fixes #157146
cc @H-Huang @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k