Skip to content

dist: add list_keys to Store API#167883

Closed
d4l3k wants to merge 1 commit intomainfrom
d4l3k/store_list
Closed

dist: add list_keys to Store API#167883
d4l3k wants to merge 1 commit intomainfrom
d4l3k/store_list

Conversation

@d4l3k
Copy link
Member

@d4l3k d4l3k commented Nov 14, 2025

This adds a list Store API and implements it for all backends.

This is intended to be used for debugging and will allow inspecting all keys in a store locally as well as remotely in the case of TCPStore.

Test plan:

pytest test/distributed/test_store.py

cc @H-Huang @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @pragupta @msaroufim @dcci

@d4l3k d4l3k requested a review from fduwjj November 14, 2025 22:53
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 14, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/167883

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 947c093 with merge base a6b6383 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added oncall: distributed Add this issue/PR to distributed oncall triage queue release notes: distributed (c10d) release notes category and removed oncall: distributed Add this issue/PR to distributed oncall triage queue labels Nov 14, 2025
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 14, 2025

The label oncall: distributed is only applicable to issues and has been removed. Please only use this label on issues.

@pytorch-bot pytorch-bot bot added oncall: distributed Add this issue/PR to distributed oncall triage queue and removed oncall: distributed Add this issue/PR to distributed oncall triage queue labels Nov 14, 2025
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 14, 2025

The label oncall: distributed is only applicable to issues and has been removed. Please only use this label on issues.

Copy link
Contributor

@fduwjj fduwjj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The implementation and rationale sounds good to me. But I just have a QQ here. Do we want to call like key_list? I feel the name list is a bit vague to me. WDYT?

@pytorch-bot pytorch-bot bot added oncall: distributed Add this issue/PR to distributed oncall triage queue and removed oncall: distributed Add this issue/PR to distributed oncall triage queue labels Nov 17, 2025
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 17, 2025

The label oncall: distributed is only applicable to issues and has been removed. Please only use this label on issues.

@d4l3k d4l3k requested a review from fduwjj November 17, 2025 17:59
@d4l3k d4l3k changed the title dist: add list to Store API dist: add list_keys to Store API Nov 17, 2025
@pytorch-bot pytorch-bot bot added oncall: distributed Add this issue/PR to distributed oncall triage queue and removed oncall: distributed Add this issue/PR to distributed oncall triage queue labels Nov 17, 2025
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 17, 2025

The label oncall: distributed is only applicable to issues and has been removed. Please only use this label on issues.

@fduwjj fduwjj added the ciflow/trunk Trigger trunk jobs on your pull request label Nov 17, 2025
@fduwjj
Copy link
Contributor

fduwjj commented Nov 17, 2025

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

Stonepia pushed a commit to Stonepia/pytorch that referenced this pull request Nov 18, 2025
This adds a `list` Store API and implements it for all backends.

This is intended to be used for debugging and will allow inspecting all keys in a store locally as well as remotely in the case of TCPStore.

Test plan:

```
pytest test/distributed/test_store.py
```

Pull Request resolved: pytorch#167883
Approved by: https://github.com/fduwjj
@pytorchmergebot
Copy link
Collaborator

This PR (#167883) was merged in ef7fa96 but it is still open, likely due to a Github bug, so mergebot is closing it manually. If you think this is a mistake, please feel free to reopen and contact Dev Infra.

@d4l3k d4l3k deleted the d4l3k/store_list branch November 18, 2025 15:44
@pytorchmergebot pytorchmergebot added the ci-no-td Do not run TD on this PR label Nov 20, 2025
@d4l3k d4l3k restored the d4l3k/store_list branch November 20, 2025 16:28
@d4l3k d4l3k reopened this Nov 20, 2025
@meta-codesync
Copy link

meta-codesync bot commented Nov 20, 2025

@d4l3k has imported this pull request. If you are a Meta employee, you can view this in D87552563.

@facebook-github-bot
Copy link
Contributor

@pytorchbot merge

(Initiating merge automatically since Phabricator Diff has merged)

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@yangw-dev
Copy link
Contributor

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@yangw-dev
Copy link
Contributor

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: 1 jobs have failed, first few of them are: Meta Internal-Only Changes Check

Details for Dev Infra team Raised by workflow job

@yangw-dev
Copy link
Contributor

@pytorchbot merge -i

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged while ignoring the following 1 checks: Meta Internal-Only Changes Check

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@d4l3k d4l3k deleted the d4l3k/store_list branch November 21, 2025 15:09
JacobSzwejbka pushed a commit that referenced this pull request Dec 8, 2025
This reverts commit ef7fa96.

Reverted #167883 on behalf of https://github.com/yangw-dev due to break some internal test,  error: use of undeclared identifier, reached out author but no resp, so revert this to keep diff train hygiene ([comment](#167883 (comment)))
JacobSzwejbka pushed a commit that referenced this pull request Dec 8, 2025
This adds a `list` Store API and implements it for all backends.

This is intended to be used for debugging and will allow inspecting all keys in a store locally as well as remotely in the case of TCPStore.

Test plan:

```
pytest test/distributed/test_store.py
```

Pull Request resolved: #167883
Approved by: https://github.com/fduwjj
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-no-td Do not run TD on this PR ciflow/trunk Trigger trunk jobs on your pull request Merged release notes: distributed (c10d) release notes category Reverted

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants