Skip to content

Add option to disable rewriting index hints in default global save plan#105861

Closed
jonb377 wants to merge 1 commit intopytorch:mainfrom
jonb377:jonbolin-index-hints
Closed

Add option to disable rewriting index hints in default global save plan#105861
jonb377 wants to merge 1 commit intopytorch:mainfrom
jonb377:jonbolin-index-hints

Conversation

@jonb377
Copy link
Copy Markdown
Contributor

@jonb377 jonb377 commented Jul 24, 2023

With distributed checkpointing in PyTorch/XLA SPMD, the WriteItem index hints should not be modified when creating the global plan. In order to reuse the default planner logic for checkpoint metadata creation, we need to make the behavior of rewriting index hints optional.

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot Bot commented Jul 24, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/105861

Note: Links to docs will display an error until the docs builds have been completed.

✅ 4 Unrelated Failures

As of commit 1b91c71:

UNSTABLE - The following jobs failed but were likely due to flakiness present on trunk and has been marked as unstable:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@linux-foundation-easycla
Copy link
Copy Markdown

linux-foundation-easycla Bot commented Jul 24, 2023

CLA Signed

The committers listed above are authorized under a signed CLA.

@jonb377
Copy link
Copy Markdown
Contributor Author

jonb377 commented Jul 24, 2023

@pytorchbot label "topic: not user facing"

Copy link
Copy Markdown
Contributor

@kumpera kumpera left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the contribution.

@jonb377
Copy link
Copy Markdown
Contributor Author

jonb377 commented Jul 25, 2023

@pytorchbot merge

@pytorch-bot pytorch-bot Bot added the ciflow/trunk Trigger trunk jobs on your pull request label Jul 25, 2023
@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@kumpera
Copy link
Copy Markdown
Contributor

kumpera commented Jul 25, 2023

@pytorchmergebot merge -f "failures are not related"

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Can't merge closed PR #105861

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged open source topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants