[DTensor] Add unflatten tests for multi-mesh sharding in view ops#176151
Closed
weifengpy wants to merge 56 commits intogh/weifengpy/82/basefrom
Closed
[DTensor] Add unflatten tests for multi-mesh sharding in view ops#176151weifengpy wants to merge 56 commits intogh/weifengpy/82/basefrom
weifengpy wants to merge 56 commits intogh/weifengpy/82/basefrom
Conversation
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/176151
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 8c515d4 with merge base 3edbad8 ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
weifengpy
added a commit
that referenced
this pull request
Mar 2, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: c83ff36 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 2, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: d331820 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 2, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 1f38a72 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 6516a32 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: baff1df Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 609226e Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 3d09172 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 2609eb0 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: eaf2e8e Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 3f1df1f Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 2ec6bc4 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 66a6185 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 3, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 748277b Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 3df005f Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: c9fd678 Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 8991e8d Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 99c6e12 Pull Request resolved: #176151
wconstab
approved these changes
Mar 25, 2026
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: c7f11df Pull Request resolved: #176151
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
weifengpy
added a commit
that referenced
this pull request
Mar 25, 2026
Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. ghstack-source-id: 8306adb Pull Request resolved: #176151
Contributor
Author
totally. Just did a refactor and reduced 663 LOC. from claude |
…iew ops" Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. [ghstack-poisoned]
Contributor
Author
|
@pytorchmergebot merge |
Collaborator
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Copilot AI
pushed a commit
that referenced
this pull request
Mar 27, 2026
…76151) Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. Pull Request resolved: #176151 Approved by: https://github.com/wconstab ghstack dependencies: #166483 Co-authored-by: Xia-Weiwen <12522207+Xia-Weiwen@users.noreply.github.com>
AaronWang04
pushed a commit
to AaronWang04/pytorch
that referenced
this pull request
Mar 31, 2026
…torch#176151) Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. Pull Request resolved: pytorch#176151 Approved by: https://github.com/wconstab ghstack dependencies: pytorch#166483
pytorch-bot Bot
pushed a commit
that referenced
this pull request
Apr 2, 2026
…76151) Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. Pull Request resolved: #176151 Approved by: https://github.com/wconstab ghstack dependencies: #166483
nklshy-aws
pushed a commit
to nklshy-aws/pytorch
that referenced
this pull request
Apr 7, 2026
…torch#176151) Add comprehensive tests for unflatten (view) operations with _StridedShard placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven sharding error cases, and flatten-unflatten round-trips with reversed mesh shapes. Pull Request resolved: pytorch#176151 Approved by: https://github.com/wconstab ghstack dependencies: pytorch#166483
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Stack from ghstack (oldest at bottom):
Add comprehensive tests for unflatten (view) operations with _StridedShard
placements on 1D, 2D, and 3D meshes. Tests cover all factorizations of
dimension sizes, (SS,SS), (R,SS), (R,R,SS) placement patterns, uneven
sharding error cases, and flatten-unflatten round-trips with reversed
mesh shapes.