[dynamo][hop] Remove unnecessary realize_all from speculate subgraph by anijain2305 · Pull Request #176742 · pytorch/pytorch

anijain2305 · 2026-03-06T20:18:04Z

Stack from ghstack (oldest at bottom):

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @kadeng @chauhang @amjames @Lucaskabela @jataylo

[ghstack-poisoned]

pytorch-bot · 2026-03-06T20:18:09Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/176742

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki

Note: Links to docs will display an error until the docs builds have been completed.

❌ 4 New Failures, 2 Unrelated Failures

As of commit c9e90f1 with merge base e407d75 ():

NEW FAILURES - The following jobs have failed:

pull / linux-jammy-py3.10-gcc11 / test (distributed, 1, 2, lf.linux.2xlarge) (gh)
test/distributed/tensor/test_dtensor_ops.py::TestLocalDTensorOpsCPU::test_dtensor_op_db_nn_functional_poisson_nll_loss_cpu_float32
pull / linux-jammy-py3.10-gcc11 / test (distributed, 2, 2, lf.linux.2xlarge) (gh)
test/distributed/tensor/test_dtensor.py::DTensorTest::test_ops_zero_size_shards
trunk / linux-jammy-cuda13.0-py3.10-gcc11 / test (distributed, 1, 3, lf.linux.g4dn.12xlarge.nvidia.gpu) (gh)
test/distributed/tensor/test_dtensor.py::DTensorTest::test_ops_zero_size_shards
trunk / linux-jammy-rocm-py3.10 / test (distributed, 2, 3, linux.rocm.gpu.gfx950.4) (gh)
test/distributed/tensor/test_dtensor.py::DTensorTest::test_ops_zero_size_shards

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

inductor / unit-test / inductor-test / test (inductor_distributed, 1, 1, linux.g5.12xlarge.nvidia.gpu) (gh) (trunk failure)
test/distributed/_composable/fsdp/test_fully_shard_state_dict.py::TestFullyShardStateDictMultiProcess::test_dp_state_dict_save_load

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

inductor / inductor-cpu-test / test (cpu_inductor_torchbench, 1, 2, linux.2xlarge.amx, unstable) (gh) (#174929)
detectron2_maskrcnn_r_50_fpn

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot · 2026-03-06T20:18:12Z

This PR needs a `release notes:` label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

ghstack-source-id: 98cedc2 Pull Request resolved: #176742

…e subgraph" cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx kadeng chauhang amjames Lucaskabela jataylo [ghstack-poisoned]

anijain2305 · 2026-03-10T22:01:24Z

@pytorchbot merge

pytorchmergebot · 2026-03-10T22:03:43Z

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

pytorchmergebot · 2026-03-10T22:35:24Z

Merge failed

Reason: 1 mandatory check(s) failed. The first few are:

pull / linux-jammy-py3.10-gcc11 / test (distributed, 2, 2, lf.linux.2xlarge)

Dig deeper by viewing the failures on hud

Details for Dev Infra team

Raised by workflow job

Failing merge rule: Core Maintainers

anijain2305 · 2026-03-10T23:06:36Z

@pytorchbot merge -i

pytorchmergebot · 2026-03-10T23:08:57Z

Merge started

Your change will be merged while ignoring the following 3 checks: pull / linux-jammy-py3.10-gcc11 / test (distributed, 1, 2, lf.linux.2xlarge), pull / linux-jammy-py3.10-gcc11 / test (distributed, 2, 2, lf.linux.2xlarge), trunk / linux-jammy-cuda13.0-py3.10-gcc11 / test (distributed, 1, 3, lf.linux.g4dn.12xlarge.nvidia.gpu)

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

pytorchmergebot · 2026-03-11T02:11:02Z

Merge failed

Reason: 1 jobs have failed, first few of them are: trunk / linux-jammy-rocm-py3.10 / test (distributed, 2, 3, linux.rocm.gpu.gfx950.4)

Details for Dev Infra team

Raised by workflow job

anijain2305 · 2026-03-11T04:07:42Z

@pytorchbot merge -i

pytorchmergebot · 2026-03-11T04:09:49Z

Merge started

Your change will be merged while ignoring the following 6 checks: pull / linux-jammy-py3.10-gcc11 / test (distributed, 1, 2, lf.linux.2xlarge), pull / linux-jammy-py3.10-gcc11 / test (distributed, 2, 2, lf.linux.2xlarge), inductor / inductor-cpu-test / test (cpu_inductor_torchbench, 1, 2, linux.2xlarge.amx, unstable), inductor / unit-test / inductor-test / test (inductor_distributed, 1, 1, linux.g5.12xlarge.nvidia.gpu), trunk / linux-jammy-rocm-py3.10 / test (distributed, 2, 3, linux.rocm.gpu.gfx950.4), trunk / linux-jammy-cuda13.0-py3.10-gcc11 / test (distributed, 1, 3, lf.linux.g4dn.12xlarge.nvidia.gpu)

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

ghstack-source-id: f14e435 Pull Request resolved: pytorch/pytorch#176742

[dynamo][hop] Remove unnecessary realize_all from speculate subgraph

c78b4fe

[ghstack-poisoned]

anijain2305 requested review from aorenste and zou3519 as code owners March 6, 2026 20:18

This was referenced Mar 6, 2026

[dynamo] Prevent recompile on hoistable opaque objects #176643

Closed

[dynamo] Add subgraph reuse for invoke_subgraph #176644

Open

pytorch-bot bot added ciflow/inductor module: dynamo labels Mar 6, 2026

anijain2305 added a commit that referenced this pull request Mar 6, 2026

[dynamo][hop] Remove unnecessary realize_all from speculate subgraph

142cd83

ghstack-source-id: 98cedc2 Pull Request resolved: #176742

anijain2305 added 2 commits March 6, 2026 15:22

Update on "[dynamo][hop] Remove unnecessary realize_all from speculat…

fc2281c

…e subgraph" cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx kadeng chauhang amjames Lucaskabela jataylo [ghstack-poisoned]

Update on "[dynamo][hop] Remove unnecessary realize_all from speculat…

7c0b432

…e subgraph" cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx kadeng chauhang amjames Lucaskabela jataylo [ghstack-poisoned]

anijain2305 added ciflow/trunk Trigger trunk jobs on your pull request topic: not user facing topic category labels Mar 7, 2026

anijain2305 mentioned this pull request Mar 10, 2026

[dynamo] Prevent VT realization for the first arg #177078

Closed

pytorch-bot bot added the ciflow/torchtitan Run TorchTitan integration tests label Mar 10, 2026

Update on "[dynamo][hop] Remove unnecessary realize_all from speculat…

c9e90f1

…e subgraph" cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx kadeng chauhang amjames Lucaskabela jataylo [ghstack-poisoned]

zou3519 approved these changes Mar 10, 2026

View reviewed changes

pytorchmergebot added the merging label Mar 10, 2026

pytorchmergebot removed the merging label Mar 10, 2026

pytorchmergebot added the merging label Mar 10, 2026

mlazos approved these changes Mar 10, 2026

View reviewed changes

pytorchmergebot removed the merging label Mar 11, 2026

pytorchmergebot added the merging label Mar 11, 2026

pytorchmergebot closed this in 622c885 Mar 11, 2026

pytorchmergebot added Merged and removed merging labels Mar 11, 2026

sandy-gags pushed a commit to sandy-gags/pytorch that referenced this pull request Mar 12, 2026

[dynamo][hop] Remove unnecessary realize_all from speculate subgraph

51c3345

ghstack-source-id: f14e435 Pull Request resolved: pytorch/pytorch#176742

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[dynamo][hop] Remove unnecessary realize_all from speculate subgraph#176742

[dynamo][hop] Remove unnecessary realize_all from speculate subgraph#176742
anijain2305 wants to merge 4 commits intogh/anijain2305/1071/basefrom
gh/anijain2305/1071/head

anijain2305 commented Mar 6, 2026 •

edited

Loading

Uh oh!

pytorch-bot bot commented Mar 6, 2026 •

edited

Loading

Uh oh!

pytorch-bot bot commented Mar 6, 2026

Uh oh!

anijain2305 commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 10, 2026

Uh oh!

anijain2305 commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 11, 2026

Uh oh!

anijain2305 commented Mar 11, 2026

Uh oh!

pytorchmergebot commented Mar 11, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Conversation

anijain2305 commented Mar 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Mar 6, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/176742

❌ 4 New Failures, 2 Unrelated Failures

Uh oh!

pytorch-bot bot commented Mar 6, 2026

This PR needs a release notes: label

Uh oh!

anijain2305 commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 10, 2026

Merge started

Uh oh!

pytorchmergebot commented Mar 10, 2026

Merge failed

Uh oh!

anijain2305 commented Mar 10, 2026

Uh oh!

pytorchmergebot commented Mar 10, 2026

Merge started

Uh oh!

pytorchmergebot commented Mar 11, 2026

Merge failed

Uh oh!

anijain2305 commented Mar 11, 2026

Uh oh!

pytorchmergebot commented Mar 11, 2026

Merge started

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

anijain2305 commented Mar 6, 2026 •

edited

Loading

pytorch-bot bot commented Mar 6, 2026 •

edited

Loading

This PR needs a `release notes:` label