Skip to content

[Re-land] [Helion + torch.compile] Refactor TemplateBuffer as extensible base class#177367

Closed
yf225 wants to merge 3 commits intogh/yf225/141/basefrom
gh/yf225/141/head
Closed

[Re-land] [Helion + torch.compile] Refactor TemplateBuffer as extensible base class#177367
yf225 wants to merge 3 commits intogh/yf225/141/basefrom
gh/yf225/141/head

Conversation

@yf225
Copy link
Copy Markdown
Contributor

@yf225 yf225 commented Mar 13, 2026

Stack from ghstack (oldest at bottom):

This is a reland of #177063.

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

  • Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.init
  • Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
  • Move get_allowed_prologue_inps() to base class
  • Extract _read_deps_from_inputs() helper from extract_read_writes()
  • Remove can_fuse_multi_output_epilogue() (always returned False, unused)
  • Simplify TritonTemplateBuffer.init() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @kadeng @muchulee8 @amjames @chauhang @aakhundov @coconutruben @jataylo

…lass

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

[ghstack-poisoned]
@pytorch-bot
Copy link
Copy Markdown

pytorch-bot bot commented Mar 13, 2026

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/177367

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit 16b0092 with merge base e0818d6 (image):

UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot bot commented Mar 13, 2026

This PR needs a release notes: label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

…ible base class"

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy kadeng muchulee8 amjames chauhang aakhundov coconutruben jataylo

[ghstack-poisoned]
yf225 added a commit that referenced this pull request Mar 13, 2026
…lass

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

ghstack-source-id: 38e5ed8
Pull Request resolved: #177367
…ible base class"

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx ipiszy kadeng muchulee8 amjames chauhang aakhundov coconutruben jataylo

[ghstack-poisoned]
@yf225 yf225 added the topic: not user facing topic category label Mar 13, 2026
@yf225 yf225 requested review from jansel and shunting314 March 13, 2026 19:15
@yf225 yf225 changed the title [Helion + torch.compile] Refactor TemplateBuffer as extensible base class [Reland] [Helion + torch.compile] Refactor TemplateBuffer as extensible base class Mar 13, 2026
@pytorch-bot pytorch-bot bot added the ci-no-td Do not run TD on this PR label Mar 13, 2026
@yf225 yf225 changed the title [Reland] [Helion + torch.compile] Refactor TemplateBuffer as extensible base class [Re-land] [Helion + torch.compile] Refactor TemplateBuffer as extensible base class Mar 13, 2026
@yf225
Copy link
Copy Markdown
Contributor Author

yf225 commented Mar 13, 2026

@pytorchbot merge -f "unrelated failures"

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

AaronWang04 pushed a commit to AaronWang04/pytorch that referenced this pull request Mar 24, 2026
…ble base class (pytorch#177367)

This is a reland of pytorch#177063.

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

Pull Request resolved: pytorch#177367
Approved by: https://github.com/shunting314
ghstack dependencies: pytorch#177302
EmanueleCoradin pushed a commit to EmanueleCoradin/pytorch that referenced this pull request Mar 30, 2026
…ble base class (pytorch#177367)

This is a reland of pytorch#177063.

Move common fields and methods from TritonTemplateBuffer up to
TemplateBuffer so that external template backends (e.g. Helion) can
reuse the same mutation-tracking and prologue-fusion infrastructure:

- Add mutated_inputs, allowed_prologue_inps params to TemplateBuffer.__init__
- Build mutation_outputs list in base class (parallel to ExternKernel.mutation_outputs)
- Move get_allowed_prologue_inps() to base class
- Extract _read_deps_from_inputs() helper from extract_read_writes()
- Remove can_fuse_multi_output_epilogue() (always returned False, unused)
- Simplify TritonTemplateBuffer.__init__() to delegate to super()

get_outputs() stays on TritonTemplateBuffer since it is the only
subclass that currently passes mutated_inputs; other subclasses
(CppTemplateBuffer, CuteDSLTemplateBuffer, etc.) manage their own
output lists independently.

Pull Request resolved: pytorch#177367
Approved by: https://github.com/shunting314
ghstack dependencies: pytorch#177302
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-no-td Do not run TD on this PR ciflow/inductor ciflow/torchtitan Run TorchTitan integration tests Merged module: inductor topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants