[CD][CUDA13][PTXAS] Remove ptxas bundle from PyTorch cu13 Binary by nWEIdia · Pull Request #174716 · pytorch/pytorch

nWEIdia · 2026-02-10T21:11:20Z

The ptxas bundling was introduced in #163988 to workaround issues users may face due to #163801

Fortunately, on the triton upstream side, triton-lang/triton@884fdae finally landed, which is means #163801 is permanently fixed.

In addition, pytorch's triton commit pin has been updated via #178821

We can now roll back #163801 .

In between, we unified the arm sbsa build with x86, so revert won't work. Manually reverting the export.

Test plan: download and check the binary size to confirm 1) ptxas is gone from both x86 and sbsa (even though I only added to sbsa cu13 initially) 2) unit test that ran on #163988 should still pass.

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @kadeng @muchulee8 @amjames @chauhang @aakhundov @coconutruben @jataylo @eqy @ptrblck @tinglvv @malfet @atalman

pytorch-bot · 2026-02-10T21:11:24Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/174716

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

Rolling out OSDC (ARC) runners on pull & trunk workflows in PyTorch main

❌ 7 Cancelled Jobs

As of commit 55f4526 with merge base 1aa5e36 ():

CANCELLED JOBS - The following jobs were cancelled. Please retry:

linux-s390x-binary-manywheel / manywheel-py3_10-cpu-s390x-build / build (gh)
##[error]The operation was canceled.
linux-s390x-binary-manywheel / manywheel-py3_11-cpu-s390x-build / build (gh)
##[error]The operation was canceled.
linux-s390x-binary-manywheel / manywheel-py3_12-cpu-s390x-build / build (gh)
linux-s390x-binary-manywheel / manywheel-py3_13-cpu-s390x-build / build (gh)
##[error]The operation was canceled.
linux-s390x-binary-manywheel / manywheel-py3_13t-cpu-s390x-build / build (gh)
linux-s390x-binary-manywheel / manywheel-py3_14-cpu-s390x-test / test (gh)
linux-s390x-binary-manywheel / manywheel-py3_14t-cpu-s390x-build / build (gh)

This comment was automatically generated by Dr. CI and updates every 15 minutes.

pytorch-bot · 2026-02-10T21:11:27Z

This PR needs a `release notes:` label

If your changes are user facing and intended to be a part of release notes, please use a label starting with release notes:.

If not, please add the topic: not user facing label.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "topic: not user facing"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

nWEIdia · 2026-02-10T21:15:44Z

Two follow-ups needed:

pytorch is switching to the triton commit that uses ptxas from cu13.1
in between the triton introduced the TRITON_PTXAS_BLACKWELL_PATH, which this compiler.py is not aware of.

nWEIdia · 2026-03-30T23:18:10Z

@pytorchbot rebase

pytorchmergebot · 2026-03-30T23:19:52Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

pytorchmergebot · 2026-03-30T23:19:56Z

Successfully rebased main-revert-ptxas-cu13-bundle onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout main-revert-ptxas-cu13-bundle && git pull --rebase)

nWEIdia · 2026-03-31T18:01:54Z

@pytorchbot rebase

pytorchmergebot · 2026-03-31T18:03:59Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

pytorchmergebot · 2026-03-31T18:04:23Z

Successfully rebased main-revert-ptxas-cu13-bundle onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout main-revert-ptxas-cu13-bundle && git pull --rebase)

nWEIdia · 2026-04-02T20:10:48Z

@pytorchbot rebase

pytorchmergebot · 2026-04-02T20:12:38Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

pytorchmergebot · 2026-04-02T20:12:41Z

Successfully rebased main-revert-ptxas-cu13-bundle onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout main-revert-ptxas-cu13-bundle && git pull --rebase)

atalman

lgtm

nWEIdia · 2026-04-21T23:34:57Z

@pytorchbot rebase

pytorchmergebot · 2026-04-21T23:36:39Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

pytorchmergebot · 2026-04-21T23:36:43Z

Successfully rebased main-revert-ptxas-cu13-bundle onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout main-revert-ptxas-cu13-bundle && git pull --rebase)

nWEIdia · 2026-04-21T23:44:04Z

The follow up question is:
would any pytorch unit test on any platform (most likely dgx spark and THOR) require to invoke ptxas-blackwell binary ? As it currently stands (after merging this PR), they would only get the ptxas binary, which is

""ptxas": "12.9.86"

nWEIdia · 2026-04-22T01:20:35Z

Previously without bundled ptxas, dgx spark or Thor users do not have a convenient way of getting ptxas (since triton did not ship a cuda 13.1 ptxas as it current does), so the bundled ptxas -- for people who know, would be a last resort to solve the problem without installing CTK.

Now, even when the PyTorch code (compile_task.py) only uses ptxas (not ptxas-blackwell in triton terminology), advanced users can still manually rename ptxas-blackwell.

nWEIdia · 2026-04-22T19:10:55Z

@pytorchbot rebase

pytorchmergebot · 2026-04-22T19:12:45Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

12.9), which fixes pytorch#163801 permanently. Reverting the bundling of ptxas, as even without ctk, users could get it from simply pip installing triton.

pytorchmergebot · 2026-04-22T19:12:49Z

Successfully rebased main-revert-ptxas-cu13-bundle onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout main-revert-ptxas-cu13-bundle && git pull --rebase)

nWEIdia · 2026-04-23T04:17:48Z

@pytorchbot merge

pytorchmergebot · 2026-04-23T04:20:04Z

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

pytorchmergebot · 2026-04-23T05:18:48Z

Merge failed

Reason: 7 jobs have failed, first few of them are: linux-s390x-binary-manywheel / manywheel-py3_13-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_11-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_10-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_13t-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_12-cpu-s390x-build / build

Details for Dev Infra team

Raised by workflow job

nWEIdia · 2026-04-23T21:16:09Z

@pytorchbot merge

pytorchmergebot · 2026-04-23T21:18:36Z

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

pytorchmergebot · 2026-04-23T21:18:57Z

Merge failed

Reason: 7 jobs have failed, first few of them are: linux-s390x-binary-manywheel / manywheel-py3_13-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_11-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_10-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_13t-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_12-cpu-s390x-build / build

Details for Dev Infra team

Raised by workflow job

nWEIdia · 2026-04-23T21:19:32Z

@pytorchbot merge -i

pytorchmergebot · 2026-04-23T21:21:46Z

Merge started

Your change will be merged while ignoring the following 7 checks: linux-s390x-binary-manywheel / manywheel-py3_13-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_11-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_10-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_13t-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_12-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_14t-cpu-s390x-build / build, linux-s390x-binary-manywheel / manywheel-py3_14-cpu-s390x-test / test

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

nWEIdia requested a review from a team as a code owner February 10, 2026 21:11

pytorch-bot Bot added ciflow/inductor module: inductor labels Feb 10, 2026

nWEIdia added ciflow/binaries Trigger all binary build and upload jobs on the PR release notes: build release notes category labels Feb 10, 2026

pytorchbot added the open source label Feb 10, 2026

bdhirsh requested a review from tinglvv February 10, 2026 23:20

bdhirsh added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Feb 10, 2026

tinglvv approved these changes Feb 10, 2026

View reviewed changes

pytorchmergebot force-pushed the main-revert-ptxas-cu13-bundle branch from 4028921 to 84e3531 Compare March 30, 2026 23:19

pytorch-bot Bot added the ciflow/torchtitan Run TorchTitan integration tests label Mar 30, 2026

pytorchmergebot force-pushed the main-revert-ptxas-cu13-bundle branch from 84e3531 to 1935092 Compare March 31, 2026 18:04

pytorchmergebot force-pushed the main-revert-ptxas-cu13-bundle branch from 1935092 to 786e656 Compare April 2, 2026 20:12

nWEIdia requested review from atalman and malfet April 5, 2026 02:55

atalman approved these changes Apr 21, 2026

View reviewed changes

pytorchmergebot force-pushed the main-revert-ptxas-cu13-bundle branch from 786e656 to 8abcbd1 Compare April 21, 2026 23:36

nWEIdia added 2 commits April 22, 2026 19:12

[CD][CUDA][PTXAS] Triton from main now ships ptxas 13.1 (upgrade from

26c2f2c

12.9), which fixes pytorch#163801 permanently. Reverting the bundling of ptxas, as even without ctk, users could get it from simply pip installing triton.

Remove the variable export.

55f4526

pytorchmergebot force-pushed the main-revert-ptxas-cu13-bundle branch from 8abcbd1 to 55f4526 Compare April 22, 2026 19:12

pytorch-bot Bot added the ciflow/trunk Trigger trunk jobs on your pull request label Apr 23, 2026

pytorchmergebot added the merging label Apr 23, 2026

pytorchmergebot removed the merging label Apr 23, 2026

pytorchmergebot added the merging label Apr 23, 2026

pytorchmergebot removed the merging label Apr 23, 2026

pytorchmergebot added the merging label Apr 23, 2026

pytorchmergebot added the Merged label Apr 23, 2026

pytorchmergebot closed this in ccd5b41 Apr 23, 2026

pytorchmergebot removed the merging label Apr 23, 2026

Conversation

nWEIdia commented Feb 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot Bot commented Feb 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/174716

❗ 1 Active SEVs

❌ 7 Cancelled Jobs

Uh oh!

pytorch-bot Bot commented Feb 10, 2026

This PR needs a release notes: label

Uh oh!

nWEIdia commented Feb 10, 2026

Uh oh!

nWEIdia commented Mar 30, 2026

Uh oh!

pytorchmergebot commented Mar 30, 2026

Uh oh!

pytorchmergebot commented Mar 30, 2026

Uh oh!

nWEIdia commented Mar 31, 2026

Uh oh!

pytorchmergebot commented Mar 31, 2026

Uh oh!

pytorchmergebot commented Mar 31, 2026

Uh oh!

nWEIdia commented Apr 2, 2026

Uh oh!

pytorchmergebot commented Apr 2, 2026

Uh oh!

pytorchmergebot commented Apr 2, 2026

Uh oh!

atalman left a comment

Choose a reason for hiding this comment

Uh oh!

nWEIdia commented Apr 21, 2026

Uh oh!

pytorchmergebot commented Apr 21, 2026

Uh oh!

pytorchmergebot commented Apr 21, 2026

Uh oh!

nWEIdia commented Apr 21, 2026

Uh oh!

nWEIdia commented Apr 22, 2026

Uh oh!

nWEIdia commented Apr 22, 2026

Uh oh!

pytorchmergebot commented Apr 22, 2026

Uh oh!

pytorchmergebot commented Apr 22, 2026

Uh oh!

nWEIdia commented Apr 23, 2026

Uh oh!

pytorchmergebot commented Apr 23, 2026

Merge started

Uh oh!

pytorchmergebot commented Apr 23, 2026

Merge failed

Uh oh!

nWEIdia commented Apr 23, 2026

Uh oh!

pytorchmergebot commented Apr 23, 2026

Merge started

Uh oh!

pytorchmergebot commented Apr 23, 2026

Merge failed

Uh oh!

nWEIdia commented Apr 23, 2026

Uh oh!

pytorchmergebot commented Apr 23, 2026

Merge started

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

nWEIdia commented Feb 10, 2026 •

edited

Loading

pytorch-bot Bot commented Feb 10, 2026 •

edited

Loading

This PR needs a `release notes:` label