Skip to content

[Inductor] Convert 0d CPU tensor to scalar during triton codegen#87329

Closed
yanboliang wants to merge 6 commits intopytorch:masterfrom
yanboliang:unspec
Closed

[Inductor] Convert 0d CPU tensor to scalar during triton codegen#87329
yanboliang wants to merge 6 commits intopytorch:masterfrom
yanboliang:unspec

Conversation

@yanboliang
Copy link
Contributor

@yanboliang yanboliang commented Oct 19, 2022

This is a follow up to address this. We revised to use the codegen approach to handle 0d CPU tensor, which will not support cudagraph any more.

cc @jansel @lezcano @fdrocha @mlazos @soumith @voznesenskym

@pytorch-bot
Copy link

pytorch-bot bot commented Oct 19, 2022

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/87329

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 Failures, 4 Pending

As of commit fce492c:

The following jobs have failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@yanboliang yanboliang requested a review from ngimel October 19, 2022 23:19
@yanboliang yanboliang self-assigned this Oct 19, 2022
@yanboliang yanboliang added ciflow/trunk Trigger trunk jobs on your pull request topic: not user facing topic category labels Oct 19, 2022
@ngimel
Copy link
Collaborator

ngimel commented Oct 20, 2022

Does this fix pytorch/torchdynamo#1681 (comment)? Can you add a test with a similar pattern, a mix of cpu and cuda ops?

@yanboliang
Copy link
Contributor Author

Does this fix pytorch/torchdynamo#1681 (comment)? Can you add a test with a similar pattern, a mix of cpu and cuda ops?

Yes, it fixed.

@yanboliang
Copy link
Contributor Author

@pytorchbot merge -f "irrelevant mac failures"

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@yanboliang yanboliang deleted the unspec branch October 21, 2022 01:26
ptillet pushed a commit to triton-lang/triton that referenced this pull request Oct 25, 2022
In ```torch._inductor```, we [convert 0d CPU tensor to scalar during
triton codegen](pytorch/pytorch#87329), so need
add missing triton support for bf16/fp16/fp64.
ptillet pushed a commit to triton-lang/triton that referenced this pull request Dec 20, 2022
In ```torch._inductor```, we [convert 0d CPU tensor to scalar during
triton codegen](pytorch/pytorch#87329), so need
add missing triton support for bf16/fp16/fp64.
pingzhuu pushed a commit to siliconflow/triton that referenced this pull request Apr 2, 2024
In ```torch._inductor```, we [convert 0d CPU tensor to scalar during
triton codegen](pytorch/pytorch#87329), so need
add missing triton support for bf16/fp16/fp64.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged module: inductor topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants