Skip to content

sglang x torch.compile silent incorrectness in PyTorch 2.6 for deepseek-v3 #150714

Closed
sgl-project/sglang
#5213
Closed
sglang x torch.compile silent incorrectness in PyTorch 2.6 for deepseek-v3#150714
sgl-project/sglang
#5213
Assignees
zou3519
Labels
high prioritymodule: correctness (silent)issue that returns an incorrect result silentlyoncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
@zou3519

Description

@zou3519
zou3519
opened on Apr 4, 2025

We should check if it's in PyTorch 2.7 as well. If it is then we should fix it

cc @ezyang @gchanan @kadeng @msaroufim @chauhang @penguinwu

Metadata

Metadata

Assignees

Labels

high prioritymodule: correctness (silent)issue that returns an incorrect result silentlyoncall: pt2triagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions