Skip to content

0.1.12 fails on DeepSeek R1 on MI300 #2864

@gshtras

Description

@gshtras

vllm-project/vllm#39485

Running DeepSeek R1 on vLLM with AITER enabled on MI300 crashes with
ERROR 04-10 06:05:12 [multiproc_executor.py:971] RuntimeError: This GEMM is not supported!

Mor edetails and repro instructions in the vLLM issue above

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions