Skip to content

fp8 rowwise scaled_mm error: CUBLAS_STATUS_INVALID_VALUE #3788

@danielvegamyhre

Description

@danielvegamyhre

Repro

On H100 run:
pytest test/prototype/moe_training/test_scaled_grouped_mm.py -v -rs

Error

RuntimeError: CUDA error: CUBLAS_STATUS_INVALID_VALUE when calling ::cublasLtMatmulDescSetAttribute(descriptor(), attr, &value, sizeof(value))

Metadata

Metadata

Labels

bugSomething isn't working

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions