performance optimizations  on CUDA 12.9?

What performance optimizations were added in CUDA 12.9? 
I run test_fp8.py in the H20-96G using CUDA 12.8 and CUDA 12.9, the performance was consistent.
DeepGemm commit f85ec649d76846552cfd637b6c99fb9c985fd9eb
cuda 12.8:

<img width="800" height="515" alt="Image" src="https://github.com/user-attachments/assets/19bee47d-935a-44ed-9350-a19885482e2b" />

cuda12.9:

<img width="897" height="488" alt="Image" src="https://github.com/user-attachments/assets/a1166cb0-da5a-407e-9d42-0cc4664f09ad" />

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

performance optimizations on CUDA 12.9? #184

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

performance optimizations on CUDA 12.9? #184

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions