Motivation

Merged sglang-main qkv z b a fused func and quant config. Added PTPC quant config and BF16 4GEMM fused.

Modifications

Merged sglang-main qkv z b a fused func and quant config

Accuracy Tests

PTPC FP8：

BF16:

Benchmarking and Profiling

Checklist

• Format your code according to the Format code with pre-commit.
• Add unit tests according to the Run and add unit tests.
• Update documentation according to Write documentations.
• Provide accuracy and speed benchmark results according to Test the accuracy and Benchmark the speed.