[Feature]: VPTQ quantization via vllm pr #1152
Description
🚀 The feature, motivation and pitch
Author claims it works. Would be sweet to have.
Alternatives
No response
Additional context
No response
{{ message }}
Author claims it works. Would be sweet to have.
No response
No response