Checklist
Motivation
Thanks for your efforts in building such a powerful open source inference engine!
We recently found some inconveniences in using custom chat template. Could you please consider adding some features like chat_template_kwargs in vLLM? (please refer to this page)
Related resources
No response
Checklist
Motivation
Thanks for your efforts in building such a powerful open source inference engine!
We recently found some inconveniences in using custom chat template. Could you please consider adding some features like chat_template_kwargs in vLLM? (please refer to this page)
Related resources
No response