### Checklist - [ ] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed. - [ ] 2. Please use English, otherwise it will be closed. ### Motivation as titled https://github.com/sgl-project/sglang/pull/4321 is ugly :) @Alcanderian will help add abstraction ### Related resources _No response_
Checklist
Motivation
as titled
#4321 is ugly :)
@Alcanderian will help add abstraction
Related resources
No response