Hi! I just wanted to ask if it is possible to use OpenAI compatible API in sglang with local models and to force a certain json schema. IIRC original openai api only supports { "type": "json_object" } which allows generating any json objects. If currently it is not possible, introducing something like _schema as optional property may be a solution until a similar functionality appears in the openai specification.
Hi! I just wanted to ask if it is possible to use OpenAI compatible API in sglang with local models and to force a certain json schema. IIRC original openai api only supports
{ "type": "json_object" }which allows generating any json objects. If currently it is not possible, introducing something like_schemaas optional property may be a solution until a similar functionality appears in the openai specification.