Hello. In our use case, we would like to make calls to the backend with a "grammar" or "cfg" field similar to what outline implements in their vllm implementation:
dottxt-ai/outlines#517
Would this be in the cards? I see there is already a Lark CFG implementation, but it seems to be front end/python only.
Hello. In our use case, we would like to make calls to the backend with a "grammar" or "cfg" field similar to what outline implements in their vllm implementation:
dottxt-ai/outlines#517
Would this be in the cards? I see there is already a Lark CFG implementation, but it seems to be front end/python only.