We should start transitioning to the PEG parser approach. This one looks very similar to the new mistral-3 series, there is already a parser out there to reference. The difference is you'll need to match the name within the JSON instead of outside of it, but it should be easy with the schema(), json() and json_member() helpers.

Got it, thanks, I took it to work)

Rebased onto latest master
Reimplemented the parser in PEG format

Any updates?

Running CI after rebasing on master and will merge if it's OK.

Okay, think this should be fine.

Sorry, but model has "<|role_sep|>\n" and "<|message_sep|>\n\n" as tokens -> so newlines are the part of these special tokens

Is there still need to remove \n here?

Oh wow. Okay, nevermind, you're right. Those are some crazy tokens :)

Yeah, that has to be reverted. Can you please fix the merge as well? I think I might've messed up something, can't really check now.