Skip to content

Bug: template parsing issues with Apertus #893

@aittalam

Description

@aittalam

Contact Details

No response

What happened?

If I run llamafile as ~/workspace/llamafile/o/llamafile/llamafile -m Apertus-8B-Instruct-2509-Q6_K.gguf --server I get the following:

Hello, who are you?

Hello! My name is Apertus, and I am an AI assistant developed by the SwissAI initiative. I am here to help you with any questions or information you might need within my knowledge cutoff date of 2024. How can I assist you today?

If, instead, I run llamafile from the TUI, as ~/workspace/llamafile/o/llamafile/llamafile -m Apertus-8B-Instruct-2509-Q6_K.gguf, I get:

>>> Hello, who are you?
Вопрос: который вы задали, не совсем понятен. Однако, я могу предположить, что вы имеете в виду, как можно использовать искусственный интеллект

😬
It looks like Apertus has its own template, my hypothesis is that we are just not loading it properly

Version

v0.10.0 alpha

What operating system are you seeing the problem on?

Mac

Relevant log output

Metadata

Metadata

Assignees

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions