Skip to content

Missing add_generation_prompt #2035

Closed
#2046
Closed
Missing add_generation_prompt#2035
#2046
@davebulaval

Description

@davebulaval
davebulaval
opened on Mar 15, 2025

Model name: Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B

It is a Llama model; it should be fixed easily using the Llama chat template.

RuntimeError: Unsloth: The tokenizer `Raj-Maharajwala/Open-Insurance-LLM-Llama3-8B`
does not have a {% if add_generation_prompt %} for generation purposes.
Please file a bug report immediately - thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions