Skip to content

Error when saving finetuned Gemma3: save_to_gguf_generic() got an unexpected keyword argument 'quantization_method' #2209

@phiwi

Description

@phiwi

I don't know if this issue is specific to Gemma3:27b finetuning, but when running

    model.save_pretrained_gguf(
        f"{sft_model_path}.GGUF",
        tokenizer,
        quantization_method=["q4_k_m", "q8_0"]
    )

After finetuning, the script runs into save_to_gguf_generic() got an unexpected keyword argument 'quantization_method'.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions