Skip to content

Gemma 3n 4-bit finetune Q4_K_M GGUF support #3040

@aphilas

Description

@aphilas

Q4_K_M is not supported:

RuntimeError: Unsloth: `q4_k_m` quantization type is not supported.
The following quantization types are supported: `['f32', 'f16', 'bf16', 'q8_0']`

Originally posted by @aphilas in #2924

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestFeature request pending on roadmapfixedFixed!

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions