Skip to content

[Bug] Impossible to convert Gemma3 4b into gguf #2399

@edoproch

Description

@edoproch

I tried to save my fine-tuned gemma3 on HuggingFace in gguf format, I followed the unsloth's notebook but I have the following error when I run model.save_pretrained_merged("gemma-3-finetune", tokenizer)

NotImplementedError: Unsloth: llama.cpp GGUF conversion does not yet support converting model types of Gemma3ForConditionalGeneration.

Suggestions?

PS: same error using model.push_to_hub_gguf

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions