Skip to content

Add special case for Qwen3VLMoe#19445

Merged
CISC merged 8 commits intoggml-org:masterfrom
pwilkin:qwen3vlmoe-convert
Feb 10, 2026
Merged

Add special case for Qwen3VLMoe#19445
CISC merged 8 commits intoggml-org:masterfrom
pwilkin:qwen3vlmoe-convert

Conversation

@pwilkin
Copy link
Contributor

@pwilkin pwilkin commented Feb 9, 2026

Fix special conversion case for Qwen3VLMoe models introduced in #16780

@pwilkin pwilkin requested a review from CISC as a code owner February 9, 2026 09:15
CISC
CISC reviewed Feb 9, 2026
View reviewed changes
Copy link
Member

@CISC CISC left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The experts down_proj above was also permuted.

@github-actions github-actions bot added the python python script changes label Feb 9, 2026
@pwilkin
Copy link
Contributor Author

pwilkin commented Feb 9, 2026

@CISC aight, tested on a newly converted Qwen3-VL-30B-A3B-Instruct, seems to work fine.

CISC
CISC reviewed Feb 9, 2026
View reviewed changes
@CISC CISC mentioned this pull request Feb 9, 2026
Merged
pwilkin and others added 2 commits February 9, 2026 13:57
@pwilkin @CISC
Update convert_hf_to_gguf.py
29f86fa 
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@pwilkin @CISC
Update convert_hf_to_gguf.py
965e805 
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@pwilkin
Copy link
Contributor Author

pwilkin commented Feb 9, 2026

Done methinks, I was hoping TextModel would do the language_model stripping for me but unfortunately it's in Qwen2MoeModel :(

@pwilkin
Copy link
Contributor Author

pwilkin commented Feb 9, 2026

I'm not pressing the merge button today ;)

@pwilkin
Copy link
Contributor Author

pwilkin commented Feb 9, 2026

@ggerganov think we can merge this one?

@CISC
Copy link
Member

CISC commented Feb 9, 2026

@ggerganov think we can merge this one?

Will merge once EditorConfig goes green.

@pwilkin
Copy link
Contributor Author

pwilkin commented Feb 9, 2026

@CISC any idea what happened to the CI? It seems like no runners are currently running (I've noticed the actions cache is overflowing, but don't know if it has anything to do with it).

@CISC
Copy link
Member

CISC commented Feb 9, 2026

@CISC any idea what happened to the CI? It seems like no runners are currently running (I've noticed the actions cache is overflowing, but don't know if it has anything to do with it).

GitHub had a major outage, so things are probably slammed.

CISC
CISC reviewed Feb 9, 2026
View reviewed changes
@pwilkin @CISC
Update convert_hf_to_gguf.py
33d1364 
Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
@CISC CISC merged commit 854b09f into ggml-org:master Feb 10, 2026
6 checks passed
@CISC CISC mentioned this pull request Feb 10, 2026
Merged
liparetejas pushed a commit to liparetejas/llama.cpp that referenced this pull request Feb 23, 2026
@pwilkin @CISC @liparetejas
convert : move experts permutation from Qwen2MoeModel to Qwen3VLMoeTe…
7e50905 
…xtModel (ggml-org#19445)

* Add special case for Qwen3VLMoe

* Fix down path, remove arrows and checkmarks

* ws

* Moved to Qwen3VL

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
bartowski1182 pushed a commit to bartowski1182/llama.cpp that referenced this pull request Mar 2, 2026
@pwilkin @CISC @bartowski1182
convert : move experts permutation from Qwen2MoeModel to Qwen3VLMoeTe…
bef697c 
…xtModel (ggml-org#19445)

* Add special case for Qwen3VLMoe

* Fix down path, remove arrows and checkmarks

* ws

* Moved to Qwen3VL

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

* Update convert_hf_to_gguf.py

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>

---------

Co-authored-by: Sigbjørn Skjæret <sigbjorn.skjaeret@scala.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@CISC CISC CISC approved these changes

Assignees

No one assigned

Labels

python python script changes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@pwilkin @CISC