Skip to content

vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add.#17287

Merged
0cc4m merged 1 commit intoggml-org:masterfrom
jeffbolznv:mat_vec_mul_fuse2
Nov 15, 2025
Merged

vulkan: Fuse mul_mat_id+add_id+mul and mul_mat+add+add.#17287
0cc4m merged 1 commit intoggml-org:masterfrom
jeffbolznv:mat_vec_mul_fuse2

Conversation

@jeffbolznv
Copy link
Collaborator

These both show up in gpt-oss. Also, cleanup the mul_mat_vec fusion code a bit.

I get a few percent boost in gpt-oss from this.

@github-actions github-actions bot added testing Everything test related Vulkan Issues specific to the Vulkan backend ggml changes relating to the ggml tensor library for machine learning labels Nov 15, 2025
These both show up in gpt-oss. Also, cleanup the mul_mat_vec fusion code a bit.
@0cc4m 0cc4m merged commit 24dc769 into ggml-org:master Nov 15, 2025
72 checks passed
Anico2 added a commit to Anico2/llama.cpp that referenced this pull request Jan 15, 2026
These both show up in gpt-oss. Also, cleanup the mul_mat_vec fusion code a bit.
blime4 referenced this pull request in blime4/llama.cpp Feb 5, 2026
These both show up in gpt-oss. Also, cleanup the mul_mat_vec fusion code a bit.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning testing Everything test related Vulkan Issues specific to the Vulkan backend

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants