Skip to content

metal : add solve_tri#19302

Merged
ggerganov merged 1 commit intomasterfrom
gg/metal-solve-tri
Feb 3, 2026
Merged

metal : add solve_tri#19302
ggerganov merged 1 commit intomasterfrom
gg/metal-solve-tri

Conversation

@ggerganov
Copy link
Member

Add GGML_OP_SOLVE_TRI implementation for Metal.

Model Test t/s master t/s gg/metal-solve-tri Speedup
qwen3next 80B.A3B Q8_0 pp2048 457.71 1033.97 2.26
qwen3next 80B.A3B Q8_0 pp4096 454.06 1015.32 2.24
qwen3next 80B.A3B Q8_0 pp8192 445.92 986.42 2.21
qwen3next 80B.A3B Q8_0 tg32 33.34 33.23 1.00

@ggerganov ggerganov merged commit 44008ce into master Feb 3, 2026
74 of 75 checks passed
@ggerganov ggerganov deleted the gg/metal-solve-tri branch February 3, 2026 21:43
@github-actions github-actions bot added ggml changes relating to the ggml tensor library for machine learning Apple Metal https://en.wikipedia.org/wiki/Metal_(API) labels Feb 3, 2026
agent-enemy-2 pushed a commit to agent-enemy-2/llama.cpp that referenced this pull request Feb 4, 2026
liparetejas pushed a commit to liparetejas/llama.cpp that referenced this pull request Feb 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant