Skip to content

convert : filter lora tensor names#23077

Merged
ggerganov merged 1 commit into
masterfrom
cisc/convert-lora-filter-tensors
May 19, 2026
Merged

convert : filter lora tensor names#23077
ggerganov merged 1 commit into
masterfrom
cisc/convert-lora-filter-tensors

Conversation

@CISC

@CISC CISC commented May 14, 2026

Copy link
Copy Markdown
Member

Overview

Fixes #23047

Additional information

When generating LoRA tensors we need to run the base names through filter_tensors so they match expected names in modify_tensors.

Requirements

@CISC CISC changed the title filter lora tensor names convert : filter lora tensor names May 14, 2026
@github-actions github-actions Bot added the python python script changes label May 14, 2026
@CISC CISC added the merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. label May 14, 2026

@snipeart007 snipeart007 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The PR does not solve the issue yet.
#23047 (comment)

@CISC

CISC commented May 15, 2026

Copy link
Copy Markdown
Member Author

The PR does not solve the issue yet. #23047 (comment)

It does, you did not use the updated convert_lora_to_gguf.py. :)

@CISC CISC dismissed snipeart007’s stale review May 15, 2026 11:53

Did not use PR

@ggerganov

Copy link
Copy Markdown
Member

I assume we are waiting for @snipeart007 to confirm this works. Or should we merge?

@snipeart007

snipeart007 commented May 18, 2026

Copy link
Copy Markdown

I'm on it now. I'm trying to confirm this works. I'll be back in a few minutes.

@snipeart007

Copy link
Copy Markdown

I assume we are waiting for @snipeart007 to confirm this works. Or should we merge?

Yeah it works!!!. I can confirm that this PR solves my issue. Sorry for the delayed confirmation🙏🙏

@snipeart007 snipeart007 left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can confirm this PR solves the issue. No hiccups whatsoever

@ggerganov ggerganov merged commit f1c1c5c into master May 19, 2026
8 checks passed
@ggerganov ggerganov deleted the cisc/convert-lora-filter-tensors branch May 19, 2026 06:44
kgrama pushed a commit to kgrama/llama.cpp that referenced this pull request May 19, 2026
xxmustafacooTR pushed a commit to xxPlayground/llama-cpp-turboquant that referenced this pull request May 19, 2026
rsenthilkumar6 pushed a commit to rsenthilkumar6/llama.cpp that referenced this pull request May 19, 2026
ArberSephirotheca pushed a commit to ArberSephirotheca/llama.cpp that referenced this pull request May 19, 2026
fhnmor21 pushed a commit to fhnmor21/llama-cpp-turboquant that referenced this pull request May 19, 2026
dbrain pushed a commit to dbrain/hbd-llama-cpp-turboquant that referenced this pull request May 21, 2026
baramofme pushed a commit to baramofme/llama-cpp-turboquant that referenced this pull request May 23, 2026
Jcfunk added a commit to Jcfunk/llama.cpp that referenced this pull request May 23, 2026
* upstream/HEAD:
  ci : install server kleidiai runner dependencies (ggml-org#23259)
  server-context: guarantee there is at least 1 token to decode (ggml-org#23280)
  server : print graphs reused in slot timings (ggml-org#23279)
  save-load-state : refactor tests and improve readability (ggml-org#23196)
  llama-eval : add per-task summary stats (ggml-org#23151)
  ggml-webgpu : extend GDN for K>1 (ggml-org#23299)
  [SCYL] add chapter for performance reference in SYCL.md (ggml-org#23315)
  convert : filter lora tensor names (ggml-org#23077)
  sycl: add GGML_SYCL_USE_ASYNC_MEM_OP env toggle (ggml-org#22153)
  rpc : keep last_graph_uid in the device context (ggml-org#23273)
srossitto79 pushed a commit to srossitto79/llama.cpp that referenced this pull request May 23, 2026
carlosfundora pushed a commit to carlosfundora/llama.cpp-1-bit-turbo that referenced this pull request May 24, 2026
fewtarius pushed a commit to fewtarius/llama.cpp that referenced this pull request May 30, 2026
turbo-tan pushed a commit to turbo-tan/llama.cpp-tq3 that referenced this pull request Jun 2, 2026
@CISC CISC mentioned this pull request Jun 4, 2026
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

merge ready A maintainer can use this label to indicate that they consider the changes final and ready to merge. python python script changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Misc. bug: convert_lora_to_gguf.py fails for Gemma 4

3 participants