Checklist
Describe the bug
Currently, LoRA in SGLang cannot handle none lora_path properly.
Reproduction
Some cases below will have issues.
- First batch input
lora_path as [a, a]. Second batch input lora_path as [None, None]. The second batch will be processed as if you had input lora_path as [a, a].
- If you input
lora_path as [a, None], the output of the second prompt will be almost empty.
Environment
Main branch
Checklist
Describe the bug
Currently, LoRA in SGLang cannot handle
nonelora_path properly.Reproduction
Some cases below will have issues.
lora_pathas[a, a]. Second batch inputlora_pathas[None, None]. The second batch will be processed as if you had input lora_path as[a, a].lora_pathas [a, None], the output of the second prompt will be almost empty.Environment
Main branch