Skip to content

[Feature] Add server arg enable-lora to allow starting up with empty lora-paths #7463

@lifuhuang

Description

@lifuhuang

Checklist

Motivation

Currently SGL implicitly uses --lora-paths to decide whether engine/server should be started with LoRA support enabled.

As we are going to support dynamic lora loading/unloading soon (#7446), the current implicit constraint is no longer reasonable as it should be perfectly legal for users to start a LoRA-enabled server without having to provide any lora paths, but instead load/unload adapters later as needed.

Related resources

No response

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions