Checklist
Describe the bug
Adding an issue to track a bug for the new dynamic lora support:
Currently the new dynamic lora support creates gpu buffer based on existing adapter max lora ranks, when a new adapter is loaded that has larger lora rank than the initial set, it might not correctly handle it (to be verified).
We need to add logic to reset existing buffers when max-lora-rank changes.
Reproduction
TODO
Environment
N/A
Checklist
Describe the bug
Adding an issue to track a bug for the new dynamic lora support:
Currently the new dynamic lora support creates gpu buffer based on existing adapter max lora ranks, when a new adapter is loaded that has larger lora rank than the initial set, it might not correctly handle it (to be verified).
We need to add logic to reset existing buffers when max-lora-rank changes.
Reproduction
TODO
Environment
N/A