Skip to content

fix: multimodal_config in monkey_patch_vllm_dummy_weight_loader#1260

Merged
zhyncs merged 1 commit intosgl-project:mainfrom
lxww302:ww-dummy-weight
Aug 30, 2024
Merged

fix: multimodal_config in monkey_patch_vllm_dummy_weight_loader#1260
zhyncs merged 1 commit intosgl-project:mainfrom
lxww302:ww-dummy-weight

Conversation

@lxww302
Copy link
Copy Markdown
Contributor

@lxww302 lxww302 commented Aug 29, 2024

Motivation

fixes #1259 using dummy weight with vllm 0.5.5.

Modifications

fix monkey_patch_vllm_dummy_weight_loader

Checklist

  • Format your code according to the Contributor Guide.
  • Add unit tests as outlined in the Contributor Guide.
  • Update documentation as needed, including docstrings or example tutorials.

@zhyncs zhyncs merged commit a362340 into sgl-project:main Aug 30, 2024
timethink pushed a commit to timethink/sglang that referenced this pull request Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] cannot set --load-format=dummy with vllm 0.5.5

2 participants