Skip to content

Refactor engine vlm params and mainly to ensure CI stability for unit-test-backend-1-gpu (0),#14080

Merged
zhaochenyang20 merged 7 commits intosgl-project:refactor-engine-vlm-paramsfrom
minleminzui:refactor-engine-vlm-params
Nov 28, 2025
Merged

Refactor engine vlm params and mainly to ensure CI stability for unit-test-backend-1-gpu (0),#14080
zhaochenyang20 merged 7 commits intosgl-project:refactor-engine-vlm-paramsfrom
minleminzui:refactor-engine-vlm-params

Conversation

@minleminzui
Copy link
Copy Markdown
Collaborator

Motivation

#10532

Mainly to ensure CI stability for unit-test-backend-1-gpu (0),
which runs pytest test/srt/test_vision_openai_server_a.py.

Fix bugs in VLM query and improve documentation to make VLM query usage and sampling parameters more clear and detailed

Modifications

  • Fix bugs in python/sglang/srt/multimodal/processors/base_processor.py related to object assignment.
  • Add detailed documentation and examples in docs/advanced_features/vlm_query.ipynb.
  • Clarify and expand sampling parameter docs in docs/basic_usage/sampling_params.md.
  • Add more test cases in test/srt/test_vlm_input_format.py.

Accuracy Tests

Benchmarking and Profiling

Checklist

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@github-actions github-actions Bot added documentation Improvements or additions to documentation Multi-modal multi-modal language model labels Nov 28, 2025
@zhaochenyang20 zhaochenyang20 merged commit 2ef05c2 into sgl-project:refactor-engine-vlm-params Nov 28, 2025
3 checks passed
minleminzui added a commit to minleminzui/sglang that referenced this pull request Nov 28, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
minleminzui added a commit to minleminzui/sglang that referenced this pull request Nov 28, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
minleminzui added a commit to minleminzui/sglang that referenced this pull request Dec 11, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
minleminzui added a commit to minleminzui/sglang that referenced this pull request Dec 12, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
minleminzui added a commit to minleminzui/sglang that referenced this pull request Dec 12, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
minleminzui added a commit to minleminzui/sglang that referenced this pull request Dec 12, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
BenYao21 added a commit to minleminzui/sglang that referenced this pull request Dec 13, 2025
…-test-backend-1-gpu (0), (sgl-project#14080)

Co-authored-by: BenYao21 <cyao22@asu.edu>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation Multi-modal multi-modal language model

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants