Skip to content

Fix sessions with mm inputs#21269

Merged
hnyls2002 merged 4 commits intosgl-project:mainfrom
aurickq:mm-sessions-fix
Mar 27, 2026
Merged

Fix sessions with mm inputs#21269
hnyls2002 merged 4 commits intosgl-project:mainfrom
aurickq:mm-sessions-fix

Conversation

@aurickq
Copy link
Copy Markdown
Contributor

@aurickq aurickq commented Mar 24, 2026

  • We can only clear multimodal inputs from the request if it's not part of any session. Otherwise, it may be reused later.
  • We need to adjust mm offsets if bos token is trimmed
  • Bring back Vision Sessions test using InternVL2

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@ispobock
Copy link
Copy Markdown
Collaborator

@aurickq could you fix the lint first? then I will trigger the ci

@ispobock
Copy link
Copy Markdown
Collaborator

/tag-and-rerun-ci

@hnyls2002 hnyls2002 merged commit c2b3e42 into sgl-project:main Mar 27, 2026
253 of 306 checks passed
@hnyls2002
Copy link
Copy Markdown
Collaborator

Follow-up: #21501 — release mm features on session close + harden BOS offset adjustment

satyamk7054 pushed a commit to satyamk7054/sglang that referenced this pull request Apr 3, 2026
JustinTong0323 pushed a commit to JustinTong0323/sglang that referenced this pull request Apr 7, 2026
yhyang201 pushed a commit to yhyang201/sglang that referenced this pull request Apr 22, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants