Skip to content

Fix flaky tool calls in the Kimi K2.5 model#17914

Merged
Kangyan-Zhou merged 1 commit intosgl-project:mainfrom
JustinTong0323:fix-kimi-k2-tool-call-flaky
Jan 29, 2026
Merged

Fix flaky tool calls in the Kimi K2.5 model#17914
Kangyan-Zhou merged 1 commit intosgl-project:mainfrom
JustinTong0323:fix-kimi-k2-tool-call-flaky

Conversation

@JustinTong0323
Copy link
Copy Markdown
Collaborator

@JustinTong0323 JustinTong0323 commented Jan 29, 2026

Motivation

The SGLANG_TOOL_STRICT_LEVEL has some unknown issue, remove defaulting it for kimi_k2 for now, would investigate later

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Review Process

  1. Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
  4. After green CI and required approvals, ask Merge Oncalls to merge.

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@JustinTong0323 JustinTong0323 changed the title Fix flaky tool calls in the Kimi K2 model Fix flaky tool calls in the Kimi K2.5 model Jan 29, 2026
@Kangyan-Zhou Kangyan-Zhou merged commit 9409c43 into sgl-project:main Jan 29, 2026
53 of 60 checks passed
@eraser00
Copy link
Copy Markdown
Contributor

eraser00 commented Jan 29, 2026

Try upgrading xgrammar above to v0.1.29?

SGLANG_TOOL_STRICT_LEVEL=2 works well with xgrammar v0.1.31 in our test

charlesHsuGG pushed a commit to charlesHsuGG/sglang that referenced this pull request Jan 30, 2026
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Chen-0210 pushed a commit to Chen-0210/sglang that referenced this pull request Jan 30, 2026
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
@yayoimizuha yayoimizuha mentioned this pull request Jan 31, 2026
5 tasks
sfiisf pushed a commit to sfiisf/sglang that referenced this pull request Feb 5, 2026
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Johnsonms pushed a commit to Johnsonms/sglang that referenced this pull request Feb 14, 2026
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants