Release sglang kernel 0.4.0 by BBuf · Pull Request #20440 · sgl-project/sglang

BBuf · 2026-03-12T09:52:21Z

Motivation

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Format your code according to the Format code with pre-commit.
Add unit tests according to the Run and add unit tests.
Update documentation according to Write documentations.
Provide accuracy and speed benchmark results according to Test the accuracy and Benchmark the speed.
Follow the SGLang code style guidance.

Review Process

Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
Get approvals from CODEOWNERS and other reviewers.
Trigger CI tests with comments or contact authorized users to do so.
- /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
After green CI and required approvals, ask Merge Oncalls to merge.

gemini-code-assist · 2026-03-12T09:52:51Z

Summary of Changes

Hello, I'm Gemini Code Assist¹! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request focuses on a significant version upgrade and renaming effort for the sglang-kernel package. The primary goal is to release version 0.4.0 and to standardize the package's name from sgl-kernel to sglang-kernel across the entire project. This change impacts dependency specifications, build configurations, documentation, and various scripts, ensuring a consistent and updated reference to the kernel library.

Highlights

Version Bump: The sglang-kernel package has been updated to version 0.4.0 across all relevant configurations and dependencies.
Package Renaming: The package name sgl-kernel has been consistently renamed to sglang-kernel throughout the codebase, documentation, and build scripts to standardize its identity.
Documentation Updates: Installation guides, contribution guidelines, and release scripts have been updated to reflect the new package name and version, ensuring clarity for users and developers.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog

3rdparty/amd/wheel/README.md
- Updated references to the kernel package name from sgl-kernel to sglang-kernel.
- Adjusted installation commands to reflect the new package name.
3rdparty/amd/wheel/sglang/pyproject.toml
- Updated the sgl-kernel dependency to sglang-kernel with version 0.4.0 for ROCm 7.0.0 and 7.2.0 extras.
docker/Dockerfile
- Updated the SGL_KERNEL_VERSION argument to 0.4.0.
- Modified pip install commands to use sglang_kernel instead of sgl_kernel.
docs/developer_guide/contribution_guide.md
- Clarified terminology by updating mentions of sgl-kernel to sglang-kernel.
- Updated instructions for bumping the kernel package version and wheel release.
docs/get_started/install.md
- Updated installation instructions to refer to sglang-kernel wheels for CUDA 13.
docs/platforms/ascend_contribution_guide.md
- Updated references to the kernel package name from sgl-kernel to sglang-kernel.
- Adjusted instructions for updating the kernel package.
python/pyproject.toml
- Updated the sgl-kernel dependency to sglang-kernel==0.4.0.
python/sglang/check_env.py
- Changed the package name in PACKAGE_LIST from sgl_kernel to sglang-kernel.
python/sglang/srt/entrypoints/engine.py
- Updated the assert_pkg_version call to check for sglang-kernel version 0.4.0.
scripts/ci/amd/amd_ci_install_dependency.sh
- Added an uninstall command for sglang-kernel to ensure clean CI environment setup.
scripts/ci/cuda/ci_install_dependency.sh
- Updated grep patterns to extract sglang-kernel version.
- Modified pip install commands to use sglang_kernel wheel names.
scripts/release/README.md
- Updated documentation for bump_kernel_version.py to reflect sglang-kernel and version 0.4.0.
- Added sgl-kernel/pyproject_musa.toml to the list of files updated by the script.
scripts/release/bump_kernel_version.py
- Included sgl-kernel/pyproject_musa.toml in the list of files to be updated during a kernel version bump.
scripts/release/bump_kernel_version_to_sglang.py
- Updated script description to reflect sglang-kernel.
- Modified regular expressions to target sglang-kernel for version updates in pyproject.toml and engine.py.
scripts/release/check_kernel_version_to_sglang.py
- Updated script description to reflect sglang-kernel.
- Modified regular expressions to correctly extract sglang-kernel versions from various files.
scripts/release/commit_and_pr_kernel_to_sglang.sh
- Updated commit messages and pull request titles/bodies to reference sglang-kernel and its new version.
scripts/update_kernel_whl_index.py
- Adjusted wheel filename patterns and index directory paths to use sglang-kernel.
sgl-kernel/README.md
- Updated the project title to sglang-kernel.
- Modified the PyPI badge and installation instructions to use sglang-kernel.
- Clarified that the source tree remains sgl-kernel/.
sgl-kernel/analyze_whl_kernel_sizes.py
- Updated the script's description to refer to sglang-kernel wheel files.
sgl-kernel/pyproject.toml
- Updated the project name to sglang-kernel and the version to 0.4.0.
sgl-kernel/pyproject_cpu.toml
- Updated the project version to 0.4.0.
sgl-kernel/pyproject_musa.toml
- Updated the project name to sglang-kernel and the version to 0.4.0.
sgl-kernel/pyproject_rocm.toml
- Updated the project name to sglang-kernel and the version to 0.4.0.
sgl-kernel/python/sgl_kernel/load_utils.py
- Updated installation hints to suggest pip install sglang-kernel.
sgl-kernel/python/sgl_kernel/version.py
- Updated the __version__ string to 0.4.0.
sgl-kernel/setup_musa.py
- Updated the package name in setup() call to sglang-kernel.
sgl-kernel/setup_rocm.py
- Updated the package name in setup() call to sglang-kernel.

Ignored Files

Ignored by pattern: .github/workflows/** (1)
- .github/workflows/release-whl-kernel.yml

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature	Command	Description
Code Review	`/gemini review`	Performs a code review for the current pull request in its current state.
Pull Request Summary	`/gemini summary`	Provides a summary of the current pull request in its current state.
Comment	@gemini-code-assist	Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help	`/gemini help`	Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

gemini-code-assist

Code Review

This pull request releases version 0.4.0 of the sglang kernel, which includes renaming the package from sgl-kernel to sglang-kernel. The changes are mostly mechanical updates across the codebase to reflect the new package name and version. My review found a potential security issue where the SHA256 hashes for wheel dependencies have been removed, which should be addressed to ensure dependency integrity.

gemini-code-assist · 2026-03-12T09:55:05Z

  "torchvision @ https://repo.radeon.com/rocm/manylinux/rocm-rel-7.0.2/torchvision-0.24.0%2Brocm7.0.2.gitb919bd0c-cp310-cp310-linux_x86_64.whl",
  "mooncake-transfer-engine-non-cuda==0.3.8.post1",
-  "sgl-kernel @ https://github.com/sgl-project/whl/releases/download/v0.3.21/sgl_kernel-0.3.21+rocm700-cp310-abi3-manylinux2014_x86_64.whl#sha256=2d56ee97d8e6dae29d35a2524de4bffb8e07752bcc74e73313462496427832bf",
+  "sglang-kernel @ https://github.com/sgl-project/whl/releases/download/v0.4.0/sglang_kernel-0.4.0+rocm700-cp310-abi3-manylinux2014_x86_64.whl",


For security, it's important to include the SHA256 hash for this wheel dependency. The hash was present for the previous version but has been removed here. Please calculate the new hash for sglang_kernel-0.4.0+rocm700-cp310-abi3-manylinux2014_x86_64.whl and append it to the URL (e.g., #sha256=...). This prevents man-in-the-middle attacks and ensures dependency integrity.

gemini-code-assist · 2026-03-12T09:55:05Z

  "torchvision @ https://repo.radeon.com/rocm/manylinux/rocm-rel-7.2/torchvision-0.24.0%2Brocm7.2.0.gitb919bd0c-cp310-cp310-linux_x86_64.whl",
  "mooncake-transfer-engine-non-cuda==0.3.8.post1",
-  "sgl-kernel @ https://github.com/sgl-project/whl/releases/download/v0.3.21/sgl_kernel-0.3.21+rocm720-cp310-abi3-manylinux2014_x86_64.whl#sha256=91a3f50ef0b9d2a140dbf6e2aabff45a50c45a4782b9215997bce6f71749180f",
+  "sglang-kernel @ https://github.com/sgl-project/whl/releases/download/v0.4.0/sglang_kernel-0.4.0+rocm720-cp310-abi3-manylinux2014_x86_64.whl",


Similar to the rocm700 dependency, the SHA256 hash for this rocm720 wheel is missing. Please add the hash for sglang_kernel-0.4.0+rocm720-cp310-abi3-manylinux2014_x86_64.whl to ensure the integrity of the downloaded package.

Fridge003 · 2026-03-14T07:59:48Z

/tag-and-rerun-ci

BBuf · 2026-03-16T12:35:01Z

https://github.com/sgl-project/sglang/actions/runs/23110715096/job/67176005992?pr=20440

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

BBuf added 2 commits March 12, 2026 17:41

release

0bc8835

ud

8cd2e64

BBuf requested review from CatherineSue, FlamingoPg, Fridge003, HaiShaw, JustinTong0323, Kangyan-Zhou, bingxche, ishandhanani, ispobock, merrymercy, slin1237, yctseng0211, yizhang2077 and zhyncs as code owners March 12, 2026 09:52

github-actions Bot added documentation Improvements or additions to documentation amd dependencies Pull requests that update a dependency file sgl-kernel npu mthreads labels Mar 12, 2026

gemini-code-assist Bot reviewed Mar 12, 2026

View reviewed changes

Fridge003 reviewed Mar 13, 2026

View reviewed changes

Comment thread 3rdparty/amd/wheel/README.md Outdated

Fridge003 reviewed Mar 13, 2026

View reviewed changes

Comment thread docs/developer_guide/contribution_guide.md Outdated

Comment thread sgl-kernel/README.md Outdated

Fridge003 added 3 commits March 12, 2026 22:23

Update 3rdparty/amd/wheel/README.md

3906486

Update docs/developer_guide/contribution_guide.md

3fe8737

Update sgl-kernel/README.md

27606ee

github-actions Bot added the run-ci label Mar 14, 2026

Fridge003 and others added 4 commits March 14, 2026 12:34

Merge branch 'main' into release_sglang_kernel_040

40b469e

Merge branch 'main' into release_sglang_kernel_040

11dde26

Merge branch 'main' into release_sglang_kernel_040

19aa8a5

ud

18ec076

BBuf requested review from DarkSharpness, HydraQYH, celve and yuan-luo as code owners March 15, 2026 12:50

github-actions Bot added the jit-kernel label Mar 15, 2026

Fridge003 added the high priority label Mar 16, 2026

BBuf merged commit 15097c5 into main Mar 16, 2026
191 of 220 checks passed

BBuf deleted the release_sglang_kernel_040 branch March 16, 2026 12:35

JustinTong0323 mentioned this pull request Mar 16, 2026

Upgrade transformers==5.3.0 #17784

Merged

21 tasks

Wangzheee pushed a commit to Wangzheee/sglang that referenced this pull request Mar 21, 2026

Release sglang kernel 0.4.0 (sgl-project#20440)

1d245a5

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

0-693 pushed a commit to 0-693/sglang that referenced this pull request Mar 25, 2026

Release sglang kernel 0.4.0 (sgl-project#20440)

d105981

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

JustinTong0323 pushed a commit to JustinTong0323/sglang that referenced this pull request Apr 7, 2026

Release sglang kernel 0.4.0 (sgl-project#20440)

d98b019

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

yhyang201 pushed a commit to yhyang201/sglang that referenced this pull request Apr 22, 2026

Release sglang kernel 0.4.0 (sgl-project#20440)

6b017c3

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Release sglang kernel 0.4.0#20440

Release sglang kernel 0.4.0#20440
BBuf merged 9 commits intomainfrom
release_sglang_kernel_040

BBuf commented Mar 12, 2026

Uh oh!

gemini-code-assist Bot commented Mar 12, 2026

Uh oh!

gemini-code-assist Bot left a comment

Uh oh!

gemini-code-assist Bot Mar 12, 2026

Uh oh!

gemini-code-assist Bot Mar 12, 2026

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Fridge003 commented Mar 14, 2026

Uh oh!

Uh oh!

BBuf commented Mar 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

BBuf commented Mar 12, 2026

Motivation

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Review Process

Uh oh!

gemini-code-assist Bot commented Mar 12, 2026

Summary of Changes

Highlights

Footnotes

Uh oh!

gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

Code Review

Uh oh!

gemini-code-assist Bot Mar 12, 2026

Choose a reason for hiding this comment

Uh oh!

gemini-code-assist Bot Mar 12, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Fridge003 commented Mar 14, 2026

Uh oh!

Uh oh!

BBuf commented Mar 16, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants