Skip to content

[CPU] Add gemma4_rmsnorm_cpu kernel#22842

Merged
mingfeima merged 6 commits intosgl-project:mainfrom
blzheng:beilei/pr_norm
Apr 17, 2026
Merged

[CPU] Add gemma4_rmsnorm_cpu kernel#22842
mingfeima merged 6 commits intosgl-project:mainfrom
blzheng:beilei/pr_norm

Conversation

@blzheng
Copy link
Copy Markdown
Contributor

@blzheng blzheng commented Apr 15, 2026

Motivation

This PR adds the gemma4_rmsnorm_cpu kernel and extends support for 3D inputs in other rmsnorm kernels to fix the Xeon CI failure after #21734

Test Plan:
test/srt/cpu/test_norm.py

Modifications

Accuracy Tests

Speed Tests and Profiling

Checklist

Review and Merge Process

  1. Ping Merge Oncalls to start the process. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • Common commands include /tag-and-rerun-ci, /tag-run-ci-label, /rerun-failed-ci
  4. After green CI and required approvals, ask Merge Oncalls or people with Write permission to merge the PR.

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@blzheng
Copy link
Copy Markdown
Contributor Author

blzheng commented Apr 15, 2026

/tag-run-ci-label

@blzheng
Copy link
Copy Markdown
Contributor Author

blzheng commented Apr 15, 2026

/rerun-failed-ci

Comment thread python/sglang/srt/layers/layernorm.py
blzheng and others added 2 commits April 16, 2026 09:19
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
@blzheng blzheng requested a review from mingfeima April 16, 2026 01:26
@mingfeima
Copy link
Copy Markdown
Collaborator

this one fixed CI break on Xeon.

@mingfeima mingfeima merged commit 0dcfae5 into sgl-project:main Apr 17, 2026
72 of 92 checks passed
jmamou pushed a commit to jmamou/sglang that referenced this pull request Apr 20, 2026
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
yhyang201 pushed a commit to yhyang201/sglang that referenced this pull request Apr 22, 2026
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
zhangying098 pushed a commit to zhangying098/sglang that referenced this pull request Apr 23, 2026
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
kyx1999 pushed a commit to KMSorSMS/sglang that referenced this pull request Apr 27, 2026
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants