Skip to content

Build ROCm7.2 Image with latest AITER v0.1.10.post3#18741

Merged
HaiShaw merged 1 commit intosgl-project:mainfrom
HaiShaw:rocm720-aiter
Feb 12, 2026
Merged

Build ROCm7.2 Image with latest AITER v0.1.10.post3#18741
HaiShaw merged 1 commit intosgl-project:mainfrom
HaiShaw:rocm720-aiter

Conversation

@HaiShaw
Copy link
Copy Markdown
Collaborator

@HaiShaw HaiShaw commented Feb 12, 2026

Motivation

Modifications

Accuracy Tests

Benchmarking and Profiling

Checklist

Review Process

  1. Ping Merge Oncalls to start the PR flow. See the PR Merge Process.
  2. Get approvals from CODEOWNERS and other reviewers.
  3. Trigger CI tests with comments or contact authorized users to do so.
    • /tag-run-ci-label, /rerun-failed-ci, /tag-and-rerun-ci
  4. After green CI and required approvals, ask Merge Oncalls to merge.

@gemini-code-assist
Copy link
Copy Markdown
Contributor

Summary of Changes

Hello @HaiShaw, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request updates the ROCm7.2 Docker image configuration to integrate the latest AITER version, 'v0.1.10.post3'. This ensures that all future builds of the ROCm7.2 image will leverage the most recent AITER features and bug fixes, and explicitly enables the AITER build process for the 'gfx950' architecture.

Highlights

  • AITER Version Update: Updated the AITER_COMMIT environment variable from 'v0.1.10.post2' to 'v0.1.10.post3' across all relevant build stages within the ROCm7.2 Dockerfile.
  • AITER Build Enablement: Enabled the BUILD_AITER_ALL flag for the 'gfx950' build stage, changing its value from '0' to '1' to ensure AITER is built for this architecture.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Changelog
  • docker/rocm720.Dockerfile
    • Updated the AITER_COMMIT environment variable to 'v0.1.10.post3'.
    • Set the BUILD_AITER_ALL environment variable to '1' for the 'gfx950' build stage.
Activity
  • No specific activity (comments, reviews, or progress updates) has been recorded for this pull request yet.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown
Contributor

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the AITER version to v0.1.10.post3 and enables the AITER build for the gfx950 architecture in the ROCm 7.2 Dockerfile. The changes are straightforward and align with the goal of using the latest AITER version. I've provided a suggestion to improve the maintainability of the Dockerfile by using a build argument for the version string, which would simplify future updates. I also pointed out a potentially obsolete hot patch that might need to be removed.

Comment thread docker/rocm720.Dockerfile
ENV BUILD_AITER_ALL="1"
ENV BUILD_MOONCAKE="1"
ENV AITER_COMMIT="v0.1.10.post2"
ENV AITER_COMMIT="v0.1.10.post3"
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

medium

I have a couple of suggestions regarding this version update:

  1. Maintainability: The AITER_COMMIT version is hardcoded in multiple places. To improve maintainability, consider defining it as a build argument at the top of the file and reusing it in each stage. This would centralize the version and simplify future updates.
    For example:

    • At the top of the Dockerfile, add: ARG AITER_COMMIT_VERSION="v0.1.10.post3"
    • In each build stage (e.g., after FROM ... AS gfx942), add: ARG AITER_COMMIT_VERSION
    • Then, replace this line and other similar lines with: ENV AITER_COMMIT=$AITER_COMMIT_VERSION
  2. Potentially Obsolete Patch: The hot patch for AITER on lines 139-149 is commented as being for v0.1.10.post1. Since you're updating to v0.1.10.post3, this patch might be obsolete. If the issue it addresses is fixed in the new version, removing the patch would be cleaner and safer.

@HaiShaw HaiShaw merged commit f441747 into sgl-project:main Feb 12, 2026
43 checks passed
Johnsonms pushed a commit to Johnsonms/sglang that referenced this pull request Feb 14, 2026
magicYang1573 pushed a commit to magicYang1573/sglang that referenced this pull request Mar 9, 2026
Wangzheee pushed a commit to Wangzheee/sglang that referenced this pull request Mar 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant