Skip to content

bump emerging-optimizer package for deepseek v4 coefficients type#4523

Closed
FDecaYed wants to merge 501 commits into
NVIDIA:mainfrom
FDecaYed:deyuf/muon_dsv4
Closed

bump emerging-optimizer package for deepseek v4 coefficients type#4523
FDecaYed wants to merge 501 commits into
NVIDIA:mainfrom
FDecaYed:deyuf/muon_dsv4

Conversation

@FDecaYed

@FDecaYed FDecaYed commented Apr 29, 2026

Copy link
Copy Markdown
Contributor

What does this PR do ?

⚠️ For major changes (either in lines of code or in its impact), please make sure to first share a design doc with the team. If you're unsure what's the best way to do so, contact the @mcore-oncall.

Issue tracking

For PRs from open-source community contributors:

  • New features: a linked issue is required. Please open a feature request and reference it here before submitting the PR.
  • Small updates (bug fixes, minor improvements): a linked issue is recommended and will accelerate the PR review process.

Linked issue:

Contribution process

Pre-checks

  • I have added relevant unit tests
  • I have added relevant functional tests
  • I have added proper typing to my code Typing guidelines
  • I have added relevant documentation
  • I have run the autoformatter.sh on my PR

Code review

Feel free to message or comment the @mcore-oncall to help accelerate your merge into main. The less complex your PR is, the faster it will be approved and merged!

All PRs start as draft. If you open a non-draft PR, it will be automatically converted to draft.

Step 1: Mark PR as "Ready for Review"

  1. When your PR is ready, click Ready for Review.
  2. An oncall reviewer is auto-assigned and expert reviewers are notified based on your changes.
    • Some PRs may jump straight to step 2. This is determined by .github/CODEOWNERS.

⚠️ Only mark as ready once merge-conflicts are resolved and the CI is passing.
Final Review might get declined if these requirements are not fulfilled.

Step 2: Final Review

For PRs that change megatron/core, once all expert reviewers have approved, the Final Review label is applied automatically and final reviewers are assigned.

For PRs outside megatron/core, this step is skipped.

Step 3: Approved

Once all required reviewers have approved, the Approved label is applied automatically.

Merge

Any member of mcore-engineers will be able to merge your PR.

For MRs into `dev` branch The proposed review process for `dev` branch is under active discussion.

MRs are mergable after one approval by either eharper@nvidia.com or zijiey@nvidia.com.

xuwchen and others added 30 commits January 16, 2026 06:55
@xuwchen
[Dev] docs(megatron-fsdp): add Megatron-FSDP user guide (NVIDIA#2397)
b927e1f
@hxbai @yaox12
[Dev] Optimizer State and Master Weight Offloading (NVIDIA#2760)
6b157e0 
Co-authored-by: Xin Yao <xiny@nvidia.com>
@ko3n1g
Revert "[Dev] Optimizer State and Master Weight Offloading (NVIDIA#2760…
8ac3a9f 
…)" (NVIDIA#2984)
@nanz-nv @Victarry
Forced load imbalance (NVIDIA#2917)
bd8411c 
Co-authored-by: Dennis(Zhenhuan) Liu <denliu@nvidia.com>
@hxbai @yaox12 @ko3n1g
[Dev] [Reapply] Optimizer State and Master Weight Offloading (NVIDIA#…
0a2e01f 
…2987)

Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci(fix): CI_COMMIT_BRANCH on forks (NVIDIA#2982) (NVIDIA#2989)
8abc086 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@Victarry @yanring
[Dev] Update MoE readme. (NVIDIA#2808)
5b17f19 
Co-authored-by: Zijie Yan <zijiey@nvidia.com>
@litianjian @yanring
feat: add routing replay for Mcore (NVIDIA#2693)
9ea50a9 
Co-authored-by: litianjian <litianjian@bytedance.com>
Co-authored-by: Zijie Yan <zijiey@nvidia.com>
@yuzhongw-nvidia @jstjohn @deepakn94
[dev] feat(moe): Support apply wd to qk layernorm for Qwen3-Next (NVI…
ac9f665 
…DIA#2825)

Signed-off-by: John St. John <jstjohn@nvidia.com>
Co-authored-by: John St. John <jstjohn@nvidia.com>
Co-authored-by: Deepak Narayanan <2724038+deepakn94@users.noreply.github.com>
@yuzhongw-nvidia @ko3n1g
[dev] feat(moe): Cherry-pick NVIDIA#1989 back to dev (NVIDIA#3011)
6e2153b 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@lhb8125
[Dev]feat(moe): code refactor for fine grained activation offloading (N…
68e5fec 
…VIDIA#2905)

Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: root <root@eos0321.eos.clusters.nvidia.com>
Co-authored-by: root <root@eos0321.eos.clusters.nvidia.com>
@lhb8125
[Dev] [fix] Bug fix for offloading in evaluate() (NVIDIA#3041)
6807df4 
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
@ko3n1g
ci: Log node name (NVIDIA#3081) (NVIDIA#3082)
b3bba3f 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@FDecaYed @Phlip79
@github-actions @sidsingh-nvidia @tdene @buptzyb @jaredcasper @ko3n1g @lmcafee-nvidia @sbhavani @chtruong814 @maanug-nv @wdykas @HaochenYuan @jenchen13 @asolergi-nv @deepakn94 @tomlifu @shanmugamr1992 @santhnm2 @kanz-nv @mathemakitten @youngeunkwon0405 @nschank @ericharper @WineChord @yaox12 @ChenhanYu @lhb8125 @Wohox @jstjohn @kwyss-nvidia @ankurv-nvidia @jon-barker @yuzhongw-nvidia @kunlunl @shjwudp @cspades @yobibyte @cuichenx @yaoyu-33 @dimapihtar @zhongbozhu @yanring @skyw @BoxiangW @mkhona-nvidia @AAnoosheh @hexinw-nvidia @rhewett-nv @BestJuly @shifangx @Deepak-J0shi @jkamalu @nvda-bnorick @duncanriach @xuwchen @parthmannan @xiaoyao0115 @jiemingz @yashaswikarnati @thomasdhc
[dev] pull main 260122 (NVIDIA#3045)
a4e3fb3 
Signed-off-by: Robin Zhang <robinz@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
Signed-off-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Signed-off-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: Pingtian Li <pingtianl@nvidia.com>
Signed-off-by: John St. John <jstjohn@nvidia.com>
Signed-off-by: John St John <jstjohn@nvidia.com>
Signed-off-by: kunlunl <kunlunl@nvidia.com>
Signed-off-by: jianbinc <shjwudp@gmail.com>
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com>
Signed-off-by: Boxiang Wang <boxiangw@nvidia.com>
Signed-off-by: Deyu Fu <deyuf@nvidia.com>
Signed-off-by: Hao Wu <skyw@nvidia.com>
Signed-off-by: Asha Anoosheh <aanoosheh@nvidia.com>
Signed-off-by: Li Tao <lit@nvidia.com>
Signed-off-by: lit <lit@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
Signed-off-by: root <root@eos0321.eos.clusters.nvidia.com>
Signed-off-by: tailaim <tailaim@nvidia.com>
Signed-off-by: Parth Mannan <pmannan@nvidia.com>
Signed-off-by: Cory Ye <cye@nvidia.com>
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
Signed-off-by: Jieming Zhang <jiemingz@nvidia.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Robin Zhang <robinz@nvidia.com>
Co-authored-by: Jared Casper <155158+jaredcasper@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Lawrence McAfee <85179052+lmcafee-nvidia@users.noreply.github.com>
Co-authored-by: Santosh Bhavani <santosh.bhavani@live.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
Co-authored-by: Maanu Grover <109391026+maanug-nv@users.noreply.github.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
Co-authored-by: wdykas <73254672+wdykas@users.noreply.github.com>
Co-authored-by: William Dykas <wdykas@cw-pdx-cs-001-vscode-02.cm.cluster>
Co-authored-by: root <root@gpu-h100-0371.cm.cluster>
Co-authored-by: root <root@gpu-h100-0159.cm.cluster>
Co-authored-by: HaochenYuan <106647990+HaochenYuan@users.noreply.github.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Jenny Chen <jennifchen@nvidia.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Co-authored-by: Deepak Narayanan <2724038+deepakn94@users.noreply.github.com>
Co-authored-by: Lifu Zhang <lifuz@nvidia.com>
Co-authored-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Kan Zhu <kanz@nvidia.com>
Co-authored-by: helen ngo <helenn@nvidia.com>
Co-authored-by: Youngeun Kwon <youngeunk@nvidia.com>
Co-authored-by: Nick Schank <nicolas.schank@gmail.com>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Nick Schank <nick@reflection.ai>
Co-authored-by: wineandchord <guoqizhou123123@qq.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Chenhan D. Yu <5185878+ChenhanYu@users.noreply.github.com>
Co-authored-by: Hongbin Liu <lhb8125@users.noreply.github.com>
Co-authored-by: Pingtian Li <pingtianl@nvidia.com>
Co-authored-by: John St. John <jstjohn@users.noreply.github.com>
Co-authored-by: kwyss-nvidia <kwyss@nvidia.com>
Co-authored-by: ankurv-nvidia <ankurv@nvidia.com>
Co-authored-by: Deepak Narayanan <dnarayanan@nvidia.com>
Co-authored-by: Jon Barker <jbarker@nvidia.com>
Co-authored-by: root <root@gpu-h100-0348.cm.cluster>
Co-authored-by: root <root@gpu-h100-0193.cm.cluster>
Co-authored-by: root <root@gpu-h100-0082.cm.cluster>
Co-authored-by: root <root@gpu-h100-0495.cm.cluster>
Co-authored-by: root <root@gpu-h100-0213.cm.cluster>
Co-authored-by: root <root@gpu-h100-0435.cm.cluster>
Co-authored-by: root <root@gpu-h100-0188.cm.cluster>
Co-authored-by: root <root@gpu-h100-0032.cm.cluster>
Co-authored-by: root <root@gpu-h100-0023.cm.cluster>
Co-authored-by: root <root@gpu-h100-0368.cm.cluster>
Co-authored-by: root <root@gpu-h100-0203.cm.cluster>
Co-authored-by: root <root@gpu-h100-0229.cm.cluster>
Co-authored-by: root <root@gpu-h100-0123.cm.cluster>
Co-authored-by: root <root@gpu-h100-0217.cm.cluster>
Co-authored-by: root <root@gpu-h100-0496.cm.cluster>
Co-authored-by: root <root@gpu-h100-0022.cm.cluster>
Co-authored-by: root <root@gpu-h100-0176.cm.cluster>
Co-authored-by: root <root@gpu-h100-0190.cm.cluster>
Co-authored-by: Yuzhong Wang <yuzhongw@nvidia.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
Co-authored-by: jianbinc <shjwudp@gmail.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>
Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>
Co-authored-by: Chen Cui <chcui@nvidia.com>
Co-authored-by: Yu Yao <54727607+yaoyu-33@users.noreply.github.com>
Co-authored-by: Mcore Bot <mcore-bot@nvidia.com>
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
Co-authored-by: dimapihtar <dpihtar@gmail.com>
Co-authored-by: Zhongbo Zhu <42691305+zhongbozhu@users.noreply.github.com>
Co-authored-by: Zijie Yan <zijiey@nvidia.com>
Co-authored-by: Hao Wu <skyw@nvidia.com>
Co-authored-by: Boxiang Wang <boxiangw@nvidia.com>
Co-authored-by: mikail <mkhona@nvidia.com>
Co-authored-by: root <root@gpu-h100-0261.cm.cluster>
Co-authored-by: root <root@gpu-h100-0029.cm.cluster>
Co-authored-by: root <root@gpu-h100-0215.cm.cluster>
Co-authored-by: Asha Anoosheh <aanoosheh@nvidia.com>
Co-authored-by: Hexin Wang <160587990+hexinw-nvidia@users.noreply.github.com>
Co-authored-by: Russell Hewett <rhewett@nvidia.com>
Co-authored-by: Li Tao <lit@nvidia.com>
Co-authored-by: shifangx <shifangx@nvidia.com>
Co-authored-by: Deepak Joshi <151525321+Deepak-J0shi@users.noreply.github.com>
Co-authored-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
Co-authored-by: root <root@eos0321.eos.clusters.nvidia.com>
Co-authored-by: John Kamalu <jkamalu@users.noreply.github.com>
Co-authored-by: Brandon Norick <bnorick@nvidia.com>
Co-authored-by: Pingtian Li <158665726+Wohox@users.noreply.github.com>
Co-authored-by: Duncan Riach <33532941+duncanriach@users.noreply.github.com>
Co-authored-by: xuwchen <79835960+xuwchen@users.noreply.github.com>
Co-authored-by: John St. John <jstjohn@nvidia.com>
Co-authored-by: Parth Mannan <38387286+parthmannan@users.noreply.github.com>
Co-authored-by: tailaim <tailaim@nvidia.com>
Co-authored-by: kunlunl <kunlunl@nvidia.com>
Co-authored-by: Jimmy Zhang <133159885+jiemingz@users.noreply.github.com>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
Co-authored-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@thomasdhc @FDecaYed
ci: Skip test_precision_aware_optimizer (NVIDIA#3062)
420aa6a 
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@FDecaYed
Merge branch 'main' into deyuf/dev_pull_main_260122_fix_git
da56650
@ko3n1g @Phlip79
@github-actions @sidsingh-nvidia @tdene @buptzyb @jaredcasper @lmcafee-nvidia @sbhavani @chtruong814 @maanug-nv @wdykas @HaochenYuan @jenchen13 @asolergi-nv @deepakn94 @tomlifu @shanmugamr1992 @santhnm2 @kanz-nv @mathemakitten @youngeunkwon0405 @nschank @ericharper @WineChord @yaox12 @ChenhanYu @lhb8125 @Wohox @jstjohn @kwyss-nvidia @ankurv-nvidia @jon-barker @yuzhongw-nvidia @kunlunl @shjwudp @cspades @yobibyte @cuichenx @yaoyu-33 @dimapihtar @zhongbozhu @yanring @skyw @BoxiangW @mkhona-nvidia @AAnoosheh @hexinw-nvidia @rhewett-nv @BestJuly @shifangx @Deepak-J0shi @jkamalu @nvda-bnorick @duncanriach @xuwchen @parthmannan @xiaoyao0115 @jiemingz @yashaswikarnati @thomasdhc
[dev] fix git history for dev pull main 260122 (NVIDIA#3094)
08357d8 
Signed-off-by: Robin Zhang <robinz@nvidia.com>
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Charlie Truong <chtruong@nvidia.com>
Signed-off-by: Maanu Grover <maanug@nvidia.com>
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
Signed-off-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Signed-off-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Signed-off-by: Keshav Santhanam <ksanthanam@nvidia.com>
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
Signed-off-by: Pingtian Li <pingtianl@nvidia.com>
Signed-off-by: John St. John <jstjohn@nvidia.com>
Signed-off-by: John St John <jstjohn@nvidia.com>
Signed-off-by: kunlunl <kunlunl@nvidia.com>
Signed-off-by: jianbinc <shjwudp@gmail.com>
Signed-off-by: Deepak Narayanan <dnarayanan@nvidia.com>
Signed-off-by: dimapihtar <dpihtar@gmail.com>
Signed-off-by: Zhongbo Zhu <zhongboz@nvidia.com>
Signed-off-by: Boxiang Wang <boxiangw@nvidia.com>
Signed-off-by: Deyu Fu <deyuf@nvidia.com>
Signed-off-by: Hao Wu <skyw@nvidia.com>
Signed-off-by: Asha Anoosheh <aanoosheh@nvidia.com>
Signed-off-by: Li Tao <lit@nvidia.com>
Signed-off-by: lit <lit@nvidia.com>
Signed-off-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
Signed-off-by: root <root@eos0321.eos.clusters.nvidia.com>
Signed-off-by: tailaim <tailaim@nvidia.com>
Signed-off-by: Parth Mannan <pmannan@nvidia.com>
Signed-off-by: Cory Ye <cye@nvidia.com>
Signed-off-by: Jimmy Zhang <jiemingz@nvidia.com>
Signed-off-by: Jieming Zhang <jiemingz@nvidia.com>
Signed-off-by: Dong Hyuk Chang <donghyukc@nvidia.com>
Co-authored-by: Philip Petrakian <ppetrakian@nvidia.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Siddharth Singh <136645615+sidsingh-nvidia@users.noreply.github.com>
Co-authored-by: Teodor-Dumitru Ene <teodord.ene@gmail.com>
Co-authored-by: Robin Zhang <robinz@nvidia.com>
Co-authored-by: Jared Casper <155158+jaredcasper@users.noreply.github.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
Co-authored-by: Lawrence McAfee <85179052+lmcafee-nvidia@users.noreply.github.com>
Co-authored-by: Santosh Bhavani <santosh.bhavani@live.com>
Co-authored-by: Charlie Truong <chtruong@nvidia.com>
Co-authored-by: Maanu Grover <109391026+maanug-nv@users.noreply.github.com>
Co-authored-by: Teodor-Dumitru Ene <34819528+tdene@users.noreply.github.com>
Co-authored-by: wdykas <73254672+wdykas@users.noreply.github.com>
Co-authored-by: William Dykas <wdykas@cw-pdx-cs-001-vscode-02.cm.cluster>
Co-authored-by: root <root@gpu-h100-0371.cm.cluster>
Co-authored-by: root <root@gpu-h100-0159.cm.cluster>
Co-authored-by: HaochenYuan <106647990+HaochenYuan@users.noreply.github.com>
Co-authored-by: Philip Petrakian <pgpetrak@gmail.com>
Co-authored-by: Jenny Chen <jennifchen@nvidia.com>
Co-authored-by: Antoni-Joan Solergibert <asolergibert@nvidia.com>
Co-authored-by: Deepak Narayanan <2724038+deepakn94@users.noreply.github.com>
Co-authored-by: Lifu Zhang <lifuz@nvidia.com>
Co-authored-by: Lifu Zhang <lifuz@login-lyris01.lyris.clusters.nvidia.com>
Co-authored-by: Shanmugam Ramasamy <111910568+shanmugamr1992@users.noreply.github.com>
Co-authored-by: Shanmugam Ramasamy <shanmugamr@cw-dfw-cs-001-login-01.cm.cluster>
Co-authored-by: Keshav Santhanam <ksanthanam@nvidia.com>
Co-authored-by: Kan Zhu <kanz@nvidia.com>
Co-authored-by: helen ngo <helenn@nvidia.com>
Co-authored-by: Youngeun Kwon <youngeunk@nvidia.com>
Co-authored-by: Nick Schank <nicolas.schank@gmail.com>
Co-authored-by: Eric Harper <eharper@nvidia.com>
Co-authored-by: Nick Schank <nick@reflection.ai>
Co-authored-by: wineandchord <guoqizhou123123@qq.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
Co-authored-by: Chenhan D. Yu <5185878+ChenhanYu@users.noreply.github.com>
Co-authored-by: Hongbin Liu <lhb8125@users.noreply.github.com>
Co-authored-by: Pingtian Li <pingtianl@nvidia.com>
Co-authored-by: John St. John <jstjohn@users.noreply.github.com>
Co-authored-by: kwyss-nvidia <kwyss@nvidia.com>
Co-authored-by: ankurv-nvidia <ankurv@nvidia.com>
Co-authored-by: Deepak Narayanan <dnarayanan@nvidia.com>
Co-authored-by: Jon Barker <jbarker@nvidia.com>
Co-authored-by: root <root@gpu-h100-0348.cm.cluster>
Co-authored-by: root <root@gpu-h100-0193.cm.cluster>
Co-authored-by: root <root@gpu-h100-0082.cm.cluster>
Co-authored-by: root <root@gpu-h100-0495.cm.cluster>
Co-authored-by: root <root@gpu-h100-0213.cm.cluster>
Co-authored-by: root <root@gpu-h100-0435.cm.cluster>
Co-authored-by: root <root@gpu-h100-0188.cm.cluster>
Co-authored-by: root <root@gpu-h100-0032.cm.cluster>
Co-authored-by: root <root@gpu-h100-0023.cm.cluster>
Co-authored-by: root <root@gpu-h100-0368.cm.cluster>
Co-authored-by: root <root@gpu-h100-0203.cm.cluster>
Co-authored-by: root <root@gpu-h100-0229.cm.cluster>
Co-authored-by: root <root@gpu-h100-0123.cm.cluster>
Co-authored-by: root <root@gpu-h100-0217.cm.cluster>
Co-authored-by: root <root@gpu-h100-0496.cm.cluster>
Co-authored-by: root <root@gpu-h100-0022.cm.cluster>
Co-authored-by: root <root@gpu-h100-0176.cm.cluster>
Co-authored-by: root <root@gpu-h100-0190.cm.cluster>
Co-authored-by: Yuzhong Wang <yuzhongw@nvidia.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
Co-authored-by: jianbinc <shjwudp@gmail.com>
Co-authored-by: Cory Ye <44509866+cspades@users.noreply.github.com>
Co-authored-by: shanmugamr1992 <shanmugamr1992@gmail.com>
Co-authored-by: yobi byte <yobibyte@users.noreply.github.com>
Co-authored-by: Chen Cui <chcui@nvidia.com>
Co-authored-by: Yu Yao <54727607+yaoyu-33@users.noreply.github.com>
Co-authored-by: Mcore Bot <mcore-bot@nvidia.com>
Co-authored-by: Dmytro Pykhtar <37850217+dimapihtar@users.noreply.github.com>
Co-authored-by: dimapihtar <dpihtar@gmail.com>
Co-authored-by: Zhongbo Zhu <42691305+zhongbozhu@users.noreply.github.com>
Co-authored-by: Zijie Yan <zijiey@nvidia.com>
Co-authored-by: Hao Wu <skyw@nvidia.com>
Co-authored-by: Boxiang Wang <boxiangw@nvidia.com>
Co-authored-by: mikail <mkhona@nvidia.com>
Co-authored-by: root <root@gpu-h100-0261.cm.cluster>
Co-authored-by: root <root@gpu-h100-0029.cm.cluster>
Co-authored-by: root <root@gpu-h100-0215.cm.cluster>
Co-authored-by: Asha Anoosheh <aanoosheh@nvidia.com>
Co-authored-by: Hexin Wang <160587990+hexinw-nvidia@users.noreply.github.com>
Co-authored-by: Russell Hewett <rhewett@nvidia.com>
Co-authored-by: Li Tao <lit@nvidia.com>
Co-authored-by: shifangx <shifangx@nvidia.com>
Co-authored-by: Deepak Joshi <151525321+Deepak-J0shi@users.noreply.github.com>
Co-authored-by: Hongbin Liu <hongbinl@cw-dfw-cs-001-login-02.cm.cluster>
Co-authored-by: root <root@eos0321.eos.clusters.nvidia.com>
Co-authored-by: John Kamalu <jkamalu@users.noreply.github.com>
Co-authored-by: Brandon Norick <bnorick@nvidia.com>
Co-authored-by: Pingtian Li <158665726+Wohox@users.noreply.github.com>
Co-authored-by: Duncan Riach <33532941+duncanriach@users.noreply.github.com>
Co-authored-by: xuwchen <79835960+xuwchen@users.noreply.github.com>
Co-authored-by: John St. John <jstjohn@nvidia.com>
Co-authored-by: Parth Mannan <38387286+parthmannan@users.noreply.github.com>
Co-authored-by: tailaim <tailaim@nvidia.com>
Co-authored-by: kunlunl <kunlunl@nvidia.com>
Co-authored-by: Jimmy Zhang <133159885+jiemingz@users.noreply.github.com>
Co-authored-by: Yashaswi Karnati <144376261+yashaswikarnati@users.noreply.github.com>
Co-authored-by: Dong Hyuk Chang <donghyukc@nvidia.com>
@FDecaYed @yuzhongw-nvidia @ko3n1g
[dev] fixes for pull main 260122 (NVIDIA#3103)
0f82f05 
Signed-off-by: oliver könig <okoenig@nvidia.com>
Signed-off-by: Deyu Fu <deyuf@nvidia.com>
Co-authored-by: Yuzhong Wang <yuzhongw@nvidia.com>
Co-authored-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
ci: Disable broken test (NVIDIA#3121)
0ceb698 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@BestJuly @skydoorkai @kunlunl
[Dev] Param offset in _ParamAndGradBucket should be aligned (NVIDIA#3010
f6f2abe 
)

Signed-off-by: skydoorkai <htsantaclara@163.com>
Co-authored-by: skydoorkai <htsantaclara@163.com>
Co-authored-by: Kunlun Li <94586211+kunlunl@users.noreply.github.com>
@Wohox
[Dev] fix cg missing wgrad hook (NVIDIA#2999)
d587dd1
@shjwudp @yanring
[Megatron-FSDP] Add fsdp_all_gather_in_start_param_sync option in DDP…
8f8f735 
… Config (NVIDIA#2627)

Co-authored-by: Zijie Yan <zijiey@nvidia.com>
@wplf @shjwudp
[Dev] Support EP with HSDP (NVIDIA#2800)
bde9e32 
Signed-off-by: jinliangl <jinliangl@nvidia.com>
Co-authored-by: Jinliang Li <jinliangl@pool0-01676.cm.cluster>
Co-authored-by: Jinliang Li <jinliangl@cw-dfw-cs-001-vscode-01.cm.cluster>
Co-authored-by: Jianbin Chang <shjwudp@gmail.com>
@ko3n1g
Cherrypick CI improvements to dev branch (NVIDIA#3118)
27fcfb2 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@FDecaYed
Merge branch 'main' into deyuf/dev_pull_main_260130
a9fb6c8
@ko3n1g
[dev] ci: Add DSv3 proxy (NVIDIA#3144)
55e3a0a 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@ko3n1g
[dev] ci: Fix DSv3 (NVIDIA#3187)
a78ae49 
Signed-off-by: oliver könig <okoenig@nvidia.com>
@youngeunkwon0405 @yaox12
Fix: nccl-ub in ddp path (NVIDIA#3181)
9375be4 
Signed-off-by: Youngeun Kwon <youngeunk@nvidia.com>
Co-authored-by: Xin Yao <xiny@nvidia.com>
@yuzhongw-nvidia
[dev] perf(moe): Refine gated delta net implementation (NVIDIA#3040)
0f73a8a
@BestJuly
[Dev] Add the missing part to support 1F1B overlap for Qwen3-Next (NV…
5035cbe 
…IDIA#2996)
@FDecaYed FDecaYed requested review from a team as code owners June 12, 2026 12:43
@FDecaYed FDecaYed marked this pull request as draft June 12, 2026 12:45
@FDecaYed

FDecaYed commented Jun 12, 2026

Copy link
Copy Markdown
Contributor Author

close in favor of bumping to v0.3 tag
dev PR: #5320
main PR: #5321

@FDecaYed FDecaYed closed this Jun 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

complexity: medium deepseekv4 DeepSeek V4 PRs

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.