Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
71 commits
Select commit Hold shift + click to select a range
b671ca7
support fine-grained activation offloading
lhb8125 Oct 24, 2025
e8fd17f
update years in copyright
lhb8125 Oct 24, 2025
85548e6
update copyright
lhb8125 Oct 27, 2025
5dd6841
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Oct 27, 2025
f5bf8c4
fix ft and import error
Oct 28, 2025
0321e20
address comments
lhb8125 Oct 28, 2025
9068805
format
lhb8125 Oct 28, 2025
61af7fd
update golden values on eos
lhb8125 Oct 28, 2025
b67a0ed
minor fix
lhb8125 Oct 28, 2025
a11d351
format
lhb8125 Oct 28, 2025
b84b5ff
renaming golden values
lhb8125 Oct 29, 2025
2f76430
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Oct 29, 2025
c320e5b
fix bug: accuracy issu because of recomputing and offloading same modul
lhb8125 Nov 4, 2025
896c02f
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Nov 4, 2025
ccb2f8a
Merge branch 'hongbinl/activation_offloading_github_main' of https://…
lhb8125 Nov 4, 2025
aa4c86c
format
lhb8125 Nov 4, 2025
92ce540
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Nov 5, 2025
5787848
update golden values
lhb8125 Nov 5, 2025
7eaec4d
update golden values
lhb8125 Nov 5, 2025
3c68f79
update model_config and golden values
lhb8125 Nov 6, 2025
ee53677
format
lhb8125 Nov 6, 2025
1c1d9c8
remove old golden values
lhb8125 Nov 6, 2025
30f8dec
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Nov 10, 2025
b2a261f
update golden values
lhb8125 Nov 6, 2025
50dc90b
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Nov 18, 2025
0a9b694
support new TE version
lhb8125 Nov 18, 2025
950b26f
move set_ideal_affinity_for_current_gpu to pipeline/util
lhb8125 Nov 18, 2025
495032a
format
lhb8125 Nov 18, 2025
2123564
format
lhb8125 Dec 1, 2025
bd69216
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Dec 1, 2025
8d05dfc
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Dec 9, 2025
9d23103
update golden value
lhb8125 Dec 9, 2025
7b6ebb3
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Dec 9, 2025
743ac56
code refactor
lhb8125 Jan 6, 2026
6829963
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 6, 2026
4b96d05
Merge branch 'hongbinl/activation_offloading_github_main' of https://…
lhb8125 Jan 6, 2026
7d8929b
format
lhb8125 Jan 6, 2026
480cbfa
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 6, 2026
83058e4
bug fix when cuda graph is disabled and fix for dumping offloading info
Jan 7, 2026
9605a67
refactor and update ut
lhb8125 Jan 8, 2026
b7a25ac
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 8, 2026
cb612c7
format
lhb8125 Jan 8, 2026
64ae361
remove unrelated changes
lhb8125 Jan 8, 2026
a8dfa65
fix ut
lhb8125 Jan 8, 2026
2c63e1d
fix ut
lhb8125 Jan 8, 2026
f52069e
fix ut
lhb8125 Jan 8, 2026
0643e55
update ut
lhb8125 Jan 9, 2026
d57ccb0
format
lhb8125 Jan 9, 2026
eadb8a3
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 9, 2026
ff4a2cd
update golden values
lhb8125 Jan 9, 2026
6dc9e2f
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 9, 2026
9555702
fix ut
lhb8125 Jan 9, 2026
9895754
Merge branch 'hongbinl/activation_offloading_github_main' of https://…
lhb8125 Jan 9, 2026
fd2d3fd
add version check
lhb8125 Jan 12, 2026
f8c09fa
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 12, 2026
84d13e9
minor refactor for fine_grained_activation_offload.py
lhb8125 Jan 12, 2026
49f3643
Merge branch 'hongbinl/activation_offloading_github_main' of https://…
lhb8125 Jan 12, 2026
1d1e0ca
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 12, 2026
483d87a
format
lhb8125 Jan 12, 2026
a498067
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 12, 2026
2f42e91
fix doc
lhb8125 Jan 14, 2026
469cef0
code refactor
lhb8125 Jan 14, 2026
c1fdba4
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 14, 2026
b93d212
remove group_start() calls
lhb8125 Jan 14, 2026
16d4114
format
lhb8125 Jan 14, 2026
1964268
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 14, 2026
6263630
add comments
lhb8125 Jan 14, 2026
9423c6b
fix min_offload_size and update golden values
lhb8125 Jan 14, 2026
cc28dd7
rename group_commit
lhb8125 Jan 15, 2026
b7153fa
Merge branch 'main' into hongbinl/activation_offloading_github_main
lhb8125 Jan 15, 2026
871bdaf
fix test_mamba_moe_model.py
lhb8125 Jan 15, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix min_offload_size and update golden values
Signed-off-by: Hongbin Liu <hongbinl@nvidia.com>
  • Loading branch information
lhb8125 committed Jan 14, 2026
commit 9423c6b3b5eefad443e90bbdfbb62a83fe30bf75
2 changes: 1 addition & 1 deletion megatron/training/arguments.py
Original file line number Diff line number Diff line change
Expand Up @@ -2372,7 +2372,7 @@ def _add_training_args(parser):
help='Enable fine-grained activation offloading.')
group.add_argument('--offload-modules', nargs='*', type=str, default=[],
help='The submodules to offload its input. Choices: "attn_norm", "qkv_linear", "core_attn", "attn_proj", "mlp_norm", "expert_fc1", "moe_act".')
group.add_argument('--min-offloaded-tensor-size', type=int, default=10*1024*1024,
group.add_argument('--min-offloaded-tensor-size', type=int, default=1024*1024,
help='The minimum size of the tensor to be offloaded.')
group.add_argument('--batch-invariant-mode', action='store_true',
help='Use batch-invariant kernels for deterministic forward execution regardless '
Expand Down
Loading
Loading