Skip to content

ZeRO checkpointing to support torch.optim.Adam #332

New issue
New issue
Closed
#337
Closed
ZeRO checkpointing to support torch.optim.Adam#332
#337
Assignees
tjruwase
@tjruwase

Description

@tjruwase
tjruwase
opened on Aug 24, 2020

ZeRO checkpointing currently works only for apex's fused_adam, but not for torch's adam.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions