Skip to content

[BUG] #2904

@Rishabh-Choudhry

Description

@Rishabh-Choudhry

Describe the bug

When using deepspeed accelerator with pytorch lightning, I get this error. The issue seems to be the wrong path calling in the deepspeed library for UtilsBuilder class.

File "deepspeed/runtime/engine.py", line 392, in init
util_ops = UtilsBuilder().load()
TypeError: 'NoneType' object is not callable

The issue gets resolved after updating the path from from deepspeed.ops.op_builder import UtilsBuilder to from deepspeed.ops.op_builder.utils import UtilsBuilder.

To Reproduce
Use strategy=DeepSpeedStrategy(stage=2) with torch lightning trainer.

Expected behavior
The deepspeed accelerator should run as normal with pytorch lightning.

System info (please complete the following information):

  • OS: Ubuntu
  • GPU count and types : 1 x NVIDIA T4
  • Python version : 3.8.12

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingtraining

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions