-
Notifications
You must be signed in to change notification settings - Fork 4.7k
Closed
Labels
Description
Describe the bug
When using deepspeed accelerator with pytorch lightning, I get this error. The issue seems to be the wrong path calling in the deepspeed library for UtilsBuilder class.
File "deepspeed/runtime/engine.py", line 392, in init
util_ops = UtilsBuilder().load()
TypeError: 'NoneType' object is not callable
The issue gets resolved after updating the path from from deepspeed.ops.op_builder import UtilsBuilder to from deepspeed.ops.op_builder.utils import UtilsBuilder.
To Reproduce
Use strategy=DeepSpeedStrategy(stage=2) with torch lightning trainer.
Expected behavior
The deepspeed accelerator should run as normal with pytorch lightning.
System info (please complete the following information):
- OS: Ubuntu
- GPU count and types : 1 x NVIDIA T4
- Python version : 3.8.12
Z-MU-Z and ccssyy