The version information is as follows:
- Deepspeed. 0.8.1
- transformers. 4.26.1
Problem
When I use Trainer with Deepspeed, the Number of trainable parameters is 0. Like this:

And it happens when using zero3. When I use zero2, it does not have this problem.