I have noticed that one could make a typo in the config file and DeepSpeed silently ignores it. e.g. I did:

    "gradient_clipp1ng": 1

and got no errors.

Not sure if it should validate the value as well, as float is expected, but I guess int is fine as it's just converted to float.

This lack of validation could lead to user errors which could be hard to notice.

Nothing urgent, but at some point it'd be good to tell the user if they added a config entry which is invalid.

Thank you.