Since test_mlp.test_gradient() has failed on CI before (#13193 (comment)), it'd be good to fix the random seed used to generate X.

For the test to stay robust, we can also increase the number of generated samples from 5 to 100.