Sometimes we want to run the same cross validation experiment multiple times to get an idea of variance across replicates. Currently, it's not easy to manipulate the seed that's used to generate the folds. It's hard coded in learner.py
It would be nice if this could be a parameter that could be manipulated, either in the config directly, or minimally through the api.