-
Notifications
You must be signed in to change notification settings - Fork 450
Backporting n_jobs=None to joblib 0.11.1 #786
Description
As mentioned by @ogrisel on Gitter (regarding using joblib <0.12 with latest scikit-learn),
The problem is that we cannot easily revert back to to 0.11 unfortunately: the use n_jobs=None change prevents that. We could issue a joblib 0.11.1 release for which n_jobs=None would be accepted an treated as n_jobs=1.
If it is possible to make such a release, I think it would be very useful.
Currently, scikit-learn 0.20, can only work with joblib 0.12 that also uses loky as the default back-end. For any issue, that affects loky, it means that that scikit-learn users need to wait for the issue to be fixed upstream. I don't doubt that most issues (if any are discovered) will be resolved, however I think it's also important to give users a quick workaround if needed, in any case.
For Linux distributions that package scikit-learn and joblib separately I think it also doesn't hurt to have a larger range of compatible versions.
Another use case for this is that I am currently working on packaging joblib for Pyodide, and I wanted to start with joblib 0.11 as that the WebAssembly environment doesn't support creating threads/processes yet, so all the additions in the vendored loky in that context mean just more possibilities to fail by calling unsupported parts of the stdlib. And as mentioned earlier that version of joblib doesn't work with scikit-learn 0.20...
This would be very much appreciated.