Skip to content

Backporting n_jobs=None to joblib 0.11.1 #786

@rth

Description

@rth

As mentioned by @ogrisel on Gitter (regarding using joblib <0.12 with latest scikit-learn),

The problem is that we cannot easily revert back to to 0.11 unfortunately: the use n_jobs=None change prevents that. We could issue a joblib 0.11.1 release for which n_jobs=None would be accepted an treated as n_jobs=1.

If it is possible to make such a release, I think it would be very useful.

Currently, scikit-learn 0.20, can only work with joblib 0.12 that also uses loky as the default back-end. For any issue, that affects loky, it means that that scikit-learn users need to wait for the issue to be fixed upstream. I don't doubt that most issues (if any are discovered) will be resolved, however I think it's also important to give users a quick workaround if needed, in any case.

For Linux distributions that package scikit-learn and joblib separately I think it also doesn't hurt to have a larger range of compatible versions.

Another use case for this is that I am currently working on packaging joblib for Pyodide, and I wanted to start with joblib 0.11 as that the WebAssembly environment doesn't support creating threads/processes yet, so all the additions in the vendored loky in that context mean just more possibilities to fail by calling unsupported parts of the stdlib. And as mentioned earlier that version of joblib doesn't work with scikit-learn 0.20...

This would be very much appreciated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions