Originally reported by @ogrisel and @jorisvandenbossche in https://github.com/dask/dask-ml/pull/62#pullrequestreview-71802786