Borrowed from #3588 (comment)

Basically Dask appears to load all of the intermediate chunks in memory well before they are used. In some workloads this can exhaust the available memory and crash the workers. Would be good to adjust the task priority to take this into account.