Skip to content

Blockwise.clone#7312

Merged
jrbourbeau merged 8 commits intodask:masterfrom
crusaderky:clone
Mar 5, 2021
Merged

Blockwise.clone#7312
jrbourbeau merged 8 commits intodask:masterfrom
crusaderky:clone

Conversation

@crusaderky
Copy link
Collaborator

dask.graph_manipulation.bind and clone will no longer materialize Blockwise layers

@crusaderky
Copy link
Collaborator Author

No new tests as this is already 100% covered by test_graph_manipulation.py

@crusaderky crusaderky changed the title WIP Blockwise.clone Blockwise.clone Mar 4, 2021
@crusaderky crusaderky marked this pull request as ready for review March 4, 2021 15:05
Copy link
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @crusaderky! Could you add a test to ensure cloneing doesn't materialize the Blockwise layer (e.g. using the is_materialized method)

@crusaderky
Copy link
Collaborator Author

@jrbourbeau done

Copy link
Member

@jrbourbeau jrbourbeau left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thanks @crusaderky!

@jrbourbeau jrbourbeau merged commit 0da9696 into dask:master Mar 5, 2021
@crusaderky crusaderky deleted the clone branch March 7, 2021 10:58
dcherian added a commit to dcherian/dask that referenced this pull request Mar 8, 2021
* upstream/master: (43 commits)
  bump version to 2021.03.0
  Bump minimum version of distributed (dask#7328)
  Fix `percentiles_summary` with `dask_cudf` (dask#7325)
  Temporarily revert recent Array.__setitem__ updates (dask#7326)
  Blockwise.clone (dask#7312)
  NEP-35 duck array update (dask#7321)
  Don't allow setting `.name` for array (dask#7222)
  Use nearest interpolation for creating percentiles of integer input (dask#7305)
  Test `exp` with CuPy arrays (dask#7322)
  Check that computed chunks have right size and dtype (dask#7277)
  pytest.mark.flaky (dask#7319)
  Contributing docs: add note to pull the latest git tags before pip installing Dask (dask#7308)
  Support for Python 3.9 (dask#7289)
  Add broadcast-based merge implementation (dask#7143)
  Add split_every to graph_manipulation (dask#7282)
  Typo in optimize docs (dask#7306)
  dask.graph_manipulation support for xarray.Dataset (dask#7276)
  Add plot width and height support for Bokeh 2.3.0 (dask#7297)
  Add numpy functions tri, triu_indices, triu_indices_from, tril_indices, tril_indices_from (dask#6997)
  Remove "cleanup" task in dataframe on-disk shuffle. The partd directory (dask#7260)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants