Skip to content

Merge dask-expr repository into dask#11623

Merged
fjetter merged 940 commits intodask:mainfrom
phofl:merge-prep
Jan 8, 2025
Merged

Merge dask-expr repository into dask#11623
fjetter merged 940 commits intodask:mainfrom
phofl:merge-prep

Conversation

@phofl
Copy link
Copy Markdown
Collaborator

@phofl phofl commented Dec 23, 2024

  • Closes #xxxx
  • Tests added / passed
  • Passes pre-commit run --all-files

phofl and others added 30 commits February 14, 2024 16:12
…assign (dask#887)

Co-authored-by: Hendrik Makait <hendrik@makait.com>
Co-authored-by: Patrick Hoefler <61934744+phofl@users.noreply.github.com>
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Dec 23, 2024

Unit Test Results

See test report for an extended history of previous test failures. This is useful for diagnosing flaky tests.

     15 files  ±     0       15 suites  ±0   4h 31m 57s ⏱️ + 41m 3s
 17 158 tests + 4 546   15 963 ✅ + 4 514   1 195 💤 + 32  0 ❌ ±0 
211 407 runs  +54 509  194 226 ✅ +53 984  17 181 💤 +525  0 ❌ ±0 

Results for commit a817ce9. ± Comparison against base commit d280e16.

This pull request removes 7 and adds 4553 tests. Note that renamed tests count towards both.
dask.tests.test_spark_compat ‑ test_roundtrip_hive_parquet_spark_to_dask[fastparquet]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-10]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-1]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-5]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-10]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-1]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-5]
dask.dataframe.dask_expr.io.tests.test_delayed ‑ test_from_delayed[None]
dask.dataframe.dask_expr.io.tests.test_delayed ‑ test_from_delayed[foo]
dask.dataframe.dask_expr.io.tests.test_delayed ‑ test_from_delayed_dask
dask.dataframe.dask_expr.io.tests.test_delayed ‑ test_from_delayed_fusion
dask.dataframe.dask_expr.io.tests.test_delayed ‑ test_from_delayed_optimizing
dask.dataframe.dask_expr.io.tests.test_distributed
dask.dataframe.dask_expr.io.tests.test_distributed ‑ test_io_fusion_merge
dask.dataframe.dask_expr.io.tests.test_distributed ‑ test_parquet_distriuted[arrow]
dask.dataframe.dask_expr.io.tests.test_distributed ‑ test_pickle_size[arrow]
dask.dataframe.dask_expr.io.tests.test_from_pandas ‑ test_from_pandas[DataFrame-False]
…
This pull request removes 7 skipped tests and adds 39 skipped tests. Note that renamed tests count towards both.
dask.tests.test_spark_compat ‑ test_roundtrip_hive_parquet_spark_to_dask[fastparquet]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-10]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-1]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_dask_to_spark[fastparquet-5]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-10]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-1]
dask.tests.test_spark_compat ‑ test_roundtrip_parquet_spark_to_dask[fastparquet-5]
dask.dataframe.dask_expr.io.tests.test_distributed
dask.dataframe.dask_expr.io.tests.test_sql
dask.dataframe.dask_expr.tests.test_collection ‑ test_ffill_and_bfill[0-bfill-None]
dask.dataframe.dask_expr.tests.test_collection ‑ test_ffill_and_bfill[0-ffill-None]
dask.dataframe.dask_expr.tests.test_collection ‑ test_ffill_and_bfill[index-bfill-None]
dask.dataframe.dask_expr.tests.test_collection ‑ test_ffill_and_bfill[index-ffill-None]
dask.dataframe.dask_expr.tests.test_collection ‑ test_shift[1-1h-1]
dask.dataframe.dask_expr.tests.test_collection ‑ test_shift[1-1h-2]
dask.dataframe.dask_expr.tests.test_collection ‑ test_shift[1-freq2-1]
dask.dataframe.dask_expr.tests.test_collection ‑ test_shift[1-freq2-2]
…

♻️ This comment has been updated with latest results.

@phofl
Copy link
Copy Markdown
Collaborator Author

phofl commented Dec 23, 2024

We will have to use a merge commit here, not squash commit

@phofl phofl force-pushed the merge-prep branch 2 times, most recently from 2d14d9b to 03776e7 Compare December 24, 2024 10:42
@fjetter
Copy link
Copy Markdown
Member

fjetter commented Jan 7, 2025

have we figured out the docs redirect problem?

Remove duplicated files and clean up merge
@phofl
Copy link
Copy Markdown
Collaborator Author

phofl commented Jan 7, 2025

have we figured out the docs redirect problem?

Not yet, but most of them will be in the same place anyway, we should be able to fix the remaining ones through moving the place where we are importing them from hopefully. That's something I'd tackle after this is in though

@fjetter
Copy link
Copy Markdown
Member

fjetter commented Jan 7, 2025

A note to myself: We will have to change the repo settings to allow merges without squashing to preserve the git history

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.