Skip to content

Use development version of distributed in CI#7279

Merged
jrbourbeau merged 1 commit intodask:masterfrom
jrbourbeau:dev-distributed-ci
Feb 26, 2021
Merged

Use development version of distributed in CI#7279
jrbourbeau merged 1 commit intodask:masterfrom
jrbourbeau:dev-distributed-ci

Conversation

@jrbourbeau
Copy link
Member

This PR updates our CI to use the latest development version of distributed. This is needed when changes are co-introduced in dask and distributed (e.g. #7179 / dask/distributed#4489). Note that distributeds CI already points to the development version of dask -- when reviewing #7179 I mistakenly thought that we also did the same thing for dasks CI.

cc @madsbk

Copy link
Member

@jakirkham jakirkham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Thanks James 😄

Copy link
Member

@jakirkham jakirkham left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry missed one thing that we had in distributed that we may need here to ensure things get installed correctly

- mmh3
- pip
- pip:
- git+https://github.com/dask/distributed
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We may need this workaround borrowed from distributed

Suggested change
- git+https://github.com/dask/distributed
- git+https://github.com/dask/distributed.git@master

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good thinking. I was wondering about that myself, but it looks like the correct version of distributed of getting installed (see https://github.com/dask/dask/pull/7279/checks?check_run_id=1989339554#step:5:82) in the Python 3.6 CI builds. This is what I get when using the latest distributed commit (dask/distributed@7f8bb81) locally:

In [1]: import distributed

In [2]: distributed.__version__
Out[2]: '2021.02.0+17.g7f8bb817'

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok great! Yeah if we don't need it, let's skip it

@jrbourbeau
Copy link
Member Author

Thanks for reviewing @jakirkham!

@jrbourbeau jrbourbeau merged commit 1f3226f into dask:master Feb 26, 2021
@jrbourbeau jrbourbeau deleted the dev-distributed-ci branch February 26, 2021 18:52
@jakirkham
Copy link
Member

Ofc! Thanks for the fix James 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants