Skip to content

[DO NOT MERGE] Try PyArrow nightly release#6936

Closed
jrbourbeau wants to merge 4 commits intodask:masterfrom
jrbourbeau:pyarrow-nightly
Closed

[DO NOT MERGE] Try PyArrow nightly release#6936
jrbourbeau wants to merge 4 commits intodask:masterfrom
jrbourbeau:pyarrow-nightly

Conversation

@jrbourbeau
Copy link
Member

This is just to see if CI passes with the nightly version of pyarrrow, in anticipation of a new pyarrrow release (xref #6772 (comment))

  • Tests added / passed
  • Passes black dask / flake8 dask

@jrbourbeau jrbourbeau mentioned this pull request Dec 4, 2020
2 tasks
@jorisvandenbossche
Copy link
Member

I think the nightly wheel building is currently only working for linux, and those builds also pass (I think mac and windows are getting older nightly wheels).

Copy link
Member

@jorisvandenbossche jorisvandenbossche left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for checking this!

# Try nightly version of pyarrow
conda uninstall --force pyarrow
python -m pip install --extra-index-url https://pypi.fury.io/arrow-nightlies/ \
--pre pyarrow
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could also put this in the if [[ ${UPSTREAM_DEV} ]] block above, and then actually merge this?

Comment on lines +27 to +29
conda uninstall --force pyarrow
python -m pip install --extra-index-url https://pypi.fury.io/arrow-nightlies/ \
--pre pyarrow
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that you can also install pyarrow from arrow-nightlies conda channel. There all possible combinations that are on conda-forge are also available.

@jorisvandenbossche
Copy link
Member

For some reason, for python 3.6, it's installing pyarrow 0.13 from the conda-forge channel, and not the nightly (which causes the failure on those builds)

For windows, it's still choosing the pyarrow 2.0.0 version from the conda-forge channel, and not the one from the nightlies channel for some reason. So those builds are also failing with the original failures we saw for pyarrow 2.0.0 on windows (one of the original reasons this version is being skipped on CI)

@jrbourbeau
Copy link
Member Author

Closing in favor of #7030 (thanks @jorisvandenbossche!)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants