Skip to content

PR: Make CI jobs much faster & less flaky w/Mamba, 1-pass solve & other tweaks#425

Merged
dalthviz merged 3 commits intospyder-ide:masterfrom
CAM-Gerlach:ci-use-mamba
Apr 10, 2023
Merged

PR: Make CI jobs much faster & less flaky w/Mamba, 1-pass solve & other tweaks#425
dalthviz merged 3 commits intospyder-ide:masterfrom
CAM-Gerlach:ci-use-mamba

Conversation

@CAM-Gerlach
Copy link
Copy Markdown
Member

@CAM-Gerlach CAM-Gerlach commented Apr 9, 2023

As originally prompted by the fix recommended in conda/conda#12390 for the CI issue in #423 , this will use Mamba rather than Conda on the CIs, which not only has stable, accurate solves avoiding that issue and other potential similar ones, but also speeds up the Conda=yes jobs (which are currently the slowest) by around ≈2x total, and should also avoid the timeout/hang issues we sometimes see especially on macOS (and occasionally Windows).

Also:

  • Create the environment for each binding and install packages all in one pass, rather than a separate install step for Qt/bindings, for a further substantial speedup
  • Use a unique environment name for each binding to avoid needing to remove the environment before creating it
  • Tweak various shell options for CI bash commands/scripts

Fixes #423

@CAM-Gerlach CAM-Gerlach self-assigned this Apr 9, 2023
@CAM-Gerlach CAM-Gerlach changed the title PR: Use Mamba to greatly speed up CI jobs and avoid flaky resolution issues PR: Make CI jobs much faster & less flaky w/Mamba, 1-pass solve & other tweaks Apr 9, 2023
@CAM-Gerlach CAM-Gerlach added this to the v2.4.0 milestone Apr 9, 2023
@CAM-Gerlach CAM-Gerlach marked this pull request as ready for review April 9, 2023 06:47
Copy link
Copy Markdown
Member

@ccordoba12 ccordoba12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, thanks @CAM-Gerlach!

Copy link
Copy Markdown
Member

@dalthviz dalthviz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @CAM-Gerlach !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix flaky importlib error on Ubuntu Python 3.7 conda CI job

3 participants