Speed up CircleCI jobs by replacing pip with uv pip#5255
Speed up CircleCI jobs by replacing pip with uv pip#5255cclauss wants to merge 6 commits intopyodide:mainfrom
Conversation
|
This would be more reliable and easier to understand if |
You don't need to activate the virtual environments at least for uv as running |
|
I've personally found some troubles with using the |
|
Thanks for your assistance @dhruvmanila. I believe each CircleCI job step is a new invocation of |
|
Apologies, I was looking at it through the GitHub Mobile app and inadvertently pressed that button. |
DRAFT: Highly experimental!!
Description
Fixes #5228
Creating Pyodide pull requests often requires several commits to get things working correctly and all tests passing. Unfortunately, there are numerous, long test runs on GitHub Actions and CircleCI so waiting for feedback can slow innovation. Pip installing numerous, large dependencies seems to be a substantial portion of the time required to run all these CI jobs.
Could some CI jobs be substantially accelerated using uv pip instead of pip?
If there is interest in trying this and a maintainer can recommend one CI job to start with, I would like to create a proof-of-concept pull request to benchmark the performance improvement of using uv for that job.
Related to:
#5018 (comment)
#5004 (comment)
Let's start just with the instances of
pip installin one file:.circleci/config.yml@dhruvmanila Any advice on how to avoid repeated
source .venv/bin/activatecalls inside complex CircleCI jobs? https://docs.astral.sh/uv does not yet mention CircleCI.Checklists