WIP: Parallelize Continuous Integration test and documentation build#830
WIP: Parallelize Continuous Integration test and documentation build#830
Conversation
Split the unit tests and documentation build into two separate and parallel paths to reduce total time spent on Continuous Integration. Also only performing documentation build on Python 3.9 only to conserve CI resources.
|
Just resurfacing this comment by Leo from #344 (comment):
And also at #964 (review):
So we should probably run the docs build on only one Python version (e.g. Python 3.9) instead of three (3.7, 3.8, 3.9) to further save on CI resources. |
|
I agree that we should separate "Building the documentation" and "Full tests" into two separate workflows. We can have faster jobs runs and also can control the jobs runs based on files, e.g., we don't want to run the full tests if only gallery examples are changed. I also agree that we should only build the documentation for one Python version (e.g., 3.9), not three versions. |
|
Closing in favour of alternative implementation at #1033 |
Description of proposed changes
Split the unit tests and documentation build into two separate and parallel paths to reduce total time spent on Continuous Integration. Also only performing documentation build on Python 3.9 only to conserve CI resources. Edit: doesn't work yet...
This should save an estimated ~4 min of CI time (the unit tests and docs build take about 4 min respectively, i.e. 8 mins in serial, 4 min in parallel), so the longest running Windows CI should go from ~18min to ~14min.
References:
Part of #584
Reminders
make formatandmake checkto make sure the code follows the style guide.doc/api/index.rst.Notes
/formatin the first line of a comment to lint the code automatically