Skip to content

[WIP] Move CI infrastructure to GitHub Actions#3321

Closed
JCGoran wants to merge 69 commits into
masterfrom
jelic/move_infra_to_gha
Closed

[WIP] Move CI infrastructure to GitHub Actions#3321
JCGoran wants to merge 69 commits into
masterfrom
jelic/move_infra_to_gha

Conversation

@JCGoran

@JCGoran JCGoran commented Jan 28, 2025 •
edited
Loading

Copy link
Copy Markdown
Collaborator

According to https://github.com/orgs/community/discussions/70492#discussioncomment-7362186, public repositories have unlimited free minutes, with a time limit for each job of about 6 hours, which should be plenty for our use-case.

Since the external CIs were used for building wheels on various platforms, we now build the following wheels with GitHub Actions:

  • MacOS, x86_64 and arm64 (new, used to be manual), with Python versions 3.9 to 3.13
  • manylinux, x86_64 and aarch64, with Python versions 3.9 to 3.13

Supersedes #3213.

Would close #2359.

TODO list (not exhaustive):

  • add upload step for both nightly (automatic on schedule) and release (manual)
  • add MPT headers (do we need this?)
  • disable azure-pipelines comment bot (should probably be done after this PR is merged)
  • make the corresponding changes to:
  • update docs
  • update issue templates
  • assess how difficult is it to backport to older releases (notably 8.2); see Backport #3321 to 8.2 release #3329 for progress (UPDATE: it's not necessary to backport the CI, only the documentation would require updating)
  • remove azure pipeline as a required pipeline
  • remove circleCI as a pipeline in general
  • (optional) add GHA comment bot (note that the URL can be pasted into the various CIs we use, and a browser where one is logged in, but one cannot directly download the artifact using wget or curl without auth. To do this with a CLI tool, see here)
  • make the wheels that do not have custom versions default to using -nightly tag and correct version (see here for how setuptools-scm does that)
  • replace get-last-azure-url job in external.yml with get-last-artifact-url, and update the other ones to make it work with a GitHub comment

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from a1f0eaf to c57ea5f Compare January 28, 2025 09:21
@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from 9ea3830 to de7d057 Compare January 28, 2025 10:12
@codecov

codecov Bot commented Jan 28, 2025 •
edited
Loading

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 68.34%. Comparing base (9222ca9) to head (e2343bd).
⚠️ Report is 151 commits behind head on master.

Additional details and impacted files 
@@           Coverage Diff           @@
##           master    #3321   +/-   ##
=======================================
  Coverage   68.34%   68.34%           
=======================================
  Files         682      682           
  Lines      116452   116452           
=======================================
  Hits        79584    79584           
  Misses      36868    36868

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@azure-pipelines

azure-pipelines Bot commented Feb 24, 2025

Copy link
Copy Markdown

✔️ 1cc77d6 -> Azure artifacts URL

@JCGoran JCGoran mentioned this pull request Feb 24, 2025
Closed
@github-actions

github-actions Bot commented Feb 24, 2025

Copy link
Copy Markdown
Contributor

✔️ c5144ef -> artifacts URL

@azure-pipelines

azure-pipelines Bot commented Feb 24, 2025

Copy link
Copy Markdown

✔️ c5144ef -> Azure artifacts URL

@github-actions

github-actions Bot commented Feb 25, 2025

Copy link
Copy Markdown
Contributor

✔️ 5a28a75 -> artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch 2 times, most recently from c5190a0 to 5a00cab Compare February 25, 2025 13:16
@github-actions

github-actions Bot commented Feb 25, 2025

Copy link
Copy Markdown
Contributor

✔️ c5190a0 -> artifacts URL

@github-actions

github-actions Bot commented Feb 25, 2025

Copy link
Copy Markdown
Contributor

✔️ 5a00cab -> artifacts URL

@azure-pipelines

azure-pipelines Bot commented Feb 25, 2025

Copy link
Copy Markdown

✔️ 5a00cab -> Azure artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch from 5a00cab to d4b2129 Compare February 25, 2025 20:37
@github-actions

github-actions Bot commented Feb 25, 2025

Copy link
Copy Markdown
Contributor

✔️ d4b2129 -> artifacts URL

@azure-pipelines

azure-pipelines Bot commented Feb 25, 2025

Copy link
Copy Markdown

✔️ d4b2129 -> Azure artifacts URL

@JCGoran JCGoran force-pushed the jelic/move_infra_to_gha branch 2 times, most recently from b9fa846 to 832f5f3 Compare February 26, 2025 11:32
@sonarqubecloud

sonarqubecloud Bot commented Feb 26, 2025

Copy link
Copy Markdown

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

@github-actions

github-actions Bot commented Feb 26, 2025

Copy link
Copy Markdown
Contributor

✔️ 832f5f3 -> artifacts URL

@sonarqubecloud

sonarqubecloud Bot commented Apr 11, 2025

Copy link
Copy Markdown

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

@github-actions

github-actions Bot commented Apr 11, 2025

Copy link
Copy Markdown
Contributor

✔️ e2343bd -> artifacts URL

@JCGoran JCGoran mentioned this pull request Apr 11, 2025
Merged
@JCGoran

JCGoran commented Dec 1, 2025

Copy link
Copy Markdown
Collaborator Author

#3382 basically makes the switch trivial if one wants to do it since it just requires adding a runner like macos-14 to the list of platforms the wheel-building runs on.

@JCGoran JCGoran closed this Dec 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@pramodk pramodk pramodk left review comments

Assignees

No one assigned

Labels

CI Continuous Integration wheel

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

missing neuron-nightly for macOS M1/M2

2 participants

@JCGoran @pramodk