Skip to content

Check if all tests pass as a single job#18554

Merged
SaschaCowley merged 4 commits intobetafrom
testsPassAction
Jul 27, 2025
Merged

Check if all tests pass as a single job#18554
SaschaCowley merged 4 commits intobetafrom
testsPassAction

Conversation

@seanbudd
Copy link
Copy Markdown
Member

@seanbudd seanbudd commented Jul 25, 2025

Link to issue number:

Part of #17878

Summary of the issue:

GitHub Rulesets require specifying every job you wish to block a PR/push.
With many rulesets, adding new blocking jobs is fragile.
For example, if a new system test suite is added, it will need to be added to every ruleset.

Description of user facing changes:

none

Description of developer facing changes:

Blocking tests are added to the job allTestsPass.

Description of development approach:

We can use that job to confirm if a build can be merged or not via rulesets.

Testing strategy:

actions

Known issues with pull request:

none

Code Review Checklist:

  • Documentation:
    • Change log entry
    • User Documentation
    • Developer / Technical Documentation
    • Context sensitive help for GUI changes
  • Testing:
    • Unit tests
    • System (end to end) tests
    • Manual testing
  • UX of all users considered:
    • Speech
    • Braille
    • Low Vision
    • Different web browsers
    • Localization in other languages / culture than English
  • API is compatible with existing add-ons.
  • Security precautions taken.

@coderabbitai summary

Copilot AI review requested due to automatic review settings July 25, 2025 05:10
@seanbudd seanbudd requested a review from a team as a code owner July 25, 2025 05:10
@seanbudd seanbudd requested a review from SaschaCowley July 25, 2025 05:10

This comment was marked as outdated.

@seanbudd seanbudd requested a review from Copilot July 25, 2025 05:30
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR introduces a centralized job for checking if all tests pass to simplify GitHub ruleset management. Instead of requiring each ruleset to specify every individual test job, they can now reference a single allTestsPass job that depends on all the required test and build jobs.

  • Adds a new allTestsPass job that depends on all critical test and build jobs
  • Updates downstream jobs to depend on allTestsPass instead of listing individual dependencies
  • Simplifies ruleset configuration by providing a single status check point

@seanbudd seanbudd changed the title Check if all tests pass as an action Check if all tests pass as a single job Jul 25, 2025
@SaschaCowley SaschaCowley merged commit fabca52 into beta Jul 27, 2025
21 checks passed
@SaschaCowley SaschaCowley deleted the testsPassAction branch July 27, 2025 23:53
@github-actions github-actions bot added this to the 2025.3 milestone Jul 27, 2025
@seanbudd
Copy link
Copy Markdown
Member Author

This PR is not working correctly

seanbudd added a commit that referenced this pull request Jul 29, 2025
<!-- Please read and fill in the following template, for an explanation
of the sections see:

https://github.com/nvaccess/nvda/blob/master/projectDocs/dev/githubPullRequestTemplateExplanationAndExamples.md
Please also note that the NVDA project has a Citizen and Contributor
Code of Conduct which can be found at
https://github.com/nvaccess/nvda/blob/master/CODE_OF_CONDUCT.md. NV
Access expects that all contributors and other community members read
and abide by the rules set out in this document while participating or
contributing to this project. This includes creating or commenting on
issues and pull requests.

Please initially open PRs as a draft.
When you would like a review, mark the PR as "ready for review".
See
https://github.com/nvaccess/nvda/blob/master/.github/CONTRIBUTING.md.
-->

### Link to issue number:
Fixup #18554
seanbudd added a commit that referenced this pull request Jul 30, 2025
Link to issue number:

Fixup of #18554
Summary of the issue:

#18345 was missed from #18554 as pyright checks were not on beta, and #18554 was targeted to beta
@seanbudd seanbudd modified the milestones: 2025.3, 2025.2 Aug 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants