Skip to content

CI: remove debug builds from the primary test matrix#2724

Merged
sporksmith merged 1 commit intoshadow:mainfrom
sporksmith:fewer-debug-builds
Feb 7, 2023
Merged

CI: remove debug builds from the primary test matrix#2724
sporksmith merged 1 commit intoshadow:mainfrom
sporksmith:fewer-debug-builds

Conversation

@sporksmith
Copy link
Copy Markdown
Contributor

Testing both debug and release builds for every configuration is overkill. Testing a debug build for each compiler should be sufficient to catch most debug-only bugs; e.g. a debug assertion that fails.

Note that the same is not true of release builds - bugs arising from unsound/undefined behavior may only trigger on some platforms.

@github-actions github-actions bot added the Component: Testing Unit and integration tests and frameworks label Feb 6, 2023
@sporksmith sporksmith added this to the Code health and maintenance milestone Feb 6, 2023
@sporksmith
Copy link
Copy Markdown
Contributor Author

@robgjansen This will need some of the debug builds removed from the required tests to be able to merge. I also modified the clang debug build.

So to merge this as-is, the set of "shadow" tests we'd want to require now is:

shadow (ubuntu-20.04, ubuntu:18.04, gcc, release)
shadow (ubuntu-20.04, ubuntu:20.04, gcc, release)
shadow (ubuntu-20.04, ubuntu:22.04, gcc, release)
shadow (ubuntu-20.04, debian:10-slim, gcc, release)
shadow (ubuntu-20.04, debian:11-slim, gcc, release)
shadow (ubuntu-20.04, fedora:34, gcc, release)
shadow (ubuntu-20.04, fedora:35, gcc, release)
shadow (ubuntu-20.04, fedora:36, gcc, release)
shadow (ubuntu-20.04, fedora:37, gcc, release)
shadow (ubuntu-20.04, quay.io/centos/centos:stream8, gcc, release)
shadow (ubuntu-22.04, ubuntu:22.04, gcc, release)
shadow (ubuntu-22.04, ubuntu:22.04, clang, release)
shadow (ubuntu-20.04, ubuntu:22.04, gcc, debug)
shadow (ubuntu-20.04, ubuntu:22.04, clang, debug)

Testing both debug and release builds for every configuration is
overkill. Testing a debug build for each compiler should be sufficient
to catch debug-only bugs; e.g. a debug assertion that fails.

Note that the same is not true of release builds - bugs arising from
unsound/undefined behavior may only trigger on some platforms.
@sporksmith sporksmith enabled auto-merge (squash) February 7, 2023 19:15
@sporksmith sporksmith merged commit 71abd0a into shadow:main Feb 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Component: Testing Unit and integration tests and frameworks

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants