Skip to content

Test reliability is impacting CI workflows #1917

@peternied

Description

@peternied

There has been an increased number of test failures that have started to prevent continuous integration for pull requests. It looks like this has been accelerated by the recent cut over to the Randomizer test runner. While there has been progress with pull requests like #1914, we should continue to invest in this space to keep our build and test runs passing consistently.

List of tests that have seen issues blocking a pull request:

  • TenantInfoActionTest.testTenantInfoAPIAccess
  • ComplianceAuditlogTest.testComplianceEnable
  • ComplianceAuditlogTest. testSourceFilterMsearch

List of tests that have seen issues failures, but passed on retry:

  • TransportUserInjectorIntegTest.testSecurityUserInjection
  • AllowlistApiTest.testAllowlistAuditComplianceLogging
  • LegacyTenantInfoActionTests.testTenantInfoAPIUpdate

As we see more tests with issues or resolve test issue I'll update this list

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingtest fixtest fixes

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions