[Security Solution] Fix real prebuilt rules package related flakiness in integration tests by maximpn · Pull Request #227689 · elastic/kibana

maximpn · 2025-07-11T15:51:59Z

Resolves: #220333
Resolves: #227571
Resolves: #219407

Summary

This PR fixes flakiness caused by the real prebuilt rules package installation.

Details

Multiple Rule Management API endpoints install the prebuilt rules package under the hood when it's not installed. In normal case this installation happens from the EPR. The problem is that EPR might be unavailable for some period of time or there network issues blocking EPR access. On top of that real package is heavy and requires some time and resources to be installed. While the major part of our functionality doesn't depend on the real prebuilt rules package and the concrete rules there. On top of that API endpoints depending on the real prebuilt rules package fail with HTTP 500 error when EPR is unavailable.

This PR extends the Functional Test Runner with rootHooks.beforeAll configuration option which is used to install a lightweight mock prebuilt rules package. This action prevents real package installation make the tests much more predictable.

Flaky test runner

kibanamachine · 2025-07-11T18:08:53Z

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8627

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_import_export/trial_license_complete_tier/configs/ess.config.ts: 200/200 tests passed.

see run history

kibanamachine · 2025-07-14T15:25:03Z

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8642

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/rule_import_export/trial_license_complete_tier/configs/serverless.config.ts: 200/200 tests passed.

see run history

elasticmachine · 2025-07-15T19:03:21Z

💚 Build Succeeded

Buildkite Build
Commit: 1023909

Metrics [docs]

✅ unchanged

History

💔 Build #318777 failed 0eb0bea

cc @maximpn

elasticmachine · 2025-07-15T20:42:28Z

Pinging @elastic/security-detections-response (Team:Detections and Resp)

elasticmachine · 2025-07-15T20:42:30Z

Pinging @elastic/security-solution (Team: SecuritySolution)

elasticmachine · 2025-07-15T20:42:31Z

Pinging @elastic/security-detection-rule-management (Team:Detection Rule Management)

xcrzx

LGTM! Just a few minor comments

xcrzx · 2025-07-17T09:47:27Z

src/platform/packages/shared/kbn-test/src/functional_test_runner/lib/mocha/setup_mocha.ts

+      beforeAll:
+        rootHooks?.beforeAll && !skipRootHooks ? () => rootHooks.beforeAll(providers) : undefined,


How would the error messages look when a root hook fails?

I’m wondering if we need to add some logging here for better debuggability. Something like:

Suggested change

beforeAll:

rootHooks?.beforeAll && !skipRootHooks ? () => rootHooks.beforeAll(providers) : undefined,

beforeAll:

rootHooks?.beforeAll && !skipRootHooks

? async () => {

try {

log.info('Executing rootHooks.beforeAll...');

await rootHooks.beforeAll(providers);

log.success('rootHooks.beforeAll completed successfully');

} catch (error) {

log.error(`rootHooks.beforeAll failed: ${error?.message}`);

throw error;

}

}

: undefined,

good point. If there is no default error handling, we need something like this.

Mocha logs root hooks execution. You may see entries like "before all" hook in "{root}". On top of that error in root hooks get caught and shown. The format seems matching test suite before/beforeEach/...

Example of a test error in beforeAll (locally)

info Only running suites (and their sub-suites) if they include the tag(s): [ 'x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/common/import_export/export_prebuilt_rules.ts' ] info Starting tests └-> "before all" hook in "{root}" └- ✖ fail: "before all" hook in "{root}" │ Error: Test error │ at Object.beforeAll (config.base.ts:138:19) │ at Context._mocha.default.rootHooks.beforeAll (setup_mocha.ts:60:66) │ at processImmediate (node:internal/timers:485:21) │ │ │ │0 passing (3ms) │1 failing │ │1) "before all" hook in "{root}": │ │ Error: Test error │ at Object.beforeAll (config.base.ts:138:19) │ at Context._mocha.default.rootHooks.beforeAll (setup_mocha.ts:60:66) │ at processImmediate (node:internal/timers:485:21)

Example of a successful run (locally)

info Only running suites (and their sub-suites) if they include the tag(s): [ 'x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/common/import_export/export_prebuilt_rules.ts' ] info Starting tests └-> "before all" hook in "{root}" │ info Installing mock prebuilt rules package... │ succ Mock prebuilt rules package has been installed └-: Rules Management - Prebuilt Rules (Common tests) └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Prebuilt Rules (Common tests)" └-: @ess @serverless @skipInServerlessMKI Export prebuilt rules └-> "before all" hook: beforeTestSuite.trigger for "exports prebuilt rules by rule_ids via the _export API" └-> exports prebuilt rules by rule_ids via the _export API └-> "before each" hook: global before each for "exports prebuilt rules by rule_ids via the _export API" └-> "before each" hook for "exports prebuilt rules by rule_ids via the _export API" └- ✓ pass (1.5s)

Example of a successful run (CI)

└-> "before all" hook in "{root}" -- | └-: Rules Management - Rule import export API | └-> "before all" hook: beforeTestSuite.trigger in "Rules Management - Rule import export API" | └-: @ess @serverless @skipInServerlessMKI import_rules | └-> "before all" hook: beforeTestSuite.trigger in "@ess @serverless @skipInServerlessMKI import_rules" | └-: threshold validation | └-> "before all" hook: beforeTestSuite.trigger for "should result in partial success if no threshold-specific fields are provided" | └-> should result in partial success if no threshold-specific fields are provided | └-> "before each" hook: global before each for "should result in partial success if no threshold-specific fields are provided" | └-> "before each" hook for "should result in partial success if no threshold-specific fields are provided" | └- ✓ pass (64ms)

xcrzx · 2025-07-17T09:59:21Z

...tions_response/rules_management/prebuilt_rules/common/import_export/export_prebuilt_rules.ts

+    after(async () => {
+      await deleteAllPrebuiltRuleAssets(es, log);
+      await deleteAllRules(supertest, log);
+    });


Do we need this after cleanup? Cleaning data after execution isn’t very reliable, a test might never execute after due to errors or timeouts. Tests should always prefer before and beforeEach for cleanup and preparing expected state prior to execution, rather than relying on other tests to clean up after themselves.

…akiness in integration tests (#227689) (#228777) # Backport This will backport the following commits from `main` to `8.19`: - [[Security Solution] Fix real prebuilt rules package related flakiness in integration tests (#227689)](#227689)  ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport)  Co-authored-by: Maxim Palenov <maxim.palenov@elastic.co>

… in integration tests (elastic#227689) **Resolves: elastic#220333 **Resolves: elastic#227571 **Resolves: elastic#219407 ## Summary This PR fixes flakiness caused by the real prebuilt rules package installation. ## Details Multiple Rule Management API endpoints install the prebuilt rules package under the hood when it's not installed. In normal case this installation happens from the EPR. The problem is that EPR might be unavailable for some period of time or there network issues blocking EPR access. On top of that real package is heavy and requires some time and resources to be installed. While the major part of our functionality doesn't depend on the real prebuilt rules package and the concrete rules there. On top of that API endpoints depending on the real prebuilt rules package fail with HTTP 500 error when EPR is unavailable. This PR extends the Functional Test Runner with `rootHooks.beforeAll` configuration option which is used to install a lightweight mock prebuilt rules package. This action prevents real package installation make the tests much more predictable. ## Flaky test runner - ✅ [ECH import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8627) - ✅ [Serverless import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8642) (cherry picked from commit 76908c5) # Conflicts: # x-pack/test/security_solution_api_integration/config/ess/config.base.ts # x-pack/test/security_solution_api_integration/config/serverless/config.base.ts

maximpn · 2025-07-21T15:04:47Z

💚 All backports created successfully

Status	Branch	Result
✅	8.18

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

…kiness in integration tests (#227689) (#228778) # Backport This will backport the following commits from `main` to `9.0`: - [[Security Solution] Fix real prebuilt rules package related flakiness in integration tests (#227689)](#227689)  ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport)  Co-authored-by: Maxim Palenov <maxim.palenov@elastic.co>

… in integration tests (elastic#227689) **Resolves: elastic#220333 **Resolves: elastic#227571 **Resolves: elastic#219407 ## Summary This PR fixes flakiness caused by the real prebuilt rules package installation. ## Details Multiple Rule Management API endpoints install the prebuilt rules package under the hood when it's not installed. In normal case this installation happens from the EPR. The problem is that EPR might be unavailable for some period of time or there network issues blocking EPR access. On top of that real package is heavy and requires some time and resources to be installed. While the major part of our functionality doesn't depend on the real prebuilt rules package and the concrete rules there. On top of that API endpoints depending on the real prebuilt rules package fail with HTTP 500 error when EPR is unavailable. This PR extends the Functional Test Runner with `rootHooks.beforeAll` configuration option which is used to install a lightweight mock prebuilt rules package. This action prevents real package installation make the tests much more predictable. ## Flaky test runner - ✅ [ECH import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8627) - ✅ [Serverless import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8642)

…akiness in integration tests (#227689) (#228814) # Backport This will backport the following commits from `main` to `8.18`: - [[Security Solution] Fix real prebuilt rules package related flakiness in integration tests (#227689)](#227689)  ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport)

… in integration tests (elastic#227689) **Resolves: elastic#220333 **Resolves: elastic#227571 **Resolves: elastic#219407 ## Summary This PR fixes flakiness caused by the real prebuilt rules package installation. ## Details Multiple Rule Management API endpoints install the prebuilt rules package under the hood when it's not installed. In normal case this installation happens from the EPR. The problem is that EPR might be unavailable for some period of time or there network issues blocking EPR access. On top of that real package is heavy and requires some time and resources to be installed. While the major part of our functionality doesn't depend on the real prebuilt rules package and the concrete rules there. On top of that API endpoints depending on the real prebuilt rules package fail with HTTP 500 error when EPR is unavailable. This PR extends the Functional Test Runner with `rootHooks.beforeAll` configuration option which is used to install a lightweight mock prebuilt rules package. This action prevents real package installation make the tests much more predictable. ## Flaky test runner - ✅ [ECH import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8627) - ✅ [Serverless import custom rules integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8642)

… reduce flakiness (#229689) **Resolves: #182441 **Resolves: #182442 **Resolves: #228942 **Relates to: #227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1)

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1) # Conflicts: # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/revert_prebuilt_rule.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_suppression.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_suppression_basic_ess.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/bulk_actions/bulk_edit_rules_suppression_essentials_serverless.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/customization/rule_customization.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_via_fleet.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/snoozing/rule_snoozing.cy.ts

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1)

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1) # Conflicts: # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_via_fleet.cy.ts # x-pack/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/snoozing/rule_snoozing.cy.ts

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1) # Conflicts: # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/prebuilt_rules/installation/install_via_fleet.cy.ts # x-pack/solutions/security/test/security_solution_cypress/cypress/e2e/detection_response/rule_management/rule_actions/snoozing/rule_snoozing.cy.ts

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121 (cherry picked from commit 980add1)

… reduce flakiness (elastic#229689) **Resolves: elastic#182441 **Resolves: elastic#182442 **Resolves: elastic#228942 **Relates to: elastic#227689 ## Summary This PR installs mock prebuilt rules package for e2e Cypress test to reduce flakniess caused by accessing to the real EPR. It's similar to the mock package installation in integration tests [PR](elastic#227689). **Flaky test runner** - ESS: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9120 - Serverless: https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/9121

…leet!` FTR api tests (#250075) ## Summary This PR fixes the flakiness around creating an Endpoint package policy using `endpointPolicyTestResources.createPolicy()`. When an Endpoint package policy is created, the default rules are installed in the background, which process can be flaky, or, together with other functionalities, simply too slow (i.e. taking more than 2 minutes, causing `socket hang up` error). Therefore, there's a workaround by the Detections team to install a mock `security_detection_engine` package. This fix workaround is applied in the EDR API tests as well. For more info, see the original workaround PR: - #227689 Flaky runner: 25/25 ✅ for all 6 test groups: - artifacts ESS + serverless - artifacts with Endpoint exceptions moved FF enabled ESS + serverless - spaces ESS + serverless https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/10576/steps/canvas fix #249780 fix #249463 fix #249468 fix #248923 fix #248759 fix #248578 fix #248554 fix #247416 fix #247211 fix #246564 fix #246341 fix #246450 fix #246356 fix #246207 ### Checklist Check the PR satisfies following conditions. Reviewers should verify this PR satisfies this list as well. - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed

…leet!` FTR api tests (elastic#250075) ## Summary This PR fixes the flakiness around creating an Endpoint package policy using `endpointPolicyTestResources.createPolicy()`. When an Endpoint package policy is created, the default rules are installed in the background, which process can be flaky, or, together with other functionalities, simply too slow (i.e. taking more than 2 minutes, causing `socket hang up` error). Therefore, there's a workaround by the Detections team to install a mock `security_detection_engine` package. This fix workaround is applied in the EDR API tests as well. For more info, see the original workaround PR: - elastic#227689 Flaky runner: 25/25 ✅ for all 6 test groups: - artifacts ESS + serverless - artifacts with Endpoint exceptions moved FF enabled ESS + serverless - spaces ESS + serverless https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/10576/steps/canvas fix elastic#249780 fix elastic#249463 fix elastic#249468 fix elastic#248923 fix elastic#248759 fix elastic#248578 fix elastic#248554 fix elastic#247416 fix elastic#247211 fix elastic#246564 fix elastic#246341 fix elastic#246450 fix elastic#246356 fix elastic#246207 ### Checklist Check the PR satisfies following conditions. Reviewers should verify this PR satisfies this list as well. - [x] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed (cherry picked from commit d36d440)

maximpn self-assigned this Jul 11, 2025

maximpn force-pushed the fix-import-rule-with-exceptions-integration-test branch from c7e7dd4 to 0eb0bea Compare July 14, 2025 12:16

maximpn changed the title ~~[Security Solution] Fix import custom rules with exceptions flaky integration test~~ [Security Solution] Fix real prebuilt rules package related flakiness in integration tests Jul 14, 2025

maximpn force-pushed the fix-import-rule-with-exceptions-integration-test branch from 0eb0bea to 1023909 Compare July 15, 2025 17:12

maximpn marked this pull request as ready for review July 15, 2025 20:42

maximpn requested review from a team as code owners July 15, 2025 20:42

maximpn requested a review from xcrzx July 15, 2025 20:42

xcrzx approved these changes Jul 17, 2025

View reviewed changes

xcrzx added v8.18.4 and removed v8.18.0 labels Jul 17, 2025

maximpn mentioned this pull request Jul 21, 2025

[8.18] [Security Solution] Fix real prebuilt rules package related flakiness in integration tests (#227689) #228814

Merged

kibanamachine mentioned this pull request Jul 21, 2025

[Lens] Fix Firefox inline editor scroll #228625

Merged

1 task

mistic added v9.0.5 and removed v9.0.4 labels Jul 22, 2025

kibanamachine added the v8.18.5 label Jul 23, 2025

banderror mentioned this pull request Jul 28, 2025

[Security Solution] Address recent flakiness in Rule Management tests #229688

Closed

73 tasks

maximpn mentioned this pull request Aug 6, 2025

[Security Solution] Install mock prebuilt rules package in Cypress to reduce flakiness #229689

Merged

gergoabraham mentioned this pull request Jan 23, 2026

[EDR Workflows] Fix and unskip Unable to create Package Policy via Fleet! FTR api tests #250075

Merged

1 task

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Security Solution] Fix real prebuilt rules package related flakiness in integration tests#227689

[Security Solution] Fix real prebuilt rules package related flakiness in integration tests#227689
maximpn merged 5 commits intoelastic:mainfrom
maximpn:fix-import-rule-with-exceptions-integration-test

maximpn commented Jul 11, 2025 •

edited by kibanamachine

Loading

Uh oh!

kibanamachine commented Jul 11, 2025

Uh oh!

kibanamachine commented Jul 14, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

xcrzx left a comment

Uh oh!

xcrzx Jul 17, 2025

Uh oh!

dmlemeshko Jul 21, 2025 •

edited

Loading

Uh oh!

maximpn Jul 21, 2025

Uh oh!

xcrzx Jul 17, 2025

Uh oh!

maximpn commented Jul 21, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

		beforeAll:
		rootHooks?.beforeAll && !skipRootHooks ? () => rootHooks.beforeAll(providers) : undefined,

-      beforeAll:
-        rootHooks?.beforeAll && !skipRootHooks ? () => rootHooks.beforeAll(providers) : undefined,
+      beforeAll:
+        rootHooks?.beforeAll && !skipRootHooks
+          ? async () => {
+              try {
+                log.info('Executing rootHooks.beforeAll...');
+                await rootHooks.beforeAll(providers);
+                log.success('rootHooks.beforeAll completed successfully');
+              } catch (error) {
+                log.error(`rootHooks.beforeAll failed: ${error?.message}`);
+                throw error;
+              }
+            }
+          : undefined,

Conversation

maximpn commented Jul 11, 2025 • edited by kibanamachine Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Details

Flaky test runner

Uh oh!

kibanamachine commented Jul 11, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8627

Uh oh!

kibanamachine commented Jul 14, 2025

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8642

Uh oh!

elasticmachine commented Jul 15, 2025

💚 Build Succeeded

Metrics [docs]

History

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

elasticmachine commented Jul 15, 2025

Uh oh!

xcrzx left a comment

Choose a reason for hiding this comment

Uh oh!

xcrzx Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

dmlemeshko Jul 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

maximpn Jul 21, 2025

Choose a reason for hiding this comment

Uh oh!

xcrzx Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

maximpn commented Jul 21, 2025

💚 All backports created successfully

Questions ?

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

maximpn commented Jul 11, 2025 •

edited by kibanamachine

Loading

dmlemeshko Jul 21, 2025 •

edited

Loading