Skip to content

[Security Solution] Fix rule's lastRun.outcomeMsg functional test flakiness#259955

Merged
maximpn merged 1 commit intoelastic:mainfrom
maximpn:fix-last-run-outcome-msg-migration-test-flakiness
Mar 27, 2026
Merged

[Security Solution] Fix rule's lastRun.outcomeMsg functional test flakiness#259955
maximpn merged 1 commit intoelastic:mainfrom
maximpn:fix-last-run-outcome-msg-migration-test-flakiness

Conversation

@maximpn
Copy link
Copy Markdown
Contributor

@maximpn maximpn commented Mar 27, 2026

Resolves: #259634
Relates to: #258105

Summary

This PR fixes rule's lastRun.outcomeMsg functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy outcomeMsg's value.

@maximpn maximpn self-assigned this Mar 27, 2026
@maximpn maximpn added test Team:ResponseOps Platform ResponseOps team (formerly the Cases and Alerting teams) t// v9.4.0 v9.3.3 v9.2.8 v8.19.14 labels Mar 27, 2026
@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#11248

[✅] x-pack/platform/test/alerting_api_integration/spaces_only/tests/alerting/group4/config.ts: 100/100 tests passed.

see run history

@maximpn maximpn marked this pull request as ready for review March 27, 2026 12:42
@maximpn maximpn requested a review from a team as a code owner March 27, 2026 12:42
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

@maximpn maximpn added release_note:skip Skip the PR/issue when compiling release notes backport:version Backport to applied version labels labels Mar 27, 2026
@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

cc @maximpn

Copy link
Copy Markdown
Contributor

@doakalexi doakalexi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@maximpn maximpn merged commit 737848b into elastic:main Mar 27, 2026
39 checks passed
@maximpn maximpn deleted the fix-last-run-outcome-msg-migration-test-flakiness branch March 27, 2026 16:29
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.2, 9.3

https://github.com/elastic/kibana/actions/runs/23656650179

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Mar 27, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.

(cherry picked from commit 737848b)
@kibanamachine
Copy link
Copy Markdown
Contributor

💔 Some backports could not be created

Status Branch Result
8.19 Backport failed because of merge conflicts
9.2 Backport failed because of merge conflicts
9.3

Note: Successful backport PRs will be merged automatically after passing CI.

Manual backport

To create the backport manually run:

node scripts/backport --pr 259955

Questions ?

Please refer to the Backport tool documentation

maximpn added a commit to maximpn/kibana that referenced this pull request Mar 27, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.

(cherry picked from commit 737848b)
maximpn added a commit to maximpn/kibana that referenced this pull request Mar 27, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.

(cherry picked from commit 737848b)
@maximpn
Copy link
Copy Markdown
Contributor Author

maximpn commented Mar 27, 2026

💚 All backports created successfully

Status Branch Result
9.2
8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Mar 27, 2026
…st flakiness (#259955) (#260055)

# Backport

This will backport the following commits from `main` to `9.3`:
- [[Security Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness (#259955)](#259955)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2026-03-27T16:29:05Z","message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","Team:ResponseOps","backport:version","v9.4.0","v9.3.3","v9.2.8","v8.19.14"],"title":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness","number":259955,"url":"https://github.com/elastic/kibana/pull/259955","mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},"sourceBranch":"main","suggestedTargetBranches":["9.3","9.2","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/259955","number":259955,"mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},{"branch":"9.3","label":"v9.3.3","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.2","label":"v9.2.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.14","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Maxim Palenov <maxim.palenov@elastic.co>
maximpn added a commit that referenced this pull request Mar 27, 2026
…st flakiness (#259955) (#260063)

# Backport

This will backport the following commits from `main` to `9.2`:
- [[Security Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness (#259955)](#259955)

<!--- Backport version: 11.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2026-03-27T16:29:05Z","message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","Team:ResponseOps","backport:version","v9.4.0","v9.3.3","v9.2.8","v8.19.14"],"title":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness","number":259955,"url":"https://github.com/elastic/kibana/pull/259955","mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},"sourceBranch":"main","suggestedTargetBranches":["9.2","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/259955","number":259955,"mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},{"branch":"9.3","label":"v9.3.3","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/260055","number":260055,"state":"OPEN"},{"branch":"9.2","label":"v9.2.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.14","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
maximpn added a commit that referenced this pull request Mar 27, 2026
…est flakiness (#259955) (#260065)

# Backport

This will backport the following commits from `main` to `8.19`:
- [[Security Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness (#259955)](#259955)

<!--- Backport version: 11.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2026-03-27T16:29:05Z","message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","Team:ResponseOps","backport:version","v9.4.0","v9.3.3","v9.2.8","v8.19.14"],"title":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test
flakiness","number":259955,"url":"https://github.com/elastic/kibana/pull/259955","mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},"sourceBranch":"main","suggestedTargetBranches":["9.2","8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/259955","number":259955,"mergeCommit":{"message":"[Security
Solution] Fix rule's lastRun.outcomeMsg functional test flakiness
(#259955)\n\n**Resolves:
https://github.com/elastic/kibana/issues/259634**\n**Relates to:**
https://github.com/elastic/kibana/pull/258105\n\n## Summary\n\nThis PR
fixes rule's `lastRun.outcomeMsg` functional test flakiness. The
flakiness was caused by race condition between rule execution and
setting the legacy `outcomeMsg`'s
value.","sha":"737848bc8a0a670e95d9613635683d5e9a17796e"}},{"branch":"9.3","label":"v9.3.3","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/260055","number":260055,"state":"OPEN"},{"branch":"9.2","label":"v9.2.8","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.14","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
SoniaSanzV pushed a commit to SoniaSanzV/kibana that referenced this pull request Mar 30, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.
jeramysoucy pushed a commit to jeramysoucy/kibana that referenced this pull request Apr 1, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.
paulinashakirova pushed a commit to paulinashakirova/kibana that referenced this pull request Apr 2, 2026
…kiness (elastic#259955)

**Resolves: elastic#259634
**Relates to:** elastic#258105

## Summary

This PR fixes rule's `lastRun.outcomeMsg` functional test flakiness. The flakiness was caused by race condition between rule execution and setting the legacy `outcomeMsg`'s value.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels release_note:skip Skip the PR/issue when compiling release notes Team:ResponseOps Platform ResponseOps team (formerly the Cases and Alerting teams) t// test v8.19.14 v9.2.8 v9.3.3 v9.4.0

Projects

None yet

4 participants