Skip to content

[Security Solution] Implement prebuilt rule upgrade notifications test plan#225912

Merged
maximpn merged 3 commits intoelastic:mainfrom
maximpn:implement-rule-upgrade-notifications-test-plan
Jul 24, 2025
Merged

[Security Solution] Implement prebuilt rule upgrade notifications test plan#225912
maximpn merged 3 commits intoelastic:mainfrom
maximpn:implement-rule-upgrade-notifications-test-plan

Conversation

@maximpn
Copy link
Copy Markdown
Contributor

@maximpn maximpn commented Jun 30, 2025

Addresses: #202078

Summary

This PR implements the Prebuilt Rules Upgrade Notifications test plan.

Details

This PR implements test scenarios listed in the Prebuilt Rules Upgrade Notifications test plan. Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

Flaky test runner

@maximpn maximpn self-assigned this Jun 30, 2025
@maximpn maximpn added test release_note:skip Skip the PR/issue when compiling release notes impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:Detection Rule Management Security Detection Rule Management Team Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area backport:version Backport to applied version labels v9.1.0 v8.19.0 labels Jun 30, 2025
@maximpn maximpn force-pushed the implement-rule-upgrade-notifications-test-plan branch 2 times, most recently from 4d53dfc to a6a766d Compare July 15, 2025 14:56
@maximpn maximpn force-pushed the implement-rule-upgrade-notifications-test-plan branch from a6a766d to 093ea20 Compare July 15, 2025 15:05
@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8657

[❌] Security Solution Rule Management - Cypress: 74/100 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🎉 All tests passed! - kibana-flaky-test-suite-runner#8656

[✅] x-pack/test/security_solution_api_integration/test_suites/detections_response/rules_management/prebuilt_rules/customization_enabled/configs/ess.config.ts: 200/200 tests passed.

see run history

@kibanamachine
Copy link
Copy Markdown
Contributor

Flaky Test Runner Stats

🟠 Some tests failed. - kibana-flaky-test-suite-runner#8664

[❌] Security Solution Rule Management - Cypress: 75/100 tests passed.

see run history

@maximpn maximpn marked this pull request as ready for review July 16, 2025 07:06
@maximpn maximpn requested review from a team as code owners July 16, 2025 07:06
@maximpn maximpn requested review from dhurley14 and dplumlee July 16, 2025 07:06
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-detections-response (Team:Detections and Resp)

@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@maximpn maximpn deleted the implement-rule-upgrade-notifications-test-plan branch July 24, 2025 10:12
@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
8.18 Backport failed because of merge conflicts
8.19 Backport failed because of merge conflicts
9.0 Backport failed because of merge conflicts
9.1 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 225912

Questions ?

Please refer to the Backport tool documentation

kertal pushed a commit to kertal/kibana that referenced this pull request Jul 25, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.
maximpn added a commit to maximpn/kibana that referenced this pull request Jul 28, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.

(cherry picked from commit 92f07aa)

# Conflicts:
#	x-pack/solutions/security/plugins/security_solution/public/detection_engine/rule_management_ui/components/mini_callout/mini_callout.tsx
maximpn added a commit to maximpn/kibana that referenced this pull request Jul 28, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.

(cherry picked from commit 92f07aa)

# Conflicts:
#	x-pack/solutions/security/plugins/security_solution/public/detection_engine/rule_management_ui/components/mini_callout/mini_callout.tsx
maximpn added a commit to maximpn/kibana that referenced this pull request Jul 28, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.

(cherry picked from commit 92f07aa)

# Conflicts:
#	x-pack/solutions/security/plugins/security_solution/public/detection_engine/rule_management_ui/components/mini_callout/mini_callout.tsx
maximpn added a commit to maximpn/kibana that referenced this pull request Jul 28, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.

(cherry picked from commit 92f07aa)

# Conflicts:
#	x-pack/solutions/security/plugins/security_solution/public/detection_engine/rule_management_ui/components/mini_callout/mini_callout.tsx
#	x-pack/test/security_solution_cypress/cypress/e2e/detection_response/detection_engine/rule_edit/custom_saved_query.cy.ts
@maximpn
Copy link
Copy Markdown
Contributor Author

maximpn commented Jul 28, 2025

💚 All backports created successfully

Status Branch Result
9.1
9.0
8.19
8.18

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

@kibanamachine kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label Jul 28, 2025
@kibanamachine
Copy link
Copy Markdown
Contributor

Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync.
cc: @maximpn

@maximpn maximpn removed the backport missing Added to PRs automatically when the are determined to be missing a backport. label Jul 28, 2025
maximpn added a commit that referenced this pull request Jul 28, 2025
…ns test plan (#225912) (#229584)

# Backport

This will backport the following commits from `main` to `9.1`:
- [[Security Solution] Implement prebuilt rule upgrade notifications
test plan (#225912)](#225912)

<!--- Backport version: 10.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-07-24T10:05:19Z","message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","impact:medium","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Solution] Implement prebuilt rule upgrade notifications test
plan","number":225912,"url":"https://github.com/elastic/kibana/pull/225912","mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225912","number":225912,"mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}}]}]
BACKPORT-->
maximpn added a commit that referenced this pull request Jul 28, 2025
…ns test plan (#225912) (#229585)

# Backport

This will backport the following commits from `main` to `9.0`:
- [[Security Solution] Implement prebuilt rule upgrade notifications
test plan (#225912)](#225912)

<!--- Backport version: 10.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-07-24T10:05:19Z","message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","impact:medium","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Solution] Implement prebuilt rule upgrade notifications test
plan","number":225912,"url":"https://github.com/elastic/kibana/pull/225912","mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225912","number":225912,"mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}}]}]
BACKPORT-->
maximpn added a commit that referenced this pull request Jul 28, 2025
…ons test plan (#225912) (#229586)

# Backport

This will backport the following commits from `main` to `8.19`:
- [[Security Solution] Implement prebuilt rule upgrade notifications
test plan (#225912)](#225912)

<!--- Backport version: 10.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-07-24T10:05:19Z","message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","impact:medium","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Solution] Implement prebuilt rule upgrade notifications test
plan","number":225912,"url":"https://github.com/elastic/kibana/pull/225912","mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225912","number":225912,"mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}}]}]
BACKPORT-->
maximpn added a commit that referenced this pull request Jul 28, 2025
…ons test plan (#225912) (#229588)

# Backport

This will backport the following commits from `main` to `8.18`:
- [[Security Solution] Implement prebuilt rule upgrade notifications
test plan (#225912)](#225912)

<!--- Backport version: 10.0.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Maxim
Palenov","email":"maxim.palenov@elastic.co"},"sourceCommit":{"committedDate":"2025-07-24T10:05:19Z","message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7","branchLabelMapping":{"^v9.2.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["test","release_note:skip","impact:medium","v9.0.0","Team:Detections
and Resp","Team: SecuritySolution","Team:Detection Rule
Management","Feature:Prebuilt Detection
Rules","backport:version","v8.18.0","v9.1.0","v8.19.0","v9.2.0"],"title":"[Security
Solution] Implement prebuilt rule upgrade notifications test
plan","number":225912,"url":"https://github.com/elastic/kibana/pull/225912","mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}},"sourceBranch":"main","suggestedTargetBranches":["9.0","8.18","9.1","8.19"],"targetPullRequestStates":[{"branch":"9.0","label":"v9.0.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.18","label":"v8.18.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"9.1","label":"v9.1.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"},{"branch":"main","label":"v9.2.0","branchLabelMappingKey":"^v9.2.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225912","number":225912,"mergeCommit":{"message":"[Security
Solution] Implement prebuilt rule upgrade notifications test plan
(#225912)\n\n**Addresses:**
https://github.com/elastic/kibana/issues/202078\n\n## Summary\n\nThis PR
implements the [Prebuilt Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).\n\n##
Details\n\nThis PR implements test scenarios listed in the [Prebuilt
Rules Upgrade Notifications test
plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).
Unit tests listed in the test plan was skipped due to low testability of
the UI code, high maintenance effort and low total value since the same
scenarios are covered by the e2e tests.\n\n## Flaky test runner\n\n- ✅
[added integration tests (200
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)\n-
✅ [added e2e tests (75
runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664)
Since the whole Rule Management Cypress tests group was ran you may
observe some failures in unrelated to this PR
tests.","sha":"92f07aa54762c34145d6c84bb23840a5f7fc83e7"}}]}]
BACKPORT-->
eokoneyo pushed a commit to eokoneyo/kibana that referenced this pull request Jul 31, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.
delanni pushed a commit to delanni/kibana that referenced this pull request Aug 5, 2025
…t plan (elastic#225912)

**Addresses:** elastic#202078

## Summary

This PR implements the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md).

## Details

This PR implements test scenarios listed in the [Prebuilt Rules Upgrade Notifications test plan](https://github.com/elastic/kibana/blob/main/x-pack/solutions/security/plugins/security_solution/docs/testing/test_plans/detection_response/prebuilt_rules/prebuilt_rule_upgrade_notifications.md). Unit tests listed in the test plan was skipped due to low testability of the UI code, high maintenance effort and low total value since the same scenarios are covered by the e2e tests.

## Flaky test runner

- ✅ [added integration tests (200 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8656)
- ✅ [added e2e tests (75 runs)](https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8664) Since the whole Rule Management Cypress tests group was ran you may observe some failures in unrelated to this PR tests.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport:version Backport to applied version labels Feature:Prebuilt Detection Rules Security Solution Prebuilt Detection Rules area impact:medium Addressing this issue will have a medium level of impact on the quality/strength of our product. release_note:skip Skip the PR/issue when compiling release notes Team:Detection Rule Management Security Detection Rule Management Team Team:Detections and Resp Security Detection Response Team Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. test v8.18.5 v8.19.1 v9.0.5 v9.1.1 v9.2.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

8 participants