[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout#260029
Conversation
…oup17 group8 was taking ~40min, exceeding the 50min Buildkite step timeout and causing 3 automatic retries (~236min wasted CI time per PR). Split the single get_rules_with_gaps test file into two halves so each group targets ~20min.
💚 Build Succeeded
Metrics [docs]
|
|
Starting backport for target branches: 8.19, 9.2, 9.3 |
…hanges * commit 'd0e62a657916e84694a93983e513ce9e34e0b635': (27 commits) [Agent Builder] Agent overview page design updates (elastic#260468) [Inference UI] Add model detail flyout with endpoint management (elastic#260307) [Fleet] Update doc links in agent policy settings (elastic#260245) [Security Solution] show risk score in new flyout header (elastic#260187) Replace deprecated EUI icons in files owned by @elastic/kibana-security (elastic#255636) [Cases][Templates] Add DATE_PICKER field control type (elastic#260209) [SharedUX] Get spaces callout on each solution nav (elastic#259723) [SharedUX] Preserve feature visibility on solution change (elastic#259316) [CI] Increase investigations cypress disks to 110G (elastic#260423) [Agent Builder] Expose read-only conversations on plugin start contract (elastic#260435) [dasboards as code] drop panels with server errors (elastic#260073) [One Workflow] Add force-delete (hard delete) option for workflows (elastic#260391) [Agent Builder] Fix sidebar error handling error (elastic#260446) [Agent Builder] Add attachment origin to Converse API (elastic#259043) [Alerting v2] Fix rule results preview chart responsiveness (elastic#260444) [Streams] Processing error panel UI improvements (elastic#260028) fix flaky test: alert details error page timeout (elastic#260302) [Agent Builder] Add attachment origin to Converse API (elastic#259043) [One Workflow] Add more unit tests to workflows_extensions plugin (elastic#260384) [ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (elastic#260029) ...
rylnd
left a comment
There was a problem hiding this comment.
Split looks good, and the test improvements are appreciated. Thank you!
| spaceId: apiOptions.spaceId, | ||
| }); | ||
|
|
||
| // Test filtering by unfilled status |
There was a problem hiding this comment.
👍 Appreciate these being moved into the test description.
|
Friendly reminder: Looks like this PR hasn’t been backported yet. |
… fix CI timeout (elastic#260029) ## Summary `security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR. Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way. ## Changes - **group8** — 5 `it` blocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated status - **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid params - Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml` and `.github/CODEOWNERS` - Replaced inline `if` auth guard with a consistent `switch` pattern matching the rest of the file - Split "filter by gap status" `it` block into separate `unfilled` and `filled` assertions
… fix CI timeout (elastic#260029) ## Summary `security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR. Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way. ## Changes - **group8** — 5 `it` blocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated status - **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid params - Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml` and `.github/CODEOWNERS` - Replaced inline `if` auth guard with a consistent `switch` pattern matching the rest of the file - Split "filter by gap status" `it` block into separate `unfilled` and `filled` assertions
|
Friendly reminder: Looks like this PR hasn’t been backported yet. |
|
Starting backport for target branches: 8.19, 9.2, 9.3 |
💔 All backports failed
Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
… fix CI timeout (elastic#260029) ## Summary `security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR. Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way. ## Changes - **group8** — 5 `it` blocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated status - **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid params - Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml` and `.github/CODEOWNERS` - Replaced inline `if` auth guard with a consistent `switch` pattern matching the rest of the file - Split "filter by gap status" `it` block into separate `unfilled` and `filled` assertions (cherry picked from commit 37a00eb) # Conflicts: # .buildkite/ftr_platform_stateful_configs.yml # .github/CODEOWNERS
… fix CI timeout (elastic#260029) ## Summary `security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR. Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way. ## Changes - **group8** — 5 `it` blocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated status - **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid params - Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml` and `.github/CODEOWNERS` - Replaced inline `if` auth guard with a consistent `switch` pattern matching the rest of the file - Split "filter by gap status" `it` block into separate `unfilled` and `filled` assertions (cherry picked from commit 37a00eb) # Conflicts: # .buildkite/ftr_platform_stateful_configs.yml # .github/CODEOWNERS # x-pack/platform/test/alerting_api_integration/security_and_spaces/group8/tests/alerting/gap/get_rules_with_gaps.ts
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
… fix CI timeout (elastic#260029) ## Summary `security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR. Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way. ## Changes - **group8** — 5 `it` blocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated status - **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid params - Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml` and `.github/CODEOWNERS` - Replaced inline `if` auth guard with a consistent `switch` pattern matching the rest of the file - Split "filter by gap status" `it` block into separate `unfilled` and `filled` assertions (cherry picked from commit 37a00eb) # Conflicts: # .buildkite/ftr_platform_stateful_configs.yml # .github/CODEOWNERS # x-pack/platform/test/alerting_api_integration/security_and_spaces/group1/tests/alerting/gap/get_rules_with_gaps.ts
|
Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync. |
…fig to fix CI timeout (#260029) (#261140) # Backport This will backport the following commits from `main` to `9.3`: - [[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)](#260029) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Stelios Mavro","email":"81311181+steliosmavro@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-03-31T11:55:34Z","message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport missing","backport:all-open","v9.4.0"],"title":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout","number":260029,"url":"https://github.com/elastic/kibana/pull/260029","mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/260029","number":260029,"mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}}]}] BACKPORT-->
…fig to fix CI timeout (#260029) (#261147) # Backport This will backport the following commits from `main` to `9.2`: - [[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)](#260029) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Stelios Mavro","email":"81311181+steliosmavro@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-03-31T11:55:34Z","message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport missing","backport:all-open","v9.4.0"],"title":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout","number":260029,"url":"https://github.com/elastic/kibana/pull/260029","mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/260029","number":260029,"mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}}]}] BACKPORT-->
…nfig to fix CI timeout (#260029) (#261150) # Backport This will backport the following commits from `main` to `8.19`: - [[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)](#260029) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Stelios Mavro","email":"81311181+steliosmavro@users.noreply.github.com"},"sourceCommit":{"committedDate":"2026-03-31T11:55:34Z","message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a","branchLabelMapping":{"^v9.4.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport missing","backport:all-open","v9.4.0"],"title":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout","number":260029,"url":"https://github.com/elastic/kibana/pull/260029","mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.4.0","branchLabelMappingKey":"^v9.4.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/260029","number":260029,"mergeCommit":{"message":"[ResponseOps] Split alerting security_and_spaces group8 FTR config to fix CI timeout (#260029)\n\n## Summary\n\n`security_and_spaces/group8` had 262 tests taking ~40 minutes. With ~10\nminutes of step overhead this consistently exceeded the 50-minute\nBuildkite timeout — all tests passed but the step was killed during\npost-test cleanup, triggering 3 automatic retries and wasting ~236\nminutes of CI time per affected PR.\n\nSplit into two groups targeting ~20 minutes each, with minor test\nquality fixes along the way.\n\n## Changes\n\n- **group8** — 5 `it` blocks: return rules with gaps, ordering\n(asc/desc), filter by gap status, filter by aggregated status\n- **group17** (new) — 5 `it` blocks: deleted rule, empty results, latest\ngap timestamp, no timestamp when no gaps, invalid params\n- Registered `group17` in `.buildkite/ftr_platform_stateful_configs.yml`\nand `.github/CODEOWNERS`\n- Replaced inline `if` auth guard with a consistent `switch` pattern\nmatching the rest of the file\n- Split \"filter by gap status\" `it` block into separate `unfilled` and\n`filled` assertions","sha":"37a00eb6f6cc1793c5db0e88796f9c53fd21065a"}}]}] BACKPORT-->
Summary
security_and_spaces/group8had 262 tests taking ~40 minutes. With ~10 minutes of step overhead this consistently exceeded the 50-minute Buildkite timeout — all tests passed but the step was killed during post-test cleanup, triggering 3 automatic retries and wasting ~236 minutes of CI time per affected PR.Split into two groups targeting ~20 minutes each, with minor test quality fixes along the way.
Changes
itblocks: return rules with gaps, ordering (asc/desc), filter by gap status, filter by aggregated statusitblocks: deleted rule, empty results, latest gap timestamp, no timestamp when no gaps, invalid paramsgroup17in.buildkite/ftr_platform_stateful_configs.ymland.github/CODEOWNERSifauth guard with a consistentswitchpattern matching the rest of the fileitblock into separateunfilledandfilledassertions