Skip to content

FIX - Failing test: Stateful Observability - Deployment-agnostic Feature Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule"#225090

Merged
fkanout merged 2 commits intoelastic:mainfrom
fkanout:224778-fix-fail-tests
Jun 25, 2025

Conversation

@fkanout
Copy link
Copy Markdown
Contributor

@fkanout fkanout commented Jun 24, 2025

Summary

It fixes #224778
✅ Falky test runner https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

  • Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
  • Documentation was added for features that require explanation or tutorials
  • Unit or functional tests were updated or added to match the most common scenarios
  • If a plugin configuration key changed, check if it needs to be allowlisted in the cloud and added to the docker list
  • This was checked for breaking HTTP API changes, and any breaking changes have been approved by the breaking-change committee. The release_note:breaking label should be applied in these situations.
  • Flaky Test Runner was used on any tests changed
  • The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines

Identify risks

Does this PR introduce any risks? For example, consider risks like hard to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified risk. Invite stakeholders and evaluate how to proceed before merging.

@fkanout fkanout self-assigned this Jun 24, 2025
@github-actions github-actions bot added the author:obs-ux-management PRs authored by the obs ux management team label Jun 24, 2025
@elastic elastic deleted a comment from kibanamachine Jun 25, 2025
@fkanout fkanout marked this pull request as ready for review June 25, 2025 09:12
@fkanout fkanout requested a review from a team as a code owner June 25, 2025 09:12
@fkanout fkanout added backport:prev-minor v9.1.0 v8.19.0 Team:actionable-obs Formerly "obs-ux-management", responsible for SLO, o11y alerting, significant events, & synthetics. labels Jun 25, 2025
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

@fkanout fkanout added the release_note:skip Skip the PR/issue when compiling release notes label Jun 25, 2025
@mgiota mgiota self-requested a review June 25, 2025 10:34
await esClient.deleteByQuery({
index: SYNTHETICS_RULE_ALERT_INDEX,
query: { match_all: {} },
conflicts: 'proceed',
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fkanout This option tells elasticsearch that in case of conflict (ie a document is updated or deleted in the meantime) it will continue to process the other documents?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, the error tha causes this test to fail is concurrent modifications to the same document during your cleanup process

@elasticmachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] FTR Configs #4 / alerting api integration security and spaces enabled - Group 2 Alerting and Actions Telemetry test telemetry should retrieve telemetry data in the expected format
  • [job] [logs] FTR Configs #126 / alerting api integration security and spaces enabled - Group 2 Connectors execute global_read at space1 should log api key information from execute request

Metrics [docs]

✅ unchanged

cc @fkanout

@fkanout fkanout merged commit e140d22 into elastic:main Jun 25, 2025
20 checks passed
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.19, 9.0

https://github.com/elastic/kibana/actions/runs/15874851211

kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jun 25, 2025
…ure Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (elastic#225090)

## Summary

It fixes elastic#224778
✅ Falky test runner
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441
### Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

- [ ] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)
- [ ]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [ ] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] If a plugin configuration key changed, check if it needs to be
allowlisted in the cloud and added to the [docker
list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)
- [ ] This was checked for breaking HTTP API changes, and any breaking
changes have been approved by the breaking-change committee. The
`release_note:breaking` label should be applied in these situations.
- [ ] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
- [ ] The PR description includes the appropriate Release Notes section,
and the correct `release_note:*` label is applied per the
[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)

### Identify risks

Does this PR introduce any risks? For example, consider risks like hard
to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified
risk. Invite stakeholders and evaluate how to proceed before merging.

- [ ] [See some risk
examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)
- [ ] ...

(cherry picked from commit e140d22)
kibanamachine pushed a commit to kibanamachine/kibana that referenced this pull request Jun 25, 2025
…ure Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (elastic#225090)

## Summary

It fixes elastic#224778
✅ Falky test runner
https://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441
### Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

- [ ] Any text added follows [EUI's writing
guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses
sentence case text and includes [i18n
support](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)
- [ ]
[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)
was added for features that require explanation or tutorials
- [ ] [Unit or functional
tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)
were updated or added to match the most common scenarios
- [ ] If a plugin configuration key changed, check if it needs to be
allowlisted in the cloud and added to the [docker
list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)
- [ ] This was checked for breaking HTTP API changes, and any breaking
changes have been approved by the breaking-change committee. The
`release_note:breaking` label should be applied in these situations.
- [ ] [Flaky Test
Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was
used on any tests changed
- [ ] The PR description includes the appropriate Release Notes section,
and the correct `release_note:*` label is applied per the
[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)

### Identify risks

Does this PR introduce any risks? For example, consider risks like hard
to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified
risk. Invite stakeholders and evaluate how to proceed before merging.

- [ ] [See some risk
examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)
- [ ] ...

(cherry picked from commit e140d22)
@kibanamachine
Copy link
Copy Markdown
Contributor

💚 All backports created successfully

Status Branch Result
8.19
9.0

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine added a commit that referenced this pull request Jun 25, 2025
…ic Feature Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (#225090) (#225266)

# Backport

This will backport the following commits from `main` to `8.19`:
- [FIX - Failing test: Stateful Observability - Deployment-agnostic
Feature Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule "after all" hook in
"SyntheticsCustomStatusRule"
(#225090)](#225090)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Faisal
Kanout","email":"faisal.kanout@elastic.co"},"sourceCommit":{"committedDate":"2025-06-25T11:15:24Z","message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6","branchLabelMapping":{"^v9.1.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:prev-minor","Team:obs-ux-management","v9.1.0","v8.19.0","author:obs-ux-management"],"title":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\"","number":225090,"url":"https://github.com/elastic/kibana/pull/225090","mergeCommit":{"message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6"}},"sourceBranch":"main","suggestedTargetBranches":["8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225090","number":225090,"mergeCommit":{"message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6"}},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Faisal Kanout <faisal.kanout@elastic.co>
kibanamachine added a commit that referenced this pull request Jun 25, 2025
…c Feature Flag API Integration Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts - Stateful Observability feature flag testing - Deployment-agnostic API integration tests SyntheticsCustomStatusRule "after all" hook in "SyntheticsCustomStatusRule" (#225090) (#225267)

# Backport

This will backport the following commits from `main` to `9.0`:
- [FIX - Failing test: Stateful Observability - Deployment-agnostic
Feature Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule "after all" hook in
"SyntheticsCustomStatusRule"
(#225090)](#225090)

<!--- Backport version: 9.6.6 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Faisal
Kanout","email":"faisal.kanout@elastic.co"},"sourceCommit":{"committedDate":"2025-06-25T11:15:24Z","message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6","branchLabelMapping":{"^v9.1.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport:prev-minor","Team:obs-ux-management","v9.1.0","v8.19.0","author:obs-ux-management"],"title":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\"","number":225090,"url":"https://github.com/elastic/kibana/pull/225090","mergeCommit":{"message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6"}},"sourceBranch":"main","suggestedTargetBranches":["8.19"],"targetPullRequestStates":[{"branch":"main","label":"v9.1.0","branchLabelMappingKey":"^v9.1.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/225090","number":225090,"mergeCommit":{"message":"FIX
- Failing test: Stateful Observability - Deployment-agnostic Feature
Flag API Integration
Tests.x-pack/test/api_integration/deployment_agnostic/apis/observability/alerting/synthetics/custom_status_rule·ts
- Stateful Observability feature flag testing - Deployment-agnostic API
integration tests SyntheticsCustomStatusRule \"after all\" hook in
\"SyntheticsCustomStatusRule\" (#225090)\n\n## Summary\n\nIt fixes
#224778\n✅ Falky test
runner\nhttps://buildkite.com/elastic/kibana-flaky-test-suite-runner/builds/8441\n###
Checklist\n\nCheck the PR satisfies following conditions. \n\nReviewers
should verify this PR satisfies this list as well.\n\n- [ ] Any text
added follows [EUI's
writing\nguidelines](https://elastic.github.io/eui/#/guidelines/writing),
uses\nsentence case text and includes
[i18n\nsupport](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md)\n-
[
]\n[Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html)\nwas
added for features that require explanation or tutorials\n- [ ] [Unit or
functional\ntests](https://www.elastic.co/guide/en/kibana/master/development-tests.html)\nwere
updated or added to match the most common scenarios\n- [ ] If a plugin
configuration key changed, check if it needs to be\nallowlisted in the
cloud and added to the
[docker\nlist](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker)\n-
[ ] This was checked for breaking HTTP API changes, and any
breaking\nchanges have been approved by the breaking-change committee.
The\n`release_note:breaking` label should be applied in these
situations.\n- [ ] [Flaky
Test\nRunner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1)
was\nused on any tests changed\n- [ ] The PR description includes the
appropriate Release Notes section,\nand the correct `release_note:*`
label is applied per
the\n[guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process)\n\n###
Identify risks\n\nDoes this PR introduce any risks? For example,
consider risks like hard\nto test bugs, performance regression,
potential of data loss.\n\nDescribe the risk, its severity, and
mitigation for each identified\nrisk. Invite stakeholders and evaluate
how to proceed before merging.\n\n- [ ] [See some
risk\nexamples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx)\n-
[ ]
...","sha":"e140d226bd07fb429b13839084140013ccb0ecf6"}},{"branch":"8.19","label":"v8.19.0","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->

Co-authored-by: Faisal Kanout <faisal.kanout@elastic.co>
benakansara added a commit that referenced this pull request Dec 9, 2025
Resolves #241490

- Followed same approach as the
[fix](#225090) for another similar
failing test which is adding `conflicts: 'proceed'` in `deleteByQuery`
to avoid throwing error in case of conflict deleting documents.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

author:obs-ux-management PRs authored by the obs ux management team release_note:skip Skip the PR/issue when compiling release notes Team:actionable-obs Formerly "obs-ux-management", responsible for SLO, o11y alerting, significant events, & synthetics. v8.19.0 v9.0.4 v9.1.0

Projects

None yet

4 participants