[One Workflow] Fix flaky alert trigger Scout test by removing order-dependent assertions#259299
Merged
skynetigor merged 4 commits intoelastic:mainfrom Mar 24, 2026
Merged
Conversation
dej611
reviewed
Mar 24, 2026
...anagement/test/scout_workflows_ui/ui/parallel_tests/workflow_execution/alert_trigger.spec.ts
Outdated
Show resolved
Hide resolved
…kibana into fix_alert_scout_test
Contributor
💛 Build succeeded, but was flaky
Failed CI StepsTest Failures
Metrics [docs] |
mbondyra
added a commit
to mbondyra/kibana
that referenced
this pull request
Mar 24, 2026
…ra/kibana into dashboard_align_attachment_to_api * 'dashboard_align_attachment_to_api' of github.com:mbondyra/kibana: (45 commits) [OTel Tracing] HTTP instrumentation (elastic#258663) Replace deprecated EUI icons in files owned by @elastic/ml-ui (elastic#255624) [Codeowners] add missing codeowners for security_solution_api_integration tests (elastic#259223) [CI] fix bad imports that came from a merge-race (elastic#259383) Add `.claude/worktrees/` to `.gitignore` (elastic#259192) Improve unknown-key validation error message in @kbn/config-schema (elastic#258633) [ML] Update Security ML jobs to use entity analytics fields for host and user fields (elastic#255339) [Table sweep] Update table columns responsiveness in Index Management and Dashboards (elastic#259340) skip failing test suite (elastic#258790) skip failing test suite (elastic#259261) chore: util to clean cached images (elastic#259335) [Entity Store] Use last_seen for automated resolution watermark (elastic#258574) [One Workflow] Fix flaky alert trigger Scout test by removing order-dependent assertions (elastic#259299) Skip serverless Discover request counts tests for MKI (elastic#259333) [Security Solution] render header title in new document flyout in Security Solution and Discover (elastic#258166) [Agent Builder] register inference endpoint feature (elastic#259259) [Agent Builder] Skills Command Menu - Add descriptions and scope options to agent (elastic#258964) [Streams][Streamlang][API] Fully use meta({id}) to reuse schema partials in OAS output (elastic#259275) fix(files_example): add tableCaption to EuiInMemoryTable for a11y (elastic#258289) [Entity Store] Adding list endpoint with query filter (elastic#258320) ...
jeramysoucy
pushed a commit
to jeramysoucy/kibana
that referenced
this pull request
Mar 26, 2026
…ependent assertions (elastic#259299) closes: elastic#252959 ## Summary Fixes flaky alert trigger Scout test by removing order-dependent assertions on workflow executions. Workflow executions can start in any order, so the test now collects all outputs first and then asserts that every expected value is present (order-independent), instead of checking each execution by index. Also re-enables the test (`test.describe.skip` → `test.describe`), which was skipped in elastic#252959.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
closes: #252959
Summary
Fixes flaky alert trigger Scout test by removing order-dependent assertions on workflow executions.
Workflow executions can start in any order, so the test now collects all outputs first and then asserts that every expected value is present (order-independent), instead of checking each execution by index.
Also re-enables the test (
test.describe.skip→test.describe), which was skipped in #252959.