Add support for essentials and ease tiers in Scout#244553
Add support for essentials and ease tiers in Scout#244553MadameSheema merged 8 commits intoelastic:mainfrom
Conversation
|
Pinging @elastic/security-solution (Team: SecuritySolution) |
| ...defaultConfig.kbnTestServer, | ||
| serverArgs: [ | ||
| ...defaultConfig.kbnTestServer.serverArgs, | ||
| '--serverless=security', |
There was a problem hiding this comment.
just to make sure: serverless arg should be security. Not EASE or essentials?
There was a problem hiding this comment.
Right, serverless arg should be security, EASE and essentials refers to the tier used in the security project.
dmlemeshko
left a comment
There was a problem hiding this comment.
LGTM
@MadameSheema I think it would be better to backport PR to "all-open" to avoid merge conflicts in the future even though we don't run svl tests in those branches.
With this PR tests won't be run for tiers, you need to make changes in
kibana/.buildkite/scripts/steps/test/scout_configs.sh
Lines 62 to 74 in 4fc8027
I'm not sure if we need to run all the platform tests for each tier, let me know you thoughts
Thank you for pointing this out! I'll make the changes 😊
I’m not sure because I don’t know what the platform tests cover. Could you please share the link with me? |
💛 Build succeeded, but was flaky
Failed CI StepsTest Failures
Metrics [docs]
History
|
delanni
left a comment
There was a problem hiding this comment.
scout_configs.sh 👍
Side question:
@elastic/appex-qa - do you think the tools/scripts around scout are located close enough, so we could share or hand over ownership of these scripts? You probably know more about it, so your approval might be more relevant
|
Starting backport for target branches: 8.19, 9.1, 9.2 |
💔 All backports failed
Manual backportTo create the backport manually run: Questions ?Please refer to the Backport tool documentation |
## Summary Adds support for the essentials and ease severless tiers to the Scout testing framework, enabling local server startup with the Security Essentials and Security EASE tier configuration. ### Testing * Verified that node scripts/scout.js start-server --serverless=security-essentials successfully starts the environment * Verified that node scripts/scout.js start-server --serverless=security-ease successfully starts the environment --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
|
Friendly reminder: Looks like this PR hasn’t been backported yet. |
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
## Summary Adds support for the essentials and ease severless tiers to the Scout testing framework, enabling local server startup with the Security Essentials and Security EASE tier configuration. ### Testing * Verified that node scripts/scout.js start-server --serverless=security-essentials successfully starts the environment * Verified that node scripts/scout.js start-server --serverless=security-ease successfully starts the environment --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> (cherry picked from commit d273b13) # Conflicts: # .buildkite/scripts/steps/test/scout_configs.sh
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
## Summary Adds support for the essentials and ease severless tiers to the Scout testing framework, enabling local server startup with the Security Essentials and Security EASE tier configuration. ### Testing * Verified that node scripts/scout.js start-server --serverless=security-essentials successfully starts the environment * Verified that node scripts/scout.js start-server --serverless=security-ease successfully starts the environment --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> (cherry picked from commit d273b13) # Conflicts: # .buildkite/scripts/steps/test/scout_configs.sh # src/platform/packages/shared/kbn-scout/src/playwright/tags.ts # src/platform/packages/shared/kbn-scout/src/playwright/utils/runner_utils.ts # src/platform/packages/shared/kbn-scout/src/servers/flags.ts # src/platform/packages/shared/kbn-scout/src/types/cli.d.ts
|
Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync. |
1 similar comment
|
Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync. |
|
Looks like this PR has backport PRs but they still haven't been merged. Please merge them ASAP to keep the branches relatively in sync. |
## Summary Adds support for the essentials and ease severless tiers to the Scout testing framework, enabling local server startup with the Security Essentials and Security EASE tier configuration. ### Testing * Verified that node scripts/scout.js start-server --serverless=security-essentials successfully starts the environment * Verified that node scripts/scout.js start-server --serverless=security-ease successfully starts the environment --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
…245218) # Backport This will backport the following commits from `main` to `9.2`: - [Add support for essentials and ease tiers in Scout (#244553)](#244553) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Gloria Hornero","email":"gloria.hornero@elastic.co"},"sourceCommit":{"committedDate":"2025-12-02T09:38:37Z","message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport missing","Team: SecuritySolution","backport:all-open","v9.3.0"],"title":"Add support for essentials and ease tiers in Scout","number":244553,"url":"https://github.com/elastic/kibana/pull/244553","mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/244553","number":244553,"mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}}]}] BACKPORT--> Co-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>
…245220) # Backport This will backport the following commits from `main` to `9.1`: - [Add support for essentials and ease tiers in Scout (#244553)](#244553) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Gloria Hornero","email":"gloria.hornero@elastic.co"},"sourceCommit":{"committedDate":"2025-12-02T09:38:37Z","message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","backport missing","Team: SecuritySolution","backport:all-open","v9.3.0"],"title":"Add support for essentials and ease tiers in Scout","number":244553,"url":"https://github.com/elastic/kibana/pull/244553","mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/244553","number":244553,"mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}},{"url":"https://github.com/elastic/kibana/pull/245218","number":245218,"branch":"9.2","state":"OPEN"}]}] BACKPORT--> --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> Co-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>
💚 All backports created successfully
Note: Successful backport PRs will be merged automatically after passing CI. Questions ?Please refer to the Backport tool documentation |
…246052) # Backport This will backport the following commits from `main` to `8.19`: - [Add support for essentials and ease tiers in Scout (#244553)](#244553) <!--- Backport version: 10.2.0 --> ### Questions ? Please refer to the [Backport tool documentation](https://github.com/sorenlouv/backport) <!--BACKPORT [{"author":{"name":"Gloria Hornero","email":"gloria.hornero@elastic.co"},"sourceCommit":{"committedDate":"2025-12-02T09:38:37Z","message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169","branchLabelMapping":{"^v9.3.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","Team: SecuritySolution","backport:all-open","v9.3.0","v9.2.3","v9.1.9"],"title":"Add support for essentials and ease tiers in Scout","number":244553,"url":"https://github.com/elastic/kibana/pull/244553","mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}},"sourceBranch":"main","suggestedTargetBranches":[],"targetPullRequestStates":[{"branch":"main","label":"v9.3.0","branchLabelMappingKey":"^v9.3.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/244553","number":244553,"mergeCommit":{"message":"Add support for essentials and ease tiers in Scout (#244553)\n\n## Summary\n\nAdds support for the essentials and ease severless tiers to the Scout\ntesting framework, enabling local server startup with the Security\nEssentials and Security EASE tier configuration.\n\n### Testing\n* Verified that node scripts/scout.js start-server\n--serverless=security-essentials successfully starts the environment\n* Verified that node scripts/scout.js start-server\n--serverless=security-ease successfully starts the environment\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>","sha":"d273b13e561742ececd030f269b746da54915169"}},{"branch":"9.2","label":"v9.2.3","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/245218","number":245218,"state":"MERGED","mergeCommit":{"sha":"c2d14f99d8409cb7a70aa0471ff683ad65063f86","message":"[9.2] Add support for essentials and ease tiers in Scout (#244553) (#245218)\n\n# Backport\n\nThis will backport the following commits from `main` to `9.2`:\n- [Add support for essentials and ease tiers in Scout\n(#244553)](https://github.com/elastic/kibana/pull/244553)\n\n\n\n### Questions ?\nPlease refer to the [Backport tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n\n\nCo-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>"}},{"branch":"9.1","label":"v9.1.9","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"url":"https://github.com/elastic/kibana/pull/245220","number":245220,"state":"MERGED","mergeCommit":{"sha":"b43c3082b4cca070d8f7d8e41b13a460e0094784","message":"[9.1] Add support for essentials and ease tiers in Scout (#244553) (#245220)\n\n# Backport\n\nThis will backport the following commits from `main` to `9.1`:\n- [Add support for essentials and ease tiers in Scout\n(#244553)](https://github.com/elastic/kibana/pull/244553)\n\n\n\n### Questions ?\nPlease refer to the [Backport tool\ndocumentation](https://github.com/sorenlouv/backport)\n\n\n\n---------\n\nCo-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>\nCo-authored-by: Dzmitry Lemechko <dzmitry.lemechko@elastic.co>"}}]}] BACKPORT--> --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Summary
Adds support for the essentials and ease severless tiers to the Scout testing framework, enabling local server startup with the Security Essentials and Security EASE tier configuration.
Testing