Skip to content

[8.19] [scout] discover tests with custom server configs (#251297)#254155

Merged
dmlemeshko merged 11 commits intoelastic:8.19from
dmlemeshko:backport/8.19/pr-251297
Mar 3, 2026
Merged

[8.19] [scout] discover tests with custom server configs (#251297)#254155
dmlemeshko merged 11 commits intoelastic:8.19from
dmlemeshko:backport/8.19/pr-251297

Conversation

@dmlemeshko
Copy link
Copy Markdown
Contributor

Backport

This will backport the following commits from main to 8.19:

Questions ?

Please refer to the Backport tool documentation

## Summary

This PR update Scout discovery command to optionally include configs
associated with custom servers directories (located under
`test/scout_*/` path):

```bash
node scripts/scout.js discover-playwright-configs --include-custom-servers
```

Since some Teams may decide not to run their config in the unified Scout
CI execution, I added `excluded_configs` in
`.buildkite/scout_ci_config.yml` to list them explicitly:

```
plugins:
  enabled:
    - apm
    - console
    ...
  disabled:

packages:
    ...

# Define test configs to be excluded from automatic discovery & execution in CI environment (process.env.CI=true)
excluded_configs:
  - x-pack/solutions/security/plugins/cloud_security_posture/test/scout_cspm_agentless/ui/parallel.playwright.config.ts
```

While running on CI environment `node scripts/scout.js
discover-playwright-configs` will exclude those configs and they won't
be run.

This PR also removed uiam tests custom CI script/step definition as it
is no longer needed.

---------

Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
(cherry picked from commit 7b13120)

# Conflicts:
#	.buildkite/pipelines/es_serverless/verify_es_serverless_image.yml
#	.buildkite/pipelines/on_merge.yml
#	.buildkite/pipelines/pull_request/profiling_cypress.yml
#	.buildkite/scout_ci_config.yml
#	.buildkite/scripts/pipelines/pull_request/pipeline.ts
#	.buildkite/scripts/steps/test/scout_test_run_builder.sh
#	src/platform/packages/shared/kbn-scout/src/cli/config_discovery.test.ts
@dmlemeshko dmlemeshko added the backport This PR is a backport of another PR label Feb 20, 2026
@dmlemeshko dmlemeshko enabled auto-merge (squash) February 20, 2026 10:39
@dmlemeshko dmlemeshko requested a review from a team February 20, 2026 11:45
@dmlemeshko dmlemeshko merged commit e1ea8f9 into elastic:8.19 Mar 3, 2026
13 checks passed
@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport This PR is a backport of another PR

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants