Skip to content

[ci] Run checks before tests#198452

Merged
jbudz merged 2 commits intoelastic:mainfrom
jbudz:ci-mv-checks
Nov 4, 2024
Merged

[ci] Run checks before tests#198452
jbudz merged 2 commits intoelastic:mainfrom
jbudz:ci-mv-checks

Conversation

@jbudz
Copy link
Copy Markdown
Contributor

@jbudz jbudz commented Oct 30, 2024

Should be the last group to move before tests for now.

The intent has been to move steps that fit in the build window to run before tests start. Catching errors before parallel steps should help reduce the number of test runs with known issues.

Should be the last group to move before tests for now.

The intent has been to move steps that fit in the build window to
run before tests start.  Catching errors before parallel steps
should help reduce the number of test runs with known issues.
@jbudz jbudz added Team:Operations Kibana-Operations Team release_note:skip Skip the PR/issue when compiling release notes backport:prev-major labels Oct 30, 2024
@jbudz jbudz marked this pull request as ready for review October 30, 2024 23:05
@jbudz jbudz requested a review from a team as a code owner October 30, 2024 23:05
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@elasticmachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

@jbudz jbudz merged commit cbb211a into elastic:main Nov 4, 2024
@kibanamachine
Copy link
Copy Markdown
Contributor

Starting backport for target branches: 8.15, 8.16, 8.x

https://github.com/elastic/kibana/actions/runs/11671522424

@kibanamachine
Copy link
Copy Markdown
Contributor

💔 All backports failed

Status Branch Result
8.15 Backport failed because of merge conflicts
8.16 Backport failed because of merge conflicts

You might need to backport the following PRs to 8.16:
- [Security Solution] Removing cypress folder (#197273)
8.x Backport failed because of merge conflicts

You might need to backport the following PRs to 8.x:
- [Security Solution] Removing cypress folder (#197273)

Manual backport

To create the backport manually run:

node scripts/backport --pr 198452

Questions ?

Please refer to the Backport tool documentation

jbudz added a commit to jbudz/kibana that referenced this pull request Nov 4, 2024
Should be the last group to move before tests for now.

The intent has been to move steps that fit in the build window to run
before tests start. Catching errors before parallel steps should help
reduce the number of test runs with known issues.
jbudz added a commit to jbudz/kibana that referenced this pull request Nov 4, 2024
Should be the last group to move before tests for now.

The intent has been to move steps that fit in the build window to run
before tests start. Catching errors before parallel steps should help
reduce the number of test runs with known issues.
jbudz added a commit to jbudz/kibana that referenced this pull request Nov 4, 2024
Should be the last group to move before tests for now.

The intent has been to move steps that fit in the build window to run
before tests start. Catching errors before parallel steps should help
reduce the number of test runs with known issues.
tylersmalley added a commit that referenced this pull request Feb 14, 2026
It's not an actual dependency of downstream steps, but was added more to
provide as a cost cutting gate. However, there are times it delays
downstream steps without any added value.

Here's the provenance for `check_oas_snapshot` in the pull-request
pipeline.

### 1. OAS snapshot capture first added to CI (inside "Checks")

- [PR #183338](#183338) / commit
[`975eeed255d0`](975eeed255d0)
(May 30, 2024) —
 "[HTTP/OAS] Commit OAS snapshot"
- Added `.buildkite/scripts/steps/capture_oas_snapshot.sh` and wired it
into `.buildkite/scripts/steps/checks.sh` (so it ran as part of the
Checks step, not a
standalone pipeline step yet).

### 2. Standalone "Check OAS Snapshot" step added to PR pipeline

- [PR #196534](#196534) / commit
[`2fbc843e0d69`](2fbc843e0d69)
(Oct 17, 2024) —
 "[ci] Extract OAS check + add retry"
- Motivation (from the PR summary): the capture step was flaky and was
breaking Checks; they extracted it into its own heavy step (starts
ES+Kibana) and added
retries.
- This is where it gets added as its own step in
`.buildkite/pipelines/pull_request/base.yml`, running
`.buildkite/scripts/steps/checks/capture_oas_snapshot.sh`.

### 3. `depends_on: check_oas_snapshot` added across PR test suite
pipelines

- [PR #198452](#198452) / commit
[`cbb211abe0cd`](cbb211abe0cd)
(Nov 4, 2024) —
"[ci] Run checks before tests"
- This commit added `key: check_oas_snapshot` in
`.buildkite/pipelines/pull_request/base.yml` and updated many PR suite
pipeline YAMLs to depend on it (and on
`checks`) before running.
- Example change: `.buildkite/pipelines/pull_request/response_ops.yml`
adds `- check_oas_snapshot` under `depends_on` in that commit.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
patrykkopycinski pushed a commit to patrykkopycinski/kibana that referenced this pull request Feb 19, 2026
It's not an actual dependency of downstream steps, but was added more to
provide as a cost cutting gate. However, there are times it delays
downstream steps without any added value.

Here's the provenance for `check_oas_snapshot` in the pull-request
pipeline.

### 1. OAS snapshot capture first added to CI (inside "Checks")

- [PR elastic#183338](elastic#183338) / commit
[`975eeed255d0`](elastic@975eeed255d0)
(May 30, 2024) —
 "[HTTP/OAS] Commit OAS snapshot"
- Added `.buildkite/scripts/steps/capture_oas_snapshot.sh` and wired it
into `.buildkite/scripts/steps/checks.sh` (so it ran as part of the
Checks step, not a
standalone pipeline step yet).

### 2. Standalone "Check OAS Snapshot" step added to PR pipeline

- [PR elastic#196534](elastic#196534) / commit
[`2fbc843e0d69`](elastic@2fbc843e0d69)
(Oct 17, 2024) —
 "[ci] Extract OAS check + add retry"
- Motivation (from the PR summary): the capture step was flaky and was
breaking Checks; they extracted it into its own heavy step (starts
ES+Kibana) and added
retries.
- This is where it gets added as its own step in
`.buildkite/pipelines/pull_request/base.yml`, running
`.buildkite/scripts/steps/checks/capture_oas_snapshot.sh`.

### 3. `depends_on: check_oas_snapshot` added across PR test suite
pipelines

- [PR elastic#198452](elastic#198452) / commit
[`cbb211abe0cd`](elastic@cbb211abe0cd)
(Nov 4, 2024) —
"[ci] Run checks before tests"
- This commit added `key: check_oas_snapshot` in
`.buildkite/pipelines/pull_request/base.yml` and updated many PR suite
pipeline YAMLs to depend on it (and on
`checks`) before running.
- Example change: `.buildkite/pipelines/pull_request/response_ops.yml`
adds `- check_oas_snapshot` under `depends_on` in that commit.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
ersin-erdal pushed a commit to ersin-erdal/kibana that referenced this pull request Feb 19, 2026
It's not an actual dependency of downstream steps, but was added more to
provide as a cost cutting gate. However, there are times it delays
downstream steps without any added value.

Here's the provenance for `check_oas_snapshot` in the pull-request
pipeline.

### 1. OAS snapshot capture first added to CI (inside "Checks")

- [PR elastic#183338](elastic#183338) / commit
[`975eeed255d0`](elastic@975eeed255d0)
(May 30, 2024) —
 "[HTTP/OAS] Commit OAS snapshot"
- Added `.buildkite/scripts/steps/capture_oas_snapshot.sh` and wired it
into `.buildkite/scripts/steps/checks.sh` (so it ran as part of the
Checks step, not a
standalone pipeline step yet).

### 2. Standalone "Check OAS Snapshot" step added to PR pipeline

- [PR elastic#196534](elastic#196534) / commit
[`2fbc843e0d69`](elastic@2fbc843e0d69)
(Oct 17, 2024) —
 "[ci] Extract OAS check + add retry"
- Motivation (from the PR summary): the capture step was flaky and was
breaking Checks; they extracted it into its own heavy step (starts
ES+Kibana) and added
retries.
- This is where it gets added as its own step in
`.buildkite/pipelines/pull_request/base.yml`, running
`.buildkite/scripts/steps/checks/capture_oas_snapshot.sh`.

### 3. `depends_on: check_oas_snapshot` added across PR test suite
pipelines

- [PR elastic#198452](elastic#198452) / commit
[`cbb211abe0cd`](elastic@cbb211abe0cd)
(Nov 4, 2024) —
"[ci] Run checks before tests"
- This commit added `key: check_oas_snapshot` in
`.buildkite/pipelines/pull_request/base.yml` and updated many PR suite
pipeline YAMLs to depend on it (and on
`checks`) before running.
- Example change: `.buildkite/pipelines/pull_request/response_ops.yml`
adds `- check_oas_snapshot` under `depends_on` in that commit.

Signed-off-by: Tyler Smalley <tyler.smalley@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release_note:skip Skip the PR/issue when compiling release notes Team:Operations Kibana-Operations Team v9.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants