chore: use a different e2e profile for running them from Beats#31531
Merged
mdelapenya merged 2 commits intomainfrom May 10, 2022
Merged
chore: use a different e2e profile for running them from Beats#31531mdelapenya merged 2 commits intomainfrom
mdelapenya merged 2 commits intomainfrom
Conversation
The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs
8 tasks
Contributor
💚 Build Succeeded
Expand to view the summary
Build stats
Test stats 🧪
💚 Flaky test reportTests succeeded. 🤖 GitHub commentsTo re-run your PR in the CI, just comment with:
|
v1v
approved these changes
May 5, 2022
mdelapenya
commented
May 10, 2022
Contributor
Author
|
Because the counterpart is already in place (https://github.com/elastic/e2e-testing/blob/main/.ci/.e2e-tests-beats.yaml), I'd say this is ready to go |
kuisathaverat
approved these changes
May 10, 2022
cmacknz
approved these changes
May 10, 2022
mergify bot
pushed a commit
that referenced
this pull request
May 10, 2022
* chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension (cherry picked from commit 03b013e) # Conflicts: # .ci/packaging.groovy
mergify bot
pushed a commit
that referenced
this pull request
May 10, 2022
* chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension (cherry picked from commit 03b013e) # Conflicts: # .ci/packaging.groovy
mergify bot
pushed a commit
that referenced
this pull request
May 10, 2022
* chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension (cherry picked from commit 03b013e)
Merged
rdner
pushed a commit
that referenced
this pull request
Jun 2, 2022
… them from Beats (#31573) * chore: use a different e2e profile for running them from Beats (#31531) * chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension (cherry picked from commit 03b013e) * fix: proper filename Co-authored-by: Manuel de la Peña <mdelapenya@gmail.com>
mdelapenya
added a commit
that referenced
this pull request
Jun 15, 2022
… (#31571) * chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension (cherry picked from commit 03b013e) # Conflicts: # .ci/packaging.groovy Co-authored-by: Manuel de la Peña <mdelapenya@gmail.com>
chrisberkhout
pushed a commit
that referenced
this pull request
Jun 1, 2023
* chore: use a different e2e profile for running them from Beats The e2e supports passing profile, which is used to execute a different combination of scenarios/suites to be run in different OSs/Archs * fix: file extension
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
5 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
It passes the name of a profile that will be used to add/retire specific tests from the e2e test suite when it's called from Beats pipeline.
Why is it important?
We'd like to remove scenarios that the team consider flaky while they are investigating them, to avoid adding noise to the rest of pull-requests.
I personally don't like to skip a test without further investigation because it's easily forgotten to be re-added. On the other hand, I understand that this PR would improve the reliability of the tests, therefore the team would work more smoothly and with more confidence in the CI system.
Checklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.Author's Checklist
Related issues
Requires elastic/e2e-testing#2482