Skip to content
This repository was archived by the owner on Sep 17, 2024. It is now read-only.

Only run Fleet mode and upgrade tests on Ubuntu 22#3054

Merged
joshdover merged 4 commits intomainfrom
fleet-stabilize
Oct 4, 2022
Merged

Only run Fleet mode and upgrade tests on Ubuntu 22#3054
joshdover merged 4 commits intomainfrom
fleet-stabilize

Conversation

@joshdover
Copy link
Copy Markdown
Contributor

@joshdover joshdover commented Sep 28, 2022

What does this PR do?

The Fleet test pipeline has been failing for months. This change eliminates a bunch of test scenarios while we work on stabilizing the tests to improve confidence in the suite.

Originally the goal was to run the Fleet mode and upgrade tests on Windows and Linux, but Windows is currently failing, so it is now only running on Ubuntu 22.

Why is it important?

We're ignoring all of these failures because they're so flaky. We need to be able to gate Agent builds and Fleet releases with these tests

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have run the Unit tests (make unit-test), and they are passing locally
  • I have run the End-2-End tests for the suite I'm working on, and they are passing locally
  • I have noticed new Go dependencies (run make notice in the proper directory)

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Sep 28, 2022

This pull request does not have a backport label. Could you fix it @joshdover? 🙏
To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

  • backport-v./d./d./d is the label to automatically backport to the 7./d branch. /d is the digit
    NOTE: backport-skip has been added to this pull request.

@mergify mergify bot added the backport-skip Skip notification from the automated backport with mergify label Sep 28, 2022
@joshdover joshdover added backport-v8.4.0 Automated backport with mergify backport-v8.5.0 Automated backport with mergify and removed backport-skip Skip notification from the automated backport with mergify labels Sep 28, 2022
@joshdover joshdover requested a review from AndersonQ September 28, 2022 14:19
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Sep 28, 2022

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2022-10-04T07:54:34.420+0000

  • Duration: 59 min 51 sec

Test stats 🧪

Test Results
Failed 0
Passed 216
Skipped 0
Total 216

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@cachedout
Copy link
Copy Markdown
Contributor

cc: @pazone

@pazone
Copy link
Copy Markdown

pazone commented Sep 29, 2022

👍

@joshdover joshdover enabled auto-merge (squash) October 4, 2022 07:55
@joshdover joshdover changed the title Only run Fleet mode and upgrade tests on 2 platforms Only run Fleet mode and upgrade tests on Ubuntu 22 Oct 4, 2022
@joshdover joshdover merged commit 58255b0 into main Oct 4, 2022
mergify bot pushed a commit that referenced this pull request Oct 4, 2022
@mergify mergify bot deleted the fleet-stabilize branch October 4, 2022 08:54
@v1v
Copy link
Copy Markdown
Member

v1v commented Oct 4, 2022

@Mergifyio backport 8.5

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Oct 4, 2022

backport 8.5

✅ Backports have been created

Details

mergify bot pushed a commit that referenced this pull request Oct 4, 2022
joshdover added a commit that referenced this pull request Oct 4, 2022
…3076)

Co-authored-by: Josh Dover <1813008+joshdover@users.noreply.github.com>
joshdover added a commit that referenced this pull request Oct 17, 2022
(cherry picked from commit 58255b0)

Co-authored-by: Josh Dover <1813008+joshdover@users.noreply.github.com>
v1v added a commit to v1v/e2e-testing that referenced this pull request Oct 19, 2022
* upstream/main: (35 commits)
  bump stack version 8.6.0-6545f2df (elastic#3135)
  bump stack version 8.6.0-cae815eb (elastic#3130)
  bump stack version 8.6.0-54a302f0 (elastic#3125)
  bump stack version 8.6.0-233dc5d4 (elastic#3122)
  bump stack version 8.6.0-40086bc7 (elastic#3115)
  bump stack version 8.6.0-5a8d757d (elastic#3111)
  bump stack version 8.6.0-c49fac70 (elastic#3106)
  bump stack version 8.6.0-7c9f25a9 (elastic#3105)
  bump stack version 8.6.0-d939cfde (elastic#3096)
  bump stack version 8.6.0-0fca2953 (elastic#3081)
  Turn off all tests but Fleet mode and upgrade for Beats and Agent pipelines (elastic#3077)
  backport: Add 8.5 branch (elastic#3029)
  Only run Fleet mode and upgrade tests on 2 platforms (elastic#3054)
  fix: added setuptools-rust to requiremets.txt (elastic#3048)
  Added support for bulk api update change (elastic#3043)
  Making Changes for Docs for E2E setup (elastic#2929)
  Update ingest notifications channel (elastic#3023)
  chore: stringify http responses (elastic#2772)
  Adding support for v1.25.0 k8s (elastic#2975)
  Fix testcases for fleet api (elastic#2999)
  ...
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

backport-v8.4.0 Automated backport with mergify backport-v8.5.0 Automated backport with mergify

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants