Skip to content

[CI] ensure one shot-worker#22588

Merged
v1v merged 1 commit intoelastic:masterfrom
v1v:feature/force-new-workers
Nov 16, 2020
Merged

[CI] ensure one shot-worker#22588
v1v merged 1 commit intoelastic:masterfrom
v1v:feature/force-new-workers

Conversation

@v1v
Copy link
Copy Markdown
Member

@v1v v1v commented Nov 16, 2020 •
edited
Loading

What does this PR do?

Force one-shot workers approach

Why is it important?

Certain builds are failing when configuring the worker with the install tools step. I've got my feeling that it happens normally when there is a peak of load, and could be caused when the windows workers are reused, although I'm not 100% sure if that's the reason yet.

[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>.ci/scripts/install-tools.bat
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set GOPATH=C:\Users\jenkins\workspace\Beats_beats_master 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set MAGEFILE_CACHE=C:\Users\jenkins\workspace\Beats_beats_master\.magefile 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>REM Configure GCC for either 32 or 64 bits 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set MINGW_ARCH=64 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>IF NOT EXIST "C:\Program Files (x86)" (set MINGW_ARCH=32 ) 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set PATH=C:\Users\jenkins\workspace\Beats_beats_master\bin;C:\ProgramData\chocolatey\bin;C:\tools\mingw64\bin;C:\Users\jenkins\workspace\Beats_beats_master\bin;C:\Users\jenkins\.gvm\versions\go1.14.7.windows.amd64\bin;C:\ProgramData\chocolatey\bin;C:\Python38;C:\Python38\Scripts;C:\tools\mingw64\bin;C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Python38\Scripts\;C:\Python38\;C:\Python27\;C:\Python27\Scripts;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\PowerShell\7\;C:\ProgramData\chocolatey\bin;C:\ProgramData\GooGet;C:\Program Files\Google\Compute Engine\metadata_scripts;C:\Program Files\Google\Compute Engine\sysprep;C:\Program Files\infra\bin;C:\Program Files\Git\cmd;C:\Program Files\Java\jdk1.8.0_211\bin;C:\Program Files\CMake\bin;C:\tools\mingw64\bin;C:\Program Files\dotnet\ 
[2020-11-12T23:45:34.275Z] 
[2020-11-12T23:45:34.275Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>where /q curl 
[2020-11-12T23:45:34.534Z] 
[2020-11-12T23:45:34.534Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>IF ERRORLEVEL 1 (choco install curl -y --no-progress --skipdownloadcache ) 
[2020-11-12T23:45:35.473Z] Chocolatey v0.10.15
[2020-11-12T23:45:35.733Z] Installing the following packages:
[2020-11-12T23:45:35.733Z] curl
[2020-11-12T23:45:35.733Z] By installing you accept licenses for the packages.
[2020-11-12T23:45:50.630Z] 
[2020-11-12T23:45:50.630Z] curl v7.73.0 [Approved]
[2020-11-12T23:45:50.630Z] curl package files install completed. Performing other installation steps.
[2020-11-12T23:45:50.630Z] Extracting 64-bit C:\ProgramData\chocolatey\lib\curl\tools\curl-7.73.0-win64-mingw.zip to C:\ProgramData\chocolatey\lib\curl\tools...
[2020-11-12T23:45:50.630Z] C:\ProgramData\chocolatey\lib\curl\tools
[2020-11-12T23:45:51.210Z]  ShimGen has successfully created a shim for curl.exe
[2020-11-12T23:45:51.210Z]  The install of curl was successful.
[2020-11-12T23:45:51.210Z]   Software installed to 'C:\ProgramData\chocolatey\lib\curl\tools'
[2020-11-12T23:45:51.210Z] 
[2020-11-12T23:45:51.210Z] Chocolatey installed 1/1 packages. 
[2020-11-12T23:45:51.210Z]  See the log for details (C:\ProgramData\chocolatey\logs\chocolatey.log).
[2020-11-12T23:45:51.790Z] 
[2020-11-12T23:45:51.790Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>mkdir C:\Users\jenkins\workspace\Beats_beats_master\bin 
[2020-11-12T23:45:51.790Z] 
[2020-11-12T23:45:51.790Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>REM If 32 bits then install the GVM accordingly 
[2020-11-12T23:45:51.790Z] 
[2020-11-12T23:45:51.790Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>IF NOT EXIST "C:\Program Files (x86)" (curl -sL -o C:\Users\jenkins\workspace\Beats_beats_master\bin\gvm.exe https://github.com/andrewkroh/gvm/releases/download/v0.2.2/gvm-windows-386.exe ) 
[2020-11-12T23:45:51.790Z] 
[2020-11-12T23:45:51.790Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>where /q gvm 
[2020-11-12T23:45:52.169Z] 
[2020-11-12T23:45:52.169Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>IF ERRORLEVEL 1 (
[2020-11-12T23:45:52.169Z] IF EXIST "C:\Program Files (x86)" (curl -sL -o C:\Users\jenkins\workspace\Beats_beats_master\bin\gvm.exe https://github.com/andrewkroh/gvm/releases/download/v0.2.2/gvm-windows-amd64.exe )  ELSE (curl -sL -o C:\Users\jenkins\workspace\Beats_beats_master\bin\gvm.exe https://github.com/andrewkroh/gvm/releases/download/v0.2.2/gvm-windows-386.exe )  
[2020-11-12T23:45:52.169Z]  IF ERRORLEVEL 1 (exit /b 1 )  
[2020-11-12T23:45:52.169Z]  dir "C:\Users\jenkins\workspace\Beats_beats_master\bin" /b 
[2020-11-12T23:45:52.169Z] ) 
[2020-11-12T23:45:52.169Z] 
[2020-11-12T23:45:52.169Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>FOR /F "tokens=*" %i IN ('"gvm.exe" use 1.14.7 --format batch') DO %i
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set GOROOT=C:\Users\jenkins\.gvm\versions\go1.14.7.windows.amd64
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>set PATH=C:\Users\jenkins\.gvm\versions\go1.14.7.windows.amd64\bin;$C:\Users\jenkins\workspace\Beats_beats_master\bin;C:\ProgramData\chocolatey\bin;C:\tools\mingw64\bin;C:\Users\jenkins\workspace\Beats_beats_master\bin;C:\Users\jenkins\.gvm\versions\go1.14.7.windows.amd64\bin;C:\ProgramData\chocolatey\bin;C:\Python38;C:\Python38\Scripts;C:\tools\mingw64\bin;C:\ProgramData\Oracle\Java\javapath;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Python38\Scripts\;C:\Python38\;C:\Python27\;C:\Python27\Scripts;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\PowerShell\7\;C:\ProgramData\chocolatey\bin;C:\ProgramData\GooGet;C:\Program Files\Google\Compute Engine\metadata_scripts;C:\Program Files\Google\Compute Engine\sysprep;C:\Program Files\infra\bin;C:\Program Files\Git\cmd;C:\Program Files\Java\jdk1.8.0_211\bin;C:\Program Files\CMake\bin;C:\tools\mingw64\bin;C:\Program Files\dotnet\
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>go env 
[2020-11-12T23:46:59.872Z] 'go' is not recognized as an internal or external command,
[2020-11-12T23:46:59.872Z] operable program or batch file.
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>go get github.com/magefile/mage 
[2020-11-12T23:46:59.872Z] 'go' is not recognized as an internal or external command,
[2020-11-12T23:46:59.872Z] operable program or batch file.
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>where mage 
[2020-11-12T23:46:59.872Z] INFO: Could not find files for the given pattern(s).
[2020-11-12T23:46:59.872Z] 
[2020-11-12T23:46:59.872Z] C:\Users\jenkins\workspace\Beats_beats_master\src\github.com\elastic\beats>mage -version 
[2020-11-12T23:46:59.872Z] 'mage' is not recognized as an internal or external command,
[2020-11-12T23:46:59.872Z] operable program or batch file.

@v1v v1v self-assigned this Nov 16, 2020
@v1v v1v added the automation label Nov 16, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Nov 16, 2020
@v1v v1v requested a review from a team November 16, 2020 11:52
@v1v v1v added the Team:Automation Label for the Observability productivity team label Nov 16, 2020
@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Nov 16, 2020
@v1v v1v marked this pull request as ready for review November 16, 2020 11:52
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Nov 16, 2020

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 16630
Skipped 1349
Total 17979

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Nov 16, 2020

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #22588 opened]

  • Start Time: 2020-11-16T10:59:16.046+0000

  • Duration: 75 min 41 sec

Test stats 🧪

Test Results
Failed 0
Passed 16630
Skipped 1349
Total 17979

@v1v v1v merged commit 0a75258 into elastic:master Nov 16, 2020
@v1v v1v deleted the feature/force-new-workers branch November 16, 2020 14:36
@v1v v1v mentioned this pull request Nov 16, 2020
Merged
v1v added a commit to v1v/beats that referenced this pull request Nov 16, 2020
@v1v
[CI] ensure one shot-worker (elastic#22588)
429c343
v1v added a commit to v1v/beats that referenced this pull request Nov 16, 2020
@v1v
[CI] ensure one shot-worker (elastic#22588)
b1bd221
@v1v v1v mentioned this pull request Nov 16, 2020
Merged
v1v added a commit that referenced this pull request Nov 16, 2020
@v1v
[CI] ensure one shot-worker (#22588) (#22592)
1f3db93
v1v added a commit that referenced this pull request Nov 16, 2020
@v1v
[CI] ensure one shot-worker (#22588) (#22591)
1d58fff
v1v added a commit to v1v/beats that referenced this pull request Nov 17, 2020
@v1v
Revert "[CI] ensure one shot-worker (elastic#22588)"
8a42f53 
This reverts commit 0a75258.
@v1v v1v mentioned this pull request Nov 17, 2020
Merged
v1v added a commit that referenced this pull request Nov 17, 2020
@v1v
Revert "[CI] ensure one shot-worker (#22588) (#22592)"
42a8a02 
This reverts commit 1f3db93.
v1v added a commit that referenced this pull request Nov 17, 2020
@v1v
Revert "[CI] ensure one shot-worker (#22588) (#22591)"
26a505d 
This reverts commit 1d58fff.
v1v added a commit that referenced this pull request Nov 17, 2020
@v1v
Revert "[CI] ensure one shot-worker (#22588) (#22592)" (#22623)
12e5591 
This reverts commit 1f3db93.
v1v added a commit that referenced this pull request Nov 17, 2020
@v1v
Revert "[CI] ensure one shot-worker (#22588) (#22591)" (#22624)
beb80a7 
This reverts commit 1d58fff.
v1v added a commit that referenced this pull request Nov 17, 2020
@v1v
[ci] revert one shot-workers (#22622)
9157d18 
* Revert "[CI] filter static versus ephemeral workers (#22607)"
This reverts commit 5e21666.
* Revert "[CI] ensure one shot-worker (#22588)"
This reverts commit 0a75258.
v1v added a commit to v1v/beats that referenced this pull request Nov 17, 2020
@v1v
[CI] ensure one shot-worker (elastic#22588)
7aca472
@v1v v1v mentioned this pull request Mar 9, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cachedout cachedout cachedout approved these changes

+1 more reviewer

@mdelapenya mdelapenya mdelapenya approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

@v1v v1v

Labels

automation Team:Automation Label for the Observability productivity team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@v1v @elasticmachine @cachedout @mdelapenya