Skip to content

Cherry-pick to 7.9: [CI] more parallel stages and less provisioned workers (#20569)#20582

Merged
v1v merged 2 commits intoelastic:7.9from
v1v:backport/7.9/pr-20569
Aug 17, 2020
Merged

Cherry-pick to 7.9: [CI] more parallel stages and less provisioned workers (#20569)#20582
v1v merged 2 commits intoelastic:7.9from
v1v:backport/7.9/pr-20569

Conversation

@v1v
Copy link
Copy Markdown
Member

@v1v v1v commented Aug 13, 2020

Backports the following commits to 7.9:

@v1v v1v added automation backport ci Team:Automation Label for the Observability productivity team labels Aug 13, 2020
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 13, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Aug 13, 2020

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #20582 updated]

  • Start Time: 2020-08-17T09:14:08.138+0000

  • Duration: 65 min 18 sec

Test stats 🧪

Test Results
Failed 2
Passed 17563
Skipped 1833
Total 19398

Test errors

Expand to view the tests failures

  • Name: Build and Test / Libbeat / Libbeat oss / TestOutputReload – pipeline

    • Age: 1
    • Duration: 68.9
    • Error Details: Failed
  • Name: Build and Test / Libbeat / Libbeat oss / TestOutputReload/client – pipeline

    • Age: 1
    • Duration: 35.29
    • Error Details: Failed

Steps errors

Expand to view the steps failures

  • Name: Mage build test

    • Description: mage build test

    • Duration: 22 min 14 sec

    • Start Time: 2020-08-17T09:38:34.190+0000

    • log

  • Name: Make test

    • Description: make -C generator/_templates/metricbeat test

    • Duration: 1 min 51 sec

    • Start Time: 2020-08-17T09:39:02.614+0000

    • log

  • Name: Make test

    • Description: make -C generator/_templates/metricbeat test

    • Duration: 1 min 7 sec

    • Start Time: 2020-08-17T09:54:41.548+0000

    • log

  • Name: Recursively delete the current directory from the workspace

    • Description: script returned exit code 2

    • Duration: 0 min 17 sec

    • Start Time: 2020-08-17T09:58:18.576+0000

    • log

  • Name: Make test

    • Description: make -C generator/_templates/beat test

    • Duration: 2 min 23 sec

    • Start Time: 2020-08-17T09:56:40.337+0000

    • log

  • Name: Recursively delete the current directory from the workspace

    • Description: script returned exit code 2

    • Duration: 0 min 18 sec

    • Start Time: 2020-08-17T09:59:10.318+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-08-17T10:18:40.044Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-20582-2/source/source.tgz
[2020-08-17T10:18:40.062Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-20582-2/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-20582/source.tgz
[2020-08-17T10:18:47.611Z] + tar --version
[2020-08-17T10:18:47.907Z] + tar -xpf source.tgz
[2020-08-17T10:18:58.214Z] + rm source.tgz
[2020-08-17T10:18:58.227Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats
[2020-08-17T10:18:58.248Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Lint
[2020-08-17T10:18:58.337Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-08-17T10:18:58.427Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Winlogbeat-oss
[2020-08-17T10:18:58.509Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-08-17T10:18:58.590Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-08-17T10:18:58.669Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/dockerlogbeat
[2020-08-17T10:18:58.758Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Journalbeat
[2020-08-17T10:18:58.854Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-08-17T10:18:58.944Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-08-17T10:18:59.029Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Packetbeat-Linux
[2020-08-17T10:18:59.109Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-08-17T10:18:59.209Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Heartbeat-oss
[2020-08-17T10:18:59.296Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-08-17T10:18:59.394Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Heartbeat-Windows
[2020-08-17T10:18:59.477Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-08-17T10:18:59.558Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-08-17T10:18:59.656Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-08-17T10:18:59.739Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-08-17T10:18:59.839Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-08-17T10:18:59.921Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-08-17T10:19:00.008Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-08-17T10:19:00.105Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-08-17T10:19:00.198Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-Windows
[2020-08-17T10:19:00.309Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-08-17T10:19:00.411Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-08-17T10:19:00.490Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Libbeat-x-pack
[2020-08-17T10:19:00.579Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Functionbeat-Windows
[2020-08-17T10:19:00.660Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-08-17T10:19:00.738Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Packetbeat-Windows
[2020-08-17T10:19:00.824Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-08-17T10:19:00.923Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-08-17T10:19:01.020Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-08-17T10:19:01.105Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-08-17T10:19:01.193Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-Windows
[2020-08-17T10:19:01.293Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-08-17T10:19:01.398Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-08-17T10:19:01.493Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-08-17T10:19:01.585Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-08-17T10:19:01.702Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Libbeat-oss
[2020-08-17T10:19:01.796Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Packetbeat-Mac-OS-X
[2020-08-17T10:19:01.940Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-oss
[2020-08-17T10:19:02.042Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Filebeat-x-pack
[2020-08-17T10:19:02.153Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-08-17T10:19:02.260Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-08-17T10:19:02.355Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-08-17T10:19:02.796Z] + cat
[2020-08-17T10:19:02.796Z] + /usr/local/bin/runbld ./runbld-script --job-name elastic+beats+pull-request
[2020-08-17T10:19:02.796Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-08-17T10:19:09.378Z] runbld>>> runbld started
[2020-08-17T10:19:09.378Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-08-17T10:19:10.757Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-08-17T10:19:10.757Z] runbld>>> Matches in the system config:
[2020-08-17T10:19:10.757Z] runbld>>> - Matched ^elastic\+beats
[2020-08-17T10:19:10.757Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-08-17T10:19:12.138Z] runbld>>> Debug logging enabled.
[2020-08-17T10:19:12.138Z] runbld>>> Storing result
[2020-08-17T10:19:12.398Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-08-17T10:19:12.398Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200817101911-6E1D1A71
[2020-08-17T10:19:12.398Z] runbld>>> Adding system facts.
[2020-08-17T10:19:13.340Z] runbld>>> Adding vcs info for the latest commit:  6e920af66b481a0f8db68df49643461a90c95292
[2020-08-17T10:19:13.341Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-08-17T10:19:13.341Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-08-17T10:19:13.341Z] + echo 'Processing JUnit reports with runbld...'
[2020-08-17T10:19:13.341Z] Processing JUnit reports with runbld...
[2020-08-17T10:19:13.602Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-08-17T10:19:13.602Z] runbld>>> DURATION: 37ms
[2020-08-17T10:19:13.602Z] runbld>>> STDOUT: 40 bytes
[2020-08-17T10:19:13.602Z] runbld>>> STDERR: 49 bytes
[2020-08-17T10:19:13.602Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-08-17T10:19:13.602Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20582
[2020-08-17T10:19:14.540Z] runbld>>> Storing build metadata: 
[2020-08-17T10:19:14.540Z] runbld>>> Adding test report.
[2020-08-17T10:19:14.540Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats
[2020-08-17T10:19:15.476Z] runbld>>> Found 136 test output files
[2020-08-17T10:19:17.390Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-08-17T10:19:17.391Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20582/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-08-17T10:19:18.771Z] runbld>>> Test output logs contained: Errors: 0 Failures: 2 Tests: 19252 Skipped: 1555
[2020-08-17T10:19:19.031Z] runbld>>> Storing result
[2020-08-17T10:19:19.031Z] runbld>>> FAILURES: 2
[2020-08-17T10:19:19.599Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-08-17T10:19:19.599Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200817101911-6E1D1A71
[2020-08-17T10:19:19.859Z] runbld>>> Email notification disabled by environment variable.
[2020-08-17T10:19:19.859Z] runbld>>> Slack notification disabled by environment variable.
[2020-08-17T10:19:25.331Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-20582
[2020-08-17T10:19:25.436Z] [INFO] getVaultSecret: Getting secrets
[2020-08-17T10:19:25.516Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-17T10:19:26.284Z] + chmod 755 generate-build-data.sh
[2020-08-17T10:19:26.284Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20582/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20582/runs/2 FAILURE 3917884
[2020-08-17T10:19:26.284Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20582/runs/2/steps/?limit=10000 -o steps-info.json

@v1v v1v requested a review from a team August 17, 2020 13:12
@v1v v1v merged commit 372cd78 into elastic:7.9 Aug 17, 2020
@v1v v1v deleted the backport/7.9/pr-20569 branch August 17, 2020 13:35
leweafan pushed a commit to leweafan/beats that referenced this pull request Apr 28, 2023
…rkers (elastic#20569) (elastic#20582)

* [CI] more parallel stages and less provisioned workers (elastic#20569)
* Enable and fix Journalbeat integration tests (elastic#20140)
* [CI] Fix missing when for Packetbeat (elastic#20626)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automation backport ci Team:Automation Label for the Observability productivity team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants