Skip to content

Cherry-pick to 7.x: [CI] more parallel stages and less provisioned workers (#20569)#20583

Merged
v1v merged 2 commits intoelastic:7.xfrom
v1v:backport/7.x/pr-20569
Aug 17, 2020
Merged

Cherry-pick to 7.x: [CI] more parallel stages and less provisioned workers (#20569)#20583
v1v merged 2 commits intoelastic:7.xfrom
v1v:backport/7.x/pr-20569

Conversation

@v1v
Copy link
Copy Markdown
Member

@v1v v1v commented Aug 13, 2020 •
edited
Loading

Backports the following commits to 7.x:

@v1v v1v added automation backport ci Team:Automation Label for the Observability productivity team labels Aug 13, 2020
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Aug 13, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Aug 13, 2020 •
edited by jenkins-beats-ci bot
Loading

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #20583 event]

  • Start Time: 2020-08-17T09:14:54.300+0000

  • Duration: 72 min 50 sec

Test stats 🧪

Test Results
Failed 2
Passed 15870
Skipped 1771
Total 17643

Test errors

Expand to view the tests failures

  • Name: Build and Test / Libbeat / Libbeat oss / TestOutputReload – pipeline

    • Age: 1
    • Duration: 34.64
    • Error Details: Failed

  • Name: Build and Test / Libbeat / Libbeat oss / TestOutputReload/network_client – pipeline

    • Age: 1
    • Duration: 18.44
    • Error Details: Failed

Steps errors

Expand to view the steps failures

  • Name: Mage build test

    • Description: mage build test

    • Duration: 5 min 51 sec

    • Start Time: 2020-08-17T09:38:05.746+0000

    • log

  • Name: Make test

    • Description: make -C generator/_templates/beat test

    • Duration: 6 min 6 sec

    • Start Time: 2020-08-17T09:50:07.649+0000

    • log

  • Name: Recursively delete the current directory from the workspace

    • Description: script returned exit code 2

    • Duration: 1 min 8 sec

    • Start Time: 2020-08-17T09:56:27.458+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-08-17T10:26:07.790Z] + tar -xpf source.tgz
[2020-08-17T10:26:18.116Z] + rm source.tgz
[2020-08-17T10:26:18.131Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats
[2020-08-17T10:26:18.156Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Lint
[2020-08-17T10:26:18.242Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-08-17T10:26:18.327Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Winlogbeat-oss
[2020-08-17T10:26:18.411Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-08-17T10:26:18.500Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-08-17T10:26:18.590Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-08-17T10:26:18.672Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-08-17T10:26:18.765Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-08-17T10:26:18.857Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/dockerlogbeat
[2020-08-17T10:26:18.943Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-08-17T10:26:19.034Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Journalbeat
[2020-08-17T10:26:19.119Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-08-17T10:26:19.211Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Libbeat-oss
[2020-08-17T10:26:19.297Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-08-17T10:26:19.389Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Packetbeat-Linux
[2020-08-17T10:26:19.484Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-08-17T10:26:19.569Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-08-17T10:26:19.655Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Packetbeat-Mac-OS-X
[2020-08-17T10:26:19.743Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-08-17T10:26:19.828Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-08-17T10:26:19.921Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-08-17T10:26:20.008Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Heartbeat-oss
[2020-08-17T10:26:20.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-08-17T10:26:20.185Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-08-17T10:26:20.277Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Heartbeat-Windows
[2020-08-17T10:26:20.367Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-08-17T10:26:20.454Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-08-17T10:26:20.544Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-08-17T10:26:20.640Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-08-17T10:26:20.729Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-08-17T10:26:20.817Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-08-17T10:26:20.910Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-08-17T10:26:21.004Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-Windows
[2020-08-17T10:26:21.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Packetbeat-Windows
[2020-08-17T10:26:21.210Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Libbeat-x-pack
[2020-08-17T10:26:21.304Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Functionbeat-Windows
[2020-08-17T10:26:21.391Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-08-17T10:26:21.477Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-08-17T10:26:21.571Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-08-17T10:26:21.660Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-08-17T10:26:21.745Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-Windows
[2020-08-17T10:26:21.834Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-oss
[2020-08-17T10:26:21.926Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Filebeat-x-pack
[2020-08-17T10:26:22.015Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests
[2020-08-17T10:26:22.209Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-OSS-Python-Integration-tests
[2020-08-17T10:26:22.298Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-08-17T10:26:22.725Z] + cat
[2020-08-17T10:26:22.725Z] + /usr/local/bin/runbld ./runbld-script --job-name elastic+beats+pull-request
[2020-08-17T10:26:22.725Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-08-17T10:26:29.344Z] runbld>>> runbld started
[2020-08-17T10:26:29.344Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-08-17T10:26:30.730Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-08-17T10:26:30.730Z] runbld>>> Matches in the system config:
[2020-08-17T10:26:30.730Z] runbld>>> - Matched ^elastic\+beats
[2020-08-17T10:26:30.730Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-08-17T10:26:32.116Z] runbld>>> Debug logging enabled.
[2020-08-17T10:26:32.116Z] runbld>>> Storing result
[2020-08-17T10:26:32.116Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-08-17T10:26:32.116Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200817102631-68A11822
[2020-08-17T10:26:32.116Z] runbld>>> Adding system facts.
[2020-08-17T10:26:33.061Z] runbld>>> Adding vcs info for the latest commit:  7fff71352735538964bdd428d05a86d4e009cd9a
[2020-08-17T10:26:33.061Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-08-17T10:26:33.061Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-08-17T10:26:33.061Z] Processing JUnit reports with runbld...
[2020-08-17T10:26:33.061Z] + echo 'Processing JUnit reports with runbld...'
[2020-08-17T10:26:33.635Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-08-17T10:26:33.635Z] runbld>>> DURATION: 34ms
[2020-08-17T10:26:33.635Z] runbld>>> STDOUT: 40 bytes
[2020-08-17T10:26:33.635Z] runbld>>> STDERR: 49 bytes
[2020-08-17T10:26:33.635Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-08-17T10:26:33.635Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-20583
[2020-08-17T10:26:34.211Z] runbld>>> Storing build metadata: 
[2020-08-17T10:26:34.211Z] runbld>>> Adding test report.
[2020-08-17T10:26:34.211Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats
[2020-08-17T10:26:35.153Z] runbld>>> Found 134 test output files
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-08-17T10:26:36.543Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-20583/src/github.com/elastic/beats/Metricbeat-OSS-Go-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-08-17T10:26:37.930Z] runbld>>> Test output logs contained: Errors: 0 Failures: 2 Tests: 17492 Skipped: 1516
[2020-08-17T10:26:37.930Z] runbld>>> Storing result
[2020-08-17T10:26:37.930Z] runbld>>> FAILURES: 2
[2020-08-17T10:26:38.502Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-08-17T10:26:38.502Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200817102631-68A11822
[2020-08-17T10:26:38.502Z] runbld>>> Email notification disabled by environment variable.
[2020-08-17T10:26:38.502Z] runbld>>> Slack notification disabled by environment variable.
[2020-08-17T10:26:44.007Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-20583
[2020-08-17T10:26:44.122Z] [INFO] getVaultSecret: Getting secrets
[2020-08-17T10:26:44.212Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-08-17T10:26:44.995Z] + chmod 755 generate-build-data.sh
[2020-08-17T10:26:44.995Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20583/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20583/runs/2 FAILURE 4310434
[2020-08-17T10:26:44.995Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20583/runs/2/steps/?limit=10000 -o steps-info.json
[2020-08-17T10:26:48.223Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20583/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-08-17T10:26:48.774Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-20583/runs/2/log/ -o pipeline-log.txt

@v1v v1v requested a review from a team August 17, 2020 13:12
@v1v v1v merged commit 52610ae into elastic:7.x Aug 17, 2020
@v1v v1v deleted the backport/7.x/pr-20569 branch August 17, 2020 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@mdelapenya mdelapenya mdelapenya approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

automation backport ci Team:Automation Label for the Observability productivity team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@v1v @elasticmachine @mdelapenya