Cherry-pick to 7.x: [CI] ensure one shot-worker (#22588) by v1v · Pull Request #22591 · elastic/beats

v1v · 2020-11-16T14:37:02Z

Backports the following commits to 7.x:

[CI] ensure one shot-worker ([CI] ensure one shot-worker #22588)

elasticmachine · 2020-11-16T16:35:56Z

🐛 Flaky test report

❕ There are test failures but not known flaky tests.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	1
Passed	16387
Skipped	1368
Total	17756

Genuine test errors

💔 There are test failures but not known flaky tests, most likely a genuine test failure.

Name: Build&Test / metricbeat-goIntegTest / TestFetch – status

elasticmachine · 2020-11-16T16:35:58Z

💔 Tests Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: [Pull request #22591 opened]
Start Time: 2020-11-16T14:37:45.845+0000
Duration: 118 min 53 sec

Test stats 🧪

Test	Results
Failed	1
Passed	16387
Skipped	1368
Total	17756

Test errors

Expand to view the tests failures

`Build&Test / metricbeat-goIntegTest / TestFetch – status`

Expand to view the error details

 Failed

Expand to view the stacktrace

     stats_integration_test.go:59: kibana/stats event: {
          "elasticsearch": {
            "cluster": {
              "id": "64buxpGPSI6e34Jt2t2XGA"
            }
          },
          "kibana": {
            "stats": {
              "concurrent_connections": 3,
              "host": {
                "name": "0"
              },
              "index": "kibana",
              "name": "kibana",
              "process": {
                "event_loop_delay": {
                  "ms": 22.91227400000207
                },
                "memory": {
                  "heap": {
                    "size_limit": {
                      "bytes": 1526909922
                    },
                    "total": {
                      "bytes": 661229568
                    },
                    "used": {
                      "bytes": 331841160
                    }
                  }
                },
                "uptime": {
                  "ms": 133671
                }
              },
              "request": {
                "disconnects": 0,
                "total": 7
              },
              "response_time": {
                "avg": {
                  "ms": 146
                },
                "max": {
                  "ms": 606
                }
              },
              "snapshot": false,
              "status": "green"
            }
          },
          "process": {
            "pid": 6
          },
          "service": {
            "address": "0:5601",
            "id": "19501bd4-d601-4552-8a69-5180e81c1e0f",
            "name": "kibana",
            "type": "kibana",
            "version": "7.9.0"
          }
        }
    status_integration_test.go:38:

Steps errors

Expand to view the steps failures

`metricbeat-goIntegTest - mage goIntegTest`

Took 32 min 41 sec . View more details on here
Description: mage goIntegTest

`Error signal`

Took 0 min 0 sec . View more details on here
Description: Error 'hudson.AbortException: script returned exit code 1'

Log output

Expand to view the last 100 lines of log output

[2020-11-16T16:35:10.103Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/winlogbeat-Lint-1605538483016
[2020-11-16T16:35:10.193Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/winlogbeat-crosscompile-1605538484538
[2020-11-16T16:35:10.287Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/auditbeat-Lint-1605538485701
[2020-11-16T16:35:10.372Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/libbeat-Lint-1605538503835
[2020-11-16T16:35:10.459Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-elastic-agent-build-1605538526045
[2020-11-16T16:35:10.543Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/auditbeat-crosscompile-1605538528520
[2020-11-16T16:35:10.629Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/packetbeat-Lint-1605538530585
[2020-11-16T16:35:10.716Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/journalbeat-Lint-1605538538286
[2020-11-16T16:35:10.800Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-functionbeat-build-1605538543458
[2020-11-16T16:35:10.911Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-functionbeat-Lint-1605538543957
[2020-11-16T16:35:11.001Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/journalbeat-unitTest-1605538550744
[2020-11-16T16:35:11.085Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/heartbeat-Lint-1605538557848
[2020-11-16T16:35:11.174Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-auditbeat-Lint-1605538560643
[2020-11-16T16:35:11.262Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-dockerlogbeat-build-1605538561005
[2020-11-16T16:35:11.351Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-winlogbeat-Lint-linux----ubuntu-18-1605538561755
[2020-11-16T16:35:11.446Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/filebeat-Lint-1605538568479
[2020-11-16T16:35:11.532Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-libbeat-Lint-1605538575391
[2020-11-16T16:35:11.621Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-filebeat-Lint-1605538875744
[2020-11-16T16:35:11.708Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/heartbeat-build-1605538879667
[2020-11-16T16:35:11.796Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-Lint-1605538879964
[2020-11-16T16:35:11.882Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-Lint-1605538879980
[2020-11-16T16:35:11.968Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/packetbeat-build-1605538880506
[2020-11-16T16:35:12.055Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-unitTest-1605538880585
[2020-11-16T16:35:12.141Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/libbeat-crosscompile-1605538881650
[2020-11-16T16:35:12.228Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/auditbeat-build-1605538883877
[2020-11-16T16:35:12.316Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-auditbeat-build-1605538934115
[2020-11-16T16:35:12.403Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/generator-metricbeat-test-1605538952459
[2020-11-16T16:35:12.487Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-libbeat-build-1605538993544
[2020-11-16T16:35:12.575Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-crosscompile-1605539011914
[2020-11-16T16:35:12.661Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/generator-beat-test-1605539084875
[2020-11-16T16:35:12.747Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-elastic-agent-windows-windows-2019-1605539087451
[2020-11-16T16:35:12.835Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/auditbeat-windows-windows-2019-1605539126524
[2020-11-16T16:35:12.927Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/heartbeat-windows-windows-2019-1605539173376
[2020-11-16T16:35:13.018Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/winlogbeat-windows-windows-2019-1605539204222
[2020-11-16T16:35:13.109Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-auditbeat-windows-windows-2019-1605539223827
[2020-11-16T16:35:13.205Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-winlogbeat-build-windows-2019-1605539224583
[2020-11-16T16:35:13.293Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-functionbeat-windows-windows-2019-1605539255386
[2020-11-16T16:35:13.388Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1605539312988
[2020-11-16T16:35:13.478Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/filebeat-windows-windows-2019-1605539356333
[2020-11-16T16:35:13.569Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-windows-windows-2019-1605539406945
[2020-11-16T16:35:13.655Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-windows-windows-2019-1605539435602
[2020-11-16T16:35:13.740Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/packetbeat-windows-windows-2019-1605539500696
[2020-11-16T16:35:13.827Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/filebeat-build-1605539801504
[2020-11-16T16:35:13.915Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/libbeat-build-1605539977373
[2020-11-16T16:35:14.004Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-filebeat-build-1605540220681
[2020-11-16T16:35:14.094Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-goIntegTest-1605540341170
[2020-11-16T16:35:14.181Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-pythonIntegTest-1605540415866
[2020-11-16T16:35:14.265Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343
[2020-11-16T16:35:14.669Z] + cat
[2020-11-16T16:35:14.669Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-11-16T16:35:14.669Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-11-16T16:35:22.793Z] runbld>>> runbld started
[2020-11-16T16:35:22.793Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-11-16T16:35:23.730Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-11-16T16:35:23.730Z] runbld>>> Matches in the system config:
[2020-11-16T16:35:23.730Z] runbld>>> - Matched ^elastic\+beats
[2020-11-16T16:35:23.730Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-11-16T16:35:25.113Z] runbld>>> Debug logging enabled.
[2020-11-16T16:35:25.113Z] runbld>>> Storing result
[2020-11-16T16:35:25.113Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-11-16T16:35:25.113Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201116163524-89E3DB21
[2020-11-16T16:35:25.113Z] runbld>>> Adding system facts.
[2020-11-16T16:35:26.492Z] runbld>>> Adding vcs info for the latest commit:  429c343e37f735604ce96b62ae6d2595831c76d4
[2020-11-16T16:35:26.492Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-11-16T16:35:26.492Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-11-16T16:35:26.492Z] Processing JUnit reports with runbld...
[2020-11-16T16:35:26.492Z] + echo 'Processing JUnit reports with runbld...'
[2020-11-16T16:35:26.751Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-11-16T16:35:26.751Z] runbld>>> DURATION: 28ms
[2020-11-16T16:35:26.751Z] runbld>>> STDOUT: 40 bytes
[2020-11-16T16:35:26.751Z] runbld>>> STDERR: 49 bytes
[2020-11-16T16:35:26.752Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-11-16T16:35:26.752Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-22591
[2020-11-16T16:35:28.133Z] runbld>>> Storing build metadata: 
[2020-11-16T16:35:28.133Z] runbld>>> Adding test report.
[2020-11-16T16:35:28.133Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats
[2020-11-16T16:35:28.701Z] runbld>>> Found 123 test output files
[2020-11-16T16:35:28.701Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-11-16T16:35:28.701Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-11-16T16:35:28.701Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-11-16T16:35:28.960Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-11-16T16:35:28.960Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/x-pack-metricbeat-build-1605544167343/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-11-16T16:35:29.897Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-goIntegTest-1605540341170/metricbeat/build/TEST-go-integration-graphite.xml
[2020-11-16T16:35:29.897Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats/metricbeat-goIntegTest-1605540341170/metricbeat/build/TEST-go-integration-windows.xml
[2020-11-16T16:35:32.432Z] runbld>>> Test output logs contained: Errors: 0 Failures: 1 Tests: 17756 Skipped: 1088
[2020-11-16T16:35:32.432Z] runbld>>> Storing result
[2020-11-16T16:35:32.432Z] runbld>>> FAILURES: 1
[2020-11-16T16:35:32.691Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-11-16T16:35:32.691Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201116163524-89E3DB21
[2020-11-16T16:35:32.691Z] runbld>>> Email notification disabled by environment variable.
[2020-11-16T16:35:32.691Z] runbld>>> Slack notification disabled by environment variable.
[2020-11-16T16:35:38.026Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-22591/src/github.com/elastic/beats
[2020-11-16T16:35:38.224Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-22591
[2020-11-16T16:35:38.306Z] [INFO] getVaultSecret: Getting secrets
[2020-11-16T16:35:38.353Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-11-16T16:35:39.114Z] + chmod 755 generate-build-data.sh
[2020-11-16T16:35:39.115Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-22591/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-22591/runs/1 FAILURE 7073001
[2020-11-16T16:35:39.115Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-22591/runs/1/steps/?limit=10000 -o steps-info.json
[2020-11-16T16:35:43.237Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-22591/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-11-16T16:35:43.488Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-22591/runs/1/log/ -o pipeline-log.txt

v1v · 2020-11-16T17:41:52Z

Unrelated error with the tests instead related to the provisioned workers fix

This reverts commit 1d58fff.

[CI] ensure one shot-worker (elastic#22588)

429c343

v1v self-assigned this Nov 16, 2020

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Nov 16, 2020

v1v added automation backport ci Team:Automation Label for the Observability productivity team labels Nov 16, 2020

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Nov 16, 2020

v1v requested a review from a team November 16, 2020 14:37

v1v merged commit 1d58fff into elastic:7.x Nov 16, 2020

v1v deleted the backport/7.x/pr-22588 branch November 16, 2020 17:42

v1v added a commit that referenced this pull request Nov 17, 2020

Revert "[CI] ensure one shot-worker (#22588) (#22591)"

26a505d

This reverts commit 1d58fff.

v1v mentioned this pull request Nov 17, 2020

Revert "Cherry-pick to 7.x: [CI] ensure one shot-worker (#22588)" #22624

Merged

v1v added a commit that referenced this pull request Nov 17, 2020

Revert "[CI] ensure one shot-worker (#22588) (#22591)" (#22624)

beb80a7

This reverts commit 1d58fff.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick to 7.x: [CI] ensure one shot-worker (#22588)#22591

Cherry-pick to 7.x: [CI] ensure one shot-worker (#22588)#22591
v1v merged 1 commit intoelastic:7.xfrom
v1v:backport/7.x/pr-22588

v1v commented Nov 16, 2020

Uh oh!

elasticmachine commented Nov 16, 2020

Test stats 🧪

Genuine test errors

Uh oh!

elasticmachine commented Nov 16, 2020

Build stats

Test stats 🧪

`Build&Test / metricbeat-goIntegTest / TestFetch – status`

`metricbeat-goIntegTest - mage goIntegTest`

`Error signal`

Uh oh!

v1v commented Nov 16, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

v1v commented Nov 16, 2020

Uh oh!

elasticmachine commented Nov 16, 2020

🐛 Flaky test report

Test stats 🧪

Genuine test errors

Uh oh!

elasticmachine commented Nov 16, 2020

💔 Tests Failed

Build stats

Test stats 🧪

Test errors

Build&Test / metricbeat-goIntegTest / TestFetch – status

Steps errors

metricbeat-goIntegTest - mage goIntegTest

Error signal

Log output

Uh oh!

v1v commented Nov 16, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

`Build&Test / metricbeat-goIntegTest / TestFetch – status`

`metricbeat-goIntegTest - mage goIntegTest`

`Error signal`