Skip to content

Add missing Jenkins stages for Auditbeat#18835

Merged
jsoriano merged 6 commits intoelastic:masterfrom
jsoriano:jenkinsfile-auditbeat
May 30, 2020
Merged

Add missing Jenkins stages for Auditbeat#18835
jsoriano merged 6 commits intoelastic:masterfrom
jsoriano:jenkinsfile-auditbeat

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented May 28, 2020

Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.

Parallelize all Auditbeat stages.

Skip tests in auditbeat that are currently failing, issue to follow up created: #18855

Part of #17411

@jsoriano jsoriano self-assigned this May 28, 2020
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label Team:Automation Label for the Observability productivity team and removed needs_team Indicates that the issue/PR needs a Team:* label labels May 28, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented May 28, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #18835 updated]

  • Start Time: 2020-05-29T14:52:00.066+0000

  • Duration: 86 min 41 sec

Test stats 🧪

Test Results
Failed 0
Passed 8829
Skipped 1467
Total 10296

Steps errors

Expand to view the steps failures

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:26.761+0000

    • log

  • Name: Mage build test

    • Description: mage build test

    • Duration: 10 min 46 sec

    • Start Time: 2020-05-29T15:26:55.899+0000

    • log

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:36.076+0000

    • log

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:40.517+0000

    • log

  • Name: Make -C generator/_templates/metricbeat test

    • Description: make -C generator/_templates/metricbeat test

    • Duration: 6 min 33 sec

    • Start Time: 2020-05-29T15:53:36.223+0000

    • log

  • Name: Make -C generator/_templates/beat test

    • Description: make -C generator/_templates/beat test

    • Duration: 6 min 1 sec

    • Start Time: 2020-05-29T16:06:55.206+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-05-29T16:13:16.062Z]   OS/Arch:      linux/amd64
[2020-05-29T16:13:16.062Z]   Experimental: false
[2020-05-29T16:13:16.062Z]  containerd:
[2020-05-29T16:13:16.062Z]   Version:     v1.2.10
[2020-05-29T16:13:16.062Z]   GitCommit:                  b34a5c8af56e510852c35414db4c1f4fa6172339
[2020-05-29T16:13:16.062Z]  runc:
[2020-05-29T16:13:16.062Z]   Version:     1.0.0-rc8+dev
[2020-05-29T16:13:16.062Z]   GitCommit:                  3e425f80a8c931f88e6d94a8c831b9d5aa481657
[2020-05-29T16:13:16.062Z]  docker-init:
[2020-05-29T16:13:16.062Z]   Version:     0.18.0
[2020-05-29T16:13:16.062Z]   GitCommit:                  fec3683
[2020-05-29T16:17:14.854Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:15.160Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-29T16:17:15.172Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Lint
[2020-05-29T16:17:15.248Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-oss
[2020-05-29T16:17:15.320Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-05-29T16:17:15.400Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Dockerlogbeat
[2020-05-29T16:17:15.471Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-05-29T16:17:15.540Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Journalbeat-oss
[2020-05-29T16:17:15.610Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-05-29T16:17:15.688Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-05-29T16:17:15.759Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-05-29T16:17:15.830Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-05-29T16:17:15.899Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-05-29T16:17:15.970Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-05-29T16:17:16.044Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-05-29T16:17:16.129Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-oss
[2020-05-29T16:17:16.201Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-05-29T16:17:16.272Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-05-29T16:17:16.342Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-05-29T16:17:16.418Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-05-29T16:17:16.489Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-05-29T16:17:16.558Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-x-pack
[2020-05-29T16:17:16.629Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Packetbeat-oss
[2020-05-29T16:17:16.698Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-05-29T16:17:16.773Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-05-29T16:17:16.843Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-05-29T16:17:16.911Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-Windows
[2020-05-29T16:17:16.979Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-05-29T16:17:17.049Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-05-29T16:17:17.118Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-05-29T16:17:17.188Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-05-29T16:17:17.265Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Windows
[2020-05-29T16:17:17.337Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-05-29T16:17:17.408Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-05-29T16:17:17.479Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-05-29T16:17:17.549Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-05-29T16:17:17.619Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-05-29T16:17:17.690Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-05-29T16:17:17.762Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack
[2020-05-29T16:17:17.834Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-oss
[2020-05-29T16:17:17.905Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-Windows
[2020-05-29T16:17:17.976Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-05-29T16:17:18.047Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-oss
[2020-05-29T16:17:18.116Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-Windows
[2020-05-29T16:17:18.186Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-05-29T16:17:18.258Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-05-29T16:17:18.342Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-05-29T16:17:18.414Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-05-29T16:17:18.764Z] + cat
[2020-05-29T16:17:18.764Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-29T16:17:18.764Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-29T16:17:25.355Z] runbld>>> runbld started
[2020-05-29T16:17:25.355Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-29T16:17:26.739Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18835' in order of occurrence in the config (last value wins).
[2020-05-29T16:17:28.124Z] runbld>>> Debug logging enabled.
[2020-05-29T16:17:28.124Z] runbld>>> Storing result
[2020-05-29T16:17:28.124Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-29T16:17:28.124Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200529161727-1ABD4DB2
[2020-05-29T16:17:28.124Z] runbld>>> Adding system facts.
[2020-05-29T16:17:29.067Z] runbld>>> Adding vcs info for the latest commit:  da75568821ae55be2d1076f4ef6eb417ece61d2d
[2020-05-29T16:17:29.068Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-29T16:17:29.068Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-29T16:17:29.068Z] Processing JUnit reports with runbld...
[2020-05-29T16:17:29.068Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-29T16:17:29.639Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-29T16:17:29.639Z] runbld>>> DURATION: 13ms
[2020-05-29T16:17:29.639Z] runbld>>> STDOUT: 40 bytes
[2020-05-29T16:17:29.639Z] runbld>>> STDERR: 49 bytes
[2020-05-29T16:17:29.639Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-29T16:17:29.639Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:31.024Z] runbld>>> Storing build metadata: 
[2020-05-29T16:17:31.024Z] runbld>>> Adding test report.
[2020-05-29T16:17:31.024Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:31.967Z] runbld>>> Found 56 test output files
[2020-05-29T16:17:33.881Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 10146 Skipped: 1335
[2020-05-29T16:17:34.141Z] runbld>>> Storing result
[2020-05-29T16:17:34.141Z] runbld>>> FAILURES: 0
[2020-05-29T16:17:34.403Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-29T16:17:34.403Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200529161727-1ABD4DB2
[2020-05-29T16:17:34.403Z] runbld>>> Email notification disabled by environment variable.
[2020-05-29T16:17:34.403Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-29T16:17:39.980Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835
[2020-05-29T16:17:40.108Z] [INFO] getVaultSecret: Getting secrets
[2020-05-29T16:17:40.166Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-29T16:17:40.928Z] + chmod 755 generate-build-data.sh
[2020-05-29T16:17:40.928Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7 FAILURE 5140602
[2020-05-29T16:17:40.928Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/steps/?limit=10000 -o steps-info.json
[2020-05-29T16:17:42.811Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/tests/?status=FAILED -o tests-errors.json
[2020-05-29T16:17:43.722Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/log/ -o pipeline-log.txt

@jsoriano jsoriano force-pushed the jenkinsfile-auditbeat branch from 36838d8 to 5f8faf6 Compare May 29, 2020 10:29
@jsoriano jsoriano marked this pull request as ready for review May 29, 2020 14:53
@jsoriano jsoriano requested a review from a team as a code owner May 29, 2020 14:53
@jsoriano
Copy link
Copy Markdown
Member Author

Failure in Metricbeat x-pack should be solved by #18777

@jsoriano jsoriano added the needs_backport PR is waiting to be backported to other branches. label May 29, 2020
@jsoriano jsoriano merged commit 3bf5689 into elastic:master May 30, 2020
@jsoriano jsoriano deleted the jenkinsfile-auditbeat branch May 30, 2020 10:39
jsoriano added a commit to jsoriano/beats that referenced this pull request May 30, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

(cherry picked from commit 3bf5689)
@jsoriano jsoriano added v7.9.0 and removed needs_backport PR is waiting to be backported to other branches. labels May 30, 2020
jsoriano added a commit that referenced this pull request May 30, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

(cherry picked from commit 3bf5689)
v1v added a commit to v1v/beats that referenced this pull request Jun 2, 2020
…-stage-level

* upstream/master: (30 commits)
  Add a GRPC listener service for Agent (elastic#18827)
  Disable host.* fields by default for iptables module (elastic#18756)
  [WIP] Clarify capabilities of the Filebeat auditd module (elastic#17068)
  fix: rename file and remove extra separator (elastic#18881)
  ci: enable JJBB (elastic#18812)
  Disable host.* fields by default for Checkpoint module (elastic#18754)
  Disable host.* fields by default for Cisco module (elastic#18753)
  Update latest.yml testing env to 7.7.0 (elastic#18535)
  Upgrade k8s.io/client-go and k8s keystore tests (elastic#18817)
  Add missing Jenkins stages for Auditbeat (elastic#18835)
  [Elastic Log Driver] Create a config shim between libbeat and the user (elastic#18605)
  Use indexers and matchers in config when defaults are enabled (elastic#18818)
  Fix panic on `metricbeat test modules` (elastic#18797)
  [CI] Fix permissions in MacOSX agents (elastic#18847)
  [Ingest Manager] When not port are specified and the https is used fallback to 443 (elastic#18844)
  [Ingest Manager] Fix install service script for windows (elastic#18814)
  [Metricbeat] Fix getting compute instance metadata with partial zone/region config (elastic#18757)
  Improve error messages in s3 input (elastic#18824)
  Add memory metrics into compute googlecloud (elastic#18802)
  include bucket name when logging error (elastic#18679)
  ...
@v1v v1v mentioned this pull request Jun 3, 2020
2 tasks
v1v pushed a commit to v1v/beats that referenced this pull request Jun 12, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.
v1v added a commit that referenced this pull request Jun 12, 2020
…19151)

Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

Co-authored-by: Jaime Soriano Pastor <jaime.soriano@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Team:Automation Label for the Observability productivity team v7.9.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants