Skip to content

Add dependencies-report script#19499

Closed
urso wants to merge 1 commit intoelastic:masterfrom
urso:report-dependencies
Closed

Add dependencies-report script#19499
urso wants to merge 1 commit intoelastic:masterfrom
urso:report-dependencies

Conversation

@urso
Copy link
Copy Markdown

@urso urso commented Jun 29, 2020 •
edited by andresrc
Loading

  • Bug

What does this PR do?

Adds a script to report dependencies in a csv file by running dev-tools/dependencies-report -csv $OUTPUT_FILE

Sample output:

name,url,version,revision,license
4d63.com/tz,https://4d63.com/tz,v1.1.1,6d37baae851b,MIT
cloud.google.com/go,https://cloud.google.com/go,v0.51.0,,Apache-2.0
cloud.google.com/go/pubsub,https://cloud.google.com/go/pubsub,v1.0.1,,Apache-2.0
cloud.google.com/go/storage,https://cloud.google.com/go/storage,v1.0.0,,Apache-2.0
code.cloudfoundry.org/go-loggregator,https://code.cloudfoundry.org/go-loggregator,v7.4.0,,Apache-2.0
github.com/Azure/azure-event-hubs-go/v3,https://github.com/Azure/azure-event-hubs-go,v3.1.2,,MIT
github.com/Azure/azure-sdk-for-go,https://github.com/Azure/azure-sdk-for-go,v37.1.0,,Apache-2.0
github.com/Azure/azure-storage-blob-go,https://github.com/Azure/azure-storage-blob-go,v0.8.0,,MIT
github.com/Azure/go-autorest/autorest,https://github.com/Azure/go-autorest,v0.9.4,,Apache-2.0

Why is it important?

With the removal of vendor we don't create a dependency report anymore, which is required as part of the unified release process.

Checklist

- [ ] My code follows the style guidelines of this project
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
~~- [ ] I have made corresponding change to the default configuration files~~~~
- [ ] I have added tests that prove my fix is effective or that my feature works
- [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

run $ dev-tools/dependencies-report -csv test.csv. On success check test.csv

Related issues

@urso urso added review needs_backport PR is waiting to be backported to other branches. Team:Services (Deprecated) Label for the former Integrations-Services team labels Jun 29, 2020
@urso urso requested a review from kvch June 29, 2020 21:23
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jun 29, 2020

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jun 29, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jun 29, 2020 •
edited
Loading

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19499 event]

  • Start Time: 2020-06-30T07:42:51.296+0000

  • Duration: 24 min 34 sec

Steps errors

Expand to view the steps failures

  • Name: Make check

    • Description: make check

    • Duration: 15 min 10 sec

    • Start Time: 2020-06-30T07:48:26.283+0000

    • log

  • Name: Report to Codecov

    • Description: curl -sSLo codecov https://codecov.io/bash for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat do FILE="${i}/build/coverage/full.cov" if [ -f "${FILE}" ]; then bash codecov -f "${FILE}" fi done

    • Duration: 2 min 22 sec

    • Start Time: 2020-06-30T08:03:37.984+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-06-30T08:06:02.468Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-30T08:06:02.469Z] Stage "Kubernetes" skipped due to earlier failure(s)
[2020-06-30T08:06:02.671Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.673Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.674Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-30T08:06:02.675Z] Stage "Packetbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.677Z] Stage "dockerlogbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.678Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.679Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.680Z] Stage "Journalbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:02.681Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-30T08:06:03.981Z] Failed in branch Elastic Agent x-pack
[2020-06-30T08:06:03.982Z] Failed in branch Elastic Agent x-pack Windows
[2020-06-30T08:06:03.983Z] Failed in branch Elastic Agent Mac OS X
[2020-06-30T08:06:03.983Z] Failed in branch Filebeat oss
[2020-06-30T08:06:03.984Z] Failed in branch Filebeat x-pack
[2020-06-30T08:06:03.985Z] Failed in branch Filebeat Mac OS X
[2020-06-30T08:06:03.986Z] Failed in branch Filebeat x-pack Mac OS X
[2020-06-30T08:06:03.987Z] Failed in branch Filebeat Windows
[2020-06-30T08:06:03.987Z] Failed in branch Filebeat x-pack Windows
[2020-06-30T08:06:03.988Z] Failed in branch Auditbeat oss Linux
[2020-06-30T08:06:03.989Z] Failed in branch Auditbeat crosscompile
[2020-06-30T08:06:03.989Z] Failed in branch Auditbeat oss Mac OS X
[2020-06-30T08:06:03.990Z] Failed in branch Auditbeat oss Windows
[2020-06-30T08:06:03.991Z] Failed in branch Auditbeat x-pack
[2020-06-30T08:06:03.992Z] Failed in branch Auditbeat x-pack Mac OS X
[2020-06-30T08:06:03.993Z] Failed in branch Auditbeat x-pack Windows
[2020-06-30T08:06:03.993Z] Failed in branch Libbeat x-pack
[2020-06-30T08:06:03.994Z] Failed in branch Metricbeat OSS Unit tests
[2020-06-30T08:06:03.995Z] Failed in branch Metricbeat OSS Integration tests
[2020-06-30T08:06:03.995Z] Failed in branch Metricbeat Python integration tests
[2020-06-30T08:06:03.996Z] Failed in branch Metricbeat crosscompile
[2020-06-30T08:06:03.997Z] Failed in branch Metricbeat Mac OS X
[2020-06-30T08:06:03.998Z] Failed in branch Metricbeat x-pack Mac OS X
[2020-06-30T08:06:03.998Z] Failed in branch Metricbeat Windows
[2020-06-30T08:06:03.999Z] Failed in branch Metricbeat x-pack Windows
[2020-06-30T08:06:04.000Z] Failed in branch Winlogbeat Windows x-pack
[2020-06-30T08:06:04.001Z] Failed in branch Kubernetes
[2020-06-30T08:06:04.577Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.578Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.579Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-30T08:06:04.580Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.581Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.582Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-30T08:06:04.642Z] Failed in branch Packetbeat
[2020-06-30T08:06:04.643Z] Failed in branch dockerlogbeat
[2020-06-30T08:06:04.644Z] Failed in branch Journalbeat
[2020-06-30T08:06:04.856Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.857Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.859Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-30T08:06:04.860Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-30T08:06:04.899Z] Failed in branch Metricbeat x-pack
[2020-06-30T08:06:04.899Z] Failed in branch Winlogbeat
[2020-06-30T08:06:05.078Z] Failed in branch Heartbeat
[2020-06-30T08:06:05.079Z] Failed in branch Libbeat
[2020-06-30T08:06:05.080Z] Failed in branch Functionbeat
[2020-06-30T08:06:05.081Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-30T08:06:05.154Z] Failed in branch Generators
[2020-06-30T08:06:05.281Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19499/src/github.com/elastic/beats
[2020-06-30T08:06:05.585Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-30T08:06:05.597Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19499/src/github.com/elastic/beats/Lint
[2020-06-30T08:06:05.972Z] + cat
[2020-06-30T08:06:05.972Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-30T08:06:05.972Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-30T08:06:12.582Z] runbld>>> runbld started
[2020-06-30T08:06:12.582Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-06-30T08:06:14.497Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19499' in order of occurrence in the config (last value wins).
[2020-06-30T08:06:15.883Z] runbld>>> Debug logging enabled.
[2020-06-30T08:06:15.883Z] runbld>>> Storing result
[2020-06-30T08:06:15.883Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-30T08:06:15.883Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200630080615-3C476D2A
[2020-06-30T08:06:15.883Z] runbld>>> Adding system facts.
[2020-06-30T08:06:17.280Z] runbld>>> Adding vcs info for the latest commit:  94a6797313392a4bba5377b770136efecc1eb95d
[2020-06-30T08:06:17.280Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-30T08:06:17.280Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-30T08:06:17.280Z] Processing JUnit reports with runbld...
[2020-06-30T08:06:17.280Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-30T08:06:17.540Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-30T08:06:17.540Z] runbld>>> DURATION: 18ms
[2020-06-30T08:06:17.540Z] runbld>>> STDOUT: 40 bytes
[2020-06-30T08:06:17.540Z] runbld>>> STDERR: 49 bytes
[2020-06-30T08:06:17.540Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-30T08:06:17.540Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19499/src/github.com/elastic/beats
[2020-06-30T08:06:18.483Z] runbld>>> Storing build metadata: 
[2020-06-30T08:06:18.483Z] runbld>>> Adding test report.
[2020-06-30T08:06:18.483Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19499/src/github.com/elastic/beats
[2020-06-30T08:06:19.054Z] runbld>>> Found 0 test output files
[2020-06-30T08:06:19.054Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 0 Skipped: 0
[2020-06-30T08:06:19.315Z] runbld>>> Storing result
[2020-06-30T08:06:19.576Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-30T08:06:19.576Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200630080615-3C476D2A
[2020-06-30T08:06:19.576Z] runbld>>> Email notification disabled by environment variable.
[2020-06-30T08:06:19.576Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-30T08:06:25.094Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19499
[2020-06-30T08:06:25.195Z] [INFO] getVaultSecret: Getting secrets
[2020-06-30T08:06:25.261Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-30T08:06:26.007Z] + chmod 755 generate-build-data.sh
[2020-06-30T08:06:26.007Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19499/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19499/runs/2 FAILURE 1414452
[2020-06-30T08:06:26.007Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19499/runs/2/steps/?limit=10000 -o steps-info.json
[2020-06-30T08:06:26.258Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19499/runs/2/tests/?status=FAILED -o tests-errors.json

@kvch kvch mentioned this pull request Jun 30, 2020
Merged
@kvch
Copy link
Copy Markdown
Contributor

kvch commented Jun 30, 2020

Closed by #19506

@kvch kvch closed this Jun 30, 2020
@kvch kvch mentioned this pull request Jun 30, 2020
Merged
@urso urso removed the needs_backport PR is waiting to be backported to other branches. label Jul 3, 2020
@urso urso deleted the report-dependencies branch July 9, 2020 19:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kvch kvch Awaiting requested review from kvch

Assignees

No one assigned

Labels

review Team:Integrations Label for the Integrations team Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@urso @elasticmachine @kvch @andresrc