Skip to content

Cherry-pick to 7.x: Get stats for all indices, including hidden indices (#18703)#19682

Merged
ycombinator merged 1 commit intoelastic:7.xfrom
ycombinator:backport/7.x/pr-18703
Jul 8, 2020
Merged

Cherry-pick to 7.x: Get stats for all indices, including hidden indices (#18703)#19682
ycombinator merged 1 commit intoelastic:7.xfrom
ycombinator:backport/7.x/pr-18703

Conversation

@ycombinator
Copy link
Copy Markdown
Contributor

Backports the following commits to 7.x:

* Get stats for all indices

* Update default stack versions to use in integration tests

* Add integration test for hidden indices stats

* Better naming of variables

* Adding CHANGELOG entry

* Use expand_wildcards in tests as well

* Collect stats for open and hidden indices (but not closed ones)
@ycombinator ycombinator self-assigned this Jul 6, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jul 6, 2020
@ycombinator ycombinator added the Team:Services (Deprecated) Label for the former Integrations-Services team label Jul 6, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jul 6, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19682 opened]

  • Start Time: 2020-07-06T17:21:38.717+0000

  • Duration: 75 min 13 sec

Test stats 🧪

Test Results
Failed 1
Passed 3484
Skipped 808
Total 4293

Test errors

Expand to view the tests failures

  • Name: Build and Test / Metricbeat x-pack / Metricbeat x-pack / TestFetch – stats

    • Age: 1
    • Duration: 0
    • Error Details: Failed

Steps errors

Expand to view the steps failures

  • Name: Mage build test
    • Description: mage build test

    • Duration: 41 min 35 sec

    • Start Time: 2020-07-06T17:47:34.314+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-07-06T18:34:55.484Z]   Fail:     0
[2020-07-06T18:34:55.484Z]   Skip:     0
[2020-07-06T18:34:55.484Z]   Pass:     0
[2020-07-06T18:34:55.484Z]   Packages: 0
[2020-07-06T18:34:55.484Z]   Duration: 6.362909422s
[2020-07-06T18:34:55.484Z]   Coverage Report: /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-windows.html
[2020-07-06T18:34:55.484Z]   JUnit Report:    /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-windows.xml
[2020-07-06T18:34:55.484Z]   Output File:     /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-windows.out
[2020-07-06T18:34:55.484Z] >> go test: Integration-windows Test Passed
[2020-07-06T18:34:56.929Z] >> go test: Integration-zookeeper Testing
[2020-07-06T18:36:18.515Z] SUMMARY:
[2020-07-06T18:36:18.516Z]   Fail:     0
[2020-07-06T18:36:18.516Z]   Skip:     3
[2020-07-06T18:36:18.516Z]   Pass:     4
[2020-07-06T18:36:18.516Z]   Packages: 3
[2020-07-06T18:36:18.516Z]   Duration: 1m18.554723844s
[2020-07-06T18:36:18.516Z]   Coverage Report: /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-zookeeper.html
[2020-07-06T18:36:18.516Z]   JUnit Report:    /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-zookeeper.xml
[2020-07-06T18:36:18.516Z]   Output File:     /go/src/github.com/elastic/beats/metricbeat/build/TEST-go-integration-zookeeper.out
[2020-07-06T18:36:18.516Z] >> go test: Integration-zookeeper Test Passed
[2020-07-06T18:36:19.603Z] Recording test results
[2020-07-06T18:36:21.966Z] Stashed 39 file(s)
[2020-07-06T18:36:22.006Z] Archiving artifacts
[2020-07-06T18:36:22.925Z] + curl -sSLo codecov https://codecov.io/bash
[2020-07-06T18:36:23.185Z] + FILE=auditbeat/build/coverage/full.cov
[2020-07-06T18:36:23.185Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.185Z] + FILE=filebeat/build/coverage/full.cov
[2020-07-06T18:36:23.185Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=heartbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=libbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=metricbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=packetbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-07-06T18:36:23.186Z] + FILE=journalbeat/build/coverage/full.cov
[2020-07-06T18:36:23.186Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-07-06T18:36:26.512Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats
[2020-07-06T18:36:26.847Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-07-06T18:36:26.869Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Lint
[2020-07-06T18:36:27.024Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-07-06T18:36:27.177Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-07-06T18:36:27.331Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-07-06T18:36:27.485Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-07-06T18:36:27.635Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-07-06T18:36:27.782Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-Windows
[2020-07-06T18:36:27.937Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-07-06T18:36:28.092Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-07-06T18:36:28.260Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-07-06T18:36:28.722Z] + cat
[2020-07-06T18:36:28.722Z] + /usr/local/bin/runbld ./runbld-script
[2020-07-06T18:36:28.722Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-07-06T18:36:35.316Z] runbld>>> runbld started
[2020-07-06T18:36:35.316Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-07-06T18:36:37.232Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19682' in order of occurrence in the config (last value wins).
[2020-07-06T18:36:38.617Z] runbld>>> Debug logging enabled.
[2020-07-06T18:36:38.617Z] runbld>>> Storing result
[2020-07-06T18:36:38.617Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-07-06T18:36:38.617Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200706183638-5A8E710D
[2020-07-06T18:36:38.617Z] runbld>>> Adding system facts.
[2020-07-06T18:36:40.007Z] runbld>>> Adding vcs info for the latest commit:  854a319ecedcecf87c1ff5c95a4e50923f5a6947
[2020-07-06T18:36:40.007Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-07-06T18:36:40.007Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-07-06T18:36:40.007Z] + echo 'Processing JUnit reports with runbld...'
[2020-07-06T18:36:40.007Z] Processing JUnit reports with runbld...
[2020-07-06T18:36:40.269Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-07-06T18:36:40.269Z] runbld>>> DURATION: 15ms
[2020-07-06T18:36:40.269Z] runbld>>> STDOUT: 40 bytes
[2020-07-06T18:36:40.269Z] runbld>>> STDERR: 49 bytes
[2020-07-06T18:36:40.269Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-07-06T18:36:40.269Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats
[2020-07-06T18:36:41.216Z] runbld>>> Storing build metadata: 
[2020-07-06T18:36:41.216Z] runbld>>> Adding test report.
[2020-07-06T18:36:41.216Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats
[2020-07-06T18:36:42.159Z] runbld>>> Found 72 test output files
[2020-07-06T18:36:42.159Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-07-06T18:36:42.159Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-07-06T18:36:42.159Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-07-06T18:36:42.422Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-07-06T18:36:42.422Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-07-06T18:36:42.993Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-07-06T18:36:42.993Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-07-06T18:36:43.254Z] runbld>>> Test output logs contained: Errors: 0 Failures: 1 Tests: 4293 Skipped: 612
[2020-07-06T18:36:43.254Z] runbld>>> Storing result
[2020-07-06T18:36:43.254Z] runbld>>> FAILURES: 1
[2020-07-06T18:36:43.825Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-07-06T18:36:43.825Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200706183638-5A8E710D
[2020-07-06T18:36:44.085Z] runbld>>> Email notification disabled by environment variable.
[2020-07-06T18:36:44.085Z] runbld>>> Slack notification disabled by environment variable.
[2020-07-06T18:36:50.374Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19682
[2020-07-06T18:36:50.516Z] [INFO] getVaultSecret: Getting secrets
[2020-07-06T18:36:50.603Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-07-06T18:36:52.908Z] + chmod 755 generate-build-data.sh
[2020-07-06T18:36:52.908Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19682/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19682/runs/1 FAILURE 4512772
[2020-07-06T18:36:52.908Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19682/runs/1/steps/?limit=10000 -o steps-info.json
[2020-07-06T18:36:54.365Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19682/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-07-06T18:36:55.068Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19682/runs/1/log/ -o pipeline-log.txt

@ycombinator
Copy link
Copy Markdown
Contributor Author

CI failure is unrelated and will be fixed once #19744 is merged.

@ycombinator ycombinator merged commit 602ce7d into elastic:7.x Jul 8, 2020
@ycombinator ycombinator deleted the backport/7.x/pr-18703 branch July 8, 2020 15:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants