Skip to content

tests/system: fix system tests (bp #5037)#5038

Merged
axw merged 6 commits into7.xfrom
mergify/bp/7.x/pr-5037
Apr 1, 2021
Merged

tests/system: fix system tests (bp #5037)#5038
axw merged 6 commits into7.xfrom
mergify/bp/7.x/pr-5037

Conversation

@mergify
Copy link
Copy Markdown
Contributor

@mergify mergify bot commented Mar 31, 2021

This is an automatic backport of pull request #5037 done by Mergify.


Mergify commands and options

More conditions and actions can be found in the documentation.

You can also trigger Mergify actions by commenting on this pull request:

  • @Mergifyio refresh will re-evaluate the rules
  • @Mergifyio rebase will rebase this PR on its base branch
  • @Mergifyio update will merge the base branch into this PR
  • @Mergifyio backport <destination> will backport this PR on <destination> branch

Additionally, on Mergify dashboard you can:

  • look at your merge queues
  • generate the Mergify configuration with the config editor.

Finally, you can contact us on https://mergify.io/

* tests/system: adapt to new API response

In elastic/kibana#95146
the response structure for listing APM agent central
config changed. Update system tests to match.

* tests/system: add user_agent.device.type

elastic/elasticsearch#69322
added support for extracting device types to the
user_agent ingest processors. Update approvals to
match.

(cherry picked from commit 0e09aa6)
@ghost
Copy link
Copy Markdown

ghost commented Mar 31, 2021

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #5038 updated

  • Start Time: 2021-04-01T01:02:00.352+0000

  • Duration: 43 min 34 sec

  • Commit: 596b12a

Test stats 🧪

Test Results
Failed 0
Passed 4796
Skipped 123
Total 4919

Trends 🧪

Image of Build Times

Image of Tests

Steps errors 3

Expand to view the steps failures

Run Window tests
  • Took 10 min 21 sec . View more details on here
Run Linux tests
  • Took 26 min 34 sec . View more details on here
  • Description: ./.ci/scripts/linux-test.sh
Test Sync
  • Took 4 min 33 sec . View more details on here
  • Description: ./.ci/scripts/sync.sh

Log output

Expand to view the last 100 lines of log output

[2021-04-01T01:39:25.082Z] === RUN   TestJaegerGRPCMuxed
[2021-04-01T01:39:25.082Z] --- PASS: TestJaegerGRPCMuxed (3.40s)
[2021-04-01T01:39:25.082Z] === RUN   TestJaegerGRPCMuxedTLS
[2021-04-01T01:39:25.082Z] --- PASS: TestJaegerGRPCMuxedTLS (3.45s)
[2021-04-01T01:39:25.082Z] === RUN   TestJaegerGRPCSampling
[2021-04-01T01:39:25.082Z] --- PASS: TestJaegerGRPCSampling (3.01s)
[2021-04-01T01:39:25.082Z] === RUN   TestJaegerGRPCAuth
[2021-04-01T01:39:25.082Z] --- PASS: TestJaegerGRPCAuth (3.57s)
[2021-04-01T01:39:25.082Z] === RUN   TestAPMServerGRPCRequestLoggingValid
[2021-04-01T01:39:25.082Z] --- PASS: TestAPMServerGRPCRequestLoggingValid (3.27s)
[2021-04-01T01:39:25.082Z] === RUN   TestAPMServerRequestLoggingValid
[2021-04-01T01:39:25.082Z] --- PASS: TestAPMServerRequestLoggingValid (0.34s)
[2021-04-01T01:39:25.083Z] === RUN   TestApprovedMetrics
[2021-04-01T01:39:25.083Z] --- PASS: TestApprovedMetrics (3.62s)
[2021-04-01T01:39:25.083Z] === RUN   TestBreakdownMetrics
[2021-04-01T01:39:25.083Z] --- PASS: TestBreakdownMetrics (3.55s)
[2021-04-01T01:39:25.083Z] === RUN   TestApplicationMetrics
[2021-04-01T01:39:25.083Z] --- PASS: TestApplicationMetrics (3.41s)
[2021-04-01T01:39:25.083Z] === RUN   TestAPMServerMonitoring
[2021-04-01T01:39:25.083Z] --- PASS: TestAPMServerMonitoring (1.42s)
[2021-04-01T01:39:25.083Z] === RUN   TestAPMServerMonitoringBuiltinUser
[2021-04-01T01:39:25.083Z] --- PASS: TestAPMServerMonitoringBuiltinUser (2.02s)
[2021-04-01T01:39:25.083Z] === RUN   TestAPMServerOnboarding
[2021-04-01T01:39:25.083Z] --- PASS: TestAPMServerOnboarding (3.53s)
[2021-04-01T01:39:25.083Z] === RUN   TestOTLPGRPCTraces
[2021-04-01T01:39:25.083Z] --- PASS: TestOTLPGRPCTraces (3.06s)
[2021-04-01T01:39:25.083Z] === RUN   TestOTLPGRPCMetrics
[2021-04-01T01:39:25.083Z] --- PASS: TestOTLPGRPCMetrics (3.47s)
[2021-04-01T01:39:25.083Z] === RUN   TestOTLPGRPCAuth
[2021-04-01T01:39:25.083Z] --- PASS: TestOTLPGRPCAuth (3.29s)
[2021-04-01T01:39:25.083Z] === RUN   TestOTLPClientIP
[2021-04-01T01:39:25.083Z] --- PASS: TestOTLPClientIP (3.45s)
[2021-04-01T01:39:25.083Z] === RUN   TestRUMXForwardedFor
[2021-04-01T01:39:25.083Z] --- PASS: TestRUMXForwardedFor (3.40s)
[2021-04-01T01:39:25.083Z] === RUN   TestRUMErrorSourcemapping
[2021-04-01T01:39:25.083Z] --- PASS: TestRUMErrorSourcemapping (3.63s)
[2021-04-01T01:39:25.083Z] === RUN   TestRUMAuth
[2021-04-01T01:39:25.083Z] --- PASS: TestRUMAuth (0.61s)
[2021-04-01T01:39:25.083Z] === RUN   TestKeepUnsampled
[2021-04-01T01:39:25.083Z] === RUN   TestKeepUnsampled/false
[2021-04-01T01:39:25.083Z] === RUN   TestKeepUnsampled/true
[2021-04-01T01:39:25.083Z] --- PASS: TestKeepUnsampled (6.69s)
[2021-04-01T01:39:25.083Z]     --- PASS: TestKeepUnsampled/false (3.25s)
[2021-04-01T01:39:25.083Z]     --- PASS: TestKeepUnsampled/true (3.44s)
[2021-04-01T01:39:25.083Z] === RUN   TestKeepUnsampledWarning
[2021-04-01T01:39:25.083Z] --- PASS: TestKeepUnsampledWarning (2.86s)
[2021-04-01T01:39:25.083Z] === RUN   TestTailSampling
[2021-04-01T01:39:25.083Z]     sampling_test.go:138: waiting for 100 "parent" transactions
[2021-04-01T01:39:25.083Z]     sampling_test.go:138: waiting for 100 "child" transactions
[2021-04-01T01:39:25.083Z] --- PASS: TestTailSampling (4.86s)
[2021-04-01T01:39:25.083Z] === RUN   TestTailSamplingUnlicensed
[2021-04-01T01:39:25.083Z] 2021/04/01 01:38:49 Starting container id: 648025ff460a image: quay.io/testcontainers/ryuk:0.2.3
[2021-04-01T01:39:25.083Z] 2021/04/01 01:38:49 Waiting for container id 648025ff460a image: quay.io/testcontainers/ryuk:0.2.3
[2021-04-01T01:39:25.083Z] 2021/04/01 01:38:49 Container is ready id: 648025ff460a image: quay.io/testcontainers/ryuk:0.2.3
[2021-04-01T01:39:25.083Z] 2021/04/01 01:38:50 Starting container id: be35b32ab4b5 image: docker.elastic.co/elasticsearch/elasticsearch:7.13.0-SNAPSHOT
[2021-04-01T01:39:25.083Z] 2021/04/01 01:38:50 Waiting for container id be35b32ab4b5 image: docker.elastic.co/elasticsearch/elasticsearch:7.13.0-SNAPSHOT
[2021-04-01T01:39:25.083Z] 2021/04/01 01:39:10 Container is ready id: be35b32ab4b5 image: docker.elastic.co/elasticsearch/elasticsearch:7.13.0-SNAPSHOT
[2021-04-01T01:39:25.083Z] --- PASS: TestTailSamplingUnlicensed (34.09s)
[2021-04-01T01:39:25.083Z] FAIL
[2021-04-01T01:39:25.083Z] FAIL	github.com/elastic/apm-server/systemtest	223.344s
[2021-04-01T01:39:25.083Z] === RUN   TestAPMServer
[2021-04-01T01:39:25.083Z] 2021/04/01 01:35:37 Building apm-server...
[2021-04-01T01:39:25.083Z] 2021/04/01 01:35:39 Built /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5038/src/github.com/elastic/apm-server/apm-server
[2021-04-01T01:39:25.083Z] --- PASS: TestAPMServer (2.89s)
[2021-04-01T01:39:25.083Z] === RUN   TestUnstartedAPMServer
[2021-04-01T01:39:25.083Z] --- PASS: TestUnstartedAPMServer (0.00s)
[2021-04-01T01:39:25.083Z] === RUN   TestAPMServerStartTLS
[2021-04-01T01:39:25.083Z] --- PASS: TestAPMServerStartTLS (0.18s)
[2021-04-01T01:39:25.083Z] === RUN   TestExpvar
[2021-04-01T01:39:25.083Z] --- PASS: TestExpvar (0.12s)
[2021-04-01T01:39:25.083Z] PASS
[2021-04-01T01:39:25.083Z] ok  	github.com/elastic/apm-server/systemtest/apmservertest	3.238s
[2021-04-01T01:39:25.083Z] ?   	github.com/elastic/apm-server/systemtest/estest	[no test files]
[2021-04-01T01:39:25.083Z] ?   	github.com/elastic/apm-server/systemtest/fleettest	[no test files]
[2021-04-01T01:39:25.083Z] FAIL
[2021-04-01T01:39:25.083Z] + cleanup
[2021-04-01T01:39:25.083Z] + rm -rf /tmp/tmp.xeCyIyBUmT
[2021-04-01T01:39:25.083Z] + .ci/scripts/docker-get-logs.sh
[2021-04-01T01:39:26.099Z] Post stage
[2021-04-01T01:39:26.116Z] Running in /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5038/src/github.com/elastic/apm-server/build
[2021-04-01T01:39:26.147Z] Archiving artifacts
[2021-04-01T01:39:26.572Z] Recording test results
[2021-04-01T01:39:27.150Z] [Checks API] No suitable checks publisher found.
[2021-04-01T01:39:27.499Z] + tar --version
[2021-04-01T01:39:27.869Z] + tar --exclude=system-tests-linux-files.tgz -czf system-tests-linux-files.tgz system-tests
[2021-04-01T01:39:28.165Z] Archiving artifacts
[2021-04-01T01:39:28.728Z] Failed in branch System and Environment Tests
[2021-04-01T01:44:30.653Z] [INFO] For detailed information see: https://apm-ci.elastic.co/job/apm-integration-tests-selector-mbp/job/7.x/492/display/redirect
[2021-04-01T01:44:31.039Z] Copied 17 artifacts from "APM Integration Test MBP Selector » 7.x" build number 492
[2021-04-01T01:44:32.139Z] Post stage
[2021-04-01T01:44:32.154Z] Recording test results
[2021-04-01T01:44:33.022Z] [Checks API] No suitable checks publisher found.
[2021-04-01T01:44:33.475Z] Running on Jenkins in /var/lib/jenkins/workspace/pm-server_apm-server-mbp_PR-5038
[2021-04-01T01:44:33.546Z] [INFO] getVaultSecret: Getting secrets
[2021-04-01T01:44:33.813Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-04-01T01:44:34.619Z] + chmod 755 generate-build-data.sh
[2021-04-01T01:44:34.619Z] + ./generate-build-data.sh https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5038/ https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5038/runs/6 FAILURE 2554005
[2021-04-01T01:44:34.869Z] INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5038/runs/6/steps/?limit=10000 -o steps-info.json
[2021-04-01T01:44:35.420Z] INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5038/runs/6/tests/?status=FAILED -o tests-errors.json
[2021-04-01T01:44:35.671Z] INFO: curl https://apm-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/apm-server/apm-server-mbp/PR-5038/runs/6/log/ -o pipeline-log.txt

@axw
Copy link
Copy Markdown
Member

axw commented Mar 31, 2021

This one is failing because 7.x doesn't yet use the 7.13-SNAPSHOT images.

@axw
Copy link
Copy Markdown
Member

axw commented Mar 31, 2021

@Mergifyio update

@mergify
Copy link
Copy Markdown
Contributor Author

mergify bot commented Mar 31, 2021

Command update: success

Branch has been successfully updated

@codecov-io
Copy link
Copy Markdown

codecov-io commented Mar 31, 2021

Codecov Report

Merging #5038 (596b12a) into 7.x (99fabf0) will decrease coverage by 0.03%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##              7.x    #5038      +/-   ##
==========================================
- Coverage   77.22%   77.18%   -0.04%     
==========================================
  Files         178      178              
  Lines       10468    10468              
==========================================
- Hits         8084     8080       -4     
- Misses       2384     2388       +4     
Impacted Files Coverage Δ
kibana/connecting_client.go 71.87% <0.00%> (-4.69%) ⬇️
beater/beater.go 68.68% <0.00%> (-0.34%) ⬇️

@axw
Copy link
Copy Markdown
Member

axw commented Mar 31, 2021

@Mergifyio update

@mergify
Copy link
Copy Markdown
Contributor Author

mergify bot commented Mar 31, 2021

Command update: success

Branch has been successfully updated

@axw
Copy link
Copy Markdown
Member

axw commented Apr 1, 2021

Remaining system test failure will be addressed by #5013

@axw axw merged commit 19d467c into 7.x Apr 1, 2021
@axw axw deleted the mergify/bp/7.x/pr-5037 branch April 1, 2021 01:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants