Cherry-pick #23274 to 7.x: Synthetics docker image by andrewvc · Pull Request #23380 · elastic/beats

andrewvc · 2021-01-06T23:02:40Z

Cherry-pick of PR #23274 to 7.x branch. Original message:

Adjusts the heartbeat docker image to install deps for heartbeat synthetics. Fixes #22837

What does this PR do?

Why is it important?

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
I have made corresponding change to the default configuration files
I have added tests that prove my fix is effective or that my feature works
I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

[ ]

How to test this PR locally

Related issues

Use cases

Screenshots

Logs

Adjusts the heartbeat docker image to install deps for heartbeat synthetics. Fixes elastic#22837 (cherry picked from commit dbc61ed)

elasticmachine · 2021-01-06T23:02:43Z

Pinging @elastic/uptime (Team:Uptime)

elasticmachine · 2021-01-06T23:54:54Z

❕ Build Aborted

There is a new build on-going so the previous on-going builds have been aborted.

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: andrewvc commented: /test please
Reason: Aborted from #9
- Start Time: 2021-01-14T14:39:32.859+0000
Duration: 134 min 40 sec
Commit: 886f7db

Test stats 🧪

Test	Results
Failed	0
Passed	17329
Skipped	1372
Total	18701

Log output

Expand to view the last 100 lines of log output

[2021-01-14T15:27:59.945Z] 16.54s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_147_o365
[2021-01-14T15:27:59.945Z] 11.51s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_002_panw
[2021-01-14T15:27:59.945Z] 11.48s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_001_panw
[2021-01-14T15:27:59.945Z] 11.24s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_270_cisco
[2021-01-14T15:27:59.945Z] 10.61s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_114_ibmmq
[2021-01-14T15:27:59.945Z] 10.60s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_009_zscaler
[2021-01-14T15:27:59.945Z] 10.57s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_191_oracle
[2021-01-14T15:27:59.945Z] 10.57s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_201_oracle
[2021-01-14T15:27:59.945Z] 10.44s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_289_imperva
[2021-01-14T15:27:59.945Z] 10.43s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_164_juniper
[2021-01-14T15:27:59.945Z] 10.42s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_116_ibmmq
[2021-01-14T15:27:59.945Z] 10.41s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_178_squid
[2021-01-14T15:27:59.945Z] 10.19s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_288_cisco
[2021-01-14T15:27:59.945Z] 10.16s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_182_infoblox
[2021-01-14T15:27:59.945Z] 10.15s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_183_fortinet
[2021-01-14T15:27:59.945Z] 10.13s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_112_f5
[2021-01-14T15:27:59.945Z] ================ 305 passed, 292 warnings in 1459.34s (0:24:19) ================
[2021-01-14T15:27:59.945Z] >> python test: Integration Testing Complete
[2021-01-14T15:28:04.489Z] Client: Docker Engine - Community
[2021-01-14T15:28:04.489Z]  Version:           20.10.2
[2021-01-14T15:28:04.489Z]  API version:       1.41
[2021-01-14T15:28:04.489Z]  Go version:        go1.13.15
[2021-01-14T15:28:04.489Z]  Git commit:        2291f61
[2021-01-14T15:28:04.489Z]  Built:             Mon Dec 28 16:17:32 2020
[2021-01-14T15:28:04.489Z]  OS/Arch:           linux/amd64
[2021-01-14T15:28:04.489Z]  Context:           default
[2021-01-14T15:28:04.489Z]  Experimental:      true
[2021-01-14T15:28:04.489Z] 
[2021-01-14T15:28:04.489Z] Server: Docker Engine - Community
[2021-01-14T15:28:04.489Z]  Engine:
[2021-01-14T15:28:04.489Z]   Version:          20.10.2
[2021-01-14T15:28:04.489Z]   API version:      1.41 (minimum version 1.12)
[2021-01-14T15:28:04.489Z]   Go version:       go1.13.15
[2021-01-14T15:28:04.489Z]   Git commit:       8891c58
[2021-01-14T15:28:04.489Z]   Built:            Mon Dec 28 16:15:09 2020
[2021-01-14T15:28:04.489Z]   OS/Arch:          linux/amd64
[2021-01-14T15:28:04.489Z]   Experimental:     false
[2021-01-14T15:28:04.489Z]  containerd:
[2021-01-14T15:28:04.489Z]   Version:          1.4.3
[2021-01-14T15:28:04.489Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-01-14T15:28:04.489Z]  runc:
[2021-01-14T15:28:04.489Z]   Version:          1.0.0-rc92
[2021-01-14T15:28:04.489Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-01-14T15:28:04.489Z]  docker-init:
[2021-01-14T15:28:04.489Z]   Version:          0.19.0
[2021-01-14T15:28:04.489Z]   GitCommit:        de40ad0
[2021-01-14T15:28:04.489Z] Unable to find image 'alpine:3.4' locally
[2021-01-14T15:28:05.865Z] 3.4: Pulling from library/alpine
[2021-01-14T15:28:05.865Z] c1e54eec4b57: Pulling fs layer
[2021-01-14T15:28:06.124Z] c1e54eec4b57: Verifying Checksum
[2021-01-14T15:28:06.124Z] c1e54eec4b57: Download complete
[2021-01-14T15:28:06.382Z] c1e54eec4b57: Pull complete
[2021-01-14T15:28:06.382Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-01-14T15:28:06.382Z] Status: Downloaded newer image for alpine:3.4
[2021-01-14T15:28:08.595Z] + python .ci/scripts/pre_archive_test.py
[2021-01-14T15:28:10.603Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-01-14T15:28:10.614Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-23380/src/github.com/elastic/beats/build
[2021-01-14T15:28:10.934Z] + rm -rf ve
[2021-01-14T15:28:10.934Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-01-14T15:28:10.947Z] Recording test results
[2021-01-14T15:28:13.003Z] [Checks API] No suitable checks publisher found.
[2021-01-14T15:28:13.371Z] Client: Docker Engine - Community
[2021-01-14T15:28:13.371Z]  Version:           20.10.2
[2021-01-14T15:28:13.371Z]  API version:       1.41
[2021-01-14T15:28:13.371Z]  Go version:        go1.13.15
[2021-01-14T15:28:13.371Z]  Git commit:        2291f61
[2021-01-14T15:28:13.371Z]  Built:             Mon Dec 28 16:17:32 2020
[2021-01-14T15:28:13.371Z]  OS/Arch:           linux/amd64
[2021-01-14T15:28:13.371Z]  Context:           default
[2021-01-14T15:28:13.371Z]  Experimental:      true
[2021-01-14T15:28:13.371Z] 
[2021-01-14T15:28:13.371Z] Server: Docker Engine - Community
[2021-01-14T15:28:13.371Z]  Engine:
[2021-01-14T15:28:13.371Z]   Version:          20.10.2
[2021-01-14T15:28:13.371Z]   API version:      1.41 (minimum version 1.12)
[2021-01-14T15:28:13.371Z]   Go version:       go1.13.15
[2021-01-14T15:28:13.371Z]   Git commit:       8891c58
[2021-01-14T15:28:13.371Z]   Built:            Mon Dec 28 16:15:09 2020
[2021-01-14T15:28:13.371Z]   OS/Arch:          linux/amd64
[2021-01-14T15:28:13.371Z]   Experimental:     false
[2021-01-14T15:28:13.371Z]  containerd:
[2021-01-14T15:28:13.371Z]   Version:          1.4.3
[2021-01-14T15:28:13.371Z]   GitCommit:        269548fa27e0089a8b8278fc4fc781d7f65a939b
[2021-01-14T15:28:13.371Z]  runc:
[2021-01-14T15:28:13.371Z]   Version:          1.0.0-rc92
[2021-01-14T15:28:13.371Z]   GitCommit:        ff819c7e9184c13b7c2607fe6c30ae19403a7aff
[2021-01-14T15:28:13.371Z]  docker-init:
[2021-01-14T15:28:13.371Z]   Version:          0.19.0
[2021-01-14T15:28:13.371Z]   GitCommit:        de40ad0
[2021-01-14T15:28:25.116Z] Scheduling project: Beats » Beats Packaging » PR-23380
[2021-01-14T16:09:22.968Z] Starting building: Beats » Beats Packaging » PR-23380 #14
[2021-01-14T16:53:11.111Z] [INFO] For detailed information see: https://beats-ci.elastic.co/job/Beats/job/packaging/job/PR-23380/14/display/redirect
[2021-01-14T16:53:12.255Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-23380/src/github.com/elastic/beats
[2021-01-14T16:53:12.639Z] Running on beats-ci-immutable-ubuntu-1804-1610643135372812047 in /var/lib/jenkins/workspace/Beats_beats_PR-23380
[2021-01-14T16:53:12.722Z] [INFO] getVaultSecret: Getting secrets
[2021-01-14T16:53:12.810Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-01-14T16:53:13.929Z] + chmod 755 generate-build-data.sh
[2021-01-14T16:53:13.929Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23380/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23380/runs/8 ABORTED 8020332
[2021-01-14T16:53:13.929Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23380/runs/8/steps/?limit=10000 -o steps-info.json
[2021-01-14T16:53:17.224Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-23380/runs/8/tests/?status=FAILED -o tests-errors.json

jsoriano · 2021-01-07T15:46:23Z

/package

jsoriano · 2021-01-07T16:44:35Z

dev-tools/packaging/templates/docker/Dockerfile.tmpl

+    {{ $beatHome }}/.npm \
+    {{ $beatHome }}/.cache \
+    {{ $beatHome }}/.config \
+    {{ $beatHome }}/suites && \


There is an error here, that is making builds to fail also in master, could you please take a look?

Suggested change

{{ $beatHome }}/suites && \

{{ $beatHome }}/suites

I have opened a PR to detect these issues that includes this fix: #23401

Fix heartbeat build and launch packaging jobs when packaging files change to detect these issues.

andrewvc · 2021-01-14T14:39:02Z

/test please

kuisathaverat · 2021-01-14T14:40:42Z

/test

kuisathaverat · 2021-01-14T14:41:23Z

you do not have to pet Jenkins 😄

urso · 2021-01-15T12:43:24Z

CI did succeed: https://beats-ci.elastic.co/blue/organizations/jenkins/Beats%2Fbeats/detail/PR-23380/9/pipeline/
Status is from older run that has succeeded but marked as aborted.

Add synthetics to Heartbeat docker image (elastic#23274)

3199053

Adjusts the heartbeat docker image to install deps for heartbeat synthetics. Fixes elastic#22837 (cherry picked from commit dbc61ed)

andrewvc added [zube]: In Review backport Team:obs-ds-hosted-services Label for the Observability Hosted Services team labels Jan 6, 2021

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Jan 6, 2021

botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Jan 6, 2021

andrewvc mentioned this pull request Jan 6, 2021

Migrate examples to use heartbeat snapshot docker containers instead of experimental synthetics ones elastic/synthetics#182

Closed

5 tasks

kuisathaverat approved these changes Jan 7, 2021

View reviewed changes

jsoriano reviewed Jan 7, 2021

View reviewed changes

Merge remote-tracking branch 'origin/7.x' into backport_23274_7.x

058fa77

andrewvc added the Heartbeat label Jan 11, 2021

andrewvc and others added 4 commits January 11, 2021 16:24

Merge remote-tracking branch 'origin/7.x' into backport_23274_7.x

a44b216

Merge remote-tracking branch 'origin/7.x' into backport_23274_7.x

9b2a1a9

Merge remote-tracking branch 'origin/7.x' into backport_23274_7.x

98a24da

Fix heartbeat build (elastic#23401)

886f7db

Fix heartbeat build and launch packaging jobs when packaging files change to detect these issues.

v1v mentioned this pull request Jan 15, 2021

GitHub PR comment with wrong notifications order when aborting builds elastic/apm-pipeline-library#906

Closed

urso merged commit 31d4a1d into elastic:7.x Jan 15, 2021

zube bot added [zube]: Done and removed [zube]: In Review labels Jan 15, 2021

zube bot removed the [zube]: Done label Apr 16, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Cherry-pick #23274 to 7.x: Synthetics docker image#23380

Cherry-pick #23274 to 7.x: Synthetics docker image#23380
urso merged 6 commits intoelastic:7.xfrom
andrewvc:backport_23274_7.x

andrewvc commented Jan 6, 2021 •

edited by zube bot

Loading

Uh oh!

elasticmachine commented Jan 6, 2021

Uh oh!

elasticmachine commented Jan 6, 2021 •

edited by jenkins-beats-ci bot

Loading

Build stats

Test stats 🧪

Uh oh!

jsoriano commented Jan 7, 2021

Uh oh!

jsoriano Jan 7, 2021

Uh oh!

jsoriano Jan 7, 2021

Uh oh!

andrewvc commented Jan 14, 2021

Uh oh!

kuisathaverat commented Jan 14, 2021

Uh oh!

kuisathaverat commented Jan 14, 2021

Uh oh!

urso commented Jan 15, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

andrewvc commented Jan 6, 2021 • edited by zube bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Why is it important?

Checklist

Author's Checklist

How to test this PR locally

Related issues

Use cases

Screenshots

Logs

Uh oh!

elasticmachine commented Jan 6, 2021

Uh oh!

elasticmachine commented Jan 6, 2021 • edited by jenkins-beats-ci bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

❕ Build Aborted

Build stats

Test stats 🧪

Log output

Uh oh!

jsoriano commented Jan 7, 2021

Uh oh!

jsoriano Jan 7, 2021

Choose a reason for hiding this comment

Uh oh!

jsoriano Jan 7, 2021

Choose a reason for hiding this comment

Uh oh!

andrewvc commented Jan 14, 2021

Uh oh!

kuisathaverat commented Jan 14, 2021

Uh oh!

kuisathaverat commented Jan 14, 2021

Uh oh!

urso commented Jan 15, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

andrewvc commented Jan 6, 2021 •

edited by zube bot

Loading

elasticmachine commented Jan 6, 2021 •

edited by jenkins-beats-ci bot

Loading