Add field for user agent device type by jsoriano · Pull Request #24871 · elastic/beats

jsoriano · 2021-03-31T11:57:19Z

Add field definition for new user agent field added in elastic/elasticsearch#69322

Regenerate Filebeat test files with this new field.

Should fix Filebeat builds.

Thanks @v1v and @marc-gr for identifying this issue!

elasticmachine · 2021-03-31T11:57:21Z

Pinging @elastic/integrations (Team:Integrations)

elasticmachine · 2021-03-31T11:57:21Z

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

elasticmachine · 2021-03-31T13:39:57Z

💔 Build Failed

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

Build Cause: Pull request #24871 opened
Start Time: 2021-03-31T11:58:04.727+0000
Duration: 101 min 48 sec
Commit: ef508ef

Test stats 🧪

Test	Results
Failed	0
Passed	46007
Skipped	5122
Total	51129

Trends 🧪

Steps errors

Expand to view the steps failures

Show only the first 10 steps failures

`Sleep`

Took 0 min 0 sec . View more details on here
Description: 5

`Extract`

Took 0 min 1 sec . View more details on here
Description: 7z x -tgzip -so source.tgz | 7z x -si -ttar

`Delete folders that are causing exceptions (See JENKINS-58421)`

Took 0 min 0 sec . View more details on here
Description: rm -rf ve || true; find . -type d -name vendor -exec rm -r {} \;

`Sleep`

Took 0 min 2 sec . View more details on here
Description: 5

`check for Docker`

Took 0 min 0 sec . View more details on here
Description: command -v docker

`Sleep`

Took 0 min 1 sec . View more details on here
Description: 5

`Sleep`

Took 2 min 46 sec . View more details on here
Description: 5

`Sleep`

Took 0 min 2 sec . View more details on here
Description: 5

`Error signal`

Took 0 min 0 sec . View more details on here
Description: untar: step failed with error java.util.regex.Matcher

`Recursively delete the current directory from the workspace`

Took 1 min 45 sec . View more details on here
Description: java.util.regex.Matcher

Log output

Expand to view the last 100 lines of log output

[2021-03-31T13:38:00.493Z] 8.64s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_027_cisco
[2021-03-31T13:38:00.493Z] 8.52s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_266_panw
[2021-03-31T13:38:00.493Z] 8.49s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_268_panw
[2021-03-31T13:38:00.493Z] 8.34s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_269_panw
[2021-03-31T13:38:00.493Z] 8.01s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_037_cisco
[2021-03-31T13:38:00.493Z] 8.00s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_142_zscaler
[2021-03-31T13:38:00.493Z] 7.96s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_196_juniper
[2021-03-31T13:38:00.493Z] 7.95s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_241_oracle
[2021-03-31T13:38:00.493Z] 7.92s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_145_tomcat
[2021-03-31T13:38:00.493Z] 7.90s call     x-pack/filebeat/tests/system/test_xpack_modules.py::XPackTest::test_fileset_file_224_gcp
[2021-03-31T13:38:00.493Z] ======================= 323 passed in 1405.92s (0:23:25) =======================
[2021-03-31T13:38:00.493Z] >> python test: Integration Testing Complete
[2021-03-31T13:38:05.268Z] Cleaning up /var/lib/jenkins/workspace/PR-24871-1-95bd2bbc-4d89-41e5-84a9-42115ce32637
[2021-03-31T13:38:05.268Z] Client: Docker Engine - Community
[2021-03-31T13:38:05.268Z]  Version:           20.10.3
[2021-03-31T13:38:05.268Z]  API version:       1.41
[2021-03-31T13:38:05.268Z]  Go version:        go1.13.15
[2021-03-31T13:38:05.268Z]  Git commit:        48d30b5
[2021-03-31T13:38:05.268Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-31T13:38:05.268Z]  OS/Arch:           linux/amd64
[2021-03-31T13:38:05.268Z]  Context:           default
[2021-03-31T13:38:05.268Z]  Experimental:      true
[2021-03-31T13:38:05.268Z] 
[2021-03-31T13:38:05.268Z] Server: Docker Engine - Community
[2021-03-31T13:38:05.268Z]  Engine:
[2021-03-31T13:38:05.268Z]   Version:          20.10.3
[2021-03-31T13:38:05.268Z]   API version:      1.41 (minimum version 1.12)
[2021-03-31T13:38:05.268Z]   Go version:       go1.13.15
[2021-03-31T13:38:05.268Z]   Git commit:       46229ca
[2021-03-31T13:38:05.268Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-31T13:38:05.268Z]   OS/Arch:          linux/amd64
[2021-03-31T13:38:05.268Z]   Experimental:     false
[2021-03-31T13:38:05.268Z]  containerd:
[2021-03-31T13:38:05.268Z]   Version:          1.4.4
[2021-03-31T13:38:05.268Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-31T13:38:05.268Z]  runc:
[2021-03-31T13:38:05.268Z]   Version:          1.0.0-rc93
[2021-03-31T13:38:05.268Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-31T13:38:05.268Z]  docker-init:
[2021-03-31T13:38:05.268Z]   Version:          0.19.0
[2021-03-31T13:38:05.268Z]   GitCommit:        de40ad0
[2021-03-31T13:38:05.268Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-31T13:38:05.268Z] Unable to find image 'alpine:3.4' locally
[2021-03-31T13:38:05.838Z] 3.4: Pulling from library/alpine
[2021-03-31T13:38:06.097Z] c1e54eec4b57: Pulling fs layer
[2021-03-31T13:38:06.358Z] c1e54eec4b57: Verifying Checksum
[2021-03-31T13:38:06.358Z] c1e54eec4b57: Download complete
[2021-03-31T13:38:06.619Z] c1e54eec4b57: Pull complete
[2021-03-31T13:38:06.619Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2021-03-31T13:38:06.619Z] Status: Downloaded newer image for alpine:3.4
[2021-03-31T13:38:08.597Z] Change permissions with write access of all files inside the specific folder
[2021-03-31T13:38:10.063Z] Running in /var/lib/jenkins/workspace/PR-24871-1-95bd2bbc-4d89-41e5-84a9-42115ce32637/src/github.com/elastic/beats/build
[2021-03-31T13:38:10.457Z] + rm -rf ve
[2021-03-31T13:38:10.457Z] + find . -type d -name vendor -exec rm -r {} ;
[2021-03-31T13:38:10.933Z] + python .ci/scripts/pre_archive_test.py
[2021-03-31T13:38:12.841Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2021-03-31T13:38:12.903Z] Running in /var/lib/jenkins/workspace/PR-24871-1-95bd2bbc-4d89-41e5-84a9-42115ce32637/src/github.com/elastic/beats/build
[2021-03-31T13:38:12.984Z] Recording test results
[2021-03-31T13:38:16.160Z] [Checks API] No suitable checks publisher found.
[2021-03-31T13:38:16.825Z] + go clean -modcache
[2021-03-31T13:38:20.490Z] Cleaning up /var/lib/jenkins/workspace/PR-24871-1-95bd2bbc-4d89-41e5-84a9-42115ce32637
[2021-03-31T13:38:20.490Z] Client: Docker Engine - Community
[2021-03-31T13:38:20.490Z]  Version:           20.10.3
[2021-03-31T13:38:20.490Z]  API version:       1.41
[2021-03-31T13:38:20.490Z]  Go version:        go1.13.15
[2021-03-31T13:38:20.490Z]  Git commit:        48d30b5
[2021-03-31T13:38:20.490Z]  Built:             Fri Jan 29 14:33:13 2021
[2021-03-31T13:38:20.490Z]  OS/Arch:           linux/amd64
[2021-03-31T13:38:20.490Z]  Context:           default
[2021-03-31T13:38:20.490Z]  Experimental:      true
[2021-03-31T13:38:20.490Z] 
[2021-03-31T13:38:20.490Z] Server: Docker Engine - Community
[2021-03-31T13:38:20.490Z]  Engine:
[2021-03-31T13:38:20.490Z]   Version:          20.10.3
[2021-03-31T13:38:20.490Z]   API version:      1.41 (minimum version 1.12)
[2021-03-31T13:38:20.490Z]   Go version:       go1.13.15
[2021-03-31T13:38:20.490Z]   Git commit:       46229ca
[2021-03-31T13:38:20.490Z]   Built:            Fri Jan 29 14:31:25 2021
[2021-03-31T13:38:20.490Z]   OS/Arch:          linux/amd64
[2021-03-31T13:38:20.490Z]   Experimental:     false
[2021-03-31T13:38:20.490Z]  containerd:
[2021-03-31T13:38:20.490Z]   Version:          1.4.4
[2021-03-31T13:38:20.490Z]   GitCommit:        05f951a3781f4f2c1911b05e61c160e9c30eaa8e
[2021-03-31T13:38:20.490Z]  runc:
[2021-03-31T13:38:20.490Z]   Version:          1.0.0-rc93
[2021-03-31T13:38:20.490Z]   GitCommit:        12644e614e25b05da6fd08a38ffa0cfe1903fdec
[2021-03-31T13:38:20.491Z]  docker-init:
[2021-03-31T13:38:20.491Z]   Version:          0.19.0
[2021-03-31T13:38:20.491Z]   GitCommit:        de40ad0
[2021-03-31T13:38:20.491Z] Change ownership of all files inside the specific folder from root/root to current user/group
[2021-03-31T13:38:27.111Z] Change permissions with write access of all files inside the specific folder
[2021-03-31T13:38:27.433Z] Running in /var/lib/jenkins/workspace/PR-24871-1-95bd2bbc-4d89-41e5-84a9-42115ce32637
[2021-03-31T13:38:38.791Z] Stage "Packaging" skipped due to earlier failure(s)
[2021-03-31T13:38:39.058Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-24871/src/github.com/elastic/beats
[2021-03-31T13:38:50.567Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-24871
[2021-03-31T13:38:50.747Z] [INFO] getVaultSecret: Getting secrets
[2021-03-31T13:38:50.898Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2021-03-31T13:38:52.576Z] + chmod 755 generate-build-data.sh
[2021-03-31T13:38:52.577Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24871/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24871/runs/1 FAILURE 6047565
[2021-03-31T13:38:52.827Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-24871/runs/1/steps/?limit=10000 -o steps-info.json

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	0
Passed	46007
Skipped	5122
Total	51129

jsoriano · 2021-03-31T14:02:09Z

/test

marc-gr

LGTM

jsoriano · 2021-03-31T15:27:35Z

Failing tests are not related, merging.

Add field definition for new user agent field added in elastic/elasticsearch#69322 (cherry picked from commit 6454736)

Revert field added in #24871 and regenerate filebeat test files.

…#24876)" This reverts commit da0299a.

This reverts commit da0299a. Field added in #24876 has been reverted in master in #25141.

jsoriano added 2 commits March 31, 2021 13:15

Add user agent device type field

0f39265

Update x-pack expected files

ef508ef

jsoriano added review Filebeat Filebeat Team:Integrations Label for the Integrations team Team:Automation Label for the Observability productivity team Team:Security-External Integrations labels Mar 31, 2021

jsoriano self-assigned this Mar 31, 2021

jsoriano requested a review from a team as a code owner March 31, 2021 11:57

botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Mar 31, 2021

jsoriano removed the request for review from a team March 31, 2021 11:57

jsoriano added the :Testing label Mar 31, 2021

kvch mentioned this pull request Mar 31, 2021

Use identifier in HarvesterGroup in filestream #24864

Merged

3 tasks

urso approved these changes Mar 31, 2021

View reviewed changes

jsoriano added the needs_backport PR is waiting to be backported to other branches. label Mar 31, 2021

marc-gr approved these changes Mar 31, 2021

View reviewed changes

andrewkroh added the ecs label Mar 31, 2021

jsoriano merged commit 6454736 into elastic:master Mar 31, 2021

jsoriano deleted the user-agent-device-type branch March 31, 2021 15:28

jsoriano mentioned this pull request Mar 31, 2021

Cherry-pick #24871 to 7.x: Add field for user agent device type #24876

Merged

jsoriano added a commit to jsoriano/beats that referenced this pull request Mar 31, 2021

Add field for user agent device type (elastic#24871)

9d5ad23

Add field definition for new user agent field added in elastic/elasticsearch#69322 (cherry picked from commit 6454736)

jsoriano added v7.13.0 and removed needs_backport PR is waiting to be backported to other branches. labels Mar 31, 2021

jsoriano added a commit that referenced this pull request Mar 31, 2021

Add field for user agent device type (#24871) (#24876)

da0299a

Add field definition for new user agent field added in elastic/elasticsearch#69322 (cherry picked from commit 6454736)

jsoriano pushed a commit that referenced this pull request Apr 19, 2021

Fix for tests after device... field has been removed (#25141)

863c704

Revert field added in #24871 and regenerate filebeat test files.

jsoriano added a commit to jsoriano/beats that referenced this pull request Apr 19, 2021

Revert "Add field for user agent device type (elastic#24871) (elastic…

77810a0

…#24876)" This reverts commit da0299a.

jsoriano added a commit that referenced this pull request Apr 20, 2021

Revert "Add field for user agent device type (#24871) (#24876)" (#25153)

6fcafb7

This reverts commit da0299a. Field added in #24876 has been reverted in master in #25141.

Conversation

jsoriano commented Mar 31, 2021

Uh oh!

elasticmachine commented Mar 31, 2021

Uh oh!

elasticmachine commented Mar 31, 2021

Uh oh!

elasticmachine commented Mar 31, 2021

💔 Build Failed

Build stats

Test stats 🧪

Trends 🧪

Steps errors

Sleep

Extract

Delete folders that are causing exceptions (See JENKINS-58421)

Sleep

check for Docker

Sleep

Sleep

Sleep

Error signal

Recursively delete the current directory from the workspace

Log output

💚 Flaky test report

Test stats 🧪

Uh oh!

jsoriano commented Mar 31, 2021

Uh oh!

marc-gr left a comment

Choose a reason for hiding this comment

Uh oh!

jsoriano commented Mar 31, 2021

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

`Sleep`

`Extract`

`Delete folders that are causing exceptions (See JENKINS-58421)`

`Sleep`

`check for Docker`

`Sleep`

`Sleep`

`Sleep`

`Error signal`

`Recursively delete the current directory from the workspace`