Skip to content

Cherry-pick #20820 to 7.x: Add new modules/filesets from rsa2elk for 7.10#21129

Merged
adriansr merged 1 commit intoelastic:7.xfrom
adriansr:backport_20820_7.x
Sep 21, 2020
Merged

Cherry-pick #20820 to 7.x: Add new modules/filesets from rsa2elk for 7.10#21129
adriansr merged 1 commit intoelastic:7.xfrom
adriansr:backport_20820_7.x

Conversation

@adriansr
Copy link
Copy Markdown
Contributor

@adriansr adriansr commented Sep 17, 2020 •
edited by zube bot
Loading

Cherry-pick of PR #20820 to 7.x branch. Original message:

This adds the following new modules:

And the following filesets to existing modules:

  • barracuda/spamfirewall
  • cisco/meraki
  • f5/bigipafm
  • fortinet/fortimail
  • fortinet/fortimanager
  • juniper/netscreen
  • sophos/utm

Testing logs are autogenerated from the devices so they don't make much
sense.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Note to reviewers

What to check:

  • Docs, esp. those for existing modules (barracuda, f5, fortinet, juniper, sophos).

@adriansr
Add new modules/filesets from rsa2elk for 7.10 (elastic#20820)
519ae6a 
This the following new modules:
- citrix (netscaler fileset): This existed in 7.9 but was removed by elastic#20706.
- cyberark (corepass fileset).
- proofpoint (emailsecurity fileset).
- snort (log fileset).
- symantec (endpointprotection fileset).

And the following filesets to existing modules:
- barracuda/spamfirewall
- cisco/meraki
- f5/bigipafm
- fortinet/fortimail
- fortinet/fortimanager
- juniper/netscreen
- sophos/utm

(cherry picked from commit 3390aa8)
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Sep 17, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Sep 17, 2020

Pinging @elastic/siem (Team:SIEM)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Sep 17, 2020
@adriansr adriansr requested a review from a team September 17, 2020 09:49
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Sep 17, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21129 opened]

  • Start Time: 2020-09-17T09:21:14.784+0000

  • Duration: 69 min 15 sec

Test stats 🧪

Test Results
Failed 0
Passed 4781
Skipped 825
Total 5606

Steps errors

Expand to view the steps failures

  • Name: Mage build test

    • Description: mage build test

    • Duration: 10 min 49 sec

    • Start Time: 2020-09-17T09:51:49.809+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-09-17T10:28:47.983Z]  Git commit:        48a66213fe
[2020-09-17T10:28:47.983Z]  Built:             Mon Jun 22 15:45:36 2020
[2020-09-17T10:28:47.983Z]  OS/Arch:           linux/amd64
[2020-09-17T10:28:47.983Z]  Experimental:      false
[2020-09-17T10:28:47.983Z] 
[2020-09-17T10:28:47.983Z] Server: Docker Engine - Community
[2020-09-17T10:28:47.983Z]  Engine:
[2020-09-17T10:28:47.983Z]   Version:          19.03.12
[2020-09-17T10:28:47.983Z]   API version:      1.40 (minimum version 1.12)
[2020-09-17T10:28:47.983Z]   Go version:       go1.13.10
[2020-09-17T10:28:47.983Z]   Git commit:       48a66213fe
[2020-09-17T10:28:47.983Z]   Built:            Mon Jun 22 15:44:07 2020
[2020-09-17T10:28:47.983Z]   OS/Arch:          linux/amd64
[2020-09-17T10:28:47.983Z]   Experimental:     false
[2020-09-17T10:28:47.983Z]  containerd:
[2020-09-17T10:28:47.983Z]   Version:          1.2.13
[2020-09-17T10:28:47.983Z]   GitCommit:        7ad184331fa3e55e52b890ea95e65ba581ae3429
[2020-09-17T10:28:47.983Z]  runc:
[2020-09-17T10:28:47.983Z]   Version:          1.0.0-rc10
[2020-09-17T10:28:47.983Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-09-17T10:28:47.983Z]  docker-init:
[2020-09-17T10:28:47.983Z]   Version:          0.18.0
[2020-09-17T10:28:47.983Z]   GitCommit:        fec3683
[2020-09-17T10:28:47.983Z] Unable to find image 'alpine:3.4' locally
[2020-09-17T10:28:48.555Z] 3.4: Pulling from library/alpine
[2020-09-17T10:28:48.555Z] c1e54eec4b57: Pulling fs layer
[2020-09-17T10:28:48.819Z] c1e54eec4b57: Verifying Checksum
[2020-09-17T10:28:48.819Z] c1e54eec4b57: Download complete
[2020-09-17T10:28:49.084Z] c1e54eec4b57: Pull complete
[2020-09-17T10:28:49.084Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2020-09-17T10:28:49.084Z] Status: Downloaded newer image for alpine:3.4
[2020-09-17T10:28:51.338Z] + python .ci/scripts/pre_archive_test.py
[2020-09-17T10:28:53.261Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2020-09-17T10:28:53.287Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/build
[2020-09-17T10:28:53.346Z] Recording test results
[2020-09-17T10:28:55.079Z] Stashed 4 file(s)
[2020-09-17T10:28:55.101Z] Archiving artifacts
[2020-09-17T10:28:55.862Z] + python .ci/scripts/search_system_tests.py
[2020-09-17T10:28:55.890Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2020-09-17T10:28:56.258Z] + tar --version
[2020-09-17T10:28:56.635Z] + tar --exclude=x-pack-filebeat--system-tests-linux.tgz -czf x-pack-filebeat--system-tests-linux.tgz build/x-pack/filebeat/build/system-tests
[2020-09-17T10:29:18.604Z] Archiving artifacts
[2020-09-17T10:29:43.472Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-09-17T10:29:43.511Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-09-17T10:29:43.577Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21129-1/source/source.tgz
[2020-09-17T10:29:43.604Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21129-1/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21129/source.tgz
[2020-09-17T10:29:53.442Z] + tar --version
[2020-09-17T10:29:53.760Z] + tar -xpf source.tgz
[2020-09-17T10:30:06.355Z] + rm source.tgz
[2020-09-17T10:30:06.379Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats
[2020-09-17T10:30:06.429Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Lint
[2020-09-17T10:30:06.590Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-09-17T10:30:06.757Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-oss
[2020-09-17T10:30:06.919Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-Windows
[2020-09-17T10:30:07.082Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-09-17T10:30:07.246Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-09-17T10:30:07.407Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats/Filebeat-x-pack
[2020-09-17T10:30:07.927Z] + cat
[2020-09-17T10:30:07.927Z] + /usr/local/bin/runbld ./runbld-script --job-name elastic+beats+pull-request
[2020-09-17T10:30:07.927Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-09-17T10:30:14.521Z] runbld>>> runbld started
[2020-09-17T10:30:14.521Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-09-17T10:30:15.910Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-09-17T10:30:16.172Z] runbld>>> Matches in the system config:
[2020-09-17T10:30:16.172Z] runbld>>> - Matched ^elastic\+beats
[2020-09-17T10:30:16.172Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-09-17T10:30:17.556Z] runbld>>> Debug logging enabled.
[2020-09-17T10:30:17.556Z] runbld>>> Storing result
[2020-09-17T10:30:17.556Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-09-17T10:30:17.556Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20200917103017-2DCCAECE
[2020-09-17T10:30:17.556Z] runbld>>> Adding system facts.
[2020-09-17T10:30:18.502Z] runbld>>> Adding vcs info for the latest commit:  519ae6ae618dc4deb4cc4e3823e95b1fc0063a83
[2020-09-17T10:30:18.502Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-09-17T10:30:18.502Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-09-17T10:30:18.502Z] Processing JUnit reports with runbld...
[2020-09-17T10:30:18.502Z] + echo 'Processing JUnit reports with runbld...'
[2020-09-17T10:30:19.074Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-09-17T10:30:19.074Z] runbld>>> DURATION: 14ms
[2020-09-17T10:30:19.074Z] runbld>>> STDOUT: 40 bytes
[2020-09-17T10:30:19.074Z] runbld>>> STDERR: 49 bytes
[2020-09-17T10:30:19.074Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-09-17T10:30:19.074Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21129
[2020-09-17T10:30:20.017Z] runbld>>> Storing build metadata: 
[2020-09-17T10:30:20.017Z] runbld>>> Adding test report.
[2020-09-17T10:30:20.017Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21129/src/github.com/elastic/beats
[2020-09-17T10:30:20.588Z] runbld>>> Found 14 test output files
[2020-09-17T10:30:21.976Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 5606 Skipped: 800
[2020-09-17T10:30:22.237Z] runbld>>> Storing result
[2020-09-17T10:30:22.237Z] runbld>>> FAILURES: 0
[2020-09-17T10:30:22.497Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-09-17T10:30:22.497Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20200917103017-2DCCAECE
[2020-09-17T10:30:22.497Z] runbld>>> Email notification disabled by environment variable.
[2020-09-17T10:30:22.497Z] runbld>>> Slack notification disabled by environment variable.
[2020-09-17T10:30:28.443Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21129
[2020-09-17T10:30:28.745Z] [INFO] getVaultSecret: Getting secrets
[2020-09-17T10:30:28.845Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-09-17T10:30:29.928Z] + chmod 755 generate-build-data.sh
[2020-09-17T10:30:29.928Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21129/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21129/runs/1 FAILURE 4154870
[2020-09-17T10:30:29.928Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21129/runs/1/steps/?limit=10000 -o steps-info.json
[2020-09-17T10:30:30.479Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21129/runs/1/tests/?status=FAILED -o tests-errors.json

@adriansr adriansr merged commit fe5c4ad into elastic:7.x Sep 21, 2020
@zube zube bot removed the [zube]: Done label Dec 21, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@marc-gr marc-gr marc-gr approved these changes

Assignees

No one assigned

Labels

backport review

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@adriansr @elasticmachine @marc-gr