Skip to content

PostgreSQL Filebeat: Define fields.epr.yml#19127

Merged
kvch merged 1 commit intoelastic:masterfrom
kvch:migrate-package-postgresql
Jun 12, 2020
Merged

PostgreSQL Filebeat: Define fields.epr.yml#19127
kvch merged 1 commit intoelastic:masterfrom
kvch:migrate-package-postgresql

Conversation

@kvch
Copy link
Copy Markdown
Contributor

@kvch kvch commented Jun 11, 2020

This PR defines additional fields referenced in the ingest pipeline.

The file is used by the import-beats script to include them in integration packages.

@kvch kvch added the Team:Services (Deprecated) Label for the former Integrations-Services team label Jun 11, 2020
@kvch kvch requested a review from mtojek June 11, 2020 12:02
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Jun 11, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #19127 opened]

  • Start Time: 2020-06-11T12:03:19.500+0000

  • Duration: 56 min 38 sec

Test stats 🧪

Test Results
Failed 10
Passed 3929
Skipped 672
Total 4611

Test errors

Expand to view the tests failures

  • Name: Build and Test / Filebeat Mac OS X / test_file_disappear – test_crawler.Test

    • Age: 1
    • Duration: 1.971
    • Error Details:
  • Name: Build and Test / Filebeat Windows / test_close_renamed – test_harvester.Test

    • Age: 1
    • Duration: 0.552
    • Error Details: [Errno 2] No such file or directory: 'C:\Users\jenkins\workspace\Beats_beats-beats-mbp_PR-19127\src\github.com\elastic\beats\filebeat\build\system-tests\run\test_harvester.Test.test_close_renamed\registry/filebeat/data.json'
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file – test_registrar.Test

    • Age: 1
    • Duration: 3.652
    • Error Details: 'NoneType' object is not subscriptable
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file_inode – test_registrar.Test

    • Age: 1
    • Duration: 5.975
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_rotating_file_with_restart – test_registrar.Test

    • Age: 1
    • Duration: 6.385
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_0 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 3.421
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_6_3_1 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 1.73
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_faulty_6_3_1 – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 1.889
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_latest – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 2.072
    • Error Details:
  • Name: Build and Test / Filebeat Mac OS X / test_upgrade_from_single_file_to_folder_hierarchy – test_registrar_upgrade.Test

    • Age: 1
    • Duration: 2.285
    • Error Details:

Steps errors

Expand to view the steps failures

  • Name: Mage build unitTest

    • Description: mage build unitTest

    • Duration: 23 min 27 sec

    • Start Time: 2020-06-11T12:28:41.758+0000

    • log

  • Name: Report to Codecov

    • Description: curl -sSLo codecov https://codecov.io/bash for i in auditbeat filebeat heartbeat libbeat metricbeat packetbeat winlogbeat journalbeat do FILE="${i}/build/coverage/full.cov" if [ -f "${FILE}" ]; then bash codecov -f "${FILE}" fi done

    • Duration: 1 min 28 sec

    • Start Time: 2020-06-11T12:52:15.590+0000

    • log

  • Name: Recursively delete the current directory from the workspace

    • Description: script returned exit code 1

    • Duration: 1 min 10 sec

    • Start Time: 2020-06-11T12:54:28.881+0000

    • log

  • Name: Mage build unitTest

    • Description: mage build unitTest

    • Duration: 10 min 7 sec

    • Start Time: 2020-06-11T12:30:31.256+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-06-11T12:57:52.845Z] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[2020-06-11T12:57:52.845Z] 	at java.lang.Thread.run(Thread.java:748)
[2020-06-11T12:57:52.845Z] No artifacts found that match the file pattern "**/build/TEST*.out". Configuration error?
[2020-06-11T12:57:53.343Z] + curl -sSLo codecov https://codecov.io/bash
[2020-06-11T12:58:19.969Z] + FILE=auditbeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-06-11T12:58:19.969Z] + FILE=filebeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-06-11T12:58:19.969Z] + bash codecov -f filebeat/build/coverage/full.cov
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.969Z]   _____          _
[2020-06-11T12:58:19.969Z]  / ____|        | |
[2020-06-11T12:58:19.969Z] | |     ___   __| | ___  ___ _____   __
[2020-06-11T12:58:19.969Z] | |    / _ \ / _` |/ _ \/ __/ _ \ \ / /
[2020-06-11T12:58:19.969Z] | |___| (_) | (_| |  __/ (_| (_) \ V /
[2020-06-11T12:58:19.969Z]  \_____\___/ \__,_|\___|\___\___/ \_/
[2020-06-11T12:58:19.969Z]                               Bash-20200602-f809a24
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.969Z] 
[2020-06-11T12:58:19.970Z] ==> Jenkins CI detected.
[2020-06-11T12:58:19.970Z]     project root: .
[2020-06-11T12:58:19.970Z]     Fixing merge commit SHA
[2020-06-11T12:58:19.970Z]     Yaml found at: codecov.yml
[2020-06-11T12:58:19.970Z]     -> Found 1 reports
[2020-06-11T12:58:19.970Z] ==> Detecting git/mercurial file structure
[2020-06-11T12:58:19.970Z] ==> Reading reports
[2020-06-11T12:58:19.970Z]     + filebeat/build/coverage/full.cov bytes=261361
[2020-06-11T12:58:19.970Z] ==> Appending adjustments
[2020-06-11T12:58:19.970Z]     https://docs.codecov.io/docs/fixing-reports
[2020-06-11T12:58:30.102Z]     + Found adjustments
[2020-06-11T12:58:30.102Z] ==> Gzipping contents
[2020-06-11T12:58:30.102Z] ==> Uploading reports
[2020-06-11T12:58:30.102Z]     url: https://codecov.io
[2020-06-11T12:58:30.102Z]     query: branch=PR-19127&commit=54da4bd46f1842cce40d5b2291c9ddd26b43080a&build=1&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-19127%2F1%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=19127&job=
[2020-06-11T12:58:30.102Z]     -> Pinging Codecov
[2020-06-11T12:58:30.102Z] https://codecov.io/upload/v4?package=bash-20200602-f809a24&token=secret&branch=PR-19127&commit=54da4bd46f1842cce40d5b2291c9ddd26b43080a&build=1&build_url=https%3A%2F%2Fbeats-ci.elastic.co%2Fjob%2FBeats%2Fjob%2Fbeats-beats-mbp%2Fjob%2FPR-19127%2F1%2F&name=&tag=&slug=elastic%2Fbeats&service=jenkins&flags=&pr=19127&job=
[2020-06-11T12:58:30.102Z] HTTP 400
[2020-06-11T12:58:30.102Z] Please provide the repository token to upload reports via `-t :repository-token`
[2020-06-11T12:58:30.102Z] + FILE=heartbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=libbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=metricbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=packetbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-06-11T12:58:30.102Z] + FILE=journalbeat/build/coverage/full.cov
[2020-06-11T12:58:30.102Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-06-11T12:58:33.378Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:33.725Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-11T12:58:33.747Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Lint
[2020-06-11T12:58:33.898Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-06-11T12:58:34.049Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-Windows
[2020-06-11T12:58:34.203Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-06-11T12:58:34.357Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-x-pack
[2020-06-11T12:58:34.524Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-06-11T12:58:34.679Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats/Filebeat-oss
[2020-06-11T12:58:35.124Z] + cat
[2020-06-11T12:58:35.124Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-11T12:58:35.124Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-11T12:58:41.723Z] runbld>>> runbld started
[2020-06-11T12:58:41.723Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-11T12:58:42.667Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-19127' in order of occurrence in the config (last value wins).
[2020-06-11T12:58:44.054Z] runbld>>> Debug logging enabled.
[2020-06-11T12:58:44.054Z] runbld>>> Storing result
[2020-06-11T12:58:44.315Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-11T12:58:44.315Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200611125843-D99E9F61
[2020-06-11T12:58:44.315Z] runbld>>> Adding system facts.
[2020-06-11T12:58:45.260Z] runbld>>> Adding vcs info for the latest commit:  e7ff998cd72d6982f3af6c6d32f0c0257c6ce165
[2020-06-11T12:58:45.260Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-11T12:58:45.260Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-11T12:58:45.525Z] Processing JUnit reports with runbld...
[2020-06-11T12:58:45.525Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-11T12:58:45.786Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-11T12:58:45.786Z] runbld>>> DURATION: 19ms
[2020-06-11T12:58:45.786Z] runbld>>> STDOUT: 40 bytes
[2020-06-11T12:58:45.786Z] runbld>>> STDERR: 49 bytes
[2020-06-11T12:58:45.786Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-11T12:58:45.786Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:47.169Z] runbld>>> Storing build metadata: 
[2020-06-11T12:58:47.169Z] runbld>>> Adding test report.
[2020-06-11T12:58:47.169Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127/src/github.com/elastic/beats
[2020-06-11T12:58:48.111Z] runbld>>> Found 13 test output files
[2020-06-11T12:58:49.065Z] runbld>>> Test output logs contained: Errors: 2 Failures: 8 Tests: 4611 Skipped: 648
[2020-06-11T12:58:49.326Z] runbld>>> Storing result
[2020-06-11T12:58:49.326Z] runbld>>> FAILURES: 10
[2020-06-11T12:58:51.238Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-11T12:58:51.238Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200611125843-D99E9F61
[2020-06-11T12:58:51.238Z] runbld>>> Email notification disabled by environment variable.
[2020-06-11T12:58:51.238Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-11T12:58:57.009Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-19127
[2020-06-11T12:58:57.181Z] [INFO] getVaultSecret: Getting secrets
[2020-06-11T12:58:57.255Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-11T12:58:58.129Z] + chmod 755 generate-build-data.sh
[2020-06-11T12:58:58.129Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1 FAILURE 3338359
[2020-06-11T12:58:58.129Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/steps/?limit=10000 -o steps-info.json
[2020-06-11T12:58:59.040Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/tests/?status=FAILED -o tests-errors.json
[2020-06-11T12:58:59.040Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-19127/runs/1/log/ -o pipeline-log.txt

@kvch kvch merged commit d7dd12e into elastic:master Jun 12, 2020
v1v added a commit to v1v/beats that referenced this pull request Jun 12, 2020
…ngs-archive

* upstream/master: (119 commits)
  Update filebeat input docs (elastic#19110)
  Add ECS fields from log pipeline of PostgreSQL (elastic#19127)
  Init package libbeat/statestore (elastic#19117)
  [Ingest Manager] Retryable downloads of beats (elastic#19102)
  [DOCS] Add output.console to Functionbeat doc and Functionbeat reference file (elastic#18965)
  Add compatibility info (elastic#18929)
  Set ecszap version to v0.2.0 (elastic#19106)
  [filebeat][httpjson] Fix unit test function call (elastic#19124)
  [Filebeat][httpjson] Adds oauth2 support for httpjson input (elastic#18892)
  Allow host.* fields to be disabled in Suricata module (elastic#19107)
  Make selector string casing configurable (elastic#18854)
  Switch the GRPC communication where Agent is running the server and the beats are connecting back to Agent (elastic#18973)
  Disable host.* fields by default for netflow module (elastic#19087)
  Automatically fill zube teams on backports if available (elastic#18924)
  Fix crash on vsphere module (elastic#19078)
  [Ingest Manager] Download snapshot artifacts from snapshots repo (elastic#18685)
  [Ingest Manager] Basic Elastic Agent documentation (elastic#19030)
  Make user.id a string in system/users, in line with ECS (elastic#19019)
  [docs] Add 7.8 release highlights placeholder file (elastic#18493)
  Fix translate_sid's empty target field handling (elastic#18991)
  ...
melchiormoulin pushed a commit to melchiormoulin/beats that referenced this pull request Oct 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants