Filebeat new registry by urso · Pull Request #12908 · elastic/beats

urso · 2019-07-15T11:25:10Z

This PR updates the current filebeat registry to use libbeat/registry as backend. This is the same new registry to be used with #14229. This way inputs using the old input API and inputs using the new inputs API will use the very same registry file.

The reason for having both using the same backend is to ease migration. This PR introduces some initial support for registry file migration (in case we update the backend in the future). The migration support already copies the old registry file into the new location. By migrating the old file from the get go we do not have to deal with 2 different file formats now and in the future.

Mixing the registrar with the new registry is not exactly optimal. Traditionally filebeat stores states per input and in the registrar. Now we need to store it in the input, the registrar, and the new registry (also in-memory). Plus the new registry supports selective field updates, but the registrar doesn't make use of it. This means all fields need to be serialized and written twice. Once for generic in memory state and once for writing to disk. Although in most cases only one field would be enough, we need to serialize all fields all the time, due to the registrar mixing internal and external state in one common structure. This can't be really helped and is a temporary limitation.

To get an idea about the impact I did run a few tests. Each test runs filebeat for ~90s and we measure throughput, memory, and CPU usage (besides small peaks and lows run was rather stable). NASA HTTP access logs are chosen as sample data.

Filebeat -> console. Single log file.

master       76k/s     233%   50.5MB
newreg       73k/s     277%   49MB

Filebeat -> console, 101 log files.

master       83.6k/s   243%   46.5MB
newreg       83k/s     279%   46.2MB

Filebeat -> console, 101 log files, registry flush timeout 2s

master       92.5k/s   258%   44.8MB
newreg       92k/s     261%   42.5MB

All in all there is a performance degragation due to this change. This becomes most noticable in increased CPU usage. Each update serializes the complete state, no matter if only one field is updated. With separating meta-data and read-offset updates in the future I'd expect the overhead for serializing and writing updates to be reduced.

filebeat/input/file/state.go

ph · 2019-07-25T13:02:06Z

@urso is that a draft? I've put the work in progress label on it.

libbeat/registry/registry.go

kvch · 2020-04-02T16:10:28Z

filebeat/registrar/migrate.go

Why isn't this function a private function of Migrator?

func (m *Migrator) ensureCurrent() error {

And looking at the other functions in this file, those can be part of the Migrator as well.

True. I wanted to keep the change minimal, also to reduce the chance of messing up variables. The NewRegistry has been split into Migrator and the current implementation of New, so to explicitely require Filebeat to call migration before instantiating any registry. As all functionality is private to this package I didn't see this as a critical change.

filebeat/registrar/migrate.go

Registry file becomes a shared resource. As a long running write transaction can block others from making progress, we want a more short lived transaction.

elasticmachine · 2020-05-04T20:23:26Z

💔 Build Failed

Expand to view the summary

Build stats

Build Cause: [Pull request Filebeat new registry #12908 updated]
Start Time: 2020-05-04T18:15:15.025+0000
Duration: 128 min 44 sec (7664317)
Commit: 750f462

Test stats 🧪

Test	Results
Failed	37
Passed	4711
Skipped	749
Total	5497

Test errors

Expand to view the tests failures

Name: Build and Test / Filebeat x-pack / runTest – nose.failure.Failure
- Status: FAILED
- Age: 1
- Duration: 0
- Error Details: Cannot subscript an existing Union. Use Union[u, t] instead.
Name: Build and Test / Filebeat Windows / test_file_disappear – test_crawler.Test
- Status: FAILED
- Age: 1
- Duration: 10.647
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_file_disappear_appear – test_crawler.Test
- Status: FAILED
- Age: 1
- Duration: 10.755
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_close_eof – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.443
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_close_removed – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.312
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_close_renamed – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.558
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_close_timeout – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 13.385
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_decode_error – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.447
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_empty_line – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.754
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_empty_lines_only – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.439
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_exceed_buffer – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.443
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_symlink_and_file – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.448
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_symlink_removed – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 11.445
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_symlink_rotated – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.133
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_truncate – test_harvester.Test
- Status: FAILED
- Age: 1
- Duration: 10.651
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_registrar_file_content – test_publisher.Test
- Status: FAILED
- Age: 1
- Duration: 15.272
- Error Details: Timeout waiting for 'cond' to be true. Waited 15 seconds.
Name: Build and Test / Filebeat Windows / test_clean_removed – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.409
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_clean_removed_with_clean_inactive – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 15.281
- Error Details: Timeout waiting for 'cond' to be true. Waited 15 seconds.
Name: Build and Test / Filebeat Windows / test_custom_registry_file_location – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 1.264
- Error Details: Timeout waiting for 'cond' to be true. Waited 1 seconds.
Name: Build and Test / Filebeat Windows / test_data_path – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 0.395
- Error Details:
Name: Build and Test / Filebeat Windows / test_ignore_older_state – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 11.207
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_ignore_older_state_clean_inactive – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 12.243
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_invalid_state – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.108
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_registrar_file_content – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.256
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_registrar_files – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 1.257
- Error Details: Timeout waiting for 'cond' to be true. Waited 1 seconds.
Name: Build and Test / Filebeat Windows / test_registrar_files_with_input_level_processors – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.101
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_registrar_meta – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 1.253
- Error Details: Timeout waiting for 'cond' to be true. Waited 1 seconds.
Name: Build and Test / Filebeat Windows / test_restart_state_reset – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.452
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_restart_state_reset_ttl – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.384
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_restart_state_reset_ttl_no_clean_inactive – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.443
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_restart_state_reset_ttl_with_space – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.248
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_rotating_file – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 12.364
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_state_after_rotation – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 11.311
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_state_after_rotation_ignore_older – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 11.313
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_symlink_failure – test_registrar.Test
- Status: FAILED
- Age: 1
- Duration: 10.111
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.
Name: Build and Test / Filebeat Windows / test_once – test_shutdown.Test
- Status: FAILED
- Age: 1
- Duration: 15.291
- Error Details: Timeout waiting for 'cond' to be true. Waited 15 seconds.
Name: Build and Test / Filebeat Windows / test_shutdown_wait_timeout – test_shutdown.Test
- Status: FAILED
- Age: 1
- Duration: 14.931
- Error Details: Timeout waiting for 'cond' to be true. Waited 10 seconds.

Steps errors

Expand to view the steps failures

Name: Mage update build test
- Description: mage update build test
- Result: FAILURE
- Duration: 6 min 50 sec<
- Start Time: 2020-05-04T19:21:53.925+0000
Name: Mage build unitTest
- Description: mage build unitTest
- Result: FAILURE
- Duration: 15 min 20 sec<
- Start Time: 2020-05-04T19:24:25.621+0000
Name: Make -C libbeat testsuite
- Description: make -C libbeat testsuite
- Result: FAILURE
- Duration: 5 min 13 sec<
- Start Time: 2020-05-04T19:21:54.539+0000
Name: Make -C generator/_templates/metricbeat test
- Description: make -C generator/_templates/metricbeat test
- Result: FAILURE
- Duration: 1 min 53 sec<
- Start Time: 2020-05-04T19:22:00.084+0000
Name: Make -C generator/_templates/beat test
- Description: make -C generator/_templates/beat test
- Result: FAILURE
- Duration: 1 min 52 sec<
- Start Time: 2020-05-04T19:32:52.701+0000

Log output

Expand to view the last 100 lines of log output

[2020-05-04T20:22:09.496Z] + FILE=auditbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f auditbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=filebeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f filebeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=heartbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f heartbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=libbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f libbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=metricbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f metricbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=packetbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f packetbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=winlogbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f winlogbeat/build/coverage/full.cov ]
[2020-05-04T20:22:09.496Z] + FILE=journalbeat/build/coverage/full.cov
[2020-05-04T20:22:09.496Z] + [ -f journalbeat/build/coverage/full.cov ]
[2020-05-04T20:22:11.711Z] Failed in branch Filebeat oss
[2020-05-04T20:22:12.274Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-05-04T20:22:12.711Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-04T20:22:12.737Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Lint
[2020-05-04T20:22:12.978Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-05-04T20:22:13.192Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Winlogbeat-oss
[2020-05-04T20:22:13.585Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-05-04T20:22:14.013Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Dockerlogbeat
[2020-05-04T20:22:14.314Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Journalbeat-oss
[2020-05-04T20:22:14.693Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Libbeat-oss
[2020-05-04T20:22:15.165Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-05-04T20:22:15.534Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Filebeat-x-pack
[2020-05-04T20:22:15.902Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-05-04T20:22:16.125Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-05-04T20:22:16.439Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-05-04T20:22:16.882Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-05-04T20:22:17.271Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-05-04T20:22:17.536Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Heartbeat-oss
[2020-05-04T20:22:17.721Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-05-04T20:22:17.951Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Libbeat-x-pack
[2020-05-04T20:22:18.353Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Auditbeat-Linux
[2020-05-04T20:22:18.590Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Packetbeat-oss
[2020-05-04T20:22:18.836Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-Windows
[2020-05-04T20:22:19.120Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-05-04T20:22:19.373Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Filebeat-Windows
[2020-05-04T20:22:19.683Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-05-04T20:22:20.111Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Heartbeat-Windows
[2020-05-04T20:22:20.420Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Functionbeat-Windows
[2020-05-04T20:22:20.740Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-05-04T20:22:21.099Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-05-04T20:22:21.556Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Auditbeat-Windows
[2020-05-04T20:22:22.006Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-05-04T20:22:22.556Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Filebeat-oss
[2020-05-04T20:22:23.354Z] + cat
[2020-05-04T20:22:23.354Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-04T20:22:23.354Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-04T20:22:30.184Z] runbld>>> runbld started
[2020-05-04T20:22:30.184Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-04T20:22:31.620Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-12908' in order of occurrence in the config (last value wins).
[2020-05-04T20:22:33.066Z] runbld>>> Debug logging enabled.
[2020-05-04T20:22:33.066Z] runbld>>> Storing result
[2020-05-04T20:22:33.066Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-04T20:22:33.067Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200504202232-8546AB84
[2020-05-04T20:22:33.067Z] runbld>>> Adding system facts.
[2020-05-04T20:22:34.068Z] runbld>>> Adding vcs info for the latest commit:  750f4620b414467f3f0a63a424afb819653c4e41
[2020-05-04T20:22:34.356Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-04T20:22:34.357Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-04T20:22:34.357Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-04T20:22:34.357Z] Processing JUnit reports with runbld...
[2020-05-04T20:22:34.629Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-04T20:22:34.629Z] runbld>>> DURATION: 16ms
[2020-05-04T20:22:34.629Z] runbld>>> STDOUT: 40 bytes
[2020-05-04T20:22:34.629Z] runbld>>> STDERR: 49 bytes
[2020-05-04T20:22:34.629Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-04T20:22:34.629Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-05-04T20:22:36.124Z] runbld>>> Storing build metadata: 
[2020-05-04T20:22:36.125Z] runbld>>> Adding test report.
[2020-05-04T20:22:36.125Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-05-04T20:22:37.139Z] runbld>>> Found 88 test output files
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-05-04T20:22:37.746Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-x-pack/x-pack/metricbeat/build/TEST-go-integration-cloudfoundry.xml
[2020-05-04T20:22:38.364Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-windows.xml
[2020-05-04T20:22:38.364Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests/metricbeat/build/TEST-go-integration-graphite.xml
[2020-05-04T20:22:38.646Z] runbld>>> Test output logs contained: Errors: 36 Failures: 1 Tests: 5347 Skipped: 566
[2020-05-04T20:22:38.646Z] runbld>>> Storing result
[2020-05-04T20:22:38.646Z] runbld>>> FAILURES: 37
[2020-05-04T20:22:46.963Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-04T20:22:46.963Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200504202232-8546AB84
[2020-05-04T20:22:46.963Z] runbld>>> Email notification disabled by environment variable.
[2020-05-04T20:22:46.963Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-04T20:22:50.990Z] Body did not finish within grace period; terminating with extreme prejudice
[2020-05-04T20:22:51.102Z] ERROR: runbld post build action failed.
[2020-05-04T20:22:51.102Z] Timeout has been exceeded
[2020-05-04T20:22:55.718Z] Running on worker-395930 in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908
[2020-05-04T20:22:57.044Z] [INFO] getVaultSecret: Getting secrets
[2020-05-04T20:22:57.354Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-04T20:23:00.796Z] + chmod 755 generate-build-data.sh
[2020-05-04T20:23:00.796Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/17 ABORTED 7664317
[2020-05-04T20:23:00.796Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/17/steps/?limit=10000 -o steps-info.json
[2020-05-04T20:23:02.390Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/17/tests/?status=FAILED -o tests-errors.json

elasticmachine · 2020-06-15T23:02:00Z

💔 Build Failed

Expand to view the summary

Build stats

Build Cause: [Branch indexing]
Start Time: 2020-06-15T22:38:27.319+0000
Duration: 23 min 25 sec

Steps errors

Expand to view the steps failures

Name: Make check
- Description: make check
- Duration: 16 min 44 sec
- Start Time: 2020-06-15T22:45:40.194+0000
- log

Log output

Expand to view the last 100 lines of log output

[2020-06-15T23:01:27.993Z] Stage "Kubernetes" skipped due to earlier failure(s)
[2020-06-15T23:01:28.073Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.074Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.075Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-15T23:01:28.076Z] Stage "Packetbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.077Z] Stage "dockerlogbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.078Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.079Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.079Z] Stage "Journalbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:28.080Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-15T23:01:28.686Z] Failed in branch Elastic Agent x-pack
[2020-06-15T23:01:28.687Z] Failed in branch Elastic Agent x-pack Windows
[2020-06-15T23:01:28.688Z] Failed in branch Elastic Agent Mac OS X
[2020-06-15T23:01:28.689Z] Failed in branch Filebeat oss
[2020-06-15T23:01:28.690Z] Failed in branch Filebeat x-pack
[2020-06-15T23:01:28.690Z] Failed in branch Filebeat Mac OS X
[2020-06-15T23:01:28.691Z] Failed in branch Filebeat x-pack Mac OS X
[2020-06-15T23:01:28.692Z] Failed in branch Filebeat Windows
[2020-06-15T23:01:28.692Z] Failed in branch Filebeat x-pack Windows
[2020-06-15T23:01:28.693Z] Failed in branch Auditbeat oss Linux
[2020-06-15T23:01:28.767Z] Failed in branch Auditbeat crosscompile
[2020-06-15T23:01:28.768Z] Failed in branch Auditbeat oss Mac OS X
[2020-06-15T23:01:28.769Z] Failed in branch Auditbeat oss Windows
[2020-06-15T23:01:28.770Z] Failed in branch Auditbeat x-pack
[2020-06-15T23:01:28.771Z] Failed in branch Auditbeat x-pack Mac OS X
[2020-06-15T23:01:28.772Z] Failed in branch Auditbeat x-pack Windows
[2020-06-15T23:01:28.772Z] Failed in branch Libbeat x-pack
[2020-06-15T23:01:28.773Z] Failed in branch Metricbeat OSS Unit tests
[2020-06-15T23:01:28.774Z] Failed in branch Metricbeat OSS Integration tests
[2020-06-15T23:01:28.775Z] Failed in branch Metricbeat Python integration tests
[2020-06-15T23:01:28.775Z] Failed in branch Metricbeat crosscompile
[2020-06-15T23:01:28.776Z] Failed in branch Metricbeat Mac OS X
[2020-06-15T23:01:28.777Z] Failed in branch Metricbeat x-pack Mac OS X
[2020-06-15T23:01:28.778Z] Failed in branch Metricbeat Windows
[2020-06-15T23:01:28.779Z] Failed in branch Metricbeat x-pack Windows
[2020-06-15T23:01:28.779Z] Failed in branch Winlogbeat Windows x-pack
[2020-06-15T23:01:28.780Z] Failed in branch Kubernetes
[2020-06-15T23:01:29.104Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.105Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.106Z] Stage "Metricbeat x-pack" skipped due to earlier failure(s)
[2020-06-15T23:01:29.107Z] Stage "Winlogbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.108Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.108Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-15T23:01:29.164Z] Failed in branch Packetbeat
[2020-06-15T23:01:29.165Z] Failed in branch dockerlogbeat
[2020-06-15T23:01:29.165Z] Failed in branch Journalbeat
[2020-06-15T23:01:29.438Z] Stage "Heartbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.440Z] Stage "Libbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.441Z] Stage "Functionbeat" skipped due to earlier failure(s)
[2020-06-15T23:01:29.442Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-15T23:01:29.500Z] Failed in branch Metricbeat x-pack
[2020-06-15T23:01:29.501Z] Failed in branch Winlogbeat
[2020-06-15T23:01:29.730Z] Failed in branch Heartbeat
[2020-06-15T23:01:29.731Z] Failed in branch Libbeat
[2020-06-15T23:01:29.731Z] Failed in branch Functionbeat
[2020-06-15T23:01:29.732Z] Stage "Generators" skipped due to earlier failure(s)
[2020-06-15T23:01:29.823Z] Failed in branch Generators
[2020-06-15T23:01:29.974Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-06-15T23:01:30.288Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-06-15T23:01:30.301Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats/Lint
[2020-06-15T23:01:30.705Z] + cat
[2020-06-15T23:01:30.705Z] + /usr/local/bin/runbld ./runbld-script
[2020-06-15T23:01:30.705Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-06-15T23:01:37.292Z] runbld>>> runbld started
[2020-06-15T23:01:37.292Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-06-15T23:01:39.841Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-12908' in order of occurrence in the config (last value wins).
[2020-06-15T23:01:40.783Z] runbld>>> Debug logging enabled.
[2020-06-15T23:01:40.783Z] runbld>>> Storing result
[2020-06-15T23:01:41.045Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-06-15T23:01:41.045Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200615230140-C90230C7
[2020-06-15T23:01:41.045Z] runbld>>> Adding system facts.
[2020-06-15T23:01:41.991Z] runbld>>> Adding vcs info for the latest commit:  9008b19b1d991d2c2a5e2e4f96ce0a44537d5a69
[2020-06-15T23:01:41.991Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-06-15T23:01:42.252Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-06-15T23:01:42.252Z] Processing JUnit reports with runbld...
[2020-06-15T23:01:42.252Z] + echo 'Processing JUnit reports with runbld...'
[2020-06-15T23:01:42.522Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-06-15T23:01:42.522Z] runbld>>> DURATION: 17ms
[2020-06-15T23:01:42.522Z] runbld>>> STDOUT: 40 bytes
[2020-06-15T23:01:42.522Z] runbld>>> STDERR: 49 bytes
[2020-06-15T23:01:42.522Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-06-15T23:01:42.522Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-06-15T23:01:43.913Z] runbld>>> Storing build metadata: 
[2020-06-15T23:01:43.913Z] runbld>>> Adding test report.
[2020-06-15T23:01:43.913Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908/src/github.com/elastic/beats
[2020-06-15T23:01:44.900Z] runbld>>> Found 0 test output files
[2020-06-15T23:01:44.900Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 0 Skipped: 0
[2020-06-15T23:01:45.160Z] runbld>>> Storing result
[2020-06-15T23:01:45.421Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-06-15T23:01:45.421Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200615230140-C90230C7
[2020-06-15T23:01:45.421Z] runbld>>> Email notification disabled by environment variable.
[2020-06-15T23:01:45.421Z] runbld>>> Slack notification disabled by environment variable.
[2020-06-15T23:01:51.129Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-12908
[2020-06-15T23:01:51.222Z] [INFO] getVaultSecret: Getting secrets
[2020-06-15T23:01:51.292Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-06-15T23:01:52.165Z] + chmod 755 generate-build-data.sh
[2020-06-15T23:01:52.165Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/2 FAILURE 1404581
[2020-06-15T23:01:52.166Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/2/steps/?limit=10000 -o steps-info.json
[2020-06-15T23:01:52.416Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-06-15T23:01:52.666Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-12908/runs/2/log/ -o pipeline-log.txt

urso requested a review from a team as a code owner July 15, 2019 11:25

houndci-bot reviewed Jul 15, 2019

View reviewed changes

filebeat/input/file/state.go Outdated Show resolved Hide resolved

houndci-bot reviewed Jul 15, 2019

View reviewed changes

filebeat/input/file/state.go Outdated Show resolved Hide resolved

houndci-bot reviewed Jul 15, 2019

View reviewed changes

filebeat/input/file/state.go Outdated Show resolved Hide resolved

ph added the libbeat label Jul 25, 2019

ph added the in progress Pull request is currently in progress. label Jul 25, 2019

urso force-pushed the feature-new-registry-file branch from 6799ac9 to 43a1d61 Compare August 6, 2019 17:29

urso force-pushed the filebeat-new-registry branch 2 times, most recently from 061835b to 37ef309 Compare August 6, 2019 18:57

urso force-pushed the feature-new-registry-file branch from 569f2f9 to 4027ecf Compare September 11, 2019 15:46

urso force-pushed the filebeat-new-registry branch 2 times, most recently from 8183bcd to 75b470e Compare September 19, 2019 00:48

urso force-pushed the feature-new-registry-file branch from d5faecf to 03bf7b9 Compare October 15, 2019 22:42

kvch self-requested a review November 11, 2019 08:21

kvch reviewed Nov 11, 2019

View reviewed changes

libbeat/registry/registry.go Outdated Show resolved Hide resolved

urso added the Team:Beats label Nov 14, 2019

urso force-pushed the filebeat-new-registry branch from 75b470e to 870239c Compare November 21, 2019 01:06

urso force-pushed the feature-new-registry-file branch from ef8c2be to 40bed88 Compare November 21, 2019 13:45

urso force-pushed the filebeat-new-registry branch from 870239c to 285ab8d Compare November 21, 2019 13:48

urso mentioned this pull request Nov 21, 2019

[WIP] Filebeat input v2 #14229

Closed

urso added the Project:Filebeat-Input-v2 label Nov 22, 2019

This was referenced Dec 17, 2019

Journalbeat #8323

Closed

Refactor how we write support file to disk (Registry, Keystore) #5755

Closed

urso mentioned this pull request Jan 3, 2020

Filebeat input v2 API #15324

Closed

27 tasks

urso force-pushed the feature-new-registry-file branch from f8cbeb2 to dc050b0 Compare January 16, 2020 21:19

urso force-pushed the filebeat-new-registry branch from 5a8c7e4 to b5219e1 Compare January 16, 2020 21:19

urso added [zube]: Inbox [zube]: In Progress and removed [zube]: Inbox labels Feb 4, 2020

urso force-pushed the filebeat-new-registry branch from b5219e1 to 76fec47 Compare February 10, 2020 13:59

kvch mentioned this pull request Feb 13, 2020

filebeat (practically) hangs after restart on machine with a lot of logs #16076

Open

urso force-pushed the filebeat-new-registry branch 3 times, most recently from 65b125f to 0a47376 Compare March 3, 2020 19:56

andresrc added Team:Integrations Label for the Integrations team and removed Team:Beats labels Mar 6, 2020

urso force-pushed the feature-new-registry-file branch from 19757f0 to fb3b053 Compare March 27, 2020 16:17

urso force-pushed the filebeat-new-registry branch from 0a47376 to 5d37a2f Compare April 1, 2020 18:38

urso requested a review from kvch April 2, 2020 14:13

kvch reviewed Apr 2, 2020

View reviewed changes

libbeat/registry/registry.go Outdated Show resolved Hide resolved

kvch reviewed Apr 2, 2020

View reviewed changes

filebeat/registrar/migrate.go Outdated Show resolved Hide resolved

kvch approved these changes Apr 2, 2020

View reviewed changes

urso force-pushed the filebeat-new-registry branch from b9eff45 to f24f242 Compare April 9, 2020 16:28

urso added 7 commits May 4, 2020 20:13

Init filebeat + new registry file

44937a3

no long running transaction

995453b

Registry file becomes a shared resource. As a long running write transaction can block others from making progress, we want a more short lived transaction.

Update migration procedure to re-serialize input

c587f08

fix import path

8c74c48

Separate migration from registrar init in Filebeat

24f74ea

Fix test build

ca4cfb7

review

750f462

urso force-pushed the filebeat-new-registry branch from f24f242 to 750f462 Compare May 4, 2020 18:14

urso closed this Jun 16, 2020

zube bot added [zube]: Done and removed [zube]: In Progress labels Jun 16, 2020

andresrc removed the [zube]: Done label Jun 22, 2020

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Filebeat new registry#12908

Filebeat new registry#12908
urso wants to merge 7 commits intoelastic:feature-new-registry-filefrom
urso:filebeat-new-registry

urso commented Jul 15, 2019 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

ph commented Jul 25, 2019

Uh oh!

Uh oh!

Uh oh!

kvch Apr 2, 2020

Uh oh!

urso Apr 3, 2020

Uh oh!

Uh oh!

elasticmachine commented May 4, 2020

Build stats

Test stats 🧪

Uh oh!

elasticmachine commented Jun 15, 2020

Build stats

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

urso commented Jul 15, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

ph commented Jul 25, 2019

Uh oh!

Uh oh!

Uh oh!

kvch Apr 2, 2020

Choose a reason for hiding this comment

Uh oh!

urso Apr 3, 2020

Choose a reason for hiding this comment

Uh oh!

Uh oh!

elasticmachine commented May 4, 2020

💔 Build Failed

Build stats

Test stats 🧪

Test errors

Steps errors

Log output

Uh oh!

elasticmachine commented Jun 15, 2020

💔 Build Failed

Build stats

Steps errors

Log output

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

urso commented Jul 15, 2019 •

edited

Loading