Skip to content

Cherry-pick #21481 to 7.x: Add filestream input reader#21538

Merged
kvch merged 1 commit intoelastic:7.xfrom
kvch:backport_21481_7.x
Oct 6, 2020
Merged

Cherry-pick #21481 to 7.x: Add filestream input reader#21538
kvch merged 1 commit intoelastic:7.xfrom
kvch:backport_21481_7.x

Conversation

@kvch
Copy link
Copy Markdown
Contributor

@kvch kvch commented Oct 5, 2020 •
edited by zube bot
Loading

Cherry-pick of PR #21481 to 7.x branch. Original message:

What does this PR do?

This PR adds the event reader and publisher functionality. This is mostly the refactoring of Harvester from filebeat/input/log. Two things are missing: metrics and special readers e.g. multiline.

Why is it important?

New step.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
    - [ ] I have made corresponding changes to the documentation
    - [ ] I have made corresponding change to the default configuration files
    - [ ] I have added tests that prove my fix is effective or that my feature works
    - [ ] I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Related issues

@kvch kvch added [zube]: In Review backport Team:Services (Deprecated) Label for the former Integrations-Services team labels Oct 5, 2020
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Oct 5, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 5, 2020

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Oct 5, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 5, 2020 •
edited by jenkins-beats-ci bot
Loading

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21538 updated]

  • Start Time: 2020-10-05T16:47:39.588+0000

  • Duration: 94 min 53 sec

Test stats 🧪

Test Results
Failed 328
Passed 4075
Skipped 570
Total 4973

Test errors

Expand to view the tests failures

  • Name: Build&Test / filebeat-windows-windows-2019 / test_reload_same_config – filebeat.tests.system.test_reload_inputs.Test

    • Age: 1
    • Duration: 16.36
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 15 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_001_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.966
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 257, 'destination.address': '127.0.0.1', 'destination.port': 80, 'destination.ip': '127.0.0.1', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.path': '/', 'url.query': 'q=100', 'input.type': 'log', 'iis.access.sub_status': 0, 'iis.access.win32_status': 0, '@timestamp': '2018-01-01T08:09:10.000Z', 'related.ip': ['85.181.35.98', '127.0.0.1'], 'service.type': 'iis', 'http.request.method': 'GET', 'http.response.status_code': 200, 'event.duration': 123000000, 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0', 'user_agent.os.name': 'Windows', 'user_agent.os.version': '7', 'user_agent.os.full': 'Windows 7', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Other', 'user_agent.version': '57.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_004_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.19
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 286, 'destination.address': '127.0.0.1', 'destination.port': 80, 'destination.ip': '127.0.0.1', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.port': 2780, 'source.ip': '85.181.35.98', 'fileset.name': 'error', 'url.original': '/ThisIsMyUrl.htm', 'input.type': 'log', 'iis.error.reason_phrase': 'Hostname', '@timestamp': '2018-01-01T09:10:11.000Z', 'related.ip': ['85.181.35.98', '127.0.0.1'], 'service.type': 'iis', 'http.request.method': 'GET', 'http.response.status_code': 400, 'http.version': '1.1', 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.error', 'event.outcome': 'failure'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_006_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.196
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 0, 'destination.address': '192.168.101.101', 'destination.port': 443, 'destination.ip': '192.168.101.101', 'source.geo.continent_name': 'North America', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.location.lon': -97.822, 'source.geo.location.lat': 37.751, 'source.address': '149.42.83.135', 'source.port': 12345, 'source.ip': '149.42.83.135', 'fileset.name': 'error', 'url.original': '12.2.1', 'input.type': 'log', 'iis.error.reason_phrase': 'URL', '@timestamp': '2018-05-05T05:05:55.000Z', 'related.ip': ['149.42.83.135', '192.168.101.101'], 'service.type': 'iis', 'http.request.method': 't3', 'http.response.status_code': 400, 'http.version': '0.9', 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.error', 'event.outcome': 'failure'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_029_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.568
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['10.0.0.2', '10.0.0.1', '85.181.35.98'], 'log.offset': 341, 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.original': '/ocelot', 'input.type': 'log', '@timestamp': '2016-12-07T10:05:07.000Z', 'related.ip': ['85.181.35.98'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 571, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:49.0) Gecko/20100101 Firefox/49.0', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12', 'user_agent.os.full': 'Mac OS X 10.12', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Mac', 'user_agent.version': '49.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_030_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.524
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['77.179.66.156'], 'log.offset': 0, 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-RP', 'source.geo.city_name': 'Germersheim', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Rheinland-Pfalz', 'source.geo.location.lon': 8.3639, 'source.geo.location.lat': 49.2231, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '77.179.66.156', 'source.ip': '77.179.66.156', 'fileset.name': 'access', 'url.original': '/', 'input.type': 'log', '@timestamp': '2016-10-25T12:49:33.000Z', 'related.ip': ['77.179.66.156'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 612, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.59 Safari/537.36', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12.0', 'user_agent.os.full': 'Mac OS X 10.12.0', 'user_agent.name': 'Chrome', 'user_agent.device.name': 'Mac', 'user_agent.version': '54.0.2840.59'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_031_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 1.888
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['10.0.0.2', '10.0.0.1', '85.181.35.98'], 'log.offset': 365, 'destination.domain': 'example.com', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.original': '/ocelot', 'input.type': 'log', '@timestamp': '2016-12-07T10:05:07.000Z', 'related.ip': ['85.181.35.98'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 571, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:49.0) Gecko/20100101 Firefox/49.0', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12', 'user_agent.os.full': 'Mac OS X 10.12', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Mac', 'user_agent.version': '49.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_034_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 90.003
    • Error Details: Failed: Timeout >90.0s

  • Name: Build&Test / filebeat-build / test_fileset_file_035_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.171
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_036_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.172
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_037_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.214
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_038_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.155
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_039_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.172
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_040_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.164
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_041_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.208
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_042_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.221
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_043_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.2
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_044_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.199
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_045_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.164
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_046_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.133
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_047_nats – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.142
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_048_santa – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.166
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_049_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.132
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_050_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.177
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_051_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.136
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_052_traefik – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.136
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_053_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.157
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_054_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.138
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_055_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.177
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_056_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.136
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_057_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.199
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_058_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.183
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_059_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.218
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_060_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.204
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_061_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.161
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_062_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.127
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_063_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.162
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_064_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.193
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_065_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.177
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_066_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.138
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_067_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.104
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_068_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.13
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_069_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.187
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_070_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.126
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_071_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.111
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_072_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.116
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_073_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.159
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_074_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.113
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_075_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.106
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_076_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.132
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_077_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.089
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_078_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.102
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_079_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.101
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_080_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.102
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_081_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.11
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_082_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.104
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_083_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.098
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_084_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.146
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_085_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.165
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_086_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.125
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_087_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.159
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_088_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.178
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_089_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.104
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_090_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.155
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_091_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.14
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_092_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.135
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_093_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.15
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_094_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.11
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_095_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.129
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_096_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.137
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_097_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.169
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_098_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.165
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_099_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.233
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_100_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.206
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_101_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.141
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_102_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.178
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_103_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.141
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_104_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.179
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_105_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.22
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_106_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.093
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_107_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.103
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_108_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.105
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_109_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.097
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_110_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.089
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_111_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.085
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_112_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.157
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_113_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.098
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_114_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.114
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_115_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.216
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_116_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.123
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_117_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.101
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_118_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.092
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_119_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.099
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_120_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.165
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_121_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.136
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_stdin_eof – filebeat.tests.system.test_stdin.Test

    • Age: 1
    • Duration: 10.129
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_000_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 32.6
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['destination.geo.country_name']]}, full object: {'kubernetes.container.name': 'ambassador', 'kubernetes.node.name': 'minikube', 'kubernetes.pod.uid': 'e57d545e-2a9d-11e9-995f-08002730e0dc', 'kubernetes.pod.name': 'ambassador-76c58d9df4-jwhsg', 'kubernetes.namespace': 'default', 'kubernetes.labels.service': 'ambassador', 'log.offset': 0, 'destination.geo.continent_name': 'North America', 'destination.geo.region_iso_code': 'US-VA', 'destination.geo.city_name': 'Ashburn', 'destination.geo.country_iso_code': 'US', 'destination.geo.country_name': 'United States', 'destination.geo.region_name': 'Virginia', 'destination.geo.location.lon': -77.4728, 'destination.geo.location.lat': 39.0481, 'destination.as.number': 14618, 'destination.as.organization.name': 'Amazon.com, Inc.', 'destination.address': '52.71.234.219', 'destination.port': 80, 'destination.ip': '52.71.234.219', 'source.address': '172.17.0.3', 'source.ip': '172.17.0.3', 'network.protocol': 'http', 'related.ip': ['172.17.0.3', '52.71.234.219'], 'event.duration': 180000000, 'event.kind': 'event', 'event.module': 'envoyproxy', 'event.type': ['connection', 'protocol'], 'event.category': ['network'], 'event.dataset': 'envoyproxy.log', 'event.outcome': ['success'], 'user_agent.original': 'curl/7.59.0', 'user_agent.name': 'curl', 'user_agent.device.name': 'Other', 'user_agent.version': '7.59.0', 'fileset.name': 'log', 'message': 'ACCESS [2019-04-10T03:49:34.451Z] "GET /httpbin/status/501 HTTP/1.1" 501 - 0 0 180 179 "172.17.0.3" "curl/7.59.0" "413bf460-bd56-4515-ada4-2a69c5e78e54" "httpbin.org" "52.71.234.219:80"', 'envoyproxy.log_type': 'ACCESS', 'envoyproxy.authority': 'httpbin.org', 'envoyproxy.upstream_service_time': 179000000, 'envoyproxy.request_id': '413bf460-bd56-4515-ada4-2a69c5e78e54', 'envoyproxy.proxy_type': 'http', 'url.path': '/httpbin/status/501', 'url.domain': 'httpbin.org', 'tags': ['envoyproxy'], 'input.type': 'log', '@timestamp': '2019-04-10T03:49:34.451Z', 'service.type': 'envoyproxy', 'http.request.method': 'GET', 'http.request.body.bytes': 0, 'http.response.status_code': 501, 'http.response.body.bytes': 0, 'http.version': '1.1'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['destination.geo.country_name']]})

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_001_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 4.198
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['destination.geo.country_name']]}, full object: {'log.offset': 399, 'destination.geo.continent_name': 'North America', 'destination.geo.country_iso_code': 'US', 'destination.geo.country_name': 'United States', 'destination.geo.location.lon': -97.822, 'destination.geo.location.lat': 37.751, 'destination.as.number': 54113, 'destination.as.organization.name': 'Fastly', 'destination.address': '151.101.66.217', 'destination.port': 80, 'destination.ip': '151.101.66.217', 'source.address': '172.17.0.3', 'source.ip': '172.17.0.3', 'network.protocol': 'http', 'related.ip': ['172.17.0.3', '151.101.66.217'], 'event.duration': 41000000, 'event.kind': 'event', 'event.module': 'envoyproxy', 'event.type': ['connection', 'protocol'], 'event.category': ['network'], 'event.dataset': 'envoyproxy.log', 'event.outcome': ['success'], 'user_agent.original': 'curl/7.59.0', 'user_agent.name': 'curl', 'user_agent.device.name': 'Other', 'user_agent.version': '7.59.0', 'message': '[2019-04-11T00:51:07.980Z] "GET /elastic/ HTTP/1.1" 301 - 0 0 41 39 "172.17.0.3" "curl/7.59.0" "078d1daa-b786-4d6d-85a5-7e4366adaa19" "www.elastic.co" "151.101.66.217:80"', 'fileset.name': 'log', 'envoyproxy.log_type': 'ACCESS', 'envoyproxy.authority': 'www.elastic.co', 'envoyproxy.upstream_service_time': 39000000, 'envoyproxy.request_id': '078d1daa-b786-4d6d-85a5-7e4366adaa19', 'envoyproxy.proxy_type': 'http', 'url.path': '/elastic/', 'url.domain': 'www.elastic.co', 'tags': ['envoyproxy'], 'input.type': 'log', '@timestamp': '2019-04-11T00:51:07.980Z', 'service.type': 'envoyproxy', 'http.request.method': 'GET', 'http.request.body.bytes': 0, 'http.response.status_code': 301, 'http.response.body.bytes': 0, 'http.version': '1.1'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['destination.geo.country_name']]})

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_002_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 90.003
    • Error Details: Failed: Timeout >90.0s

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_003_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 10.27
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

Steps errors

Expand to view the steps failures

  • Name: mage build test

    • Description: mage build test

    • Duration: 39 min 11 sec

    • Start Time: 2020-10-05T17:12:54.793+0000

    • log

  • Name: mage build unitTest

    • Description: mage build unitTest

    • Duration: 9 min 0 sec

    • Start Time: 2020-10-05T17:16:36.798+0000

    • log

  • Name: mage build test

    • Description: mage build test

    • Duration: 58 min 44 sec

    • Start Time: 2020-10-05T17:21:04.708+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-10-05T18:18:50.518Z] c1e54eec4b57: Pull complete
[2020-10-05T18:18:50.518Z] Digest: sha256:b733d4a32c4da6a00a84df2ca32791bb03df95400243648d8c539e7b4cce329c
[2020-10-05T18:18:50.518Z] Status: Downloaded newer image for alpine:3.4
[2020-10-05T18:18:52.746Z] + python .ci/scripts/pre_archive_test.py
[2020-10-05T18:18:54.662Z] Copy ./x-pack/filebeat/build into build/x-pack/filebeat/build
[2020-10-05T18:18:54.674Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/build
[2020-10-05T18:18:54.686Z] WARNING: Unknown parameter(s) found for class type 'hudson.tasks.junit.pipeline.JUnitResultsStep': id,stashedTestReports
[2020-10-05T18:18:54.690Z] Recording test results
[2020-10-05T18:18:57.437Z] Stashed 4 file(s)
[2020-10-05T18:18:57.447Z] Archiving artifacts
[2020-10-05T18:18:58.256Z] + python .ci/scripts/search_system_tests.py
[2020-10-05T18:18:58.274Z] [INFO] system-tests='build/x-pack/filebeat/build/system-tests'. If no empty then let's create a tarball
[2020-10-05T18:18:58.601Z] + tar --version
[2020-10-05T18:18:58.948Z] + tar --exclude=x-pack-filebeat--system-tests-linux.tgz -czf x-pack-filebeat--system-tests-linux.tgz build/x-pack/filebeat/build/system-tests
[2020-10-05T18:19:20.981Z] Archiving artifacts
[2020-10-05T18:19:32.656Z] Client: Docker Engine - Community
[2020-10-05T18:19:32.656Z]  Version:           19.03.13
[2020-10-05T18:19:32.656Z]  API version:       1.40
[2020-10-05T18:19:32.656Z]  Go version:        go1.13.15
[2020-10-05T18:19:32.656Z]  Git commit:        4484c46d9d
[2020-10-05T18:19:32.656Z]  Built:             Wed Sep 16 17:02:36 2020
[2020-10-05T18:19:32.656Z]  OS/Arch:           linux/amd64
[2020-10-05T18:19:32.656Z]  Experimental:      false
[2020-10-05T18:19:32.656Z] 
[2020-10-05T18:19:32.656Z] Server: Docker Engine - Community
[2020-10-05T18:19:32.656Z]  Engine:
[2020-10-05T18:19:32.656Z]   Version:          19.03.13
[2020-10-05T18:19:32.656Z]   API version:      1.40 (minimum version 1.12)
[2020-10-05T18:19:32.656Z]   Go version:       go1.13.15
[2020-10-05T18:19:32.656Z]   Git commit:       4484c46d9d
[2020-10-05T18:19:32.656Z]   Built:            Wed Sep 16 17:01:06 2020
[2020-10-05T18:19:32.656Z]   OS/Arch:          linux/amd64
[2020-10-05T18:19:32.656Z]   Experimental:     false
[2020-10-05T18:19:32.656Z]  containerd:
[2020-10-05T18:19:32.656Z]   Version:          1.3.7
[2020-10-05T18:19:32.656Z]   GitCommit:        8fba4e9a7d01810a393d5d25a3621dc101981175
[2020-10-05T18:19:32.656Z]  runc:
[2020-10-05T18:19:32.656Z]   Version:          1.0.0-rc10
[2020-10-05T18:19:32.656Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-05T18:19:32.656Z]  docker-init:
[2020-10-05T18:19:32.656Z]   Version:          0.18.0
[2020-10-05T18:19:32.656Z]   GitCommit:        fec3683
[2020-10-05T18:19:39.433Z] Failed in branch x-pack/filebeat-build
[2020-10-05T18:19:44.543Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-05T18:19:44.556Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-05T18:19:44.617Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21538-2/source/source.tgz
[2020-10-05T18:19:44.637Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21538-2/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21538/source.tgz
[2020-10-05T18:19:55.213Z] + tar --version
[2020-10-05T18:19:55.518Z] + tar -xpf source.tgz
[2020-10-05T18:20:08.102Z] + rm source.tgz
[2020-10-05T18:20:08.164Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats
[2020-10-05T18:20:08.173Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/uncategorized-1601917754883
[2020-10-05T18:20:08.225Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/filebeat-windows-windows-2019-1601918749145
[2020-10-05T18:20:08.263Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1601918831079
[2020-10-05T18:20:08.300Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/filebeat-build-1601920332547
[2020-10-05T18:20:08.344Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats/x-pack-filebeat-build-1601921936808
[2020-10-05T18:20:08.687Z] + cat
[2020-10-05T18:20:08.687Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-05T18:20:08.687Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-05T18:20:15.293Z] runbld>>> runbld started
[2020-10-05T18:20:15.293Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-05T18:20:17.216Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-05T18:20:17.216Z] runbld>>> Matches in the system config:
[2020-10-05T18:20:17.216Z] runbld>>> - Matched ^elastic\+beats
[2020-10-05T18:20:17.216Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-05T18:20:18.164Z] runbld>>> Debug logging enabled.
[2020-10-05T18:20:18.164Z] runbld>>> Storing result
[2020-10-05T18:20:18.426Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-05T18:20:18.426Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201005182018-154D13F7
[2020-10-05T18:20:18.426Z] runbld>>> Adding system facts.
[2020-10-05T18:20:19.826Z] runbld>>> Adding vcs info for the latest commit:  1e16353fab13ecca2edd43ee564f418ac479cf99
[2020-10-05T18:20:19.826Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-05T18:20:19.826Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-05T18:20:19.826Z] Processing JUnit reports with runbld...
[2020-10-05T18:20:19.826Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-05T18:20:20.088Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-05T18:20:20.088Z] runbld>>> DURATION: 27ms
[2020-10-05T18:20:20.088Z] runbld>>> STDOUT: 40 bytes
[2020-10-05T18:20:20.088Z] runbld>>> STDERR: 49 bytes
[2020-10-05T18:20:20.088Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-05T18:20:20.088Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21538
[2020-10-05T18:20:21.033Z] runbld>>> Storing build metadata: 
[2020-10-05T18:20:21.033Z] runbld>>> Adding test report.
[2020-10-05T18:20:21.033Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21538/src/github.com/elastic/beats
[2020-10-05T18:20:21.982Z] runbld>>> Found 12 test output files
[2020-10-05T18:20:23.906Z] runbld>>> Test output logs contained: Errors: 0 Failures: 328 Tests: 4973 Skipped: 545
[2020-10-05T18:20:23.906Z] runbld>>> Storing result
[2020-10-05T18:20:23.906Z] runbld>>> FAILURES: 328
[2020-10-05T18:21:31.673Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-05T18:21:31.673Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201005182018-154D13F7
[2020-10-05T18:21:31.673Z] runbld>>> Email notification disabled by environment variable.
[2020-10-05T18:21:31.673Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-05T18:21:32.263Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21538
[2020-10-05T18:21:32.519Z] [INFO] getVaultSecret: Getting secrets
[2020-10-05T18:21:32.604Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-05T18:21:33.301Z] + chmod 755 generate-build-data.sh
[2020-10-05T18:21:33.301Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21538/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21538/runs/2 FAILURE 5633451
[2020-10-05T18:21:33.301Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21538/runs/2/steps/?limit=10000 -o steps-info.json
[2020-10-05T18:21:35.163Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21538/runs/2/tests/?status=FAILED -o tests-errors.json
[2020-10-05T18:21:35.714Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21538/runs/2/log/ -o pipeline-log.txt

@kvch
Add filestream input reader (elastic#21481)
1e16353 
This PR adds the event reader and publisher functionality. This is mostly the refactoring of `Harvester` from `filebeat/input/log`. Two things are missing: metrics and special readers e.g. `multiline`.

(cherry picked from commit 40b24dd)
@kvch kvch force-pushed the backport_21481_7.x branch from 33c737d to 1e16353 Compare October 5, 2020 16:46
@kvch
Copy link
Copy Markdown
Contributor Author

kvch commented Oct 6, 2020

Failing tests are unrelated.

@kvch kvch merged commit de395d1 into elastic:7.x Oct 6, 2020
@zube zube bot removed the [zube]: Done label Jan 4, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@faec faec faec approved these changes

Assignees

No one assigned

Labels

backport Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kvch @elasticmachine @faec