Skip to content

Cherry-pick #20775 to 7.x: Add a persistent cache for cloudfoundry metadata based on badger#21551

Merged
jsoriano merged 2 commits intoelastic:7.xfrom
jsoriano:backport_20775_7.x
Oct 6, 2020
Merged

Cherry-pick #20775 to 7.x: Add a persistent cache for cloudfoundry metadata based on badger#21551
jsoriano merged 2 commits intoelastic:7.xfrom
jsoriano:backport_20775_7.x

Conversation

@jsoriano
Copy link
Copy Markdown
Member

@jsoriano jsoriano commented Oct 6, 2020 •
edited by zube bot
Loading

Cherry-pick of PR #20775 to 7.x branch. Original message:

What does this PR do?

Add a persistent cache on disk for Cloudfoundry metadata, based on badger.

Why is it important?

Improve restart of beats when monitoring very big Cloudfoundry deployments.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

Author's Checklist

  • Look for some way to avoid so much json unmarshalling.
  • Cache should be closed at some moment (to be continued in Fix leaks with metadata processors #16349).
  • Add settings to make it optional?
  • Use different store names for different Cloudfoundry deployments, to support monitoring multiple clusters from the same Beat (maybe not needed because it is difficult to have uuid collisions).
  • (To be done if requested by reviewers) When ready, separate in two PRs, one for the persistent cache, and another one for the change in add_cloudfoundry_metadata.

How to test this PR locally

  • Use add_cloudfoundry_metadata with Filebeat or Metricbeat.
  • Restart the Beat.
  • The Beat should reuse information on disk to enrich events without querying cloudfoundry API.

Related issues

@jsoriano
Add a persistent cache for cloudfoundry metadata based on badger (ela…
f331a2b 
…stic#20775)

Cache on disk is used by add_cloudfoundry_metadata.
Cache is written into the beats data directory. Objects in cache
are serialized using CBOR encoding.
Badger DB is added as dependency.

(cherry picked from commit 76905a2)
@jsoriano jsoriano added [zube]: In Review backport Team:Platforms Label for the Integrations - Platforms team Team:Services (Deprecated) Label for the former Integrations-Services team labels Oct 6, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 6, 2020

Pinging @elastic/integrations-platforms (Team:Platforms)

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 6, 2020

Pinging @elastic/integrations-services (Team:Services)

@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label and removed needs_team Indicates that the issue/PR needs a Team:* label labels Oct 6, 2020
@botelastic
Copy link
Copy Markdown

botelastic bot commented Oct 6, 2020

This pull request doesn't have a Team:<team> label.

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Oct 6, 2020 •
edited by jenkins-beats-ci bot
Loading

💔 Tests Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #21551 updated]

  • Start Time: 2020-10-06T09:59:11.345+0000

  • Duration: 110 min 6 sec

Test stats 🧪

Test Results
Failed 331
Passed 15953
Skipped 1364
Total 17648

Test errors

Expand to view the tests failures

  • Name: Build&Test / filebeat-build / test_fileset_file_001_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.556
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 257, 'destination.address': '127.0.0.1', 'destination.port': 80, 'destination.ip': '127.0.0.1', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.path': '/', 'url.query': 'q=100', 'input.type': 'log', 'iis.access.sub_status': 0, 'iis.access.win32_status': 0, '@timestamp': '2018-01-01T08:09:10.000Z', 'related.ip': ['85.181.35.98', '127.0.0.1'], 'service.type': 'iis', 'http.request.method': 'GET', 'http.response.status_code': 200, 'event.duration': 123000000, 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64; rv:57.0) Gecko/20100101 Firefox/57.0', 'user_agent.os.name': 'Windows', 'user_agent.os.version': '7', 'user_agent.os.full': 'Windows 7', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Other', 'user_agent.version': '57.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_004_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.168
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 286, 'destination.address': '127.0.0.1', 'destination.port': 80, 'destination.ip': '127.0.0.1', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.port': 2780, 'source.ip': '85.181.35.98', 'fileset.name': 'error', 'url.original': '/ThisIsMyUrl.htm', 'input.type': 'log', 'iis.error.reason_phrase': 'Hostname', '@timestamp': '2018-01-01T09:10:11.000Z', 'related.ip': ['85.181.35.98', '127.0.0.1'], 'service.type': 'iis', 'http.request.method': 'GET', 'http.response.status_code': 400, 'http.version': '1.1', 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.error', 'event.outcome': 'failure'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_006_iis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.412
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'log.offset': 0, 'destination.address': '192.168.101.101', 'destination.port': 443, 'destination.ip': '192.168.101.101', 'source.geo.continent_name': 'North America', 'source.geo.country_iso_code': 'US', 'source.geo.country_name': 'United States', 'source.geo.location.lon': -97.822, 'source.geo.location.lat': 37.751, 'source.address': '149.42.83.135', 'source.port': 12345, 'source.ip': '149.42.83.135', 'fileset.name': 'error', 'url.original': '12.2.1', 'input.type': 'log', 'iis.error.reason_phrase': 'URL', '@timestamp': '2018-05-05T05:05:55.000Z', 'related.ip': ['149.42.83.135', '192.168.101.101'], 'service.type': 'iis', 'http.request.method': 't3', 'http.response.status_code': 400, 'http.version': '0.9', 'event.kind': 'event', 'event.module': 'iis', 'event.category': ['web', 'network'], 'event.type': ['connection'], 'event.dataset': 'iis.error', 'event.outcome': 'failure'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_029_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.249
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['10.0.0.2', '10.0.0.1', '85.181.35.98'], 'log.offset': 341, 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.original': '/ocelot', 'input.type': 'log', '@timestamp': '2016-12-07T10:05:07.000Z', 'related.ip': ['85.181.35.98'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 571, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:49.0) Gecko/20100101 Firefox/49.0', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12', 'user_agent.os.full': 'Mac OS X 10.12', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Mac', 'user_agent.version': '49.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_030_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.48
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['77.179.66.156'], 'log.offset': 0, 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-RP', 'source.geo.city_name': 'Germersheim', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Rheinland-Pfalz', 'source.geo.location.lon': 8.3639, 'source.geo.location.lat': 49.2231, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '77.179.66.156', 'source.ip': '77.179.66.156', 'fileset.name': 'access', 'url.original': '/', 'input.type': 'log', '@timestamp': '2016-10-25T12:49:33.000Z', 'related.ip': ['77.179.66.156'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 612, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/54.0.2840.59 Safari/537.36', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12.0', 'user_agent.os.full': 'Mac OS X 10.12.0', 'user_agent.name': 'Chrome', 'user_agent.device.name': 'Mac', 'user_agent.version': '54.0.2840.59'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_031_nginx – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 2.125
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['source.geo.country_name']]}, full object: {'nginx.access.remote_ip_list': ['10.0.0.2', '10.0.0.1', '85.181.35.98'], 'log.offset': 365, 'destination.domain': 'example.com', 'source.geo.continent_name': 'Europe', 'source.geo.region_iso_code': 'DE-BE', 'source.geo.city_name': 'Berlin', 'source.geo.country_iso_code': 'DE', 'source.geo.country_name': 'Germany', 'source.geo.region_name': 'Land Berlin', 'source.geo.location.lon': 13.4531, 'source.geo.location.lat': 52.4473, 'source.as.number': 6805, 'source.as.organization.name': 'Telefonica Germany', 'source.address': '85.181.35.98', 'source.ip': '85.181.35.98', 'fileset.name': 'access', 'url.original': '/ocelot', 'input.type': 'log', '@timestamp': '2016-12-07T10:05:07.000Z', 'related.ip': ['85.181.35.98'], 'service.type': 'nginx', 'http.request.method': 'GET', 'http.response.status_code': 200, 'http.response.body.bytes': 571, 'http.version': '1.1', 'event.timezone': '-02:00', 'event.kind': 'event', 'event.module': 'nginx', 'event.category': ['web'], 'event.type': ['access'], 'event.dataset': 'nginx.access', 'event.outcome': 'success', 'user_agent.original': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:49.0) Gecko/20100101 Firefox/49.0', 'user_agent.os.name': 'Mac OS X', 'user_agent.os.version': '10.12', 'user_agent.os.full': 'Mac OS X 10.12', 'user_agent.name': 'Firefox', 'user_agent.device.name': 'Mac', 'user_agent.version': '49.0.'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['source.geo.country_name']]})

  • Name: Build&Test / filebeat-build / test_fileset_file_034_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 90.003
    • Error Details: Failed: Timeout >90.0s

  • Name: Build&Test / filebeat-build / test_fileset_file_035_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.19
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_036_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.17
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_037_osquery – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.218
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_038_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.179
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_039_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.214
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_040_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.163
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_041_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.147
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_042_redis – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.186
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_043_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.16
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_044_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.149
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_045_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.156
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_046_haproxy – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.155
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_047_nats – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.153
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_048_santa – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.209
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_049_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.203
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_050_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.106
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_051_icinga – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.121
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_052_traefik – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.153
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_053_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.156
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_054_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.112
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_055_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.119
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_056_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.123
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_057_logstash – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.108
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_058_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.165
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_059_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.123
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_060_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.13
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_061_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.099
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_062_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.13
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_063_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.168
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_064_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.142
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_065_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.154
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_066_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.131
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_067_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.114
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_068_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.116
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_069_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.232
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_070_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.158
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_071_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.18
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_072_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.117
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_073_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.129
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_074_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.143
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_075_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.151
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_076_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.108
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_077_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.126
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_078_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.118
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_079_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.134
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_080_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.142
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_081_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.125
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_082_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.136
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_083_elasticsearch – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.124
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_084_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.153
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_085_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.129
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_086_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.18
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_087_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.134
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_088_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.122
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_089_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.14
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_090_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.134
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_091_apache – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.19
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_092_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.199
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_093_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.147
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_094_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.13
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_095_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.121
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_096_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.228
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_097_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.114
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_098_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.124
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_099_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.164
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_100_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.129
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_101_postgresql – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.14
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_102_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.093
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_103_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.133
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_104_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.084
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_105_auditd – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.099
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_106_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.154
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_107_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.102
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_108_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.15
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_109_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.122
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_110_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.125
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_111_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.087
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_112_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.115
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_113_system – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.087
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_114_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.091
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_115_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.11
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_116_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.117
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_117_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.132
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_118_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.156
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_119_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.104
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_120_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.103
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_fileset_file_121_kafka – filebeat.tests.system.test_modules.Test

    • Age: 1
    • Duration: 10.153
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / filebeat-build / test_stdin_eof – filebeat.tests.system.test_stdin.Test

    • Age: 1
    • Duration: 10.147
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_000_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 34.666
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['destination.geo.country_name']]}, full object: {'kubernetes.container.name': 'ambassador', 'kubernetes.node.name': 'minikube', 'kubernetes.pod.uid': 'e57d545e-2a9d-11e9-995f-08002730e0dc', 'kubernetes.pod.name': 'ambassador-76c58d9df4-jwhsg', 'kubernetes.namespace': 'default', 'kubernetes.labels.service': 'ambassador', 'log.offset': 0, 'destination.geo.continent_name': 'North America', 'destination.geo.region_iso_code': 'US-VA', 'destination.geo.city_name': 'Ashburn', 'destination.geo.country_iso_code': 'US', 'destination.geo.country_name': 'United States', 'destination.geo.region_name': 'Virginia', 'destination.geo.location.lon': -77.4728, 'destination.geo.location.lat': 39.0481, 'destination.as.number': 14618, 'destination.as.organization.name': 'Amazon.com, Inc.', 'destination.address': '52.71.234.219', 'destination.port': 80, 'destination.ip': '52.71.234.219', 'source.address': '172.17.0.3', 'source.ip': '172.17.0.3', 'network.protocol': 'http', 'related.ip': ['172.17.0.3', '52.71.234.219'], 'event.duration': 180000000, 'event.kind': 'event', 'event.module': 'envoyproxy', 'event.type': ['connection', 'protocol'], 'event.category': ['network'], 'event.dataset': 'envoyproxy.log', 'event.outcome': ['success'], 'user_agent.original': 'curl/7.59.0', 'user_agent.name': 'curl', 'user_agent.device.name': 'Other', 'user_agent.version': '7.59.0', 'fileset.name': 'log', 'message': 'ACCESS [2019-04-10T03:49:34.451Z] "GET /httpbin/status/501 HTTP/1.1" 501 - 0 0 180 179 "172.17.0.3" "curl/7.59.0" "413bf460-bd56-4515-ada4-2a69c5e78e54" "httpbin.org" "52.71.234.219:80"', 'envoyproxy.log_type': 'ACCESS', 'envoyproxy.authority': 'httpbin.org', 'envoyproxy.upstream_service_time': 179000000, 'envoyproxy.request_id': '413bf460-bd56-4515-ada4-2a69c5e78e54', 'envoyproxy.proxy_type': 'http', 'url.path': '/httpbin/status/501', 'url.domain': 'httpbin.org', 'tags': ['envoyproxy'], 'input.type': 'log', '@timestamp': '2019-04-10T03:49:34.451Z', 'service.type': 'envoyproxy', 'http.request.method': 'GET', 'http.request.body.bytes': 0, 'http.response.status_code': 501, 'http.response.body.bytes': 0, 'http.version': '1.1'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['destination.geo.country_name']]})

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_001_envoyproxy – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 4.629
    • Error Details: AssertionError: The following expected object doesn't match: Diff: {'dictionary_item_added': [root['destination.geo.country_name']]}, full object: {'log.offset': 399, 'destination.geo.continent_name': 'North America', 'destination.geo.country_iso_code': 'US', 'destination.geo.country_name': 'United States', 'destination.geo.location.lon': -97.822, 'destination.geo.location.lat': 37.751, 'destination.as.number': 54113, 'destination.as.organization.name': 'Fastly', 'destination.address': '151.101.66.217', 'destination.port': 80, 'destination.ip': '151.101.66.217', 'source.address': '172.17.0.3', 'source.ip': '172.17.0.3', 'network.protocol': 'http', 'related.ip': ['172.17.0.3', '151.101.66.217'], 'event.duration': 41000000, 'event.kind': 'event', 'event.module': 'envoyproxy', 'event.type': ['connection', 'protocol'], 'event.category': ['network'], 'event.dataset': 'envoyproxy.log', 'event.outcome': ['success'], 'user_agent.original': 'curl/7.59.0', 'user_agent.name': 'curl', 'user_agent.device.name': 'Other', 'user_agent.version': '7.59.0', 'fileset.name': 'log', 'message': '[2019-04-11T00:51:07.980Z] "GET /elastic/ HTTP/1.1" 301 - 0 0 41 39 "172.17.0.3" "curl/7.59.0" "078d1daa-b786-4d6d-85a5-7e4366adaa19" "www.elastic.co" "151.101.66.217:80"', 'envoyproxy.log_type': 'ACCESS', 'envoyproxy.authority': 'www.elastic.co', 'envoyproxy.upstream_service_time': 39000000, 'envoyproxy.request_id': '078d1daa-b786-4d6d-85a5-7e4366adaa19', 'envoyproxy.proxy_type': 'http', 'url.path': '/elastic/', 'url.domain': 'www.elastic.co', 'tags': ['envoyproxy'], 'input.type': 'log', '@timestamp': '2019-04-11T00:51:07.980Z', 'service.type': 'envoyproxy', 'http.request.method': 'GET', 'http.request.body.bytes': 0, 'http.response.status_code': 301, 'http.response.body.bytes': 0, 'http.version': '1.1'} assert 1 == 0 + where 1 = len({'dictionary_item_added': [root['destination.geo.country_name']]})

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_002_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 90.004
    • Error Details: Failed: Timeout >90.0s

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_003_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 10.208
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

  • Name: Build&Test / x-pack/filebeat-build / test_fileset_file_004_cisco – x-pack.filebeat.tests.system.test_xpack_modules.XPackTest

    • Age: 1
    • Duration: 10.208
    • Error Details: beat.beat.TimeoutError: Timeout waiting for 'cond' to be true. Waited 10 seconds.

Steps errors

Expand to view the steps failures

  • Name: mage build test

    • Description: mage build test

    • Duration: 39 min 3 sec

    • Start Time: 2020-10-06T10:35:32.837+0000

    • log

  • Name: mage build test

    • Description: mage build test

    • Duration: 58 min 45 sec

    • Start Time: 2020-10-06T10:35:33.570+0000

    • log

Log output

Expand to view the last 100 lines of log output 

[2020-10-06T11:47:12.006Z]  runc:
[2020-10-06T11:47:12.006Z]   Version:          1.0.0-rc10
[2020-10-06T11:47:12.006Z]   GitCommit:        dc9208a3303feef5b3839f4323d9beb36df0a9dd
[2020-10-06T11:47:12.006Z]  docker-init:
[2020-10-06T11:47:12.006Z]   Version:          0.18.0
[2020-10-06T11:47:12.006Z]   GitCommit:        fec3683
[2020-10-06T11:47:20.115Z] [INFO] unstashV2: JOB_GCS_BUCKET is set. bucket param got precedency instead.
[2020-10-06T11:47:20.132Z] [INFO] unstashV2: JOB_GCS_CREDENTIALS is set. credentialsId param got precedency instead.
[2020-10-06T11:47:20.230Z] [Google Cloud Storage Plugin] Found 1 files to download from pattern: gs://beats-ci-temp/Beats/beats/PR-21551-2/source/source.tgz
[2020-10-06T11:47:20.274Z] [Google Cloud Storage Plugin] Downloading: Beats/beats/PR-21551-2/source/source.tgz to local path: /var/lib/jenkins/workspace/Beats_beats_PR-21551/source.tgz
[2020-10-06T11:47:35.176Z] + tar --version
[2020-10-06T11:47:35.479Z] + tar -xpf source.tgz
[2020-10-06T11:47:48.055Z] + rm source.tgz
[2020-10-06T11:47:48.165Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats
[2020-10-06T11:47:48.175Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/lint-1601980300824
[2020-10-06T11:47:48.206Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/libbeat-stress-tests-1601980539638
[2020-10-06T11:47:48.243Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/winlogbeat-crosscompile-1601980613431
[2020-10-06T11:47:48.274Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/auditbeat-crosscompile-1601980642424
[2020-10-06T11:47:48.305Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-elastic-agent-build-1601980677467
[2020-10-06T11:47:48.339Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-dockerlogbeat-build-1601980688664
[2020-10-06T11:47:48.371Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/journalbeat-unitTest-1601980712524
[2020-10-06T11:47:48.410Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/libbeat-crosscompile-1601980802988
[2020-10-06T11:47:48.441Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-functionbeat-build-1601980815759
[2020-10-06T11:47:48.476Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/packetbeat-build-1601980910803
[2020-10-06T11:47:48.510Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-elastic-agent-windows-windows-2019-1601981021709
[2020-10-06T11:47:48.547Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/auditbeat-windows-windows-2019-1601981046955
[2020-10-06T11:47:48.580Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-unitTest-1601981071692
[2020-10-06T11:47:48.616Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/heartbeat-build-1601981112657
[2020-10-06T11:47:48.716Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/auditbeat-build-1601981146043
[2020-10-06T11:47:48.751Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-crosscompile-1601981163266
[2020-10-06T11:47:48.782Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/heartbeat-windows-windows-2019-1601981177900
[2020-10-06T11:47:48.815Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/generator-metricbeat-test-1601981190104
[2020-10-06T11:47:48.849Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-auditbeat-windows-windows-2019-1601981221196
[2020-10-06T11:47:48.886Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/generator-beat-test-1601981225032
[2020-10-06T11:47:48.923Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-winlogbeat-build-windows-2019-1601981281490
[2020-10-06T11:47:48.957Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-auditbeat-build-1601981289640
[2020-10-06T11:47:48.991Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/filebeat-windows-windows-2019-1601981346119
[2020-10-06T11:47:49.026Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-libbeat-build-1601981350504
[2020-10-06T11:47:49.066Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-functionbeat-windows-windows-2019-1601981408644
[2020-10-06T11:47:49.101Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/packetbeat-windows-windows-2019-1601981417543
[2020-10-06T11:47:49.143Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-filebeat-windows-windows-2019-1601981434260
[2020-10-06T11:47:49.179Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/winlogbeat-windows-windows-2019-1601981530136
[2020-10-06T11:47:49.212Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-windows-windows-2019-1601981660189
[2020-10-06T11:47:49.249Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-windows-windows-2019-1601981674811
[2020-10-06T11:47:49.284Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-pythonIntegTest-1601982490156
[2020-10-06T11:47:49.323Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/libbeat-build-1601982520726
[2020-10-06T11:47:49.364Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-goIntegTest-1601982614457
[2020-10-06T11:47:49.408Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/filebeat-build-1601982883414
[2020-10-06T11:47:49.449Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-filebeat-build-1601984006403
[2020-10-06T11:47:49.492Z] Running in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618
[2020-10-06T11:47:49.837Z] + cat
[2020-10-06T11:47:49.837Z] + /usr/local/bin/runbld ./runbld-test-reports --job-name elastic+beats+pull-request
[2020-10-06T11:47:49.837Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-10-06T11:47:58.016Z] runbld>>> runbld started
[2020-10-06T11:47:58.016Z] runbld>>> 1.6.12/f45d832f2ba0aa2722ab4ec1fda8ad140f027f8b
[2020-10-06T11:47:58.964Z] runbld>>> The following profiles matched the job 'elastic+beats+pull-request' in order of occurrence in the config (last value wins).
[2020-10-06T11:47:58.964Z] runbld>>> Matches in the system config:
[2020-10-06T11:47:58.964Z] runbld>>> - Matched ^elastic\+beats
[2020-10-06T11:47:58.964Z] runbld>>> - Matched ^elastic\+beats\+pull-request
[2020-10-06T11:48:00.353Z] runbld>>> Debug logging enabled.
[2020-10-06T11:48:00.615Z] runbld>>> Storing result
[2020-10-06T11:48:00.615Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-10-06T11:48:00.615Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201006114800-2EA184D1
[2020-10-06T11:48:00.615Z] runbld>>> Adding system facts.
[2020-10-06T11:48:02.012Z] runbld>>> Adding vcs info for the latest commit:  60bfe3e3d9bbebaab68828d462769856c6d0345a
[2020-10-06T11:48:02.013Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-10-06T11:48:02.013Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-10-06T11:48:02.276Z] Processing JUnit reports with runbld...
[2020-10-06T11:48:02.276Z] + echo 'Processing JUnit reports with runbld...'
[2020-10-06T11:48:02.540Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-10-06T11:48:02.540Z] runbld>>> DURATION: 47ms
[2020-10-06T11:48:02.540Z] runbld>>> STDOUT: 40 bytes
[2020-10-06T11:48:02.540Z] runbld>>> STDERR: 49 bytes
[2020-10-06T11:48:02.540Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-10-06T11:48:02.540Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats_PR-21551
[2020-10-06T11:48:03.490Z] runbld>>> Storing build metadata: 
[2020-10-06T11:48:03.490Z] runbld>>> Adding test report.
[2020-10-06T11:48:03.490Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats
[2020-10-06T11:48:04.443Z] runbld>>> Found 123 test output files
[2020-10-06T11:48:05.401Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618/x-pack/metricbeat/build/TEST-go-integration-openmetrics.xml
[2020-10-06T11:48:05.401Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618/x-pack/metricbeat/build/TEST-go-integration-istio.xml
[2020-10-06T11:48:05.401Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618/x-pack/metricbeat/build/TEST-go-integration-activemq.xml
[2020-10-06T11:48:05.401Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618/x-pack/metricbeat/build/TEST-go-integration-iis.xml
[2020-10-06T11:48:05.663Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/x-pack-metricbeat-build-1601984553618/x-pack/metricbeat/build/TEST-go-integration-tomcat.xml
[2020-10-06T11:48:06.611Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-goIntegTest-1601982614457/metricbeat/build/TEST-go-integration-graphite.xml
[2020-10-06T11:48:06.611Z] runbld>>> No testsuite node found in /var/lib/jenkins/workspace/Beats_beats_PR-21551/src/github.com/elastic/beats/metricbeat-goIntegTest-1601982614457/metricbeat/build/TEST-go-integration-windows.xml
[2020-10-06T11:48:08.003Z] runbld>>> Test output logs contained: Errors: 0 Failures: 331 Tests: 17648 Skipped: 1088
[2020-10-06T11:48:08.003Z] runbld>>> Storing result
[2020-10-06T11:48:08.003Z] runbld>>> FAILURES: 331
[2020-10-06T11:49:15.782Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-10-06T11:49:15.782Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1597739501209/t/20201006114800-2EA184D1
[2020-10-06T11:49:15.782Z] runbld>>> Email notification disabled by environment variable.
[2020-10-06T11:49:15.782Z] runbld>>> Slack notification disabled by environment variable.
[2020-10-06T11:49:16.485Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats_PR-21551
[2020-10-06T11:49:16.518Z] [INFO] getVaultSecret: Getting secrets
[2020-10-06T11:49:16.608Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-10-06T11:49:17.208Z] + chmod 755 generate-build-data.sh
[2020-10-06T11:49:17.208Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21551/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21551/runs/2 FAILURE 6605601
[2020-10-06T11:49:17.208Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21551/runs/2/steps/?limit=10000 -o steps-info.json
[2020-10-06T11:49:21.331Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats/PR-21551/runs/2/tests/?status=FAILED -o tests-errors.json

@jsoriano
Copy link
Copy Markdown
Member Author

jsoriano commented Oct 6, 2020

Failing filebeat tests will be fixed by #21526

@masci masci mentioned this pull request Oct 6, 2020
Closed
@jsoriano jsoriano merged commit e378faf into elastic:7.x Oct 6, 2020
@jsoriano jsoriano deleted the backport_20775_7.x branch October 6, 2020 12:23
@zube zube bot removed the [zube]: Done label Jan 5, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ChrsMark ChrsMark ChrsMark approved these changes

Assignees

No one assigned

Labels

backport Team:Platforms Label for the Integrations - Platforms team Team:Services (Deprecated) Label for the former Integrations-Services team

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@jsoriano @elasticmachine @ChrsMark