Skip to content

[APM] Add experimental support for Data Streams#89650

Merged
sorenlouv merged 7 commits intoelastic:masterfrom
sorenlouv:add-data-streams-indicies
Feb 11, 2021
Merged

[APM] Add experimental support for Data Streams#89650
sorenlouv merged 7 commits intoelastic:masterfrom
sorenlouv:add-data-streams-indicies

Conversation

@sorenlouv
Copy link
Copy Markdown
Contributor

@sorenlouv sorenlouv commented Jan 28, 2021 •
edited
Loading

Closes #87501

@sorenlouv sorenlouv requested a review from a team January 28, 2021 22:50
@botelastic botelastic bot added the Team:APM - DEPRECATED Use Team:obs-ux-infra_services. label Jan 28, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Jan 28, 2021

Pinging @elastic/apm-ui (Team:apm)

sorenlouv
sorenlouv commented Jan 28, 2021
View reviewed changes
@dgieselaar
Copy link
Copy Markdown
Contributor

dgieselaar commented Jan 29, 2021

What about:

  • the Kibana index pattern
  • the permissions of the kibana_system role (in the ES repo)
  • the permissions of the apm_user role (in the ES repo)
  • the ML job(s)
  • the SIEM rules
  • predefined rules in the API tests
  • documentation

We probably don't need to update them all. But I was a bit surprised by how many (hardcoded) references there are to apm-* so at least wanted to mention some I found.

@sorenlouv
Copy link
Copy Markdown
Contributor Author

sorenlouv commented Jan 29, 2021 •
edited
Loading

I was a bit surprised by how many (hardcoded) references there are to apm-* so at least wanted to mention some I found.

Good point. I initially thought we'd just make the UI usable for fleet users and then ignore everything else until 8.0. But thinking again it'll be a bad experience if the permissions, ML jobs etc don't work out of the box as expected.

Wrt permissions I think adding the new data stream indices to the apm_user role will be fairly straight forward. Similarly, I hope we can make ML jobs work for other indices than apm-* by supplying a list of indicies to ML when creating the job. This won't work for existing jobs though.

Not sure what we'll do with the index pattern. Not sure an index pattern can span across different indicies that don't share a common prefix. So we might have to create an alias for this

@sorenlouv sorenlouv changed the title Add data stream indicies [APM] Add support for Data Streams Feb 1, 2021
@sorenlouv sorenlouv force-pushed the add-data-streams-indicies branch from a32a7ed to 23879a0 Compare February 4, 2021 23:06
@sorenlouv sorenlouv added release_note:skip Skip the PR/issue when compiling release notes v7.12.0 labels Feb 5, 2021
@sorenlouv sorenlouv changed the title [APM] Add support for Data Streams [APM] Add experimental support for Data Streams Feb 5, 2021
@sorenlouv
Copy link
Copy Markdown
Contributor Author

sorenlouv commented Feb 6, 2021

@elasticmachine merge upstream

@sorenlouv
Copy link
Copy Markdown
Contributor Author

sorenlouv commented Feb 7, 2021

retest

sorenlouv
sorenlouv commented Feb 8, 2021
View reviewed changes
src/plugins/apm_oss/server/index.ts Outdated
Copy link
Copy Markdown
Contributor Author

@sorenlouv sorenlouv Feb 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Option to disable fleet support. Should it be called something else like fleet.enabled?

sorenlouv
sorenlouv commented Feb 8, 2021
View reviewed changes
x-pack/plugins/apm/public/components/shared/KueryBar/index.tsx Outdated
Copy link
Copy Markdown
Contributor Author

@sorenlouv sorenlouv Feb 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed processorEvent from the dynamic index pattern. It barely had an impact since 850 fields of 905 are shared. So limiting to a single processorEvent didn't have any significant advantages.

sorenlouv
sorenlouv commented Feb 8, 2021
View reviewed changes
x-pack/plugins/apm/public/hooks/use_dynamic_index_pattern.ts Outdated
Copy link
Copy Markdown
Contributor Author

@sorenlouv sorenlouv Feb 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another benefit of removing processorEvent: a dynamic index pattern is now only fetched once.

@sorenlouv sorenlouv force-pushed the add-data-streams-indicies branch from 5fac944 to d8d0175 Compare February 10, 2021 14:32
@sorenlouv
Copy link
Copy Markdown
Contributor Author

sorenlouv commented Feb 11, 2021

jenkins run the e2e

@sorenlouv
Copy link
Copy Markdown
Contributor Author

sorenlouv commented Feb 11, 2021

@elasticmachine merge upstream

@sorenlouv sorenlouv merged commit a31cc73 into elastic:master Feb 11, 2021
@sorenlouv sorenlouv deleted the add-data-streams-indicies branch February 11, 2021 09:44
gmmorris added a commit to gmmorris/kibana that referenced this pull request Feb 11, 2021
@gmmorris
Merge branch 'master' into task-manager/support-limited-concurrency
1713500 
* master: (44 commits)
  [APM] Add experimental support for Data Streams (elastic#89650)
  [Search Session] Control "Kibana / Search Sessions" management section by privileges (elastic#90818)
  [Lens] Median as default function (elastic#90952)
  Implement custom global header banner (elastic#87438)
  [Fleet] Reduce permissions. (elastic#90302)
  Update dependency @elastic/charts to v24.5.1 (elastic#89822)
  [Create index pattern] Can't create single character index without wildcard (elastic#90919)
  [ts/build_ts_refs] add support for --clean flag (elastic#91060)
  Don't clean when running e2e tests (elastic#91057)
  Fixes track_total_hits in the body not having an effect when using search strategy (elastic#91068)
  [Security Solution][Detections] Adds list plugin Saved Objects to Security feature privilege (elastic#90895)
  Removing the code plugin entirely for 8.0 (elastic#77940)
  chore(NA): move the instruction to remove yarn global bazelisk package into the first place on install bazel tools (elastic#91026)
  [jest/ci] remove max-old-space-size override to use 4gb default (elastic#91020)
  [Fleet] Restrict integration changes for managed policies (elastic#90675)
  [CI] Fix auto-backport condditions so that it doesn't trigger for other labels (elastic#91042)
  [DOCS] Uses variable to refer to query profiler (elastic#90976)
  [App Search] Relevance Tuning logic listeners (elastic#89461)
  [Metrics UI] Fix saving/loading saved views from URL (elastic#90216)
  Limit cardinality of transaction.name (elastic#90955)
  ...
@sorenlouv sorenlouv mentioned this pull request Feb 11, 2021
Merged
dgieselaar added a commit that referenced this pull request Feb 13, 2021
@sorenlouv @kibanamachine @dgieselaar
[7.x] [APM] Add experimental support for Data Streams (#89650) (#91098)
188f336 
* [APM] Add experimental support for Data Streams (#89650)

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

* Update mock types for apm oss

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
Co-authored-by: Dario Gieselaar <dario.gieselaar@elastic.co>
@sorenlouv sorenlouv mentioned this pull request Feb 22, 2021
Closed
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Feb 22, 2021 •
edited
Loading

💔 Build Failed

Failed CI Steps

Test Failures

Kibana Pipeline / general / Firefox XPack UI Functional Tests.x-pack/test/functional/apps/grok_debugger/grok_debugger·js.logstash grok debugger app "before all" hook in "grok debugger app"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 11 times on tracked branches: https://github.com/elastic/kibana/issues/84440

[00:00:00]       │
[00:03:08]         └-: logstash
[00:03:08]           └-> "before all" hook in "logstash"
[00:03:08]           └-: grok debugger app
[00:03:08]             └-> "before all" hook in "grok debugger app"
[00:03:08]             └-> "before all" hook in "grok debugger app"
[00:03:08]               │ info [empty_kibana] Loading "mappings.json"
[00:03:08]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_task_manager_8.0.0_001/QOPg4v9bTyGyRhkuSJ_MRw] deleting index
[00:03:08]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_001/AhpJ0LwgQ9mZ1YBaAgcl2Q] deleting index
[00:03:08]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_pre6.5.0_001/MPie6Do3Q8KGBszy2ySuRQ] deleting index
[00:03:08]               │ info [empty_kibana] Deleted existing index ".kibana_8.0.0_001"
[00:03:08]               │ info [empty_kibana] Deleted existing index ".kibana_task_manager_8.0.0_001"
[00:03:08]               │ info [empty_kibana] Deleted existing index ".kibana_pre6.5.0_001"
[00:03:08]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:03:08]               │ info [empty_kibana] Created index ".kibana"
[00:03:08]               │ debg [empty_kibana] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:03:08]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana/gvJR59mOSfyQV7tw7PFQyg] update_mapping [_doc]
[00:03:08]               │ debg Migrating saved objects
[00:03:08]               │ proc [kibana]   log   [14:59:52.583] [info][savedobjects-service] [.kibana_task_manager] INIT -> CREATE_NEW_TARGET
[00:03:08]               │ proc [kibana]   log   [14:59:52.595] [info][savedobjects-service] [.kibana] INIT -> LEGACY_SET_WRITE_BLOCK
[00:03:08]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_task_manager_8.0.0_001] creating index, cause [api], templates [], shards [1]/[1]
[00:03:08]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.kibana_task_manager_8.0.0_001]
[00:03:08]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] adding block write to indices [[.kibana/gvJR59mOSfyQV7tw7PFQyg]]
[00:03:08]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] completed adding block write to indices [.kibana]
[00:03:08]               │ proc [kibana]   log   [14:59:52.673] [info][savedobjects-service] [.kibana_task_manager] CREATE_NEW_TARGET -> MARK_VERSION_INDEX_READY
[00:03:08]               │ proc [kibana]   log   [14:59:52.691] [info][savedobjects-service] [.kibana] LEGACY_SET_WRITE_BLOCK -> LEGACY_CREATE_REINDEX_TARGET
[00:03:08]               │ proc [kibana]   log   [14:59:52.706] [info][savedobjects-service] [.kibana_task_manager] MARK_VERSION_INDEX_READY -> DONE
[00:03:08]               │ proc [kibana]   log   [14:59:52.707] [info][savedobjects-service] [.kibana_task_manager] Migration completed after 128ms
[00:03:08]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_pre6.5.0_001] creating index, cause [api], templates [], shards [1]/[1]
[00:03:08]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.kibana_pre6.5.0_001]
[00:03:08]               │ proc [kibana]   log   [14:59:52.772] [info][savedobjects-service] [.kibana] LEGACY_CREATE_REINDEX_TARGET -> LEGACY_REINDEX
[00:03:08]               │ proc [kibana]   log   [14:59:52.781] [info][savedobjects-service] [.kibana] LEGACY_REINDEX -> LEGACY_REINDEX_WAIT_FOR_TASK
[00:03:08]               │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] 6573 finished with response BulkByScrollResponse[took=3ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:03:08]               │ proc [kibana]   log   [14:59:52.790] [info][savedobjects-service] [.kibana] LEGACY_REINDEX_WAIT_FOR_TASK -> LEGACY_DELETE
[00:03:08]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana/gvJR59mOSfyQV7tw7PFQyg] deleting index
[00:03:08]               │ proc [kibana]   log   [14:59:52.834] [info][savedobjects-service] [.kibana] LEGACY_DELETE -> SET_SOURCE_WRITE_BLOCK
[00:03:08]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] adding block write to indices [[.kibana_pre6.5.0_001/bCQrYo3rSKOSGzaEolDsUQ]]
[00:03:08]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] completed adding block write to indices [.kibana_pre6.5.0_001]
[00:03:08]               │ proc [kibana]   log   [14:59:52.885] [info][savedobjects-service] [.kibana] SET_SOURCE_WRITE_BLOCK -> CREATE_REINDEX_TEMP
[00:03:08]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_reindex_temp] creating index, cause [api], templates [], shards [1]/[1]
[00:03:08]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.kibana_8.0.0_reindex_temp]
[00:03:08]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_8.0.0_reindex_temp][0]]])." previous.health="YELLOW" reason="shards started [[.kibana_8.0.0_reindex_temp][0]]"
[00:03:09]               │ proc [kibana]   log   [14:59:52.970] [info][savedobjects-service] [.kibana] CREATE_REINDEX_TEMP -> REINDEX_SOURCE_TO_TEMP
[00:03:09]               │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] 6602 finished with response BulkByScrollResponse[took=2.8ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:03:09]               │ proc [kibana]   log   [14:59:52.978] [info][savedobjects-service] [.kibana] REINDEX_SOURCE_TO_TEMP -> REINDEX_SOURCE_TO_TEMP_WAIT_FOR_TASK
[00:03:09]               │ proc [kibana]   log   [14:59:52.986] [info][savedobjects-service] [.kibana] REINDEX_SOURCE_TO_TEMP_WAIT_FOR_TASK -> SET_TEMP_WRITE_BLOCK
[00:03:09]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] adding block write to indices [[.kibana_8.0.0_reindex_temp/WsNlY4r2RdO9NQKS1YNtfQ]]
[00:03:09]               │ info [o.e.c.m.MetadataIndexStateService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] completed adding block write to indices [.kibana_8.0.0_reindex_temp]
[00:03:09]               │ proc [kibana]   log   [14:59:53.049] [info][savedobjects-service] [.kibana] SET_TEMP_WRITE_BLOCK -> CLONE_TEMP_TO_TARGET
[00:03:09]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] applying create index request using existing index [.kibana_8.0.0_reindex_temp] metadata
[00:03:09]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_001] creating index, cause [clone_index], templates [], shards [1]/[1]
[00:03:09]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.kibana_8.0.0_001]
[00:03:09]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_001/bbHCt4nuRsODEp0dEyQwNA] create_mapping
[00:03:09]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_8.0.0_001][0]]])." previous.health="YELLOW" reason="shards started [[.kibana_8.0.0_001][0]]"
[00:03:09]               │ proc [kibana]   log   [14:59:53.176] [info][savedobjects-service] [.kibana] CLONE_TEMP_TO_TARGET -> OUTDATED_DOCUMENTS_SEARCH
[00:03:09]               │ proc [kibana]   log   [14:59:53.189] [info][savedobjects-service] [.kibana] OUTDATED_DOCUMENTS_SEARCH -> UPDATE_TARGET_MAPPINGS
[00:03:09]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_001/bbHCt4nuRsODEp0dEyQwNA] update_mapping [_doc]
[00:03:09]               │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] 6643 finished with response BulkByScrollResponse[took=2.2ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:03:09]               │ proc [kibana]   log   [14:59:53.259] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS -> UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK
[00:03:09]               │ proc [kibana]   log   [14:59:53.269] [info][savedobjects-service] [.kibana] UPDATE_TARGET_MAPPINGS_WAIT_FOR_TASK -> MARK_VERSION_INDEX_READY
[00:03:09]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_reindex_temp/WsNlY4r2RdO9NQKS1YNtfQ] deleting index
[00:03:09]               │ proc [kibana]   log   [14:59:53.326] [info][savedobjects-service] [.kibana] MARK_VERSION_INDEX_READY -> DONE
[00:03:09]               │ proc [kibana]   log   [14:59:53.327] [info][savedobjects-service] [.kibana] Migration completed after 750ms
[00:03:09]               │ debg [empty_kibana] Migrated Kibana index after loading Kibana data
[00:03:09]               │ debg [empty_kibana] Ensured that default space exists in .kibana
[00:03:09]               │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC","visualization:visualize:legacyChartsLibrary":true}
[00:03:09]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.kibana_8.0.0_001/bbHCt4nuRsODEp0dEyQwNA] update_mapping [_doc]
[00:03:11]               │ debg navigating to grokDebugger url: http://localhost:61101/app/dev_tools#/grokdebugger
[00:03:11]               │ debg navigate to: http://localhost:61101/app/dev_tools#/grokdebugger
[00:03:11]               │ debg browser[log] "^ A single error about an inline script not firing due to content security policy is expected!"
[00:03:11]               │ debg ... sleep(700) start
[00:03:12]               │ debg ... sleep(700) end
[00:03:12]               │ debg returned from get, calling refresh
[00:03:12]               │ debg browser[log] "^ A single error about an inline script not firing due to content security policy is expected!"
[00:03:13]               │ debg currentUrl = http://localhost:61101/login?next=%2Fapp%2Fdev_tools%3F_t%3D1614005995122#/grokdebugger
[00:03:13]               │          appUrl = http://localhost:61101/app/dev_tools#/grokdebugger
[00:03:13]               │ debg TestSubjects.find(kibanaChrome)
[00:03:13]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:03:14]               │ debg Found login page
[00:03:14]               │ debg TestSubjects.setValue(loginUsername, test_user)
[00:03:14]               │ debg TestSubjects.click(loginUsername)
[00:03:14]               │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:03:14]               │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:03:14]               │ debg browser[log] "Detected an unhandled Promise rejection.
[00:03:14]               │      Error: Unauthorized"
[00:03:15]               │ debg TestSubjects.setValue(loginPassword, changeme)
[00:03:15]               │ debg TestSubjects.click(loginPassword)
[00:03:15]               │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:03:15]               │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:03:15]               │ debg TestSubjects.click(loginSubmit)
[00:03:15]               │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:03:15]               │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:03:15]               │ proc [kibana]   log   [14:59:59.757] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:03:16]               │ debg Find.waitForDeletedByCssSelector('.kibanaWelcomeLogo') with timeout=10000
[00:03:16]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:03:16]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"] nav:not(.ng-hide)') with timeout=60000
[00:03:16]               │ debg browser[log] "^ A single error about an inline script not firing due to content security policy is expected!"
[00:03:19]               │ debg Finished login process currentUrl = http://localhost:61101/app/dev_tools#/grokdebugger
[00:03:19]               │ debg ... sleep(501) start
[00:03:19]               │ debg browser[log] "Detected an unhandled Promise rejection.
[00:03:19]               │      AbortError: The operation was aborted. "
[00:03:19]               │ debg browser[log] "^ A single error about an inline script not firing due to content security policy is expected!"
[00:03:20]               │ debg ... sleep(501) end
[00:03:20]               │ debg in navigateTo url = http://localhost:61101/app/dev_tools#/grokdebugger
[00:03:20]               │ debg TestSubjects.exists(statusPageContainer)
[00:03:20]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:03:22]               │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:03:23]               │ debg Waiting up to 20000ms for Grok Debugger to exist...
[00:03:23]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:23]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:30]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:31]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:31]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:34]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:35]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:35]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:37]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:38]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:38]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:41]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:42]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:42]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:03:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:03:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:03:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:08]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:11]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:12]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:12]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:15]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:16]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:16]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:18]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:19]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:19]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:22]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:23]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:23]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:29]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:30]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:30]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:32]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:33]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:33]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:36]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:37]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:37]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:39]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:40]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:40]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:43]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:44]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:44]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:46]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:47]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:50]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:51]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:51]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:53]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:54]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:54]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:04:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:04:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:04:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:08]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:11]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:12]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:12]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:15]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:16]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:16]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:18]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:19]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:19]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:22]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:23]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:23]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:29]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:30]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:30]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:32]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:33]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:33]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:36]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:37]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:37]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:39]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:40]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:40]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:43]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:44]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:44]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:46]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:47]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:50]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:51]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:51]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:53]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:54]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:54]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:05:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:05:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:05:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:08]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:11]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:12]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:12]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:14]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:15]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:15]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:18]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:19]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:19]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:22]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:23]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:23]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:29]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:30]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:30]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:32]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:33]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:33]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:36]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:37]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:37]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:39]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:40]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:40]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:43]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:44]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:44]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:46]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:47]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:50]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:51]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:51]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:53]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:54]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:54]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:06:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:06:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:06:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:08]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:11]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:12]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:12]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:14]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:15]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:15]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:18]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:19]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:19]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:21]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:22]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:22]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:29]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:30]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:30]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:32]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:33]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:33]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:36]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:37]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:37]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:39]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:40]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:40]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:43]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:44]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:44]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:46]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:47]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:50]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:51]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:51]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:53]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:54]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:54]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:07:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:07:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:07:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:08]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:08]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:11]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:12]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:12]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:14]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:15]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:15]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:18]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:19]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:19]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:21]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:22]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:22]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:25]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:26]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:26]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:28]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:29]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:29]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:32]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:33]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:33]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:35]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:36]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:36]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:39]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:40]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:40]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:43]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:44]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:44]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:46]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:47]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:50]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:51]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:51]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:53]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:54]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:54]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:08:57]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:08:58]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:08:58]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:09:00]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:09:01]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:09:01]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:09:04]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:09:05]               │ debg TestSubjects.exists(grokDebuggerContainer)
[00:09:05]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="grokDebuggerContainer"]') with timeout=2500
[00:09:07]               │ debg --- retry.tryForTime error: [data-test-subj="grokDebuggerContainer"] is not displayed
[00:09:08]               └- ✖ fail: logstash grok debugger app "before all" hook in "grok debugger app"
[00:09:08]               │      Error: Timeout of 360000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/dev/shm/workspace/parallel/10/kibana/x-pack/test/functional/apps/grok_debugger/grok_debugger.js)
[00:09:08]               │       at listOnTimeout (internal/timers.js:554:17)
[00:09:08]               │       at processTimers (internal/timers.js:497:7)
[00:09:08]               │ 
[00:09:08]               │

Stack Trace

Error: Timeout of 360000ms exceeded. For async tests and hooks, ensure "done()" is called; if returning a Promise, ensure it resolves. (/dev/shm/workspace/parallel/10/kibana/x-pack/test/functional/apps/grok_debugger/grok_debugger.js)
    at listOnTimeout (internal/timers.js:554:17)
    at processTimers (internal/timers.js:497:7)
Kibana Pipeline / general / X-Pack API Integration Tests.x-pack/test/api_integration/apis/ml/modules/setup_module·ts.apis Machine Learning modules module setup sets up module data for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:00:00]         └-: apis
[00:00:00]           └-> "before all" hook in "apis"
[00:07:35]           └-: Machine Learning
[00:07:35]             └-> "before all" hook in "Machine Learning"
[00:07:35]             └-> "before all" hook in "Machine Learning"
[00:07:35]               │ debg creating role ft_ml_source
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_ml_source]
[00:07:35]               │ debg creating role ft_ml_source_readonly
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_ml_source_readonly]
[00:07:35]               │ debg creating role ft_ml_dest
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_ml_dest]
[00:07:35]               │ debg creating role ft_ml_dest_readonly
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_ml_dest_readonly]
[00:07:35]               │ debg creating role ft_ml_ui_extras
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_ml_ui_extras]
[00:07:35]               │ debg creating role ft_default_space_ml_all
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_default_space_ml_all]
[00:07:35]               │ debg creating role ft_default_space1_ml_all
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_default_space1_ml_all]
[00:07:35]               │ debg creating role ft_all_spaces_ml_all
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_all_spaces_ml_all]
[00:07:35]               │ debg creating role ft_default_space_ml_read
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_default_space_ml_read]
[00:07:35]               │ debg creating role ft_default_space1_ml_read
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_default_space1_ml_read]
[00:07:35]               │ debg creating role ft_all_spaces_ml_read
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_all_spaces_ml_read]
[00:07:35]               │ debg creating role ft_default_space_ml_none
[00:07:35]               │ info [o.e.x.s.a.r.TransportPutRoleAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added role [ft_default_space_ml_none]
[00:07:35]               │ debg creating user ft_ml_poweruser
[00:07:35]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_poweruser]
[00:07:35]               │ debg created user ft_ml_poweruser
[00:07:35]               │ debg creating user ft_ml_poweruser_spaces
[00:07:35]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_poweruser_spaces]
[00:07:35]               │ debg created user ft_ml_poweruser_spaces
[00:07:35]               │ debg creating user ft_ml_poweruser_space1
[00:07:35]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_poweruser_space1]
[00:07:35]               │ debg created user ft_ml_poweruser_space1
[00:07:35]               │ debg creating user ft_ml_poweruser_all_spaces
[00:07:35]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_poweruser_all_spaces]
[00:07:35]               │ debg created user ft_ml_poweruser_all_spaces
[00:07:35]               │ debg creating user ft_ml_viewer
[00:07:35]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_viewer]
[00:07:35]               │ debg created user ft_ml_viewer
[00:07:35]               │ debg creating user ft_ml_viewer_spaces
[00:07:36]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_viewer_spaces]
[00:07:36]               │ debg created user ft_ml_viewer_spaces
[00:07:36]               │ debg creating user ft_ml_viewer_space1
[00:07:36]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_viewer_space1]
[00:07:36]               │ debg created user ft_ml_viewer_space1
[00:07:36]               │ debg creating user ft_ml_viewer_all_spaces
[00:07:36]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_viewer_all_spaces]
[00:07:36]               │ debg created user ft_ml_viewer_all_spaces
[00:07:36]               │ debg creating user ft_ml_unauthorized
[00:07:36]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_unauthorized]
[00:07:36]               │ debg created user ft_ml_unauthorized
[00:07:36]               │ debg creating user ft_ml_unauthorized_spaces
[00:07:36]               │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] added user [ft_ml_unauthorized_spaces]
[00:07:36]               │ debg created user ft_ml_unauthorized_spaces
[00:07:36]             └-: modules
[00:07:36]               └-> "before all" hook in "modules"
[00:07:52]               └-: module setup
[00:07:52]                 └-> "before all" hook in "module setup"
[00:07:52]                 └-> "before all" hook in "module setup"
[00:07:52]                   │ debg applying update to kibana config: {"dateFormat:tz":"UTC"}
[00:08:37]                 └-: sets up module data
[00:08:37]                   └-> "before all" hook for "for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true"
[00:08:37]                   └-> "before all" hook for "for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true"
[00:08:37]                     │ info [ml/module_logs] Loading "mappings.json"
[00:08:37]                     │ info [ml/module_logs] Loading "data.json.gz"
[00:08:37]                     │ info [ml/module_logs] Skipped restore for existing index "ft_module_logs"
[00:08:37]                     │ debg Searching for 'index-pattern' with title 'ft_module_logs'...
[00:08:37]                     │ debg  > Found 'df052900-7521-11eb-9cce-59c784e106fe'
[00:08:37]                     │ debg Index pattern with title 'ft_module_logs' already exists. Nothing to create.
[00:08:37]                   └-> for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true
[00:08:37]                     └-> "before each" hook: global before each for "for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true"
[00:08:37]                     │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-anomalies-shared] creating index, cause [api], templates [.ml-anomalies-], shards [1]/[1]
[00:08:37]                     │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.ml-anomalies-shared]
[00:08:37]                     │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-annotations-6] creating index, cause [api], templates [], shards [1]/[1]
[00:08:37]                     │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.ml-annotations-6]
[00:08:37]                     │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-anomalies-shared/XkHZlQ22RsaYtqnfHTzP0A] update_mapping [_doc]
[00:08:37]                     │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-config] creating index, cause [auto(bulk api)], templates [], shards [1]/[1]
[00:08:37]                     │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.ml-config]
[00:08:37]                     │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-notifications-000001] creating index, cause [auto(bulk api)], templates [.ml-notifications-000001], shards [1]/[1]
[00:08:37]                     │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.ml-notifications-000001]
[00:08:39]                     │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] Opening job [pf7_log-entry-categories-count]
[00:08:39]                     │ info [o.e.x.c.m.u.MlIndexAndAlias] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] About to create first concrete index [.ml-state-000001] with alias [.ml-state-write]
[00:08:39]                     │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-state-000001] creating index, cause [api], templates [.ml-state], shards [1]/[1]
[00:08:39]                     │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] updating number_of_replicas to [0] for indices [.ml-state-000001]
[00:08:39]                     │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] moving index [.ml-state-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ml-size-based-ilm-policy]
[00:08:39]                     │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] moving index [.ml-state-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] in policy [ml-size-based-ilm-policy]
[00:08:39]                     │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] Loading model snapshot [N/A], job latest_record_timestamp [N/A]
[00:08:39]                     │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] moving index [.ml-state-000001] from [{"phase":"hot","action":"unfollow","name":"branch-check-unfollow-prerequisites"}] to [{"phase":"hot","action":"rollover","name":"check-rollover-ready"}] in policy [ml-size-based-ilm-policy]
[00:08:39]                     │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] [autodetect/243769] [CResourceMonitor.cc@77] Setting model memory limit to 41 MB
[00:08:39]                     │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] Successfully set job state to [opened] for job [pf7_log-entry-categories-count]
[00:08:39]                     │ info [o.e.x.m.d.DatafeedJob] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] Datafeed started (from: 1970-01-01T00:00:00.000Z to: 2021-02-22T15:14:40.609Z) with frequency [450000ms]
[00:08:39]                     │ debg Waiting up to 5000ms for 'pf7_log-entry-categories-count' to exist...
[00:08:39]                     │ debg Waiting up to 5000ms for 'datafeed-pf7_log-entry-categories-count' to exist...
[00:08:39]                     │ debg Waiting up to 10000ms for 'pf7_log-entry-categories-count' to have processed_record_count > 0...
[00:08:39]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:39]                     │ debg > AD job stats fetched.
[00:08:39]                     │ debg --- retry.waitForWithTimeout error: expected anomaly detection job 'pf7_log-entry-categories-count' to have processed_record_count > 0 (got 0)
[00:08:39]                     │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-anomalies-shared/XkHZlQ22RsaYtqnfHTzP0A] update_mapping [_doc]
[00:08:40]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:40]                     │ debg > AD job stats fetched.
[00:08:40]                     │ debg Waiting up to 120000ms for job state to be closed...
[00:08:40]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:40]                     │ debg > AD job stats fetched.
[00:08:40]                     │ debg --- retry.waitForWithTimeout error: expected job state to be closed but got opened
[00:08:40]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:40]                     │ debg > AD job stats fetched.
[00:08:40]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:41]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:41]                     │ debg > AD job stats fetched.
[00:08:41]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:41]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:41]                     │ debg > AD job stats fetched.
[00:08:41]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:42]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:42]                     │ debg > AD job stats fetched.
[00:08:42]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:42]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:42]                     │ debg > AD job stats fetched.
[00:08:42]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:43]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:43]                     │ debg > AD job stats fetched.
[00:08:43]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:43]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:43]                     │ debg > AD job stats fetched.
[00:08:43]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:44]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:44]                     │ debg > AD job stats fetched.
[00:08:44]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:44]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:44]                     │ debg > AD job stats fetched.
[00:08:44]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:45]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:45]                     │ debg > AD job stats fetched.
[00:08:45]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:45]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:45]                     │ debg > AD job stats fetched.
[00:08:45]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:46]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:46]                     │ debg > AD job stats fetched.
[00:08:46]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:47]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:47]                     │ debg > AD job stats fetched.
[00:08:47]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:47]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:47]                     │ debg > AD job stats fetched.
[00:08:47]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:48]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:48]                     │ debg > AD job stats fetched.
[00:08:48]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:48]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:48]                     │ debg > AD job stats fetched.
[00:08:48]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:49]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:49]                     │ debg > AD job stats fetched.
[00:08:49]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:49]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:49]                     │ debg > AD job stats fetched.
[00:08:49]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:50]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:50]                     │ debg > AD job stats fetched.
[00:08:50]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:50]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:50]                     │ debg > AD job stats fetched.
[00:08:50]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:51]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:51]                     │ debg > AD job stats fetched.
[00:08:51]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:51]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:51]                     │ debg > AD job stats fetched.
[00:08:51]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:52]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:52]                     │ debg > AD job stats fetched.
[00:08:52]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:52]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:52]                     │ debg > AD job stats fetched.
[00:08:52]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:53]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:53]                     │ debg > AD job stats fetched.
[00:08:53]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:53]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:53]                     │ debg > AD job stats fetched.
[00:08:53]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:54]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:54]                     │ debg > AD job stats fetched.
[00:08:54]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:54]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:54]                     │ debg > AD job stats fetched.
[00:08:54]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:55]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:55]                     │ debg > AD job stats fetched.
[00:08:55]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:55]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:55]                     │ debg > AD job stats fetched.
[00:08:55]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:56]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:56]                     │ debg > AD job stats fetched.
[00:08:56]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:56]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:56]                     │ debg > AD job stats fetched.
[00:08:56]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:57]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:57]                     │ debg > AD job stats fetched.
[00:08:57]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:57]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:57]                     │ debg > AD job stats fetched.
[00:08:57]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:58]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:58]                     │ debg > AD job stats fetched.
[00:08:58]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:58]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:58]                     │ debg > AD job stats fetched.
[00:08:58]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:59]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:59]                     │ debg > AD job stats fetched.
[00:08:59]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:08:59]                     │ info [o.e.x.m.d.DatafeedJob] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] Lookback has finished
[00:08:59]                     │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [no_realtime] attempt to stop datafeed [datafeed-pf7_log-entry-categories-count] for job [pf7_log-entry-categories-count]
[00:08:59]                     │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [no_realtime] try lock [20s] to stop datafeed [datafeed-pf7_log-entry-categories-count] for job [pf7_log-entry-categories-count]...
[00:08:59]                     │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [no_realtime] stopping datafeed [datafeed-pf7_log-entry-categories-count] for job [pf7_log-entry-categories-count], acquired [true]...
[00:08:59]                     │ info [o.e.x.m.d.DatafeedManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [no_realtime] datafeed [datafeed-pf7_log-entry-categories-count] for job [pf7_log-entry-categories-count] has been stopped
[00:08:59]                     │ info [o.e.x.m.j.p.a.AutodetectProcessManager] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] Closing job [pf7_log-entry-categories-count], because [close job (api)]
[00:08:59]                     │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] [autodetect/243769] [CCmdSkeleton.cc@61] Handled 584 records
[00:08:59]                     │ info [o.e.x.m.p.l.CppLogMessageHandler] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] [autodetect/243769] [CAnomalyJob.cc@1569] Pruning all models
[00:08:59]                     │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [.ml-anomalies-shared/XkHZlQ22RsaYtqnfHTzP0A] update_mapping [_doc]
[00:08:59]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:08:59]                     │ debg > AD job stats fetched.
[00:08:59]                     │ debg --- retry.waitForWithTimeout error: expected job state to be closed but got closing
[00:09:00]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:09:00]                     │ debg > AD job stats fetched.
[00:09:00]                     │ debg --- retry.waitForWithTimeout failed again with the same message...
[00:09:00]                     │ info [o.e.x.m.p.AbstractNativeProcess] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] State output finished
[00:09:00]                     │ info [o.e.x.m.j.p.a.o.AutodetectResultProcessor] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] 2342 buckets parsed from autodetect output
[00:09:00]                     │ info [o.e.x.m.j.p.a.AutodetectCommunicator] [kibana-ci-immutable-ubuntu-16-tests-xxl-1614003588164653258] [pf7_log-entry-categories-count] job closed
[00:09:00]                     │ debg Fetching anomaly detection job stats for job pf7_log-entry-categories-count...
[00:09:00]                     │ debg > AD job stats fetched.
[00:09:00]                     │ debg Waiting up to 120000ms for datafeed state to be stopped...
[00:09:00]                     │ debg Fetching datafeed state for datafeed datafeed-pf7_log-entry-categories-count
[00:09:00]                     └- ✖ fail: apis Machine Learning modules module setup sets up module data for logs_ui_categories with prefix, startDatafeed true and estimateModelMemory true
[00:09:00]                     │       Error: Expected job model memory limits '[{"id":"pf7_log-entry-categories-count","modelMemoryLimit":"26mb"}]' (got '[{"id":"pf7_log-entry-categories-count","modelMemoryLimit":"41mb"}]')
[00:09:00]                     │       + expected - actual
[00:09:00]                     │ 
[00:09:00]                     │        [
[00:09:00]                     │          {
[00:09:00]                     │            "id": "pf7_log-entry-categories-count"
[00:09:00]                     │       -    "modelMemoryLimit": "41mb"
[00:09:00]                     │       +    "modelMemoryLimit": "26mb"
[00:09:00]                     │          }
[00:09:00]                     │        ]
[00:09:00]                     │       
[00:09:00]                     │       at Assertion.assert (/dev/shm/workspace/parallel/20/kibana/packages/kbn-expect/expect.js:100:11)
[00:09:00]                     │       at Assertion.eql (/dev/shm/workspace/parallel/20/kibana/packages/kbn-expect/expect.js:244:8)
[00:09:00]                     │       at Context.<anonymous> (test/api_integration/apis/ml/modules/setup_module.ts:870:46)
[00:09:00]                     │       at Object.apply (/dev/shm/workspace/parallel/20/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:09:00]                     │ 
[00:09:00]                     │

Stack Trace

Error: Expected job model memory limits '[{"id":"pf7_log-entry-categories-count","modelMemoryLimit":"26mb"}]' (got '[{"id":"pf7_log-entry-categories-count","modelMemoryLimit":"41mb"}]')
    at Assertion.assert (/dev/shm/workspace/parallel/20/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.eql (/dev/shm/workspace/parallel/20/kibana/packages/kbn-expect/expect.js:244:8)
    at Context.<anonymous> (test/api_integration/apis/ml/modules/setup_module.ts:870:46)
    at Object.apply (/dev/shm/workspace/parallel/20/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16) {
  actual: '[\n' +
    '  {\n' +
    '    "id": "pf7_log-entry-categories-count"\n' +
    '    "modelMemoryLimit": "41mb"\n' +
    '  }\n' +
    ']',
  expected: '[\n' +
    '  {\n' +
    '    "id": "pf7_log-entry-categories-count"\n' +
    '    "modelMemoryLimit": "26mb"\n' +
    '  }\n' +
    ']',
  showDiff: true
}

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
apm 5.2MB 5.2MB -171.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@sorenlouv sorenlouv mentioned this pull request Mar 16, 2021
Closed
6 tasks
@ogupte ogupte mentioned this pull request Aug 11, 2021
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@smith smith smith approved these changes

Assignees

No one assigned

Labels

release_note:skip Skip the PR/issue when compiling release notes Team:APM - DEPRECATED Use Team:obs-ux-infra_services. v7.12.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[APM] Add experimental support for data streams

5 participants

@sorenlouv @elasticmachine @dgieselaar @kibanamachine @smith