[7.x] [ML] Edits labelling of SIEM module and jobs from SIEM to Security (#71696) by spong · Pull Request #71797 · elastic/kibana

spong · 2020-07-15T00:37:29Z

Backports the following commits to 7.x:

[ML] Edits labelling of SIEM module and jobs from SIEM to Security ([ML] Edits labelling of SIEM module and jobs from SIEM to Security #71696)

…lastic#71696) ## Summary Edits all references to 'SIEM' in the ML SIEM modules to 'Security'. The following parts of the configurations were edited: - Module titles - Module descriptions - Job descriptions - `siem` job group changed to `security` The `siem#/` portion of the custom URLs was also edited to `security/`. Also removes the 'beta' label from module and job descriptions. ![image](https://user-images.githubusercontent.com/7405507/87452224-dbe4fd00-c5f8-11ea-887b-89c47e3467d2.png) ![image (26)](https://user-images.githubusercontent.com/7405507/87452265-edc6a000-c5f8-11ea-94a8-e101126666fa.png) Part of elastic#69319

spong · 2020-07-15T02:30:30Z

@elasticmachine merge upstream

spong · 2020-07-15T02:48:36Z

Cancelled previous build, restarting to pick up skipped test.

spong · 2020-07-15T02:53:21Z

@elasticmachine merge upstream

XavierM · 2020-07-15T04:10:51Z

@elasticmachine merge upstream

patrykkopycinski · 2020-07-15T07:06:49Z

@elasticmachine merge upstream

elasticmachine · 2020-07-15T08:11:41Z

Pinging @elastic/ml-ui (:ml)

kibanamachine · 2020-07-15T08:59:41Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 83449b9
Flaky suites:
- xpack-kibana-ciGroup4

Test Failures

Kibana Pipeline / kibana-xpack-agent / Plugin Functional Tests.x-pack/test/plugin_api_integration/test_suites/task_manager/task_manager_integration·js.task_manager scheduling and running tasks should return a task run error result when trying to run a task now which is already running

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://github.com/elastic/kibana/issues/71390

[00:00:00]       │
[00:00:00]         └-: task_manager
[00:00:00]           └-> "before all" hook
[00:00:00]           └-: scheduling and running tasks
[00:00:00]             └-> "before all" hook
[00:00:00]             └-> should support middleware
[00:00:00]               └-> "before each" hook: global before each
[00:00:00]               └-> "before each" hook
[00:00:00]               └-> "before each" hook
[00:00:00]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] [.kibana_task_manager_test_result] creating index, cause [api], templates [], shards [1]/[1]
[00:00:00]               │ debg Task created: 7fb77690-c673-11ea-9d7e-45fe5ef107ce
[00:00:00]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:00]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] [ilm-history-2-000001] creating index, cause [api], templates [ilm-history], shards [1]/[0]
[00:00:00]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] moving index [ilm-history-2-000001] from [null] to [{"phase":"new","action":"complete","name":"complete"}] in policy [ilm-history-ilm-policy]
[00:00:00]               │ debg --- retry.try failed again with the same message...
[00:00:00]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] moving index [ilm-history-2-000001] from [{"phase":"new","action":"complete","name":"complete"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] in policy [ilm-history-ilm-policy]
[00:00:00]               │ info [o.e.x.i.IndexLifecycleTransition] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] moving index [ilm-history-2-000001] from [{"phase":"hot","action":"unfollow","name":"wait-for-indexing-complete"}] to [{"phase":"hot","action":"unfollow","name":"wait-for-follow-shard-tasks"}] in policy [ilm-history-ilm-policy]
[00:00:01]               │ debg --- retry.try failed again with the same message...
[00:00:01]               │ debg --- retry.try failed again with the same message...
[00:00:02]               │ debg --- retry.try failed again with the same message...
[00:00:02]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-18-tests-xl-1594796842018734163] [.kibana_task_manager_test_result/gnvLJcXyTnyNarGS_dt_SQ] update_mapping [_doc]
[00:00:02]               │ debg --- retry.try failed again with the same message...
[00:00:03]               │ debg Task found: 7fb77690-c673-11ea-9d7e-45fe5ef107ce
[00:00:03]               │ debg Task status: claiming
[00:00:03]               │ debg Task state: {}
[00:00:03]               │ debg Task params: {
[00:00:03]               │        "originalParams": {
[00:00:03]               │          "historyItem": 77
[00:00:03]               │        },
[00:00:03]               │        "superFly": "My middleware param!"
[00:00:03]               │      }
[00:00:03]               │ debg --- retry.try error: expected undefined to sort of equal 1
[00:00:03]               │ debg Task found: 7fb77690-c673-11ea-9d7e-45fe5ef107ce
[00:00:03]               │ debg Task status: idle
[00:00:03]               │ debg Task state: {
[00:00:03]               │        "count": 1
[00:00:03]               │      }
[00:00:03]               │ debg Task params: {
[00:00:03]               │        "originalParams": {
[00:00:03]               │          "historyItem": 77
[00:00:03]               │        },
[00:00:03]               │        "superFly": "My middleware param!"
[00:00:03]               │      }
[00:00:03]               └- ✓ pass  (3.7s) "task_manager scheduling and running tasks should support middleware"
[00:00:03]             └-> should remove non-recurring tasks after they complete
[00:00:03]               └-> "before each" hook: global before each
[00:00:03]               └-> "before each" hook
[00:00:04]               └-> "before each" hook
[00:00:04]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:05]               │ debg --- retry.try failed again with the same message...
[00:00:05]               │ debg --- retry.try failed again with the same message...
[00:00:06]               │ debg --- retry.try error: expected [ { taskType: 'sampleTask',
[00:00:06]               │          retryAt: '2020-07-15T08:17:10.910Z',
[00:00:06]               │          runAt: '2020-07-15T08:16:39.866Z',
[00:00:06]               │          scope: [ 'testing' ],
[00:00:06]               │          startedAt: null,
[00:00:06]               │          state: {},
[00:00:06]               │          params: 
[00:00:06]               │           { originalParams: {},
[00:00:06]               │             superFly: 'My middleware param!' },
[00:00:06]               │          ownerId: 'kibana:5b2de169-2785-441b-ae8c-186a1936b17d',
[00:00:06]               │          scheduledAt: '2020-07-15T08:16:39.866Z',
[00:00:06]               │          attempts: 0,
[00:00:06]               │          status: 'claiming',
[00:00:06]               │          id: '825971a0-c673-11ea-9d7e-45fe5ef107ce' } ] to sort of equal []
[00:00:06]               └- ✓ pass  (2.1s) "task_manager scheduling and running tasks should remove non-recurring tasks after they complete"
[00:00:06]             └-> should use a given ID as the task document ID
[00:00:06]               └-> "before each" hook: global before each
[00:00:06]               └-> "before each" hook
[00:00:07]               └-> "before each" hook
[00:00:07]               └- ✓ pass  (18ms) "task_manager scheduling and running tasks should use a given ID as the task document ID"
[00:00:07]             └-> should allow a task with a given ID to be scheduled multiple times
[00:00:07]               └-> "before each" hook: global before each
[00:00:07]               └-> "before each" hook
[00:00:07]               └-> "before each" hook
[00:00:07]               └- ✓ pass  (48ms) "task_manager scheduling and running tasks should allow a task with a given ID to be scheduled multiple times"
[00:00:07]             └-> should reschedule if task errors
[00:00:07]               └-> "before each" hook: global before each
[00:00:07]               └-> "before each" hook
[00:00:07]               └-> "before each" hook
[00:00:07]               │ debg --- retry.try error: Cannot read property 'id' of undefined
[00:00:07]               │ debg --- retry.try error: expected 'test-task-for-sample-task-plugin-to-test-task-manager' to sort of equal '83edcd40-c673-11ea-9d7e-45fe5ef107ce'
[00:00:08]               │ debg --- retry.try failed again with the same message...
[00:00:08]               │ proc [kibana]   log   [08:16:43.983] [error][plugins][taskManager][taskManager] Task sampleTask "83edcd40-c673-11ea-9d7e-45fe5ef107ce" failed: Error: Dangit!!!!!
[00:00:08]               │ debg --- retry.try failed again with the same message...
[00:00:09]               │ debg --- retry.try failed again with the same message...
[00:00:09]               └- ✓ pass  (2.6s) "task_manager scheduling and running tasks should reschedule if task errors"
[00:00:09]             └-> should reschedule if task returns runAt
[00:00:09]               └-> "before each" hook: global before each
[00:00:09]               └-> "before each" hook
[00:00:10]               └-> "before each" hook
[00:00:10]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:11]               │ debg --- retry.try failed again with the same message...
[00:00:11]               │ debg --- retry.try failed again with the same message...
[00:00:12]               │ debg --- retry.try error: expected 16 to sort of equal 17
[00:00:12]               └- ✓ pass  (2.1s) "task_manager scheduling and running tasks should reschedule if task returns runAt"
[00:00:12]             └-> should reschedule if task has an interval
[00:00:12]               └-> "before each" hook: global before each
[00:00:12]               └-> "before each" hook
[00:00:13]               └-> "before each" hook
[00:00:13]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:14]               │ debg --- retry.try failed again with the same message...
[00:00:14]               │ debg --- retry.try failed again with the same message...
[00:00:15]               │ debg --- retry.try failed again with the same message...
[00:00:15]               │ debg --- retry.try failed again with the same message...
[00:00:16]               │ debg --- retry.try failed again with the same message...
[00:00:16]               │ debg --- retry.try failed again with the same message...
[00:00:17]               │ debg --- retry.try failed again with the same message...
[00:00:17]               │ debg --- retry.try error: expected undefined to sort of equal 1
[00:00:18]               │ debg --- retry.try failed again with the same message...
[00:00:18]               └- ✓ pass  (5.2s) "task_manager scheduling and running tasks should reschedule if task has an interval"
[00:00:18]             └-> should support the deprecated interval field
[00:00:18]               └-> "before each" hook: global before each
[00:00:18]               └-> "before each" hook
[00:00:19]               └-> "before each" hook
[00:00:19]               │ proc [kibana]   log   [08:16:55.020] [warning][plugins][taskManager][taskManager] Task of type "sampleTask" has been scheduled with the deprecated 'interval' field which is due to be removed in a future release
[00:00:19]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:20]               │ debg --- retry.try failed again with the same message...
[00:00:20]               │ debg --- retry.try failed again with the same message...
[00:00:21]               │ debg --- retry.try failed again with the same message...
[00:00:21]               │ debg --- retry.try failed again with the same message...
[00:00:22]               │ debg --- retry.try failed again with the same message...
[00:00:22]               │ debg --- retry.try failed again with the same message...
[00:00:23]               │ debg --- retry.try failed again with the same message...
[00:00:23]               │ debg --- retry.try error: expected 1 to sort of equal 0
[00:00:24]               │ debg --- retry.try failed again with the same message...
[00:00:25]               └- ✓ pass  (5.2s) "task_manager scheduling and running tasks should support the deprecated interval field"
[00:00:25]             └-> should return a task run result when asked to run a task now
[00:00:25]               └-> "before each" hook: global before each
[00:00:25]               └-> "before each" hook
[00:00:25]               └-> "before each" hook
[00:00:25]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:26]               │ debg --- retry.try failed again with the same message...
[00:00:26]               │ debg --- retry.try failed again with the same message...
[00:00:27]               │ debg --- retry.try failed again with the same message...
[00:00:27]               │ debg --- retry.try failed again with the same message...
[00:00:28]               │ debg --- retry.try failed again with the same message...
[00:00:28]               │ debg --- retry.try failed again with the same message...
[00:00:29]               │ debg --- retry.try failed again with the same message...
[00:00:30]               │ debg --- retry.try error: expected 1 to sort of equal 2
[00:00:30]               │ debg --- retry.try failed again with the same message...
[00:00:31]               └- ✓ pass  (5.3s) "task_manager scheduling and running tasks should return a task run result when asked to run a task now"
[00:00:31]             └-> should prioritize tasks which are called using runNow
[00:00:31]               └-> "before each" hook: global before each
[00:00:31]               └-> "before each" hook
[00:00:31]               └-> "before each" hook
[00:00:31]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:32]               │ debg --- retry.try failed again with the same message...
[00:00:33]               │ debg --- retry.try failed again with the same message...
[00:00:33]               │ debg --- retry.try failed again with the same message...
[00:00:34]               │ debg --- retry.try failed again with the same message...
[00:00:34]               │ debg --- retry.try failed again with the same message...
[00:00:35]               │ debg --- retry.try failed again with the same message...
[00:00:35]               │ debg --- retry.try failed again with the same message...
[00:00:44]               │ debg --- retry.try error: expected 10 to sort of equal 0
[00:00:45]               │ debg --- retry.try failed again with the same message...
[00:00:45]               │ debg --- retry.try failed again with the same message...
[00:00:46]               │ debg --- retry.try failed again with the same message...
[00:00:47]               │ debg --- retry.try failed again with the same message...
[00:00:47]               │ debg --- retry.try failed again with the same message...
[00:00:48]               │ debg --- retry.try failed again with the same message...
[00:00:48]               │ debg --- retry.try error: expected 1 to sort of equal 0
[00:00:49]               │ debg --- retry.try failed again with the same message...
[00:00:49]               │ debg --- retry.try failed again with the same message...
[00:00:50]               │ debg --- retry.try failed again with the same message...
[00:00:50]               │ debg --- retry.try failed again with the same message...
[00:00:51]               │ debg --- retry.try failed again with the same message...
[00:00:51]               │ debg --- retry.try failed again with the same message...
[00:00:52]               └- ✓ pass  (20.4s) "task_manager scheduling and running tasks should prioritize tasks which are called using runNow"
[00:00:52]             └-> should return a task run error result when running a task now fails
[00:00:52]               └-> "before each" hook: global before each
[00:00:52]               └-> "before each" hook
[00:00:53]               └-> "before each" hook
[00:00:53]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:00:53]               │ debg --- retry.try failed again with the same message...
[00:00:54]               │ debg --- retry.try failed again with the same message...
[00:00:54]               │ debg --- retry.try failed again with the same message...
[00:00:55]               │ debg --- retry.try failed again with the same message...
[00:00:55]               │ debg --- retry.try failed again with the same message...
[00:00:56]               │ debg --- retry.try failed again with the same message...
[00:00:57]               │ proc [kibana]   log   [08:17:32.304] [error][plugins][taskManager][taskManager] Task sampleTask "9f566740-c673-11ea-9d7e-45fe5ef107ce" failed: Error: error on run now
[00:00:57]               └- ✓ pass  (3.9s) "task_manager scheduling and running tasks should return a task run error result when running a task now fails"
[00:00:57]             └-> should return a task run error result when trying to run a non-existent task
[00:00:57]               └-> "before each" hook: global before each
[00:00:57]               └-> "before each" hook
[00:00:57]               └-> "before each" hook
[00:00:57]               └- ✓ pass  (30ms) "task_manager scheduling and running tasks should return a task run error result when trying to run a non-existent task"
[00:00:57]             └-> should return a task run error result when trying to run a task now which is already running
[00:00:57]               └-> "before each" hook: global before each
[00:00:57]               └-> "before each" hook
[00:00:57]               └-> "before each" hook
[00:00:57]               │ debg --- retry.try error: Cannot read property 'status' of undefined
[00:00:57]               │ debg --- retry.try failed again with the same message...
[00:00:58]               │ debg --- retry.try error: expected 'idle' to sort of equal 'running'
[00:00:58]               │ debg --- retry.try failed again with the same message...
[00:00:59]               │ debg --- retry.try failed again with the same message...
[00:01:00]               │ debg --- retry.try error: expected 'claiming' to sort of equal 'running'
[00:01:00]               │ debg --- retry.try error: expected 0 to sort of equal 1
[00:01:01]               │ proc [kibana]   log   [08:17:36.249] [warning][plugins][taskManager][taskManager] [Task Ownership error]: (1) tasks were claimed by Kibana, but (2) tasks were fetched
[00:02:02]               │ proc [kibana]   log   [08:18:37.972] [warning][plugins][taskManager][taskManager] Cancelling task sampleTask "a1c14cc0-c673-11ea-9d7e-45fe5ef107ce" as it expired at 2020-07-15T08:18:34.960Z after running for 01m 03s (with timeout set at 1m).
[00:02:02]               │ proc [kibana]   log   [08:18:37.974] [warning][plugins][taskManager][taskManager] Cancelling task sampleTask "a1c14cc0-c673-11ea-9d7e-45fe5ef107ce" as it expired at 2020-07-15T08:18:36.250Z after running for 01m 01s (with timeout set at 1m).
[00:03:01]               └- ✖ fail: task_manager scheduling and running tasks should return a task run error result when trying to run a task now which is already running
[00:03:01]               │      Error: socket hang up
[00:03:01]               │       at createHangUpError (_http_client.js:332:15)
[00:03:01]               │       at Socket.socketOnEnd (_http_client.js:435:23)
[00:03:01]               │       at endReadableNT (_stream_readable.js:1145:12)
[00:03:01]               │       at process._tickCallback (internal/process/next_tick.js:63:19)
[00:03:01]               │ 
[00:03:01]               │

Stack Trace

{ Error: socket hang up
    at createHangUpError (_http_client.js:332:15)
    at Socket.socketOnEnd (_http_client.js:435:23)
    at endReadableNT (_stream_readable.js:1145:12)
    at process._tickCallback (internal/process/next_tick.js:63:19) code: 'ECONNRESET', response: undefined }

Build metrics

✅ unchanged

History

💔 Build #61791 failed 13d5b0b
💔 Build #61776 failed 1463e7c
💔 Build #61748 failed 7466595

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

spong added the backport This PR is a backport of another PR label Jul 15, 2020

Merge branch '7.x' into backport/7.x/pr-71696

c7363ec

Merge branch '7.x' into backport/7.x/pr-71696

1463e7c

Merge branch '7.x' into backport/7.x/pr-71696

13d5b0b

Merge branch '7.x' into backport/7.x/pr-71696

83449b9

peteharverson added the :ml label Jul 15, 2020

peteharverson merged commit 30d092f into elastic:7.x Jul 15, 2020

spong deleted the backport/7.x/pr-71696 branch July 15, 2020 15:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[7.x] [ML] Edits labelling of SIEM module and jobs from SIEM to Security (#71696)#71797

[7.x] [ML] Edits labelling of SIEM module and jobs from SIEM to Security (#71696)#71797
peteharverson merged 5 commits intoelastic:7.xfrom
spong:backport/7.x/pr-71696

spong commented Jul 15, 2020

Uh oh!

spong commented Jul 15, 2020

Uh oh!

spong commented Jul 15, 2020 •

edited

Loading

Uh oh!

spong commented Jul 15, 2020

Uh oh!

XavierM commented Jul 15, 2020

Uh oh!

patrykkopycinski commented Jul 15, 2020

Uh oh!

elasticmachine commented Jul 15, 2020

Uh oh!

kibanamachine commented Jul 15, 2020

Standard Out

Stack Trace

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

spong commented Jul 15, 2020

Uh oh!

spong commented Jul 15, 2020

Uh oh!

spong commented Jul 15, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

spong commented Jul 15, 2020

Uh oh!

XavierM commented Jul 15, 2020

Uh oh!

patrykkopycinski commented Jul 15, 2020

Uh oh!

elasticmachine commented Jul 15, 2020

Uh oh!

kibanamachine commented Jul 15, 2020

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Build metrics

History

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

spong commented Jul 15, 2020 •

edited

Loading