Skip to content

[SIEM] Updates cosumer in export_rule archive#71117

Merged
MadameSheema merged 1 commit intoelastic:masterfrom
MadameSheema:updates-export-archive
Jul 9, 2020
Merged

[SIEM] Updates cosumer in export_rule archive#71117
MadameSheema merged 1 commit intoelastic:masterfrom
MadameSheema:updates-export-archive

Conversation

@MadameSheema
Copy link
Copy Markdown
Contributor

@MadameSheema MadameSheema commented Jul 8, 2020

Summary

In this PR we are updating the consumer of the export_rule archive to siem.

This should fix a failing test seen in The Alerting PR #67157

@MadameSheema MadameSheema added Team:SIEM v8.0.0 release_note:skip Skip the PR/issue when compiling release notes v7.9.0 labels Jul 8, 2020
@MadameSheema MadameSheema self-assigned this Jul 8, 2020
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/siem (Team:SIEM)

Copy link
Copy Markdown
Contributor

@gmmorris gmmorris left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I saw the fix in real time so feel comfortable saying 👍

Thanks Glo

Copy link
Copy Markdown
Contributor

@dhurley14 dhurley14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verified the change from "consumer": "securitySolution" in the zipped json to "consumer": "siem". LGTM! Thanks :)

@kibanamachine
Copy link
Copy Markdown
Contributor

💛 Build succeeded, but was flaky


Test Failures

Firefox UI Functional Tests.test/functional/apps/visualize/_tsvb_chart·ts.visualize app visual builder "before each" hook for "should verify topN label and count display"

Link to Jenkins

Standard Out

[00:00:00]       │
[00:12:24]         └-: visualize app
[00:12:24]           └-> "before all" hook
[00:12:24]           └-> "before all" hook
[00:12:24]             │ debg Starting visualize before method
[00:12:25]             │ info [logstash_functional] Loading "mappings.json"
[00:12:25]             │ info [logstash_functional] Loading "data.json.gz"
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.22] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.22][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.22][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.22"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.22" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.20] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.20][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.20][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.20"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.20" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:25]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [logstash-2015.09.21] creating index, cause [api], templates [], shards [1]/[0]
[00:12:25]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.21][0]]])." previous.health="YELLOW" reason="shards started [[logstash-2015.09.21][0]]"
[00:12:25]             │ info [logstash_functional] Created index "logstash-2015.09.21"
[00:12:25]             │ debg [logstash_functional] "logstash-2015.09.21" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:35]             │ info progress: 13545
[00:12:35]             │ info [logstash_functional] Indexed 4633 docs into "logstash-2015.09.22"
[00:12:35]             │ info [logstash_functional] Indexed 4757 docs into "logstash-2015.09.20"
[00:12:35]             │ info [logstash_functional] Indexed 4614 docs into "logstash-2015.09.21"
[00:12:35]             │ info [long_window_logstash] Loading "mappings.json"
[00:12:35]             │ info [long_window_logstash] Loading "data.json.gz"
[00:12:35]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [long-window-logstash-0] creating index, cause [api], templates [], shards [1]/[0]
[00:12:35]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] current.health="GREEN" message="Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[long-window-logstash-0][0]]])." previous.health="YELLOW" reason="shards started [[long-window-logstash-0][0]]"
[00:12:35]             │ info [long_window_logstash] Created index "long-window-logstash-0"
[00:12:35]             │ debg [long_window_logstash] "long-window-logstash-0" settings {"index":{"analysis":{"analyzer":{"makelogs_url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:12:45]             │ info progress: 12040
[00:12:47]             │ info [long_window_logstash] Indexed 14005 docs into "long-window-logstash-0"
[00:12:47]             │ info [visualize] Loading "mappings.json"
[00:12:47]             │ info [visualize] Loading "data.json"
[00:12:47]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/Q5Ogh-ASSO6_GUZReRM-9g] deleting index
[00:12:47]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_1/UIJJNfTBSCyj0KeXnXSG_Q] deleting index
[00:12:47]             │ info [visualize] Deleted existing index [".kibana_2",".kibana_1"]
[00:12:47]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:12:47]             │ info [visualize] Created index ".kibana"
[00:12:47]             │ debg [visualize] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:12:47]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] update_mapping [_doc]
[00:12:47]             │ info [visualize] Indexed 12 docs into ".kibana"
[00:12:47]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] update_mapping [_doc]
[00:12:47]             │ debg Migrating saved objects
[00:12:47]             │ proc [kibana]   log   [16:44:30.530] [info][savedobjects-service] Creating index .kibana_2.
[00:12:47]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:12:47]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] updating number_of_replicas to [0] for indices [.kibana_2]
[00:12:48]             │ proc [kibana]   log   [16:44:30.581] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:12:48]             │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:12:48]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] updating number_of_replicas to [0] for indices [.kibana_1]
[00:12:48]             │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] 9077 finished with response BulkByScrollResponse[took=26.6ms,timed_out=false,sliceId=null,updated=0,created=12,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:12:48]             │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana/Par3N9sXTYiJLsxO3Ues0Q] deleting index
[00:12:48]             │ proc [kibana]   log   [16:44:30.918] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:12:48]             │ proc [kibana]   log   [16:44:30.936] [error][savedobjects-service] Error: Unable to migrate the corrupt Saved Object document index-pattern:test_index*. To prevent Kibana from performing a migration on every restart, please delete or fix this document by ensuring that the namespace and type in the document's id matches the values in the namespace and type fields.
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:48]             │ proc [kibana]   log   [16:44:31.019] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:12:48]             │ proc [kibana]   log   [16:44:31.074] [info][savedobjects-service] Finished in 545ms.
[00:12:48]             │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:12:48]             │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-ubuntu-16-tests-xxl-1594224671117808553] [.kibana_2/3vf-bigEQUeNGkDljqoe6w] update_mapping [_doc]
[00:12:50]             │ debg replacing kibana config doc: {"defaultIndex":"logstash-*","format:bytes:defaultPattern":"0,0.[000]b"}
[00:13:24]           └-: 
[00:13:24]             └-> "before all" hook
[00:13:24]             └-: visual builder
[00:13:24]               └-> "before all" hook

Stack Trace

Error: retry.try timeout: Error: retry.try timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="createVisualizationPromptButton"])
Wait timed out after 10007ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (test/common/services/retry/retry_for_success.ts:68:13)
    at onFailure (test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (test/common/services/retry/retry_for_success.ts:68:13)

Build metrics

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@MadameSheema MadameSheema merged commit 716d56e into elastic:master Jul 9, 2020
MadameSheema added a commit to MadameSheema/kibana that referenced this pull request Jul 9, 2020
gmmorris added a commit to gmmorris/kibana that referenced this pull request Jul 9, 2020
* master: (39 commits)
  [APM] Add warning to notify user about legacy ML jobs (elastic#71030)
  updates consumer to siem (elastic#71117)
  Index pattern creation flow - fix spelling (elastic#71192)
  [Security Solution][Endpoint] User Manifest Cleanup + Artifact Compression (elastic#70759)
  [SECURITY] Rearrange rule name's column in Alert Table (elastic#71020)
  [SECURITY] Alerts back to Detections (elastic#71142)
  [Security Solution][Exceptions Builder] - Fixes operator selection bug (elastic#71178)
  [SIEM][Detection Engine] Speeds up value list imports by enabling streaming of files.
  [APM] Update ML job ID in data telemetry tasks (elastic#71044)
  [Resolver] Remove `currentPanelView` selector (elastic#71154)
  add meta.managed to index templates (elastic#71135)
  Clarify trial subscription levels (elastic#70900)
  [Security Solution] fix panel links (elastic#71148)
  skip flaky suite (elastic#69632)
  skip suite failing ES Promotion (elastic#71018)
  [ML] DF Analytics: add results field to wizard and show regression stats (elastic#70893)
  [SIEM] update wordings (elastic#71119)
  [SECURITY SOLUTION] Rename to hosts and administration (elastic#70913)
  [ML] Improvements for urlState hook. (elastic#70576)
  Removing uptime guide (elastic#71124)
  ...
MadameSheema added a commit that referenced this pull request Jul 9, 2020
@MadameSheema MadameSheema deleted the updates-export-archive branch July 14, 2021 10:41
@MindyRS MindyRS added the Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. label Sep 23, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

release_note:skip Skip the PR/issue when compiling release notes Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. Team:SIEM v7.9.0 v8.0.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants