[7.6] Refactor test entry by runner (#44679) by spalger · Pull Request #66793 · elastic/kibana

spalger · 2020-05-15T17:44:32Z

Backports the following commits to 7.6:

Refactor test entry by runner ([test] consolidate top level yarn scripts #44679)

Over the last few years we've increased the number of test runners. Entry points by test type have become too lage of a category for unique names, so this moves top level test scripts under yarn and replaces test types with the runner name. e.g. `yarn test:browser` -> `yarn test:karma` Closes elastic#41133 Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> # Conflicts: # packages/kbn-plugin-generator/sao_template/template/README.md # packages/kbn-plugin-helpers/lib/tasks.js # test/scripts/jenkins_xpack.sh

spalger · 2020-05-15T19:01:22Z

Okay, this wasn't trivial and it's probably not worth it to backport to 7.6 anyway.

kibanamachine · 2020-05-15T19:17:19Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request
Commit: f455d6a
Pipeline Steps (look for red circles / failed steps)
Interpreting CI Failures

Failed CI Steps

Test Failures

Kibana Pipeline / kibana-oss-agent / Chrome UI Functional Tests.test/functional/apps/context/_date_nanos·js.context app context view for date_nanos displays correctly when predecessors and successors are loaded

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 10 times on tracked branches: https://github.com/elastic/kibana/issues/58760

[00:00:00]       │
[00:00:12]         └-: context app
[00:00:12]           └-> "before all" hook
[00:00:12]           └-> "before all" hook
[00:00:12]             │ info [logstash_functional] Loading "mappings.json"
[00:00:12]             │ info [logstash_functional] Loading "data.json.gz"
[00:00:12]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [logstash-2015.09.22] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:00:12]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.22][0]]]).
[00:00:12]             │ info [logstash_functional] Created index "logstash-2015.09.22"
[00:00:12]             │ debg [logstash_functional] "logstash-2015.09.22" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:12]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [logstash-2015.09.20] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:00:12]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.20][0]]]).
[00:00:12]             │ info [logstash_functional] Created index "logstash-2015.09.20"
[00:00:12]             │ debg [logstash_functional] "logstash-2015.09.20" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:12]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [logstash-2015.09.21] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:00:12]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[logstash-2015.09.21][0]]]).
[00:00:12]             │ info [logstash_functional] Created index "logstash-2015.09.21"
[00:00:12]             │ debg [logstash_functional] "logstash-2015.09.21" settings {"index":{"analysis":{"analyzer":{"url":{"max_token_length":"1000","tokenizer":"uax_url_email","type":"standard"}}},"number_of_replicas":"0","number_of_shards":"1"}}
[00:00:22]             │ info progress: 13240
[00:00:23]             │ info [visualize] Loading "mappings.json"
[00:00:23]             │ info [visualize] Loading "data.json"
[00:00:23]             │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_1/_Q1Duyj8SjGq0uop7-s2yg] deleting index
[00:00:23]             │ info [visualize] Deleted existing index [".kibana_1"]
[00:00:23]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:00:23]             │ info [visualize] Created index ".kibana"
[00:00:23]             │ debg [visualize] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:00:23]             │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana/0Oxq-BujQkiUwjov0ET0RA] update_mapping [_doc]
[00:00:31]             │ info Creating index .kibana_2.
[00:00:31]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:00:31]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] updating number_of_replicas to [0] for indices [.kibana_2]
[00:00:31]             │ info Reindexing .kibana to .kibana_1
[00:00:31]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:00:31]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] updating number_of_replicas to [0] for indices [.kibana_1]
[00:00:31]             │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.tasks] creating index, cause [auto(task api)], templates [], shards [1]/[1], mappings [task]
[00:00:31]             │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] updating number_of_replicas to [0] for indices [.tasks]
[00:00:31]             │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] 866 finished with response BulkByScrollResponse[took=57.9ms,timed_out=false,sliceId=null,updated=0,created=7,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:00:31]             │ info [o.e.c.m.MetaDataDeleteIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana/0Oxq-BujQkiUwjov0ET0RA] deleting index
[00:00:31]             │ info Migrating .kibana_1 saved objects to .kibana_2
[00:00:31]             │ debg Migrating saved objects index-pattern:logstash-*, index-pattern:logstash*, index-pattern:long-window-logstash-*, visualization:Shared-Item-Visualization-AreaChart, visualization:68305470-87bc-11e9-a991-3b492a7c3e09, visualization:64983230-87bf-11e9-a991-3b492a7c3e09, visualization:5d2de430-87c0-11e9-a991-3b492a7c3e09
[00:00:31]             │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_2/WH1oXLfIS_6IHarf7Zx0pg] update_mapping [_doc]
[00:00:31]             │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_2/WH1oXLfIS_6IHarf7Zx0pg] update_mapping [_doc]
[00:00:31]             │ info Pointing alias .kibana to .kibana_2.
[00:00:31]             │ info Finished in 593ms.
[00:00:31]             │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC","telemetry:optIn":false}
[00:00:32]             │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_2/WH1oXLfIS_6IHarf7Zx0pg] update_mapping [_doc]
[00:00:33]             │ debg replacing kibana config doc: {"defaultIndex":"logstash-*"}
[00:00:33]             │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_2/WH1oXLfIS_6IHarf7Zx0pg] update_mapping [_doc]
[00:00:34]             │ debg navigating to discover url: http://localhost:6121/app/kibana#/discover
[00:00:34]             │ debg browser[INFO] http://localhost:6121/app/kibana?_t=1589565820559#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:34]             │
[00:00:34]             │ debg browser[INFO] http://localhost:6121/bundles/app/kibana/bootstrap.js 8:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:34]             │ debg ... sleep(700) start
[00:00:34]             │ debg ... sleep(700) end
[00:00:34]             │ debg returned from get, calling refresh
[00:00:35]             │ debg browser[INFO] http://localhost:6121/app/kibana?_t=1589565820559#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:35]             │
[00:00:35]             │ debg browser[INFO] http://localhost:6121/bundles/app/kibana/bootstrap.js 8:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:35]             │ debg currentUrl = http://localhost:6121/app/kibana#/discover
[00:00:35]             │          appUrl = http://localhost:6121/app/kibana#/discover
[00:00:35]             │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:37]             │ debg TestSubjects.find(kibanaChrome)
[00:00:37]             │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=10000
[00:00:37]             │ debg browser[INFO] http://localhost:6121/built_assets/dlls/vendors_2.bundle.dll.js 36:140950 "INFO: 2020-05-15T18:03:43Z
[00:00:37]             │        Adding connection to http://localhost:6121/elasticsearch
[00:00:37]             │
[00:00:37]             │      "
[00:00:37]             │ debg ... sleep(501) start
[00:00:37]             │ debg ... sleep(501) end
[00:00:37]             │ debg in navigateTo url = http://localhost:6121/app/kibana#/discover?_g=()
[00:00:37]             │ debg TestSubjects.exists(statusPageContainer)
[00:00:37]             │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:00:40]             │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:03:21]           └-: context view for date_nanos
[00:03:21]             └-> "before all" hook
[00:03:21]             └-> "before all" hook
[00:03:21]               │ info [date_nanos] Loading "mappings.json"
[00:03:21]               │ info [date_nanos] Loading "data.json"
[00:03:21]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [date-nanos] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:03:21]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[date-nanos][0]]]).
[00:03:21]               │ info [date_nanos] Created index "date-nanos"
[00:03:21]               │ debg [date_nanos] "date-nanos" settings {"index":{"number_of_replicas":"0","number_of_shards":"1"}}
[00:03:21]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [date-nanos/4yO2mgcJRVuT2KZa8T-0ag] update_mapping [_doc]
[00:03:21]               │ debg TestSubjects.exists(filter filter-disabled filter-key-geo.src filter-value-IN)
[00:03:21]               │ debg Find.existsByCssSelector('[data-test-subj="filter filter-disabled filter-key-geo.src filter-value-IN"]') with timeout=2500
[00:03:21]               │ info Creating index .kibana_3.
[00:03:21]               │ info [o.e.c.m.MetaDataCreateIndexService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:03:21]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] updating number_of_replicas to [0] for indices [.kibana_3]
[00:03:21]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_3][0]]]).
[00:03:21]               │ info Migrating .kibana_2 saved objects to .kibana_3
[00:03:21]               │ debg Migrating saved objects index-pattern:logstash*, index-pattern:long-window-logstash-*, visualization:Shared-Item-Visualization-AreaChart, visualization:68305470-87bc-11e9-a991-3b492a7c3e09, visualization:64983230-87bf-11e9-a991-3b492a7c3e09, visualization:5d2de430-87c0-11e9-a991-3b492a7c3e09, config:7.6.3-SNAPSHOT, index-pattern:logstash-*, ui-metric:kibana-user_agent:Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) HeadlessChrome/81.0.4044.122 Safari/537.36, index-pattern:date-nanos, search:ab12e3c0-f231-11e6-9486-733b1ac9221a
[00:03:21]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3/GGV23P_rRNWkLB1motaP-g] update_mapping [_doc]
[00:03:21]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3/GGV23P_rRNWkLB1motaP-g] update_mapping [_doc]
[00:03:21]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3/GGV23P_rRNWkLB1motaP-g] update_mapping [_doc]
[00:03:21]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3/GGV23P_rRNWkLB1motaP-g] update_mapping [_doc]
[00:03:21]               │ info Pointing alias .kibana to .kibana_3.
[00:03:21]               │ info Finished in 250ms.
[00:03:21]               │ debg replacing kibana config doc: {"defaultIndex":"date-nanos"}
[00:03:22]               │ debg applying update to kibana config: {"context:defaultSize":"1","context:step":"3"}
[00:03:22]               │ info [o.e.c.m.MetaDataMappingService] [kibana-ci-immutable-oraclelinux-tests-xl-1589564711174272160] [.kibana_3/GGV23P_rRNWkLB1motaP-g] update_mapping [_doc]
[00:03:23]             └-> displays predessors - anchor - successors in right order 
[00:03:23]             └-> displays correctly when predecessors and successors are loaded
[00:03:23]               └-> "before each" hook: global before each
[00:03:24]               │ debg browser.get(http://localhost:6121/app/kibana#/context/date-nanos/AU_x3-TaGFA8no6Qjisd?_a=(columns:!('@message')))
[00:03:24]               │ debg --- retry.try failed again with the same message...
[00:03:24]               │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:03:24]               │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:03:24]               │ debg browser[INFO] http://localhost:6121/app/kibana?_t=1589565990525#/context/date-nanos/AU_x3-TaGFA8no6Qjisd?_a=(columns:!(%27@message%27)) 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:03:24]               │
[00:03:24]               │ debg browser[INFO] http://localhost:6121/bundles/app/kibana/bootstrap.js 8:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:03:24]               │ debg TestSubjects.exists(filter filter-disabled filter-key-geo.src filter-value-IN)
[00:03:24]               │ debg Find.existsByCssSelector('[data-test-subj="filter filter-disabled filter-key-geo.src filter-value-IN"]') with timeout=2500
[00:03:27]               │ debg browser[INFO] http://localhost:6121/built_assets/dlls/vendors_2.bundle.dll.js 36:140950 "INFO: 2020-05-15T18:06:33Z
[00:03:27]               │        Adding connection to http://localhost:6121/elasticsearch
[00:03:27]               │
[00:03:27]               │      "
[00:03:27]               │ debg TestSubjects.find(successorsLoadMoreButton)
[00:03:27]               │ debg Find.findByCssSelector('[data-test-subj="successorsLoadMoreButton"]') with timeout=10000
[00:03:37]               │ debg --- retry.try failed again with the same message...
[00:03:37]               │ debg TestSubjects.find(predecessorsLoadMoreButton)
[00:03:37]               │ debg Find.findByCssSelector('[data-test-subj="predecessorsLoadMoreButton"]') with timeout=10000
[00:03:37]               │ debg ... sleep(1000) start
[00:03:37]               └- ✖ fail: "context app context view for date_nanos displays correctly when predecessors and successors are loaded"
[00:03:37]               │

Stack Trace

{ DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
    at emitDeprecationWarning (internal/process/promises.js:111:13)
    at emitWarning (internal/process/promises.js:104:3)
    at emitPromiseRejectionWarnings (internal/process/promises.js:143:7)
    at process._tickCallback (internal/process/next_tick.js:69:34) name: 'DeprecationWarning', code: 'DEP0018', uncaught: true }

Kibana Pipeline / kibana-intake-agent / Jest Integration Tests.packages/kbn-plugin-generator/integration_tests.running the plugin-generator via 'node scripts/generate_plugin.js plugin-name' with default config then running 'yarn test:karma' should exit 0

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 5 times on tracked branches: https://github.com/elastic/kibana/issues/59226

Stack Trace

Error: Command failed with exit code 1: yarn test:karma
    at makeError (/var/lib/jenkins/workspace/elastic+kibana+pipeline-pull-request/kibana/node_modules/execa/lib/error.js:56:11)
    at handlePromise (/var/lib/jenkins/workspace/elastic+kibana+pipeline-pull-request/kibana/node_modules/execa/index.js:114:26)
    at process._tickCallback (internal/process/next_tick.js:68:7)

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

spalger added backport This PR is a backport of another PR and removed backport This PR is a backport of another PR labels May 15, 2020

spalger mentioned this pull request May 15, 2020

[kbn/plugin-helpers] typescript-ify #66513

Merged

spalger closed this May 15, 2020

spalger deleted the backport/7.6/pr-44679 branch May 15, 2020 19:02

spalger mentioned this pull request May 19, 2020

[test] consolidate top level yarn scripts #44679

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[7.6] Refactor test entry by runner (#44679)#66793

[7.6] Refactor test entry by runner (#44679)#66793
spalger wants to merge 1 commit intoelastic:7.6from
spalger:backport/7.6/pr-44679

spalger commented May 15, 2020

Uh oh!

spalger commented May 15, 2020

Uh oh!

kibanamachine commented May 15, 2020

Standard Out

Stack Trace

Standard Out

Stack Trace

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

spalger commented May 15, 2020

Uh oh!

spalger commented May 15, 2020

Uh oh!

kibanamachine commented May 15, 2020

💔 Build Failed

Failed CI Steps

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants