[test] consolidate top level yarn scripts by jbudz · Pull Request #44679 · elastic/kibana

jbudz · 2019-09-03T15:56:29Z

Dev Docs

Over time kibana has added a number of testing frameworks, but our top level scripts have remained the same to avoid workflow changes. The current naming convention with the number of test options can leave room for ambiguity.

This PR includes two general changes:

docs will refer to the yarn script, giving us an abstraction to migrate frameworks out and avoid workflow interruptions (grunt/gulp -> node scripts/*)
test scripts now refer to the test runner, as opposed to the test type (yarn test:server -> yarn test:mocha)

Closes #41133

elasticmachine · 2019-09-03T15:56:31Z

Pinging @elastic/kibana-operations

elasticmachine · 2019-09-03T17:32:37Z

💚 Build Succeeded

continuous-integration/kibana-ci/pull-request

elasticmachine · 2019-09-19T19:11:47Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request

jbudz · 2019-09-20T20:01:13Z

@elasticmachine merge upstream

elasticmachine · 2019-09-20T21:41:41Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request

tylersmalley · 2019-09-26T15:09:42Z

packages/kbn-plugin-generator/sao_template/template/package_template.json

    "start": "plugin-helpers start",
-    "test:server": "plugin-helpers test:server",
-    "test:browser": "plugin-helpers test:browser",
+    "test:mocha": "plugin-helpers test:server",


I find this redirection a bit confusing since we are calling these by the underlying test runner, where in plugin-helpers we are calling them by what they are testing.

Thoughts on changing those in plugin helpers? Or alias them there?

elasticmachine · 2019-11-25T17:21:26Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request
Commit: ff10e65

Over the last few years we've increased the number of test runners. Entry points by test type have become too lage of a category for unique names, so this moves top level test scripts under yarn and replaces test types with the runner name. e.g. `yarn test:browser` -> `yarn test:karma` Closes elastic#41133

jbudz · 2020-01-27T17:17:12Z

#56014 upstream

jbudz · 2020-01-27T17:17:32Z

@elasticmachine merge upstream

jbudz · 2020-01-30T16:45:01Z

@elasticmachine merge upstream

jbudz · 2020-02-03T13:45:39Z

@elasticmachine merge upstream

jbudz · 2020-02-04T22:09:08Z

sorry about the force push, only overwrote the elasticmachine merge

jbudz · 2020-02-06T14:48:17Z

@elastic/kibana-canvas is anyone available to take a look? https://github.com/elastic/kibana/pull/44679/files#diff-deb8813ae9843a9da52f812cba42f78d, short version is s/browser/karma, s/server/mocha when running tests

jbudz · 2020-02-06T22:25:34Z

@elasticmachine merge upstream

elasticmachine · 2020-02-06T23:52:50Z

💚 Build Succeeded

continuous-integration/kibana-ci/pull-request
Commit: 7608224

History

💚 Build #24439 succeeded 01a65c7
💚 Build #23999 succeeded 249bade71b0f859253b30d6a68d30bccd7304eb8
💚 Build #23576 succeeded 18b2025b4a0147afdc758176eb7dc917fea23b36
💚 Build #22774 succeeded 6478b84f7cf7e3ab3b28d4471741b479f072d331
💔 Build #22726 failed c92b887

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

jbudz · 2020-02-10T16:35:08Z

@elasticmachine merge upstream

jbudz · 2020-02-10T16:36:19Z

cc canvas team again :) this shouldn't have any workflow impact, i'll be merging shortly. let me know

poffdeluxe

canvas changes lgtm

jbudz · 2020-02-18T14:56:24Z

@elasticmachine merge upstream

* Refactor test entry by runner (#44679) Over the last few years we've increased the number of test runners. Entry points by test type have become too lage of a category for unique names, so this moves top level test scripts under yarn and replaces test types with the runner name. e.g. `yarn test:browser` -> `yarn test:karma` Closes #41133 Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> * fix merge Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

kibanamachine · 2020-04-10T18:09:12Z

💔 Build Failed

continuous-integration/kibana-ci/pull-request
Commit: 5b3b4c3

Test Failures

Kibana Pipeline / kibana-intake-agent / Jest Integration Tests.packages/kbn-plugin-generator/integration_tests.running the plugin-generator via 'node scripts/generate_plugin.js plugin-name' with default config then running with es instance 'yarn start' should result in the spec plugin being initialized on kibana's stdout

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 4 times on tracked branches: https://github.com/elastic/kibana/issues/54481

Stack Trace

Error: Command failed with exit code 126: ./bin/elasticsearch-keystore create
    at makeError (/var/lib/jenkins/workspace/elastic+kibana+pipeline-pull-request/kibana/node_modules/execa/lib/error.js:56:11)
    at handlePromise (/var/lib/jenkins/workspace/elastic+kibana+pipeline-pull-request/kibana/node_modules/execa/index.js:114:26)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Kibana Pipeline / kibana-oss-agent / Chrome UI Functional Tests.test/functional/apps/discover/_errors·js.discover app errors invalid scripted field error is rendered

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:01:45]         └-: discover app
[00:01:45]           └-> "before all" hook
[00:01:45]           └-> "before all" hook
[00:09:38]           └-: errors
[00:09:38]             └-> "before all" hook
[00:09:38]             └-> "before all" hook
[00:09:38]               │ info [logstash_functional] Loading "mappings.json"
[00:09:38]               │ info [logstash_functional] Loading "data.json.gz"
[00:09:38]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.22"
[00:09:38]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.20"
[00:09:38]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.21"
[00:09:39]               │ info [invalid_scripted_field] Loading "mappings.json"
[00:09:39]               │ info [invalid_scripted_field] Loading "data.json.gz"
[00:09:39]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_1/eQRg-hVARO66YJGjWJo0Dw] deleting index
[00:09:39]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/uz2fcYIGR12YzpTIZEyWNg] deleting index
[00:09:39]               │ info [invalid_scripted_field] Deleted existing index [".kibana_2",".kibana_1"]
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:09:39]               │ info [invalid_scripted_field] Created index ".kibana"
[00:09:39]               │ debg [invalid_scripted_field] ".kibana" settings {"index":{"number_of_replicas":"0","number_of_shards":"1"}}
[00:09:39]               │ info [invalid_scripted_field] Indexed 2 docs into ".kibana"
[00:09:39]               │ info Creating index .kibana_2.
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:09:39]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] updating number_of_replicas to [0] for indices [.kibana_2]
[00:09:39]               │ info Reindexing .kibana to .kibana_1
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:09:39]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:09:39]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] updating number_of_replicas to [0] for indices [.kibana_1]
[00:09:39]               │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] 8290 finished with response BulkByScrollResponse[took=22.6ms,timed_out=false,sliceId=null,updated=0,created=2,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:09:40]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana/6Yfbqqn8TBSLUmrPYNgxgg] deleting index
[00:09:40]               │ info Migrating .kibana_1 saved objects to .kibana_2
[00:09:40]               │ debg Migrating saved objects config:7.0.0-alpha1, index-pattern:18ea0c30-2d77-11e8-93f2-6f8a391f33ef
[00:09:40]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/14UaMU_MSCemrZ9gmuk45A] update_mapping [_doc]
[00:09:40]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/14UaMU_MSCemrZ9gmuk45A] update_mapping [_doc]
[00:09:40]               │ info Pointing alias .kibana to .kibana_2.
[00:09:40]               │ info Finished in 443ms.
[00:09:40]               │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:09:40]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/14UaMU_MSCemrZ9gmuk45A] update_mapping [_doc]
[00:09:41]               │ debg navigating to discover url: http://localhost:6161/app/kibana#/discover
[00:09:41]               │ debg Navigate to: http://localhost:6161/app/kibana#/discover
[00:09:41]               │ debg ... sleep(700) start
[00:09:41]               │ debg browser[INFO] http://localhost:6161/app/kibana?_t=1586540148267#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:41]               │
[00:09:41]               │ debg browser[INFO] http://localhost:6161/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:42]               │ debg ... sleep(700) end
[00:09:42]               │ debg returned from get, calling refresh
[00:09:42]               │ debg browser[INFO] http://localhost:6161/app/kibana?_t=1586540148267#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:42]               │
[00:09:42]               │ debg browser[INFO] http://localhost:6161/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:43]               │ debg currentUrl = http://localhost:6161/app/kibana#/discover
[00:09:43]               │          appUrl = http://localhost:6161/app/kibana#/discover
[00:09:43]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:46]               │ debg TestSubjects.find(kibanaChrome)
[00:09:46]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=10000
[00:09:46]               │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 67:139970 "INFO: 2020-04-10T17:35:51Z
[00:09:46]               │        Adding connection to http://localhost:6161/elasticsearch
[00:09:46]               │
[00:09:46]               │      "
[00:09:46]               │ debg ... sleep(501) start
[00:09:46]               │ debg ... sleep(501) end
[00:09:46]               │ debg in navigateTo url = http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:09:46]               │ debg --- retry.try error: URL changed, waiting for it to settle
[00:09:47]               │ debg ... sleep(501) start
[00:09:47]               │ debg ... sleep(501) end
[00:09:47]               │ debg in navigateTo url = http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:09:47]               │ debg TestSubjects.exists(statusPageContainer)
[00:09:47]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:09:50]               │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:09:50]             └-: invalid scripted field error
[00:09:50]               └-> "before all" hook
[00:09:50]               └-> is rendered
[00:09:50]                 └-> "before each" hook: global before each
[00:09:50]                 │ debg TestSubjects.exists(discoverFetchError)
[00:09:50]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="discoverFetchError"]') with timeout=2500
[00:09:53]                 │ debg --- retry.tryForTime error: [data-test-subj="discoverFetchError"] is not displayed
[00:09:53]                 │ info Taking screenshot "/dev/shm/workspace/kibana/test/functional/screenshots/failure/discover app errors invalid scripted field error is rendered.png"
[00:09:53]                 │ info Current URL is: http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:09:54]                 │ info Saving page source to: /dev/shm/workspace/kibana/test/functional/failure_debug/html/discover app errors invalid scripted field error is rendered.html
[00:09:54]                 └- ✖ fail: "discover app errors invalid scripted field error is rendered"
[00:09:54]                 │

Stack Trace

Error: expected false to equal true
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (packages/kbn-expect/expect.js:227:8)
    at Assertion.be (packages/kbn-expect/expect.js:69:22)
    at Context.it (test/functional/apps/discover/_errors.js:41:40)

Kibana Pipeline / kibana-oss-agent / Chrome UI Functional Tests.test/functional/apps/discover/_errors·js.discover app errors invalid scripted field error is rendered

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:01:51]         └-: discover app
[00:01:51]           └-> "before all" hook
[00:01:51]           └-> "before all" hook
[00:10:03]           └-: errors
[00:10:03]             └-> "before all" hook
[00:10:03]             └-> "before all" hook
[00:10:03]               │ info [logstash_functional] Loading "mappings.json"
[00:10:03]               │ info [logstash_functional] Loading "data.json.gz"
[00:10:03]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.22"
[00:10:03]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.20"
[00:10:03]               │ info [logstash_functional] Skipped restore for existing index "logstash-2015.09.21"
[00:10:04]               │ info [invalid_scripted_field] Loading "mappings.json"
[00:10:04]               │ info [invalid_scripted_field] Loading "data.json.gz"
[00:10:04]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/2nIy0OKNSS-XNGAKwu6UFg] deleting index
[00:10:04]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_1/Vug_bUs1QcmqAlKcbuegcg] deleting index
[00:10:04]               │ info [invalid_scripted_field] Deleted existing index [".kibana_2",".kibana_1"]
[00:10:04]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:10:04]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana] creating index, cause [api], templates [], shards [1]/[0], mappings [_doc]
[00:10:04]               │ info [invalid_scripted_field] Created index ".kibana"
[00:10:04]               │ debg [invalid_scripted_field] ".kibana" settings {"index":{"number_of_replicas":"0","number_of_shards":"1"}}
[00:10:04]               │ info [invalid_scripted_field] Indexed 2 docs into ".kibana"
[00:10:05]               │ info Creating index .kibana_2.
[00:10:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:10:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:10:05]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] updating number_of_replicas to [0] for indices [.kibana_2]
[00:10:05]               │ info Reindexing .kibana to .kibana_1
[00:10:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] applying create index request using v1 templates []
[00:10:05]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1], mappings [_doc]
[00:10:05]               │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] updating number_of_replicas to [0] for indices [.kibana_1]
[00:10:05]               │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] 8331 finished with response BulkByScrollResponse[took=15.5ms,timed_out=false,sliceId=null,updated=0,created=2,deleted=0,batches=1,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:10:05]               │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana/64YcjBltRuGTUeGKxCu_Sw] deleting index
[00:10:05]               │ info Migrating .kibana_1 saved objects to .kibana_2
[00:10:05]               │ debg Migrating saved objects config:7.0.0-alpha1, index-pattern:18ea0c30-2d77-11e8-93f2-6f8a391f33ef
[00:10:05]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/CpCmXdADT02nC4Xxh_zUhg] update_mapping [_doc]
[00:10:05]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/CpCmXdADT02nC4Xxh_zUhg] update_mapping [_doc]
[00:10:05]               │ info Pointing alias .kibana to .kibana_2.
[00:10:05]               │ info Finished in 424ms.
[00:10:05]               │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:10:06]               │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xl-1586537601577777805] [.kibana_2/CpCmXdADT02nC4Xxh_zUhg] update_mapping [_doc]
[00:10:07]               │ debg navigating to discover url: http://localhost:6161/app/kibana#/discover
[00:10:07]               │ debg Navigate to: http://localhost:6161/app/kibana#/discover
[00:10:07]               │ debg ... sleep(700) start
[00:10:07]               │ debg browser[INFO] http://localhost:6161/app/kibana?_t=1586539453365#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:07]               │
[00:10:07]               │ debg browser[INFO] http://localhost:6161/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:07]               │ debg ... sleep(700) end
[00:10:07]               │ debg returned from get, calling refresh
[00:10:08]               │ debg browser[INFO] http://localhost:6161/app/kibana?_t=1586539453365#/discover 350 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:08]               │
[00:10:08]               │ debg browser[INFO] http://localhost:6161/bundles/app/kibana/bootstrap.js 9:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:08]               │ debg currentUrl = http://localhost:6161/app/kibana#/discover
[00:10:08]               │          appUrl = http://localhost:6161/app/kibana#/discover
[00:10:08]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:10:11]               │ debg TestSubjects.find(kibanaChrome)
[00:10:11]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=10000
[00:10:11]               │ debg browser[INFO] http://localhost:6161/bundles/plugin/data/data.plugin.js 67:139970 "INFO: 2020-04-10T17:24:17Z
[00:10:11]               │        Adding connection to http://localhost:6161/elasticsearch
[00:10:11]               │
[00:10:11]               │      "
[00:10:11]               │ debg ... sleep(501) start
[00:10:12]               │ debg ... sleep(501) end
[00:10:12]               │ debg in navigateTo url = http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:10:12]               │ debg --- retry.try error: URL changed, waiting for it to settle
[00:10:12]               │ debg ... sleep(501) start
[00:10:13]               │ debg ... sleep(501) end
[00:10:13]               │ debg in navigateTo url = http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:10:13]               │ debg TestSubjects.exists(statusPageContainer)
[00:10:13]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:10:15]               │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:10:16]             └-: invalid scripted field error
[00:10:16]               └-> "before all" hook
[00:10:16]               └-> is rendered
[00:10:16]                 └-> "before each" hook: global before each
[00:10:16]                 │ debg TestSubjects.exists(discoverFetchError)
[00:10:16]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="discoverFetchError"]') with timeout=2500
[00:10:18]                 │ debg --- retry.tryForTime error: [data-test-subj="discoverFetchError"] is not displayed
[00:10:19]                 │ info Taking screenshot "/dev/shm/workspace/kibana/test/functional/screenshots/failure/discover app errors invalid scripted field error is rendered.png"
[00:10:19]                 │ info Current URL is: http://localhost:6161/app/kibana#/discover?_g=()&_a=(columns:!(_source),index:%2718ea0c30-2d77-11e8-93f2-6f8a391f33ef%27,interval:auto,query:(language:kuery,query:%27%27),sort:!())
[00:10:19]                 │ info Saving page source to: /dev/shm/workspace/kibana/test/functional/failure_debug/html/discover app errors invalid scripted field error is rendered.html
[00:10:19]                 └- ✖ fail: "discover app errors invalid scripted field error is rendered"
[00:10:19]                 │

Stack Trace

Error: expected false to equal true
    at Assertion.assert (packages/kbn-expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (packages/kbn-expect/expect.js:227:8)
    at Assertion.be (packages/kbn-expect/expect.js:69:22)
    at Context.it (test/functional/apps/discover/_errors.js:41:40)

History

💚 Build #27334 succeeded 5b3b4c3
💚 Build #25639 succeeded e413d55
💚 Build #25106 succeeded 7608224
💚 Build #24439 succeeded 01a65c7
💚 Build #23999 succeeded 249bade71b0f859253b30d6a68d30bccd7304eb8

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

Over the last few years we've increased the number of test runners. Entry points by test type have become too lage of a category for unique names, so this moves top level test scripts under yarn and replaces test types with the runner name. e.g. `yarn test:browser` -> `yarn test:karma` Closes elastic#41133 Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> # Conflicts: # packages/kbn-plugin-generator/sao_template/template/README.md # packages/kbn-plugin-helpers/lib/tasks.js # test/scripts/jenkins_xpack.sh

spalger · 2020-05-15T17:44:57Z

Backporting to 7.6 for consistency

kibanamachine · 2020-05-19T17:48:44Z

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create backports run node scripts/backport --pr 44679 or prevent reminders by adding the backport:skip label.

spalger · 2020-05-19T21:30:24Z

#66793 (comment)

Okay, this wasn't trivial and it's probably not worth it to backport to 7.6 anyway.

jbudz added review Team:Operations Kibana-Operations Team release_note:plugin_api_changes Contains a Plugin API changes section for the breaking plugin API changes section. labels Sep 3, 2019

jbudz changed the title ~~Test/npm~~ [test] consolidate top level yarn scripts Sep 3, 2019

jbudz added v7.5.0 v8.0.0 labels Sep 19, 2019

tylersmalley reviewed Sep 26, 2019

View reviewed changes

jbudz force-pushed the test/npm branch from ff10e65 to c92b887 Compare January 27, 2020 15:41

jbudz requested a review from a team as a code owner January 27, 2020 15:41

jbudz added v7.7.0 and removed v7.5.0 labels Jan 27, 2020

tylersmalley approved these changes Feb 3, 2020

View reviewed changes

Merge branch 'master' into test/npm

01a65c7

jbudz force-pushed the test/npm branch from 249bade to 01a65c7 Compare February 4, 2020 22:08

Merge branch 'master' into test/npm

7608224

elastic deleted a comment from kibanamachine Feb 6, 2020

Merge branch 'master' into test/npm

e413d55

poffdeluxe approved these changes Feb 10, 2020

View reviewed changes

Merge branch 'master' into test/npm

5b3b4c3

jbudz merged commit 76d475a into elastic:master Feb 18, 2020

spalger mentioned this pull request May 15, 2020

[7.6] Refactor test entry by runner (#44679) #66793

Closed

spalger added the v7.6.3 label May 15, 2020

kibanamachine added the backport missing Added to PRs automatically when the are determined to be missing a backport. label May 19, 2020

spalger added the backport:skip This PR does not require backporting label May 19, 2020

kibanamachine removed the backport missing Added to PRs automatically when the are determined to be missing a backport. label May 19, 2020

spalger added backported and removed backport:skip This PR does not require backporting labels May 19, 2020

Conversation

jbudz commented Sep 3, 2019 • edited by jinmu03 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Dev Docs

Uh oh!

elasticmachine commented Sep 3, 2019

Uh oh!

elasticmachine commented Sep 3, 2019

💚 Build Succeeded

Uh oh!

elasticmachine commented Sep 19, 2019

💔 Build Failed

Uh oh!

jbudz commented Sep 20, 2019

Uh oh!

elasticmachine commented Sep 20, 2019

💔 Build Failed

Uh oh!

tylersmalley Sep 26, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

elasticmachine commented Nov 25, 2019

💔 Build Failed

Uh oh!

jbudz commented Jan 27, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

jbudz commented Jan 27, 2020

Uh oh!

jbudz commented Jan 30, 2020

Uh oh!

jbudz commented Feb 3, 2020

Uh oh!

jbudz commented Feb 4, 2020

Uh oh!

jbudz commented Feb 6, 2020

Uh oh!

jbudz commented Feb 6, 2020

Uh oh!

elasticmachine commented Feb 6, 2020

💚 Build Succeeded

History

Uh oh!

jbudz commented Feb 10, 2020

Uh oh!

jbudz commented Feb 10, 2020

Uh oh!

poffdeluxe left a comment

Choose a reason for hiding this comment

Uh oh!

jbudz commented Feb 18, 2020

Uh oh!

kibanamachine commented Apr 10, 2020

💔 Build Failed

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Standard Out

Stack Trace

History

Uh oh!

spalger commented May 15, 2020

Uh oh!

kibanamachine commented May 19, 2020

Uh oh!

spalger commented May 19, 2020

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

jbudz commented Sep 3, 2019 •

edited by jinmu03

Loading

tylersmalley Sep 26, 2019 •

edited

Loading

jbudz commented Jan 27, 2020 •

edited

Loading