Skip to content

[Fleet] Bootstrap functional test suite#91898

Merged
Zacqary merged 3 commits intoelastic:masterfrom
Zacqary:87669-fleet-test-bootstrap
Feb 18, 2021
Merged

[Fleet] Bootstrap functional test suite#91898
Zacqary merged 3 commits intoelastic:masterfrom
Zacqary:87669-fleet-test-bootstrap

Conversation

@Zacqary
Copy link
Copy Markdown
Contributor

@Zacqary Zacqary commented Feb 18, 2021

Summary

Closes #87669

Sets up the fleet_functional test directory and adds an initial test of Overview page integrity.

Checklist

@Zacqary Zacqary added v8.0.0 release_note:skip Skip the PR/issue when compiling release notes Feature:Fleet Fleet team's agent central management project Team:Fleet Team label for Observability Data Collection Fleet team v7.13.0 labels Feb 18, 2021
@Zacqary Zacqary requested a review from a team as a code owner February 18, 2021 18:25
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Feb 18, 2021

Pinging @elastic/fleet (Feature:Fleet)

@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Feb 18, 2021

Pinging @elastic/fleet (Team:Fleet)

jfsiii
jfsiii reviewed Feb 18, 2021
View reviewed changes
x-pack/test/fleet_functional/apps/fleet/overview_page.ts
const { overviewPage } = getPageObjects(['overviewPage']);

describe('When in the Fleet application', function () {
this.tags(['ciGroup7']);
Copy link
Copy Markdown
Contributor

@jfsiii jfsiii Feb 18, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ping @elastic/kibana-operations for CI group balancing

test/fleet_api_integration/* is ciGroup10 but I doubt that matter

jfsiii
jfsiii approved these changes Feb 18, 2021
View reviewed changes
Copy link
Copy Markdown
Contributor

@jfsiii jfsiii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚀 Thanks so much for doing this!

Ran locally and succeeds 👍🏻

FLEET_PACKAGE_REGISTRY_PORT=12345 yarn test:ftr --config x-pack/test/fleet_functional/config.ts

@Zacqary Zacqary enabled auto-merge (squash) February 18, 2021 21:04
@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Feb 18, 2021

💛 Build succeeded, but was flaky

Test Failures

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional_with_es_ssl/apps/uptime/alert_flyout·ts.Uptime app with real-world data uptime alerts overview page alert flyout controls posts an alert, verifies its presence, and deletes the alert

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 1 times on tracked branches: https://github.com/elastic/kibana/issues/88177

[00:00:00]       │
[00:00:00]         └-: Uptime app
[00:00:00]           └-> "before all" hook in "Uptime app"
[00:00:00]           └-: with real-world data
[00:00:00]             └-> "before all" hook in "with real-world data"
[00:00:00]             └-> "before all" hook in "with real-world data"
[00:00:00]               │ info [uptime/full_heartbeat] Loading "mappings.json"
[00:00:00]               │ info [uptime/full_heartbeat] Loading "data.json.gz"
[00:00:00]               │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xxl-1613676501393769552] [heartbeat-8-full-test] creating index, cause [api], templates [], shards [1]/[1]
[00:00:00]               │ info [uptime/full_heartbeat] Created index "heartbeat-8-full-test"
[00:00:00]               │ debg [uptime/full_heartbeat] "heartbeat-8-full-test" settings {"index":{"mapping":{"total_fields":{"limit":"10000"}},"number_of_replicas":"1","number_of_shards":"1","query":{"default_field":["message","tags","agent.ephemeral_id","agent.id","agent.name","agent.type","agent.version","as.organization.name","client.address","client.as.organization.name","client.domain","client.geo.city_name","client.geo.continent_name","client.geo.country_iso_code","client.geo.country_name","client.geo.name","client.geo.region_iso_code","client.geo.region_name","client.mac","client.user.domain","client.user.email","client.user.full_name","client.user.group.id","client.user.group.name","client.user.hash","client.user.id","client.user.name","cloud.account.id","cloud.availability_zone","cloud.instance.id","cloud.instance.name","cloud.machine.type","cloud.provider","cloud.region","container.id","container.image.name","container.image.tag","container.name","container.runtime","destination.address","destination.as.organization.name","destination.domain","destination.geo.city_name","destination.geo.continent_name","destination.geo.country_iso_code","destination.geo.country_name","destination.geo.name","destination.geo.region_iso_code","destination.geo.region_name","destination.mac","destination.user.domain","destination.user.email","destination.user.full_name","destination.user.group.id","destination.user.group.name","destination.user.hash","destination.user.id","destination.user.name","dns.answers.class","dns.answers.data","dns.answers.name","dns.answers.type","dns.header_flags","dns.id","dns.op_code","dns.question.class","dns.question.name","dns.question.registered_domain","dns.question.type","dns.response_code","dns.type","ecs.version","error.code","error.id","error.message","event.action","event.category","event.code","event.dataset","event.hash","event.id","event.kind","event.module","event.original","event.outcome","event.provider","event.timezone","event.type","file.device","file.directory","file.extension","file.gid","file.group","file.hash.md5","file.hash.sha1","file.hash.sha256","file.hash.sha512","file.inode","file.mode","file.name","file.owner","file.path","file.target_path","file.type","file.uid","geo.city_name","geo.continent_name","geo.country_iso_code","geo.country_name","geo.name","geo.region_iso_code","geo.region_name","group.id","group.name","hash.md5","hash.sha1","hash.sha256","hash.sha512","host.architecture","host.geo.city_name","host.geo.continent_name","host.geo.country_iso_code","host.geo.country_name","host.geo.name","host.geo.region_iso_code","host.geo.region_name","host.hostname","host.id","host.mac","host.name","host.os.family","host.os.full","host.os.kernel","host.os.name","host.os.platform","host.os.version","host.type","host.user.domain","host.user.email","host.user.full_name","host.user.group.id","host.user.group.name","host.user.hash","host.user.id","host.user.name","http.request.body.content","http.request.method","http.request.referrer","http.response.body.content","http.version","log.level","log.logger","log.original","network.application","network.community_id","network.direction","network.iana_number","network.name","network.protocol","network.transport","network.type","observer.geo.city_name","observer.geo.continent_name","observer.geo.country_iso_code","observer.geo.country_name","observer.geo.name","observer.geo.region_iso_code","observer.geo.region_name","observer.hostname","observer.mac","observer.os.family","observer.os.full","observer.os.kernel","observer.os.name","observer.os.platform","observer.os.version","observer.serial_number","observer.type","observer.vendor","observer.version","organization.id","organization.name","os.family","os.full","os.kernel","os.name","os.platform","os.version","process.args","process.executable","process.hash.md5","process.hash.sha1","process.hash.sha256","process.hash.sha512","process.name","process.thread.name","process.title","process.working_directory","server.address","server.as.organization.name","server.domain","server.geo.city_name","server.geo.continent_name","server.geo.country_iso_code","server.geo.country_name","server.geo.name","server.geo.region_iso_code","server.geo.region_name","server.mac","server.user.domain","server.user.email","server.user.full_name","server.user.group.id","server.user.group.name","server.user.hash","server.user.id","server.user.name","service.ephemeral_id","service.id","service.name","service.state","service.type","service.version","source.address","source.as.organization.name","source.domain","source.geo.city_name","source.geo.continent_name","source.geo.country_iso_code","source.geo.country_name","source.geo.name","source.geo.region_iso_code","source.geo.region_name","source.mac","source.user.domain","source.user.email","source.user.full_name","source.user.group.id","source.user.group.name","source.user.hash","source.user.id","source.user.name","tracing.trace.id","tracing.transaction.id","url.domain","url.fragment","url.full","url.original","url.password","url.path","url.query","url.scheme","url.username","user.domain","user.email","user.full_name","user.group.id","user.group.name","user.hash","user.id","user.name","user_agent.device.name","user_agent.name","user_agent.original","user_agent.os.family","user_agent.os.full","user_agent.os.kernel","user_agent.os.name","user_agent.os.platform","user_agent.os.version","user_agent.version","agent.hostname","error.type","timeseries.instance","cloud.project.id","cloud.image.id","host.os.build","host.os.codename","kubernetes.pod.name","kubernetes.pod.uid","kubernetes.namespace","kubernetes.node.name","kubernetes.replicaset.name","kubernetes.deployment.name","kubernetes.statefulset.name","kubernetes.container.name","kubernetes.container.image","jolokia.agent.version","jolokia.agent.id","jolokia.server.product","jolokia.server.version","jolokia.server.vendor","jolokia.url","monitor.type","monitor.name","monitor.id","monitor.status","monitor.check_group","http.response.body.hash","fields.*"]},"refresh_interval":"5s"}}
[00:00:01]               │ info [uptime/full_heartbeat] Indexed 2000 docs into "heartbeat-8-full-test"
[00:00:01]               │ debg replacing kibana config doc: {"dateFormat:tz":"UTC"}
[00:00:02]             └-: uptime alerts
[00:00:02]               └-> "before all" hook in "uptime alerts"
[00:00:02]               └-: overview page alert flyout controls
[00:00:02]                 └-> "before all" hook for "can open alert flyout"
[00:00:02]                 └-> "before all" hook for "can open alert flyout"
[00:00:02]                 └-> can open alert flyout
[00:00:02]                   └-> "before each" hook: global before each for "can open alert flyout"
[00:00:02]                   │ debg TestSubjects.exists(uptimeSettingsToOverviewLink)
[00:00:02]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="uptimeSettingsToOverviewLink"]') with timeout=0
[00:00:02]                   │ debg --- retry.tryForTime error: [data-test-subj="uptimeSettingsToOverviewLink"] is not displayed
[00:00:02]                   │ debg navigating to uptime url: http://localhost:6191/app/uptime
[00:00:02]                   │ debg navigate to: http://localhost:6191/app/uptime
[00:00:02]                   │ debg browser[INFO] http://localhost:6191/login?next=%2Fapp%2Fuptime%3F_t%3D1613679334511 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:02]                   │
[00:00:02]                   │ debg browser[INFO] http://localhost:6191/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:02]                   │ debg ... sleep(700) start
[00:00:03]                   │ debg ... sleep(700) end
[00:00:03]                   │ debg returned from get, calling refresh
[00:00:04]                   │ debg browser[INFO] http://localhost:6191/login?next=%2Fapp%2Fuptime%3F_t%3D1613679334511 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:04]                   │
[00:00:04]                   │ debg browser[INFO] http://localhost:6191/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:04]                   │ debg currentUrl = http://localhost:6191/login?next=%2Fapp%2Fuptime%3F_t%3D1613679334511
[00:00:04]                   │          appUrl = http://localhost:6191/app/uptime
[00:00:04]                   │ debg TestSubjects.find(kibanaChrome)
[00:00:04]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:04]                   │ debg Found login page
[00:00:04]                   │ debg TestSubjects.setValue(loginUsername, test_user)
[00:00:04]                   │ debg TestSubjects.click(loginUsername)
[00:00:04]                   │ debg Find.clickByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:00:04]                   │ debg Find.findByCssSelector('[data-test-subj="loginUsername"]') with timeout=10000
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/internal/spaces/_active_space - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/api/alerts/list_alert_types - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:00:04]                   │ debg browser[INFO] http://localhost:6191/40577/bundles/core/core.entry.js 12:161232 "Detected an unhandled Promise rejection.
[00:00:04]                   │      Error: Unauthorized"
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/40577/bundles/core/core.entry.js 5:3002 
[00:00:04]                   │ debg browser[INFO] http://localhost:6191/40577/bundles/core/core.entry.js 12:161232 "Detected an unhandled Promise rejection.
[00:00:04]                   │      Error: Unauthorized"
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/40577/bundles/core/core.entry.js 5:3002 
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/api/licensing/info - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:00:04]                   │ERROR browser[SEVERE] http://localhost:6191/internal/security/me - Failed to load resource: the server responded with a status of 401 (Unauthorized)
[00:00:05]                   │ debg TestSubjects.setValue(loginPassword, changeme)
[00:00:05]                   │ debg TestSubjects.click(loginPassword)
[00:00:05]                   │ debg Find.clickByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:00:05]                   │ debg Find.findByCssSelector('[data-test-subj="loginPassword"]') with timeout=10000
[00:00:05]                   │ debg TestSubjects.click(loginSubmit)
[00:00:05]                   │ debg Find.clickByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:00:05]                   │ debg Find.findByCssSelector('[data-test-subj="loginSubmit"]') with timeout=10000
[00:00:05]                   │ debg Find.waitForDeletedByCssSelector('.kibanaWelcomeLogo') with timeout=10000
[00:00:05]                   │ proc [kibana]   log   [20:15:37.263] [info][plugins][routes][security] Logging in with provider "basic" (basic)
[00:00:05]                   │ debg browser[INFO] http://localhost:6191/app/uptime?_t=1613679334511 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:05]                   │
[00:00:05]                   │ debg browser[INFO] http://localhost:6191/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:05]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:00:07]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"] nav:not(.ng-hide)') with timeout=60000
[00:00:08]                   │ERROR browser[SEVERE] http://localhost:6191/40577/bundles/plugin/newsfeed/newsfeed.plugin.js 0:18917 TypeError: Failed to fetch
[00:00:08]                   │          at fetch_Fetch.fetchResponse (http://localhost:6191/40577/bundles/core/core.entry.js:6:32877)
[00:00:08]                   │          at async interceptResponse (http://localhost:6191/40577/bundles/core/core.entry.js:6:28637)
[00:00:08]                   │          at async http://localhost:6191/40577/bundles/core/core.entry.js:6:31117
[00:00:08]                   │ debg browser[INFO] http://localhost:6191/app/uptime?_t=1613679339720 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:00:08]                   │
[00:00:08]                   │ debg browser[INFO] http://localhost:6191/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:00:08]                   │ debg Finished login process currentUrl = http://localhost:6191/app/uptime
[00:00:08]                   │ debg ... sleep(501) start
[00:00:09]                   │ debg ... sleep(501) end
[00:00:09]                   │ debg in navigateTo url = http://localhost:6191/app/uptime
[00:00:09]                   │ debg TestSubjects.exists(statusPageContainer)
[00:00:09]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:00:11]                   │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:00:12]                   │ debg isGlobalLoadingIndicatorVisible
[00:00:12]                   │ debg TestSubjects.exists(globalLoadingIndicator)
[00:00:12]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:00:13]                   │ debg --- retry.tryForTime error: [data-test-subj="globalLoadingIndicator"] is not displayed
[00:00:14]                   │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:00:14]                   │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:00:14]                   │ debg TestSubjects.exists(uptimeOverviewPage)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="uptimeOverviewPage"]') with timeout=2000
[00:00:14]                   │ debg TestSubjects.exists(superDatePickerToggleQuickMenuButton)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerToggleQuickMenuButton"]') with timeout=20000
[00:00:14]                   │ debg TestSubjects.exists(superDatePickerShowDatesButton)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=2500
[00:00:14]                   │ debg TestSubjects.click(superDatePickerShowDatesButton)
[00:00:14]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=10000
[00:00:14]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=10000
[00:00:14]                   │ debg TestSubjects.exists(superDatePickerstartDatePopoverButton)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=2500
[00:00:14]                   │ debg TestSubjects.getVisibleText(superDatePickerstartDatePopoverButton)
[00:00:14]                   │ debg TestSubjects.find(superDatePickerstartDatePopoverButton)
[00:00:14]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=10000
[00:00:14]                   │ debg TestSubjects.getVisibleText(superDatePickerendDatePopoverButton)
[00:00:14]                   │ debg TestSubjects.find(superDatePickerendDatePopoverButton)
[00:00:14]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerendDatePopoverButton"]') with timeout=10000
[00:00:14]                   │ debg Setting absolute range to Sep 10, 2019 @ 12:40:08.078 to Sep 11, 2019 @ 19:40:08.078
[00:00:14]                   │ debg TestSubjects.exists(superDatePickerToggleQuickMenuButton)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerToggleQuickMenuButton"]') with timeout=20000
[00:00:14]                   │ debg TestSubjects.exists(superDatePickerShowDatesButton)
[00:00:14]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerShowDatesButton"]') with timeout=2500
[00:00:17]                   │ debg --- retry.tryForTime error: [data-test-subj="superDatePickerShowDatesButton"] is not displayed
[00:00:17]                   │ debg TestSubjects.exists(superDatePickerstartDatePopoverButton)
[00:00:17]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=2500
[00:00:17]                   │ debg TestSubjects.click(superDatePickerendDatePopoverButton)
[00:00:17]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerendDatePopoverButton"]') with timeout=10000
[00:00:17]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerendDatePopoverButton"]') with timeout=10000
[00:00:17]                   │ debg Find.findByCssSelector('div.euiPopover__panel-isOpen') with timeout=10000
[00:00:17]                   │ debg TestSubjects.click(superDatePickerAbsoluteTab)
[00:00:17]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:00:17]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:00:17]                   │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:00:17]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:17]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:17]                   │ debg TestSubjects.setValue(superDatePickerAbsoluteDateInput, Sep 11, 2019 @ 19:40:08.078)
[00:00:17]                   │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:00:17]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:17]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:18]                   │ debg TestSubjects.click(superDatePickerstartDatePopoverButton)
[00:00:18]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=10000
[00:00:18]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerstartDatePopoverButton"]') with timeout=10000
[00:00:18]                   │ debg Find.waitForElementStale with timeout=10000
[00:00:18]                   │ debg Find.findByCssSelector('div.euiPopover__panel-isOpen') with timeout=10000
[00:00:18]                   │ debg TestSubjects.click(superDatePickerAbsoluteTab)
[00:00:18]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:00:18]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteTab"]') with timeout=10000
[00:00:18]                   │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:00:18]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:18]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:18]                   │ debg TestSubjects.setValue(superDatePickerAbsoluteDateInput, Sep 10, 2019 @ 12:40:08.078)
[00:00:18]                   │ debg TestSubjects.click(superDatePickerAbsoluteDateInput)
[00:00:18]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:18]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerAbsoluteDateInput"]') with timeout=10000
[00:00:19]                   │ debg TestSubjects.exists(superDatePickerApplyTimeButton)
[00:00:19]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="superDatePickerApplyTimeButton"]') with timeout=2500
[00:00:19]                   │ debg TestSubjects.click(superDatePickerApplyTimeButton)
[00:00:19]                   │ debg Find.clickByCssSelector('[data-test-subj="superDatePickerApplyTimeButton"]') with timeout=10000
[00:00:19]                   │ debg Find.findByCssSelector('[data-test-subj="superDatePickerApplyTimeButton"]') with timeout=10000
[00:00:19]                   │ debg Find.waitForElementStale with timeout=10000
[00:00:19]                   │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:00:19]                   │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:00:19]                   │ debg isGlobalLoadingIndicatorVisible
[00:00:19]                   │ debg TestSubjects.exists(globalLoadingIndicator)
[00:00:19]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:00:21]                   │ debg --- retry.tryForTime error: [data-test-subj="globalLoadingIndicator"] is not displayed
[00:00:21]                   │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:00:21]                   │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:00:21]                   │ debg TestSubjects.click(xpack.uptime.alertsPopover.toggleButton)
[00:00:21]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alertsPopover.toggleButton"]') with timeout=5000
[00:00:21]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alertsPopover.toggleButton"]') with timeout=5000
[00:00:21]                   │ debg TestSubjects.click(xpack.uptime.openAlertContextPanel)
[00:00:21]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.openAlertContextPanel"]') with timeout=5000
[00:00:21]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.openAlertContextPanel"]') with timeout=5000
[00:00:22]                   │ debg TestSubjects.click(xpack.uptime.toggleAlertFlyout)
[00:00:22]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.toggleAlertFlyout"]') with timeout=5000
[00:00:22]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.toggleAlertFlyout"]') with timeout=5000
[00:00:22]                   └- ✓ pass  (20.1s) "Uptime app with real-world data uptime alerts overview page alert flyout controls can open alert flyout"
[00:00:22]                 └-> can set alert name
[00:00:22]                   └-> "before each" hook: global before each for "can set alert name"
[00:00:22]                   │ debg TestSubjects.setValue(alertNameInput, uptime-test)
[00:00:22]                   │ debg TestSubjects.click(alertNameInput)
[00:00:22]                   │ debg Find.clickByCssSelector('[data-test-subj="alertNameInput"]') with timeout=10000
[00:00:22]                   │ debg Find.findByCssSelector('[data-test-subj="alertNameInput"]') with timeout=10000
[00:00:23]                   └- ✓ pass  (1.2s) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert name"
[00:00:23]                 └-> can set alert tags
[00:00:23]                   └-> "before each" hook: global before each for "can set alert tags"
[00:00:23]                   │ debg TestSubjects.click(comboBoxSearchInput)
[00:00:23]                   │ debg Find.clickByCssSelector('[data-test-subj="comboBoxSearchInput"]') with timeout=5000
[00:00:23]                   │ debg Find.findByCssSelector('[data-test-subj="comboBoxSearchInput"]') with timeout=5000
[00:00:23]                   │ debg TestSubjects.setValue(comboBoxInput, uptime)
[00:00:23]                   │ debg TestSubjects.click(comboBoxInput)
[00:00:23]                   │ debg Find.clickByCssSelector('[data-test-subj="comboBoxInput"]') with timeout=10000
[00:00:23]                   │ debg Find.findByCssSelector('[data-test-subj="comboBoxInput"]') with timeout=10000
[00:00:23]                   │ debg TestSubjects.click(comboBoxSearchInput)
[00:00:23]                   │ debg Find.clickByCssSelector('[data-test-subj="comboBoxSearchInput"]') with timeout=5000
[00:00:23]                   │ debg Find.findByCssSelector('[data-test-subj="comboBoxSearchInput"]') with timeout=5000
[00:00:23]                   │ debg TestSubjects.setValue(comboBoxInput, another)
[00:00:23]                   │ debg TestSubjects.click(comboBoxInput)
[00:00:23]                   │ debg Find.clickByCssSelector('[data-test-subj="comboBoxInput"]') with timeout=10000
[00:00:23]                   │ debg Find.findByCssSelector('[data-test-subj="comboBoxInput"]') with timeout=10000
[00:00:23]                   └- ✓ pass  (662ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert tags"
[00:00:23]                 └-> can set alert interval
[00:00:23]                   └-> "before each" hook: global before each for "can set alert interval"
[00:00:23]                   │ debg TestSubjects.setValue(intervalInput, 11)
[00:00:23]                   │ debg TestSubjects.click(intervalInput)
[00:00:23]                   │ debg Find.clickByCssSelector('[data-test-subj="intervalInput"]') with timeout=10000
[00:00:23]                   │ debg Find.findByCssSelector('[data-test-subj="intervalInput"]') with timeout=10000
[00:00:24]                   └- ✓ pass  (194ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert interval"
[00:00:24]                 └-> can set alert throttle interval
[00:00:24]                   └-> "before each" hook: global before each for "can set alert throttle interval"
[00:00:24]                   │ debg TestSubjects.click(notifyWhenSelect)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="notifyWhenSelect"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="notifyWhenSelect"]') with timeout=10000
[00:00:24]                   │ debg TestSubjects.click(onThrottleInterval)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="onThrottleInterval"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="onThrottleInterval"]') with timeout=10000
[00:00:24]                   │ debg TestSubjects.setValue(throttleInput, 30)
[00:00:24]                   │ debg TestSubjects.click(throttleInput)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="throttleInput"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="throttleInput"]') with timeout=10000
[00:00:24]                   └- ✓ pass  (513ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert throttle interval"
[00:00:24]                 └-> can set alert status number of time
[00:00:24]                   └-> "before each" hook: global before each for "can set alert status number of time"
[00:00:24]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.numTimesExpression)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesExpression"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesExpression"]') with timeout=10000
[00:00:24]                   │ debg TestSubjects.setValue(xpack.uptime.alerts.monitorStatus.numTimesField, 3)
[00:00:24]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.numTimesField)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesField"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesField"]') with timeout=10000
[00:00:24]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.numTimesExpression)
[00:00:24]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesExpression"]') with timeout=10000
[00:00:24]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.numTimesExpression"]') with timeout=10000
[00:00:25]                   └- ✓ pass  (354ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert status number of time"
[00:00:25]                 └-> can set alert time range
[00:00:25]                   └-> "before each" hook: global before each for "can set alert time range"
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeValueExpression)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueExpression"]') with timeout=10000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueExpression"]') with timeout=10000
[00:00:25]                   │ debg TestSubjects.setValue(xpack.uptime.alerts.monitorStatus.timerangeValueField, 1)
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeValueField)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueField"]') with timeout=10000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueField"]') with timeout=10000
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeValueExpression)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueExpression"]') with timeout=10000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeValueExpression"]') with timeout=10000
[00:00:25]                   └- ✓ pass  (429ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set alert time range"
[00:00:25]                 └-> can set monitor hours
[00:00:25]                   └-> "before each" hook: global before each for "can set monitor hours"
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeUnitExpression)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitExpression"]') with timeout=5000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitExpression"]') with timeout=5000
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable"]') with timeout=5000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable"]') with timeout=5000
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable.hoursOption)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable.hoursOption"]') with timeout=5000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitSelectable.hoursOption"]') with timeout=5000
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.timerangeUnitExpression)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitExpression"]') with timeout=5000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.timerangeUnitExpression"]') with timeout=5000
[00:00:25]                   └- ✓ pass  (503ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set monitor hours"
[00:00:25]                 └-> can set kuery bar filters
[00:00:25]                   └-> "before each" hook: global before each for "can set kuery bar filters"
[00:00:25]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.filterBar)
[00:00:25]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.filterBar"]') with timeout=10000
[00:00:25]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.filterBar"]') with timeout=10000
[00:00:26]                   │ debg TestSubjects.setValue(xpack.uptime.alerts.monitorStatus.filterBar, monitor.id: "0001-up")
[00:00:26]                   │ debg TestSubjects.click(xpack.uptime.alerts.monitorStatus.filterBar)
[00:00:26]                   │ debg Find.clickByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.filterBar"]') with timeout=10000
[00:00:26]                   │ debg Find.findByCssSelector('[data-test-subj="xpack.uptime.alerts.monitorStatus.filterBar"]') with timeout=10000
[00:00:26]                   └- ✓ pass  (615ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can set kuery bar filters"
[00:00:26]                 └-> can select location filter
[00:00:26]                   └-> "before each" hook: global before each for "can select location filter"
[00:00:26]                   │ debg TestSubjects.click(uptimeCreateAlertAddFilter)
[00:00:26]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:26]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:26]                   │ debg TestSubjects.click(uptimeAlertAddFilter.observer.geo.name)
[00:00:26]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeAlertAddFilter.observer.geo.name"]') with timeout=10000
[00:00:26]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeAlertAddFilter.observer.geo.name"]') with timeout=10000
[00:00:26]                   │ debg TestSubjects.click(uptimeCreateStatusAlert.filter_location)
[00:00:26]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_location"]') with timeout=10000
[00:00:26]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_location"]') with timeout=10000
[00:00:26]                   │ debg TestSubjects.click(filter-popover-item_mpls)
[00:00:26]                   │ debg Find.clickByCssSelector('[data-test-subj="filter-popover-item_mpls"]') with timeout=10000
[00:00:26]                   │ debg Find.findByCssSelector('[data-test-subj="filter-popover-item_mpls"]') with timeout=10000
[00:00:27]                   │ debg Find.clickByCssSelector('body') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('body') with timeout=10000
[00:00:27]                   └- ✓ pass  (712ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can select location filter"
[00:00:27]                 └-> can select port filter
[00:00:27]                   └-> "before each" hook: global before each for "can select port filter"
[00:00:27]                   │ debg TestSubjects.click(uptimeCreateAlertAddFilter)
[00:00:27]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:27]                   │ debg TestSubjects.click(uptimeAlertAddFilter.url.port)
[00:00:27]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeAlertAddFilter.url.port"]') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeAlertAddFilter.url.port"]') with timeout=10000
[00:00:27]                   │ debg TestSubjects.click(uptimeCreateStatusAlert.filter_port)
[00:00:27]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_port"]') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_port"]') with timeout=10000
[00:00:27]                   │ debg TestSubjects.click(filter-popover-item_5678)
[00:00:27]                   │ debg Find.clickByCssSelector('[data-test-subj="filter-popover-item_5678"]') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('[data-test-subj="filter-popover-item_5678"]') with timeout=10000
[00:00:27]                   │ debg Find.clickByCssSelector('body') with timeout=10000
[00:00:27]                   │ debg Find.findByCssSelector('body') with timeout=10000
[00:00:28]                   └- ✓ pass  (742ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can select port filter"
[00:00:28]                 └-> can select type/scheme filter
[00:00:28]                   └-> "before each" hook: global before each for "can select type/scheme filter"
[00:00:28]                   │ debg TestSubjects.click(uptimeCreateAlertAddFilter)
[00:00:28]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateAlertAddFilter"]') with timeout=10000
[00:00:28]                   │ debg TestSubjects.click(uptimeAlertAddFilter.monitor.type)
[00:00:28]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeAlertAddFilter.monitor.type"]') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeAlertAddFilter.monitor.type"]') with timeout=10000
[00:00:28]                   │ debg TestSubjects.click(uptimeCreateStatusAlert.filter_scheme)
[00:00:28]                   │ debg Find.clickByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_scheme"]') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('[data-test-subj="uptimeCreateStatusAlert.filter_scheme"]') with timeout=10000
[00:00:28]                   │ debg TestSubjects.click(filter-popover-item_http)
[00:00:28]                   │ debg Find.clickByCssSelector('[data-test-subj="filter-popover-item_http"]') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('[data-test-subj="filter-popover-item_http"]') with timeout=10000
[00:00:28]                   │ debg Find.clickByCssSelector('body') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('body') with timeout=10000
[00:00:28]                   └- ✓ pass  (686ms) "Uptime app with real-world data uptime alerts overview page alert flyout controls can select type/scheme filter"
[00:00:28]                 └-> can save alert
[00:00:28]                   └-> "before each" hook: global before each for "can save alert"
[00:00:28]                   │ debg TestSubjects.click(saveAlertButton)
[00:00:28]                   │ debg Find.clickByCssSelector('[data-test-subj="saveAlertButton"]') with timeout=10000
[00:00:28]                   │ debg Find.findByCssSelector('[data-test-subj="saveAlertButton"]') with timeout=10000
[00:00:29]                   │ debg TestSubjects.click(confirmAlertSaveModal > confirmModalConfirmButton)
[00:00:29]                   │ debg Find.clickByCssSelector('[data-test-subj="confirmAlertSaveModal"] [data-test-subj="confirmModalConfirmButton"]') with timeout=10000
[00:00:29]                   │ debg Find.findByCssSelector('[data-test-subj="confirmAlertSaveModal"] [data-test-subj="confirmModalConfirmButton"]') with timeout=10000
[00:00:29]                   │ debg Find.findByCssSelector('.euiToast') with timeout=60000
[00:00:30]                   │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xxl-1613676501393769552] [.kibana_8.0.0_001/m9ZHKTdDQpSN7C3le_lxbw] update_mapping [_doc]
[00:00:32]                   │ debg Find.findByCssSelector('.euiToastHeader__title') with timeout=10000
[00:00:32]                   │ debg Find.clickByCssSelector('.euiToast__closeButton') with timeout=10000
[00:00:32]                   │ debg Find.findByCssSelector('.euiToast__closeButton') with timeout=10000
[00:00:32]                   └- ✓ pass  (3.7s) "Uptime app with real-world data uptime alerts overview page alert flyout controls can save alert"
[00:00:32]                 └-> posts an alert, verifies its presence, and deletes the alert
[00:00:32]                   └-> "before each" hook: global before each for "posts an alert, verifies its presence, and deletes the alert"
[00:00:32]                   │ debg --- retry.tryForTime error: expected [] to have a length of 1 but got 0
[00:00:33]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:33]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:34]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:35]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:35]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:36]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:36]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:37]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:38]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:38]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:39]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:39]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:40]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:41]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:41]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:42]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:42]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:43]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:44]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:44]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:45]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:45]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:46]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:47]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:47]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:48]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:48]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:49]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:50]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:50]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:51]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:51]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:52]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:53]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:53]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:54]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:54]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:55]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:55]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:56]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:57]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:57]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:58]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:58]                   │ debg --- retry.tryForTime failed again with the same message...
[00:00:59]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:00]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:00]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:01]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:01]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:02]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:03]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:03]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:04]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:04]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:05]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:05]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:06]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:07]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:07]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:08]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:08]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:09]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:10]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:10]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:11]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:11]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:12]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:13]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:13]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:14]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:14]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:15]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:15]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:16]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:17]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:17]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:18]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:18]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:19]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:20]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:20]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:21]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:21]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:22]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:23]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:23]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:24]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:24]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:25]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:26]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:26]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:27]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:27]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:28]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:28]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:29]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:30]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:30]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:31]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:31]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:32]                   │ debg --- retry.tryForTime failed again with the same message...
[00:01:33]                   │ info Taking screenshot "/dev/shm/workspace/parallel/9/kibana/x-pack/test/functional/screenshots/failure/Uptime app with real-world data uptime alerts overview page alert flyout controls posts an alert_ verifies its presence_ and deletes the alert.png"
[00:01:33]                   │ info Current URL is: http://localhost:6191/app/uptime?dateRangeStart=2019-09-10T12%3A40%3A08.078Z&dateRangeEnd=2019-09-11T19%3A40%3A08.078Z
[00:01:33]                   │ info Saving page source to: /dev/shm/workspace/parallel/9/kibana/x-pack/test/functional/failure_debug/html/Uptime app with real-world data uptime alerts overview page alert flyout controls posts an alert_ verifies its presence_ and deletes the alert.html
[00:01:33]                   └- ✖ fail: Uptime app with real-world data uptime alerts overview page alert flyout controls posts an alert, verifies its presence, and deletes the alert
[00:01:33]                   │      retry.tryForTime timeout: Error: expected [] to have a length of 1 but got 0
[00:01:33]                   │     at Assertion.assert (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:100:11)
[00:01:33]                   │     at Assertion.length (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:374:8)
[00:01:33]                   │     at /dev/shm/workspace/parallel/9/kibana/x-pack/test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:97:46
[00:01:33]                   │     at runAttempt (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:01:33]                   │     at retryForSuccess (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:01:33]                   │     at Retry.tryForTime (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry.ts:23:14)
[00:01:33]                   │     at Context.<anonymous> (/dev/shm/workspace/parallel/9/kibana/x-pack/test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:92:9)
[00:01:33]                   │     at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:01:33]                   │   Error: retry.tryForTime timeout: Error: expected [] to have a length of 1 but got 0
[00:01:33]                   │       at Assertion.assert (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:100:11)
[00:01:33]                   │       at Assertion.length (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:374:8)
[00:01:33]                   │       at /dev/shm/workspace/parallel/9/kibana/x-pack/test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:97:46
[00:01:33]                   │       at runAttempt (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:27:15)
[00:01:33]                   │       at retryForSuccess (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:66:21)
[00:01:33]                   │       at Retry.tryForTime (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry.ts:23:14)
[00:01:33]                   │       at Context.<anonymous> (test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:92:9)
[00:01:33]                   │       at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:01:33]                   │       at onFailure (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:17:9)
[00:01:33]                   │       at retryForSuccess (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:57:13)
[00:01:33]                   │       at Retry.tryForTime (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry.ts:23:14)
[00:01:33]                   │       at Context.<anonymous> (test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:92:9)
[00:01:33]                   │       at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:01:33]                   │ 
[00:01:33]                   │

Stack Trace

Error: retry.tryForTime timeout: Error: expected [] to have a length of 1 but got 0
    at Assertion.assert (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.length (/dev/shm/workspace/parallel/9/kibana/packages/kbn-expect/expect.js:374:8)
    at /dev/shm/workspace/parallel/9/kibana/x-pack/test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:97:46
    at runAttempt (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:27:15)
    at retryForSuccess (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:66:21)
    at Retry.tryForTime (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry.ts:23:14)
    at Context.<anonymous> (test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:92:9)
    at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
    at onFailure (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:17:9)
    at retryForSuccess (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry_for_success.ts:57:13)
    at Retry.tryForTime (/dev/shm/workspace/parallel/9/kibana/test/common/services/retry/retry.ts:23:14)
    at Context.<anonymous> (test/functional_with_es_ssl/apps/uptime/alert_flyout.ts:92:9)
    at Object.apply (/dev/shm/workspace/parallel/9/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
fleet 754.3KB 754.4KB +175.0B

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@Zacqary Zacqary merged commit 0760bfb into elastic:master Feb 18, 2021
@Zacqary Zacqary deleted the 87669-fleet-test-bootstrap branch February 18, 2021 21:38
@Zacqary Zacqary mentioned this pull request Feb 18, 2021
Merged
Zacqary added a commit to Zacqary/kibana that referenced this pull request Feb 18, 2021
@Zacqary
[Fleet] Bootstrap functional test suite (elastic#91898)
b521ab9
Zacqary added a commit that referenced this pull request Feb 19, 2021
@Zacqary
[7.x] [Fleet] Bootstrap functional test suite (#91898) (#91942)
9c855d8
gmmorris added a commit to gmmorris/kibana that referenced this pull request Feb 19, 2021
@gmmorris
Merge branch 'master' into task-manager/docs-monitoring
fa807e9 
* master: (111 commits)
  [Logs UI] Replace dependencies in the infra bundle (elastic#91503)
  [Search Source] Do not request unmapped fields if source filters are provided (elastic#91921)
  [APM] Kql Search Bar suggests values outside the selected time range (elastic#91918)
  Refactored component edit policy tests into separate folders and using client integration testing setup (elastic#91657)
  [Fleet] Don't error on missing package_assets value (elastic#91744)
  [Lens] Pass used histogram interval to chart (elastic#91370)
  [Indexpattern management] Use indexPatterns Service instead of savedObjects client (elastic#91839)
  [Security Solutions] Fixes Cypress tests for indicator match by making the selectors more specific (elastic#91947)
  [CI] backportrc can skip CI (elastic#91886)
  Revert "[SOM] fix flaky suites (elastic#91809)"
  [Fleet] Install Elastic Agent integration by default during setup (elastic#91676)
  [Fleet] Silently swallow 404 errors when deleting ingest pipelines (elastic#91778)
  [data.search] Use incrementCounter for search telemetry (elastic#91230)
  [Fleet] Bootstrap functional test suite (elastic#91898)
  [Alerts][Docs] Added API documentation for alerts plugin (elastic#91067)
  Use correct environment in anomaly detection setup link (elastic#91877)
  [FTSR] Convert to tasks and add jest/api integration suites (elastic#91770)
  [CI] Build and publish storybooks (elastic#87701)
  docs: add PHP agent info to docs (elastic#91773)
  [DOCS] Adds and updates Visualization advanced settings (elastic#91904)
  ...
@spalger
Copy link
Copy Markdown
Contributor

spalger commented Feb 22, 2021

@Zacqary in order for these tests to run in CI you'll need to add them to the list here: https://github.com/elastic/kibana/blob/master/x-pack/scripts/functional_tests.js#L77

@spalger spalger mentioned this pull request Feb 22, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

1 more reviewer

@jfsiii jfsiii jfsiii approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

Feature:Fleet Fleet team's agent central management project release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team v7.13.0 v8.0.0

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

[Fleet] Set up Fleet functional test suite

6 participants

@Zacqary @elasticmachine @kibanamachine @spalger @jfsiii @ph