Skip to content

[7.x] [ML] Transform functional tests - re-enable feature controls suite (#91095)#91123

Merged
pheyos merged 1 commit intoelastic:7.xfrom
pheyos:backport/7.x/pr-91095
Feb 11, 2021
Merged

[7.x] [ML] Transform functional tests - re-enable feature controls suite (#91095)#91123
pheyos merged 1 commit intoelastic:7.xfrom
pheyos:backport/7.x/pr-91095

Conversation

@pheyos
Copy link
Copy Markdown
Member

@pheyos pheyos commented Feb 11, 2021

Backports the following commits to 7.x:

@pheyos
[ML] Transform functional tests - re-enable feature controls suite (e…
fadd6ca 
…lastic#91095)

This PR re-enables the transform feature controls test suite.
@pheyos pheyos self-assigned this Feb 11, 2021
@pheyos pheyos added :ml backport This PR is a backport of another PR labels Feb 11, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Feb 11, 2021

Pinging @elastic/ml-ui (:ml)

@kibanamachine
Copy link
Copy Markdown
Contributor

kibanamachine commented Feb 11, 2021

💛 Build succeeded, but was flaky

Test Failures

Kibana Pipeline / general / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/upgrade_assistant/feature_controls/upgrade_assistant_security·ts.Upgrade checkup feature controls security global dashboard all with global_upgrade_assistant_role [SkipCloud] global dashboard all with global_upgrade_assistant_role should render the "Stack" section with Upgrde Assistant

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has not failed recently on tracked branches

[00:00:00]       │
[00:10:29]         └-: Upgrade checkup 
[00:10:29]           └-> "before all" hook in "Upgrade checkup "
[00:10:29]           └-: feature controls
[00:10:29]             └-> "before all" hook in "feature controls"
[00:10:29]             └-: security
[00:10:29]               └-> "before all" hook in "security"
[00:10:29]               └-> "before all" hook in "security"
[00:10:29]                 │ info [empty_kibana] Loading "mappings.json"
[00:10:29]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana_2/nkJyDQuvQ_qZVfvNycWaDw] deleting index
[00:10:29]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana_1/t2RcP0OlSgC8LbfYcZY2QA] deleting index
[00:10:29]                 │ info [empty_kibana] Deleted existing index ".kibana_2"
[00:10:29]                 │ info [empty_kibana] Deleted existing index ".kibana_1"
[00:10:29]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana] creating index, cause [api], templates [], shards [1]/[1]
[00:10:29]                 │ info [empty_kibana] Created index ".kibana"
[00:10:29]                 │ debg [empty_kibana] ".kibana" settings {"index":{"number_of_replicas":"1","number_of_shards":"1"}}
[00:10:29]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana/KtyZqluZQaWUJKv_v7R0yA] update_mapping [_doc]
[00:10:29]                 │ debg Migrating saved objects
[00:10:29]                 │ proc [kibana]   log   [13:39:27.893] [info][savedobjects-service] Creating index .kibana_2.
[00:10:29]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana_2] creating index, cause [api], templates [], shards [1]/[1]
[00:10:29]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] updating number_of_replicas to [0] for indices [.kibana_2]
[00:10:29]                 │ proc [kibana]   log   [13:39:27.966] [info][savedobjects-service] Reindexing .kibana to .kibana_1
[00:10:29]                 │ info [o.e.c.m.MetadataCreateIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana_1] creating index, cause [api], templates [], shards [1]/[1]
[00:10:29]                 │ info [o.e.c.r.a.AllocationService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] updating number_of_replicas to [0] for indices [.kibana_1]
[00:10:29]                 │ info [o.e.t.LoggingTaskListener] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] 17376 finished with response BulkByScrollResponse[took=1.3ms,timed_out=false,sliceId=null,updated=0,created=0,deleted=0,batches=0,versionConflicts=0,noops=0,retries=0,throttledUntil=0s,bulk_failures=[],search_failures=[]]
[00:10:29]                 │ info [o.e.c.m.MetadataDeleteIndexService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana/KtyZqluZQaWUJKv_v7R0yA] deleting index
[00:10:29]                 │ proc [kibana]   log   [13:39:28.310] [info][savedobjects-service] Migrating .kibana_1 saved objects to .kibana_2
[00:10:29]                 │ proc [kibana]   log   [13:39:28.316] [info][savedobjects-service] Pointing alias .kibana to .kibana_2.
[00:10:30]                 │ proc [kibana]   log   [13:39:28.347] [info][savedobjects-service] Finished in 455ms.
[00:10:30]                 │ debg [empty_kibana] Migrated Kibana index after loading Kibana data
[00:10:30]                 │ debg [empty_kibana] Ensured that default space exists in .kibana
[00:10:30]                 │ debg applying update to kibana config: {"accessibility:disableAnimations":true,"dateFormat:tz":"UTC"}
[00:10:30]                 │ info [o.e.c.m.MetadataMappingService] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] [.kibana_2/D9HQw3-mSM6BJMuFSJFcfw] update_mapping [_doc]
[00:10:31]                 │ debg navigating to home url: http://localhost:6141/app/home#/
[00:10:31]                 │ debg navigate to: http://localhost:6141/app/home#/
[00:10:31]                 │ debg browser[INFO] http://localhost:6141/app/home?_t=1613050769956#/ 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:31]                 │
[00:10:31]                 │ debg browser[INFO] http://localhost:6141/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:31]                 │ debg ... sleep(700) start
[00:10:32]                 │ debg ... sleep(700) end
[00:10:32]                 │ debg returned from get, calling refresh
[00:10:32]                 │ debg browser[INFO] http://localhost:6141/app/home?_t=1613050769956#/ 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:32]                 │
[00:10:32]                 │ debg browser[INFO] http://localhost:6141/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:32]                 │ debg currentUrl = http://localhost:6141/app/home#/
[00:10:32]                 │          appUrl = http://localhost:6141/app/home#/
[00:10:32]                 │ debg TestSubjects.find(kibanaChrome)
[00:10:32]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:10:34]                 │ debg ... sleep(501) start
[00:10:34]                 │ debg ... sleep(501) end
[00:10:34]                 │ debg in navigateTo url = http://localhost:6141/app/home#/
[00:10:34]                 │ debg TestSubjects.exists(statusPageContainer)
[00:10:34]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:10:37]                 │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:10:52]               └-: global dashboard all with global_upgrade_assistant_role
[00:10:52]                 └-> "before all" hook for "should show the Stack Management nav link"
[00:10:52]                 └-> "before all" hook for "should show the Stack Management nav link"
[00:10:52]                   │ debg set roles = global_dashboard_all,global_upgrade_assistant_role
[00:10:52]                   │ debg creating user test_user
[00:10:52]                   │ info [o.e.x.s.a.u.TransportPutUserAction] [kibana-ci-immutable-debian-tests-xxl-1613048064406139601] updated user [test_user]
[00:10:52]                   │ debg created user test_user
[00:10:52]                   │ debg TestSubjects.exists(kibanaChrome)
[00:10:52]                   │ debg Find.existsByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=2500
[00:10:52]                   │ debg TestSubjects.find(kibanaChrome)
[00:10:52]                   │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=100000
[00:10:52]                   │ debg browser[INFO] http://localhost:6141/app/management?_t=1613050783358 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:52]                   │
[00:10:52]                   │ debg browser[INFO] http://localhost:6141/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:53]                 └-> should show the Stack Management nav link
[00:10:53]                   └-> "before each" hook: global before each for "should show the Stack Management nav link"
[00:10:54]                   │ debg isGlobalLoadingIndicatorVisible
[00:10:54]                   │ debg TestSubjects.exists(globalLoadingIndicator)
[00:10:54]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:10:55]                   │ debg --- retry.tryForTime error: [data-test-subj="globalLoadingIndicator"] is not displayed
[00:10:56]                   │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:10:56]                   │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:10:56]                   │ debg TestSubjects.exists(collapsibleNav)
[00:10:56]                   │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="collapsibleNav"]') with timeout=2500
[00:10:58]                   │ debg --- retry.tryForTime error: [data-test-subj="collapsibleNav"] is not displayed
[00:10:59]                   │ debg TestSubjects.click(toggleNavButton)
[00:10:59]                   │ debg Find.clickByCssSelector('[data-test-subj="toggleNavButton"]') with timeout=10000
[00:10:59]                   │ debg Find.findByCssSelector('[data-test-subj="toggleNavButton"]') with timeout=10000
[00:10:59]                   │ debg TestSubjects.find(collapsibleNav)
[00:10:59]                   │ debg Find.findByCssSelector('[data-test-subj="collapsibleNav"]') with timeout=10000
[00:10:59]                   │ debg Find.existsByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=2500
[00:10:59]                   │ debg Find.findByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:10:59]                   │ debg Find.clickByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:10:59]                   │ debg Find.findByCssSelector('[data-test-subj=collapsibleNav] > button') with timeout=10000
[00:10:59]                   └- ✓ pass  (5.5s) "Upgrade checkup  feature controls security global dashboard all with global_upgrade_assistant_role should show the Stack Management nav link"
[00:10:59]                 └-: [SkipCloud] global dashboard all with global_upgrade_assistant_role
[00:10:59]                   └-> "before all" hook for "should render the "Stack" section with Upgrde Assistant"
[00:10:59]                   └-> should render the "Stack" section with Upgrde Assistant
[00:10:59]                     └-> "before each" hook: global before each for "should render the "Stack" section with Upgrde Assistant"
[00:10:59]                     │ debg navigating to management url: http://localhost:6141/app/management
[00:10:59]                     │ debg navigate to: http://localhost:6141/app/management
[00:10:59]                     │ debg browser[INFO] http://localhost:6141/app/management?_t=1613050797848 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:10:59]                     │
[00:10:59]                     │ debg browser[INFO] http://localhost:6141/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:10:59]                     │ debg ... sleep(700) start
[00:11:00]                     │ debg ... sleep(700) end
[00:11:00]                     │ debg returned from get, calling refresh
[00:11:00]                     │ debg browser[INFO] http://localhost:6141/app/management?_t=1613050797848 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:11:00]                     │
[00:11:00]                     │ debg browser[INFO] http://localhost:6141/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:11:01]                     │ debg currentUrl = http://localhost:6141/app/management
[00:11:01]                     │          appUrl = http://localhost:6141/app/management
[00:11:01]                     │ debg TestSubjects.find(kibanaChrome)
[00:11:01]                     │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:11:01]                     │ debg ... sleep(501) start
[00:11:02]                     │ debg ... sleep(501) end
[00:11:02]                     │ debg in navigateTo url = http://localhost:6141/app/management
[00:11:02]                     │ debg TestSubjects.exists(statusPageContainer)
[00:11:02]                     │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="statusPageContainer"]') with timeout=2500
[00:11:04]                     │ debg --- retry.tryForTime error: [data-test-subj="statusPageContainer"] is not displayed
[00:11:05]                     │ debg Find.allByCssSelector('.mgtSideBarNav > .euiSideNav__content > .euiSideNavItem') with timeout=10000
[00:11:05]                     │ info Taking screenshot "/dev/shm/workspace/parallel/4/kibana/x-pack/test/functional/screenshots/failure/Upgrade checkup  feature controls security global dashboard all with global_upgrade_assistant_role _SkipCloud_ global dashboard all with global_upgrade_assistant_role should render the _Stack_ section with Upgrde Assistant.png"
[00:11:05]                     │ info Current URL is: http://localhost:6141/app/management
[00:11:05]                     │ info Saving page source to: /dev/shm/workspace/parallel/4/kibana/x-pack/test/functional/failure_debug/html/Upgrade checkup  feature controls security global dashboard all with global_upgrade_assistant_role _SkipCloud_ global dashboard all with global_upgrade_assistant_role should render the _Stack_ section with Upgrde Assistant.html
[00:11:05]                     └- ✖ fail: Upgrade checkup  feature controls security global dashboard all with global_upgrade_assistant_role [SkipCloud] global dashboard all with global_upgrade_assistant_role should render the "Stack" section with Upgrde Assistant
[00:11:05]                     │      Error: expected [ { sectionId: 'ingest',
[00:11:05]                     │     sectionLinks: [ 'ingest_pipelines', 'pipelines' ] },
[00:11:05]                     │   { sectionId: 'data',
[00:11:05]                     │     sectionLinks: 
[00:11:05]                     │      [ 'index_management',
[00:11:05]                     │        'index_lifecycle_management',
[00:11:05]                     │        'snapshot_restore',
[00:11:05]                     │        'rollup_jobs',
[00:11:05]                     │        'transform',
[00:11:05]                     │        'remote_clusters' ] },
[00:11:05]                     │   { sectionId: 'insightsAndAlerting',
[00:11:05]                     │     sectionLinks: [ 'watcher' ] },
[00:11:05]                     │   { sectionId: 'stack',
[00:11:05]                     │     sectionLinks: [ 'license_management', 'upgrade_assistant' ] } ] to have a length of 3 but got 4
[00:11:05]                     │       at Assertion.assert (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:100:11)
[00:11:05]                     │       at Assertion.length (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:374:8)
[00:11:05]                     │       at Context.<anonymous> (test/functional/apps/upgrade_assistant/feature_controls/upgrade_assistant_security.ts:68:36)
[00:11:05]                     │       at runMicrotasks (<anonymous>)
[00:11:05]                     │       at processTicksAndRejections (internal/process/task_queues.js:93:5)
[00:11:05]                     │       at Object.apply (/dev/shm/workspace/parallel/4/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)
[00:11:05]                     │ 
[00:11:05]                     │

Stack Trace

Error: expected [ { sectionId: 'ingest',
    sectionLinks: [ 'ingest_pipelines', 'pipelines' ] },
  { sectionId: 'data',
    sectionLinks: 
     [ 'index_management',
       'index_lifecycle_management',
       'snapshot_restore',
       'rollup_jobs',
       'transform',
       'remote_clusters' ] },
  { sectionId: 'insightsAndAlerting',
    sectionLinks: [ 'watcher' ] },
  { sectionId: 'stack',
    sectionLinks: [ 'license_management', 'upgrade_assistant' ] } ] to have a length of 3 but got 4
    at Assertion.assert (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.length (/dev/shm/workspace/parallel/4/kibana/packages/kbn-expect/expect.js:374:8)
    at Context.<anonymous> (test/functional/apps/upgrade_assistant/feature_controls/upgrade_assistant_security.ts:68:36)
    at runMicrotasks (<anonymous>)
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
    at Object.apply (/dev/shm/workspace/parallel/4/kibana/packages/kbn-test/src/functional_test_runner/lib/mocha/wrap_function.js:73:16)

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@pheyos pheyos merged commit c4227d9 into elastic:7.x Feb 11, 2021
@pheyos pheyos deleted the backport/7.x/pr-91095 branch February 11, 2021 14:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

@pheyos pheyos

Labels

backport This PR is a backport of another PR :ml

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@pheyos @elasticmachine @kibanamachine