[Ingest Manager] Update package registry docker image for CI. by skh · Pull Request #70716 · elastic/kibana

skh · 2020-07-03T13:46:20Z

Summary

Updates the docker image in CI to today's distribution build.

The image is tagged with a commit hash of the package-registry repository. The contents of this image will not change when newer distribution images are built, as they will come with a newer commit hash.

Updating the docker image we use in CI is a manual process by intention, as we only want to introduce a changed package registry on purpose, and not by accident.

How to test this

inspect the CI result
run ingest management api integration tests locally as described in dev_docs/api_integration_tests.md

elasticmachine · 2020-07-06T07:30:05Z

Pinging @elastic/ingest-management (Team:Ingest Management)

x-pack/test/ingest_manager_api_integration/apis/file.ts

skh · 2020-07-06T15:07:36Z

@elasticmachine merge upstream

jonathan-buttner

I tested this locally 👍

kibanamachine · 2020-07-06T16:56:53Z

💛 Build succeeded, but was flaky

continuous-integration/kibana-ci/pull-request
Commit: 74c1446
Flaky suites:
- xpack-kibana-ciGroup7

Test Failures

Kibana Pipeline / kibana-xpack-agent / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/dashboard/_async_dashboard·ts.dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 2 times on tracked branches: https://github.com/elastic/kibana/issues/70715

[00:00:00]       │
[00:00:00]         └-: dashboard
[00:00:00]           └-> "before all" hook
[00:09:17]           └-: sample data dashboard
[00:09:17]             └-> "before all" hook
[00:09:17]             └-> "before all" hook
[00:09:17]               │ debg ... sleep(5000) start
[00:09:22]               │ debg ... sleep(5000) end
[00:09:22]               │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050820136#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:23]               │
[00:09:23]               │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:23]               │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg TestSubjects.find(kibanaChrome)
[00:09:23]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:25]               │ debg isGlobalLoadingIndicatorVisible
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:25]               │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:41Z
[00:09:25]               │        Adding connection to http://localhost:6181/elasticsearch
[00:09:25]               │
[00:09:25]               │      "
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:25]               │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:25]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:25]               │ debg TestSubjects.click(addSampleDataSetflights)
[00:09:25]               │ debg Find.clickByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg TestSubjects.find(sampleDataSetCardflights)
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="sampleDataSetCardflights"]') with timeout=10000
[00:09:27]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:27]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:27]               │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _before all_ hook.png"
[00:09:27]               │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]               │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _before all_ hook.html
[00:09:27]               └- ✖ fail: "dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard""
[00:09:27]               │

Stack Trace

Error: expected false to equal true
    at Assertion.assert (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:100:11)
    at Assertion.be.Assertion.equal (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:227:8)
    at Assertion.be (/dev/shm/workspace/kibana/packages/kbn-expect/expect.js:69:22)
    at Context.before (test/functional/apps/dashboard/_async_dashboard.ts:39:30)
    at process._tickCallback (internal/process/next_tick.js:68:7)

Kibana Pipeline / kibana-xpack-agent / Chrome X-Pack UI Functional Tests.x-pack/test/functional/apps/dashboard/_async_dashboard·ts.dashboard sample data dashboard "after all" hook for "toggle from Discover to Dashboard attempt 2"

Link to Jenkins

Standard Out

Failed Tests Reporter:
  - Test has failed 15 times on tracked branches: https://github.com/elastic/kibana/issues/65949

[00:00:00]       │
[00:00:00]         └-: dashboard
[00:00:00]           └-> "before all" hook
[00:09:17]           └-: sample data dashboard
[00:09:17]             └-> "before all" hook
[00:09:17]             └-> "before all" hook
[00:09:17]               │ debg ... sleep(5000) start
[00:09:22]               │ debg ... sleep(5000) end
[00:09:22]               │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050820136#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:23]               │
[00:09:23]               │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:23]               │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:23]               │ debg TestSubjects.find(kibanaChrome)
[00:09:23]               │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:25]               │ debg isGlobalLoadingIndicatorVisible
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:25]               │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:41Z
[00:09:25]               │        Adding connection to http://localhost:6181/elasticsearch
[00:09:25]               │
[00:09:25]               │      "
[00:09:25]               │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:25]               │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:25]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:25]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:25]               │ debg TestSubjects.click(addSampleDataSetflights)
[00:09:25]               │ debg Find.clickByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=10000
[00:09:25]               │ debg TestSubjects.find(sampleDataSetCardflights)
[00:09:25]               │ debg Find.findByCssSelector('[data-test-subj="sampleDataSetCardflights"]') with timeout=10000
[00:09:27]               │ debg TestSubjects.exists(addSampleDataSetflights)
[00:09:27]               │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="addSampleDataSetflights"]') with timeout=2500
[00:09:27]               │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _before all_ hook.png"
[00:09:27]               │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]               │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _before all_ hook.html
[00:09:27]               └- ✖ fail: "dashboard sample data dashboard "before all" hook for "should launch sample flights data set dashboard""
[00:09:27]               │
[00:09:27]               └-> "after all" hook
[00:09:27]                 │ debg navigateToActualUrl http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │ debg browser[INFO] http://localhost:6181/app/home?_t=1594050824576#/tutorial_directory/sampleData 341 Refused to execute inline script because it violates the following Content Security Policy directive: "script-src 'unsafe-eval' 'self'". Either the 'unsafe-inline' keyword, a hash ('sha256-P5polb1UreUSOe5V/Pv7tc+yeZuJXiOi/3fqhGsU7BE='), or a nonce ('nonce-...') is required to enable inline execution.
[00:09:27]                 │
[00:09:27]                 │ debg browser[INFO] http://localhost:6181/bundles/app/core/bootstrap.js 42:19 "^ A single error about an inline script not firing due to content security policy is expected!"
[00:09:27]                 │ debg currentUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │          appUrl = http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:09:27]                 │ debg TestSubjects.find(kibanaChrome)
[00:09:27]                 │ debg Find.findByCssSelector('[data-test-subj="kibanaChrome"]') with timeout=60000
[00:09:29]                 │ debg isGlobalLoadingIndicatorVisible
[00:09:29]                 │ debg TestSubjects.exists(globalLoadingIndicator)
[00:09:29]                 │ debg Find.existsByDisplayedByCssSelector('[data-test-subj="globalLoadingIndicator"]') with timeout=1500
[00:09:29]                 │ debg browser[INFO] http://localhost:6181/34342/bundles/kbn-ui-shared-deps/kbn-ui-shared-deps.js 452:106112 "INFO: 2020-07-06T15:53:45Z
[00:09:29]                 │        Adding connection to http://localhost:6181/elasticsearch
[00:09:29]                 │
[00:09:29]                 │      "
[00:09:29]                 │ debg TestSubjects.exists(globalLoadingIndicator-hidden)
[00:09:29]                 │ debg Find.existsByCssSelector('[data-test-subj="globalLoadingIndicator-hidden"]') with timeout=100000
[00:09:29]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:29]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:09:39]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:09:39]                 │      Wait timed out after 10081ms
[00:09:40]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:40]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:09:50]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:09:50]                 │      Wait timed out after 10060ms
[00:09:50]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:09:50]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:00]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:00]                 │      Wait timed out after 10018ms
[00:10:01]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:01]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:11]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:11]                 │      Wait timed out after 10032ms
[00:10:12]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:12]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:22]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:22]                 │      Wait timed out after 10013ms
[00:10:22]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:22]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:32]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:32]                 │      Wait timed out after 10011ms
[00:10:33]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:33]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:43]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:43]                 │      Wait timed out after 10013ms
[00:10:43]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:43]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:10:53]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:10:53]                 │      Wait timed out after 10055ms
[00:10:54]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:10:54]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:04]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:04]                 │      Wait timed out after 10021ms
[00:11:04]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:04]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:14]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:14]                 │      Wait timed out after 10014ms
[00:11:15]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:15]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:25]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:25]                 │      Wait timed out after 10036ms
[00:11:25]                 │ debg TestSubjects.find(removeSampleDataSetflights)
[00:11:25]                 │ debg Find.findByCssSelector('[data-test-subj="removeSampleDataSetflights"]') with timeout=10000
[00:11:35]                 │ debg --- retry.tryForTime error: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
[00:11:35]                 │      Wait timed out after 10030ms
[00:11:36]                 │ info Taking screenshot "/dev/shm/workspace/kibana/x-pack/test/functional/screenshots/failure/dashboard sample data dashboard _after all_ hook.png"
[00:11:36]                 │ info Current URL is: http://localhost:6181/app/home#/tutorial_directory/sampleData
[00:11:36]                 │ info Saving page source to: /dev/shm/workspace/kibana/x-pack/test/functional/failure_debug/html/dashboard sample data dashboard _after all_ hook.html
[00:11:36]                 └- ✖ fail: "dashboard sample data dashboard "after all" hook for "toggle from Discover to Dashboard attempt 2""
[00:11:36]                 │

Stack Trace

Error: retry.tryForTime timeout: TimeoutError: Waiting for element to be located By(css selector, [data-test-subj="removeSampleDataSetflights"])
Wait timed out after 10030ms
    at /dev/shm/workspace/kibana/node_modules/selenium-webdriver/lib/webdriver.js:842:17
    at process._tickCallback (internal/process/next_tick.js:68:7)
    at onFailure (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:28:9)
    at retryForSuccess (/dev/shm/workspace/kibana/test/common/services/retry/retry_for_success.ts:68:13)

Build metrics

✅ unchanged

History

💚 Build #58691 succeeded 31e15b1

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

…c#70716) * Update package registry docker image for CI. * Adapt to new registry filesystem layout. * Adjust tests to changed registry behavior. Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

#70836) * Update package registry docker image for CI. * Adapt to new registry filesystem layout. * Adjust tests to changed registry behavior. Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com>

Update package registry docker image for CI.

1dee045

skh self-assigned this Jul 3, 2020

skh added release_note:skip Skip the PR/issue when compiling release notes Team:Fleet Team label for Observability Data Collection Fleet team v7.9.0 v8.0.0 labels Jul 3, 2020

skh added 2 commits July 3, 2020 16:25

Adapt to new registry filesystem layout.

df2346e

Adjust tests to changed registry behavior.

31e15b1

skh marked this pull request as ready for review July 6, 2020 07:30

jfsiii reviewed Jul 6, 2020

View reviewed changes

x-pack/test/ingest_manager_api_integration/apis/file.ts Show resolved Hide resolved

jfsiii self-requested a review July 6, 2020 14:21

jfsiii approved these changes Jul 6, 2020

View reviewed changes

Merge branch 'master' into update-registry-in-ci

74c1446

jonathan-buttner approved these changes Jul 6, 2020

View reviewed changes

jonathan-buttner mentioned this pull request Jul 6, 2020

[EPM][Security Solution] Implementing dataset component templates #70517

Merged

skh merged commit 89dcdbb into elastic:master Jul 6, 2020

skh mentioned this pull request Jul 6, 2020

[7.x] [Ingest Manager] Update package registry docker image for CI. (#70716) #70836

Merged

jen-huang mentioned this pull request Jul 6, 2020

[Ingest Manager] Support limiting integrations on an agent config #70542

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Ingest Manager] Update package registry docker image for CI.#70716

[Ingest Manager] Update package registry docker image for CI.#70716
skh merged 4 commits intoelastic:masterfrom
skh:update-registry-in-ci

skh commented Jul 3, 2020 •

edited

Loading

Uh oh!

elasticmachine commented Jul 6, 2020

Uh oh!

Uh oh!

skh commented Jul 6, 2020

Uh oh!

jonathan-buttner left a comment

Uh oh!

kibanamachine commented Jul 6, 2020

Standard Out

Stack Trace

Standard Out

Stack Trace

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

skh commented Jul 3, 2020 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

How to test this

Uh oh!

elasticmachine commented Jul 6, 2020

Uh oh!

Uh oh!

skh commented Jul 6, 2020

Uh oh!

jonathan-buttner left a comment

Choose a reason for hiding this comment

Uh oh!

kibanamachine commented Jul 6, 2020

💛 Build succeeded, but was flaky

Test Failures

Standard Out

Stack Trace

Standard Out

Stack Trace

Build metrics

History

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

skh commented Jul 3, 2020 •

edited

Loading