Skip to content

Unskips heatmap suite and fixes flakiness#96941

Merged
stratoula merged 1 commit intoelastic:masterfrom
stratoula:heatmap-flakiness
Apr 14, 2021
Merged

Unskips heatmap suite and fixes flakiness#96941
stratoula merged 1 commit intoelastic:masterfrom
stratoula:heatmap-flakiness

Conversation

@stratoula
Copy link
Copy Markdown
Contributor

@stratoula stratoula commented Apr 13, 2021

Summary

Closes #95642
Closes #92301

The heatmap suite is skipped due to a flakiness on one of its tests. The problem is that the number of colors doesn't change so the data do not change. I have noticed that the type method can be flaky so I replaced it with the simpler testSubjects.setValue.

Moreover I noticed that some suites run twice without a reason. As soon as these vislib libraries haven't been replaced yet there is no reason to test them both for the Legacy charts switch on and off. I suspect that for this reason I see this error on many heatmap failures on the cloud.

visualize app  heatmap chart should show 6 custom color ranges

Functional tests runner (100 times)
https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/1445/
https://kibana-ci.elastic.co/job/kibana+flaky-test-suite-runner/1447/

Checklist

@stratoula stratoula changed the title Unskip heatmap suite and fixes flakiness Unskips heatmap suite and fixes flakiness Apr 13, 2021
@kibanamachine
Copy link
Copy Markdown
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@stratoula stratoula added v7.13.0 v8.0.0 release_note:skip Skip the PR/issue when compiling release notes Feature:Heatmap Heatmap visualization failed-test A test failure on a tracked branch, potentially flaky-test labels Apr 13, 2021
@stratoula stratoula marked this pull request as ready for review April 13, 2021 12:56
@stratoula stratoula requested a review from liza-mae April 13, 2021 12:56
Copy link
Copy Markdown
Contributor

@liza-mae liza-mae left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@stratoula stratoula merged commit 8db70bc into elastic:master Apr 14, 2021
stratoula added a commit to stratoula/kibana that referenced this pull request Apr 14, 2021
jloleysens added a commit to jloleysens/kibana that referenced this pull request Apr 14, 2021
…ax_primary_shard_size

* 'master' of github.com:elastic/kibana: (99 commits)
  added missing optional chain for bracket notation (elastic#96939)
  [Discover][DocViewer] Fix toggle columns from doc viewer table tab (elastic#95748)
  [TSVB] Fix per-request caching of index patterns (elastic#97043)
  [Datatable] Fix filter cell flakiness (elastic#96934)
  Unskip heatmap suite and fixes flakiness (elastic#96941)
  [Fleet] Improve performance of data stream API (elastic#97058)
  [ML] Data Frame Analytics: remove beta badge (elastic#96977)
  [App Search] Migrate expanded rows for meta engines table in Engines Overview (elastic#96251)
  Instances latency distribution chart tooltips and axis fixes (elastic#95577)
  [Monitoring] Using primary average shard size (elastic#96177)
  [Workplace Search] Hide Kibana chrome on 3rd party connector redirects (elastic#97028)
  ## [Security Solution] Fixes `Exit full screen` and `Copy to cliboard` styling issues (elastic#96676)
  Index pattern field editor - Add warning on name or type change (elastic#95528)
  [App Search] Add small engine breadcrumb utility helper (elastic#96917)
  Copy esArchiver commands from ./reassign.ts to fix tests (elastic#97012)
  [Security Solution][Detections] Updates MITRE Tactics, Techniques, and Subtechniques for 7.13 (elastic#97011)
  Index patterns server - throw correct error on field caps 404 (elastic#95879)
  Use `EuiThemeProvider` in lists plugin tests and stories (elastic#96129)
  [npm] upgrade caniuse database (elastic#97002)
  chore(NA): moving @kbn/apm-utils into bazel (elastic#96227)
  ...

# Conflicts:
#	x-pack/plugins/index_lifecycle_management/__jest__/client_integration/edit_policy/serialization/policy_serialization.test.ts
#	x-pack/plugins/index_lifecycle_management/public/application/sections/edit_policy/form/schema.ts
phillipb added a commit to phillipb/kibana that referenced this pull request Apr 14, 2021
…to-metrics-tab

* 'master' of github.com:elastic/kibana: (61 commits)
  [Usage collection] Usage counters (elastic#96696)
  UI actions readme (elastic#96925)
  [TSVB] Enable brush for visualizations created with no index patterns (elastic#96727)
  [Data telemetry] Add Async Search to the tests (elastic#96693)
  added missing optional chain for bracket notation (elastic#96939)
  [Discover][DocViewer] Fix toggle columns from doc viewer table tab (elastic#95748)
  [TSVB] Fix per-request caching of index patterns (elastic#97043)
  [Datatable] Fix filter cell flakiness (elastic#96934)
  Unskip heatmap suite and fixes flakiness (elastic#96941)
  [Fleet] Improve performance of data stream API (elastic#97058)
  [ML] Data Frame Analytics: remove beta badge (elastic#96977)
  [App Search] Migrate expanded rows for meta engines table in Engines Overview (elastic#96251)
  Instances latency distribution chart tooltips and axis fixes (elastic#95577)
  [Monitoring] Using primary average shard size (elastic#96177)
  [Workplace Search] Hide Kibana chrome on 3rd party connector redirects (elastic#97028)
  ## [Security Solution] Fixes `Exit full screen` and `Copy to cliboard` styling issues (elastic#96676)
  Index pattern field editor - Add warning on name or type change (elastic#95528)
  [App Search] Add small engine breadcrumb utility helper (elastic#96917)
  Copy esArchiver commands from ./reassign.ts to fix tests (elastic#97012)
  [Security Solution][Detections] Updates MITRE Tactics, Techniques, and Subtechniques for 7.13 (elastic#97011)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

failed-test A test failure on a tracked branch, potentially flaky-test Feature:Heatmap Heatmap visualization release_note:skip Skip the PR/issue when compiling release notes v7.13.0 v8.0.0

Projects

None yet

3 participants