Skip to content

fix: flaky test Test Snap Interactive UI test interactive ui elements#26792

Merged
seaona merged 2 commits intodevelopfrom
fix-snap-ui-test
Aug 30, 2024
Merged

fix: flaky test Test Snap Interactive UI test interactive ui elements#26792
seaona merged 2 commits intodevelopfrom
fix-snap-ui-test

Conversation

@seaona
Copy link
Copy Markdown
Member

@seaona seaona commented Aug 30, 2024

Description

The snap fails at the point of trying to find the scrolll element. The problem is that the previous Connect action takes several seconds, and the default timeout for the next action is not enough (1000ms) -- see video.
In this PR we increase the timeout to 3000ms.
Note: having a bigger timeout is safe, as if the condition is met earlier, it will jump to the next step, so we won't wait for the complete 3000ms when it's not needed.

Open in GitHub Codespaces

Related issues

Fixes: #26793

Manual testing steps

  1. Check ci

Screenshots/Recordings

See how the Connect action takes some time, making the subsequent action to fail, as the scroll element cannot be located within the timeout

snap-failure-scroll.mp4

Pre-merge author checklist

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@seaona seaona self-assigned this Aug 30, 2024
@github-actions
Copy link
Copy Markdown
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@github-actions github-actions bot added the team-extension-platform Extension Platform team label Aug 30, 2024
@seaona seaona added the area-qa Relating to QA work (Quality Assurance) label Aug 30, 2024
@sonarqubecloud
Copy link
Copy Markdown

@seaona seaona marked this pull request as ready for review August 30, 2024 06:35
@seaona seaona requested a review from a team as a code owner August 30, 2024 06:35
@codecov
Copy link
Copy Markdown

codecov bot commented Aug 30, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.13%. Comparing base (1b4417d) to head (faff3ab).

Additional details and impacted files
@@           Coverage Diff            @@
##           develop   #26792   +/-   ##
========================================
  Coverage    70.13%   70.13%           
========================================
  Files         1417     1417           
  Lines        49440    49440           
  Branches     13833    13833           
========================================
  Hits         34672    34672           
  Misses       14768    14768           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@metamaskbot
Copy link
Copy Markdown
Collaborator

Builds ready [faff3ab]
Page Load Metrics (1762 ± 101 ms)
PlatformPageMetricMin (ms)Max (ms)Average (ms)StandardDeviation (ms)MarginOfError (ms)
ChromeHomefirstPaint15242303176720498
domContentLoaded15132288174019795
load152523021762210101
domInteractive145432115
Bundle size diffs
  • background: 0 Bytes (0.00%)
  • ui: 0 Bytes (0.00%)
  • common: 0 Bytes (0.00%)

Copy link
Copy Markdown
Contributor

@chloeYue chloeYue left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM ! Thanks for the fix !

@seaona seaona merged commit b7120e0 into develop Aug 30, 2024
@seaona seaona deleted the fix-snap-ui-test branch August 30, 2024 08:46
@github-actions github-actions bot locked and limited conversation to collaborators Aug 30, 2024
@metamaskbot metamaskbot added the release-12.5.0 Issue or pull request that will be included in release 12.5.0 label Aug 30, 2024
@gauthierpetetin gauthierpetetin added release-12.4.0 Issue or pull request that will be included in release 12.4.0 and removed release-12.5.0 Issue or pull request that will be included in release 12.5.0 labels Sep 11, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

area-qa Relating to QA work (Quality Assurance) flaky tests release-12.4.0 Issue or pull request that will be included in release 12.4.0 team-extension-platform Extension Platform team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix "Test Snap Interactive UI test interactive ui elements"

5 participants