[Testing] Fix for flaky UITests in CI - 2#31763
Conversation
|
/azp run MAUI-UITests-public |
|
Azure Pipelines successfully started running 1 pipeline(s). |
There was a problem hiding this comment.
Pull Request Overview
This PR addresses flaky UI test failures in the CI pipeline by improving test reliability and rendering stability for WebView and CollectionView tests.
- Added internet connectivity verification for WebView tests to ensure network availability before execution
- Changed scroll strategy from Auto to Gesture for better reliability in CollectionView horizontal scrolling tests
- Updated WebView test to use a more stable static web link (example.com) instead of a GitHub issue URL
Reviewed Changes
Copilot reviewed 3 out of 5 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
| Issue30575.cs (Tests) | Added VerifyInternetConnectivity() call before WebView test execution |
| CollectionViewUITests.HeaderAndFooter.cs | Changed scroll strategy from Auto to Gesture for improved reliability |
| Issue30575.cs (HostApp) | Updated WebView URL to example.com and added isInternetRequired flag |
| @@ -14,6 +14,7 @@ public Issue30575(TestDevice device) : base(device) { } | |||
| [Category(UITestCategories.WebView)] | |||
| public void WebViewShouldNotMirrored() | |||
There was a problem hiding this comment.
VisualTestUtils.VisualTestFailedException :
Snapshot different than baseline: WebViewShouldNotMirrored.png (1.90% difference)
Failing on Android, Mac and Windows.
There was a problem hiding this comment.
@jsuarezruiz I have added the pending snapshots in the latest commit.
|
/azp run |
|
Azure Pipelines successfully started running 3 pipeline(s). |
|
/rebase |
04cb5ce to
1184149
Compare
|
/azp run |
|
Azure Pipelines successfully started running 3 pipeline(s). |
|
/azp run |
|
Azure Pipelines successfully started running 3 pipeline(s). |
|
/rebase |
d073c7f to
dfb00ff
Compare
|
/azp run MAUI-UITests-public |
|
Azure Pipelines successfully started running 1 pipeline(s). |
jsuarezruiz
left a comment
There was a problem hiding this comment.
WebViewShouldNotMirrored test failing on Windows and Mac.
Example, Mac:
VisualTestUtils.VisualTestFailedException :
Snapshot different than baseline: WebViewShouldNotMirrored.png (3.34% difference)
| namespace Maui.Controls.Sample.Issues; | ||
|
|
||
| [Issue(IssueTracker.Github, 30575, "FlowDirection RightToLeft causes mirrored content in WebView", PlatformAffected.UWP)] | ||
| [Issue(IssueTracker.Github, 30575, "FlowDirection RightToLeft causes mirrored content in WebView", PlatformAffected.UWP, isInternetRequired: true)] |
There was a problem hiding this comment.
Is this change no longer necessary with the HtmlWebViewSource below?
There was a problem hiding this comment.
@MartyIX I have updated the test case in the latest commit.
@jsuarezruiz I have updated the test case in the latest commit. Could you please rerun the CI? |
|
/azp run |
|
Azure Pipelines successfully started running 3 pipeline(s). |
jsuarezruiz
left a comment
There was a problem hiding this comment.
@TamilarasanSF4853 Could you rebase to fix the conflicts?
79b9d70 to
9231c88
Compare
@jsuarezruiz I have rebased the branch and resolved the conflicts. |
|
/azp run |
|
Azure Pipelines successfully started running 3 pipeline(s). |
|
/rebase |
acb0087 to
b9c0296
Compare
This PR addresses UI test image failures in the main branch and includes updates to improve rendering and test stability across platforms.
Test cases: