Skip to content

[net11.0] Screenshot baseline mismatches after main merge (Shell, TabbedPage, Image, Flyout) #34586

@PureWeen

Description

@PureWeen

Build Information

Build: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Build error leg or test failing: Shell, TabbedPage UITests on Android API30
Pull request: #34550

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\\.png",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Description

After merging main → net11.0 (PR #34550), UITests fail with screenshot baseline mismatches. The root cause is the Material3 package (#33450) changing BottomNavigationView.MaxItemCount from 5 → 6 on net11.0, which altered bottom tab layout rendering.

Status

16 of the original 26 snapshots have been fixed by PR #34601, which clamps MaxItemCount back to 5 and updates the affected baselines. Issue16918Test was split to its own Known Build Error (#34624) since it has a different root cause (MacCatalyst flaky, not MaxItemCount). The pattern above now only covers the 9 remaining unfixed VerifyShell_ snapshots*.

Remaining unfixed snapshots (9)

Snapshot Test Platform Notes
VerifyShell_IsVisible.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarBackgroundColorSetToNull.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarDisabledColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarForegroundColorAndTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarTitleColorAndUnSelectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline
VerifyShell_TabBarUnselectedColor.png ShellTabbedPageFeatureTests Android 30 PR #34601 bet: code fix restores baseline

Split to separate Known Build Errors

Fixed by PR #34601 (removed from pattern)

16 snapshots with updated baselines (click to expand)
  • DynamicFontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • DynamicTabSectionVisibility.png
  • FontImageSourceColorShouldApplyOnBottomTabIconOnAndroid.png
  • ImageDoesNotDisappearWhenSwitchingTab.png
  • Issue32993TabBarUpdatesCorrectlyInRTLMode.png
  • NavigationBarLayoutWithMixedHasNavigationBar.png
  • ShellAppearanceUpdatesWhenChangingBetweenTabs.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_1.png
  • ShellAppearanceUpdatesWhenChangingShellSectionToTab_2.png
  • ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout.png
  • TabBarIconsShouldAutoscaleShell.png
  • TabBarShouldBeVisibleOnMacCatalyst.png
  • VerifyShell_TabBarBackgroundColorAndForegroundColor.png
  • VerifyShell_TabBarForegroundColor.png
  • VerifyShell_TabBarForegroundColorAndUnSelectedColor.png
  • VerifyTabbedPageMenuItemTextColor.png

Resolution

Once PR #34601 merges and the remaining 9 VerifyShell_* snapshots are confirmed passing (or baselines updated), close this issue.

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1342062
Error message validated: [Snapshot different than baseline: (VerifyShell_IsVisible|VerifyShell_TabBarBackgroundColor|VerifyShell_TabBarBackgroundColorAndTitleColor|VerifyShell_TabBarBackgroundColorSetToNull|VerifyShell_TabBarDisabledColor|VerifyShell_TabBarForegroundColorAndTitleColor|VerifyShell_TabBarTitleColor|VerifyShell_TabBarTitleColorAndUnSelectedColor|VerifyShell_TabBarUnselectedColor)\.png]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 3/24/2026 8:07:14 PM UTC

Report

Build Definition Step Name Console log Pull Request
1362580 dotnet/maui Controls Shell Log
1357500 dotnet/maui Controls Shell Log #32529
2930819 dotnet-maui Controls Shell Log
2930810 dotnet-maui Controls Image,ImageButton,IndicatorView,InputTransparent,IsEnabled,IsVisible Log
Build Definition Test Pull Request
1375765 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1374433 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
2948283 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1371822 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible #34882
2942074 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Mac).VerifyShell_IsVisible
1350456 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Android).VerifyShell_TabBarBackgroundColorSetToNull #34618
1350369 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1350390 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue14587(Android).ImageDoesNotDisappearWhenSwitchingTab
1349891 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34601
1350231 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue14587(Android).ImageDoesNotDisappearWhenSwitchingTab
1348174 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #33231
1343658 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34107
1349691 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34600
2931845 dotnet-maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Android).VerifyShell_TabBarBackgroundColorSetToNull
1348474 dotnet/maui Microsoft.Maui.TestCases.Tests.ShellTabbedPageFeatureTests(Android).VerifyShell_TabBarBackgroundColorAndForegroundColor #34601
1347854 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1344608 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34571
1348545 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue20166(Windows).ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout
1348352 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue20166(Windows).ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout
1348136 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #30074
1348042 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #29442
2931549 dotnet-maui Microsoft.Maui.TestCases.Tests.Issues.Issue32329(Android).TabBarShouldBeVisibleOnMacCatalyst
1346753 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue20166(Android).ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout
1346757 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue20166(Android).ShouldHideCustomFlyoutIconWhenNavigatingToPageWithDisabledFlyout
1346011 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1346003 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1346007 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1345702 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test
1342062 dotnet/maui Microsoft.Maui.TestCases.Tests.Issues.Issue16918(Mac).Issue16918Test #34550

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
1 4 33

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions