Skip to content

test: Sync Feature Flag Registry - 2026-04-07 01:42 UTC#28444

Merged
pnarayanaswamy merged 33 commits into
mainfrom
qa/sync-ff-registry-metamask-mobile-2026-04-07-0142
Apr 13, 2026
Merged

test: Sync Feature Flag Registry - 2026-04-07 01:42 UTC#28444
pnarayanaswamy merged 33 commits into
mainfrom
qa/sync-ff-registry-metamask-mobile-2026-04-07-0142

Conversation

@github-actions

@github-actions github-actions Bot commented Apr 7, 2026

Copy link
Copy Markdown
Contributor

Feature Flag Registry Drift Report

Feature flag drift was detected between E2E tests and production.

Download the drift-report artifact for the full report.

@github-actions github-actions Bot added team-qa QA team no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed labels Apr 7, 2026
@pnarayanaswamy pnarayanaswamy added the skip-smart-e2e-selection Skip Smart E2E selection, i.e. select all E2E tests to run label Apr 7, 2026
@github-actions

github-actions Bot commented Apr 7, 2026

Copy link
Copy Markdown
Contributor Author

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk size-XL labels Apr 7, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 7, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 7, 2026
@codecov-commenter

codecov-commenter commented Apr 7, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 82.14%. Comparing base (9f195d0) to head (1170bc0).
⚠️ Report is 3 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #28444      +/-   ##
==========================================
- Coverage   82.14%   82.14%   -0.01%     
==========================================
  Files        4949     4949              
  Lines      130070   130077       +7     
  Branches    29004    29005       +1     
==========================================
+ Hits       106851   106854       +3     
- Misses      15923    15926       +3     
- Partials     7296     7297       +1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 8, 2026
@pnarayanaswamy pnarayanaswamy requested review from a team as code owners April 8, 2026 08:53
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 8, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 10, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 10, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 13, 2026
jvbriones
jvbriones previously approved these changes Apr 13, 2026
@pnarayanaswamy

pnarayanaswamy commented Apr 13, 2026

Copy link
Copy Markdown
Contributor

For all tests with the homepageRedesignV1: { enabled: false, minimumVersion: '0.0.0' }, homepageSectionsV1: { enabled: false, minimumVersion: '0.0.0' } flags follow up tickets to be created to clean up and tackle the flags. https://consensyssoftware.atlassian.net/browse/MMQA-1712

// Exclude 'nba' — NBA markets render PredictGameDetailsContent which uses a different cash-out testID not yet supported by E2E page objects
predictLiveSports: {
versions: {
'7.67.0': { enabled: true, leagues: ['nfl'] },

@pnarayanaswamy pnarayanaswamy Apr 13, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is needed because on PROD NBA is now added to the live sports category which makes the predict tests that use Spurs vs Pelicans as test mocks to fail because it renders a different component(cash out button). A new ticket created to clean up the mocks and update the tests

...remoteFeatureFlagHomepageSectionsV1Enabled(),
...remoteFeatureFlagPredictEnabled(true),
carouselBanners: false,
exploreSectionsOrder: {

@pnarayanaswamy pnarayanaswamy Apr 13, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The exploreSectionsOrder is set to {} on PROD, this causes the tests to fail because the sections are not displayed. New ticket created to investigate and fix

LeVinhGithub
LeVinhGithub previously approved these changes Apr 13, 2026
testSpecificMock: async (mockServer: Mockttp) => {
await setupMockRequest(mockServer, {
requestMethod: 'GET',
url: /^https:\/\/digest\.api\.cx\.metamask\.io\/api\/v1\/asset-summary/,

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this suddenly needed? Should this be mocked in more places than just this test?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the test started to fail without this mock because we synced the tests with all enabled feature flags on PROD. If this is not needed then the test should override the specific mocks that cause this call to happen.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't have context for when this API is called, but I find it strange that this mock isn't required in other tests that use the send flow?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am not sure either, the test started to fail because of this API call being made from the app. This call had to be added in a lot of different tests you can see that in this PR

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since it is required in multiple tests should it be generally mocked in the test framework? Apologies if that wasn't clear at first, that was the intention with my question.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah yes you are right, I did add it to the default mocks and then forgot to clean up some tests 🙈 Will push an update

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done

@pnarayanaswamy pnarayanaswamy dismissed stale reviews from LeVinhGithub and jvbriones via 311c878 April 13, 2026 14:12
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 13, 2026
@github-actions github-actions Bot added risk-high Extensive testing required · High bug introduction risk and removed risk-high Extensive testing required · High bug introduction risk labels Apr 13, 2026
@github-actions

Copy link
Copy Markdown
Contributor Author

🔍 Smart E2E Test Selection

⏭️ Smart E2E selection skipped - skip-smart-e2e-selection label found

All E2E tests pre-selected.

View GitHub Actions results

@sonarqubecloud

Copy link
Copy Markdown

@github-actions

Copy link
Copy Markdown
Contributor Author

E2E Fixture Validation — Schema is up to date
11 value mismatches detected (expected — fixture represents an existing user).
View details

@gantunesr gantunesr left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved for Accounts CO

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

no-changelog no-changelog Indicates no external facing user changes, therefore no changelog documentation needed release-7.74.0 Issue or pull request that will be included in release 7.74.0 risk-high Extensive testing required · High bug introduction risk size-XL skip-smart-e2e-selection Skip Smart E2E selection, i.e. select all E2E tests to run team-qa QA team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants