Skip to content

Add a/b test for full screen transaction confirmations#7162

Merged
danjm merged 9 commits intodevelopfrom
abtest-fullscreenvpopup
Sep 24, 2019
Merged

Add a/b test for full screen transaction confirmations#7162
danjm merged 9 commits intodevelopfrom
abtest-fullscreenvpopup

Conversation

@danjm
Copy link
Copy Markdown
Contributor

@danjm danjm commented Sep 12, 2019

Resolves #7022

This PR adds an a/b test as per #7022. All users are placed in one of two groups. The control group sees confirmations of transactions from dapps via the current/normal notification window. The test group sees the confirmations in a full screen browser tab.

Here is a demo video of creating a transaction while in the test group: https://streamable.com/zwcjf

Meanwhile, create a tx while in the control group works as expected: https://streamable.com/xldp3

Here are the sorts of results we can see on matomo:

Screenshot from 2019-09-12 14-38-36

cc @bdresser @omnat

@danjm danjm requested review from Gudahtt and whymarrh September 12, 2019 17:17
@metamaskbot
Copy link
Copy Markdown
Collaborator

Builds ready [5fcc83b]

@danjm danjm force-pushed the abtest-fullscreenvpopup branch from 5fcc83b to 983e04b Compare September 19, 2019 11:43
@metamaskbot
Copy link
Copy Markdown
Collaborator

Builds ready [983e04b]

@metamaskbot
Copy link
Copy Markdown
Collaborator

Builds ready [07e03c9]

Gudahtt
Gudahtt previously approved these changes Sep 21, 2019
Copy link
Copy Markdown
Member

@Gudahtt Gudahtt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Though migration 37 is added both here and in #7205, so one of them will need to be renamed.

@metamaskbot
Copy link
Copy Markdown
Collaborator

Builds ready [299979c]

@danjm danjm merged commit 1bd22b5 into develop Sep 24, 2019
Gudahtt added a commit to Gudahtt/metamask-extension that referenced this pull request Sep 27, 2019
* origin/develop: (56 commits)
  Add advanced setting to enable editing nonce on confirmation screens (MetaMask#7089)
  Add migration on 3box imports and remove feature flag (MetaMask#7209)
  ci - install deps - limit install scripts to whitelist (MetaMask#7208)
  Add a/b test for full screen transaction confirmations (MetaMask#7162)
  Update minimum Firefox verison to 56.0 (MetaMask#7213)
  mesh-testing - submit infura rpc requests to mesh-testing container (MetaMask#7031)
  obs-store/local-store should upgrade webextension error to real error (MetaMask#7207)
  sesify-viz - bump dep for visualization enhancement (MetaMask#7175)
  address book entries by chainId (MetaMask#7205)
  Optimize images only during production build (MetaMask#7194)
  Use common test build during CI (MetaMask#7196)
  Report missing `en` locale messages to Sentry (MetaMask#7197)
  Verify locales on CI (MetaMask#7199)
  updated ganache and addons-linter (MetaMask#7204)
  fixup! add user rejected errors
  add user rejected errors
  update json-rpc-engine
  use eth-json-rpc-errors
  Remove unused locale messages (MetaMask#7190)
  Remove unused components (MetaMask#7191)
  ...
@whymarrh whymarrh deleted the abtest-fullscreenvpopup branch October 2, 2019 15:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fullscreen v/s Pop-up

3 participants