{"id":16789,"date":"2025-10-23T21:56:56","date_gmt":"2025-10-23T21:56:56","guid":{"rendered":"https:\/\/getshogun.com\/learn\/ecommerce-ab-testing\/"},"modified":"2025-10-23T22:25:23","modified_gmt":"2025-10-23T22:25:23","slug":"ecommerce-ab-testing","status":"publish","type":"post","link":"\/learn\/ecommerce-ab-testing","title":{"rendered":"How to Get Started with Ecommerce A\/B Testing"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Behind the scenes of all those flashy product images and captivating categories, ecommerce businesses continuously work to improve their website\u2019s user experience. One of the ways they do this is A\/B testing (or split testing).\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Ecommerce A\/B testing works to understand consumer behavior and optimize the online shopping experience. It does so by showing two different versions of a web page to different groups of a target audience.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Data shows that A\/B testing is the <\/span><a href=\"https:\/\/www.invespcro.com\/blog\/the-state-of-ab-testing\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">second most popular<\/span><\/a><span style=\"font-weight: 400;\"> conversion rate optimization (CRO) method that companies use \u2013 which proves that there\u2019s plenty of merit to the strategy. Whether it\u2019s a change in wording or a swap in color, imagine being able to convert a much greater amount of leads just by tweaking your website design.<\/span><\/p>\n<h2>Why A\/B Testing Is Important<\/h2>\n<p><span style=\"font-weight: 400;\">The ultimate goal of <a href=\"https:\/\/getshogun.com\/products\/shopify-ab-testing\">ecommerce A\/B testing<\/a> is determining how your website will perform at its best. What changes could you make to improve metrics like improving average order value (AOV) or lead to more conversions? With split testing, businesses can compare two versions of a webpage or digital asset to determine that. The different versions usually consist of a current version (A) and an altered version (B). Once the altered version is successful a new variant can be created to further optimize the page.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">There\u2019s no question that online shopping is highly competitive. While customers can visit a mall and select from the stores available there, the digital ecommerce space is endless, with an estimated <\/span><a href=\"https:\/\/www.forbes.com\/sites\/mikebugembe\/2022\/05\/06\/grow-or-die-the-new-reality-of-ecommerce\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">24 million ecommerce sites<\/span><\/a><span style=\"font-weight: 400;\"> around the world in 2022.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A\/B testing lets businesses improve their overall shopping experience by understanding their customers better and then delivering exactly what they\u2019re looking for. The entire process can help you get answers to important business questions, generate more revenue from existing customers, and even provide information for future marketing strategies.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With this hard data to base your decisions on, you can make changes to the design and UX of your website rooted in solid facts. Small tweaks to your checkout process, product pages, or home page can lead to a substantial increase in conversion rates, and A\/B testing can help you keep up with changes in consumer behavior and trends.<\/span><\/p>\n<h2>The Basics of A\/B Testing<\/h2>\n<p><span style=\"font-weight: 400;\">Before starting an A\/B test, there needs to be a theory based on what area of the site you think can be improved. For example, you might think changing the color of your \u2018Add to Cart\u2019 button from red to green will increase click-through rates.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The golden rule of A\/B testing is to only test one thing at a time. If you change multiple things on a page at once, like fonts, headlines, colors, and images, it becomes impossible to figure out which one of these changes influenced the results \u2013 for better or for worse.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">When you stick to one change, like the color of a button in our example, you can eventually associate any increase or decrease in conversions to that specific change. It\u2019s all about understanding how things work behind the test and creating a meaningful theory.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">If you\u2019re interested in testing multiple variables at once, you can use an advanced version of A\/B testing called ecommerce multivariate testing. With this type of testing you\u2019re able to test multiple variables to see which combination performs the best out of all of them. While you can look into how specific elements interact with each other and influence user behavior, it\u2019ll require a larger sample size to produce accurate results.<\/span><\/p>\n<h3>Things to Test<\/h3>\n<p><span style=\"font-weight: 400;\">There\u2019s certainly no shortage of variables you can tweak, but figuring out which changes will have the biggest impact on your ecommerce site can take some time. So, what are some things you can test? <a href=\"https:\/\/getshogun.com\/learn\/ecommerce-ab-testing-ideas\/\">Let\u2019s look at a few elements<\/a> that could bring about results.<\/span><\/p>\n<ul>\n<li><b>Pricing &#8211; <\/b><span style=\"font-weight: 400;\">Testing customers\u2019 responses to different prices can give you a closer look into their buying behavior. Are they sensitive to cost, or do they value product quality more? You can also experiment with incentives like free shipping to find out what is most appealing to your customers.<\/span><\/li>\n<li><b>Headlines &#8211; <\/b><span style=\"font-weight: 400;\">Being the first thing that visitors read on a webpage, headlines can be very influential on shopping behavior. Maybe a different headline style \u2013 like one with more personality \u2013 is more effective in getting people to make a purchase?<\/span><\/li>\n<li><b>Product Names &#8211; <\/b><span style=\"font-weight: 400;\">Just like headlines, the product names themselves can play a major role in attracting customer attention. Do straightforward descriptive names work, or is it worth playing around with a different creative naming strategy?<\/span><\/li>\n<li aria-level=\"1\"><b>Description Text &#8211; <\/b><span style=\"font-weight: 400;\">The way you describe your products outside of their product names also influences conversions. Perhaps your customers are more responsive to emotive storytelling or, alternatively, prefer an overview of the key features through concise bullet points.<\/span><\/li>\n<li><b>\u2018Buy Now\u2019 Button Copy &#8211; <\/b><span style=\"font-weight: 400;\">Little changes to your call-to-action button for purchasing can sometimes end up changing your click-through rates. If your initial copy was \u2018Buy Now,\u2019 you could test other versions like \u2018Add to Cart\u2019 or \u2018Proceed to Checkout.\u2019<\/span><\/li>\n<li><b>Social Proof &#8211; <\/b><span style=\"font-weight: 400;\">In 2021, <\/span><a href=\"https:\/\/www.statista.com\/statistics\/1020836\/share-of-shoppers-reading-reviews-before-purchase\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">36.4% of people<\/span><\/a><span style=\"font-weight: 400;\"> read between 1 and 3 reviews before making a purchase. Placing testimonials, customer reviews, and ratings on the product page or somewhere else on your site can significantly affect purchase decisions.<\/span><\/li>\n<li aria-level=\"1\"><b>Product Photos &#8211; <\/b><span style=\"font-weight: 400;\">Apart from being high-quality, you can get creative with other variables like image size, number of images, angles, or even product videos to see what resonates most with your customers.<\/span><\/li>\n<li><b>Navigation Menu &#8211; <\/b><span style=\"font-weight: 400;\">Your site\u2019s architecture has a huge influence on the customer shopping experience. The navigation menu is a big part of that, making it either difficult or effortless for them to look for specific products or categories. Experimenting with the order of items, fonts, icons, and types of menus can all be worthwhile.<\/span><\/li>\n<li aria-level=\"1\"><b>Page Layouts &#8211; <\/b><span style=\"font-weight: 400;\">How elements are laid out on each page can help guide your customers through the buying process. For example, one-column versus multi-column layouts or ordering the most important items at the top of the page and the less important elements at the bottom.<\/span><\/li>\n<\/ul>\n<div class=\"cta-visual-pb\">\n<p><span class=\"cta-title\">Get started A\/B testing on your ecommerce store<\/span>Optimize your storefront with Shogun&#8217;s A\/B testing platform.<a href=\"https:\/\/getshogun.com\/products\/shopify-ab-testing\"> Get started now<\/a><\/p>\n<\/div>\n<h3>The Benefits of A\/B Testing<\/h3>\n<h4><i>Relies on data<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">With A\/B testing, you won\u2019t have to worry about personal opinions or biases. It\u2019s goodbye assumptions and hello concrete data, where you can make informed decisions and get a reliable understanding of how changes to your online store can impact your metrics.<\/span><\/p>\n<h4><i>Lets you test before launching<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">A\/B testing doesn\u2019t force you to commit to a complete launch. It lets businesses go through many iterations of trial and error of much smaller ideas without the fear of driving away your entire audience. With so many opportunities to test, they can check out how customers are reacting to these changes before making them permanent.<\/span><\/p>\n<h4><i>Improves return on ad spend<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">Optimizing your website through A\/B testing makes it more likely that visitors coming in from paid campaigns land on a site designed for maximum conversions. If you take the time to touch on every aspect of the customer lifecycle, your return on ad spend (ROAS) improves.<\/span><\/p>\n<h4><i>Reduce cart abandonment<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">Based on data from the Baymard Institute, the <\/span><a href=\"https:\/\/baymard.com\/lists\/cart-abandonment-rate\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">average cart abandonment rate is 70.19%<\/span><\/a><span style=\"font-weight: 400;\">. While the reasons for abandonment range from high extra costs to mandatory account creation, 18% say it has to do with an overly complex checkout process, and 17% say they couldn\u2019t see the total order cost upfront \u2013 which are two things businesses can quickly change.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">By testing elements of the checkout process or altering button and information placement, you can identify those friction points that lead to cart abandonment and fix them to ensure better conversion rates.<\/span><\/p>\n<h4><i>Reduce acquisition costs<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">Customer acquisition is a strategic and often costly part of running an ecommerce store \u2013\u00a0it includes everything from advertising to social media and search engine marketing. Studies even show that securing a new customer can <\/span><a href=\"https:\/\/www.forbes.com\/sites\/forbesbusinesscouncil\/2022\/12\/12\/customer-retention-versus-customer-acquisition\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">cost 5 to 7 times more<\/span><\/a><span style=\"font-weight: 400;\"> than retaining an existing one. So, when you continually improve the user experience of your store through regular tests, you improve your chances of gaining more conversions from existing customers.<\/span><\/p>\n<h4><i>Increased ecommerce conversion rate<\/i><\/h4>\n<p><span style=\"font-weight: 400;\">All these benefits we\u2019ve discussed boil down to the main benefit of A\/B testing \u2013 increasing conversion rates. Whether you\u2019re a small startup or a large enterprise, the smallest change can make a huge statement. In fact, Amazon simply moved credit card offers from its home page to the shopping cart page, and it boosted profits by <\/span><a href=\"https:\/\/hbr.org\/2017\/09\/the-surprising-power-of-online-experiments\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">tens of millions of dollars<\/span><\/a><span style=\"font-weight: 400;\"> annually.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A\/B testing relies on tangible data, can improve ad performance, and reduces cart abandonment and acquisition costs, all while boosting conversions. With this in mind, it&#8217;s clear why many successful ecommerce businesses have A\/B testing as part of their core strategy.<\/span><\/p>\n<h3>Examples of Successful A\/B Tests<\/h3>\n<p><span style=\"font-weight: 400;\">There\u2019s hardly a better example of a successful A\/B test than Google\u2019s shades of blue experiment. Google executive Marissa Meyer led a project to test the impact of using different colored links in ads. And it wasn\u2019t different colors like pink, green, yellow, and orange \u2013 it was minute changes in shades of blue. While it may sound nonsensical to many, it might not sound that way when you hear that the company earned an extra <\/span><a href=\"https:\/\/www.theguardian.com\/technology\/2014\/feb\/05\/why-google-engineers-designers\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">$200m a year in revenue<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The experiment was prompted when the company noticed that Google ad and Gmail ad links were in different shades of blue. They used A\/B testing to see which shades of blue people liked the most based on how much they clicked on the ads. The result? They learned that a mildly purpler shade of blue led to more clicks than a slightly greener shade of blue. And thus, this little change was able to earn them an immense increase in revenue from ads.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">But, of course, Google isn\u2019t the only mega-company to have achieved some significant results. An employee at Bing, Microsoft\u2019s own search engine, came up with the idea to change the way the site displayed ad headlines. While it didn\u2019t generate the $200 million that Google was able to, annual revenue increased by <\/span><a href=\"https:\/\/hbr.org\/2017\/09\/the-surprising-power-of-online-experiments\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">over $100 million<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">While these are widely successful examples from large organizations, what about specific examples that are more applicable to ecommerce?<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Let\u2019s look at HubSpot, a CRM platform known for their well-rounded approach to business growth. They sought to improve their email engagement rate by experimenting with text alignment. In their A\/B test, they sent both centered email text to users and emails with left-justified text to another group and found that emails with left-aligned text <\/span><a href=\"https:\/\/blog.hubspot.com\/marketing\/a-b-testing-experiments-examples\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">got fewer clicks<\/span><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Similarly, they also decided to see if changing up their hero image would impact user behavior and conversions. In addition to their existing hero image, they had two other variants \u2013 variant B with more vibrant images, colorful text and shapes, and an animated headline, and variant C with color, movement, and animated images. The results showed that variant B <\/span><a href=\"https:\/\/blog.hubspot.com\/marketing\/a-b-testing-experiments-examples\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">outperformed the control by 6%<\/span><\/a><span style=\"font-weight: 400;\"> and was projected to prompt around 375 more monthly signups.<\/span><\/p>\n<div class=\"cta-visual-pb\">\n<p><span class=\"cta-title\">Get started A\/B testing on your ecommerce store<\/span>Optimize your storefront with Shogun&#8217;s A\/B testing platform.<a href=\"https:\/\/getshogun.com\/products\/shopify-ab-testing\"> Get started now<\/a><\/p>\n<\/div>\n<h2>How to Determine a Winner During an A\/B Test<\/h2>\n<p><span style=\"font-weight: 400;\">Running an A\/B test is only the start of the experiment, as the rest relies on an accurate interpretation of the results to declare a winner. The best way to do this is to look at the <\/span><a href=\"https:\/\/hbr.org\/2016\/02\/a-refresher-on-statistical-significance\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">statistical significance<\/span><\/a><span style=\"font-weight: 400;\"> of the analysis, where a result is usually considered significant if there\u2019s less than a 5% probability that the results happened by coincidence.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It\u2019s an accurate, mathematical way to see whether the results of your A\/B test came together by chance or truly reflect a pattern. After all, there are often other factors at play that may have coincidentally led to changes in conversion. These might include:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Seasonal Trends &#8211; <\/b><span style=\"font-weight: 400;\">Depending on the time of the year, customers will display different shopping behaviors. The lead-up to Christmas is a <\/span><a href=\"https:\/\/www.thinkwithgoogle.com\/consumer-insights\/consumer-trends\/last-minute-christmas-shopping\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">particularly busy shopping time<\/span><\/a><span style=\"font-weight: 400;\"> that could show a much starker contrast than quieter times of the year. Or, if you\u2019re a store that sells seasonal goods like modern swimwear, certain seasons will likely amp up sales on your ecommerce store.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Holidays &#8211; <\/b><span style=\"font-weight: 400;\">People shop differently on holidays, so running a test on a significant day like Black Friday might end up providing you with skewed data. Most shoppers enjoy attractive discounts, which makes them more likely to shop on days they can get a good deal. The end of the year might bring about an increase in customers, given that as of October 2023, <\/span><a href=\"https:\/\/www.thinkwithgoogle.com\/consumer-insights\/consumer-trends\/early-holiday-shopping-statistics\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">40% of U.S. consumers<\/span><\/a><span style=\"font-weight: 400;\"> had already started holiday shopping.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Economic Issues &#8211; <\/b><span style=\"font-weight: 400;\">Economic factors such as a recession could also influence final results, where buyers would be more cautious about their spending. They might not have the disposable income previously available, and the results may not represent their usual shopping habits.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Launch of a New Marketing Campaign &#8211; <\/b><span style=\"font-weight: 400;\">If you\u2019ve launched a big marketing campaign during your A\/B test, it might attract a chunk of new visitors who don\u2019t behave the same way as your regular customers.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Whenever you decide to conduct your A\/B test, you should account for the many other variables that can influence your results. Making sure you control external factors as much as possible and interpreting the results as carefully as you can, you\u2019ll increase your chances of accurate findings.<\/span><\/p>\n<h2>How to Run Your Own A\/B Tests with Shogun<\/h2>\n<p><span style=\"font-weight: 400;\">Now that we\u2019ve reviewed the benefits of A\/B testing and provided you with a few <\/span><a href=\"https:\/\/www.youtube.com\/watch?v=Gf4L-VHd7Tk\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">ideas for getting started<\/span><\/a><span style=\"font-weight: 400;\">, let\u2019s go over exactly what you need to do to set up your own experiments.\u00a0<\/span><\/p>\n<p><a href=\"https:\/\/getshogun.com\/products\/shopify-ab-testing\"><span style=\"font-weight: 400;\">Shogun A\/B Testing<\/span><\/a><span style=\"font-weight: 400;\"> makes it easy. You can get a brand new experiment up and running by just following three simple steps:<\/span><\/p>\n<p><b>Step 1. <\/b><span style=\"font-weight: 400;\">After downloading Shogun A\/B Testing from the <\/span><a href=\"https:\/\/apps.shopify.com\/shogun-ab-testing\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Shopify App Store<\/span><\/a><span style=\"font-weight: 400;\">, open the app and click on the \u201cCreate test\u201d button. You\u2019ll find that there are several different types of tests to choose from, including page tests, split URL tests, template tests, theme tests, and price tests.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-23265\" src=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1.webp\" alt=\"Shogun A\/B Testing allows you to create five different types of experiments.\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1.webp 2560w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1-300x169.webp 300w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1-1024x576.webp 1024w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1-768x432.webp 768w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1-1536x864.webp 1536w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_1-1-2048x1152.webp 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><b>Step 2. <\/b><span style=\"font-weight: 400;\">Once you\u2019ve selected which type of test you want to create, you\u2019ll be taken to the test settings page.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-23266\" src=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2.webp\" alt=\"Shogun A\/B Testing allows you to set up your experiments directly through the Shopify admin.\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2.webp 2560w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2-300x169.webp 300w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2-1024x576.webp 1024w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2-768x432.webp 768w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2-1536x864.webp 1536w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_2-2048x1152.webp 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">Your experiments in Shogun A\/B Testing are highly customizable. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">First of all, you\u2019ll need to choose a goal for your test. There are a few pre-set options available, such as conversion rate and average order value, or you could set up a custom event to track.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can also determine how the percentage of traffic is split up between the original version and the new variant, and you have the ability to target your test to a particular segment of your visitors as well.\u00a0<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-23267\" src=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3.webp\" alt=\"There are several configurable settings available for your experiments in Shogun A\/B Testing.\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3.webp 2560w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3-300x169.webp 300w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3-1024x576.webp 1024w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3-768x432.webp 768w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3-1536x864.webp 1536w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_3-2048x1152.webp 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><b>Step 3. <\/b><span style=\"font-weight: 400;\">Whenever you\u2019re done with the settings, go ahead and publish your test. You\u2019ll then be able to review the performance of both the original version and the new variant in real-time. Shogun even keeps track of statistical significance for you, so you\u2019ll know when you\u2019ve collected enough data to confidently declare a winner.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-23268\" src=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4.webp\" alt=\"Shogun A\/B Testing makes it easy to evaluate the results of your experiments.\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4.webp 2560w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4-300x169.webp 300w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4-1024x576.webp 1024w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4-768x432.webp 768w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4-1536x864.webp 1536w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_4-2048x1152.webp 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">That\u2019s it! Depending on the results of your test, you can either revert back to the original version or fully implement the new variant. Shogun allows you to complete either action with just a couple clicks.<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-23269\" src=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5.webp\" alt=\"Choose whether to revert back to the original version or fully implement the new variant.\" width=\"2560\" height=\"1440\" srcset=\"https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5.webp 2560w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5-300x169.webp 300w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5-1024x576.webp 1024w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5-768x432.webp 768w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5-1536x864.webp 1536w, https:\/\/getshogun.com\/learn\/wp-content\/uploads\/2023\/12\/get_started_update_5-2048x1152.webp 2048w\" sizes=\"auto, (max-width: 2560px) 100vw, 2560px\" \/><\/p>\n<p><span style=\"font-weight: 400;\">With <\/span><a href=\"https:\/\/apps.shopify.com\/shogun-ab-testing\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Shogun A\/B Testing<\/span><\/a><span style=\"font-weight: 400;\">, you\u2019ll be able to quickly conduct countless ecommerce experiments and discover all sorts of new ways to improve your online store.<\/span><\/p>\n<div class=\"cta-visual-pb\">\n<p><span class=\"cta-title\">Get started A\/B testing on your ecommerce store<\/span>Optimize your storefront with Shogun&#8217;s A\/B testing platform.<a href=\"https:\/\/getshogun.com\/products\/shopify-ab-testing\"> Get started now<\/a><\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>This guide covers everything ecommerce merchants need to know about A\/B testing, including step-by-step instructions for conducting your own tests.<\/p>\n","protected":false},"author":40,"featured_media":16790,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[],"class_list":["post-16789","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-learn"],"_links":{"self":[{"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/posts\/16789","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/users\/40"}],"replies":[{"embeddable":true,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/comments?post=16789"}],"version-history":[{"count":11,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/posts\/16789\/revisions"}],"predecessor-version":[{"id":23263,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/posts\/16789\/revisions\/23263"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/media\/16790"}],"wp:attachment":[{"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/media?parent=16789"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/categories?post=16789"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/getshogun.com\/learn\/wp-json\/wp\/v2\/tags?post=16789"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}