Can we stop this test early?
You're A/B testing to improve conversion rate, and have a huge backlog of ideas... just one problem: this test has been running forever! What should you do?
Based on Experience
Vetted industry professionals, that have experience working with these companies and others, consulted in an advisory capacity to ensure the content of this course was realistic.
This is a work of fiction. Unless otherwise indicated, all the names, characters, businesses, places, events and incidents in this course are either the product of the author's imagination or used in a fictitious manner. Any resemblance to actual persons, living or dead, or actual events is purely coincidental.
How do you answer the question "Can we stop this test early?" – learn how A/B Testing can help you find the answer!
Improving website conversion rate makes all of your marketing more profitable, so it's important you approach it in a scientific way with A/B testing. Read More
1 hour, 8 minutes
|1. We need to use it or lose it||You've been tasked with improving conversion rate on the category pages, and your boss is eager to roll out the new ideas you have in the pipeline.||8|
|2. Is this a/b test significant?||You need to make a decision on whether to conclude the test and roll out new ideas. So you pull the data and calculate statistical significance.||8|
|3. Stop, drop or roll?||Maybe there's a solution: Bayesian methods could tell us how confident we can be that we're not missing a potential winner.||14|
|4. I am not uncertain||It's unreasonable to expect our boss to understand our calculations: how do we translate our findings into terms they can understand?||13|
Frequently Asked Questions
Learn about A/B Testing today.
Discover how to solve this problem: Can we stop this test early?