A/B Testing is currently only available to early access customers. More information about early access can be found here.
Once you've published your test, you can go to the Results page to check the goal and performance of your ideas.
Open the Results page, and you'll see:
- Which variants are running
- How the variants in your experiment are performing
- Whether a particular variant is beating out the rest
- When the variant started
- When the variant ended
You can also take actions on experiments, including:
- Retire variant(s)
- Add a new variant
- Duplicate a variant
- Delete the test
- Change the goal
Crazy Egg deploys multi-armed bandit algorithms, harnessing the power of machine-learning to optimize your site. This means that you can test as many variants as you want to. Your test will automatically adapt to show the best variant with the best conversion rate.
Similar to traditional A/B testing, you can monitor the number of views and conversions that each variant gets. But, the main difference with multi-armed bandit testing is that if one variant gets a higher conversion rate than the other variants, it gets more traffic.
The idea is that the variant with the highest conversion rate is the winning version and it's automatically shown most of the time. As the test runs, the system will reconsider other variants. You do not have to check on your results, but you can if you need to.
As your test runs, add new variants to try out new ideas. Or, leave the test running along. Our machine learning algorithms will adaptively pick the optimal version to show your visitors.