How to Plan Your A/B Test

A question we hear all the time:

When Should I Start Testing?

The answer: Once you've starting receiving data that lets you come up with ideas of what to improve. 

Whether you have 5 visitors per month to your site or 5,000, if any of those visitors are not converting, you should be finding out why and testing ideas. A missed conversion is a missed opportunity. Testing out ideas to improve your visitor experience is a surefire way of building lasting relationships and more opportunities.

Once you've looked at your Snapshot Reports and watched your visitor Recordings so you have ideas for what to test, it's time to get planning.

Planning Your AB Test

Planning your AB Test doesn't have to be a challenge. Here at Crazy Egg we developed an AB Test that makes it fast and easy to test ideas that will help you improve your user experience. We do this by using the Multi-Armed Bandit approach to A/B testing so that you can maximize your ROI. The value of our approach is that you can continue experimenting with different variants by changing copy, images, and calls-to-action, and always be assured that your website traffic will be directed to the highest converting version of your web page. 

While Crazy Egg automates the A/B testing process, it's key to plan out what you want to test before you launch a variant. Figure out your goals like increasing signups for a particular event, boosting trials of your software, sending increased traffic to specific pages, and/or selling more of your product. While our A/B testing tool allows you to iterate quickly, you can be even more targeted with your time by creating a hypothesis on how changing different elements will impact your conversion rate. 

Where Should I Start?

Start with what you know. Look at your Snapshot reports for the page you want to improve your visitors experience on.  Ask yourself where are people hesitating, why are they moving past my CTA, how can I engage them more?

Sample Scenario

Let's say you're offering a limited-time deal and you want to maximize your conversions for a time period. In this instance, you could experiment with the copy on a large call-to-action button on your page. 

Control copy:

Join our mailing list and receive 25% off your first purchase.

Variant 1:

Join our mailing list to receive 25% off, plus other perks delivered straight to your inbox.

The new copy holds the potential to create a sense of urgency and may be a key factor in causing a spike in signups.  You can test this idea and goal, by creating a variant and pitting it against your original copy.  This is the type of planning you need to do.

A/B Test Ideas for Inspiration

Not sure where to begin? We've put together some lists to help you brainstorm experiments that you can test on your site so that you can deliver a better user experience.

Try testing your:

  • Homepage
  • Landing pages like event registration or blog layouts
  • Pricing page
  • Demo page 
  • Product page(s) 

Test elements like your: 

  • Calls-to-action: Wording, font-size, colors
  • Headlines: Copy, length, font-color
  • Product descriptions: Copy, style, number of words
  • Form fields: Add fields, hide fields, choices available
  • Navigation links: Order, number, variety
  • Buttons: Color, size
  • Images: Hide images, rearrange images, insert new images 
  • Page length: Increase or decrease the length of your page

Still wondering how to get started?

Contact our support team anytime. They would love to speak with you about your goals and help you get started.

Jump to:

- Crazy Egg A/B Tests: Guide to Multi-Armed Bandit Testing

Did this answer your question? Thanks for the feedback There was a problem submitting your feedback. Please try again later.

Still need help? Contact Us Contact Us