Building an A/B test

Crazy Egg makes it fast and easy to ship experiments that help you make a better site. To set-up a test, decide where the experiment runs, use the Visual Editor in Crazy Egg to design your variants, and set-up a goal. Once you're ready, you can publish your experiment! Let's go through each step together.

Create a hypothesis

Before you can start testing, you need to start with a hypothesis. For example, a hypothesis can be, “If I change the copy of the “Sign-up now” button, the number of sign-ups will increase by X.”

To help you brainstorm ideas, check out the Examples of Tests article.

Start an A/B Test

1. Go to Tests.

2. Click on Add a new test or the plus (+) at the top of the dashboard.

3. Choose the page you want to test.

Create Variant

Next, use the Crazy Egg Visual Editor to create variants.

1. Click Add Variant to create one or more variants of your page that you'd like to test. Within the sidebar menu, the Control is always your original page. You CANNOT change the Control. Variant #1 on the hand is the adjusted version. 

2. Once the editor has loaded your page, select an element that you want to edit. For example, let's select the BUY IT NOW - $15 button and change the copy.

3. Click on Edit Text & Style. Use the inline editor to change the text.

4. Click on the close button (X) once you are done. Here, we've changed the copy from Buy Now - $15 to Buy it Now.

5. Repeat steps #1-4 to create more variants
6. Click Next once you have finished creating your variants.

Deleting a Variant

If you need to delete a variant, hover over the variant, click on the red X button.

Configure goal

Define the goal to measure the impact of your variants. There are four types of goals:

  1. Sell more products
  2. Get more registrations
  3. Generate more leads
  4. Get more pageviews

Once you've chosen a goal, you'll need to define how this goal is achieved. There are four ways a goal is reached:

  1. When someone clicks a button/link. For example, Crazy Egg will record that you sold a product when a customer clicks on the Buy Now! button.
  2. When someone reaches a page. For example, Crazy Egg will record that you sold a product when a customer reaches the Order confirmed! page.
  3. When someone submits a form. For example, Crazy Egg will record that you received a registration when a customer clicks on the Register button within a form.
  4. When someone triggers a script. This method is for more advanced, technical users.

In this test, we want to see if changing the text of the button from Buy Now - $15 to Buy it Now will get more people buy the product. So we've set-up the goal as Sell more products.

To determine this, I consider a product sold when someone has clicked on the Buy Now - $15 button. A red star highlights the button I have chosen to track.

Click Next when you are happy with the goal you've chosen.

Name your test

Once you have defined your goal, create a custom name for your test.

Set your test live!

Once you're done, click on Start testing my ideas!

Note: You will NOT be able to edit your variants once the test has started. Review everything before starting the test.

Congratulations! You’ve launched your experiment and now you’re ready to check out the Results page. It will take about 24 hours for your site to see your variants live.

Editing your test

When an A/B test is running, you can edit your goals, retire variants, or add new variants. When a test is live, you CANNOT edit your variants.

1. Select Tests on the Crazy Egg Dashboard. 

2. Click on the Settings gear icon of the test you want to edit. You can click on Add new variant, Change goal, or Delete this test.

Support article

Was this article helpful?

Thank you! Your feedback is important to us.

Your feedback is greatly appreciated!

Support helper

Need more help?

Contact Support

Your message has been sent! Send another message.

We're standing by to give you a hand.