Skip to main content
An A/B test splits the visitors of one bundle between its current offer (variant A) and a new one (variant B), then shows you which converts better. When you end the test, the offer you choose becomes the bundle’s offer.

​
Start a test

1

Open the setup

In the bundle editor, click Set up A/B test above the preview. You can also go to A/B tests in the navigation and click New A/B test.
2

Set variant B

Variant A is your bundle as it is today. For variant B, change the discount type or value. Bundles with tiers let you change every tier. If a tier’s title or subtitle mentions the discount, update the text too.
3

Choose the traffic split

The slider sets the share of visitors who see variant B. It starts at 50%.
4

Start

Click Start test. Save as draft keeps the test without showing it to anyone.
A bundle must be published to start a test, and it can run one test at a time.

​
What visitors see

  • Each visitor is assigned a variant on their first visit and sees the same one on every later visit from that browser.
  • The discount a visitor was shown is the discount they get in the cart and at checkout.
  • Visitors whose browser blocks both local storage and cookies see variant A and are left out of the results.

​
Read the results

Open a test from A/B tests to compare the variants. The banner above the table tells you where the test stands:
  • Collecting data: a variant has fewer than 100 visitors, or the test has no order yet.
  • No clear winner yet: the difference could still be chance.
  • Variant is winning: the confidence is 95% or more.
Let a test run for at least one full week, so that weekdays and weekends are both covered.

​
End a test

Click End test and choose the offer to keep. Choosing variant B replaces the bundle’s discount with variant B’s. Choosing variant A leaves the bundle unchanged. From then on, all visitors see the offer you kept. Finished tests stay in the A/B tests list with their results.

​
Limits

  • A test changes the discount and the tier text. It can’t change the bundle’s products, tier quantities or design.
  • Translated tier text applies to variant A only. Variant B shows the text you entered in the test.
  • Avoid editing the bundle’s offers while its test runs: variant B keeps the tiers it was created with.