How to Set Up an A/B Test – Mention Me | Help Centre

Running A/B tests is one of the most effective ways to optimise your referral campaigns. With the updated test creation flow, you can launch smart experiments in minutes using proven templates or create custom tests tailored to your goals.

This guide walks you through how to set up, launch, and analyse a test to drive continuous performance improvements.

Step-by-Step Guide

Step 1: Navigate to the Right Campaign

Open Mention Me and navigate to the campaign where you’d like to run an A/B test.
Click the Run an A/B Test button at the top of the campaign dashboard.

Run an A/B Test button at the top of the campaign dashboard — Run an A/B Test button on campaign dashboard

Step 2: Choose a Test Template or Create a Custom One

You're now in the A/B test setup flow.
Select one of the 12 pre-built test templates based on high-performance examples from other brands.
Templates are labelled:
- High Impact: Proven to deliver strong uplift
- Low Effort: Quick and easy to implement
Filter templates using the toggles for Impact, Effort, or test type at the top of the gallery.

Template gallery for choosing A/B tests, with impact and effort filters — Test template gallery with filters

For flexibility, choose Custom Test to configure your own experience.

Select screen for custom or predefined A/B test templates — Selecting a custom or predefined template

Step 3: Configure the Variant Experience

The variant may be pre-filled based on best-performing defaults (e.g. select specific share methods).
Use the Select share methods button to customise the variant experience further.

Customising share methods for the test variant in the campaign dashboard — Configure share methods in test variant

Step 4: Check the Test Parameters

Configure how your A/B test will run. Smart defaults are applied to save time:

Confidence Level: Automatically selected based on your campaign traffic (e.g. 90%)
Success Metric: Defaults to variation conversion rate
Estimated Duration: Example shows 4 weeks, depending on traffic and goals

Confidence level and success metric settings for A/B test — Confidence settings and metrics section

Want more control? Click Adjust Speed and Metrics to:

Change Confidence Level (speed vs reliability)
Select a custom testing metric

Manual adjustment for A/B test parameters in setup process — Adjust A/B testing parameters manually

Step 5: Check Test Outcomes

The next screen lets you control what happens when the test ends. By default:

The test will auto-conclude after:
- 8 weeks
- Finding a statistically significant winner
- No meaningful difference over the campaign duration
All traffic will be directed to the best-performing variant

After the test ends, you can manually switch the variant that receives 100% of traffic.

Logic settings to complete and direct variant traffic after A/B test — Test completion logic and controls

Step 6: Launch Your Test

Click Run Test when you're ready.
Preview the final experience to see what each variation looks like post-purchase.
After launch:
- The campaign page will show your live test
- Click View A/B Test Details to monitor real-time performance

Live tracking and management of A/B test in campaign dashboard — Live A/B test tracking in dashboard

Step 7: When the Test Concludes

You’ll receive an outcome email (e.g. winner found, inconclusive)
Final traffic will be routed to your selected variant
Use the Campaign Dashboard to:
- View Detailed Results
- Use a Different Variant (manually redirect traffic)

Viewing A/B test outcome and adjusting traffic to variants — Final A/B test results with options to adjust

What Happens Next? Keep Testing

To achieve long-term gains, continue testing. As soon as one experiment concludes, we recommend launching another.

A/B Test Setup – Video Guide

Video guide: How to set up an A/B Test in Mention Me

Related to