Skip to main content

How to Run A/B Tests in Campaigns

While the platform does not currently support native A/B testing within a single campaign, you can still run effective A/B tests by using segmented lists. This workaround allows you to compare different message versions and see which performs better.

Written by Kevin

What is Segmented List?

Instead of testing multiple message variants in one campaign, you split your audience into separate lists and run multiple campaigns—each using a different message version.

By comparing results across campaigns, you can determine which message performs best.


Step-by-Step: How to Run A/B Tests Using Segmented Lists

1. Prepare Your Lead Lists

Start with a single audience, then split it into two or more similar-sized lists. Make sure the lists are as equal as possible to keep the test fair.

Example:

  • List A: 500 leads

  • List B: 500 leads


2. Create Separate Campaigns

Create a new campaign for each list:

  • Campaign A → uses List A

  • Campaign B → uses List B

Each campaign should be identical except for the message you want to test.


3. Change Only One Variable

To get clear results, test only one element at a time, such as:

  • Opening line

  • Call-to-action (CTA)

  • Message tone

  • Personalization style

Avoid changing multiple elements at once, as this makes results harder to interpret.


4. Launch Campaigns at the Same Time

Run the campaigns simultaneously to minimize timing or audience behavior differences that could affect results.


5. Compare Campaign Results

After the campaigns have run, compare key metrics such as:

  • Reply rate

  • Engagement rate

  • Conversion or booked responses

The campaign with stronger performance indicates the winning message variation.


Best Practices for A/B Testing

  • Use evenly split and similar audiences

  • Keep all settings the same across campaigns

  • Run tests long enough to collect meaningful data

  • Apply the winning message to future campaigns


Why Use This Method?

Using segmented lists allows you to:

  • Test messaging strategies before scaling

  • Improve reply and engagement rates

  • Make data-driven decisions without native A/B testing

If you need help creating segmented lists or analyzing results, feel free to reach out to our support team.

Did this answer your question?