A/B Testing

Question 1

How does Open and Reply rates test an email’s effectiveness

Answer 1

1. Open rate tests the subject line by modifying it
2. Reply rate tests the email content by modifying it

Together, they test the effectiveness of an email

Question 2

Which variables are available for A/B testing?

Answer 2

Open rate, click rate, or reply rate

Question 3

When a result is achieved, will OR automatically disable the low-performing template?

Answer 3

No, the test owner has to review and deactivate the low-performing templates - gives more flexibility

Question 4

How does OR handle testing more than 2 templates?

Answer 4

For more than 2 templates, you will have to test in pair e.g. A & B, then Winner and C

Question 5

How do you create A/B Tests?

Answer 5

Once more than 1 template is added to a SEQ step, OR will automatically activate the A/B test and direct prospects to each

Question 6

What is the recommended min. number of prospects to put through the A/B test?

Answer 6

Min. 100-150 prospects per template for a total of 200-300 data points