E10 - Testing Campaigns and Assets Flashcards
What % of all strategic marketers use A/B testing to learn about customer behavior?
75%
what is the typical email survey response rate?
15%
What % of organizations believe email marketing ROI will increase?
64%
What is the first reason to test?
To identify customer behaviors.
What’s a good analogy for testing?
Photography - keep taking photos to get the best image possible.
What’s the second reason for testing?
Reveal actual vs. stated customer actions
True or false: Customer behaviors may differ from their stated preferences and opinions
True
What are 3 reasons surveys can be interpreted incorrectly?
1 - don’t reach enough of the intended targets; 2 - include questions that can be influential towards a desired outcome; 3 - include answers influenced by group behavior
What is the third reason to test?
Increase ROI and conversions
Testing emails this week will yield the best choice for what timeframe?
This week
What time based factors can affect test results?
Current events and approaching holidays.
What can be tested?
Any element in a campaign canvas.
Give 9 examples of things that can be tested
(1) CTA (2) Subject line (3) Copy (4) Conversion path (5) Button design (6) Form location (7) Offer (8) total redesign (9) images / icons
Name the 3 steps to test
(1) develop a plan (2) execute (3) measure
3 steps to develop a plan
(1) Baseline (2) Hypothesis (3) Methodology
3 steps to execute
(1) Assets (2) Campaign (3) Edits
3 steps to measure
(1) Analyze (2) Optimize (3) Repeat
What is the lesson from the test where a complex page resulted in a 38% increase in trial sign-ups?
Pretty does not always equal winner.
Where can you find use cases of A/B comparisons?
WhichTestWon.com
//delete after class//
User912 EPITECA Eloqua1 // next slide, 22
With every test you gain insights into customer’s behavior _____
for that period in time.
1 reason that comes back as a hurdle to slow testing is what?
Timing
Some test winners might result in more opens but less ___ or ___
clickthroughs or revenue.
If you’re wondering what you should be testing, go on Topliners and search for…
Email features to test
In the form test, which test won?
The version with more checkboxes instead of more text-based fields.
In a test with and without testimonials, what was the result?
The one with testimonials led to a 34% increase in sales.
What kind of campaign do you create to do an A/B email test?
Simple email campaign
What option do you choose for Type of campaign to do an A/B email test?
A/B Test
Where do you configure the parameters o the A/B test?
In step 4 of the simple campaign wizard.
What’s the default % to test on?
50%.
Best practice is to test on at least __% of your list
10%.
What parameters can you configure in an email A/B test?
Percentage to test, winning metric, testing time, whether to automatically send the winning version after test.
What winning metrics can you choose for an email A/B test?
Total opens, unique opens, total clicks, unique clicks, total conversions
Best practice testing time is…
at least 24-48 hours.