L11 - Testing and Experimenting Flashcards

1
Q

Media Planners:

A

Essentially, a media planner needs answers to questions such as these:

  • In which geographic markets should we place extra money to achieve our marketing objective?
  • Will extra media weight generate enough additional sales to justify the cost?
  • Which advertising timing schedule is best for this brand?
  • How much money is optimum to achieve the brands goals?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why Test or Experiment?

A

Testing or experimenting is necessary for a number of reasons:

  • To help the planner make decisions
  • To avoid making costly errors
  • To modify the data with their own judgement
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How they differ:

A
  • A test is a simple piece of research in which one measures a variable (or treatment) introduced into the market to see what effect it has
  • An experiment resemble a test in that simular markets are selected for treatments, but great care is taken to make sure that the markets are equivalent
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Test or Experiment, Which is better?

A
  • Experiments provide a higher degree of objectivity
  • Experiments are better controlled
  • A test is less expensive than an experiment
  • Test usually take less time to conduct than experiments

Advertisers use tests almost exclusively to obtain guidance and support for their market decisions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Measure Examples:

A
  • Weekly gross rating points by daypart commercial length
  • Product distribution
  • Number of grocery store facings
  • Price of their own and competitors products
  • Weekly GRPS of the primary competitors
  • Dates and values of consumer promotions
  • Weather where relevant
  • Seasonal influences
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Test Marketing:

A

Is the use of controlled tests or experiments in one or more geographic areas to gather certain kinds of information or to gain experience in marketing a brand

Test marketing is most common for new brands in existing product categories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Purpose of Test Marketing:

A
  • To examine the viability and potential profitability of new products
  • To test alternative media, creative and marketing strategies for existing brands
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Nielsen Company’s BASES:

A

The company uses three measures:

  • Product distribution as a percent of all commodity volume
  • The estimated awareness of the new brand, based on the proposed media plan
  • A survey of consumers intent to buy after seeing a description of the product’s concept
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Research Designs Used in Test Marketing:

A

Research design refers to a plan of actions to be taken in the testing

Plan is carefully worked out to obtain certain kinds of information

Research designs can be very simple

  • Observing a market
  • Introducing an experimental variable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Control Markets:

A

Validity means that the test measures what it is supposed to measure

  • E.g. if advertising is introduced into a test market as an experimental treatment, the planner will want to know the extent to which advertising had any effect on the outcome

Control market is one that does not receive any special treatment

  • Must be selected carefully so that is shares all the demographic and economic characteristics of the test market
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Randomized Block Designs:

A

Is one in which subjects to be measured are first grouped together into blocks

  • Each subject is carefully chosen so that he or she will be much like every other subject in that block
  • The selection process is done at random
  • Randomized blocks are designed to prevent situations in which the outcome results from differences with the sample, rather than differences in the treatment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Latin Square Design:

A

A block divided into a number of cells containing coded letters and arranged so that a letter appears only one in each row

More precise than the randomized block

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Media Testing Example:

A

Complete media plan: a national media plan might be developed for a new product that has not been marketed before. The typical objective of the marketing part of a test for such a product is to learn a brand’s sales or the market share that could be developed on a national scale.

  • Alternative spending levels
  • Alternative schedules
  • Alternative media mixes
  • Alternative commercial length or ad sizes
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Testing a Campaign

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Impressions:

A

‘Impressions’ are the total number of viewing occasions (announcements) that a campaign delivers - duplicate numbers)

The number of impressions depends on GRP and population size

Impressions = GRP/100 x number of people in the population group

For example, a campaign with 200 GRP (ie 200%) delivered to a 1m population (F:18-34) gives 2 million impressions per week

Impressions = 200/100 x 1m = 2m impressions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Impressions can be used to:

A
  • Compare two or more different TV schedules (which one delivers most impressions relative to cost of the schedule?)
  • Compare the advertising weight allocated to different geographical regions within the target market
  • Compare how many impressions are delivered to light versus heavy users (or high versus low income earners)
17
Q

Effectiveness and Media ROI:

A

Challenge remains to measure effectiveness and return on investment (ROI).

Most common approach is to measure the campaign’s effect on a brand in terms of:

  • Perception
  • Cognition
  • Emotion
  • Persuasion
  • Association
  • Behaviour
18
Q

Developmental Research and Pretesting:

A

Concept Testing

  • The ‘big idea’ is a creative concept that is attention-grabbing and memorable
  • Compares the effectiveness of various creative ideas

Pretesting

  • Evaluative research to test finished or nearly finished ads

Diagnostics

  • Diagnoses strengths and weakness of ads
19
Q

Concurrent Testing:

A

During Execution

  • Coincidental Surveys
  • Tracking Studies
    • Attitude tests
    • Consumer diaries
    • Pantry checks
    • Test marketing
20
Q

Post-Testing:

A

After-Execution Research

Memory Tests

  • Recognition tests (aided recall)
  • Recall tests (unaided recall)

Persuasion Tests

  • Attitude-change test

+ Likeability Tests

Direct-Response Counts

  • Inquiry tests – measuring numbers of responses

In-Market Tests

  • Scanner research to collect consumer information

Single-Source Research

  • Controls TV signals, sends ads to one group but not to the other, and monitors consumption patterns
21
Q

Types of Research:

A

Secondary Research

  • Background research that uses available published information about a topic

Primary Research

  • Information that is collected for the first time from original sources exactly on the topic

Quantitative and Qualitative Research

  • Quantitative research delivers numerical data
  • Qualitative research provides insight into underlying reasons for customer behaviour
22
Q

Choosing a Research Method - 1

A

Can use both qualitative and quantitative methods:

  • Quantitative – good for gathering data
  • Qualitative – good for uncovering reasons and motives

Ways of Contact

  • In person
  • Telephone
  • Mail
  • The Internet
  • Cable TV
  • Shopping centres or stores
23
Q

Choosing a Research Method - 2

A

Survey Research

  • Quantitative method that uses structured interviews to ask large numbers of people the same set of questions

In-Depth Interviews

  • Qualitative method conducted one-on-one using open-ended questions that require respondents to generate their own answers

Focus Groups

  • A group of users or potential users who gather together to discuss a topic
  • Useful in testing ideas or exploring various alternatives in message strategy development

Observation Research

  • Takes researchers into natural settings where they note the behaviour of consumers

Ethnographic Research

  • Involves the researcher in living the lives of the people being studied
  • Has the advantage of revealing what people actually do, not what they say they do

Diaries

  • Consumers record their activities
  • They tell media planners what programs and ads the consumers watched
24
Q

Choosing a Research Method - Other Qualitative Methods:

A
  • Fill-in-the-blanks
  • Purpose-driven games
  • Story elicitation
  • Artefact creation
  • Photo elicitation
  • Photo sorts
  • Metaphors
  • Projective technique