Module #3 - Research Design Flashcards

1
Q

Define “Research Design”

A

A FRAMEWORK for conducting the research project, including the details of the information sought, how it will be sought, and how it will be analyzed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the basic difference between primary and secondary research?

A

Primary research is conducted specifically for the project at hand.

Secondary research is existing data that is re-purposed to answer your current questions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Name 3 common types of Primary Research

A

1) Survey/Individual Interviews,
2) Focus Groups
3) Observation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How can locating and reviewing any existing secondary research help you before beginning your project?

A

It can help you define your issue more clearly,

develop your approach,

identify key and relevant variables,

test hypotheses and

interpret your primary data more insightfully.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the four key considerations when evaluating the usefulness of secondary data?

A

Timeliness - is it recent enough to still be valid?

Relevance - how closely does it address the business questions you’re looking at?

Completeness - Does it cover everything you were looking to investigate? Is something missing?

Quality - You may not know the details of how the research was conducted, thus you can’t know if the data is valid.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Name the 3 broad categories of primary research design.

A

1) Exploratory
2) Descriptive
3) Causal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe “Exploratory Research”

A

PRELIMINARY research used to GAIN INSIGHT into the market or business issue, especially when tackling a NEW TOPIC - one where there has not been a lot of other research. However, even for well-researched topics such as laundry detergents, exploratory research can yield new insights or hypotheses. Very often exploratory research is the first phase of a multi-phase research project

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Describe “Descriptive Research”

A

Research that DESCRIBES the CURRENT state of the market - DEMOGRAPHIC characteristics of current users, BRAND ATTITUDES and perceptions, CUSTOMER SATISFACTION.
It is the most common research type and answers basic questions such as who are our users, when do they use our product, why are they using it or not using it, and where do they buy or use our product.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Describe “Causal Research”

A

Research that seeks to find out about CAUSE AND EFFECT RELATIONSHIP BETWEEN VARIABLES. Researchers use causal research when they want to assess the EFFECT OF A CHANGE IN ONE OR MORE OF THE MARKETING VARIABLES.
For example, what will happen to sales if we change the price of the product? Will consumers be more attracted to our product if we change the packaging design? In causal research, we test the effect of one variable such as price on another variable such as sales

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which of the 3 types of research design are considered “conclusive”?

A

Descriptive and Causal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which of the 3 types of research design are NOT considered “conclusive”?

A

Exploratory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

“Descriptive” research answers which questions?

A

Who, What, Where, When and How

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

“Causal” research answers which question?

A

Why

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Describe and draw the breakdown of Descriptive Research types.

A

Split into Cross section and Longitudinal.

Then split Cross Section into Single Cross section and Multiple cross section

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Name 3 types of Exploratory Primary research

A

1) Expert Interviews
2) Focus groups
3) Pilot surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What type of research design is used when you want to explain, monitor or test hypotheses?

A

Descriptive research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the difference between cross-sectional and longitudinal designs?

A

Cross-sectional deals with a single point in time, and longitudinal deals with 2 or more points in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is a single cross-sectional design?

A

A single sample at a single point in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a multiple cross-sectional design?

A

Two or more surveys conducted at 2 or more points in time (e.g., many tracking studies or pre- and post-tests).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is a longitudinal design?

A

Same sample tested at multiple points in time, often using a panel.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is the main advantage to using a longitudinal or panel design?

A

To be able to assess changes at the individual level. Multiple cross-sectional allows for assessing changes at the group level only.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Name 3 advantages of a cross-sectional design over a longitudinal design.

A

1) more representative (panelists are, by definition, not)
2) less response bias from prior surveys
3) speed and flexibility in data collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Name 3 advantages of a longitudinal design over a cross-sectional design.

A

1) can detect change at respondent level
2) greater accuracy in reporting actual usage and behavioral data (panelists asked to record usage in real time)
3) Ability to collect more data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the key disadvantage of multiple cross sectional vs. longitudinal.?

A

Cannot detect changes at the respondent level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Name 3 disadvantages of a longitudinal design.

A

1) not representative because people who agree to be in a panel are different from those who don’t, and respondents drop out from wave to wave.
2) Panelists are paid, thus are “professional” respondents.
3) The act of taking the survey may change the responses of some respondents in later surveys; response bias.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

In causal research, which type of variable do marketing management elements (e.g., price, packaging, positioning) tend to be? Dependent or independent?

A

Independent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

In causal research, which type of variable do business outcomes (e.g., sales volume, market share) tend to be? Dependent or independent?

A

Dependent

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Why are experimental designs good for causal research?

A

They are an efficient way to infer cause and effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

How can you conduct causal research if an experimental design is not possible or advisable?

A

You can use a non-experimental design and infer cause and effect through statistical methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What are the two classes of experimental design?

A

Field and laboratory

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is another term for a “Field experiment”?

A

In-market test or test market

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What does a lab experiment attempt to do?

A

Simulate the real world, but in a controlled environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What is another term for lab experiment?

A

Simulated Test Market

34
Q

What are the 5 main drawbacks to field experiments?

A

1) Costly
2) time intensive - takes time to set up and to wait for actual sales to occur
3) Logistics (cooperation) - often difficult to obtain cooperation from the necessary parties, e.g., retailers, franchisees, etc.
4) Difficulty - lack of control over real world elements
5) Competitive concerns - exposing plan to public alerts competition, which can launch a response

35
Q

What are the 5 key advantages of laboratory experiments?

A

1) quicker
2) cheaper
3) can control all/most aspects
4) don’t need cooperation from other parties, i.e, franchisees, distributors,
5) don’t risk revealing your plans to competition

36
Q

What is the main criticism of laboratory research?

A

Environment is artificial and lacks realism, which can affect the external validity of the experiment

37
Q

What is external validity?

A

The degree to which the results of the experiment can be generalized to the real world.

38
Q

What is it called when respondents are sensitized to looking more closely to the experimental detail?

A

Demand artifact

39
Q

Besides a potential lack of realism, what is another drawback of laboratory experiments?

A

Demand artifact, which is when respondents are conditioned by the circumstances of the experiment to look more closely at some details than they normally would.

40
Q

What are extraneous variables?

A

They are all variables other than the independent variables that may affect the response of the test units.

41
Q

Why is it important to build in controls to minimize extraneous variables?

A

Because uncontrolled extraneous variables might call into question the validity of the experiment.

42
Q

What are 3 common ways of controlling for extraneous variables?

A

1) Matching
2) Randomization
3) Statistical control

43
Q

What is “matching” and how does it help control extraneous variables?

A

Matching is when you pair up your test units with a control unit that is similar across a key set of background variables. It helps to understand which changes in the test units are due to the treatment and which are extraneous

44
Q

What is the major drawback to “matching”?

A

Impossible to perfectly match two groups, and there will still be extraneous variables that affect the test group differently from the control group

45
Q

What is randomization?

A

It is the random assignment of respondents to the test and control groups.

46
Q

How does randomization help control for extraneous variables?

A

With randomization, extraneous variables are represented equally within each group.

47
Q

What is the preferred method for controlling for extraneous variables in experiments?

A

Randomization

48
Q

When is randomization less effective?

A

When sample sizes are small

49
Q

Why is randomization less effective when sample sizes are small?

A

Because randomization only produces groups that are equal ON AVERAGE, rather than truly equal.

50
Q

How can you check whether randomization has been effective?

A

By measuring the extraneous variables and comparing them across groups.

51
Q

With respect to extraneous variables, what is “Statistical Control”?

A

It is measuring extraneous variables and adjusting for their effects with statistical analysis.

52
Q

What is “random sampling error”?

A

The error due to the particular sample selected being an imperfect representation of the population of interest.

It can be thought of as the variation between the true mean value of the sample and the true mean value of the population.

53
Q

What is “non-sampling error”?

A

Errors that can be attributed to sources other than sampling. It can be random or non-random.

54
Q

Which kind of error will a good research design strive to minimize?

A

Non-sampling error

55
Q

What are the two main categories of non-sampling error?

A

Non-response error and response error

56
Q

What is “non-response error”?

A

It is the error that arises from the fact that there is a certain level of non-response in any survey methodology. If non-responders differ from responders in important ways then you have “non-response” error.

57
Q

What is “response error”?

A

A type of non-sampling error arising from respondents giving inaccurate answers or having their answers misrecorded or misanalyzed.

58
Q

What are the three main types of “response error”?

A

1) Measurement error
2) Recording and Analysis error
3) Respondent error

59
Q

What is “measurement error”?

A

It is the error caused by the survey instrument, either in the way it is administered or the measurement itself.

60
Q

Poorly worded questions are an example of what kind of error?

A

Measurement error

61
Q

Name two types of measurement error

A

1) Poorly worded questions that cause respondents to misinterpret its meaning
2) Interviewers misreading a question

62
Q

How can a researcher minimize measurement error?

A

1) developing clear, well structured surveys
2) having rigorous interviewing standards
3) clear instructions for respondents in the case of self-administered surveys

63
Q

What can a researcher do to catch and correct possible measurement error before launching a study?

A

Conduct pre-tests

64
Q

How does conducting a pre-test help a researcher?

A

It helps catch and correct possible measurement error.

65
Q

What is “recording and analysis error”?

A

It is the error that arises from interviewers making mistakes in recording responses, or from data processing or data analysis errors.

66
Q

What is “respondent error”?

A

It arises when respondents provide misleading information, either deliberately or inadvertently.

67
Q

What are two common reasons that respondents may deliberately provide misleading information?

A

1) Not wanting to admit to some behaviors

2) Overstating the degree to which they engage in socially desirable behaviors

68
Q

Why might a respondent inadvertently provide misleading information?

A

Because the question is not clearly worded..

69
Q

Qual v Quant: How do they differ in terms of sample size?

A

Qual uses small samples; Quant uses large samples

70
Q

What are some reasons for doing qualitative studies?

A

1) develop hypotheses
2) Gain in-depth understanding of and reactions from consumers
3) generate new ideas

71
Q

What are reasons for doing quantitative studies?

A

1) provide sizing for targets, product demands, and confirm hypotheses
2) Measure differences between sub-groups
3) Determine the impact of alternative pricing, packaging, posititioning, etc
4) Assess ad recall, measure ad effectiveness

72
Q

What kind of measurement tool is used for qualitative vs. quantitative studies?

A

Qualitative uses semi-structured discussion guides, and quantitative uses structured questionnaires.

73
Q

Is qualitative research cheaper and faster than quantitative?

A

Not necessarily

74
Q

What is an “RFP”?

A

Request for Proposal, which will include recommendations for research design

75
Q

What is an “RFQ”?

A

Request for Quotation, which will include costs and timing on a study that is already designed.

76
Q

What is an “RFI”?

A

Request for Information, which will include information on the supplier’s capabilities, and strengths

77
Q

What is an MSA?

A

Master Services Agreement

78
Q

What are the 7 major pieces of a research proposal?

A

1) Background
2) Problem Definition/ Overall Purpose
3) Research Objectives
4) Research Design
5) Plan for Reporting (Deliverables)
6) Schedule/ Timeline
7) Costs

79
Q

How should the problem definition be written?

A

From the perspective of the business issue

80
Q

What do the research objectives do?

A

They state the information that the research will provide to address the business issue

81
Q

What elements of research design are included in a proposal?

A

1) The research approach - qual/quant, special analytical models
2) The sample, including qualifications, sources, & size
3) Data collection method
4) Information about the questionnaire/survey instrument (outline, special Q techniques, length of interview