PROCTOR EXAM 1 - QUAL AND SAMPLING Flashcards

1
Q

A sample is often used to study a target population. the larger our sample size the smaller our margin of error and our estimate of the population is more likely to be accurate.

A

A sample is often used to study a target population. the larger our sample size the smaller our margin of error and our estimate of the population is more likely to be accurate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Stages of the sampling process

  1. Defining the target population
  2. Deciding on the best way to reach the population
  3. Determining a sample frame
  4. Choosing a sampling method
  5. Determining a sample size and carrying out the sampling process
A

Stages of the sampling process

  1. Defining the target population
  2. Deciding on the best way to reach the population
  3. Determining a sample frame
  4. Choosing a sampling method
  5. Determining a sample size and carrying out the sampling process
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

One of the biggest decisions within the sampling process will be choosing between a probability vs. a non-probability sampling method.
This decision will depend on the purpose of the research, the need for accuracy, the budget, and timing of the project.

A

One of the biggest decisions within the sampling process will be choosing between a probability vs. a non-probability sampling method.
This decision will depend on the purpose of the research, the need for accuracy, the budget, and timing of the project.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Knowing the incidence of our target population within our sampling frame will help us predict how many interviews need to be conducted
to achieve the sample size we want and how much money the study will cost.

A

Knowing the incidence of our target population within our sampling frame will help us predict how many interviews need to be conducted
to achieve the sample size we want and how much money the study will cost.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

It is important for market researchers to treat research buyers ethically by being transparent regarding sampling practices and treat the survey participants ethically by being honest with them and fulfilling any promises to them

A

It is important for market researchers to treat research buyers ethically by being transparent regarding sampling practices and treat the survey participants ethically by being honest with them and fulfilling any promises to them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Market Research is utilized to make decisions that reduce business risks. To have con dence in the decisions that are being made, we
need to have a sample that we are con dent in. Without that, all the results produced from our study could be called into question.

A

Market Research is utilized to make decisions that reduce business risks. To have con dence in the decisions that are being made, we
need to have a sample that we are con dent in. Without that, all the results produced from our study could be called into question.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

The principles we have laid out in this course highlight that the sampling methods used to produce the research are as important to
interpreting the findings as the questions being asked. The answers to these questions can help
us formulate an idea of how accurate a secondary data set may be and how appropriate it would be to use the data set for our current need.

A

The principles we have laid out in this course highlight that the sampling methods used to produce the research are as important to interpreting the findings as the questions being asked. The answers to these questions can help
us formulate an idea of how accurate a secondary data set may be and how appropriate it would be to use the data set for our current need.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

A Random Digit Dialing (RDD) sample consists of phone

numbers randomly generated from a computer.

A

A Random Digit Dialing (RDD) sample consists of phone

numbers randomly generated from a computer.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

RDD - However, this is not the most efficient way to produce a
phone sample, as many of the numbers that are chosen
could be non-working or lead to a place of business.

A

RDD - However, this is not the most efficient way to produce a
phone sample, as many of the numbers that are chosen
could be non-working or lead to a place of business.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Often systematic sampling is used for phone—where all of the
phone numbers within the defined sample frame are put in numerical order, then the first number is chosen at random and then every
nth number the next number is chosen.
By performing a systematic sample via the phone numbers, it can help to guarantee disbursement of numbers across the population.

A

Often systematic sampling is used for phone—where all of the
phone numbers within the defined sample frame are put in numerical order, then the first number is chosen at random and then every
nth number the next number is chosen.
By performing a systematic sample via the phone numbers, it can help to guarantee disbursement of numbers across the population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Stratification would be another form of telephone sampling that may also produce a more accurate sample than an RDD sample, in certain conditions. Because telephone numbers tell you information about location, it may make sense to stratify the sample by specific geography.

A

Stratification would be another form of telephone sampling that may also produce a more accurate sample than an RDD sample, in certain conditions. Because telephone numbers tell you information about location, it may make sense to stratify the sample by specific geography.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Landlines remain an important part of telephone sampling today, largely due to the cost associated with dialing mobile telephones.

A

Landlines remain an important part of telephone sampling today, largely due to the cost associated with dialing mobile telephones.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Mixing across these two separate frames (landline and mobile), requires care to apply various screenouts and/or data
weighting , as the people with both mobile and landline telephones will be more likely to be chosen, because they exist in both frames.

A

Mixing across these two separate frames (landline and mobile), requires care to apply various screenouts and/or data
weighting , as the people with both mobile and landline telephones will be more likely to be chosen, because they exist in both frames.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Autodialers can be used to dial landline telephone numbers. These computer based dialers will call many telephone numbers quickly,
passing the phone to a live interviewer once someone has answered.

A

Autodialers can be used to dial landline telephone numbers. These computer based dialers will call many telephone numbers quickly,
passing the phone to a live interviewer once someone has answered.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

E ective sampling is important in order to gather meaningful data that will drive successful decisions. Taking care to consider alternatives
and make informed choices in each step of the sampling process helps to ensure success.

A

E ective sampling is important in order to gather meaningful data that will drive successful decisions. Taking care to consider alternatives
and make informed choices in each step of the sampling process helps to ensure success.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

One of the most common questions you will hear in the Market Research industry is “How large does my sample need to be in order to be representative?” However, it is not the sample size that determines representativeness. It is the other elements discussed in this course, such as defining the target population correctly, and selecting valid sample in a way that will assure representativeness

A

One of the most common questions you will hear in the Market Research industry is “How large does my sample need to be in order to be representative?” However, it is not the sample size that determines representativeness. It is the other elements discussed in this
course, such as defining the target population correctly, and selecting valid sample in a way that will assure representativeness

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Sample size is very often used interchangeably with the terms base size and the number of completed interviews.

A

Sample size is very often used interchangeably with the terms base size and the number of completed interviews.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Response rates - (% of those responding to an

invitation)

A

Response rates- (% of those responding to an

invitation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Participation rates - (% of those responding and willing to complete the survey)

A

Participation rates - (% of those responding and willing to complete the survey)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Base or Base Size
The number of sample units used in analysis. This could be all the completed interviews, a subset of the completed interviews, or
even all of the started interviews. This term is sometimes used interchangeably with sample size when presenting research results.

A

Base or Base Size
The number of sample units used in analysis. This could be all the completed interviews, a subset of the completed interviews, or
even all of the started interviews. This term is sometimes used interchangeably with sample size when presenting research results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Sample
A sub-group of the population of interest that has been selected for study. The term is also used to refer to a different number of people who completed the study.

A

Sample
A sub-group of the population of interest that has been selected for study. The term is also used to refer to a different number of people who completed the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Sample Size

The number of sample units selected for a study. The term is sometimes used interchangeably with base size.

A

Sample Size

The number of sample units selected for a study. The term is sometimes used interchangeably with base size.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

A margin of error (a range around a sample finding that is expected to contain
the true finding within the population). We measure through statistical analysis how likely the truth is to be within this margin.

A

A margin of error (a range around a sample finding that is expected to contain
the true finding within the population). We measure through statistical analysis how likely the truth is to be within this margin.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

The larger the sample size, the smaller the impact additional sample has on the margin of error.

A

The larger the sample size, the smaller the impact additional sample has on the margin of error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

The confidence level produces a confidence interval , which is the margin of error on either side of our result. The higher the confidence level we test at, the greater our confidence interval and margin of error become.

A

The confidence level produces a confidence interval , which is the margin of error on either side of our result. The higher the confidence level we test at, the greater our confidence interval and margin of error become.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Significance testing is often used in cross-tabulation to measure whether or not two results have a statistically significant difference.
This testing uses confidence level and margin of error to make a determination, but it does so often by comparing two results with
different base sizes. This testing is done to confirm that differences are likely to be real, rather than due to sample error

A

Significance testing is often used in cross-tabulation to measure whether or not two results have a statistically significant difference.
This testing uses confidence level and margin of error to make a determination, but it does so often by comparing two results with
different base sizes. This testing is done to confirm that differences are likely to be real, rather than due to sample error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

The screening section of the questionnaire is where we qualify participants as part of the target population, removing people from the
original sample in the process.

A

The screening section of the questionnaire is where we qualify participants as part of the target population, removing people from the
original sample in the process.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

People who begin the survey, but do not complete the survey are considered as participants who have dropped from the survey or
incompletes. This is measured as a proportion of the sample that was
able to start the survey, but did not complete the survey, even though
they were not turned away. It is important that this drop rate stays relatively consistent over time and that it is not tied to a specific element of the survey, which could potentially create a bias in the sample.

A

People who begin the survey, but do not complete the survey are considered as participants who have dropped from the survey or
incompletes. This is measured as a proportion of the sample that was
able to start the survey, but did not complete the survey, even though
they were not turned away. It is important that this drop rate stays relatively consistent over time and that it is not tied to a specific element of the survey, which could potentially create a bias in the sample.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Market researchers may evaluate the quality of the data collected through the questionnaire and decide that certain survey participants need to be removed from the data (also known as data cleaning). The data is assessed in a variety of ways, from speeding (finishing the questionnaire too quickly), straight lining (giving the same answers over and over), terse or
nonsense responses from open-ended questions, and other quality control measures. This is done is to reduce the noise in the data from these invalid responses, increasing the overall validity of the survey findings.

A

Market researchers may evaluate the quality of the data collected through the questionnaire and decide that certain survey participants need to be removed from the data (also known as data cleaning). The data is assessed in a variety of ways, from speeding (finishing the questionnaire too quickly), straight lining (giving the same answers over and over), terse or
nonsense responses from open-ended questions, and other quality control measures. This is done is to reduce the noise in the data from these invalid responses, increasing the overall validity of the survey findings.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Sampling internationally is not easy

A

Sampling internationally is not easy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

When doing international

sampling, you must understand cultural differences. You also have to understand behavioral differences

A

When doing international

sampling, you must understand cultural differences. You also have to understand behavioral differences

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

“What do clients mean when they ask for census balanced”? Research buyers will often use the word “census” when they mean
characteristics of the overall population.

A

“What do clients mean when they ask for census balanced”? Research buyers will often use the word “census” when they mean
characteristics of the overall population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

Online is also a self-completion mode where the participants do not interact with an interviewer. This method is often the preferred means to conduct surveys

A

Online is also a self-completion mode where the participants do not interact with an interviewer. This method is often the preferred means to conduct surveys

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

It is possible to achieve a probability sample from online when
the sample frame gives complete coverage of the target population

A

It is possible to achieve a probability sample from online when
the sample frame gives complete coverage of the target population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

An online sample that is trying to measure the general population is a form of convenience sampling.

A

An online sample that is trying to measure the general population is a form of convenience sampling.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Often participants who are recruited to take part in online surveys are recruited to join research panels, where they have given their
contact information and will be invited to take part in multiple research studies over their tenure.

A

Often participants who are recruited to take part in online surveys are recruited to join research panels, where they have given their
contact information and will be invited to take part in multiple research studies over their tenure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

A technique known as a
“ River Sample ” recruits participants from online advertisements directly into surveys, as opposed to using existing online panels. The difference being that online panels know more about the survey participant, tend to have a more consistent sample frame, and can adhere to a higher level of quality in this self-completion environment. However, proponents of river sampling point out that not everyone wants to join a research panel and that river sample extends the coverage in an online sample.

A

A technique known as a
“ River Sample ” recruits participants from online advertisements directly into surveys, as opposed to using existing online panels. The difference being that online panels know more about the survey participant, tend to have a more consistent sample frame, and can adhere to a higher level of quality in this self-completion environment. However, proponents of river sampling point out that not everyone wants to join a research panel and that river sample extends the coverage in an online sample.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

At its core online sampling is a convenience sample. Because online sampling has become the most popular form of sampling and widely
accepted across the Market Research industry, there has been large investment into the quality, methodology , and best practices
around online sampling.

A

At its core online sampling is a convenience sample. Because online sampling has become the most popular form of sampling and widely
accepted across the Market Research industry, there has been large investment into the quality, methodology , and best practices
around online sampling.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

The goal of recruiting through online channels should be to minimize potential bias, by recruiting through a diverse set of sources and by
trying to maximize participation.

A

The goal of recruiting through online channels should be to minimize potential bias, by recruiting through a diverse set of sources and by
trying to maximize participation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q
Many advantages to routers
1. Efficient way to allocate
sample
2. Has the opportunity to
reduce cost
3. Better user experience, especially for those who are always screened out of a survey
A
Many advantages to routers
1. Efficient way to allocate
sample
2. Has the opportunity to
reduce cost
3. Better user experience, especially for those who are always screened out of a survey
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

The concern when it comes to employing routers is a router bias occurring. The router bias is most concerning when two
studies are competing for a similar audience.

A

The concern when it comes to employing routers is a router bias occurring. The router bias is most concerning when two
studies are competing for a similar audience.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Although survey routing is clearly a form of convenience sample, there are arguments that survey routing is an improved methodology
for online panels over email invitations directly into studies. The routing technology reduces the opportunity for self-selection that could
come from an email invitation. The routing technology allows panel companies to increase reach by bringing in sample from other
sources, which could be other panel providers, river sample, other non-email based sources, such as app based panels and social
communities.

A

Although survey routing is clearly a form of convenience sample, there are arguments that survey routing is an improved methodology
for online panels over email invitations directly into studies. The routing technology reduces the opportunity for self-selection that could
come from an email invitation. The routing technology allows panel companies to increase reach by bringing in sample from other
sources, which could be other panel providers, river sample, other non-email based sources, such as app based panels and social
communities.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Their overall conclusion is that routers do not show measurable levels of bias
relative to any online sample, as long as they are employed correctly.

A

Their overall conclusion is that routers do not show measurable levels of bias
relative to any online sample, as long as they are employed correctly.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

In online research targeting can be used to help with the efficiency of the study

A

In online research targeting can be used to help with the efficiency of the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

One concern users of online research panels have is prior survey exposure. This is a conditioning effect that occurs when information from a previous survey informs the participant and influences their responses to future surveys.

A

One concern users of online research panels have is prior survey exposure. This is a conditioning effect that occurs when information from a previous survey informs the participant and influences their responses to future surveys.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

This leads us to the question of how, if at all, margin of error can be applied in online sampling, when a random sample of everyone
online cannot be employed. There are three schools of thought.
1. Margin of error should never be applied to anything other than a probability based sample.
2. Margin of error can be applied in online sampling, but only to measure differences between the current sample and future
testing that is done within the same sample frame.
3. Online samples, though not probability based, are trying to measure a marketplace. Therefore, if a business believes that the
sample they created online accurately reflects the marketplace, they can use margin of error to project to that marketplace.

A

This leads us to the question of how, if at all, margin of error can be applied in online sampling, when a random sample of everyone
online cannot be employed. There are three schools of thought.
1. Margin of error should never be applied to anything other than a probability based sample.
2. Margin of error can be applied in online sampling, but only to measure differences between the current sample and future
testing that is done within the same sample frame.
3. Online samples, though not probability based, are trying to measure a marketplace. Therefore, if a business believes that the
sample they created online accurately reflects the marketplace, they can use margin of error to project to that marketplace.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

Probability based online panels are online panels of survey participants that are recruited via probability samples using offline
means, such as address-based sampling and/or telephone. These panels are expensive to recruit and maintain

A

Probability based online panels are online panels of survey participants that are recruited via probability samples using offline
means, such as address-based sampling and/or telephone. These panels are expensive to recruit and maintain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

A sample can be developed from frames that are fundamentally different (email lists, street addresses, etc.). Similarly, studies can be implemented with more than one mode of administration (online, phone, etc.).
By having these multiple modes of contact we can work to increase response rates for our study.

A

A sample can be developed from frames that are fundamentally different (email lists, street addresses, etc.). Similarly, studies can be implemented with more than one mode of administration (online, phone, etc.).
By having these multiple modes of contact we can work to increase response rates for our study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

Probability sampling is a
rigorous, scientific, and theory-based approach to sampling. Non-probability
sampling is less rigorous but faster and significantly less expensive.

A

Probability sampling is a
rigorous, scientific, and theory-based approach to sampling. Non-probability
sampling is less rigorous but faster and significantly less expensive.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

A key part of almost every Market Research project involves the collection and/or processing of personal data (sometimes called PII for “personally identifiable information”), that is, data that can be used either directly or indirectly (e.g., by combining it with other data) to identify a specific individual. Protecting the identify of those who participate in research is recognized as a fundamental responsibility that must be met by every researcher.

A

A key part of almost every Market Research project involves the collection and/or processing of personal data (sometimes called PII for “personally identifiable information”), that is, data that can be used either directly or indirectly (e.g., by combining it with other data) to identify a specific individual. Protecting the identify of those who participate in research is recognized as a fundamental responsibility that must be met by every researcher.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

In addition, researchers are required to strictly adhere to any relevant regional, national and local laws or regulations, and industry/professional
codes of conduct that may set a higher standard. They must review and comply with the national data protection and market research self-
regulatory requirements of each country where they plan to collect or process data, as there may be differences in how basic principles are
implemented within a specific country.

A

In addition, researchers are required to strictly adhere to any relevant regional, national and local laws or regulations, and industry/professional
codes of conduct that may set a higher standard. They must review and comply with the national data protection and market research self-
regulatory requirements of each country where they plan to collect or process data, as there may be differences in how basic principles are
implemented within a specific country.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

Market researchers have an ethical obligation to
both the entity they are doing the research for
and the survey participants who are taking part
in the research.

A

Market researchers have an ethical obligation to
both the entity they are doing the research for
and the survey participants who are taking part
in the research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

Being transparent with the
research user about the sampling procedure
that will be used for the study is the most
important ethical obligation.

A

Being transparent with the
research user about the sampling procedure
that will be used for the study is the most
important ethical obligation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

Many of those regulations have to do with
protecting people’s PII (Personally Identi able
Information). PII, includes, without limitation, information such as name, address, and social security number.

A

Many of those regulations have to do with
protecting people’s PII (Personally Identi able
Information). PII, includes, without limitation, information such as name, address, and social security number.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

Much of Market Research is conducted with the assurance to participants of work to protect people’s PII and keep their identities a secret.

A

Much of Market Research is conducted with the assurance to participants of work to protect people’s PII and keep their identities a secret.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

A sample frame is the list of contacts that the sample will be drawn from

A

A sample frame is the list of contacts that the sample will be drawn from

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

The most important thing to consider regarding the sampling frame is coverage.

A

The most important thing to consider regarding the sampling frame is coverage.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

Coverage can be defined as the proportion of the target population that exists within the sampling frame

A

Coverage can be defined as the proportion of the target population that exists within the sampling frame

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

Basically there are three criteria, related to different kinds of objectives that affect decisions
about sample size:
Precision - how accurate do your estimates (means, percentages) need to be?
Power - how much do you need to be able to identify differences when they exist?
Statistical modeling - what samples are required to run various statistical models?

A

Basically there are three criteria, related to different kinds of objectives that affect decisions
about sample size:
Precision - how accurate do your estimates (means, percentages) need to be?
Power - how much do you need to be able to identify differences when they exist?
Statistical modeling - what samples are required to run various statistical models?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

To decide on a base size, we need to first understand what result will be significant to the marketing decision
and then choose a base size that makes sure that result would be statistically significant.

A

To decide on a base size, we need to first understand what result will be significant to the marketing decision
and then choose a base size that makes sure that result would be statistically significant.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

We must also weigh the practicality of finding the individuals in our target population. If we are dealing with a population that
is very small, then the desire for a large sample will be logically impossible

A

We must also weigh the practicality of finding the individuals in our target population. If we are dealing with a population that
is very small, then the desire for a large sample will be logically impossible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

If the research team defines their target too narrowly then they limit their ability to answer some key business questions

A

If the research team defines their target too narrowly then they limit their ability to answer some key business questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

if the research team defines the population too broadly, they may “waste” interviews and potentially marketing programs with potential customers who would not be very likely to use their product or service.

A

if the research team defines the population too broadly, they may “waste” interviews and potentially marketing programs with potential customers who would not be very likely to use their product or service.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

The first step is to define the target population. The decision of what the target population should be is tied directly to the goal of the
research. When making the decision of what population to measure, we do not
want to exclude anyone who could be relevant to our study, but we also
do not want to include anyone not needed.

A

The first step is to define the target population. The decision of what the target population should be is tied directly to the goal of the
research. When making the decision of what population to measure, we do not
want to exclude anyone who could be relevant to our study, but we also
do not want to include anyone not needed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

It is important to have a discussion between the research user and research company carefully defining the business issues to address, and characteristics of the population that best relate to those issues. Defining the target group is a critical step and will impact the usefulness of results to achieve business decisions and goals.

A

It is important to have a discussion between the research user and research company carefully defining the business issues to address, and characteristics of the population that best relate to those issues. Defining the target group is a critical step and will impact the usefulness of results to achieve business decisions and goals.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

Data weighting is a mathematical correction made to balance the sample and improve its validity.

A

Data weighting is a mathematical correction made to balance the sample and improve its validity.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
67
Q

Weighting factors below a one, weight the data down (we reduce their representation in the data).

A

Weighting factors below a one, weight the data down (we reduce their representation in the data).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
68
Q

Weighting factors

above a one, weight the data up (we increase their representation in the data).

A

Weighting factors

above a one, weight the data up (we increase their representation in the data).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
69
Q

When weighting by a single variable, the weighting factor

is easy to compute. Take the target value you want to achieve and divide it by the value you have.

A

When weighting by a single variable, the weighting factor

is easy to compute. Take the target value you want to achieve and divide it by the value you have.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
70
Q

The researcher usually decides if the data needs to be weighted and they come up with the weighting targets (also called the weighting scheme)

In probability sampling, it can be used as a way to control for non-response

Weighting can also be used in any situation where a quota is applied

We may be trying to balance the population to make
it look more like the population we are trying to study.

We could also be weighting samples to targets to make them more comparable.

Take care when weighting the data, as it is manipulation of the result.

Weighting methods should be communicated to the research buyer
and others using the data. For ethical reasons, weighting should not be done on the dependent variables, but rather than independent
variables.

A

The researcher usually decides if the data needs to be weighted and they come up with the weighting targets (also called the weighting scheme)

In probability sampling, it can be used as a way to control for non-response

Weighting can also be used in any situation where a quota is applied

We may be trying to balance the population to make
it look more like the population we are trying to study.

We could also be weighting samples to targets to make them more comparable.

Take care when weighting the data, as it is manipulation of the result.

Weighting methods should be communicated to the research buyer
and others using the data. For ethical reasons, weighting should not be done on the dependent variables, but rather than independent
variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
71
Q

Incidence is how often something occurs within the

population.

A

Incidence is how often something occurs within the population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
72
Q

From an analytics point of view, incidence can be stated as how often something occurs within the population

A

From an analytics point of view, incidence can be stated as how often something occurs within the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
73
Q

It is important to note that some types of convenience sampling do not have a measurable response rate, because there are not a known number of individuals invited to take part in the study.

A

It is important to note that some types of convenience sampling do not have a measurable response rate, because there are not a known number of individuals invited to take part in the study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
74
Q

Non-response error becomes especially problematic when different groups in the population respond at different rates.

A

Non-response error becomes especially problematic when different groups in the population respond at different rates.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
75
Q

Researchers frequently use incentives to increase response rates, which are discussed in more detail in the next section

A

Researchers frequently use incentives to increase response rates, which are discussed in more detail in the next section

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
76
Q

Well-designed and short questionnaires help keep refusal rates down

A

Well-designed and short questionnaires help keep refusal rates down

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
77
Q

Participants are the lifeblood of the opinion and Market Research industry. They should be respected, valued, and protected. The
researcher’s interactions with participants should be characterized by honesty and integrity. The researcher’s ultimate objective is to
ensure that with every contact:
Participants will participate in surveys willingly
Participants are informed about the survey’s intentions
Participants will be satisfied with the survey experience
Participants will be willing to participate again

A

Participants are the lifeblood of the opinion and Market Research industry. They should be respected, valued, and protected. The
researcher’s interactions with participants should be characterized by honesty and integrity. The researcher’s ultimate objective is to
ensure that with every contact:
Participants will participate in surveys willingly
Participants are informed about the survey’s intentions
Participants will be satisfied with the survey experience
Participants will be willing to participate again

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
78
Q

Incentives are given to entice people to take part in survey research and to complete the survey once it begins.

A

Incentives are given to entice people to take part in survey research and to complete the survey once it begins.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
79
Q

To increase efficiency, targeting measures may be employed.
Targeting is often used to adjust sample frames in a way that does not disrupt representivity. we need to
include everyone in the target population, but if we know we are inviting people outside of our target population, then we need to have adequate screening in the questionnaire.

A

To increase efficiency, targeting measures may be employed.
Targeting is often used to adjust sample frames in a way that does not disrupt representivity. we need to
include everyone in the target population, but if we know we are inviting people outside of our target population, then we need to have adequate screening in the questionnaire.

80
Q

Prescreening the information is collected prior to the survey and is used specifically for targeting to reduce cost

A

Prescreening the information is collected prior to the survey and is used specifically for targeting to reduce cost

81
Q

In some instances, we may be conducting a tracking study , which regularly measure changes in the marketplace over time. Or perhaps
we are doing concept testing that needs to be compared to previous waves of research. For these types of studies, it is particularly
important to control the consistency of the sample.

A

In some instances, we may be conducting a tracking study , which regularly measure changes in the marketplace over time. Or perhaps
we are doing concept testing that needs to be compared to previous waves of research. For these types of studies, it is particularly
important to control the consistency of the sample.

82
Q

Probability based sampling and non-probability sampling. Probability based
sampling is when everyone in the target population has a known, non-zero, chance
of selection.

A

Probability based sampling and non-probability sampling. Probability based
sampling is when everyone in the target population has a known, non-zero, chance
of selection.

83
Q

In order to achieve a probability-based
sample, you need to have a sample frame
that has complete coverage of the target
population and you need to understand the
likelihood of selection within this frame.

A

In order to achieve a probability-based
sample, you need to have a sample frame
that has complete coverage of the target
population and you need to understand the
likelihood of selection within this frame.

84
Q

In a non‐probability sample , some elements of the population are not
accounted for and/or elements within the
sampling frame may have no chance of selection.

A

In a non‐probability sample , some elements of the population are not
accounted for and/or elements within the
sampling frame may have no chance of selection.

85
Q

A simple random sample is when each element within the same frame has an equal chance of selection and is chosen at random. This may be the simplest form of all sampling, but it is not necessarily the most used

A

A simple random sample is when each element within the same frame has an equal chance of selection and is chosen at random. This may be the simplest form of all sampling, but it is not necessarily the most used

86
Q

When we sample strata at different rates than they occur in the population, we employ disproportionate sampling. When we sample each stratum at the same rate as occurs in the population, we are using proportionate sampling.

A

When we sample strata at different rates than they occur in the population, we employ disproportionate sampling. When we sample each stratum at the same rate as occurs in the population, we are using proportionate sampling.

87
Q

Cluster sampling includes a large number of clusters. These clusters are meant to be heterogeneous in nature.

A

Cluster sampling includes a large number of clusters. These clusters are meant to be heterogeneous in nature.

88
Q

“Convenience sampling
is a form of non-probability sampling in which the ease with which potential participants can be located or recruited is the
primary consideration.

A

“Convenience sampling
is a form of non-probability sampling in which the ease with which potential
participants can be located or recruited is the
primary consideration.

89
Q

A quota is a number of interviews required

A

A quota is a number of interviews required

90
Q

Quotas can also be used to control characteristics of the sample, to guarantee consistency across samples. This is of importance if the characteristics being controlled for have a significant impact on the findings of the study

A

Quotas can also be used to control characteristics of the sample, to guarantee consistency across samples. This is of importance if the characteristics being controlled for have a significant impact on the findings of the study

91
Q

In snowball sampling we select a sample, either through probability or non-probability methods. We then ask those selected
who participate in our research to refer someone they know to take the survey

A

In snowball sampling we select a sample, either through probability or non-probability methods. We then ask those selected
who participate in our research to refer someone they know to take the survey

92
Q

Snowball sampling is used to reach hard to nd populations,

where members of the target population are more likely to know each other

A

Snowball sampling is used to reach hard to nd populations,

where members of the target population are more likely to know each other

93
Q

Which type of telephone sample is more expensive?

A

Mobile phone numbers

94
Q

Which is NOT a difference you are likely to encounter as you design your sampling for international projects?

A

The application of sampling principles

95
Q

You are reviewing results from secondary research, you have only 2 minutes before meeting with management. You will probably be asked, “how applicable this study’s sample for our purposes?”, if you can only learn ONE of the following about the study’s sample before the meeting, what is the most important to know?

A

Population and sample definitions

96
Q

In which option will increasing the sample size result in the largest improvement in precision (that is, the largest decrease in the margin of error)?

A

Increasing the sample size from 100 to 200

97
Q

Which one of the following statements about using a sample versus a census is FALSE?

A

Accurate population estimates can only be obtained through a census.

98
Q

If you increase your confidence level, for example from 85% to 95%, what (if any) change occurs in the margin of error?

A

The margin of error increases

99
Q

Which of the following is NOT one of the steps in the sample design process?

A

Calculating corrective weights for a sample you have

100
Q

Which of the following is NOT a consideration in determining the desired sample size for a study?

A

The minimum size required to establish “statistical validity”

101
Q

Typical sampling sources for studies with physicians include all of the following, EXCEPT:

A

RDD

102
Q

Which of the following is a type of non-probability sampling technique?

A

Snowball sample

103
Q

The two main classifications of sampling techniques are _____________ and _____________.

A

probability samples; non-probability samples

104
Q

The probability sampling method used to ensure that subgroups of interest within the target population are adequately represented in the sample is called:

A

Stratified sampling

105
Q

When using a ___________ sampling technique, a large number of groups are defined with each having a heterogeneous composition. Specific groups are then selected at random to be included in the research. Every member of the selected groups is included in the sampling.

A

cluster

106
Q

An instructor is doing research with college students in his/her course to draw conclusions about the adult population. This is an example of a ___________ sample.

A

convenience

107
Q

Most market research sample sizes are selected based on:

A

Practical considerations that include: project budget, what sizes are feasible given population(s) size, and the company’s own standard practices

108
Q

True or False: Probability-based online panels are available for online research.

A

True

109
Q

The type of online sample in which individuals agree to participate in research studies, provide their demographics and other information, and typically respond at high rates to survey invitations is called:

A

An online panel sample

110
Q

When interviewing busy corporate executives, you should expect response rates to be LOWEST for a __________ minute survey.

A

30

111
Q

A change in which of the following, could potentially change sample composition?

A

All of the above

The drop out rate, The screener questions, The data cleaning procedures, The field time period

112
Q

n sampling design, we want the data collection method we select to: (SELECT THREE [3] ANSWERS THAT APPLY)

A

maximize response while reducing biases, have good coverage of our target population,
fit the study topic and objectives

113
Q

Fraud that is a particular concern for the healthcare market research is:

A

Someone pretending to be a doctor to obtain the large incentives associated with physician studies

114
Q

Screening potential participants to ensure they are members of the population of interest:

A

Helps to address some sampling frame errors that can arise

115
Q

Best practices for defining a target population for sampling purposes involve each of the following EXCEPT:

A

Stating the definition vaguely enough to be flexible in sampling

116
Q

Which of the following LEAST affects how representative a sample is?

A

The size of the sample

117
Q

True or False: It is ethical to let the readers of research results make their own judgements about it being projectable to a larger population from the margin of error you report.

A

False

118
Q

True or False: The marketing research industry is heavily regulated by governments and has no rules or guidelines on best practices and ethical guidelines.

A

False

119
Q

The closer the population estimate is to __________ , the __________ the margin of error of a sample will be.

A

50%; larger

120
Q

Sampling sources for healthcare research with patients include which of the following:

A

Volunteers responding to newspaper advertisements or announcements on websites, Panels of individuals with specific types of chronic conditions, Emails to general household panels asking if anybody in the household suffers from the target symptoms or disease, Patients who have enrolled in a product’s patient support program and indicated a willingness to be contacted for research purposes (All the above -correct answer)

121
Q

True or False: One critical requirement to have a true probability sample (as academics define) is you must know the likelihood one is picked from the list.

A

True

122
Q

In which type of sampling technique does each individual in the target population have an EQUAL chance to be included in the sample?

A

Simple random sampling

123
Q

True or False: Probability-based online panels are available for online research.

A

True

124
Q

Participant fraud can be a concern particularly for online studies. Which of the following are examples of participant fraud? (SELECT TWO [2] ANSWERS THAT APPLY)

A

A restaurant manager completes multiple visitor satisfaction cards (available at each table) to boost his restaurant’s service ratings.

A college student registers with an online panel several times as himself and as his roommates.

125
Q

Best practices for defining a target population for sampling purposes involve each of the following EXCEPT:

A

Stating the definition vaguely enough to be flexible in sampling

126
Q

True or False: It is very important that researchers report every statistically significant difference between subgroups to their client.

A

False

127
Q

Researchers must keep participants’ personally identifiable information confidential EXCEPT when:

A

Participants give permission for their data to be shared.

128
Q

Which is NOT a difference you are likely to encounter as you design your sampling for international projects?

A

The application of sampling principles

129
Q

Which of the following is NOT one of the steps in the sample design process?

A

Calculating corrective weights for a sample you have

130
Q

When determining the size of the sampling frame needed to obtain a desired number of completed interviews, a researcher must consider:

A

The contact rate, The refusal rate, The incidence rate, The termination rate during the interview, (all of the above-correct)

131
Q

True or False: For an Online sample to be a Probability sample, you must have a sampling frame with complete coverage of the target population.

A

True

132
Q

When using targeted lists as the sampling frame for a study, a researcher should:

A

Evaluate how representative the list is of the target population.
Learn how and for what purpose the targeted list was compiled.
Identify how the list differs from the target population.
Consider approaches that could make the sample more representative of the target population.

(correct answer) All of the above

133
Q

When a sample is drawn, it is a sample of:

A

people, businesses, households, transactions, (correct answer- could be any of the above)

134
Q

Five focus groups are conducted with users of a specific brand and five are conducted with non-users. The type of sampling being used is BEST described as:

A

Quota sampling

135
Q

True or False: It is possible for a wave of a tracking study to produce a very different sample than a prior wave due to different field timing, even if the same list is used and everything else about the sampling process remains exactly the same.

A

True

136
Q

All else being equal, which of the following situations is preferable:

A

Having to design multiple surveys for CATI and self-administered online data collection methods in order to obtain a more representative sample and better response rates. Mode effects will need to be considered in analysis.

137
Q

Sampling statistics, like the margin of error, are based on the use of a __________ .

A

probability sample

138
Q

_____________ provide a range of possible values into which the true population parameter will fall.

A

Confidence intervals

139
Q

True or False: Online panels are usually not specific to device-type (PC, mobile, etc.) since they are based on an online account that can be accessed via different devices.

A

True

140
Q

There are drawbacks when a survey router is used in online studies, however, a survey router has a benefit of reducing what type of bias?

A

self-selection

141
Q

In healthcare market research, a population misspecification error can be fatal to a study’s success with no way to correct later. Which of the following is an example of this type of error?

A

A study is conducted with a physician specialty which is NOT a decision-maker in the drug category the study is interested in.

142
Q

For ethical reasons, weighting should be done on the __________ variables and not on the __________ variables.

A

independent; dependent

143
Q

“Qualitative research is also referred to as motivational research
and developmental research

These days, qualitative
research is usually offered as a developmental phase in preparation for subsequent quantitative surveys

A

“Qualitative research is also referred to as motivational research
and developmental research

These days, qualitative
research is usually offered as a developmental phase in preparation for subsequent quantitative surveys

144
Q

Qualitative market research is an exploration of the
“whys” behind behaviors and attitudes. The focus is
less on who, what, when, and where, and more on
how and why.
Qualitative market research has been traditionally
used as a stepping stone to further understanding
rather than the means to an end—it is used primarily
for hypotheses development instead of hypothesis
testing.
It is a flexible form of research, which allows for
changes in approach and inquiry to gain a more in-
depth understanding of the research issues.

A

Qualitative market research is an exploration of the
“whys” behind behaviors and attitudes. The focus is
less on who, what, when, and where, and more on
how and why.
Qualitative market research has been traditionally
used as a stepping stone to further understanding
rather than the means to an end—it is used primarily
for hypotheses development instead of hypothesis
testing.
It is a flexible form of research, which allows for
changes in approach and inquiry to gain a more in-
depth understanding of the research issues.

145
Q

As part of that proposal process, the qualitative researcher(s) will
clarify the goals and objectives of the study, will suggest an appropriate qualitative methodology to address those goals and objectives,
will identify likely partners in the research plan, layout a proposed timeline, and will estimate the costs of the plan.

A

As part of that proposal process, the qualitative researcher(s) will
clarify the goals and objectives of the study, will suggest an appropriate qualitative methodology to address those goals and objectives,
will identify likely partners in the research plan, layout a proposed timeline, and will estimate the costs of the plan.

146
Q

Steps in the Process

Clarify the Purpose

Define the Methodological Approach

a. Design Options
b. Other Methodological Considerations

Select Research Partners

Develop Key Tools

Recruit Participants

Collect the Data

Analyze the Data

Present the Results

A

Steps in the Process

Clarify the Purpose

Define the Methodological Approach

a. Design Options
b. Other Methodological Considerations

Select Research Partners

Develop Key Tools

Recruit Participants

Collect the Data

Analyze the Data

Present the Results

147
Q

First and foremost, there must be a clear purpose statement or objective for the project. The purpose statement drives the design of the study. Sometimes clients have difficulty articulating the purpose. It is the researcher’s responsibility to get this clarified. The
research design and ultimately the reporting of the research results are all developed to meet this purpose statement or objective.

A

First and foremost, there must be a clear purpose statement or objective for the project. The purpose statement drives the design of the study. Sometimes clients have difficulty articulating the purpose. It is the researcher’s responsibility to get this clarified. The
research design and ultimately the reporting of the research results are all developed to meet this purpose statement or objective.

148
Q

. The design will include recommendations about the
fundamental tools to be used for the research (focus groups vs. IDIs, online vs. in-person, etc.) and the rationale for that
recommendation

A

. The design will include recommendations about the
fundamental tools to be used for the research (focus groups vs. IDIs, online vs. in-person, etc.) and the rationale for that
recommendation

149
Q

So, step three in the process is selecting the research partners. This includes the moderator, the facilities or platform partners (online
or in-person) that will be used, lining up recruiters, identifying a sample provider (if needed), etc.

A

So, step three in the process is selecting the research partners. This includes the moderator, the facilities or platform partners (online
or in-person) that will be used, lining up recruiters, identifying a sample provider (if needed), etc.

150
Q

Step four begins at the same time as Step 3. The recruitment screener is a top priority in this phase. Without an approved screener,
recruitment cannot begin. Once the screener is finalized, the discussion guide can be developed. This will probably go through multiple
iterations with the client before it is finalized.

A

Step four begins at the same time as Step 3. The recruitment screener is a top priority in this phase. Without an approved screener,
recruitment cannot begin. Once the screener is finalized, the discussion guide can be developed. This will probably go through multiple
iterations with the client before it is finalized.

151
Q

Step five is recruitment, and it typically begins in the second week of the process

A

Step five is recruitment, and it typically begins in the second week of the process

152
Q

Step six is when the groups or interviews take place.

A

Step six is when the groups or interviews take place.

153
Q

Step seven—analysis of the data—can begin before the data are finished being collected. Transcription can begin.

A

Step seven—analysis of the data—can begin before the data are finished being collected. Transcription can begin.

154
Q

Finally, step eight is presentation of the findings

A

Finally, step eight is presentation of the findings

155
Q

Step 1: Clarify the Purpose

A well-crafted purpose statement provides guidance through the
research process and includes the following elements:
It says what the general question/issue is to be discussed
It specifies (in broad terms) who the participants should be
It includes a general statement of how the information will be used
It will not specify what type of methodology to use; it focuses only on the business

A

Step 1: Clarify the Purpose

A well-crafted purpose statement provides guidance through the
research process and includes the following elements:
It says what the general question/issue is to be discussed
It specifies (in broad terms) who the participants should be
It includes a general statement of how the information will be used
It will not specify what type of methodology to use; it focuses only on the business

156
Q

Step 2A: Define the Methodological
Approach

The general design (direct vs. observed, online vs. offline, groups vs. in-
depth interviews, etc.)
The sampling frame (defining the target population to interview or
observe)
The sample source (determining who will provide the sample needed)
Geographic scope (since this isn’t quantitative, we can’t sample
everyone. We need to be selective of where our participants reside)
How many groups/interviews/observations
Incentives (while not always required, they are generally the norm.

A

Step 2A: Define the Methodological
Approach

The general design (direct vs. observed, online vs. offline, groups vs. in-
depth interviews, etc.)
The sampling frame (defining the target population to interview or
observe)
The sample source (determining who will provide the sample needed)
Geographic scope (since this isn’t quantitative, we can’t sample
everyone. We need to be selective of where our participants reside)
How many groups/interviews/observations
Incentives (while not always required, they are generally the norm.

157
Q

Semiotics may be considered a branch of indirect questioning methods. Semiotics is not so much a qualitative technique as
much as it is a form of qualitative analysis. Like observational research, it is based on the premise that consumers are not
always able to articulate their innermost feelings about brands or products. Unlike observational research, which uses people
as its data source, semiotics uses things as its data source, and studies the cultural meaning of those things

A

Semiotics may be considered a branch of indirect questioning methods. Semiotics is not so much a qualitative technique as
much as it is a form of qualitative analysis. Like observational research, it is based on the premise that consumers are not
always able to articulate their innermost feelings about brands or products. Unlike observational research, which uses people
as its data source, semiotics uses things as its data source, and studies the cultural meaning of those things

158
Q

These are also called asynchronous online discussions, or online bulletin
boards.

A

These are also called asynchronous online discussions, or online bulletin
boards.

159
Q

There is a constant push in research (qualitative or quantitative) to do research “better, faster, cheaper.” One way to achieve
this is to blur the lines between quantitative and qualitative research. This can be considered another hybrid approach, but
whereas the previous section addresses mixed methods within the qualitative spectrum, quali-quant designs represent a
hybrid of a much broader set of approaches.

A

There is a constant push in research (qualitative or quantitative) to do research “better, faster, cheaper.” One way to achieve
this is to blur the lines between quantitative and qualitative research. This can be considered another hybrid approach, but
whereas the previous section addresses mixed methods within the qualitative spectrum, quali-quant designs represent a
hybrid of a much broader set of approaches.

160
Q

Synchronous is when all participants and the moderator are engaged in the
data collection process at the same time, such as during an in-person focus group.
Asynchronous means that the moderator and participants are not engaged in the data collection process at the same time.

A

Synchronous is when all participants and the moderator are engaged in the
data collection process at the same time, such as during an in-person focus group.
Asynchronous means that the moderator and participants are not engaged in the data collection process at the same time.

161
Q

Ethnography delivers some of the deepest insights about consumers because it’s a means of seeing consumers’
real lives in a very natural, uninterrupted way over a day’s time or more – on their terms, not yours.

A

Ethnography delivers some of the deepest insights about consumers because it’s a means of seeing consumers’
real lives in a very natural, uninterrupted way over a day’s time or more – on their terms, not yours.

162
Q

It is wise for clients to evaluate potential Moderators based on the above criteria. Frequently, however, it is the “personal
chemistry” between the Moderator and the client that is most critical. Most clients are looking for a productive, comfortable,
reliable, and trustful working relationship with the Moderator; if the client has any doubts about this (even if it is based on a
“sixth sense”), a Moderator who looks well-qualified “on paper” may be passed over for another with whom the client has a
stronger sense of confidence.

A

It is wise for clients to evaluate potential Moderators based on the above criteria. Frequently, however, it is the “personal
chemistry” between the Moderator and the client that is most critical. Most clients are looking for a productive, comfortable,
reliable, and trustful working relationship with the Moderator; if the client has any doubts about this (even if it is based on a
“sixth sense”), a Moderator who looks well-qualified “on paper” may be passed over for another with whom the client has a
stronger sense of confidence.

163
Q

Independent Moderators are
those who are not employed by the organization that is paying for the research. Vested Moderators are employees of the
organization that is buying and using the research

A

Independent Moderators are
those who are not employed by the organization that is paying for the research. Vested Moderators are employees of the
organization that is buying and using the research

164
Q

Moderators typically ask more questions than appear in the discussion guide. Often these are follow-up questions that are
asked to clarify responses from participants or to encourage the participant to say more about a topic of interest. It is
impossible to anticipate what these questions will be; that is why they are not all included in the guide. (Although, to the
extent possible, at least some of the anticipated follow-up questions are included in the guide.) These follow-up questions are
called “ probes ” – they are questions designed to investigate further around a response to get more data.

A

Moderators typically ask more questions than appear in the discussion guide. Often these are follow-up questions that are
asked to clarify responses from participants or to encourage the participant to say more about a topic of interest. It is
impossible to anticipate what these questions will be; that is why they are not all included in the guide. (Although, to the
extent possible, at least some of the anticipated follow-up questions are included in the guide.) These follow-up questions are
called “ probes ” – they are questions designed to investigate further around a response to get more data.

165
Q

Moderators may want to take some notes during an in-person or video interview or discussion, but a good Moderator will
refrain from excessive note-taking. Note-taking almost always requires the Moderator to look down at what is being written
down, breaking eye-contact with the speaker and the group. A good Moderator stays with the participants, maintaining eye-
contact with them almost all of the time, to establish and maintain rapport. Here are some other reasons why note-taking by

A

Moderators may want to take some notes during an in-person or video interview or discussion, but a good Moderator will
refrain from excessive note-taking. Note-taking almost always requires the Moderator to look down at what is being written
down, breaking eye-contact with the speaker and the group. A good Moderator stays with the participants, maintaining eye-
contact with them almost all of the time, to establish and maintain rapport. Here are some other reasons why note-taking by

166
Q
These debrief sessions can
be invaluable for the
researcher (or the report-
writing team) to begin to
formulate findings and hypotheses to begin thinking about. Regardless of the research methodology followed, there are ways
to hold these debrief sessions.
A
These debrief sessions can
be invaluable for the
researcher (or the report-
writing team) to begin to
formulate findings and hypotheses to begin thinking about. Regardless of the research methodology followed, there are ways
to hold these debrief sessions.
167
Q

How does one analyze qualitative data? Each researcher has his/her own preferred style, and no method is necessarily better
than another. But all methods require the analyst to delve back into the data, which many consider to be a laborious process.
Three common options are listed below. (Keep in mind that the options below pertain only to Full Reports and Management
Summary Presentation Decks. With topline reports, there is seldom time to go through transcripts.)

A

How does one analyze qualitative data? Each researcher has his/her own preferred style, and no method is necessarily better
than another. But all methods require the analyst to delve back into the data, which many consider to be a laborious process.
Three common options are listed below. (Keep in mind that the options below pertain only to Full Reports and Management
Summary Presentation Decks. With topline reports, there is seldom time to go through transcripts.)

168
Q

While most research is done with consumers (business-to-consumer research, or B2C research), a lot of research is done with
product/service users and decision-makers in business (B2B research). Some examples include:
Talking to administrative assistants about their use of and problems with o ce supplies and the ordering process
Research focusing on employee satisfaction and retention
Research with Human Resource professionals about employee bene ts
Issues regarding on-the-job safety and possible solutions
Feedback from users about tools used on-the-job, including heavy equipment and productivity software
Feedback from sales people about the sales support tools they have at their disposal

A

While most research is done with consumers (business-to-consumer research, or B2C research), a lot of research is done with
product/service users and decision-makers in business (B2B research). Some examples include:
Talking to administrative assistants about their use of and problems with o ce supplies and the ordering process
Research focusing on employee satisfaction and retention
Research with Human Resource professionals about employee bene ts
Issues regarding on-the-job safety and possible solutions
Feedback from users about tools used on-the-job, including heavy equipment and productivity software
Feedback from sales people about the sales support tools they have at their disposal

169
Q

The use of qualitative research is prevalent in the healthcare industry. This is due to a variety of market structure
issues. First, healthcare products compete in more highly concentrated markets than do other products such as consumer
package goods, consumer electronics and services, entertainment and even nancial services. Second, the sizes of
prescription drug markets are considerably smaller in terms of numbers of patients with a particular disease than, say, users
of smart phones. Third, the number of physicians who prescribe within a given therapeutic category as well as the number of
managed care decision makers is also relatively small. Fourth, physicians are the primary prescribing decision makers.

A

The use of qualitative research is prevalent in the healthcare industry. This is due to a variety of market structure
issues. First, healthcare products compete in more highly concentrated markets than do other products such as consumer
package goods, consumer electronics and services, entertainment and even nancial services. Second, the sizes of
prescription drug markets are considerably smaller in terms of numbers of patients with a particular disease than, say, users
of smart phones. Third, the number of physicians who prescribe within a given therapeutic category as well as the number of
managed care decision makers is also relatively small. Fourth, physicians are the primary prescribing decision makers.

170
Q

As a result of the small and highly concentrated product categories and homogeneous decision-making styles, healthcare
marketers have historically had greater con dence in qualitative research. Often, major decisions around positioning,
message, and promotional materials are made using only qualitative research without any further quantification.

A

As a result of the small and highly concentrated product categories and homogeneous decision-making styles, healthcare
marketers have historically had greater con dence in qualitative research. Often, major decisions around positioning,
message, and promotional materials are made using only qualitative research without any further quantification.

171
Q

A third category of materials/tools that may need to be prepared are things that will be shown to participants, or activities
that participants will be asked to engage in over the course of a discussion.

A

A third category of materials/tools that may need to be prepared are things that will be shown to participants, or activities
that participants will be asked to engage in over the course of a discussion.

172
Q

A stimulus (also called an exhibits ) is anything that is shown to participants. Stimuli can range from short videos, printed
concept statements, or actual prototypes of products. They can also include photos that may be used in photo sort exercises,
short questionnaires for participants to fill out either before or during a focus group/interview , and props that some
Moderators use in projective exercises (e.g., little toy animals spread out on the table for participants to pick from in
response to particular questions)

A

A stimulus (also called an exhibits ) is anything that is shown to participants. Stimuli can range from short videos, printed
concept statements, or actual prototypes of products. They can also include photos that may be used in photo sort exercises,
short questionnaires for participants to fill out either before or during a focus group/interview , and props that some
Moderators use in projective exercises (e.g., little toy animals spread out on the table for participants to pick from in
response to particular questions)

173
Q

An intervention is anything that is done in a focus group/interview that is outside of simply asking straightforward
questions and getting answers.

A

An intervention is anything that is done in a focus group/interview that is outside of simply asking straightforward
questions and getting answers.

174
Q

A good amount of time is spent putting together the discussion guide. Here, we use discussion guide to include interview
guide. Discussion guide is the name typically given to guides for group discussions (2 or more participants), while interview
guide is the name typically given to guides for one-on-one in-depth interviews (IDIs).
Typically the Moderator/interviewer takes responsibility for creating this document

A

A good amount of time is spent putting together the discussion guide. Here, we use discussion guide to include interview
guide. Discussion guide is the name typically given to guides for group discussions (2 or more participants), while interview
guide is the name typically given to guides for one-on-one in-depth interviews (IDIs).
Typically the Moderator/interviewer takes responsibility for creating this document

175
Q

The screener is a questionnaire that recruiters will use to nd quali ed participants for the study. It is called a “screener”
because it is like panning for gold—we have to sift through many people to nd the nuggets (quali ed people) to be invited to
participate. Screeners are used by telephone recruiters, or they may be online surveys as a way to automate the recruitment
process.

A

The screener is a questionnaire that recruiters will use to nd qualified participants for the study. It is called a “screener”
because it is like panning for gold—we have to sift through many people to nd the nuggets (qualified people) to be invited to
participate. Screeners are used by telephone recruiters, or they may be online surveys as a way to automate the recruitment
process.

176
Q

Which of the following provides the BEST understanding of “why” and “how” participants think and behave the way they do?

A

Qualitative

177
Q

The reliability/repeatability of research results is GREATEST in __________ studies.

A

quantitative

178
Q

Some business issues are more exploratory in nature, requiring a broad understanding of a situation and introducing decision-makers to the general nature of the market. What type of research is BEST to meet these objectives?

A

Qualitative

179
Q

Clients tell you their products suffer from being seen as old-fashioned and are looking for creative ideas and collaborative efforts to solve the problem. Which would NOT be an effective methodology to recommend?

A

Online survey

180
Q

You need to understand how different hospitals go about their purchase process for radioactive isotopes (a highly specialized product). Neither you nor your client has background knowledge on the topic, which will be needed to inform the next phase of research. Which methodology would be MOST likely to address these objectives?

A

In-depth Interviews

181
Q

True or False: Qualitative research, by itself, does not fulfill business needs. It must be used to inform and guide quantitative research in order for it to have value.

A

False

182
Q

Research that focuses on gaining a holistic understanding of customers’ relationship with a brand or company, including all the “touch points” and “pain points” of contact, is called:

A

Customer experience (CX) research

183
Q

You are conducting analysis and reporting on qualitative research (in-depth-interviews) and want to communicate how frequently participants volunteered a response about a company’s “good service.” How should you present this finding in your report?

A

“Good service” was offered by 5 out of the 10 participants (without being asked about service quality).

184
Q

True or False: Findings from a qualitative study can be generalized to a larger target population if care is taken in sampling and in statistical analysis of the results.

A

False

185
Q

True or False: Focus groups are always to be preferred to In-depth Interviews wherever possible.

A

False

186
Q

True or False: vA contrived or artificial environment may be appropriate for observing participants when their behaviors do not yet exist in the natural environment or when it is not practical to observe the behavior otherwise.

A

True

187
Q

When possible (and practical), qualitative observational researchers usually prefer to observe participants in a __________ environment.

A

natural

188
Q

__________ qualitative research is when all participants and the moderator are engaged in the data collection process at the same time.

A

Synchronous

189
Q

Conducting qualitative research with individuals about sensitive topics can be challenging when participants worry about how others will react to what they share. Which of the following is the LEAST effective solution to address this challenge?

A

Conduct an online video focus group where participants do not disclose their names.

190
Q

You are designing qualitative research and your target population has a very low incidence. The research objectives would benefit most from cross-discussion among participants and being able to observe their non-verbal behavior. What qualitative methodology should you recommend?

A

Online focus group through video chat

191
Q

Regardless of whether you are considering focus groups or IDIs, in-person qualitative research is MORE LIMITED than online and phone qualitative methods with respect to:

A

the geography/markets from which individuals can participate

192
Q

A national, qualitative, in-person study will typically visit a minimum of __________ market(s).

A

two

193
Q

Of the following steps in a qualitative study, which should typically be done BEFORE the others?

A

Finalize the screener so recruiting can begin

194
Q

True or False :Screeners for qualitative research may be administered by traditional telephone interviewing or online via a short screening survey.

A

True

195
Q

True or False: In qualitative screeners, we usually include those employed in advertising and the industry that our project is about, since their expertise may be provide additional insights to our research.

A

False

196
Q

Why are interventions and stimuli used in qualitative research? (SELECT TWO [2] ANSWERS THAT APPLY.)

A

To change the pace of discussion and keep participants interested and engaged.

To help participants express their attitudes and perceptions that may be difficult to articulate otherwise.

197
Q

The most effective discussion guide for qualitative research will have each of the following features EXCEPT:

A

It will mainly include closed-ended questions intended to address business questions such as: What? Who? When? And How many?