PROCTOR EXAM 1 - Quantitative Data Collection Methods Flashcards
Telephone
Interviews which are conducted person-to-person, via the telephone.
Interviews which are conducted person-to-person, via the telephone.
Achieving a good response rate is a combination of two main factors, interviewer skill and good fieldwork practice.
Computer Assisted Telephone Interview CATI - Telephone research
Computer Assisted Telephone Interview CATI - Telephone research
Dialers (automatic dialing systems machines) are often employed by telephone centers to dial the telephone numbers and route the answered call to an available interviewer
Dialers (automatic dialing systems machines) are often employed by telephone centers to dial the telephone numbers and route the answered call to an available interviewer
TELEPHONE
PROS
*Sample control: efficiency - telephone ownership (landline, cell or VOIP) is almost universal, there are no geographical restrictions.
Sample control: sample frames - RDD (Random Digit Dialing) including mobile phone numbers makes frame errors potentially close to zero.
Field force control - interviewers can be supervised and monitored in real time.
Speed - large number of interviewers employed on a project can complete reasonably large samples relatively quickly.
Sensitive information - interview is reasonably anonymous and perception is that nothing is being committed to over the phone.
Low incidence rate - large numbers of screening calls can be made with reasonable efficiently and at relatively low cost.
TELEPHONE
PROS
*Sample control: efficiency - telephone ownership (landline, cell or VOIP) is almost universal, there are no geographical restrictions.
Sample control: sample frames - RDD (Random Digit Dialing) including mobile phone numbers makes frame errors potentially close to zero.
Field force control - interviewers can be supervised and monitored in real time.
Speed - large number of interviewers employed on a project can complete reasonably large samples relatively quickly.
Sensitive information - interview is reasonably anonymous and perception is that nothing is being committed to over the phone.
Low incidence rate - large numbers of screening calls can be made with reasonable efficiently and at relatively low cost.
TELEPHONE
CON
Diversity of questions/flexibility - restricted by participant’s ability to remember the answer choices or do the task. Ranking exercises and ‘single choice from many’ are impossible.
Physical stimuli - cannot be used except in a multi-stage project (recruit – mail out – recall).
Quantity of data - participant can break off the survey relatively easily; telephone interviews require concentration and are tiring, therefore data quality will deteriorate with long interviews due to satisficing.
Response rate - is becoming a problem due to sugging and frugging by non-research organizations and increased screening of calls via caller ID.
Participant control - the interviewer dictates the pace and the timing (at least of the initial contact).
TELEPHONE
CON
Diversity of questions/flexibility - restricted by participant’s ability to remember the answer choices or do the task. Ranking exercises and ‘single choice from many’ are impossible.
Physical stimuli - cannot be used except in a multi-stage project (recruit – mail out – recall).
Quantity of data - participant can break off the survey relatively easily; telephone interviews require concentration and are tiring, therefore data quality will deteriorate with long interviews due to satisficing.
Response rate - is becoming a problem due to sugging and frugging by non-research organizations and increased screening of calls via caller ID.
Participant control - the interviewer dictates the pace and the timing (at least of the initial contact).
TELEPHONE (GLOBAL) Mobile subscribers, in many developing countries, outnumber fixed line subscribers.
TELEPHONE (GLOBAL) Mobile subscribers, in many developing countries, outnumber fixed line subscribers.
Telephone is well suited to B2B interviewing, since it is a natural medium for most business target audiences. Often, however, the biggest challenge in B2B is finding the correct person to interview within the organization. This is more easily done by telephone than by other methods.
Telephone is well suited to B2B interviewing, since it is a natural medium for most business target audiences. Often, however, the biggest challenge in B2B is finding the correct person to interview within the organization. This is more easily done by telephone than by other methods.
Ethical Considerations
Abiding by any local ethical guidelines, interviewers need to be prepared and able to tell participants where their telephone number has been obtained, the nature and purpose of the research, and in some cases be able to point the participant to a third party who will be able to confirm the legitimacy of the research company.
Ethical Considerations
Abiding by any local ethical guidelines, interviewers need to be prepared and able to tell participants where their telephone number has been obtained, the nature and purpose of the research, and in some cases be able to point the participant to a third party who will be able to confirm the legitimacy of the research company.
Response Rate Considerations
Achieving a good response rate is a combination of two main factors, interviewer skill and good fieldwork practice.
Response Rate Considerations
Achieving a good response rate is a combination of two main factors, interviewer skill and good fieldwork practice.
Quantitative Observation
simple counting of the
prevalence of an attribute.
Quantitative Observation
simple counting of the
prevalence of an attribute.
Quantitative Observation
Mystery shopping , where the observer (‘ shopper ‘) poses as a customer to assess quality of service and standards compliance, is a form of Observational research.
Quantitative Observation
Mystery shopping , where the observer (‘ shopper ‘) poses as a customer to assess quality of service and standards compliance, is a form of Observational research.
Observation research , like
passive measurement, gets
away from the problem of
awed recall by counting actual behavior, occurring in its natural setting.
Observation research , like
passive measurement, gets
away from the problem of
awed recall by counting actual behavior, occurring in its natural setting.
Observation is not constrained by sampling, survey design or analysis issues. The observer simply sets up and counts.
Observation is not constrained by sampling, survey design or analysis issues. The observer simply sets up and counts.
Observers may also unwittingly impart an ‘observer bias’ if they are asked to make judgments about those they observe.
Observers may also unwittingly impart an ‘observer bias’ if they are asked to make judgments about those they observe.
B2B CONSIDERSATION OBSERVATIONAL
Businesses may also be less than enthusiastic about opening their procedures up to scrutiny from what may very well be a competitor.
B2B CONSIDERSATION OBSERVATIONAL
Businesses may also be less than enthusiastic about opening their procedures up to scrutiny from what may very well be a competitor.
Question Diversity and Flexibility: More complex question types can be undertaken when there is an
interviewer present to help explain the task or when the questionnaire is visible to the participant.
Questionnaires may become more complex if intricate routing and survey logic is required.
Question Diversity and Flexibility: More complex question types can be undertaken when there is an
interviewer present to help explain the task or when the questionnaire is visible to the participant.
Questionnaires may become more complex if intricate routing and survey logic is required.
Physical Stimuli: The need for this can range from the most basic (a visual representation), to touch and possibly also to smell and taste.
Physical Stimuli: The need for this can range from the most basic (a visual representation), to touch and possibly also to smell and taste.
Sample Control: Defined as the ability of the method to reach the participants specified by the sample
definition. It can be broken down further into three useful components:
Theoretical Coverage: Is it possible, in theory, to reach all potential participants?
Sample Frames: To what extend do the lists you have available to you reduce the actual coverage?
Efficiency: Can the above two factors be mitigated by greater efficiency—the ease with which
qualifying participants can be found?
Sample Control: Defined as the ability of the method to reach the participants specified by the sample
definition. It can be broken down further into three useful components:
Theoretical Coverage: Is it possible, in theory, to reach all potential participants?
Sample Frames: To what extend do the lists you have available to you reduce the actual coverage?
Efficiency: Can the above two factors be mitigated by greater efficiency—the ease with which
qualifying participants can be found?
Quantity of data: How much information can be gathered will depend on the interest level the participant has
in the subject, how engaging the task is, and the ease with which the interview can be abandoned once
started.
Quantity of data: How much information can be gathered will depend on the interest level the participant has
in the subject, how engaging the task is, and the ease with which the interview can be abandoned once
started.
Response Rate The majority of non-response in interviewed methods is made up of refusal and ‘not-at-
home’. Refusal can be reduced by actions taken by an interviewer (persuasion and follow-up/re-
contact). Not-at-home is reduced by repeated contacts at different times and days. In non-
interviewed methods the reasons for non-refusal are merely conjecture, non-response is reduced
through use of reminders
Response Rate The majority of non-response in interviewed methods is made up of refusal and ‘not-at-
home’. Refusal can be reduced by actions taken by an interviewer (persuasion and follow-up/re-
contact). Not-at-home is reduced by repeated contacts at different times and days. In non-
interviewed methods the reasons for non-refusal are merely conjecture, non-response is reduced
through use of reminders
Situational factors related to the practical aspects of the project plus budget & time constraints
Situational factors related to the practical aspects of the project plus budget & time constraints
Environment: The situation the participant is in, both in terms of physical and psychological comfort and how conducive it is for concentrating on the survey and tasks.
Environment: The situation the participant is in, both in terms of physical and psychological comfort and how conducive it is for concentrating on the survey and tasks.
Field Force Control: How easy it is to monitor and check the work done by interviewers, either in the selection
of participants or in administering the survey itself.
Field Force Control: How easy it is to monitor and check the work done by interviewers, either in the selection
of participants or in administering the survey itself.
Interviewer Bias: The extent to which the interviewer, however unwittingly, conveys his or her own opinion
and thus suggests an answer which the participant is biased to agree with.
Interviewer Bias: The extent to which the interviewer, however unwittingly, conveys his or her own opinion
and thus suggests an answer which the participant is biased to agree with.
Speed and Cost: In data collection, speed is normally measured from the moment the survey questionnaire is
fully programmed and ready to be used for interviewing to the point where data processing and
tabulation can be done.
Speed and Cost: In data collection, speed is normally measured from the moment the survey questionnaire is
fully programmed and ready to be used for interviewing to the point where data processing and
tabulation can be done.
Participant factors related to the participants, who they are & how they will react to the survey
Participant factors related to the participants, who they are & how they will react to the survey
Perceived Anonymity: The extent to which the participant feels the interviewer or researcher will not know who they are.
Perceived Anonymity: The extent to which the participant feels the interviewer or researcher will not know who they are.
Social Desirability Bias: The tendency of participants to give answers that are socially acceptable whether or not they are true.
Social Desirability Bias: The tendency of participants to give answers that are socially acceptable whether or not they are true.
Sensitive Information: Surveys may require asking for information that participants consider highly personal, confidential, or otherwise sensitive.
Sensitive Information: Surveys may require asking for information that participants consider highly personal, confidential, or otherwise sensitive.
Low Incidence Rate: How hard it is to find a qualifying participant will affect both project speed and cost.
Low Incidence Rate: How hard it is to find a qualifying participant will affect both project speed and cost.
Participant Control: The extent to which the participant is in control of the survey-taking experience, when it
is done, and the speed at which it is completed.
Participant Control: The extent to which the participant is in control of the survey-taking experience, when it
is done, and the speed at which it is completed.
Quality control check: This should be reviewed as soon as possible. In face-to-face and telephone projects a proportion of participants may be re-contacted to verify that that the interview actually took place and to confirm key pieces of information.
In online projects quality control checks will often be built into the survey itself (i.e., checking for excessive speed).
Quality control check: This should be reviewed as soon as possible. In face-to-face and telephone projects a proportion of participants may be re-contacted to verify that that the interview actually took place and to confirm key pieces of information.
In online projects quality control checks will often be built into the survey itself (i.e., checking for excessive speed).
Fieldwork control: Review quota achievement and anticipate any problems that may impact timings for project delivery. If
possible, listen in to some interviews or accompany an interviewer into the eld. This nuance can be added to the analysis.
Fieldwork control: Review quota achievement and anticipate any problems that may impact timings for project delivery. If
possible, listen in to some interviews or accompany an interviewer into the eld. This nuance can be added to the analysis.
Partial data review: Review any questions that impact costs to client – typically incidence rates and interview lengths. Act
quickly should the need arise.
Partial data review: Review any questions that impact costs to client – typically incidence rates and interview lengths. Act
quickly should the need arise.
Passive Research
Within primary data collection, where the survey is designed specifically for the current research question, passive data collection covers all instances where no questions are asked and yet data is being deliberately collected.
Passive Research
Within primary data collection, where the survey is designed specifically for the current research question, passive data collection covers all instances where no questions are asked and yet data is being deliberately collected.