Questionnaire Design and Piloting Flashcards
Which data collected is typically used in analysis? (or mroe importantly, what is NOT collected?)
Final and intermediate outcomes
Covariates to improve precision
Baseline characteristics for sub-group analysis
Compliance, and predictors of compliance
Context and local conditions
Process, implementation
Behavioral responses
NOT Unique IDs, NOT Personally identifiable information
The head of the household is typically…
The head of the household is typically the eldest member of the household. As Marc mentions, the household head isn’t always the best person to provide accurate answers and may not have the knowledge about the topics covered in a survey.
If a survey contains sensitive questions, it’s often best
That gender dynamics between the surveyor and respondent are considered when the surveyors are recruited
We may want to review surveys used in prior research on the specific topic in our discipline because:
We can leverage the thought that went into producing the prior survey
If we use the same questions, we can potentially merge the resulting data sets for meta analysis
Which of the following (set of) questions is most leading? (Choose one)
Do any of your children currently attend school regularly?
Would you be willing to pay for an insecticide-treated bed net? [If yes] How much would you be willing to pay?
How strongly do you agree with the administration’s plan to improve the nation’s health insurance?
How strongly do you agree with the administration’s plan to improve the nation’s health insurance?
The question assumes that the respondent agrees with the administration’s plan to improve health insurance.
The main reason we break a question down into as many components as possible is:
To identify if any word or words may have alternate meanings
Breaking the sentence down, and almost trying to break the intended meaning of the sentence, will help us find many of the pitfalls that could lead to ambiguity.
What problem(s) can you identify with the following question: “In the coming election, do you support Party A and not Party B?”
Double-barreled
Leading question
What problem(s) can you identify with the following question: “Do you not agree that it is not ok to smoke cigarettes?”
Leading question
Use of negatives
Validations, Conditions, or Constraints, are meant to prevent or correct
Illogical responses (such as answering “Red” when a number response is expected)
Quantities that are unrealistic (such as visiting the school 100 times in the past week)
Which of the following is the best reason to start your survey with a module on demographics?
Because demographics are considered less intrusive in some contexts and allow the surveyor to build a rapport with the respondent
The tendency to over-report responses at the beginning of a list of response options is known as:
Primacy effect
Which of the following are context effects (Select all that apply)?
Anchoring Bias Framing Effect Recency Effect Primacy Effect Telescoping Bias
Anchoring Bias
Framing Effect
Recency Effect
Primacy Effect
Telescoping bias is a measurement error.
If a skip pattern is ignored, and questions that should have been skipped are filled out, this is an error of:
Commission
Name some strategies that are used to protect PII
(a) We try to put all of the identifying information or the record information bundle up-front at the beginning, so the page (or pages) can be detached (b) We ensure unique IDs are filled on each page of the survey and (c) Separate the record information bundle from the rest of the survey as soon as possible
What is key in selecting HH for the piloting phase of questionnaire development?
It should not use the same households that are part of the study sample
