Unit 2 Flashcards
survey strengths
Quick, easy, lots of data
questions addressed in surveys
- Personal, factual questions
- Questions about others
- Factual questions about an entity
- Questions about attitudes and beliefs
- Questions about knowledge
questionnaire strengths
- Cheap, quick convenient
- minimal influence of researcher
questionnaire weaknesses
- Cannot explain questions or instructions.
- No opportunity to probe.
- Questionnaire can be read as a whole.
- Not appropriate for some participants.
- Greater risk of missing data
- Cannot verify who filled out the questionnaire
structured interviews
A data collection method (survey) in which an interviewer asks respondents:
- The same questions
- In the same order
- With the aid of a formal interview schedule
structured interviews strengths
- Promotes standardization in how questions are asked and recorded
- Standardization- reduces response bias, ensures greater accuracy and ease in processing respondents answers
structured interviews weaknesses
-Expensive, time consuming, interviewer may influence respondents answers
standardization
reduces response bias, ensures greater accuracy and ease in processing respondents answers
advantages and disadvantages of online opportunities
- low cost, can be administered many ways
- low responses, skepticism, ruin sample
response errors
- Distortions in survey results
- Caused by participants providing false or inaccurate information
- Keeping the survey short, simple, and anonymous can alleviate many of these errors
Acquiescence
- Respondents’ tendency to agree with researchers’ questions and perspectives.
- Include opposition
Social desirability
- Respondents tendency to align themselves with positive social connotations through their responses to survey questions
- Researchers may make it difficult to determine opinions
lack of interest
- Respondents provide answers just to be done
- Keep survey short
close ended survey questions
- Fixed set of possible answers to choose from
- Must have categories that are both exhaustive and mutually exclusive
- Straightforward
- Clarifies question
- Enhance comparability
open ended survey
-allow respondents to formulate their own answers
Advantages:
-Answer in their own terms
-Unusual responses
-Knowledge and experience comes to foreground
-Facilitate exploration of new areas
Disadvantages:
-Participants may not take the time to respond
-Analysis and coding take time
Linking Questions and Overall Aims
- Every question should have the potential to help answer your research question
- wording driven by topic
word choice in survey questions
- Avoid overly general questions.
- Avoid ambiguous terms.
- Minimize technical terms.
- Spell out abbreviations and acronyms.
- Avoid questions that include negatives
question structure in survey questions
-Avoid double-barreled questions.
-Avoid leading questions.
Ensure symmetry between a closed-ended question and its answers.
-Ensure that the answers provided for a closed-ended question are balanced.
survey questions considerations
- Comprehension of the questions
- Memory and requisite knowledge
- Motivation to answer honestly
fence sitters
people who do not have storms feelings on an issue but will choose a side if that is their only option
floaters
people who usually choose don’t know if it is an option
survey question order
- Most important questions should come early
- Embarrassing questions should come later
- Related questions should be grouped together
- Question order should be the same for all respondents
unintended consequences of survey question order
contrast and assimilation effects
contrast effects
question order causes a larger difference between responses than they would have otherwise
assimilation effects
question order causes responses to be more similar than they would have otherwise
tips for structured interviews
- Know and stick to schedule
- Introduce research
- Record answers
- Probe for more information of clarification
- Prompt as a last resort
testing survey quality
pilot studies and pretesting questions
pilot studies
smaller scale studies conducted before collecting the data.
The sample does not overlap with the full study sample
pretesting questions
conducted either during a pilot study or by sharing questions with colleagues. Ensures quality of questions
Trust in Science agencies
- survey about trust in CDC and political parties
- trust in science has changed over time
- more dramatic in some political groups than others
qualitative interviews
- good for detailed information, document peoples experiences
- help understand how people make meaning and understand their perspectives
- Flexible, low cost, open ended
unstructured interview
- free form and conversational qualitative interview
- No predetermined questions or order
Semi Structured interview
- use a detailed interview guide, but can add unique probes or change the order of the questions
- Can do more interviews
life history interview
nterviewee is asked to report life experiences and their understanding of events across their entire life course
oral history interview
asked to reflect on certain events or eras
prepping for an interview
-goals, topics, questions
writing interview questions
-Ask questions to spark conversation -Use “why” (sparingly) -Use probes -Ask a final question: “is there anything you would like to add?” -don't Ask leading questions -don't Ask double-barreled questions -don't Ask factual questions -don't Ask yes/no questions
interview question types
- Introducing questions
- Follow-up questions
- Probing questions
- Specifying questions
- Direct questions
- Indirect questions
- Structuring questions or statements
- Silence
- Interpreting questions
writing an interview guide
- Ensure the interview questions are aligned with your research question
- Order questions in a logical but flexible manner
- Use familiar, casual language
- Avoid judgments and leading questions
- Include prompts to record contextual information
interview considerations
- Become familiar with the interviewee’s situation and environment.
- Prepare any necessary technology.
- Choose an appropriate location.
- Communicate important details.
- Prepare the paperwork.
- Develop good interview habits
interviewer effects
-gender and anticipated opinions matter
rapport
- establishing trust with interviewee
- too much can be bad