identifying & avoiding biases Flashcards
sampling bias
A sample that does not accurately represent the population
confirmation bias
The tendency to look for or interpret information that supports one’s pre-existing
beliefs
social desirability bias
Respondents answer in ways that they believe are more socially acceptable or
favorable
self-selection bias
occurs when participants choose whether or not to participate, often resulting in
an unrepresentative sample.
overgeneralization
Drawing broad conclusions from limited data
why can confirmation bias be particularly problematic in sociological research
worsen social exclusion and tensions (ex. in-group bias)
example of social desirability bias and a strategy for reducing it in surveys
asking someone “Do you always recycle?” where they might answer “yes” even if they don’t consistently recycle. you could use indirect questioning like “How often do you think most people in your neighborhood recycle? which may lead to more reliable answers as its not their own behavior
How does self-selection bias threaten the representativeness of a sample?
- individuals more interested in a study’s topic are more likely to join
- skewed sample; makes your sample unrepresentative of your population of interest
what research practices help mitigate overgeneralization?
Use Representative Sampling
Increase Sample Size
Use Mixed Methods
Clearly Define the Target Population
Use Replication Studies
Apply Rigorous Data Analysis
Acknowledge Study Limitations
Use Peer Review and Expert Feedback
selective observation
- Noticing only social patterns that one has experienced directly or wishes to find
Confirmation bias
nonrespondents
Individuals who decline to answer questions for a survey or in-depth interview or who cannot be reached by researchers
nonresponse bias
When respondents and nonrespondents differ in important ways, which means that the relevant characteristics observed in the sample differ from those in the target population
self-selection bias
- When certain types of people are more likely to volunteer for (or be selected into) a sample
Ex. people with strong opinions on an issue may be more likely to participate in a study
attrition bias
When the participants who leave a study tend to come from particular subgroups, thereby undermining the representativeness of the study’s sample