Chapter 14: Generalizing Results Flashcards
College sophomore problem
an issue of non-probability (convenience) sampling; WEIRD (western, educated, industrialized, rich, and democratic)
2 types of generalizability
to other settings/contexts and to other people
Solution for lack of generalization to other experimental settings
standardize interaction between experimenters and participants
High ecological validity
studies that resemble real world
Mundane realism
when the situation resembles something that one would experience in everyday life
Solution to lack of generalization to the real world
find or create DVs and procedures high in mundane realism; include experimental realism; do manipulation checks
Experimental realism
when the setting induces a realistic/impactful experience, even in an artificial setting
Arguments for college sophomore problem
easy to obtain participants; university students come from all over the world (diversity in opinions)
Arguments against college sophomore problem
university students are more likely to be affluent (not representative); restricted age range
Solution to college sophomore problem
collect samples outside of college and statistically analyse whether their responses are different
Replication
repeating a study to see if one observes the same result to increase confidence in that result or demonstrate that it is not systematically observable
2 kinds of replication
direct and conceptual
Direct replication
attempted replication of a study following the same procedures that were used in the original research as closely as possible; to avoid type 1 error
Conceptual replication
attempted replication of past research using different procedures than the original study, such as different DV or manipulation
Goal of conceptual replication
to see if the relationship between variables holds even when you use a different operational definition
