Measurement, reliability + Validity Flashcards
Why is it important for psychologist to quantify everything?
- is a defining principle of science = measurement
- can be objectively obtained
- publicly available
- potentially checkable by others
What are the requirements for measurements?
- reliable = can be reproduced
- valid = actually measuring what we think it is measuring
What are the different levels of measurements?
- Nominal
- Ordinal
- Interval
- Ratio
Describe nominal level of measurement
- categorical. frq data
- when numbers are used as names (eg footballer numbers)
- All you can do is count how often each number occurs
Describe ordinal level of measurement
- numbers used as ranks
eg: order of finishing a race
Describe interval level of measurement
- scale with equal interval between points on a scale
- no true zero point
eg: IQ
Describe ration: level of measurement
- measurements made on a scale with equal interval between points on the scale
- scale has TRUE 0 point
Eg: reaction time, error scores
What is reliability?
- does it give consistent/ reproducible results?
Error in reliability may be due to….?
- natural phenomena variation
- -> within/ between individuals
- imprecision in defining + measuring psychological constructs
- -> what exactly is aggression?
What are different measures of reliability?
- Test-retest: time to time
- Alternate forms: version to version
- Split-half: item to item
- Inter-scorer: person to person
What factors affect reliability?
- phenomena itself
- -> trait vs state?
- Precision of measurements
- Sample size
- Variability in performance
- -> High > low
- Format of test:
- -> MCQ of 5Q = 25% correct by chance > than ….
- -> True/ False = 50% correct by chance
What is the replication crisis?
- many well-known findings aren’t that reliable
- -> small sample size
- -> Exact replication are rare
- -> “file drawer problem”
What is the “file drawer problem”?
- hard to get replication failures published
What are some solution to the replication crisis?
- replications
- Metal-analysis
- Converging operations = tackling problem with different methods, by different research groups
What are the 10 frq cited findings that have failed to replicate as found by Jarrett in 2016?
- power-posing
- Smiling = happier
- exposure to age related words = slower walk (x social priming)
- Babies are born with the power to imitate adults