Unit 10: Rigour in Research (Reliability + Validity) Flashcards
Reliability
The consistency and stability of the measuring instrument
Observed Score
True score + Measurement Error
Trait Error
From participants
Method Error
From Researchers
Test/Retest
Repeat test with same sample and assess consistency
Alternate Forms
2 Equal but different tests
ex. MCAT, LSAT
Inter-Rater Agreement
Agreement of observation between two or more researchers
Most Common
# of agreements / # of possible agreements
Factors affecting reliability:
- Method of scoring
- Heterogeneity of group
- Administration procedures
Factors affecting reliability:
- Method of scoring
- Heterogeneity of group
- Administration procedures
Validity:
Does the test measure what it claims to measure? Truthfulness
Validity:
Does the test measure what it claims to measure? Truthfulness
5 Types of validity:
- Internal
- External
- Criterion
- Construct
- Ecological
5 Types of validity:
- Internal
- External
- Criterion
- Construct
- Ecological
Does the test parallel the real world? Do the results extend to predictions of the outside world?
External
Does the test parallel the real world? Do the results extend to predictions of the outside world?
External