Reliability And Validity Flashcards
What is reliability?
The consistency of a measuring instrument/results
How is reliability measured?
By assessing:
- inter-rater reliability
- split-half reliability
- test re-test reliability
What is inter-rater reliability?
- the extent to which the is rn agreement between 2 or more raters
- often used for observation research and content analysis
How do you assess inter-rater reliability?
- 2 (or more) observers/laters independently observe/assess/rate the same thing and record their data
- the data from 2 armore laters are compared and correlated
- positive correlation means there’s inter-rater reliability, correlation coefficient of 0.80 or more = good inter-rater reliability
What is split-half reliability measuring?
Measures internal reliability/internal consistency of a measuring instrument
How do you assess split-half reliability?
- Split test in half (first half and second half)
- positive correlation indicates consistency
What is test re-test reliability?
- External reliability
- measures consistency over time/ on different occasions
How do you assess test re-test reliability?
- Same participants complete same test on 2 separate occasions
- positive correlation between first and second testing indicates consistency
Same test + same people= reliability, same test + different people = validity
What is validity?
Whether me research measures what it set out to measure
- measuring room cannot be valid if it isn’t reliable
What is internal validity?
- Whether the researcher rested what may intended to test
- is concerned with what goes on within the study
What factors reduce internal validity?
Observer/researcher bias
Demand characteristics and participant reactivity
Investigator effects
Social desirability bias
Confounding variables
Poorly operationalised behavioural categories
What is external validity?
The extent at which the findings of the study can be generalised beyond the study to:
- other situations (ecological)
- other people (population)
- other cultures (cross-cultural)
- other times (temporal)
What is ecological validity?
Ability to generalise a research effect beyond the particular setting which its demonstrated in another setting
What is mundane realism?
- how a study numbers the real world
- research environment is realistic to experiences in the real world
-Non real it feels for participants
What is temporal validity?
Whether research from one time period can be generalised to another time period