Week 10 Reliability and validity Flashcards
What is reliability?
The consistency of measurements, or of an individual’s performance on a test; or the absence of measurement error
What are the two types of error?
Systematic and random
What is systematic error?
Consistent error which biases the true score
What is random error?
Unpredictable error which biases the true score
What are the types of reliability?
Relative and absolute
What is relative reliability?
The degree to which data maintain their position in a sample with repeated measurements
What is absolute reliability?
The degree to which repeated measurements vary for individuals
What are the tests for reliability?
Retest reliability
Inter-rater reliability
Internal consistency
How does retest reliability test reliability?
Test stability in measurements across two tests
How does Inter-rater reliability test reliability?
Correlate the scores with data obtained from different researchers
How does internal consistency test reliability?
Reliability across different parts of a measurement instrument (questionnaire sub-scale)
Does correlation infer agreement and provide an example?
No
A perfect positive correlation exists between an expensive
laboratory body fat analyser & a cheap ‘home use’ analyser but they calculate different BF%
What are the measures of absolute reliability?
Technical error of measurement
Standard error of measurement
Coefficient of variation
Limits of agreement
What is validity?
The extent to which a test or instrument measures what i is supposed to measure
What are the types of validity of measurements?
Face validity
Content
Construct validity
Criterion (concurrent and predictive validity)