Ch. 15 Flashcards
Integrator reliability
Two or more individuals should make an observation or one observer should examine the behavior on more than one occasion
Validity
Measure accurately = does the instrument measure what it claims to measure?
Content validity
Criterion related, construct
Concurrent validity
Degree of correlation between two measures
Predictive validity
Measure of concept and some future measure of the concept
Face validity
Refers to expert verification that the instrument measures correctly
Construct validity
Test measures a theoretical construct or trait
Divergent validity
Differentiates one construct from others that are similar
Reliability
Measure consistently
Stability
Homogeneity or internal consistency, equivalence
Reliability coefficient
Measures the relationship between error variance, true variance, and the observed score
Parallel reliability
Using two comparable forms of an instrument to test the same concept
Integrator reliability
Two or more investigators are collecting data
Kappa level of 0.9 is good
A measure can be considered to be reliable while…
Unlikely found to be valid
Error variance
The differences in scores between actual measurement of behavioral changes and thee extent of variability in test scores
Chance error
Variability of scores due to random confounding variables
Test score
Error variance plus the true score
Constant error
Answering in a socially desirable way (validity effected)
Chronbachs alpha
Most common test to study validity
Measures the homogeneity of an instrument with a like-type format
Split half
Provides a measure of consistency in terms of sampling the content
KR-20
Estimate of homogeneity used for instruments that have a dischotomous response format (yes/no)
Coefficient of 0.1 shows no correlation among the error variance, true variance or observed variance
Equivalence
Consistency or agreement among observers using the same measurement instruments
Parallels or alternate form
Test-retest
Test of stability
The lower the coefficient the lower the correlation
Does not prove measurement error