chapter 4 Flashcards
**error
It means that there will always be some inaccuracy in our measurements*
reliable
Tests that are relatively free of measurement error are considered
**Charles Spearman
actually worked out most of the basics of contemporary reliability theory, and published it in 1904 in the American Journal of Psychology.
-Thorndike’s book An Introduction to the Theory of Mental and Social Measurements (1904),
bell-shaped
**The distribution of random errors is normal,
*Standard error of measurement
is the standard deviation of the error scores (X-T) around the true score (T).
Item Response Theory:
An individual receives items on a test such as an IQ test based on previous correct or incorrect items
Models of Reliability
Federal government guidelines require that a test be reliable before one can use it to make employment or educational placement decisions*
Test reliability is usually estimated in one of three ways:
Test-retest method
Parallel Forms method
Internal Consistency method (half and half with items)
Test-Retest Method
Only applies to measures ofstable traits*—but some important things one might measure change over time.
There can be a “carry-over effect”
not stable -test retest method
a low correlation between scores on two administrations could mean that the characteristic under study
Spearman-Brown formula**
Where r is correlation
r = 2r
1 + r
**All measures of internal consistency evaluate
the extent to which the different items on the test measure the same ability or trait (or the same construct-idea)
kappa statistic
is the *best method** for estimating interrater reliability-dntk
The Kappa statistic indicates
the actual agreement as a proportion of potential agreement following a correction for chance agreement.
**Standard Error of Measurement
is an estimate of the degree to which a test provides inaccurate readings