Sample heterogeneity Flashcards
Sample heterogeneity
The greater the variability of the psychological attribute among respondents, the larger the reliability. Meaning
the more heterogenous a variable, the larger the true score variance. Explaining more of the total variance
Reliability generalization studies
Looks at previous studies and their reliability. Eg revealing that all test score acceptable reliability, but that they do vary across studies.
It enables you to identify and understand the ways in whcih sample characteristics effect the reliability of test scores
Difference score
Subtracting initial score form the final score to see subjects’ difference
- Negative means skill decline
- positive improvement
Types of difference scores
Intraindividual: Change score, two scores on same test
intraindividual; Disrepancy score, two measures from different tests
interindividual; giving two people same test, difference betw;.
Difference score reliability
Differece scores are relatively reliabile when the two indvidual tests are relatively uncorrelated
DS will be relatively reliable when the two test produce scores that are themselves reliable
DS reliability will not be higher than the average reliability of the two tests
DS Reliability is much smaller than the reliability of two sets of individual test score