Reliability Flashcards
From the perspective of__test theory, variability in test scores reflects two factors: true differences between examinees on the attribute measured by the test and differences due to___.
classical; measurement error(random error)
Reliability is a measure of the amount of variability in obtained test scores that is due to___variability.
true score
A test’s reliability is commonly estimated by calculating a reliability coefficient which is a type of___coefficient. The reliability coefficient ranges in value from ____and is interpreted directly as a measure of____variability.
correlation; 0 to +1.0; true score
For example, if a test has a reliability coefficient of .91 this means that___% of variability in obtained test scores is due to__-variability while the remaining 9% reflects___.
91; true score; measurement error
Test-restest reliability is assesed by administering a test to the same group of examinees at 2 different____and then___the 2 sets of scores.
times; correlating
The test-restest reliability coefficient is also known as the coefficient of____.
stability
An alternate forms reliability coefficient is calculated by administering 2___of a test to the same grooup of examinees and correlating the two sets of scores. The alternate forms reliability coefficient is also referred to as the coefficient of___.
equivalent forms; equivalence(and stability)
To assess internal consistency reliability a test is administered once to a single group of examinees. A___reliability coefficient is calculated by splitting the test in half and correlating examinees’ scores on the two halves.Because the size of a reliability coefficient is affected by test length the split-half method tends to____a test’s true reliability.Consequently,the___formula is often used in conjunction with split-half reliability to obtain an estimate of what the test’s true reliability is.
split-half; underestimate; Spearman-Brown
Coefficient____another method used to assess internal consistency reliability indicates the average inter-item consistency rather than the consistency between two halves of the test. The Kuder-Richardson Formula 20 can be used as a substitute for coefficient alpha when test items are scored____.
alpha; dichotomously
Split-half reliability, coefficient alpha, and KR-20 are not appropriate for speed tests because they tend to___the reliability of these tests.
overestimate
Inter-rater reliability should be assessed whenever a test is___scored.
subjectively
The scores assigned by different raters can be used to calculate a ___coefficient or to determine the percent agreement between raters. A problem with this approach is that the resulting index of reliability can be artificially inflated by the effects of____.
correlation(reliability); chance agreement
The magnitude of a reliability coefficient is affected by several factors. In general, the longer a test, the___its reliability coefficient.
larger
The__formula is used to estimate the effects of lengthening or___a test on its reliability coefficient.
Spearman-Brown; shortening
If the new items do not represent the same content domain as theoriginal items or are more susceptible to measurement error, the Spearman-Brown formula is likely to___the effects oflengthening the test.
overestimate
Like other correlation coefficients, the reliability coefficient is affected by the range of scores: The greater the range, the___the reliability coefficient.
larger
To maximize a test’s reliability coefficient the sample of examinees should include people who are____with regard to the attribute(s) measured by the test.
heterogeneous
A reliability coefficient is also affected by the probability that an examinee can select the correct answer to a testquestion simply by guessing. The easier it is to guess the correct answer the___the reliability coefficient.
smaller
While the reliability coefficient is useful for assessing the amount of variability in test scores that is due to___variability for a group of examinees, it does not directly indicate how much we can expect an individual examinee’s obtained score to reflect his or her true score.
true score;
The standard error of___is useful for this purpose. It is calculated by multiplying the standard deviation of the test scores by the___of one minus the reliability coefficient.
measurement; square root
For example, if a test’s standard deviation is 10 and its reliability coefficient is .91 the standard error of measurement is equal to____.
3
The standard error of measurement is used to construct a___interval around an examiner’s obtained (“measured”) score.
confidence
