Reliability

Question 1

The _____ is the ratio of the variance of the true scores on a test to the variance of the observed scores,

Answer 1

reliability coefficient

Question 2

The _____ occurs when the first testing session influences scores from the second session. For example, test takers sometimes remember their answers from the first time they took the test. When there are carryover effects, the test–retest correlation usually overestimates the true reliability

Answer 2

carryover effect

Question 3

_____ are one important type of carryover effect. Some skills improve with practice. When a test is given a second time, test takers score better because they have sharpened their skills by having taken

Answer 3

Practice effects

Question 4

you can apply the _____ formula, which allows you to estimate what the correlation between the two halves would have been if each half had been the length of the whole test.

Answer 4

Spearman-Brown

Question 5

The _____ statistic is the best method for assessing the level of agreement among several observers. The _____ statistic was introduced by J. Cohen (1960) as a measure of agreement between two judges who each rate a set of objects using nominal scales.

Answer 5

kappa