Test Construction

Question 0

When is the kappa statistic used and what is it used for?

Answer 0

When the data are nominal or ordinal. Evaluates the consistency of ratings assigned by two raters.

Question 1

The best way to evaluate the reliability of speed tests are…

Answer 1

Test-retest
And
Alternate forms coefficient

Question 2

In factor analysis, rotating the factors does what…

Answer 2

Changes the factor loadings for the variables and eigenvalue for each factor although the total eigenvalues remains the same

Question 3

What value is preferred for the average item difficulty level in order to maximize the test’s reliability?

Answer 3

.5

Item difficulty index range from 0-1 and it indicates the number of examinees who answered the item correctly.

Question 4

Orthogonal rotation versus oblique rotation

Answer 4

Orthogonal - used when variables in a factor analysis are believed to be uncorrelated

Oblique - used when variables in a factor analysis are considered to be correlated

Question 5

A test with limited ceiling would have what shape distribution?

Answer 5

Negatively skewed - bc test would have an inadequate number of difficult items resuming in few low scores.

Question 6

What is an ipsative score?

Answer 6

Report an examinee’s scores using the examinee as a frame of reference. The score indicates the relative strength of a score within an individual.

Question 7

What is an eigenvalue?

Answer 7

Based on factor loadings of all the variables in the factor analysis to a particular factor. Explains variance of one of the factors. When the factor loadings are high, the eigenvalue will be large. A large eigenvalue means that a particular factor accounts or a large proportion of the variance among he variables.