Test Construction

Question 1

Question ID #1402: Researchers are interested in detecting differential item functioning (DIF). Which method would not be used?
Select one:
A. SIBTEST
B. Mantel-Haenszel
C. Lord's chi-square  
D. cluster analysis

Answer 1

D

Question 2

Question ID #1383: In the multitrait-multimethod matrix, a large heterotrait-monomethod coefficient would indicate:
Select one:
A. low convergent validity.
B. high convergent validity.
C. high divergent validity.  
D. low divergent validity.

Answer 2

D

Question 3

Question ID #1391: Different regression line slopes in a scatterplot suggests:
Select one:
A. differential validity
B. a lack of factorial validity
C. divergent validity
D. a lack of convergent validity

Answer 3

A

Question 4

Question ID #1373: The reliability statistic that can be interpreted as the average of all possible split-half coefficients is
Select one:
A. the Spearman-Brown formula.  
B. Cronbach's coefficient alpha.
C. chi-square.
D. point-biserial coefficient.

Answer 4

B

Question 5

Question ID #1399: A company wants its clerical employees to be very efficient, accurate and fast. Examinees are given a perceptual speed test on which they indicate whether two names are exactly identical or slightly different. The reliability of the test would be best assessed by:
Select one:
A. test-retest
B. Cronbach's coefficient alpha
C. split-half  
D. Kuder-Richardson Formula 20

Answer 5

A

Question 6

Question ID #1389: A researcher employs multiple methods of measurement in an attempt to increase reliability by reducing systematic error. This strategy is referred to as:
Select one:
A. calibration  
B. intraclass correlation (ICC)
C. triangulation
D. correction for attenuation

Answer 6

C

Question 7

Question ID #1412: Cluster analysis would most likely be used to
Select one:
A. construct a “taxonomy” of criminal personality types.
B. obtain descriptive information about a particular case.
C. test the hypothesis that an independent variable has an effect on a dependent variable.
D. test statistical hypotheses when the assumption of independence of observations is violated.

Answer 7

A

Question 8

Question ID #1396: The purpose of rotation in factor analysis is to facilitate interpretation of the factors. Rotation:
Select one:
A. alters the factor loadings for each variable but not the eigenvalue for each factor
B. alters the eigenvalue for each factor but not the factor loadings for the variables
C. alters the factor loadings for each variable and the eigenvalue for each factor
D. does not alter the eigenvalue for each factor nor the factor loadings for the variables

Answer 8

C

Question 9

Question ID #1394: Which of the following techniques would be most useful for combining test scores when poor performance on one test can be offset by excellent performance on another:
Select one:
A. multiple baseline
B. multiple hurdle  
C. multiple regression
D. multiple cutoff

Answer 9

C

Question 10

Question ID #1385: When seeking results that would be sensitive to the \_\_\_\_\_\_\_\_\_\_\_\_\_ of the test-taker, test-retest reliability would need to be the highest.
Select one:
A. maturity  
B. mood
C. aptitude
D. gender

Answer 10

D

Question 11

Question ID #1397: Differential prediction is one of the causes of test unfairness and occurs when:
Select one:
A. members of one group obtain lower scores on a selection test than members of another group, but the difference in scores is not reflected in their scores on measures of job performance
B. a rater’s knowledge of ratees’ performance on the predictor biases his/her ratings of ratees’ performance on the criterion
C. a predictor’s validity coefficient differs for different groups
D. a test has differential validity

Answer 11

A