Test construction (Item Analysis) Flashcards
An item analysis is conducted to determine which items to retain in the final version of a test. An item difficulty index (p) is calculated by dividing the number of examinees who answered the item correctly by the ______
total number of examinees
item difficulty index (p) ranges in value from ______
0 to 1.0
In general, an item difficulty level of _____ is preferred because it not only maximizes ____ between examinees of ow and high ability but also helps ensure that the test has high ________
0.50; discrimination; reliability
The optimal difficulty level is affected by the probability that an examinee can answer the item correctly by guessing. For this reason, the optimal p value for true/false items is ____
0.75
An ______ index (D) is calculated by subtracting the percent of examinees in the lower-scoring group from the percent of examinees in the upper-scoring group who answered the item correctly. It ranges in value from ______
item discrimination; -1.0 to +1.0
Advantages of item response theory (IRT_ are that item parameters are ______ invariant and performance on different sets of items or tests can be easily ________
sample; equated
use of IRT involves deriving an item _____ for each item that provides information on one, two, or three parameters –i.e., difficulty, discrimination, and ________
characteristic curve; probability of guessing correctly
Content appropriateness, taxonomic level, and extraneous abilities are factors that are considered when evaluating:
the relevance of test items
For an achievement test item that has an item discrimination index (D) of +1.0, you would expect:
high achievers to be more likely than low achievers to answer the item correctly.
The item difficulty index (p) ranges in value from:
0 to +1.0.
The optimal item difficulty index (p) for items included in a true or false test is:
.75
The slope (steepness) of an item characteristic curve indicate’s the item’s:
discrimination
