test construction 2 Flashcards
What is the range of p values (Item difficulty index)?
a. -1.0 to 1.0
b. 0 to 2.0
c. 0 to 1.5
d. 0 to 1.0
d
How to calculate the item difficulty index
p= Total number of Examinees passing the item/Total number of Examinees
What does a larger p value indicate?
a. better reliability
b. easier items
c. better item discrimination
d. harder items
b
In most situations, a p value of _____ is optimal. One exception is the case of a true/false test, for which the optimal p value is ____.
.50; .75
This refers to the extent to which a test item is able to differentiate between examinees who obtain high versus low scores on the entire test or on an external criterion.
Item discrimination
The item discrimination index ranges from:
a. -1.0 to 1.0
b. 0 to 2.0
c. 0 to 1.5
d. 0 to 1.0
a
For most tests, an item with a discrimination index of ____ or higher is considered acceptable.
.35
If all examinees in the upper group and none in the lower group answered the item correctly, D is equal to _____.
1.0
If none of the examinees in the upper group and all examinees in the lower group answered the item correctly, D equals _____.
-1.0
Test construction is usually based on one of two theories:
classical test theory
item response theory
Advantages of item response theory are that item parameters are sample invariant and performance on different sets of items or tests can be easily __________. Use of IRT involves deriving an ____________________________ for each item.
equated; item characteristic curve
Whenever we administer a test to examinees, we would like to know how much of their scores reflects “truth” and how much reflects error. It is a measure of ________ that provides us with an estimate of the proportion of variability in examinees’ obtained scores that is due to true differences among examinees on the attributes measure by the test. when a test is ________, it provides dependable, consistent results.
Reliability; reliable
Most methods for estimating reliability produce a reliability coefficient, which is a correlation coefficient that ranges in value from:
a. -1.0 to 1.0
b. 0 to 2.0
c. 0 to 1.5
d. 0 to 1.0
d
When a test’s reliability coefficient is 0.0, this means that all variability in obtained test scores is due to __________________.
measurement error
When a test’s reliability coefficient is +1.0, this indicates that all variability in scores ______________.
reflects true score variability
A reliability coefficientt of .84 indicates that ____% of variability in scores is due to true score differences among examining, while the remaining _____% is due to measurement error.
84; 16
This method for estimating reliability involves administering the same test to the same group of examinees on two different occasions and then correlating the two sets of scores.
a. Alternate forms reliability
b. Test-retest reliability
c. Split-half reliability
d. Inter-rater reliability
b
An ______________ coefficient is calculated by administering two equivalent forms of a test to the same group of examinees and correlating the two sets of scores.
a. Alternate forms reliability
b. Test-retest reliability
c. Split-half reliability
d. Inter-rater reliability
a
The test-retest reliability coefficient is also known as the coefficient of ____________.
stability
The alternate forms reliability coefficient is also referred to as the coefficient of ______________.
equivalence (and stability)