Chapter 6: Writing and Evaluating Tests

Question 1

DeVellis Guidelines for testing:
1 De\_\_\_\_\_ clearly what you want to measure
2 Generate an item po\_\_\_
3 Avoid exceptionally L\_\_\_ items
4 Keep the working sim\_\_\_
5 Avoid dou\_\_\_-bar\_\_\_\_ items 
6 Mix pos\_\_\_\_ and ne\_\_\_\_\_ wording

Answer 1

Define; pool; long; simple; double-barrelled; positive and negative

Question 2

DeVellis Guidelines for testing:
1 De\_\_\_\_\_ clearly what you want to measure
2 Generate an item po\_\_\_
3 Avoid exceptionally L\_\_\_ items
4 Keep the working sim\_\_\_
5 Avoid dou\_\_\_-bar\_\_\_\_ items 
6 Mix pos\_\_\_\_ and ne\_\_\_\_\_ wording

Answer 2

Define; pool; long; simple; double-barrelled; positive and negative

Question 3

The D________ test format offers two alternatives for each item

Answer 3

dichotomous

Question 4

True-False questions are an example of the di______ format of testing

Answer 4

dichotomous

Question 5

The po_______ test format is like the dichotomous format except that each item has more than two alternatives

Answer 5

polytomous test format

Question 6

Incorrect choices in a polytomous test are called d________

Answer 6

distractors

Question 7

The gu______ thr_______ describes the chances that a low-ability test taker will obtain each score

Answer 7

guessing-threshold

Question 8

Negatively worded items must be reversed on L_______ scales,

Answer 8

Likert Scales

Question 9

Does the category test format or the likert scale typically have more question choices?

Answer 9

Category (up to ten choices on a single item)

Question 10

A_______ C_________: a subject receives a long list of adjectives and indicates whether each one is characteristic of himself or herself

Answer 10

Adjective Checklist

Question 11

I____ A______: the methods used to evaluate test items, is one of the most important aspects of test construction

Answer 11

Item Analysis

Question 12

Item analysis involves item dif_______ analysis and item dis________ analysis

Answer 12

difficulty; discriminability

Question 13

For a test that measures achievement or ability, item dif______ is defined by the number of people who get a particular item correct

Answer 13

difficulty

Question 14

“the higher the proportion of people that got the test item right, the ea___ the test (item difficulty)

Answer 14

easier

Question 15

The optimum di______ level for a four-choice test item is approximately .625

Answer 15

Difficulty

Question 16

Item di________ determines whether the people who have done well on particular items have also done well on the whole test

Answer 16

Item discriminability

Question 17

The ex____ gro____ method compares people who have done well with those who have done poorly on a test

Answer 17

extreme groups method

Question 18

I____ Re_____ T_____: each item on a test has its own item characteristic curve that describes the probability of getting each particular item right or wrong given the ability level of each test taker

Answer 18

Item Response Theory

Question 19

A c_______-ref______ test compares performance with some clearly defined criterion for learning

Answer 19

criterion-referenced test