10 Flashcards

1
Q

10 Steps of Test Development (first 5 in chapter 10)

A

1) defining the testing universe, audience, and purpose
2) Developing a test plan
3) composing the test items
4) writing the administration instructions
5) conducting the pilot test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

1) defining the testing universe, audience, and purpose

A

prepares a working definition of the construct that the test will measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

2) Developing a test plan

A

specifies the characteristics of the test, including an operational definition of the construct and the content to be measured (the testing universe), the format for the questions, and the administration and scoring of the test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

objective test format

A

one response that is designated as “correct”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

one response that is designated as “correct”

A

objective test format

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

subjective test formats

A

do not have a single response that is designated as “correct”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

do not have a single response that is designated as “correct”

A

subjective test formats

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

projective tests

A

subjective test formats because the stimuli for these tests are ambitious pictures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

subjective test formats because the stimuli for these tests are ambitious pictures

A

projective tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

cumulative model of scoring

A

most common method

more the test taker responds in a particular fashion (with either “correct” answers or ones that are consistent with a particular attribute), the more the test taker exhibits the attribute being measured.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

more the test taker responds in a particular fashion (with either “correct” answers or ones that are consistent with a particular attribute), the more the test taker exhibits the attribute being measured.

A

cumulative model of scoring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

categorical model of scoring

A

used to place test takers in a particular group or class

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

used to place test takers in a particular group or class

A

categorical model of scoring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

ipsative model of scoring

A

presented with two to four statements in a forced choice format.

cannot simply add up all the points

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

presented with two to four statements in a forced choice format.

A

ipsative model of scoring

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

pilot test

A

a scientific evaluation of the test’s performance

17
Q

a scientific evaluation of the test’s performance

A

pilot test

18
Q

3) composing the test items

A

some standard item formats, including strengths or weaknesses that may cause test developers to choose or reject them as appropriate formats in various situations.

19
Q

objective items

A

multiple choice
true/false
forced choice

20
Q

multiple choice

A

most often used

includes a question (stem) followed by number of responses one of which is correct, the wrong ones are called distractors

21
Q

most often used

includes a question (stem) followed by number of responses one of which is correct, the wrong ones are called distractors

A

multiple choice

22
Q

true/false

A

steam and direct the test takers to mark each statement one of two answers

guessing can have a large impact on the score

23
Q

steam and direct the test takers to mark each statement one of two answers

A

true/false

24
Q

forced choice

A

choose two or more words or phrases that appear unrelated but are equally acceptable

25
choose two or more words or phrases that appear unrelated but are equally acceptable
forced choice
26
Subjective Items
essay questions interview questions projective techniques sentence completion
27
essay questions
questions are general and require lengthy written responses by test takers
28
questions are general and require lengthy written responses by test takers
essay questions
29
interview questions
general in scope, the person decides what is good or bad
30
general in scope, the person decides what is good or bad
interview quesitons
31
projective techniques
highly ambiguous stimulus elicit an unstructured response from the test taker
32
highly ambiguous stimulus elicit an unstructured response from the test taker
projective techniques
33
sentence completion
finish a sentence
34
finish a sentence
sentence completion
35
complex item formats
``` performance assessments simulations portfolios response bias social desirability acquiesence random responding and faking ```
36
writing effective items
identify item topics by consulting the test plan be sure that each item is based on can important learning objective or topic write items that assess information or skills drawn only from the testing universe write each item in a clear and direct manner use vocabulary and language appropriate for the target audience avoid using slang or colloquial alnaguage make all items independent ask someone else to review items