Ch 8.1 Test Development Flashcards
1
Q
Test Conceptualization
A
Coming up with an idea for a test
Why is a test needed?
- Existing measures are not good enough
- There are no existing measures (e.g. new medical disease)
- Literature review
2
Q
Norm - referenced
A
- Distinguish between high & low scorers
- Relative standing
- EX: WAIS-IV
3
Q
Criterion - referenced
A
- Distinguish between mastery and non - mastery
- Pass/fail
- Ex: Driver’s license exam
4
Q
Writing Items
A
Need to develop item pool
- Reservoir from which items will be drawn or discarded for the final version of the test
- Twice as many as the final version
5
Q
Where do items come from?
A
- Literature reviews
- Expert opinion
- Personal experience, knowledge
6
Q
Question Interpretation
A
Matching what you think you are asking wo what participants think you are asking
7
Q
Considerations for writing questions
A
-Be careful about eliciting a certain type of response
- Avoid leading questions
- Double barreled questions
8
Q
Rules for writing questions
A
- Follow the rules of communication
- Provide sufficient instructions
- Allow for variability
– Make measurement scale meaningful
– Floor and ceiling effects
9
Q
Survey Formats [placeholder]
A
.
10
Q
Forced Choice
A
Questions require respondents to select from a limited number of answers
11
Q
Categorical Responses
A
- Dichotomous questions
- Nominal response format
- Ordinal responses using rank order
12
Q
Interval level response
A
- Likert scale
- Semantic differential
- Response brackets
- Guttman scale or cumulative
13
Q
Guttman scale or Cumulative
A
- Items range sequentially from weaker to stronger expressions of the construct being measured
14
Q
Open-ended (free or constructed response)
A
- Fill in the blank
- Short answer
15
Q
Filter or contingency questions
A
- Do not ask questions that cannot be answered by all participants
