Test specification Flashcards
1
Q
What are the steps to developing a measure?
A
- Overall goal & pre-planning
- Content definition
- Test specification
- Item development
- Test design and assembly
- Test production
- Test administration
- Scoring responses
- Establishing passing scores
- Reporting results
- Item banking
- Test technical report
2
Q
What is test specification, and what does it describe?
A
- A test specification is the test blueprint.
- Test specifications should describe:
1. Test format
2. Item format
3. Test length
4. All the content areas of the construct(s) tested
5. Whether items or prompts will contain visual stimuli
6. How test scores will be interpreted.
7. Time limits.
3
Q
What are some things to consider when deciding on how participants will demonstrate their skills?
A
- Selected response (E.g. likert scale, mcq, dichotomous)
- Constructed response (e.g. essay question, fill-in-the-blank)
- Performance (e.g. block design task)
4
Q
More on item format
A
- Open-ended items (no limitations on the test taker)
- Forced-choice items (MCQs, True/false, likert)
- Ipsative forced choice
- Sentence-completion items
- Performance-based items (involve the manipulation of apparatus, writing an essay, oral presentations)
5
Q
What does test length depend on?
A
- Amount of administration time available
- The purpose of the measure
- Tests that measure more than one aspect of a construct need more items than tests that measure only one aspect.
- General rule of thumb is that a test needs at least 12 items.
6
Q
What are some important things to note about test length?
A
- Compliance is lower when the number of items is higher as people get fatigued or bored.
- Need at least 50% more items in initial version.
6
Q
What is the grid structure for a test specification table?
A
- Columns represent content areas
- Rows represent manifestations
7
Q
What are the different types of manifestations for a test specification table?
A
- Behavioural
- Cognitive
- Affective
