Psychometrics - Test Specification Flashcards

1
Q

12 steps to develop a measure

A
  1. Overall goal and pre-planning
  2. Content definition
  3. Test specification
  4. Item development
  5. Test design and assembly
  6. Test production
  7. Test administration
  8. Scoring responses
  9. Establishing passing scores
  10. Reporting results
  11. Item banking
  12. Test technical support
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

7 components covered in test specification

A
  1. Response format
  2. Item format
  3. Test length
  4. All the content areas of the constructs tested
  5. Whether items or prompts will contain visual stimuli
  6. How test scores will be interpreted
  7. Time limits
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Decisions with test response format

A

Selected vs constructed vs performance

Objective vs subjective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Decisions on item formats

A

Open ended vs forced choice

Sentence completion or performance based are options

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the key factor to assess when looking at test length?

A

The amount of administration time available

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Issue with tests that are too long

A

The compliance of the participants lowers, due to fatigue or boredom

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Test blueprint

A

Columns: content areas
Rows: manifestation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly