test specification Flashcards

1
Q

Test specifications should describe (7)

A
  1. test (response format)
  2. item format
  3. total number of test items (length)
  4. all the content areas of the constructs tested
  5. whether items or prompts will contain visual stimuli
  6. how test scores will be interpreted
  7. time limits
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

types of test/response format

A
  1. selected response (likert, mcq, dichotomous)
  2. Constructed response (essay, fill in the blank)
  3. performance
  4. objective formats (very structured, person only picks one response)
  5. subjective format (interpretation of response, projective tests)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

types of item formats

A
  1. open-ended items
  2. forced-choice items
  3. ipsative forced choice
  4. sentence completion items
  5. performative-based items
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Open-ended items

A

No limitations on the test taker

Describe how you normally behave when you have to confront a colleague at work [example of work stressor]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Forced-choice items

A

MCQs; True-False, Likert

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Ipsative forced choice

A

I find confronting a colleague at work…

Do you prefer humanities or commerce?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Performance-based items

A

Involve the manipulation of an apparatus
Writing an essay
Oral presentations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Test length depends on…

A

mainly depends on:

  • amount of admin time available
  • the purpose of the measure
  • tests that measure more than one aspect of a construct need more items
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Factors of test length

A
  • need at least 12 items
  • Compliance lower when item numbers are higher
  • Need at least 50% more items in initial version than final version (discard bad ones)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Blueprint

A

A grid structure (test blueprint)
Columns represent content areas (indicators)
Rows represent manifestations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly