Module 7: Test Development Flashcards
Test Development
an umbrella term for all that goes into the process of creating a test
Test Conceptualization
+ brainstorming of ideas about what kind of test a developer wants to publish
+ entail literature reviews and experimentation, creation, revision, and deletion of preliminary items
What kind of information is determined in test conceptualization?
- Construct
- Goal
- User
- Taker
- Administration
- Format
- Response
- Benefits
- Costs
- Interpretation
- Whether the test is norm-referenced or criterion-referenced
- How best to measure a targeted construct
Pilot work/study/research
preliminary reserch surrounding the creation of a prototype of the test
Pilot work/study/research
preliminary reserch surrounding the creation of a prototype of the test
Test Construction
stage in the process that entails writing test items, revisions, formatting, setting scoring rules
What kind of item should not be made?
It is not good to create an item that contains numerous ideas
Item Pool
reservoir or well from which the items will or will not be drawn for the final version of the test
Item Banks
relatively large and easily accessible collection of test questions
Computer Adaptive Testing
+ refers to an interactive, computer administered test-taking process wherein items presented to the testtaker are based in part on the testtaker’s performance on previous item
+ test administered may be different for each testtaker, depending on the test performance on the items presented
What does Computer Adaptive Testing reduce?
Reduces floor and ceiling effects
Floor Effects
occurs when there is some lower limit on a survey or questionnaire and a large percentage of respondents score near this lower limit (testtakers have low scores)
Ceiling Effects
occurs when there is some upper limit on a survey or questionnaire and a large percentage of respondents score near this upper limit (testtakers have high scores)
Item Branching
ability of the computer to tailor the
content and order of presentation of items on the basis of responses to previous items
Item Format
form, plan, structure, arrangement, and layout of individual test items
What are the different kinds of item formats?
- Dichotomous format
- Polychotomous format
- Category format
Dichotomous Format
offers two alternatives for each item
Polychotomous Format
each item has more than two alternatives
Category Format
a format where respondents are asked to rate a construct
Checklist
subject receives a longlist of adjectives and indicates whether each one if characteristic of himself or herself
Guttman Scale
items are arranged from weaker to
stronger expressions of attitude, belief, or feelings
Selected-Response Format
require testtakers to select
response from a set of alternative responses
What are the three elements of a multiple choice format?
- stem (question),
- a correct option, and
- several incorrect alternatives (distractors or foils)
Multiple Choice Format
Should’ve one correct answer, has grammatically parallel alternatives, similar length, alternatives that fit grammatically with the stem, avoid ridiculous distractors, not excessively long, “all of the above”, “none of the above” (25%)