Module 4: Test Development Flashcards
What are the Stages of Test Development?
- Test conceptualisation.
- Test construction.
- Test tryout (pilot).
- Item analysis.
- Test revision.
Steps 3 - 5 repeated.
- What is Test Conceptualisation?
How might I measure the concept?
Need to create a definition and identify relevant content areas through reviewing existing literature.
What do you Need to Identify During Test Conceptualisation?
Purpose of the test, audience of the test, type of sample, method of administration.
- What is Test Development?
Consider format and scoring, come up with test items, scaling, how they’ll be measured.
What is a Selected Response Format?
Range of options and requires participants to select one ore more (multiple choice).
What is a Constructed-Response Format?
Requires test-taker to produce an answer (short-answer questions).
What is Rational vs. Empirical Test Construction?
Rational-Driven: guided by theoretical knowledge of the construct.
Empirical: prioritises ability to discriminate between two groups.
What are the Different Types of Data?
Nominal: data is categorical and has no value.
Ordinal: data exists in categories that are ordered, but differences cannot be determined.
Interval: provide information about order and magnitude of difference.
Ratio: data with an absolute 0.
What are the Different Types of Rating Scales?
Summative: final score is obtained by summing the ratings across all the items.
Guttman: multi-item measure in which respondents are presented with increasingly difficult measures of approval for an attitude.
What are the Different Types of Scoring?
Cumulative: sum participant’s score.
Class/category: compared participant’s scores to meet a certain criteria.
Ipsative: compares participant’s score with themselves.
- What is Test Tryout?
Should be administered:
- The same as the final product.
- To a similar population that it was designed for.
- 5 - 10 subjects per item.
The goal is to have good items that are reliable and valid.
- What is Analysis?
Will vary depending on the goals of the developer.
Selecting items for the final test.
What are the Tools that Developers may use to Analyse Test Items?
Index of items difficulty.
Index of items reliability.
Index of items validity.
Index of item discrimination.
What is the Item Characteristic Curve (ICC)?
A graphic representation of item difficulty and discrimination.
- What is Test Revision (New Test)?
Items are evaluated based on strengths and weaknesses.
Revised tests then administered to a new sample (3 - 5 again).
