test development Flashcards
a term used for all the processes that goes into the method of creating a psychometrically sound test
test development
steps of test development
- Test Conceptualization
- Tests Construction
- Test Tryout
- Item Analysis
- Test Revisions
if the performance is tested as a function of age wherein interpretations of the scores obtained may differ based in age-range.
age-based scaling
if the performance is tested as a function of grade wherein interpretations of the scores obtained may differ based on the current grade level of the responded
grade-based scaling
if the performance is tested as a function of a single construct
unidimensional scaling
if the performance is tested as a function of multiple constructs
multidimensional scaling
if the performance is tested as a function of comparison
comparative
if the performance is tested and is interpreted in a nominal way
categorical scaling
a test that group words, statements, or symbols
wherein the strength of a trait is indicated by the test taker
rating scale
wherein final score is obtained by summing the ratings across items. Likert Scale is a summative scale that has numerous alternative responses
summative scale
wherein takers were presented in pairs where they are asked to compare
method of paired comparison
provides an ordinal information through either comparative or categorical scaling
sorting method
wherein items are arranged sequentially from weaker to stronger expression of attitudes, beliefs, or feelings that are being measured
guttman scale
- Multiple Choice
- Matching Type
- Binary Choice
- Likert Type
selected response
- Completion
- Short Answer
- Essay
constructed response
summing scores obtained from each items designated for each or a construct.
cumulative scoring
when scores categorize people on a certain class or type
class scoring
a scoring procedure that results into a total score coming from a variety of items from the test
ipsative scoring
a stage wherein items should be tried out on people who
are similar in critical demographic aspects to the identified
target population
test tryout
- wherein it includes preliminary research about the creation of the prototype of the test
- it involves literature review, experimentation, creations,
revisions, and deletion of preliminary test items
pilot work / pilot study
obtained by calculating the proportion of the total number of test takers who answered the test correctly
item difficulty index
indication of an internal consistency of the test
item reliability index
the degree to which a test is measuring what it purports to measure
item validity index
how an item separates or discriminates between high and low scorers
item discrimination index
analysis if the effect of foils or distractors
analysis of items alternatives
no generally acceptable method but may be through consistent responding based on thresholds established
guessing analysis
the degree, if any test item is biased
item fairness
analyzes the amount of time spent but may yield misleading results
speed test analysis
the process of revalidation on a different sample
cross-validation
using two or more tests on the chosen sample
co-validation
