VALIDITY Flashcards
is a judgment or estimate of how well a test measures what it purports to measure in a
particular context
validity
the process of gathering
and evaluating evidence about validity
validation
- relates more to what a test appears to measure than to what the test actually measures
- judgment concerning how relevant the test items appear to be
- presentation or physical appearance of the
psychological test
Ex: A math test with arithmetic problems has high ___because it looks like it measures math skills.
face validity
describes a judgment of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample
Ex: A physics exam designed to measure overall knowledge of mechanics should include questions about forces, motion, energy, and torque. If it only focuses on motion, it lacks___
content validity
– a plan regarding the types of
information to be covered by the items, the number of items tapping each area of coverage,
the organization of the items in the test, and so fort
test blueprint
developed by:
a method of gauging agreement among raters or judges regarding how essential a particular item is (essential, useful but not essential, not necessary)
C.H Lawshe
content validity ratio
a judgment of how adequately a test score can be used to infer an individual’ s most probable standing on some measure of interest—the measure of interest being the criterion
criterion related validity
the standard against which a
test or a test score is evaluated
criterion
an index of the degree to which a test score predicts some criterion measure
- Test Future Criterion
Ex: A college entrance exam (like the SAT) is said to have good __if high scores accurately forecast students’ academic performance in college.
predictive validity
the degree to which an
additional predictor explains something about the criterion measure that is not explained by predictors already in use
Ex: After a general aptitude test predicts job performance, a personality test might be added. If the personality test improves predictions beyond the aptitude test
incremental validity
an index of the degree to which a test score is related to some criterion measure obtained at the same time
Ex: A new anxiety scale is compared with a well-known anxiety assessment. If both produce similar results when administered simultaneously
concurrent validity
a factor inherent in a test that systematically prevents accurate, impartial measurement; systematic variation
test bias
- occurs when evaluator rates individuals more favorably than their actual performance
- evaluator overly harsh or critical rating individuals below actual performance
- evaluator avoid extreme ratings (middle answers)
- tendency to let one positive characteristics influence overall evaluations
leniency error
severity error
central tendency error
halo error
Extent to which a test is used in an impartial, just and equitable way
test fairness
Compute to know if the items should be used in test, Goal is to RETAIN
- If low aalisin sa test
- if High (Retain)
Content validity ratio
2 accept, 1 revisr =____
2 reject, 1 accept =
2 revise, 1 accept =
1 reject, 1 accept, 1 revise=
Accept
Reject
Ask for comment
Ask for comment
Research to prove validity of the test
Validation studies
Gagamit ng international scale and then use in Philippines, translate and study the test to become valid
• Kapag mat babaguhin sa isang Adopted scale uulit sa process ng Test development
Local validation studies
Weakest form of Validity (because it is nonscientific and no need to compute, only look for APPEARANCE)
Face validity
Item sa loob ng test (lahat ba ng item is dapat nasa scale)
Content validity
Table of specifications (base to create a test)
Test blueprint
Opposite of content irrelevance (hindi na present yung full content) (Ex: Math test, but only measure algebra)
Construct underrepresentation
To determine if the test can be used to infer the performance of an individual to another criterion/performance
(Ex: Entrance exam on Medschool, if it is high and your performance in Medschool)
Criterion related validity
Ginagamit sa aptitude test (future reference)
- need to wait for years to correlate
Predictive validity
