VALIDITY Flashcards
a judgment or estimate of how well a test
measures what it purports to measure in a particular context.
VALIDITY
This is a measure of validity based on an
evaluation of the subjects, topics, or content covered by the
items in the test.
Content Validity
This is a measure of validity that is arrived
at by executing a comprehensive analysis of how scores on the test relate to other test scores and measures, and how scores on the test can be understood within some theoretical
framework for understanding the construct that the test was designed to
measure
Construct Validity
a judgment concerning how relevant the test
items appear to be.
Face Validity
A judgment of how adequately a test
samples behavior representative of the universe of
behavior that the test was designed to sample
Content Validity
A plan regarding the types of information to be covered by the items, the number
of items tapping each area of coverage, the
organization of the items in the test, etc.
Test Blueprint
developed a method whereby raters judge
each item as to whether it is essential, useful but not essential, or not necessary for job performance.
Lawshe (1875)
is the standard against which a test or
a test score is evaluated.
criterion
is relevant for the matter at hand, valid for the purpose for which it is being used, and uncontaminated, meaning it is not part
of the predictor.
Adequate criterion
judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest
Criterion-related Validity
This is a measure of validity obtained
by evaluating the relationship of scores obtained on the test toscores on other tests or measures
Criterion-related Validity
the process of gathering and evaluating
evidence about validity.
Validation
an index of the degree to which a test
score predicts some criterion,
or outcome, measure in the
future.
Predictive validity
a correlation coefficient that
provides a measure of the relationship between test scores
and scores on the criterion measure.
Validity Coefficient
shows the percentage of people
within specified test-score intervals who subsequently
were placed in various categories of the criterion (e.g.
placed in “passed” category or “failed” category).
Expectancy Data
the ability of a test to measure a
theorized construct (e.g. intelligence, aggression,
personality, etc.) that it purports to measure.
Construct Validity
how uniform a test is in
measuring a single concept.
Evidence of homogeneity
Some constructs are expected to change over time (e.g. reading rate)
Evidence of changes with age
test scores change as a result of some experience between a pretest and a posttest (e.g. therapy).
Evidence of pretest/posttest changes
scores on a test vary in a
predictable way as a function of membership in some
group (e.g. scores on the Psychopathy Checklist for
prisoners vs. civilians).
Evidence from distinct groups
scores on the test undergoing construct validation tend to correlate highly in the predicted direction with scores on older, more established, tests designed to measure the same (or a similar) construct.
Convergent evidence
validity coefficient showing little
relationship between test scores and other variables with
which scores on the test should not theoretically be correlated
Discriminant evidence
an index of the degree to which a
test score is related to some
criterion measure obtained at
the same time
Concurrent validity
a factor inherent in a test that systematically prevents
accurate, impartial measurement.
Bias
a judgment resulting from the intentional or
unintentional misuse of a rating scale.
Rating error
a tendency to give a particular person a higher rating
than he or she objectively deserves because of a favorable overall impression.
Halo effect
The extent to which a test is used in an impartial, just, and equitable way.
Fairness
