Validity Flashcards
A judgment or estimate of how well a test measures what it purports to
measure in a particular context.
Validity
The agreement between a test score or measure and the
quality it is believed to measure
Validity
The process of gathering and evaluating evidence about
validity.
Validation
require professional time and know-how, and
they may be costly.
Local validation studies
are absolutely necessary when the
test user plans to alter in some way the format, instructions, language, or
content of the test.
Local validation studies
The degree to which all accumulated evidence supports the intended
interpretation of test scores for the intended purpose.
Validity
The process of gathering and evaluating evidence about
validity.
Validation
require professional time and know-how, and
they may be costly.
Local Validity Studies
This measure of validity is based on an evaluation of
the subjects, topics, or content covered by the items in the test
Content validity
This measure of validity is obtained by
evaluating the relationship of scores obtained on the test to scores on
other tests or measures.
Criterion related Validity
This measure of validity is arrived at by executing a
comprehensive analysis of:
• How scores on the test relate to other test scores and measures.
• How scores on the test can be understood within some theoretical
framework for understanding the construct that the test was
designed to measure.
Construct Validity
Validity best answers which of the following questions?
A. How consistent is the test over time?
B. How accurate are the results of the test?
C. Does the test measure what it is supposed to measure?
D. What is the variability of the test?
C
be defined as the agreement between a test score or
measure and the quality it is believed to measure. Validity is
sometimes defined as the answer to the question, “Does the test
measure what it is supposed to measure?”
Validity
Aspects of Validity
Face Validity
- Content Validity
- Criterion-Related Validity (Concurrent and Predictive)
- Construct Validity
A judgment concerning how relevant the test items appear to be.
Face Validity
is not a statistical or numerical
measure; rather, it taps whether a test “feels like” it is a reasonable
measure of its associated criterion
Face Validity
it taps whether a test “feels like” it is a reasonable
measure of its associated criterion
Face Validity
A judgment of how adequately a test samples behavior
representative of the universe of behavior that the test was designed to sample.
Content Validity
A plan regarding the types of information to be covered by
the items, the number of items tapping each area of coverage, the
organization of the items in the test
Test Blueprint
The content validity of a test varies across
Culture and Time
Developers must show evidence that the domain was systematically analyzed and concepts are covered in correct proportion
Content Validity
Four-step process:
Step 1 - Survey the domain – Defining the performance domain of interest
• Step 2 - Content of test matches the domain – Selecting a panel of
qualified experts in the content domain
• Step 3 - Specific test items match the content – Providing a structured
framework (instruction) for the process of matching item (Question) to the
performance domain (Answer)
• Step 4 - Analyze relative importance of each objective (weight) –
Collecting and summarizing the data form the matching process.
Not a real type of content validity
– A quick look at “face” value of questions
– Sometimes questions may not seem to measure the content,
but do
• How might you show content validity for an instrument that
measures depression?
Content Validity
evidence tells us just how well a test corresponds
with a particular criterion
Criterion Validity
