Validity Flashcards
a judgment or estimate of how well a test measures what it supposed to measure
Validity
Evidence about the appropriateness of inferences drawn from test scores
Degree to which the measurement procedure measures the variables to measure
Validity
logical result or deduction
Inferences
the process of gathering and evaluating evidence about validity
Validation
yield insights regarding a particular population of testtakers as compared to the norming sample described in a test manual
Validation Studies
degree of control among variables in the study (increased through random assignment)
Internal Validity
generalizability of the research results (increased through random selection)
External Validity
focuses on individual with their unique histories and behaviors
Conceptual Validity
Means of evaluating and integrating test data so that the clinician’s conclusions make accurate statements about the examinee
Conceptual Validity
a test appears to measure to the person being tested than to what the test actually measures
Face Validity
describes a judgement of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample
more logical than statistical
Content Validity
when the proportion of the material covered by the test approximates the proportion of material covered in the course
Content Validity
a plan regarding the types of information to be covered by the items, the no. of items tapping each area of coverage, the organization of the items, and so forth
Test Blueprint
concerned with the extent to which the test is representative of defined body of content consisting the topics and processes
- panel of experts can review the test items and rate them in terms of how closely they match the objective or domain specification
- examine if items are essential, useful and necessary
Content Validity
failure to capture important components of a construct
construct underrepresentation
happens when scores are influenced by factors irrelevant to the construct
construct-irrelevant variance
developed the formula of Content Validity Ratio
Lawshe
exactly half of the experts rate the item as essential
Zero CVR
more statistical than logical
- a judgement of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interestꟷthe measure of interest being criterion
Criterion Validity
standard on which a judgement or decision may be made
Criterion
Characteristics: relevant, valid, uncontaminated
Criterion Validity
occurs when the criterion measure includes aspects of performance that are not part of the job or when the measure is affected by “construct-irrelevant” (Messick, 1989) factors that are not part of the criterion construct
Criterion Contamination