Chapter 5 Flashcards
Predictive Study
Test is adminisistered, there is an interviewing time interval, and then the criterion is measured.
*Validity study
Concurrent Studies
Test is administered and criterion is measured at about the same time.
- Validity Study
Test Criterion Evidence
AKA
(predictive validity) (Criterion Validity) (Criterion-Related Validity)
Two types used
- Predictive studies: test admin, interval, then criterion measured
- Concurrent Studies: test admin then criterion measured same time.
Standard Error of estimate
Describes the amount of prediction error due to the imperfect validity of interpretation of a test score.
Decision Theory Model
Helps the test user determine how much information a predictor test can contribute when making classification decisions.
Multitrait-multimethod matrix
combines convergent and divergent strategies.
Validity argument
integration of numerous lines of evidence into coherent commentary.
Validity
appropriatenss and accuray of the interpretation of test scores.
Validity is a
unitary concept existing on a continuum, it’s not all or none.
Page 159 at bottom
Content Coverage
Experts look at the overall test and rate the degree to which the items cover specific domain
Item Relevance
Experts examine each individual test item and determine whether it reflects essential content in the specified domain.
Face Validity
NOT technically a FORM of Validity.
A test appearing to measure what it is designed to measure.
Threats to validity
2 threats
- test measures less or more than construct its supposed to measure.
- Construct irrelevant variance- content measures are unrelated content or characteristics of test
Reliability and Validity
without reliability there can be no validity.
Reliability is a necessary but insufficient condition for validity. Only true score variance is reliable. If reliability is equal to zero than true score variance has to be equal to zero.
Content Valdity
How adequate the test samples the content area of the construct.
Appropriateness of the test.
EX: Employers use content validity to classify employees before hired.