Week 4 Flashcards
Validity
the degree to which a test or instrument measures what it purports
Validity
Logical / Face Validity
do the methods and approach make sense?
Validity
Content Validity
Does the test fully represent the domain of the concept it is intended to measure?
Validity
Criterion Validity - Concurrent
correlating an instrument with a criterion administered at the same time
Validity
Criterion Validity - Predictive
correlating an instrument with a criterion administered in the future
Criterion Validity - Predictive
Cross- Validation
- generate a predictive equation with 1/2 of the sample
- confirm the prediction equation works with other 1/2 of sample
Validity
Construct Validity
degree to which the scores from a test measure the hypothesis construct
Measurement Reliability
- refers to the consistency and stability of a measurement tool or method
- indicates how dependably a method measures something over time, across different observers, or in various contexts
What are common sources of measurement errors?
- testing
- instrumentation
- scoring
- participant
Reliability Tests
Test-retest Reliability
measures the consistency of results when the same test is administered to the same sample at different points in time
Reliability Tests
Interrater Reliability
assesses the degree to which different observers or rates agree in their assessments
Reliability Tests
Parallel Forms
comparing two different versions of a test that are designed to be equivalent
Reliability Tests
Internal Consistency
examine the consistency of results across items within a test
* a common measure of internal consistency is Cronbach’s alpha, which assesses how well the items on a test measure the same construct
Common Statistical Approaches
Test-retest Reliability
- Pearson correlation coefficient
- Intraclass correlation coefficient (ICC)
- Coefficient of Variation