Reliability and Validity Flashcards
External Validity
Ability to generalize results to other subjects or settings
Dealing with threat
Rule out or hold variables constant Homogenize the subjects (within sub design, pre-selection) Increase accuracy of DV measurement Use counterbalancing (abba) Nuisance variables (eliminate, hold constant, measure and control statistically)
External validity
Population
Ecological
Temporal
Construct Valididy
The way you’ve decided to test is valid (clear definition of constructs, obvious levels, multiple measures)
Threats to construct validity
Reactivity to experimental situation
Demand characteristics
Experimenter effects, attributes & expectancies
Demand characteristics
Changing answers to change how they appear
Internal Validity
Independent variable causes the effect observed in the DV
Threats to internal validity
History Maturation Selection Testing Instrumentation Regression toward mean Mortality Interaction effects
Statistical Conclusion Validity
You’re making valid conclusions with the right tests and interpretations
Threats to statistical conclusion validity
Unreliable dependent measures
Violations of statistical assumptions
Validity
Accuracy or correctness if an inference from results of a study
Accuracy or correctness if an inference from results of a study
validity
Reliability
Stability, consistency or repeatability
Stability, consistency or repeatability
Reliability
Influences on reliability
Sample size, demographics, researcher characteristics, ability of researcher
