week 9, validity + descriptive statistics Flashcards
how can we combine some of the elements of different non-experimental designs to make them stronger?
non-equivalents control group design with pre and post test
what is a quasi-experimental designs
interrupted time-series design
measuring a variable over time both before and after
-no control group !!
what are some threats to internal validity for interrupted time series design designs?
check slide 13 for slide 1
selection bias -> less concern bc participants comapred to themselves
potential testing effects are distributed along the entire time series
regression to the mean, one data point may be extreme but rest are unlikely to be affected
what is cross sectional design
compare language, memory, emotional response, social skills, etc
how to combat generation cohort effect when you test different ages?
longitudinal design, test same kids throughout their lives
what is time-lag design
different cohorts are tested in different years, but age is kept constant ( 12 yr olds from 3 different years)
if theres no dfference then generation nor year of test matters
what is a confounding variable for longitudinal design
year of test, could have history and testing effects
what is a cohort-sequential design, what is a risk of it?
combines cross sectional, longitudinal, time-lag and requires replication and extension.
selective attrition is still an issue
internal validity in experimental research
to what extent are changes in the DV caused unambiguously by changes in the IV
- have all alternative explanations been adequately ruled out?
what factors reduce internal validity?
- violations of random assignment (no control group, non equivalent groups)
2.presence of confounds
external validity in non-experimental research
are the results derived from a sample generalizable to whole population?
- concerned with sampling methods
external validity in experimental research
generalizability of experimental results to other people or situations (dif contexts/outside of lab)
what factors reduce external validity?
- violations of random sampling (cant generalize to pop)
-replicate findings in other samples of same pop, other pop etc - small sample sizes, over/underestimate effect
- artificiality of experimental setting (talking about political views w strangers)
laboratory observations have… internal validity and …. external validity
naturalistic obersvations have internal validity and …. external validity
- high, low
- low,high
unsure if DV changed due to my manipulation of the IV or not (due to low internal validity)
but !! im pretty sure it would generalize (due to high external validity)
how do we increase generalizablity of results? what is this called
combine internally valid experiments with externally valid field studies, method triangualtion