Psych Stats Exam #3 Flashcards
What is ANOVA used for?
Comparing more than two means (i.e. 3+ levels of an IV)
Pros and cons of within groups design
pro: reduced variability within participants
con: participants may figure out the experiment and change behavior
Why don’t we just do a bunch of t-tests?
The false alarm rate (finding an effect that is not there, type I error) becomes extremely high
- have to multiply probability for each test (95% CI = 5% false alarm x 3 tests = 0.95 x 0.95 x 0.95 = 85% CI, 15% error)
What does ANOVA stand for?
analysis of variance
Looking for overall significant differences (One way ANOVA)
look for omnibus anova: see if there is a difference
- compare p to alpha to do this
- if there is a difference: run post hoc testing
- no difference: you are done, fail to reject the null
Post hoc tests (one way ANOVA)
tells us which specific conditions are statistically different
F statistic
ANOVA: same logic as NHST – testing against sampling dsitribution to see how unlikely / likely your results are
- use F distribution
effect size for ANOVA
eta squared (η2)
Eta squared cutoffs
0.01 = small effect
0.06 = medium effect
0.14 = large effect
F distribution
one tailed - rejection region is only in one of the tails
Measures of degrees of freedom in ANOVA
1) df between group
2) df within group
F statistic formula
F = (between group variance) / (within group variance)
Between group variance
- the variance from our IV (difference from manipulation)
Grand mean: mean of all the data - found by averaging each condition means
- between condition mean: measures how much the condition means differ from the grand mean
- “MS between” + “condition”
- large: more likely to reject the null hypothesis
Within group variance
variability not due to our manipulation (individual differences, error)
- small: more likely to reject null (want less error)
expected value under F statistic
1 (if it is 1, we fail to reject the null hypothesis)
Writing an Omnibus Anova
Overall: there is/is not an effect of the IV on the DV (F stat, p, eta squared)
Writing Post hoc tests
Condition A (M, SD) showed higher / lower levels of DV then condition B (M, SD) (t, p , d)
- For ALL comparisons
Degrees of freedom between (one way between groups ANOVA)
- first number
- conditions in the study minus 1