ANOVA Lecture 13 revision Flashcards
Statistical inference
From sample statistics, draw conclusions about population parameters
The critical value of the test statistic is determined by sample statistics
α = p(Type I error) = p(reject H0 | H0 true)
Type 1 vs Type 2 error
Retain H0 when Ho is True
Correct 1 – α
Retain H0 when Ho is false
Type II error
β
Reject H0 when ho is true
Type I Error
α
Reject H0 when ho is false
Correct (Power)
1 – β
Between Subjects ANOVA
Each participant only experiences one condition (i.e., different groups of people in each condition)
Interest is in the effect parameters (αj) because they represent systematic between-group differences.
How much the group mean deviates from the grand mean.
One family in One Way ANOVA across the entire experiment
null for between s anova
H0: 𝜇1=𝜇2=⋯=𝜇𝐽 H0: 𝛼1=𝛼2=⋯=𝛼𝐽=0
If H0 is true, Yij = μ + εij (because all αj = 0)
If H0 is false, Yij = μ + αj + εij
Are all the alpha js equal to zero? Are all the group means exactly the same? Contrasts let us know
Experiments with two between-subjects IVs
Factorial design – every level of IVA appears in combination with every level of IVB
A (row variable) has J levels
B (column variable) has K levels
J x K = number of conditions in the experiment / cells in the design / independent groups of participants
E.g., 4 x 5 = 20 cells, or combinations of conditions
Advantages of multifactor experiments:
More power (possibly), can account for more of our IV. •observed F will be possibly larger, Can assess interaction effects – only possible when there are combinations of variables
how many families for A two-way ANOVA
A three-way ANOVA
A four-way ANOVA
EER ≠ FER for multifactor experiments
•
A two-way ANOVA (2 IVs in 1 experiment) will have 3 families: A, B and AB
•
A three-way ANOVA (3 IVs in 1 experiment) will have 7 families: A, B, C, AB, AC, BC and ABC
•
A four-way ANOVA (4 IVs in 1 experiment) will have 15 families
The two-way between-subjects ANOVA model:
Main effect of A, df = J-1, Inference about αj
Main effect of B df K-1, Inference about βk
Interaction effect AxB, df = (J-1)(K-1), Inference about αβjk (J-1)(K-1) Inference about αβjk Error df N-JK Total df N-1
Contrasts
1df test, asking focussed questions, allows directional conclusions
Linear combination of weighted means, whose coefficients sum to 0
Three types of contrasts:
Mean difference contrasts • Trend contrasts • Interaction contrasts
Mean difference contrasts
Is the average of ‘this lot’ the same/different from the average of ‘that lot’ in terms of some DV of interest?
standard form vs integor
psy hat (contrast estimate) is immediately interpretable when using standard form coefficients, while • Hand-calculations are often easier when using integer form coefficients
how do we know psy is signifiant?
NHST for contrasts
For between-subjects contrasts
df effect is always 1.
ms contrast is SS cont/1 = SSc, so F = SS cont/MSE
Critical F for contrasts
For any contrast, observed F = F(1, v2) three methods
what crit F for Planned, orthogonal
DER, good power, no further control over FER or EER, not great flexibility, c.v. F.05;1,ν2