ANOVA Lecture 13 revision Flashcards

1
Q

Statistical inference

A

From sample statistics, draw conclusions about population parameters

The critical value of the test statistic is determined by sample statistics
α = p(Type I error) = p(reject H0 | H0 true)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Type 1 vs Type 2 error

A

Retain H0 when Ho is True
Correct 1 – α

Retain H0 when Ho is false
Type II error
β

Reject H0 when ho is true
Type I Error
α

Reject H0 when ho is false
Correct (Power)
1 – β

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Between Subjects ANOVA

A

Each participant only experiences one condition (i.e., different groups of people in each condition)

Interest is in the effect parameters (αj) because they represent systematic between-group differences.
How much the group mean deviates from the grand mean.

One family in One Way ANOVA across the entire experiment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

null for between s anova

A

H0: 𝜇1=𝜇2=⋯=𝜇𝐽 H0: 𝛼1=𝛼2=⋯=𝛼𝐽=0
If H0 is true, Yij = μ + εij (because all αj = 0)

If H0 is false, Yij = μ + αj + εij

Are all the alpha js equal to zero? Are all the group means exactly the same? Contrasts let us know

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Experiments with two between-subjects IVs

A

Factorial design – every level of IVA appears in combination with every level of IVB

A (row variable) has J levels

B (column variable) has K levels

J x K = number of conditions in the experiment / cells in the design / independent groups of participants

E.g., 4 x 5 = 20 cells, or combinations of conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Advantages of multifactor experiments:

A
More power (possibly), can account for more of our IV. 
•observed F will be possibly larger,
Can assess interaction effects – only possible when there are combinations of variables
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

how many families for A two-way ANOVA
A three-way ANOVA
A four-way ANOVA

A

EER ≠ FER for multifactor experiments

A two-way ANOVA (2 IVs in 1 experiment) will have 3 families: A, B and AB

A three-way ANOVA (3 IVs in 1 experiment) will have 7 families: A, B, C, AB, AC, BC and ABC

A four-way ANOVA (4 IVs in 1 experiment) will have 15 families

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

The two-way between-subjects ANOVA model:

A

Main effect of A, df = J-1, Inference about αj

Main effect of B df K-1, Inference about βk

Interaction effect AxB, df = (J-1)(K-1), Inference about αβjk
(J-1)(K-1)
Inference about αβjk
Error df N-JK
Total df N-1
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Contrasts

A

1df test, asking focussed questions, allows directional conclusions

Linear combination of weighted means, whose coefficients sum to 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Three types of contrasts:

A
Mean difference contrasts
•
Trend contrasts
•
Interaction contrasts
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Mean difference contrasts

A

Is the average of ‘this lot’ the same/different from the average of ‘that lot’ in terms of some DV of interest?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

standard form vs integor

A
psy hat (contrast estimate) is immediately interpretable when using standard form coefficients, while
•
Hand-calculations are often easier when using integer form coefficients
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

how do we know psy is signifiant?

A

NHST for contrasts
For between-subjects contrasts
df effect is always 1.

ms contrast is SS cont/1 = SSc, so F = SS cont/MSE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Critical F for contrasts

A

For any contrast, observed F = F(1, v2) three methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what crit F for Planned, orthogonal

A

DER, good power, no further control over FER or EER, not great flexibility, c.v. F.05;1,ν2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what crit F for Planned contrasts?

A
Bonferroni, 
Power - Less than DER when k > 1; more than Scheffé when k ≤ (J-1)
Yes controls FER/EER ≤ α
Flexibility - Reasonable, but planned
c.v. Fα/k;1,ν2
17
Q

what crit F for Planned or post hoc

A

Scheffé
Power - Least, most of the time, but not always, controls Yes FER/EER ≤ α
f;exibility - Unlimited,
c.v. ν1F.05;ν1,ν2

18
Q

Orthogonality

A

A pair of contrasts is orthogonal if: Σcj1cj2 = 0

19
Q

orthogonal contrasts will account for …

which error rate?

A

SS for a set of (J-1) orthogonal contrasts will account for all of SSB without overlap

Current practice allows use of DER when testing planned and orthogonal contrasts (if the researcher is not concerned about the inflating EER)

20
Q

Trend contrasts

A

(orthogonal polynomials)
Special type of contrast asking questions about quantitative aspects of the IV

Interpretation not in terms of mean differences, but in terms of trends: How does the pattern of DV means change as levels of the quantitative IV increase/decrease?

21
Q

Contrasts for two-way designs

A

Main effect contrast A – focussed questions about the αj

Main effect contrast B – focussed questions about the βk

Interaction contrast AB – focussed questions about the αβjk

Does this difference = that difference?

22
Q

FER for two-way designs

A

If contrasts are evaluated a family-wise error rate (FER), critical values must be worked out for each family
v1 = df(effect) in ANOVA
v2 = df(error)
k = number of questions about that family

DER
Bonferroni
Scheffé
c.v.
F.05;1,ν2  Fα/k;1,ν2  ν1F.05;ν1,ν2
23
Q

Sources of variability

A

Between-subjects -> condition =group
Total variability SS(Total) is Between groups SS(Condition)
and Within groups SS(Error)

Within-subjects -> condition = repeated measures
Total variability SS(Total) is Within group, partitioned into SS(Subjects), SS(Condition) and SS(Error) ( Subject x Treatment Interaction)

24
Q

5 points for Within-subjects (repeated measures) variables

A
  1. Difference scores = contrast scores
  2. Partitioning within-subjects variability
  3. Different ways of testing planned contrasts for repeated measures variables
  4. Normalising coefficients (a question of scaling)
  5. Pooled vs. separate error terms for within-subjects contrasts
25
Q

when might we not be able to provide a direction of effect for a 1 df question?

A

cross over