Psych Stats Exam #3 Flashcards

1
Q

What is ANOVA used for?

A

Comparing more than two means (i.e. 3+ levels of an IV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Pros and cons of within groups design

A

pro: reduced variability within participants
con: participants may figure out the experiment and change behavior

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why don’t we just do a bunch of t-tests?

A

The false alarm rate (finding an effect that is not there, type I error) becomes extremely high
- have to multiply probability for each test (95% CI = 5% false alarm x 3 tests = 0.95 x 0.95 x 0.95 = 85% CI, 15% error)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does ANOVA stand for?

A

analysis of variance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Looking for overall significant differences (One way ANOVA)

A

look for omnibus anova: see if there is a difference
- compare p to alpha to do this
- if there is a difference: run post hoc testing
- no difference: you are done, fail to reject the null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Post hoc tests (one way ANOVA)

A

tells us which specific conditions are statistically different

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

F statistic

A

ANOVA: same logic as NHST – testing against sampling dsitribution to see how unlikely / likely your results are
- use F distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

effect size for ANOVA

A

eta squared (η2)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Eta squared cutoffs

A

0.01 = small effect
0.06 = medium effect
0.14 = large effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

F distribution

A

one tailed - rejection region is only in one of the tails

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Measures of degrees of freedom in ANOVA

A

1) df between group
2) df within group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

F statistic formula

A

F = (between group variance) / (within group variance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Between group variance

A
  • the variance from our IV (difference from manipulation)
    Grand mean: mean of all the data
  • found by averaging each condition means
  • between condition mean: measures how much the condition means differ from the grand mean
  • “MS between” + “condition”
  • large: more likely to reject the null hypothesis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Within group variance

A

variability not due to our manipulation (individual differences, error)
- small: more likely to reject null (want less error)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

expected value under F statistic

A

1 (if it is 1, we fail to reject the null hypothesis)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Writing an Omnibus Anova

A

Overall: there is/is not an effect of the IV on the DV (F stat, p, eta squared)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Writing Post hoc tests

A

Condition A (M, SD) showed higher / lower levels of DV then condition B (M, SD) (t, p , d)
- For ALL comparisons

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Degrees of freedom between (one way between groups ANOVA)

A
  • first number
  • conditions in the study minus 1
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Degrees of freedom within (one way between groups ANOVA)

A
  • second (usually larger) number
  • participants in each condition - # of conditions
20
Q

Assumptions of ANOVA

A

1) DV is scale
2) IV is nominal / ordinal
3) homogeneity of variances
4) DV is normally distributed in population

21
Q

Homogeneity of Variances

A

the amount of variability within each condition should be similar across all conditions
- check this: if the p value is less than alpha, you have to run a correction

22
Q

calculating residual (MS within)

A

sum of squares (within) / degrees of freedom (within)

23
Q

calculating condition (MS between)

A

sum of squares (between) / degrees of freedom (between)

24
Q

If you have more between condition variance…

A

you are more likely to reject the null (as experiment had more influence on the difference you saw)

25
Q

Within condition study allows researchers to…

A

more likely to find an effect if one exists (more power) - less participant variance

26
Q

Within groups ANOVA degrees of freedom

A

1) Df between
2) Df within

27
Q

Df between (one-way repeated measures ANOVA)

A

of conditions-1
- same as between groups ANOVA

28
Q

Df within (one-way repeated measures ANOVA)

A

(conditions-1) * (participants -1)
- Different from between groups ANOVA

29
Q

Factorial ANOVA

A

2+ independent variables each with 2+ levels
- used to see an interaction

30
Q

Interaction definition

A

when the effect of one independent variable depends on the other independent variable

31
Q

Main effect

A

the effect of one IV by ignoring/averaging the other IV
- calculated using marginal means

32
Q

Marginal Means

A

the mean for one level of the IV (down a column or across a row)
- used to find main effects

33
Q

Simple Effect

A

the effect of one IV at a specific level of the other IV
- found by looking across each row (or down each column) and seeing if there is a difference

34
Q

How to identify an interaction

A

Compare simple effects: see if they differ in effect size (magnitude) or direction

35
Q

Quantitative interaction

A

difference in effect size not direction

36
Q

Qualitative interaction

A

difference in direction not effect size

37
Q

Can you have no main effects and still a qualitative interaction

A

YES

38
Q

When to use a t-test

A
  • 1 nominal IV (2 levels)
  • Scale DV
  • independent or paired samples
39
Q

When to use a One-way ANOVA

A
  • 1 nominal IV (3+ levels)
  • Scale DV
  • Between groups or repeated measures
40
Q

Factorial ANOVA

A
  • 2+ nominal IV (2+ levels)
  • Scale DV
  • Between groups, repeated measures, or mixed design
41
Q

What does a 2x2x3 design mean?

A

there are 3 independent variables, the first with 2 levels, the second with 2 levels and the third with three levels

42
Q

Write up example for interaction

A

“The effect on test performance of using a mnemonic device changes depending on whether or not the student was trained in mnemonic use: mnemonic use improves test performance with and without training but is more beneficial with training than without”

43
Q

3 Patterns of an interaction

A

1) An effect is larger at one level than the other, but they are in the same direction
2) An effect is present at one level but not the other (i.e. one simple effect is null)
3) An effect is reversed at one level compared to the other (i.e. the simple effects are in opposite directions)

44
Q

Number of simple and main effects in a 2x2 interaction

A
  • 2 main effects
  • 4 simple effects
45
Q

Manual Bonferroni correction:

A

We run multiple sets of t-tests then we divide our original alpha by the number of post hoc tests we ran
ex: If 2 post hoc tests and original alpha of 0.05
- 0.05/2 = 0.025 → this becomes a new alpha that we compare the p values of the t-test to this