Chapter 12: ANCOVA Flashcards
1
Q
What is ANCOVA?
A
When we measure covariates and include them in an analysis of variance we call it analysis of covariance: ANCOVA
2
Q
Covariates
A
Continuous variables that are not part of the main experimental manipulation but have an influence on the dependent variable
3
Q
Reasons for including covariates in ANOVA
A
1- To reduce within-group error variance
2- Eliminate confounds
4
Q
ANCOVA: Equation
A
Outcome=bo+b1Dummy1+b2Dummy2+b3covariate+error
- Covariate: added as a predictor in ANCOVA
- this model tests the difference in group means adjusted for covariate
5
Q
ANCOVA:
ANOVA table: Model 1
A
- how well the model fits when only the covariate is used in model
6
Q
ANCOVA:
ANOVA table: Model 2
A
- the goodness of fit of model when covariate & dummy variables are used is used in model
- difference in R^2: the individual contribution of experimental groups
—> R^2 (M.2)- R^2 (M.1)
7
Q
Constant
A
bo in ANCOVA
8
Q
ANCOVA as ‘controlling’ for the covariate
A
- compares the predicted group means at the average value of the covariate, so the groups are being compared at a level of the covariate that is the same for each group
- ‘controlling for covariate’ analogy is not a good one
9
Q
Assumptions of ANCOVA
A
- Linearity
- Normality
- Independence of error
- Homoscedasticity
- Independence of the covariate and experimental groups
- homogeneity of regression slopes
10
Q
Independence of the covariates and predictor groups
A
- covariate must be independent of categorical predictor
- this situation arises mostly when participants aren’t randomly assigned to experimental conditions
- covariance must share no variance with experimental groups: the expected value of covariance will be the same for every group
—> group means for covariance will be equal
11
Q
Solution for violation of:
The independence of covariate and experimental effect
A
- assign participants randomly to experimental groups
- or: match experimental groups on the covariate
12
Q
Statistical Requirement:
Independence of Covariate and experimental effect
A
- no statistical requirement for experimental effect to be independent of covariate
- this assumption makes interpretation more straightforward
13
Q
Temporal Additivity
A
- assumption that all experimental groups would experience the same change in covariate over time if the experimental groups had no effect
- according to Senn: the idea that ANCOVA is biased unless experimental groups are equal on the covariate applies only when there is temporal additivity
- when we have temporal additivity: make sure that the covariate is same in all experimental groups
14
Q
Homogeneity of Regression Slopes
A
- relationship between outcome (dependent variable) & covariate is the same in each of our treatment groups
- visual representation: scatter plot of covariate vs outcome for each experimental group
15
Q
Homogeneity of Regression Slopes
- how to check for it
A
- When an ANCOVA is conducted we look at overall relationship between outcome (dependent variable) & covariate
- fit a regression line to entire data set, ignoring to which group a person belongs
- imagine plotting a scatterplot for each group of participants with covariate on one axis and outcome on the other
16
Q
Heterogeneity of regression slopes
A
- relationship between participant’s outcome and covariate is different in the different experimental groups
17
Q
What are the consequences of violating the assumption of homogeneity of regression slopes?
A
I. Type I error rate is inflated and the power to detect effects is not maximized
—> This is especially true when group sizes are unequal and when the standardized regression slopes differ by more than .4
18
Q
What to do when assumptions are violated?
A
- bootstrap (robust)
- post hoc (robust)
- R (main bits of ANCOVA can not be done using bootstrap or post-hoc test)
19
Q
If assumption of Homogeneity of Regression Slopes is violated:
A
- use a multilevel model
20
Q
ANCOVA: SPSS
- Testing the independence of the treatment variable and covariate
A
- Run ANOVA
- Outcome or Dependent Variable: Covariate
- Predictor or Independent Variable: Experimental groups
- if F of predictor is non-significant then assumption has not been violated
21
Q
ANCOVA: Main Analysis: SPSS
A
I. Analyze
II. General Linear Model
III. Univariate
22
Q
ANCOVA: Contrasts
A
- You can NOT enter your own codes
- Select one of the standard contrasts
23
Q
ANCOVA: Other Options
A
- here you can get a limited range of Post-Hoc tests
24
Q
ANCOA:
How to specify Post-Hoc test?
A
- select the independent variable and drag it to the box labeled: Display Means
- select compare main effects
- Select either Bonferroni or Sidak
- Sidak more power than Bonferroni
- Descriptive
- Parameter Estimates
- Homogeneity test
25
Planned Contrasts in ANCOVA
- use regression
- create all dummy variables
- Compute a hierarchical regression where the covariate is entered first and then enter all dummy variables
Dummy 1
Control -2
G1 1
G2 1
Dummy 2
Control 0
G1 - 1
G2 1
26
ANCOVA: Bootstrap
- useful for parameter estimates and post-hoc tests but not main F test
27
ANCOVA: Options
- Estimates of Effect Size
- produces partial eta square
28
ANCOVA: Options
- Contrast Coefficient Matrix
- useful to see which groups are compared in which contrast
29
Spread vs Level plot
- useful to check if there is a relationship between mean and standard deviation
- if a relationship exists: transform
30
Residual Plot
- useful to assess homoscedasticity
31
ANCOVA: Levene’s test
- ANCOVA is more concerned about the homogeneity of residuals rather than that of variance
- so if Levene’s test is significant: ignore
32
Homogeneity of Residuals
- use Residual plots
- Post-Hoc tests
- bootstrap
33
ANCOVA: b
- df of t-test
- df(t-test)= N-p-1
| - p: number of predictors including the covariate
34
ANCOVA: Dummy Variables
- experiment 1: all who have value 1
- experiment 2 all who have value 2
- experiment 3: control: coded with 0
Experiment 1: b: represents the difference of means for those who have 0 and those who have 1
Experiment 1: b: represents the difference of means for those who have 0 and those who have 2
35
ANCOVA: Contrasts
- if results in bootstrap are different from other contrast analysis: reflects that our data may be biased
36
ANCOVA: Interpreting the Covariate
- draw Scatter plot:
x-axis: covariate
Y-axis: outcome
—> check their relationship
- also use the parameter estimates table for Beta value of covariate
37
ANCOVA:
- Testing the assumption of homogeneity of regression slopes
- relationship between covariate & outcome should be similar at different levels of the predictor variable
- Rerun ANCOVA: Specify Model: Custom
- Enter main effects as well as interaction!!
38
ANCOVA: Calculating Effect Size
- eta squared (mu squared): total variance that a variable explains
- partial eta squared (partial mu squared: the proportion of variance that a variable explains that is not explained by other variables in the analysis
39
Eta Square Formula
- μ^2= SSeffect/SST
40
Partial Eta Square Formula
- partial μ^2= SSeffect/ (SSeffect+SSR)
41
What is ANCOVA used for?
- to compare several means adjusted for 1 or more other variables (covariates)
42
ANCOVA: Effect Size:
- Omega Squared (ω^2)
- can be calculated only when we have equal number of participants in each group
43
ANCOVA: Effect Size
- Contrasts
- r contrast = √[t^2/ (t^2 +df)]
| - r covariate: same formula
44
ANCOVA: Reporting Results
- The covariate, partner’s libido, was significantly related to the participant’s libido, F(1, 26) = 4.96,
p =.035, r =.40. There was also a significant effect of Viagra on levels of libido after controlling for the effect of partner’s libido, F(2, 26) = 4.14, p = .027, partial η2 =.24.
- Planned contrasts revealed that having a high dose of Viagra significantly increased libido compared to having a placebo, t(26) = −2.77, p =.01, r =.48, but not compared to having a low dose, t(26) = −0.54, p =.59, r =.11.
