PG MANOVA

Question 1

What is MANOVA

Answer 1

Ð ANOVA with multiple DVs

Ð Mean diffs between groups or combinations of DVs

Ð Math same as discriminant function analysis, so we are mathematically constructing a DV which maximises the diff between the factors, and does it each separately for each factor. New DVs are linear combination of DVs.

Ð Different combination of DVs for each effect in design.

Question 2

why manova?

Answer 2

MANOVA is especially appropriate when the investigator has gathered a system of dependent variables to address a multivariate hypothesis. A variable system is “loosely defined as a col- lection of conceptually interrelated variables that, at least potentially, determines one or more meaningful underlying variates or constructs”

Question 3

Why measure same DV several different ways, or analyse or measure multiple DVs?

Answer 3

Ð Capturing broader and richer information

Ð Any IV that is valuable is likely to affect participants in more than one way…. Say, psychological and physiological distress (e.g. stress intervention might affect physiological (heart rate / ski conductance) & emotional (scale report) & observational etc etc. Some people say bung in a load of measures so you catch any effect possible. But this is slightly dubious. \

Question 4

when you run a MANOVA with 4 DVs …. what else do you get in the output?

Answer 4

4 separate ANOVAs - useful to save time

Question 5

if you must run post-hoc tests, which one?

Answer 5

tukey

Question 6

one assumption is critical here…. that is?

Answer 6

homogeneity of varaince-CO-VARAINCE matrices

Question 7

how does one test for CO-VARAINCE?

Answer 7

in multivariate = Box’s test =

Question 8

What is the ANOVA version to test for homogeneity of variance?

Answer 8

Levene’s test

Question 9

what does Levene’s test care about

Answer 9

variance BETWEEN GROUPS

Question 10

what are the 4 tests for MANOVA?

Answer 10

Ð Pillai’s trace (Bartlett) – most robust against violations of assumptions (when N equal) + best when var is >1 variate
Ð Wilk’s Lambda
Ð Hottelling’s Trace
Ð Roy’s Largest Root - powerful if diff is on first variate

Question 11

what are the advantages of MANOVA over ANOVA?

Answer 11

Ð Multiple DVs increase chance of getting an effect

Ð Protection against type-1 error inflation (finding effect when there is none by chance as running so many separate ones – think frmri)

Ð Can (rarely show effects not possible in ANOVA) - Ð Sometimes might have more power

Ð More separation in 2D than you could get in 1D between the 2 alone. Happens super rare. (THIS IS WHERE COLE PAPER COMES IN)

Question 12

what are the disadvantages of MANOVA over ANOVA?

Answer 12

Ð ADDITIONAL assumption
Ð Vague and ambiguous outcomes (omnibus)
Ð Usually LOWER POWER (see cole)

Ð POWER declines when adding more DVs
Ð On the very reason you might want MANOVA (multiple DVs) – actually you reduce power anyway.

Question 13

what was alans take home message?

Answer 13

TAKE HOME MESSAGE: THE WAY VARIABLES WORK, IT’S GEN CASE THAT MANOVA WILL COME OUT WITH A LOW POWER COMBINATION

Question 14

MANOVA vs RM MANOVA

Answer 14

MANOVA vs RM MANOVA

Ð RM MANOVA = profile analysis = each repeated measure is a DV (only when >3 levels)
Ð MANOVA calculations use the scores from the k DVs
Ð RM MANOVA calculations use (k-1) transformed DV scores (e.g. the k-1 differences (segments) between adjacent scores).

MORE POWER using a univariate measure (see RM MANOVA)

Question 15

what is Doubly multivariate?

Answer 15

Doubly multivariate = MANOVA with RM (when RM is a composite DV like in this lecture)

Question 16

what are the 3 main assumptions of MANOVA?

Answer 16

1) INDEPENDENT OBSERVATIONS
2) OBSERVATIONS ON THE DV FOLLOW A MULTIVARIATE NORMAL DISTRIBUTION IN EACH GROUP
3) POPULATION COVARIANCE MATRICES OF DVs FOR THE GROUPS ARE EQUAL (HOMOGENIETY OF VARIANCE-COVARIANCE MATRICES)

Question 17

details of INDEPENDENT OBSERVATIONS ?

Answer 17

Ð SERIOUS IS VIOLATED
Ð Dependant obs occur quite often in social science (e.g. co-operative learning / assessments of teaching methods)
Ð METHODS for dealing with: more stringent alpha / use multivariate analysis technique

Question 18

details of MULTIVARIATE NORMAL DISTRIBUTION?

Answer 18

Ð In UNI-variate - Only slight effect on power and effect as of central limit theorem and sampling distribution
Ð In MANOVA MULTI-variate: much stricter.
Ð All individual DVs need normality + any linear combination + any subsets of variables have multivariate normality – check scatterplots of each pair (cigar shaped – elliptical)
Ð IF VIOLATED
Ð Makes test unreliable as with ANOVA
Ð More serious with small sample sizes

Question 19

details of HOMOGENIETY OF VARIANCE-COVARIANCE MATRICES?

Answer 19

Ð MANOVA different from RM MANOVA
Ð MANOVA between groups = (HOMOGENIETY OF VARIANCE-COVARIANCE MATRICES)
Ð RM MANOVA = Sphericity (homogeneity of covariance)

Ð Keep the group sizes equal as always

ALWAYS make correction when doing subsequent individual ANOVAs after – just use Bonferroni as easy to remember, but more conservative.

Question 20

what are the basics of step-down analysis ?

Answer 20

Ð Tests each DV in riority order
Ð Establishes if each DV is affected by group treatment after controlling for effect of other higher priority DVs
Ð Highest priority DV is tested by ANOVA, and the rest are using ANCOVA
Ð Each successive DV is tested with higher priority DVs as covariates

Issue with multiple comparisons and differential weighting of alpha correction (a priori, imp variables are given more stringent corrections and vice versa)

Question 21

how does one calculate bonferroni ?

Answer 21

alpha divided by the number of tests

Question 22

Box’s test - what does it need to be?

Answer 22

Tabachnick and Fidell say that Box’s test is sensitive: as a rule of thumb you only really need worry if unequal sample sizes and p < .001. If you were worried, or if it was worse, you could review data screening, e.g. were we too liberal with outliers, should we consider a transformation? See T&F for further discussion.

Question 23

if we check Box’s, we should also check…..?

Answer 23

Since the question asks about homogeneity tests in the plural, we might note at this point that Levene’s test (for the univariate tests)

Question 24

What other detail in the output can we use with a rule of thumb to garner equal variance past Box’s and Levene’s?

Answer 24

Note the ratios of the relevant SDs (must not be greater than 4:1. As a rule of thumb this means that we can proceed with the Anova)

Question 25

how to check Mahalanobis distance/?

Answer 25

run regression with variables
click save MD

The MD measure is compared against the critical value of the chi-squared distribution with p=0.001 and df=8 (the number of variables involved).