L9 - One-Way ANOVA Assumptions and Designs, Error Rate Control Flashcards
What do the Brown-Forsyth and Welch tests do?
Brown-Forsyth and Welch tests are used when homogenity of variances is not met in a one-way between-subjects ANOVA.
They adjust the observed F value and degrees of freedom to make the actual false rejection rate closer to the nominal rate set by alpha.
What are three statistical assumptions for one-way between subjects ANOVA
- homogeneity of variances
- independent observation
- balanced design
What should be done if there is a discrepancy between inferences from Brown-Forsyth and Welch tests?
If there is a discrepancy between inferences using F* and W, when sample size differs AND variances are heterogenous, we should not reject the omnibus null hypothesis, if it is being used.
What happens if there is a violation of homogeneity of variances, but sample sizes are the same?
The homogeneity of group variances assumption operates in a very similar way to that in the independent two-group design – if the sample size of each group is the same, or are almost the same, then inferences for both the omnibus test and planned comparisons are robust to mild-to-moderate violation of this assumption.
If there is evidence that there is a violation of homogeneity of variance, what will the outcome be for the one-way design if it is a) balanced and b) unbalanced?
➢ Balanced: The Fcontrast/tcontrast tests for planned comparisons will generally still be robust when using MSwithin.
➢ Unbalanced: The use of MSwithin in testing planned comparisons will not be robust. –> need to use ROBUST TEST STATISTICS, using separate variances for the standard errors in planned comparison.
What is an important assumption for within-subjects ANOVA using repeated measures?
the INTERVAL between TWO ADJACENT MEASUREMENTS must be the same for all people
What is the SS within subjects further decomposed into?
SS within subjects = SS between occasions + SS individual x occasion interaction
occasion = variable/time point measurements
What is the df for SS individual x occasion interaction?
(n-1)(k-1)
What is the df for SS occasions?
k-1
What is the df for SS within ?
N-n
What is the df for SS between?
n-1
How do we calculate the observed F statistic in within subjects ANOVA?
F = MS occ / MS error
What are the two options for testing a null hypothesis using within-subjects ANOVA?
➢ The multivariate test – which does not assume sphericity of the covariance matrix among the dependent measures (this will not be approached in this subject); or
➢ The univariate test – which does assume sphericity.
What kind of within subjects ANOVA does not assume sphericity?
Multivariate test
What is sphericity?
Recall that the two important features in the dependent samples t test were:
➢ The use of difference scores between the set of paired measurements of each participant; and
➢ The strength of the correlation between the two sets of scores for reducing the size of the standard error.
The assumption of sphericity requires at a population level that:
➢ The variance of all difference scores between any two levels are the same; and
➢ The covariance between all sets of differences scores to also be the same.
A sufficient (but not necessary) condition for sphericity to hold is that the covariance matrix of the observed scores on all levels of the factor to show compound symmetry.
What is compound symmetry?
A covariance matrix demonstrates compound symmetry if all variances along the diagonal of the matrix are the same value and if all off-diagonal covariances are also the same value (which implies that all correlations among the variables are equal).
What is Mauchly’s test of sphericity?
➢ The null hypothesis for Mauchly’s test is that the covariance matrix demonstrates sphericity, therefore we do not want evidence to reject this null hypothesis (i.e. a small obtained p value is undesirable).
➢ The test itself can be affected by mild departures from normality in the DV scores, and therefore a significant result can reflect this occurrence rather than a departure of sphericity.
What is epsilon?
Epsilon is a sample statistic measuring the degree of departure from sphericity.
If sphericity is present, population epsilon equals 1.
Its lowest possible value is 1/(k – 1); i.e. the lower-bound value in the third estimate provided – it can be ignored.
The Greenhouse-Geiser estimate is a more conservative estimate of the population epsilon that controls ER≤α.
The Huynh-Feldt estimate is more liberal.
If the Huynh-Feldt equals 1, then the obtained p value for Mauchly’s test will be >.05
Note: If in doubt, use Greenhouse-Geisser, as it is the middle estimate.
Why is it important to run epsilon test?
The relevance of these estimates of epsilon is that violation of the assumption of sphericity makes the obtained F test no longer robust for the omnibus null hypothesis in within-subjects ANOVA and for planned comparisons—its becomes very liberal in these circumstances.
The epsilon estimates provide a way to adjust the degrees of freedom for the F test so that the false reject error rate is maintained close to alpha when the omnibus null hypothesis is true.
How do we correct the degrees of freedom using epsilon?
By multiplying both degrees of freedom for the omnibus f test by the relevant epsilon estimate.
What are orthogonal polynomial planned comparisons?
These are a wet of planned contrast weights used in one way between subjects ANOVA, to see what kind of change might be occurring across time.
is it linear? quadratic? cubic? quartic? etc.
can have k-2 planned orthogonal comparison weights.
–>set of orthogonal polynomial contrast weights completely account for all possible change b/c theyre ORTHOG.
–> prepackaged by SPSS, don’t need to work them out.
How can we visually identify what ‘order’ polynomials may fit the data well?
by counting the amounts of ‘bends’ in the graph.
3 bends –> cubic
What are the two different kinds of standardised mean contrasts for within-subject designs?
- Standardised group differences
- Standardised individual change
XECI will calculate point and interval estimates for group difference, but only point estimate for individ. change.
USE BONNETS DELTA or STANDARDISED D for individ change, and hedges’ g for group diff!
What’s the difference between alpha value and false rejection error rate?
- ALPHA is set BEFORE undertaking the null hyp test
- FALSE REJECTION ERROR RATE occurs AFTER deciding to reject the null hyp
