LEC 5 Parametric Tests ll Flashcards
Parametric tests for >2 groups
- independent
- related
- one-way ANOVA (independent)
2. repeated measure ANOVA (related)
One-way ANOVA assumptions (4)
- the samples are random samples of their population
- the underlying populations are normally distributed
- the underlying populations are independent
- the underlying populations have equal variances
- unequal variances (Welch ANOVA)
Why do we need to use one-way ANOVA instead of conducting all possible independent-samples t-tests?
To control the overall probability of making a Type l error on the pre-determined significance level (alpha=0.05)
Type 1 error : false +ve (results say have association but in reality no association)
Type l error
= 1 - alpha
- alpha = 0.05
- false positive
- reject null hypothesis when null hypothesis is true
- in reality there is no statistically significant difference but results show statistically significant difference
Type ll error
- beta
- false negative
- failure to reject null hypothesis when alternative hypothesis is true
- in reality there is statistically significant difference but results show no statistically significant difference
2 sources of variation
- within groups (SD)
2. between groups (mean compared to overall mean)
Within group variation
- variation of individual values around their population means
- SD
Between groups variation
- variation of population means around the overall mean
- one way ANOVA will yield p<0.05
- hence do post-hoc test to determine where is the difference in population means
Overall mean
Summation of all scores / entire population
One-way ANOVA hypothesis
Null hypothesis
- all the means of the underlying populations are the same
Alternate hypothesis
- not all the means of the underlying populations are the same
OR
- the means of at least 2 of the underlying populations are different
Tests of normality
- Shapiro-Wilk (n<50)
2. Kolmogorov-Smirnov (n>=50)
Normality test hypothesis
Null hypothesis
- the underlying population follows normal distribution
Alternate hypothesis
- the underlying population does not follow normal distribution
Tests of equal variance
- F test
- 2 independent groups
- normal distribution - Levene’s test
- at least 2 independent groups
- normal or non-normal distribution
Levene’s Test hypothesis
Null hypothesis
- the underlying populations have equal variances
Alternate hypothesis
- NOT ALL underlying populations have equal variances
If one-way ANOVA test shows significant difference, what other test to do?
Post-hoc test
To determine where the difference lies
Post-hoc test (2)
- identify the differences while controlling the overall probability of making type l error (alpha)
- involve testing each pair of means individually
More conservative post-hoc test (3)
- means a larger diff is required to show significance in the test
- reduces statistical power (1-beta) and thus higher chance for type ll error (beta)
- allows the control of type l error
type l error : false +ve
type ll error : false -ve
Types of post-hoc tests (5)
- Bonferroni adjustment
- Least Significant Difference (LSD) test
- Tukey’s test
- Scheffe’s procedure
- Dunnett’s test
Bonferroni adjustment (3)
- very conservative
- for any type of statistical tests (parametric & non-parametric)
- adjusted significance level = (alpha/m)
m = number of pairwise comparisons
LSD (3)
- least conservative
- hence higher chance of type l error (false +ve) & show more statistical significance
- strongly discourage to use it
false +ve : rejecting Ho when Ho is true
Tukey’s test
- more conservative than LSD
Scheffe’s procedure
- most conservative
Dunnett’s test
- to compare against control group
Repeated measures ANOVA
to compare >2 paired groups
eg same group of subjects over different conditions
Repeated measures ANOVA hypothesis
Null hypothesis
- the means of the underlying populations are equal
Alternate hypothesis
- not all the means of the underlying populations are equal
OR
- the means of at least 2 populations are different
Relationship between LSD and Bonferroni test
Bonferroni p-value = m x (LSD’s p-value)
cos Bonferroni adjustment is alpha/m & LSD does not adjust for alpha value
Types of pairing in paired groups
- Self pairing
- self control - Matching
- similar characteristics/baselines are compared
Adjusted significance level (Bonferroni adjustment)
= alpha/m
m is the number of comparison group/pairwise group
ANOVA
Analysis of Variance
Statistical test for :
- > 2 independent groups
- continuous normally distributed
- equal variance
One-way ANOVA
Statistical test for :
- > 2 independent groups
- continuous normally distributed
- unequal variance
Welch-ANOVA
When using statistical software to compute p-values for post-hoc analysis, do you take into consideration bonferroni’s adjusted significance level or p=0.05?
Depends
- cos software might readjust p-value back to 0.05 level
- check footnote for the significance level
p<0.05 for one-way ANOVA
- suggests between group variability
- cos assumption of one-way ANOVA is equal variance within sample groups