11 - Effect Size And Power Flashcards
Effect size
The extent to which two populations do not overlap
Importance of effect size
- summarise a series of experiments with the same IV and DV
- is independent from sample sizes, different means and variances
- complement test of statistical significance
- rank several IV within the same experiment
- help us calculate the sample size needed for a study
Level of effect size
Small d=0.2 (85% overlap)
Medium d= 0.5 (67% overlap)
Large d=0.8 (53% overlap)
Standardised mean difference.
d= (M1-M2)/SD
The larger the difference between two population means
The greater the defect size
The smaller the variance within two populations
The greater the effect size
The greater the effect size
The greater the power
Statistical power
The probability that the test will correctly reject a false null hypothesis
Factors that influence power:
- the bigger the sample, the bigger the power
- changing the design of a study can increase the power to detect significant differences
- the smaller the SD the greater the power (more stable conditions, precise measures, less diverse pop)
- use less stringent level of significance (low power 1%, big power 10%)
- use one tailed test
Low power means
That event is H1 is true, this study is not likely to give significant results in support of it.
Effect size d formula
(M1-M2)/SD
Within group SD
Tells us about the degree of error dur to individual differences
Decrease from 0.05 to 0.01
We decrease the chance of type 1 error, rejecting the null hypothesis when it’s true but we increase the probability of type 2 error, accepting the null hypothesis when it’s false.