Power (concepts and calculating) Flashcards
What is power
Probability of correctly rejecting a false H0 (carried out before study
Factors affecting power
- size of alpha (decreasing alpha = decreased power, increasing alpha = increased power)
- directionality
- size of effect (bigger size of effect = easier to detect (power)
- size of population standard variation (affects SEM) - (as sigma increases, SEM increases, power decreases)
- size of number of participants (affects SEM) - as the number increases, SEM decreases, power increases)
What is needed to calculate power
- ⍺
- 1-tailed of 2-tailed
- 𝛾
- σ
- n
*Cannot calculate ‘the’ powder for an experiment - it requires knowing the true effect size 𝛾 which depends on the true population mean (μ1)
Cohen’s rule of thumb
- Used when researcher doesn’t know enough about the DV to identify the effect size
size of effect
.2 = small effect
.5 = medium effect
.8 = large effect
Effect size
An effect size is a standardized measure telling you how big to expect the mean differences between conditions to be
What is fixed in power
gamma, alpha and the tails are typically fixed the only thing variable and manipulable is the number of participants and the power
How does confidence interval show precision
- Precisions is reflected in the width of the confidence interval
○ Higher precision = narrower interval
Increasing n = increased precision
What are the methodological issues when calculating power
○ Draws attention to β (type 2 error) and 1-β (power or sensitivity)
○ Focus on effect size as well as significance
○ Highlights the distinction between statistical vs practical significance
§ By specifying a minimum effect size of interest = saying that any smaller effect than that value has so practice important (even if H0 is false)
§ All null hypotheses can be said to be false since true value of μ is unlikely to be exactly equal to μ0
Hence focus should be on whether H0 is false to an important degree (minimum effect size of practical importance)
As the P value decreases….
P value decreases as n increased because it reduces the standard error or variance and increases t stat
T increase p decrease