Define null hypothesis (H0)
Hypothesis of no effect/nothing happening
Define alternative hypothesis (HA)
Describes effect expected to see
Hypothesis Testing Steps
Define null distribution
Probability distribution of a test statistic value when a random sample is taken from a hypothetical population for which the null hypothesis is true
Type 1 error (alpha)
Rejecting a true null hypothesis (false positive)
- 5% chance of type 1 error usually
Type 2 error (beta)
Failing to reject a false null hypothesis (false negative)
- Do not usually know this value
- The smaller B, the greater the power of the test (power = 1 - B)
Power depends on:
If the test statistic we obtain from our sample leads to:
Decreasing type 1 error/alpha:
makes it harder to reject H0
- decreases type 1 error rate
- increases type 2 error rate
- decreases power
What are the ways to decrease sampling error?
Replication
Balance
Equal # of units in each treatment
- Minimizes the SE associated with the treatments. Larger samples are always better, but a balanced design allocates sampling effort optimally
Blocking
If you know what confounding variables might be, use:
blocking
If you don’t know what the confounding variables might be, use:
random assignment
Extreme treatments
Bigger manipulation usually leads to a bigger response
- Responses are not always linear