Module 2 Flashcards
Define null hypothesis (H0)
Hypothesis of no effect/nothing happening
Define alternative hypothesis (HA)
Describes effect expected to see
Hypothesis Testing Steps
- State H0 and HA
- Compute test statistics, compare data to H0 (how well sample results fir if H0 is true)
- Determine P-value
- Draw appropriate conclusions
Define null distribution
Probability distribution of a test statistic value when a random sample is taken from a hypothetical population for which the null hypothesis is true
Type 1 error (alpha)
Rejecting a true null hypothesis (false positive)
- 5% chance of type 1 error usually
Type 2 error (beta)
Failing to reject a false null hypothesis (false negative)
- Do not usually know this value
- The smaller B, the greater the power of the test (power = 1 - B)
Power depends on:
- How different the truth is from the null hypothesis
- Type 1 error rate
- Precision (sample size)
If the test statistic we obtain from our sample leads to:
- p-value < alpha = rejection of H0, there is a significant difference
- p-value >= alpha = fail to reject H0
Decreasing type 1 error/alpha:
makes it harder to reject H0
- decreases type 1 error rate
- increases type 2 error rate
- decreases power
What are the ways to decrease sampling error?
- Replication
- Balance
- Blocking
- Extreme treatments
Replication
- Application of treatment to multiple, independent experimental subjects or units
- To measure the precision of the estimate
- Avoid pseudoreplication by correctly identifying independent replicates
Balance
Equal # of units in each treatment
- Minimizes the SE associated with the treatments. Larger samples are always better, but a balanced design allocates sampling effort optimally
Blocking
- Helps to account for extraneous variation by dividing experimental units into groups
- Both treatments in both situations
- Cannot limit variation, so must account for it
If you know what confounding variables might be, use:
blocking
If you don’t know what the confounding variables might be, use:
random assignment