4 - Testing hypothesis and their limits Flashcards
How can we obtain confidence intervals?
From the variance and standard deviation of the mean
Measures of dispersion
Variance and standard deviation
Standard Deviation
most common measure used for normal or near normal distributions.
• Defined by a statistical formula, but remember that:
• The mean +/- one SD contains about 2/3 of the observations.
• the mean +/- 2 SD’s includes about 95% of the observations.
Variance
- first compute the mean and store it
- subtract the mean from every sample, Xi, square it and store the result
- sum all the squared values
- divide the sum by n-1
95% confidence interval
(h - 1.96 x s.e(h)) (h + 1.96 x s.e(h))
normal distribution
A function that represents the distribution of variables as a symmetrical bell-shaped graph.
measures of central tendency
mean, median, mode - in a normal distribution, all are equal
Parametric statistical methods assume a distribution with known shape
Negative + positive skew
negative - Bell of curve is to the right
positive - Bell of curve is to the left
Two things that lead to narrower (or wider) confidence intervals:
- a larger sample size implies a smaller standard error = narrower.
- If the variance is small, the population will be fairly homogeneous and thus there will be little variation in any particular sample taken from the population = narrower.
Classical Hypothesis Testing:Steps
- Define the null hypothesis
- Define the alternative hypothesis
- Calculate a p value
- Accept or reject the null hypothesis based on the p value
- If the null hypothesis is rejected, then accept the alternative hypothesis
The Null Hypotheses
no difference between the two groups to be compared
The Alternative Hypothesis
there is a difference between the 2 groups to be compared
• Example: Difference in Pain Score on 100mm VAS of 13mm or greater
The p value
probability of obtaining the results observed, if the null hypothesis were true
• If p = 0.7, then the chance of obtaining the same results as the experiment is 70%
• accept the null hypothesis
• If p= 0.01 then the chance of obtaining the same results as the experiment is 1%
- Very unlikely due to chance!
- So we reject the null hypothesis
Rejecting the Null Hypothesis
- The cut-point for rejecting the null hypothesis is arbitrary (a)
- Typically, a = 0.05
- If the null hypothesis is rejected, then the alternative hypothesis is accepted as true
Limitations of the p Value
- p < 0.05 tells us that the observed treatment difference is “statistically significantly” different
- p < 0.05 does not tell us:
- The uncertainty around the point estimate
- The likelihood that the true treatment effect is clinically important