Lecture 24 chance 2 Flashcards
Internal validity
Extent to which we can rely on we think that the study findings valid based on how the study was done
3 components - chance, bias, confounding
Chance
Sampling error
P values
Based on hypothesis testing
Probability of getting study estimate (or one further from the null), when there is really no association in population, because of sampling error (chance)
P values telling us about associations about
Differences between groups
Whether or not that difference is sufficiently large, inconsistent with there being no difference of underlying population
Truth
Dont know it
Could be association between exposure and outcome Or no association between exposure and outcome
2 ways to be correct
Find an association when there truly is one Or not find an association when there isnt one
Consistent with the underlying population
Could be wrong in 2 ways
find an association in study (measure of association that does not equal null value) when there truly is no association (population parameter is of null value) Or no association when there is one
P values
Probability from study
Study has got it wrong this way it has found an association when there truly is not one in the population
P values require
Null hypothesis
Alternative hypothesis
Really is no association in the population
Population parameter equals null value (ratio measure null value = 1, Difference measure null value = 0)
Really is an association in the population hypothesis is
Parameter does not equal null value
P values Probability when
null hypothesis is true that our study has found an association when there truly isnt
Type 1 error
Finding an association when there truly isnt one
Set at 5%
Probability less than 5%
sufficiently unlikely that chance is the reason for finding this association
Threshold: 0.05 (5%, or 1 in 20)
Find association by chance
If p < 0.05
reject null hypothesis (no association)
Accept alternative hypothesis (is association in population)
Association is statistically significant
Never accept
null hypothesis
p > 0.05
Fail to reject H0
Reject HA
Association is: ‘Not Statistically Significant’