Topic 2 Flashcards
why are most published research findings false?
statistical challenges
biases
misconduct due to reward system in science
of 49 articles, how many were shown to be wrong?
14 (41%)
ppV
positive predictive value
probability that a research finding the has been claimed to be true, is in fact true
1-B
(1-type 2 error rate)
Type 1 error
failure to reject a null hypothesis
false pos
type 2 error
false negative
failure to reject a null hypothesis
corollary 1: smaller the studies, the less likely they are to be true
small sample = small power
= small PPV
Corollary 2: smaller the effect size the less likely it is to be true
power decreases with small effect
lots of false positives
Corollary 3: greater the # and lesser the selection of tested relationships, less likely to be true
PPV depends of restudy odds (R)
research findings are more likely to be true in confirmatory designs
Corollary 4: greater the flexibility, less likely they are to be true
flexibility increases potential for bias (U)
common standards =increase PPV
Corollary 5: greater financial interests, less likely the findings are to be true
bias
Corollary 6: hotter the scientific field, the less likely the research findings are to be true
PPV decrees with increasing number of research teams
Proteus phenomenon
Proteus phenomenon
rapidly alternating extreme research claims and extremely opposite refutations
common in molecular genetics