5 - External Validity Flashcards
what is internal vs external validity?
internal: the ability of the study results to support a cause-effect relationship btw the treatment and observed outcome
external: the applicability of the study results to patients
what is efficacy vs effectiveness?
- both wrt external validity!
- efficacy (aka explanatory/management): can intervention work under “ideal” circumstances?
- effectiveness (aka pragmatic): does the intervention work under “usual” circumstances?
- typically most trials will have both, but more efficacy
what are the 8 hierarchies within valid studies?
- participant eligibility criteria
- intervention flexibility
- practitioner expertise
- follow-up intensity
- nature of outcomes
- participant compliance
- practitioner adherence
- primary analysis
participant eligibility criteria
- p 66
intervention flexibility
- p 66
practitioner expertise
- p 66
follow-up intensity
- p 66
nature of outcomes
- p 67
participant compliance
- p 67
practitioner adherence
- p 67
primary analysis
- p 67
a statistically non-singificant result in a pragmatic trial can be interpreted as….
- either there is no diff btw the groups (signal is too small)
- or the variability in the outcome is too great to detect diff (noise too big)
if a well designed and executed efficacy study shows that the experimental treatment is no better than the control, we can conclude that..
- there is no diff btw treatment groups
- bc efficacy study has done all it can to reduce noise, so if we still cannot detect signal in this case, we know signal is not there (not big)