Lecture 9: Randomized Controlled Trials and Statistical Power Flashcards
What are RCTs?
- experimental investigation that randomly assigns participants to an intervention or control group
- ensures a balanced distribution of confounders between study groups
- able to determine causality rather than only association
What are the aspects of RCT that are difficult to achieve in nutrition research?
- blinding
- placebo-control
RCTs vs observational studies in terms of randomization
RCTs is able to determine causality because there is an actual intervention and you are holding all of the other factors constant if the randomization is done appropriately. It is different from an observational study bc in an observational study you are not doing anything to your participants, you observe relationships, but you cannot comment on causality. They might be related but you cannot say one caused another. The issue of knowing directionality, what caused the outcome.
CONSORT
Consolidated Standards of Reporting Trials
What do you have report when you are registering your RCT?
Protocol
Outcome measures of interest
- Primary outcome
- Secondary outcome
Why report trials before hand?
- transparency
- track changes
- prevent fishing expeditions where you look at lots of variables and measurements trying to find something interesting.
- keep scientific integrity more robust
What are the commonly used randomization methods?
simple and stratified
Explain simple randomization
each participant is randomly assigned to treatment or control group
Explain stratified randomization
participants are first placed into strata, in order to control for a particular variable, and then participants within strata are randomly assigned to treatment or control group.
What are the potential risks for bias in RCTs
- loss to follow-up (attrition): when participants withdraw from the study or are unreachable
- non compliance: when participants in intervention group do not comply with the intervention (or when participants in control group adopt the intervention)
- these can lead to missing data
True/False
RCTs eliminate confounders and risk of biases.
False
RCTs eliminate the potential for confounders but they don’t eliminate the risk of bias. Just because you randomize your participants, it doesn’t eliminate this risk of error getting into your analysis, it eliminates confounding.
What is bias?
Bias is a systematic or random error that will skew the validity of your results.
Why is lost to follow up is a problem?
- missing data
- if you have disproportionate numbers of participants who finished your intervention than your control then there could be something about those participants who didn’t finish the intervention that would have been important to have their data for.
- journal and peer reviewers pay attention to these numbers.
What are the ways of dealing with missing data in RCTs?
- per protocol analysis
- as treated analysis
- intention-to-treat analysis
Explain the per protocol analysis
includes only participants who have completed the originally allocated treatment (i.e. removes drop-outs and non-compliant participants)
- sample size reduces.
Explain the as treated analysis
groups participants according to the treatment they actually followed, rather than what they were intended to follow (i.e. attempts to mitigate non-compliance)
Explain the intention-to-treat analysis
includes all participants in the groups to which they were randomly assigned, regardless of compliance or study completion (“once randomized, always analyzed”)
How to manage missing data in ITT?
- last value carried forward
(use the last available measured value in the final analysis) - imputation
(use statistical modelling to estimate what the missing value(s) would be if the participants completed the study.)
What is type 1 error?
alpha
it is rejecting a true null hypothesis (false positive)
you say you have found statistically significant results when you actually have not.
What is type 2 error?
Beta
is when you accept a false null hypothesis means that you have incorrectly generated results that are not statistically significant.
What is statistical power?
statistical power is the likelihood that a study will detect an effect when there is an effect there to be detected. If statistical power is high, the probability of making a Type II error, or concluding there is no effect when, in fact, there is one, goes down.
Why to calculate sample size?
- to know what is the minimum sample size needed to detect a statistically significant result?
- done a priori
Why to calculate statistical power?
- given a specified sample size and effect size, what is the statistical power to detect a statistically significant result?
- done after the study
Why is power calculation done after the study?
for examples NHANES, CCHS are collecting data constantly and if you wanted to do a study on that then your sample size is set for you so you cannot control that. So, you run a power calculation to see if you will have enough power to detect a significant result. You need to know your effect size.