Systematic reviews Flashcards
Why do we need to review research?
So many articles, we need a good summary
What is a review?
Summary of what is known, often prepared by an expert and can be on any topic
What are the advantages of a traditional review? 3
Summarise everything Give flavor of a subject Might point us towards original research
What are the problems with a traditional review?4+
Messy Not clear Only sees part of the picture Unscientific- not standardised, no clear purpose, presents impressions of one individual
What do systemic reviews do?
Allow us to objectively review all available evidence Attempt to collate all evidence to answer a specific question using systemic ways More reliable
What do systemic reviews mostly look at?
effects of a treatment on a disease
Where does the best evidence for systemic reviews come from?
Randomised controlled trials
What type of data do most systemic reviews use?
Summary/aggregate data
What does a protocol for a systemic review need to have?6
Clear question with objectives set out search strategy to identify all trials consistent data collection across all trials Assessment of trial quality Synthesis of results Structured presentation of results
5 things systemic reviews should specify
PICOS Population Intervention Comparison Outcomes Study design
How to ensure the studies are similar
Set up good eligibility criteria Include trials with sim questions Some difference eg dosage expected
Where do you find studies: how
Rely on bibliographic data bases, build a structured search strategy and use index terms and free text terms
Biases involved with finding studies?
Studies with more dramatic results are more likely to be published, quicker and in better journals Publication bias, time lag bias, language bias –> reporting biases
How to avoid reporting biases?
All relevant trials published and unpublished checked
other than bibliographic data bases, where to look? 5
Grey literature Conference abstracts and proceedings Trial registers References for relevant articles Ask experts in fields
Which studies do you exclude?
Ineligible populations, interventions, comparisons and study types
How to collate data?
Using a predefined form
3 other challenges with obtaining enough data: what to do
Trial authors might not report results for some outcomes Not give detailed report of methods Not state exclusions –> ask for missing data
Why do you need to assess study quality?
Trials with poor design, conduct or analysis may over or underestimate effect of treatments
How to assess quality of studies?
Need to extract info to judge (methods of randomisation, analysis methods, outcomes)
A good systematic review will: 3
Provide a comprehensive objective and unbiased summary of all evidence Overcome problems with traditional reviews Results can be presented narratively as it will have a meta analysis
What is a meta analysis?
Quantitatively combining results of related trials to get an overall average effect of treatment
Why use meta analysis?3
To detect smaller effects reliably (they might still be very imp) Provides more patients than any one trial so greater power to detect difference between treatment and control and greater confidence that estimate of effects represent the truth