L4 Critical Appraisal of Systematic Reviews Flashcards
core aim of reviews
to collect, evaluate and present the available research evidence of a topic
why may individual studies be misleading
chance or bias
why must the evidence base be synthesised
so an observer can reliably understand its implications
what does an increase of primary research lead to
an increase of reviews
how many types of reviews exist
about 25
types of reviews
11
- Systematic review
- Scoping review
- Meta-analysis
- Literature / Narrative reviews
- Rapid reviews
- Living reviews
- Critical reviews
- Overviews
- Qualitative systematic reviews
- State-of-the-art reviews
- Umbrella review
what is a systematic review
A summary of all available primary research or evidence in response to a research question. A systematic review uses all existing research and is sometimes called secondary research (research on research). They are often required by research funders to establish the state of existing knowledge and are frequently used in guideline development (Clark, 2011)
five types of systematic reviews
- Effectiveness reviews
- Experiential (qualitative) reviews
- Costs/Economic Evaluation reviews
- Prevalence and/or Incidence reviews
- Diagnostic Test Accuracy reviews
describe effectiveness reviews
- Most common type of systematic reviews
- Assesses the effectiveness of an intervention
- Widely used to inform the development of trustworthy clinical guidelines
- Questions are developed often using the PICO format
(Munn et al., 2018)
what is effectiveness
the extent to which an intervention, when used appropriately, achieves the intended effect
indications for systematic reviews
- Uncover the international evidence
- Confirm current practice/ address any variation/ identify new practices
- Identify and inform areas for future research
- Identify and investigate conflicting results
- Produce statements to guide decision-making
(Munn et al., 2018)
what is a scoping review
“exploratory projects that systematically map the literature available on a topic, identifying key concepts, theories, sources of evidence and gaps in the research.“
Canadian Institute of Health Research
what is a meta analysis
a combination of a group of studies to reach a conclusion statistically about the effect if an intervention.
when not to conduct a meta-analysis
- Heterogeneity of studies (can also be tested statistically)
- Poor quality of studies
- Publication bias (selective publication of positive studies and exclusion of negative studies)
- Small number of studies or limited sample size
why is a limited sample size a reason to not conduct a meta-analysis
- Too few studies or studies with limited sample sizes provide less information to summarise or pool the results.
- Can yield inaccurate, unstable or erroneous results.
- Too few studies in the trial impede the exploration of publication bias and can confound the conclusions.
six steps of conducting a systematic review
- Prepare your topic
- Search for studies
- Screen studies
- Extract data
- Analyse and synthesis evidence
- Report findings
high quality
Grade working group grades of evidence
further research is very unlikely to change our confidence in the estimate of effect
Flynn et al 2018
moderate quality
Grade working group grades of evidence
further research is likely to have an important impact on our confidence in the estimate and may change the estimate
flynn et al 2018
low quality
Grade working group grades of evidence
further research is likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate
very low quality
Grade working group grades of evidence
we are very uncertain about the estimate
flynn et al 2018
what does PRISMA stand for
Preferred Reporting Items for Systematic Reviews and Meta-Analyses
what is PRISMA
an evidence-based minimum set of items for reporting in systematic reviews and meta-analyses
three limitations of systematic reviews
- Systematic reviews are costly and take a long time to produce. The need for good evidence is often urgent.
- Systematic reviews answer a specific clinical question. In real life, the useful question is sometimes broader.
- Once published, systematic reviews can quickly become out-of-date as new evidence emerges. When evidence becomes incorrect in this way, it has the potential to cause harm