Systematic Review Flashcards

1
Q

What is a systematic review?

A

A summary of (all available) evidence on a particular topic based on a clearly formulated question that uses systematic and explicit predefined methods to identify, select and critically appraise relevant research and to collect and analyse data using validated methods from the studies that are included in the review

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are some examples of statistical methods used to analyse systematic review results?

A

Meta-analysis
Narrative
Realist review
Meta-synthesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why conduct a systematic review?

A
  1. To help identify which forms of health-care work are helpful, ones that are not and that are harmful
  2. Methods used inc. steps to minimize bias in all parts of the process
  3. Health-care providers/policy makers need to be evidence based making judicious use of evidence and ensuring practice is up to date
  4. Busy health care providers need quick and effective ways of identifying what works best for their patient
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What should a stringent study include?

A

Inclusion and exclusion criteria

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 3 key functions of a systematic review?

A
  1. Synthesise the evidence i.e. bring results from similar randomized trials together
  2. Understand heterogeneity in treatment effect
  3. Set the research and practice agenda
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does the term systematic refer to in a systematic review?

A

Combining the trials in a reliable way i.e. systematically

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When would we be likely to use systematic reviews?

A

Systematic reviews are the bedrock of clinical guidance e.g. NICE guidance so reading and using them is one of the best ways to stay abreast of what is new in your field of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the hierarchy of evidence from least to most rigour?

A
  1. Editorials and expert opinion
  2. Case series and reports
  3. Case-control studies
  4. Cohort studies
  5. RCTs
  6. Systematic reviews
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the types of quantitative review evidence?

A
  1. Prevention/treatment/therapy
  2. Causation
  3. Diagnosis/prognosis
  4. Cost/cost-effectiveness
  5. Prevalence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the types of qualitative reviews (meta-ethnographies)?

A

Experience/barriers/facilitators/meaning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Before you start a systematic review, what do you need to know?

A
Purpose of review
Nature of research Q
Population
Team factors
Search strategy
Type of studies/data inc. 
Outcomes (1mary/2ndary)
Methods of analysis/evaluation of outcome
Conclusions and added value
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How can you scope the literature to determine thee rationale for the systematic review?

A
  1. Cochrane library, PubMed, Google
  2. PROSPERO database to register it
  3. Has a similar review been done? If so, why undertake a new one?
  4. Awareness of possible nature and volume of evidence/implications for timeline and resource
  5. Further project ideas (evidence gaps highlighted in NICE guidelines)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What would you do when getting started?

A

Familiarise yourself with process and start preparing protocol following reporting guidelines (PRISMA-P) and consult standard reference books e.g. Cochrane handbook

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How can you translate a research question into a review?

A

Using suitable frameworks:

  1. PICOS (quantitative) = Population, Intervention, Comparison, Outcome and Study design
  2. SPICE (qualitative) = Setting, Perspective/Perspective, Intervention, Comparison and Evaluation

BUT each one may not be applicable for every question/review

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What should the protocol include?

A
  1. Informed by and refined from research questions

2. Inc. all relevant items (as stated by PRISMA and module guidelines)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is GRADE?

A

Systematic approach to rating the certainty of evidence in systematic reviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What relevant items should be included in a systematic review protocol?

A
  1. Search strategy (sources, terms, limits)
  2. Inclusion/exclusion criteria
  3. Data extraction
  4. Risk of bias assessment
  5. Analysis/synthesis plan (quantitative/qualitative)
  6. Presentation + interpretation (GRADE)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What should you do when literature searching and retrieving studies?

A
  • Seek assistance from librarian
  • Identify where you plan to search e.g. appropriate data bases
  • Identify search terms
  • Useful search techniques e.g. Free Test searching, Thesaurus or controlled language screening and combining terms (AND, OR, NOT)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the steps that take place after a search has been conducted?

A
  1. Identification: state no. of records identified through database searching and through other sources
  2. Screening: delete duplicates and state no. of records screened (inc. vs exc.)
  3. Eligibility: state no. of records assessed for eligibility (in/out) and no. of records excluded with reasons (PICOS/SPICE)
  4. Included studies: state no. of records included in qualitative/quantitative synthesis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How can you present results of a search? Why?

A

PRISMA flow chart/diagram that includes no. of hits, no. excluded and reasons for, the amount included in the review and the no. meta-analysed - shows transparency of search methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are the steps used after you have found studies to include in your review?

A
  1. Data abstraction: pre-defined data abstraction form linked to research Qs and aims
  2. Quality assessment using suitable tool to inform analysis and interpretation - GRADE (inc. high, low or unclear risk of bias)
  3. Analysis of results (quantitative/qualitative)
  4. Critical summary and write-up: present and interpret findings
22
Q

Define selection bias.

A

Systematic bias in the way participants are selected

23
Q

Define performance bias.

A

Systematic differences in the care provided to the participants in the comparison groups other than the intervention under investigation

24
Q

Define detection bias.

A

Systematic differences between comparison groups in outcome assessment (blinding)

25
Q

Define attrition bias.

A

Systematic differences between comparison groups in the loss of participants from the study (drop-outs)

26
Q

Define reporting bias.

A

Selective reporting of study outcomes

27
Q

What other types of bias exist?

A

Funding (conflict of interest if funder intervened)

Error in results

28
Q

What is a meta-analysis? What is the downside to using these?

A

If the results of the individual studies are combined produce an overall statistic requiring statistical packages to conduct the analysis (STATA + RevMan) HOWEVER, it will be subject to any biases that arise from study selection process and may produce a mathematically precise but clinically misleading result (may want to remove studies at high risk of bias)

29
Q

What information has to be harmonized to conduct a meta-analysis?

A
Outcome being examined
Timeframe for outcome
Summary effect size used 
No. of trials included 
Heterogeneity in comparison
30
Q

What is heterogeneity?

A

The % of variation between studies in this meta-analysis due to differences between studies and not just sampling error (I^2) which shapes our understanding of pooled effect e.g. is this the true effect or the average effect in a distribution?

31
Q

What are the different classes of heterogeneity?

A
0% = none
25% = low
50% = moderate
75% = high
32
Q

How can you present the results of your meta-analysis?

A

Forest plot

33
Q

What is the final row and diamond of the forest plot? What happens if it crosses the vertical line 1 or lies on either side?

A

Pooled effect (row) and point estimate (diamond) of all studies analysed

If it crosses the line at 1, there is no statistically significant difference however if it lies towards the side favouring the intervention, there is a statistically significant result favouring intervention and vice versa

34
Q

What is the middle vertical line in a forest plot?

A

Line of nil effect where there is no statistically significant difference (null hypothesis)

For OR = 1
For mean difference = 0

35
Q

How can you reduce heterogeneity?

A

Conduct further analysis

Look at factors alone to see if this reduces it

36
Q

How do you analyse results of a systematic review that are not quantitative and therefore cannot be meta-analysed?

A

Narrative analysis: description of studies that cannot go into a statistical meta-analysis as they are different and difficult to harmonize as well as being qualitative

37
Q

What types of bias exist in a systematic review?

A
Publication
Duplicate (multiple) publication
Language
Outcome reporting
Citation
38
Q

What is duplicate (multiple) publication bias?

A

If a systematic review counts the same study more than once as it has been published > 1 time exaggerating the outcome

39
Q

What it outcome reporting bias?

A

Reporting of outcomes that deviate from set plan because they encountered problems

40
Q

What is citation bias?

A

Researchers do each other a favour by citing each other a lot

41
Q

How can you represent publication bias if there is 10 or more studies? What does each dot represent? What should it look like?

A

Funnel plot where each dot represents a single study - should look like an inverted V symmetrical is publication bias is NOT present (will be asymmetrical and skewed if this type of bias exists)

42
Q

What is publication bias?

A

Studies with positive results are more likely to be published than negative studies - the subsequent over-representation of positive studies in systematic reviews may mean that reviews are biased toward a positive result.

43
Q

What should be included in your review team?

A
  1. 2nd reviewer
  2. Reference management, statistical and qualitative analysis software language support and resources
  3. Advice on literature search, review methodology and content expertise
44
Q

What should you consider in terms of other planning issues?

A
  1. Iterative process: seek feedback early
  2. Consider protocol registration (PROSPERO)
  3. Plan your timeline - do NOT underestimate time required (3 months - 4 years)
45
Q

How can you borrow wisdom from previous work?

A
  • Find systematic review of similar nature
  • Cochrane library (Medicine and Health-Related)
  • Campbell library (Education, Social Welfare, International Development etc.)
  • Published reviews and protocols in PubMed/Medline and Systematic Reviews journal
46
Q

What are the contents of a high quality systematic review?

A

Search strategy inclusive and reproducible
Flow of all studies/papers (PRISMA)
How inc. and exc. criteria apply (PICOS/SPICE)
Table of characteristics of studies (inc. and exc. reasons)
Quality assessment cohesive synthesis/analysis (+/- meta-analysis)
Practical application (context) of findings
Strengths and limitations of systematic review

47
Q

What are the 3 main sections in the CASP checklist?

A
  1. Are the results of the study valid?
  2. What are the results?
  3. Will the results help locally?
48
Q

What do the squares in a forest plot show?

A

The % weight given to each study indicating proportion that this study’s results contributed to pooled result in meta-analysis- studies weighted by inverse of variance for estimated measure of effect i.e. more precise studies with narrower CIs have a higher weighting

49
Q

What are the horizontal lines sticking out from squares on a forest plot?? Why are some longer?

A

Confidence intervals - less precise studies have bigger CIs and longer lines relating not to study size but the variability of patient response

50
Q

What would a odds ratio (OR) of 1.42with 95% confidence interval (CI) 1.17-1.73 indicate?

A

The odds are 42% higher
It lies between the 95% CIs and the CI does not inc. 1 (null hypothesis) meaning the null hypothesis can be rejected at the 5% level OR result is statistically significant