Appraising Systematic Reviews Flashcards

1
Q

What is a systematic review?

A

Method for of locating, appraising and synthesising research from primary studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How do systematic reviews differ from literature reviews?

A

prepared using predefined methods

- lit reviews don’t have strict requirements

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does conducting a systematic review involve?

A
  • research question
  • determine eligibility criteria (pre-defined)
  • comprehensive search to identify all relevant studies (beyond electronic searches)
  • select studies based on predefined eligibility criteria
  • appraise risk of bias in each study
  • extract data
  • synthesise results (meta-analysis)
  • interpret and report results
  • update review at an apropriate time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What type of reviews overlap with meta-analysis?

A
systematic reviews
lit reviews (no strict method)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Advantages of systematic review

A

Adv:

  • established generalisability of overall results
  • makes explicit differences in results
  • identifies gaps in knowledge
  • guides decision making
  • improves dissemination of evidence
  • hasten assimilation of research into practise
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Disadvantages of systematic review

A

can be done badly

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the best study design to assess effectiveness of intervention?

A

Systematic review of RCT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the best source for systematic reviews

A

Cochrane Database

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is so good about Cochrane systematic reviews?

A
  • rigorous standards

- editorial teams support reviews

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Can systematic reviews be updated?

A

YES- as new studies are released

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the checklists we use to appraise systematic reviews?

A

AMSTAR (Assessment of multiple systematic reviews)

  • CASP (checklist for appraising reviews)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Criteria for systematic reviews

A

AMSTAR- check word doc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q
  1. Were the methods used to combine the findings of the study appropriate? what are you looking for?
A

I^2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q
  1. Was the likelihood of publication bias assessed? What are we looking for?
A

funnel plot or Egger regression test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q
  1. Was conflict of interest included?
A

acknowledged sources of support in systematic review and included studies
- can be in declarations of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Most common way results are presented for meta-analysis

A

forest plot

17
Q

Interpreting funnel plot

box, line, size of box, diamond, points of edge of diamond

A
  • Box = mean
  • Line = confidence interval
  • Size of box = weights
  • Diamond = represents overall effect when combining info from the studies
  • Points of edge of diamond = 95% confidence interval
  • Spread of diamond = range
18
Q
  1. Was an ‘a priori’ design provided?
A

inclusion criteria & research question established before conduct of review

19
Q
  1. Was there duplicate study selection and data excration?
A

2 or more independent data extractors

20
Q
  1. Was a comprehensive lit review performed?
A

2 or more electronic sources searched

21
Q
  1. Was the status of publication (i.e. grey literature) used as an inclusion criteria?
A

want no exclusion based on publication status, language etc.
(no is good)

22
Q
  1. Was there a list of studies provided?
A
  • list of included and excluded studies provided

- Cochrane always include

23
Q
  1. Were the characteristics of included studies provided?
A

data on participants, interventions, outcomes (often in table) included

24
Q
  1. Was the scientific quality of included studies assessed and documented?
A
  • critically appraise each study

- satisfied if ‘a priori’ methods of assessment provided

25
8. Was the scientific quality of the included studies used appropriately in formulating conclusions?
putting less weight on studies prone to bias and more weight on studies performed well e.g. “the results should be interpreted with caution due to poor quality of included studies.”