Exam Two - Systematic reviews/Meta Analyses Flashcards

1
Q

Narrative or systematic review?
general or focused topic

A

narrative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Narrative or systematic review?
no specific criteria required of studied included in review.

A

narrative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Narrative or systematic review?
search and selection methods not reported

A

narrative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Narrative or systematic review?
quality and/or level of evidence of studies included in review is rarely considered

A

narrative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Narrative or systematic review?
focused question PICO

A

systematic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Narrative or systematic review?
summary of findings from studies that meet specific criteria

A

systematic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Narrative or systematic review?
rigorous search and selection methods established a priori

A

systematic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Narrative or systematic review?
extensive analysis of the quality of individual studies included in review (usually)

A

systematic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

why are systematic reviews helpful?

A

1 - it is nearly impossible to stay current
2 - SR reduce the tendency to read articles that agree with you or that you are looking for

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what is step one of a SR?

A

state your PICO

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

PICO choices tend to become your…

A

inclusion and exclusion criteria

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what are steps 2,3 of SR?

A

Define the lit search
- type of studies to be included
- patient population that will be included
- definition of “intervention”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what kind of studies are typically included in SR

A

RCTs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

step 4 of a SR

A

comprehensive, objective literature search
- include database and search term provided
- beware of publication bias
- beware of self reporting bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is publication bias?

A
  • tendency to only publish articles if you find a significant result
  • overtime this results in an overabundance of articles showing a significant difference
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How do you combat publication bias?

A

“grey literature” search for articles not available through database searching
- contact authors for unpublished data
- government studies
- dissertations/theses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

what is selective reporting bias?

A
  • outcomes that are measured in the study but not reported because another outcome had more significant results
  • statistically significant outcomes are more likely to be chosen by authors for reporting
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

what is step 5 of SR

A
  • retrieve/screen articles
  • some do not meet predetermined criteria
  • ex. must use a specific outcome measure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a pro of requiring a specific outcome measure reported to be included in SR

A
  • facilitates homogeneity of the results and combining results between studies
20
Q

What is a con of requiring a specific outcome measure reported to be included in SR

A
  • excludes findings from RCTs that may affect the validity of the review’s conclusions
21
Q

what is step 6,7 of SR

A

Review articles for quality/internal validity
- each article is typically reviewed by at least 2 reviewers

22
Q

Why do you want each article to be reviewed by 2 reviewers to be included in your SR?

A
  • assure the reader “garbage in/garbage out” does not apply
  • occasionally used to statistically place more emphasis on results of high quality studies (weighting)
23
Q

what is step 8,9 of the SR

A

synthesis/analyze findings
- the goal of SR is to synthesize results of all relevant studies that evaluate a common question to get an answer

24
Q

What are the 2 methods of synthesizing results

A

1 - systematic review (qualitatively/descriptively)
2 - meta-analysis (statistically) we want to be able to do this one

25
the _________ of the study results typically determines if the data will be synthesized statistically
heterogeneity
26
What are two major things that contribute to the heterogeneity in design
1 - sample characteristics 2 - methodology
27
How can you tell if effects are reasonable similar between studies?
1 - degree of overlap of study confidence intervals - "eyeball test" - little overlap = little heterogeneity 2 - cochran Q or Chi Square tests - significance = heterogeneity - may not be reported if <5 studies included in the review
28
Can you do a systematic review or meta analysis if the results are heterogeneous?
NO! Results must be homogenous
29
What is step 10 of a SR?
report results quantitatively - typically described as "minimal" "moderate" or "strong" evidence for or against an intervention (considers count and quality of the articles)
30
Can you have more than one comparison per systematic review?
yes, absolutely! Piccccoooooooo
31
What are the advantages for doing a meta-analysis? (5)
1 - increase power 2 - more precise estimate of effect (larger n) 3 - quantifies the magnitude of the effect 4 - resolve conflicting results 5 - may improve external validity
32
What is a big problem when trying to do a meta-analysis?
studies often use different outcome measures to quantify the same construct
33
What is the main solution for the big problem we've discussed with meta analysis
authors of meta analyses can transform the results of each study into a dimensionless measure (so no units to worry about)
34
What are some dimensionless measures for interval or ratio outcome measures?
standard mean difference weighted mean difference
35
What are some dimensionless measures for nominal or ordinal outcome measures?
- relative risk - odds ratio
36
Why is it good to use weighted mean difference?
places greater emphasis on studies with more subjects and less variability (greater confidence)
37
True or false, better quality articles (higher PEDro score) could have greater weight regardless of sample size?
true!
38
What should you know to be able to read forest plots of continuous DVs?
- size of each square corresponds to the weight of the study - center of diamond is the average effect for all studies - tips of diamond represents CI IF THE TIP OF DIAMOND CROSSES 0.0 THE EFFECT OF THE INTERVENTION IS NOT SIGNIFICANT
39
if the tip of the diamond crosses ________- for continuous DV forest plots, then the effect of the intervention is not significant
zero
40
What should you know to be able to read forest plots of discerete DVs?
IF THE DIAMOND CROSSES THE 1.0 THE INTERVENTION DOES NOT SIGNIFICANTLY INFLUENCE THE LIKELIHOOD OF EXPERIENCING THE OUTCOME
41
What is a common SR result report?
- inconclusive results
42
Why are inconclusive SR results useful??
- clinicians can be misled by the results of ONE study that "agrees" with their philosophy - an inconclusive or negative SR may lead to review of their practice patterns
43
Why is PRISMA useful?
Its like the PEDro for SR and MA
44
What type of questions should you ask when trying to discover if a SR is VALID?
1 - did the review address a focused question 2 - where the inclusion/exclusion criteria appropriate 3 - is it unlikely that important, relevant studies were missed 4 - was the validity of the studies included appraised 5 - were the reviewers blinded and free of bias 6 - were the results reasonable homogenous?
45
What type of questions should you ask when trying to determine the clinical utility of a SR?
1 - were the results clearly stated 2 - effect size or NNT calculated 3 - can the results be applied to my patients and setting 4 - were the important outcome measures (to you) included in the review 5 - will my patient consider the benefits of the intervention to outweigh the risk (and cost)?