Meta-analysis Flashcards

1
Q

Meta-analysis

A
  • A systematic method for combining the results of multiple similar studies addressing a similar clinical question
  • Allows more accurate conclusions to be drawn from a larger pooled number of participants
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Aim of meta-analysis

A

To estimate the treatment effect with the greatest possible power and precision

Meta-analysis increases the sample size
• Reduces the risk of type 2 error/ false negative results
• Produces estimates that better approximate the population parameters
• Standard error = standard deviation/ √sample size
• 95% Confidence intervals = sample mean ± (standard error x 1.96)
• i.e. the bigger the sample size the smaller the standard error and confidence intervals and the more precise the estimate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Process

A
  1. Set the study question
  2. Literature search
  3. Study selection
  4. Data extraction and quality assessment
  5. Statistical analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Places to look for study

A

• Electronic medical databases e.g.
– Embase, Medline
• Published books, conference material
• Relevant internet sites e.g. specialist societies, guidelines
• Research registries, unpublished studies
• Research and clinical affairs departments of pharmaceutical companies
• General internet search e.g. Google/ google scholar

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Study selection

A
•	Pre-defined criteria to include:
–	Study types
–	Participant inclusion and exclusion criteria
–	Treatment and control
–	Treatment time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Publication bias

A

• Journals prefer to publish trials with significant positive findings rather than negative or indifferent trial results
– Need to try and identify unpublished trials
• Funnel plot – used to try and identify the existence of publication bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

• Funnel plot

A

used to try and identify the existence of publication bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Statistical analysis

A
•	Combines information from different studies
–	Aggregate trial results
–	Individual patient data level
•	Basic requirements
–	Common measure of treatment effect
•	Odds or risk ratio
•	Mean difference
–	Variance or standard error of treatment effect must be calculated for each study
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

fixed effect model

A

assumes meta-analysis is trying to estimate an overall treatment effect
used where studies match closely in design and methodology
variability within studies but not between
trials contribute to estimat eaccording to their weight

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

random effects model

A

assumes a different underlying treatment effecr for each study
used where studies do not match
variability within and between studies
given mroe weight to smaller studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

fixed effect model details

A

assumes eacht rial provides an estimate of the same population value
requires estimate of treatment effect and variance for each trial

trials are weighted
big trials have low standard error hence carry more weight
weight = 1/variance
1/se^2

pooled estimates
for each trial estimate of treatment, effect is multiplied by its trial weight
weighted estimates are added and total divided by sum of weights
null hypothesis - pooled estimate is 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

testing for heterogenity

A

q test and i2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

q test (chi)

A

tests null hyptothesis that all studies have same treatment effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

i2

A

tests how much heterogeneity there is

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

z

A

tests the null hypothesis that effect size is 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

tau t - for random effects model

A

estimate of variance between studies in random effects model

17
Q

limitations of meta-analysis

A

• Only as good as the available studies
– e.g. limited if studies are small, poorly performed, very heterogeneous, have poor internal validity
• Many potential sources of bias
– Study selection, missing studies (more likely to be ‘negative’), bias within individual studies, choice of statistical methods
• Pooled estimates may not be directly meaningful/ applicable to real life clinical practice
• Complex
– Requires expertise to navigate the process

18
Q

addressing limitations of meta-analysis

A
  • Clear protocol before meta-analysis starts
  • Full transparent reporting of methods and results including study selection
  • Awareness and discussion of bias
  • Developing expertise in conduct and interpretation of meta-analysis