STATS Lec 20- Systematic reveiw and meta analysis Flashcards
1
Q
Literature reviews
A
- Narrative
- Provides written summary of information- e.g. introduction to a project
- Usually done for a purpose
- Usually involves some critical element
- May be comprehensive and unbiased, often not
- Systematic review
- A research method
2
Q
Why do a systematic review
A
- Fergusson et al (2005) effect of aprotinin on the outcome of cardiac surgery
- A CUMULATIVE systematic review of 64 RCT- first in 1987
- Meta-analysis of first 12 trials (1987-1992)- Statistically significant effect of treatment
- 52 further trials performed between 1992 and 202- would not have been required if meta-analysis had been done in 1992
3
Q
Classical versus cumulative meta-analysis
Smoking cessation with nicotine patch at 6 months
A
- 2nd box is a combination of all previous studies put together
- Showing clear benefit with tight confidence intervals
4
Q
Systematic review: A research method
A
- Process of identifying, interpreting and summarising information from studies in order to answer a structured question
- Doing an experiment with existing data rather than with your own data- Prof Li Wan Po
5
Q
Compare these two
A
- Narrative review
- No defined method
- Exploratory, creative
- May be biased
- Introduction to a project
- Systematic review
- Rigorous method
- Transparent and replicable
- Aims to eliminate bias
- Research method
6
Q
Meta-analysis
A
- Statistical- combination of the results from studies to obtain a more precise estimate of treatment effect
- Can be included as part of a systematic review- usually end part
7
Q
Key points- to do a systematic review you need to
A
- Have a good working knowledge and understanding of the field
- Understand the systematic review methodology
- Be able to follow the research method in a focussed, structured and transparent way
- Undertake a rigorous, systematic, comprehensive and exhaustive search for ALL relavent literature
8
Q
Stages of systematic review
A
- Scope and Mapping- refine your research question
- Plan search, develop protocol
- Search and document- comprehensive and complete
- Apply inclusion and exclusion criteria- refine search
- Quality assessment- further exlude if necessary
- Data extraction- compliation into summary tables
- Synthesis- Meta-analysis if appropriate
- Write-up
9
Q
search strategy: VITAL
A
- Databases
- Search terms and combinations
- Should be inclusive- identify all potentially relevant studies
- Limitations of search- recognise the effect on conclusions
- Unpublished data- relevance
10
Q
Inclusion/Exclusion criteria
A
- Include only studies relavent to question
- Consider
- Study design
- Population intervention
- Outcomes
- QUALITY
11
Q
Hierarchy of evidence a quality issue
A
- Randomised controlled trial
- Non-randomised trial
- Cohort study (prospective)
- Case-control study (retrospective)
- Cross-sectional study
- Surveillance data
- Case report
- Systematic review and meta-analysis is often considered higher than RCT because it is many RCT summarised at once
- Further down, you move away from robust, reliable data and start to introduce bias
12
Q
Assessing quality: checklist
A
- Published checklists available
- Modify to suit your question
- What is a good quality/bad quality in your field
- How to measure ‘quality’
- Subjective measure
- Must be transparent
- Quality of reporting vs. quality of the study
13
Q
DH NSF quality assessment scale (2008)
A
14
Q
Next stage: summarise results
A
- Descriptive summary and tables- show off data
- Measure of effect (+CI) for each study
- Concept of effect size
- Depends on question and data
- Test for heterogeneity
- Can data be combined from different studies
15
Q
Outcome measures: effect size
A
- Varies depending on research question
- Clinical
- Odds ratio, RR, reduction in BP
- See slides at the end
- Economic
- Cost/Benefit
- Should be appropriate to your research question
- Clinical