41. LEVELS OF EVIDENCE Flashcards
- What are the Levels of Evidence based on?
- they are based on the Oxford Center for Evidence
based Medicine (2009) - there is no gold standard rule on the levels of evidence
- they are changed and revised over time
- other organisations have slightly different levels
- What are the Levels?
1a
1b
1c
2a
2b
3a
3b
4
5
NB:
- the strongest and most reliable studies are the at the
top of the list
- What is the type of study related with:
Evidence Level 1a?
- Systematic Reviews and Meta-Analysis
- of Randomised Controlled Trials (RCT)
- What are the strengths related with:
Evidence Level 1a?
- IT IS AN INTERVENTIONAL STUDY
- this means that the exposure is assigned to the
participants
- the exposure is not assessed - IT HAS HIGH INTERNAL VALIDITY
- very low Random Error
- very low Bias and Confounding
- IT HAS HIGH EXTERNAL VALIDITY
- this is assuming that the samples are representative
- and that there are no drop outs
- IT CAN PROVE TEMPORALITY IS ASSOCIATIONS
- IT IS THE STRONGEST EVIDENCE
- that proves that an exposure causes an outcome
- What are the Limitations related with:
Evidence Level 1a?
- IT DEPENDS ON THE QUALITY OF THE INCLUDED
STUDIES
- if the original studies are poorly conducted
- this cannot be fixed
- What is the type of study related with:
Evidence Level 1b?
- High Quality Randomised Controlled Trials
- that are individual studies
THESE STUDIES:
- have narrow confidence intervals
- they have a low drop out rate
- random allocation takes place
- What are the strengths related with:
Evidence Level 1b?
- IT IS AN INTERVENTIONAL STUDY
- this means that the exposure is assigned to the
participants
- the exposure is not assessed - IT HAS HIGH INTERNAL VALIDITY
- very low Random Error
- very low Bias and Confounding
- IT CAN PROVE TEMPORALITY IS ASSOCIATIONS
- IT IS A STUDY THAT CAN INFER CAUSALITY
- this proves that an exposure causes an outcome
- but this has to be assumed with caution
- since we are only looking at a single study
- What are the Limitations related with:
Evidence Level 1b?
- this is only a single study
- the External Validity could be low
- this is definitely the case if the study sample is too
specific - this means that it will not be representative
- What type of study is related with:
Evidence Level 1c?
- high quality studies
- they are not randomised
- they are not controlled
- they are individual studies
THESE STUDIES HAVE:
- a low drop out rate
- a narrow confidence interval
- What are the strengths related with:
Evidence Level 1c?
- IT IS AN INTERVENTIONAL STUDY
- this means that the exposure is assigned to the
participants
- the exposure is not assessed - IT HAS MODERATE INTERNAL VALIDITY
- it has a lower bias than in Observational Studies
- IT CAN PROVE TEMPORALITY IS ASSOCIATIONS
- What are the limitations related with:
Evidence Level 1c?
- IT IS PRONE TO CONFOUNDING
- this is because of the lack of Randomisation - THE EXTERNAL VALIDITY IS LOW
- since we are dealing with a single study
- the study can be too specific
- this means that it is not representative
- What is the type of study related with:
Evidence Level 2a?
- Systematic reviews and Meta-Analysis
- of Cohort Studies
- What are the strengths related with:
Evidence Level 2a?
- IT HAS AN ACCEPTABLE INTERNAL VALIDITY
- very large sample
- low Random error
- IT CAN PROVE TEMPORALITY IS ASSOCIATIONS
- HIGH EXTERNAL VALIDITY
- only if we assume that the samples are representative
- What are the limitations related with:
Evidence Level 2a?
- PRONE TO BIAS AND CONFOUNDING
- this is because of the Methodological limitations
- the study is observational
- CAUSALITY CAN NOT BE INFERRED
- we can not state that the outcome is caused by the
Exposure
- What is the type of study related with:
Evidence Level 2b?
- These studies can be high quality Cohort studies
- these studies are individual
THESE STUDIES:
- have narrow confidence intervals
- they have low drop out rates
- they have accurate assessments
- they are adjusted for confounding
- These studies can be low Quality Randomised Control
Trials (RCTs)- they are individual studies
THESE STUDIES HAVE:
- wide confidence intervals
- they have a high drop out rate
- random allocation is not maintained
- What are the strengths related with:
Evidence Level 2b?
- IT HAS AN ACCEPTABLE INTERNAL VALIDITY
- the sample is large
- random error is low
- this applies only for the Cohort Studies
- IT CAN PROVE TEMPORALITY IS ASSOCIATIONS
- What are the limitations related with:
Evidence Level 2b?
- IT IS PRONE TO BIAS AND CONFOUNDING
- this is due to the methodological limitations
of the included studies
- this is due to the methodological limitations
- CAUSALITY CAN NOT BE INFERRED
- we can not state that the outcome is caused by the
exposure
- What type of study is related with:
Evidence Level 3a?
- Systematic Reviews and Meta-Analysis
- of Case-Control studies
- What are the strengths related with:
Evidence Level 3a?
- A VERY LARGE SAMPLE IS USED
- the Random Error is low - IT HAS HIGH EXTERNAL VALIDITY
- assuming that the sample is representative
- What are the limitations related with:
Evidence Level 3a?
- LOW INTERNAL VALIDITY
- there is Bias present
- there is Confounding - CANNOT PROVE TEMPORALITY IN ASSOCIATIONS
- CAUSALITY CANNOT BE INFERRED
- we cannot state that the outcome is caused by the
exposure
- What type of study is related with:
Evidence Level 3b?
- high quality Case Control studies
- they are individual cases
THESE STUDIES HAVE:
- narrow confidence intervals
- accurate assessments
- no serious recall bias
- adjustments for Confounding
- What are the strengths related with:
Evidence Level 3b?
- THE SAMPLE IS LARGE
- random error is low
- What are the limitations related with:
Evidence Level 3b?
- LOW INTERNAL VALIDITY
- there is bias present
- there is Confounding - CANNOT PROVE TEMPORALITY IN ASSOCIATIONS
- CAUSALITY CANNOT BE INFERRED
- cannot state that the outcome is caused by the
exposure
- What type of study is related with:
Evidence Level 4?
- CASE-SERIES
- this is the follow-up of patients that receive specific
treatments
- we look at their prognosis - CROSS-SECTIONAL STUDIES
- LOW QUALITY COHORT AND CASE-CONTROL STUDIES
- they have a wide confidence interval
- they have a high bias
- they are affected by Confounding
- What are the strengths related with:
Evidence Level 4?
- IT IS EASY TO CONDUCT
- IT IS CHEAP
- IT CAN GENERATE A HYPOTHESES
- this can be used for further and higher quality
research
- What are the limitations related with:
Evidence Level 4?
- IT HAS A VERY LOW INTERNAL VALIDITY
- random error
- bias
- confounding - IT CANNOT PROVE TEMPORALITY IN ASSOCIATIONS
- except for Cohort studies - CAUSALITY CANNOT BE INFERRED
- we cannot state that the outcome is caused by the
exposure - THE EXTERNAL VALIDITY IS LOW
- What types of studies are related with:
Evidence Level 5?
- INDIVIDUAL EXPERT OPINIONS AND REPORTS
- EXPERT COMMITTEE OPINIONS AND REPORTS
- CLINICAL EXPERIENCES OF RESPECTED AUTHORITIES
- What are the strengths related with:
Evidence Level 5?
- VERY EAST TO CONDUCT
- CHEAP TO CONDUCT
- CAN GENERATE A HYPOTHESIS
- that can be used for higher quality research
- What are the limitations related with:
Evidence Level 5?
- DO NOT QUALIFY AS SCIENTIFIC RESEARCH
- NOT BASED ON EMPIRICAL RESEARCH FINDINGS
- it is just based on clinical observations - THE INTERNAL VALIDITY IS EXTREMELY LOW
- THE EXTERNAL VALIDITY IS EXTREMELY LOW
- CANNOT INFER CAUSALITY AT ALL
- we cannot state that the outcome is a result of the
exposure
- What are the four factors that determine the Strength of Recommendation?
- The Quality of Evidence
- The balance between the desirable and undesirable
effects - Values and preferences
- such as the patients, the professionals, the
paymasters and the public - Cost
- how the available resources are utilised
- Does strong level evidence always mean strong recommendations?
- no
- What can be said about RCT results and Observational Study results?
- always believe the RCT results
- What do we use the “GRADE” guidelines to establish?
- we use them to establish the Quality of Evidence
- it grades the strength of recoomendations
- What do the “GRADE” guidelines analyse?
- IMPRECISION
- this is done by using the 95% Confidence Interval - LIMITATIONS IN THE STUDY DESIGN (BIAS):
- this looks at the quality - INCONSISTENCY OF RESULTS
- this looks at the Heterogeneity - PUBLICATION BIAS
- this looks at the Publication Bias - INDIRECTNESS OF EVIDENCE
- this looks at the generalisability of the data
- Why do we rate the Certainty in the Evidence and the Strength of the Recommendations?
- IT HELPS US TO JUDGE THE EVIDENCE
- and the recommendations in Healthcare - CLINICAL ACTIONS
- are likely to differ
- this depends on whether one concludes that the
evidence is high or low - TO DECIDE WHETHER THE HEALTH BENEFITS
- are worth the additional costs - HELPS TO IMPROVE COMMUNICATION
- of the practice guidelines
- What kind of studies are given a High Quality Rating based on the GRADE System?
- Randomised Trials (RCT)
- Double Upgraded Observational Studies
- What kind of studies are given a Moderate Quality Rating based on the GRADE System?
- Downgraded Randomised Trials (RCT)
- Upgraded Observational Studies
- What kind of studies are given a Low Quality Rating based on the GRADE System?
- Double Downgraded Randomised Trials (RCT)
- Observational Studies
- What kind of studies are given a Very Low Quality Rating based on the GRADE System?
- Triple Downgraded Randomised Trials (RCT)
- Downgraded Observational Studies
- Case Series
- Case Reports
- What are factors that can decrease the Quality level of data evidence?
- Limitations in the design
- Limitations in the implementation of the studies
- Bias
- Indirect Population
- Indirect Intervention
- Indirect Control
- Indirect Outcomes
- Unexplained Heterogeneity
- Inconsistency of Results
- Problems with subgroup analyses
- Imprecision of Results
- Wide Confidence Intervals
- High probability of Publication Results
- What are factors that can increase the Quality Level of data evidence?
- Large Magnitude of Effect
- All possible confounding is adjusted for
- There is a dose-response gradient