Research Methods Midterm Flashcards

1
Q

Systematic Review

A
  • Structured review of primary studies integrating statistical analysis to the results, if appropriate
  • Has scientific protocol with objectives and methods
  • May include a meta-analysis
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Meta-Analysis

A

Quantitative synthesis of 2 or more studies to produce a single estimate of the effect of an intervention or exposure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Narrative Review

A

Qualitative, narrative summaries of evidence on a given topic that involves informal and subjective methods to collect and interpret information, and is usually written by experts in the field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Systematic Reviews vs. Narrative Reviews

A

Narrative reviews are worse because…
-They are subjective (prone to bias and error)
+No description of the methods use by review
+Literature search may be incomplete or selective
+May not be able to distinguish research from opinion
-They are usually not quantitative
+No estimate of overall effects
+Cannot detect small effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Systematic Review: Reasons to Perform

A
  1. Manage health information efficiently
  2. Distinguish sense from non-sense
  3. Provide evidence based health care
    - Summarize and integrate results from individual studies
    - Determine if new studies are needed
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Systematic Review: Role

A
  1. Identifies original research
  2. Facilitates critical appraisal of original research
  3. Summarizes large body of knowledge
  4. Estimates treatment/exposure effects
  5. Promotes evidence-based medicine
  6. Identifies research gaps
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Systematic Review: Steps

A
  1. Objectives and Protocol
  2. Literature Search
  3. Quality Assessment
  4. Assemble Data Set
  5. Data Synthesis
  6. Perform sensitivity analysis, subgroup analysis, publication bias analysis, if appropriate
  7. Conclusions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Systematic Review: Steps - Objectives and Protocol

A
  • Objectives/study question (PICO/PECO)
  • Inclusion/exclusion criteria for individual studies
  • Literature search and data analysis plan
  • Can register on PROSPERO website
  • No REB required
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Systematic Review: Steps - Literature Search

A
  • Database, search strategies, screening/reading studies
  • Identification of all relevant studies
  • Structured search strategy
  • Title/abstract screening
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Systematic Review: Steps - Quality Assessment

A
  • Tabulate study characteristics and assess quality
  • Study Characteristics (design, participants, interventions, outcomes)
  • Study Quality Assessment (RCT, use Cochrane Risk of Bias)
  • Judging Methodological Quality (focus on internal validity)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Systematic Review: Steps - Assemble Data Set

A

-Extraction of data and data entry
-Full text review
-Data Extraction
+Discrepancies resolved by discussion/external referee
+Write to researchers to get additional info
+Estimate data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Systematic Review: Steps - Data Synthesis

A

-Statistics and heterogeneity
-Qualitative Data Synthesis: Summary information based on words, NOT stats (i.e.. participants, interventions, outcomes, study design)
-Quantitative Data Synthesis: Statistical analysis combining the results of independent clinical trials considered by the analyst to be combinable
+Statistical model can be Fixed or Random Effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Systematic Review: Interpreting Treatment Effects - Statistical Measures of Effects for Dichotomous Outcomes

A

-Relative Risk: Relevant event rate
RR = [a/(a+b)]/[c/(c+d)]
-Risk Difference: Absolute difference in event rate
RD = a/(a+b) - c/(c+d)
-Odds Ratio: Relative number of individuals that fulfill the criteria for a given outcome divided by the number who do not
OR = (a/b)/(c/d)
+Approximates RR when baseline probabilities of the outcome are low (less than 0.1-0.2)
-NNT = 1/RD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Systematic Review: Interpreting Treatment Effects - Statistical Measures of Effects for Continuous Outcomes

A

-Mean Difference: Weighted difference in mean between intervention and control groups
MD = Mean (int) - Mean (cont)
-Standardized Mean Difference: Absolute difference in mean value between intervention and control divided by SD

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Systematic Review: Interpreting Treatment Effects - Testing for Heterogeneity

A
  1. Inspect scatter in data points and overlap in CI
    - Forest Plot
  2. Check results of I2 and chi-squared tests
    - I2 estimates percentage of variability in results across studies that is likely due to true differences in treatment effects (not chance)
    - Chi-square estimates the variation between results of trials due to chance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Systematic Review: Steps - Perform sensitivity analysis, sub-group analysis, publication bias analysis

A

-Sensitivity Analysis: Involves repeating analysis in different subgroups of studies (between-study)
+According to methodological quality. publication status, language, etc.
+If overall results do not change with different approaches, then he results of the statistical synthesis is considered robust
-Sub-Group Analysis: Statistical analysis that focuses on a particular sub-group of participants across studies, not sub-groups (within-study)
+According to age, sex, etc.
+Planned in advance (a-priori) in protocol
+Supported by a biological hypothesis
-Publication Bias
+Funnel Plot should look like inverted cone

17
Q

Systematic Review: Steps - Conclusions

A
  • Evidence based conclusions, future research
  • Summarize and publish review
  • Make clinical and scientific recommendations
18
Q

Systematic Review: Tools for Assessing Quality

A
  1. AMSTAR
  2. GRADE
  3. Others
19
Q

AMSTAR

A

Assessment of Multiple Systematic Reviews

-Quality rating that speaks to the credibility of the methods used for systematic review

20
Q

AMSTAR Steps

A
  1. Was an ‘a priori’ design provided?
  2. Was there duplicate study selection and data extraction?
  3. Was a comprehensive literature search performed?
  4. Was the status of the publication used as an inclusion criteria?
  5. Was a list of studies (included and excluded) provided?
  6. Were the characteristics of the induced studies provided?
  7. Was the scientific quality of the included studies assessed and documented?
  8. Was the scientific quality of the included studies used appropriately in formulating conclusions?
  9. Were the methods used to combine the findings of studies appropriate?
  10. Was the likelihood of publication bias assessed?
  11. Was the conflict of interest stated?
21
Q

Systematic Review: Key Points for Critical Appraisal

A
  1. Are the results valid?
  2. What are the results?
  3. Can I apply the results?
22
Q

Systematic Review: Tools for Reporting

A
  1. PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-Analyses
    - Has 27 items covering 7 topics: title, abstract, intro, methods, results, discussion, funding
  2. MOOSE: Meta-Analyses of Observational Studies
23
Q

Systematic Review: Weaknesses

A
  • Authors decide inputs, processes, and results
  • Judgments are prone to random and systematic errors
  • Having more than 2 reviewers can help reduce errors and bias
24
Q

Possible Sources of Error

A
  • Clinical question
  • Study selection and inclusion
  • Data extraction
  • Assessment of study quality
  • Assessment of ability to combine studies
  • Statistical methods for data synthesis
25
Q

Clinical Practice Guidelines

A

-Systematically developed statements which assist clinicians and patients in making decisions about appropriate treatment for specific conditions/circumstances

26
Q

Clinical Practice Guidelines: Purposes

A
  • Improve quality of care and patient/health care outcomes
  • Distil a large body of knowledge into a convenient readily useable format
  • Assist patients and clinicians in making decisions and advocating for quality care
  • Provide guidance by which to hold the health care system accountable
  • Reduce practice variation
  • Optimize resource utilization
  • Expose gaps in knowledge
27
Q

Clinical Practice Guidelines: Guideline Development Steps

A
  1. Prioritize problems, establish guideline panel
  2. Identify clinical questions
  3. Conduct systematic reviews
  4. Assess the relative importance of outcomes
  5. Prepare evidence profile: quality of evidence for each outcome and summary of findings
  6. Assess overall quality of evidence
  7. Decide direction and strength of recommendation
  8. Draft guideline
  9. Consult with stakeholders and/or external peer reviewer
  10. Disseminate guideline
  11. Implement guideline and evaluate
28
Q

Clinical Practice Guidelines: Methodology Decisions

A
  1. Convene a multi-disciplinary team
  2. Select guideline process (AGREE-II)
  3. Select clinical questions (GRADE)
  4. Select evidence synthesis and recommendation process (GRADE + Cochrane)
29
Q

AGREE-II

A
  1. Scope and Purpose
  2. Stakeholder Involvement
  3. Rigour of Development
  4. Clarity and Presentation
  5. Applicability
  6. Editorial Independence
30
Q

AGREE-II: Scope and Purpose

A

-Overall aim of the guideline, the specific clinical questions and the large patient population

31
Q

AGREE-II: Stakeholders

A
  • Extent to which guideline represent views of intended users
  • TEAM: Together Everyone Achieves More
32
Q

AGREE-II: Rigour of Development

A

-Process used to gather and synthesize the evidence, methods used to formulate the recommendations and to update them

33
Q

AGREE-II: Rigour of Development - Process for Developing Recommendations

A

-C