Review Slides plus class review Flashcards
A narrative in the professional literature that identifies a single incident and discusses pertinent factors related to the patient
Brings a novel or unusual patient to the attention of colleagues
Information is preliminary and unrefined in terms of research methodology
Important nonetheless
Case Report
Case Report
single incident and discusses pertinent factors related to the patient
novel or unusual patient
info preliminary / unrefined
this type of study analyzes a number of individual cases that share a commonality
-Usually relatively low numbers of subjects
Case Series
Case Series are used to
Examine adverse events or effects
Catalog new diseases or outbreaks
Determine the feasibility or safety of a new treatment or intervention
Discuss the potential efficacy of a new treatment
Data does not necessarily extrapolate to larger populations
Evidence may be circumstantial
Confounding factors may be present
Case reports and case series lack “sufficient methodological rigor”
But – both typically indicate the need for further study
Examine the relationship between exposures and diseases as measured in a population rather than in individuals.
Ecologic Studies
Can often be done by utilizing data from surveys or registries without having to interview, examine, or even identify individual subjects.
Ecologic Studies
After describing an association at the population level, the next step would be to do a an analytic study to see if the association holds true in individuals.
Ecologic Studies
Is a type of bias specific to ecological studies. Occurs when relationships that exist for groups are assumed to also be true for individuals.
Ecological Fallacy
Examines the relationship between outcomes and other variables of interest as they exist in a defined population at one particular time.
Determines prevalence (% of population) not incidence (rate)
Enrolls a large number of individuals
“The chicken or the egg?”: cannot show causality, does not separate cause/effect
Does not establish a temporal relationship between risk factors and disease because they are measured at the same time
Cross-sectional studies
Examines the relationship between outcomes and other variables of interest as they exist in a defined population at one particular time.
Cross-sectional studies
Determines prevalence (% of population) not incidence (rate)
Cross-sectional studies
can a cross-sectional study show causality?
NO!!! does not separate cause and effect
Look at slide 8 for the flow chart of the cross-sectional study
Boy you betta!
Strengths-
Can assess multiple outcomes and exposures simultaneously
Can be completed quickly
Data generated can lead to further studies
Can generate prevalence
Cross-sectional studies
Strengths of Cross-sectional studies?
Can assess multiple outcomes and exposures simultaneously
Can be completed quickly
Data generated can lead to further studies
Can generate prevalence
Limitations-
No time reference
-“Snapshot In Time”- like looking at a photograph
Only useful for common conditions
Cannot calculate incidence, it is a prevalence study
Results are dependent on the study population
We assume that the exposure rate is constant over time.
Cross-sectional studies
Cross-sectional studies Limitations?
Limitations-
No time reference
-“Snapshot In Time”- like looking at a photograph
Only useful for common conditions
Cannot calculate incidence, it is a prevalence study
Results are dependent on the study population
We assume that the exposure rate is constant over time.
Studies in which patients who already have a specific condition (cases) are compared with people who do not have the condition (controls).
The researcher looks back to identify factors or exposures that might be associated with the illness.
This type of study design may follow a case-series (as a retrospective look at causes).
Tries to capture the cause and effect relationship by comparing frequency of a risk factor among those how are exposed and not-exposed.
Case-control studies
Case-control studies
Studies in which patients who already have a specific condition (cases) are compared with people who do not have the condition (controls).
The researcher looks back to identify factors or exposures that might be associated with the illness.
This type of study design may follow a case-series (as a retrospective look at causes).
Tries to capture the cause and effect relationship by comparing frequency of a risk factor among those how are exposed and not-exposed.
Studies in which patients who already have a specific condition (cases) are compared with people who do not have the condition (controls).
Case-control studies
The researcher looks back to identify factors or exposures that might be associated with the illness.
This type of study design may follow a case-series (as a retrospective look at causes).
Case-control studies
Tries to capture the cause and effect relationship by comparing frequency of a risk factor among those how are exposed and not-exposed.
Case-control studies
Look at review slide 12/13 for flow chart
don’t be a slacker
Strengths-
Good for studying rare outcomes
Can evaluate many exposures
Ideal for initial, explanatory idea
Simple & fast – we already know the outcomes
Efficient-no waiting for outcome to occur
Inexpensive
Case-control studies
Case-control studies Strengths
Strengths-
Good for studying _____
Can evaluate many ____
Ideal for ___ idea
Simple & fast – we already know the ____
_____-no waiting for outcome to occur
cost?
Case-control studies
Strengths-
Good for studying rare outcomes
Can evaluate many exposures
Ideal for initial, explanatory idea
Simple & fast – we already know the outcomes
Efficient-no waiting for outcome to occur
Inexpensive
Limitations-
Single outcome
High risk for bias
High risk for confounding variables
Other factors may exist that influence outcomes
Can’t determine prevalence
Temporality
- –Can’t make causal interpretations
- –Can’t determine incidence
- –Can’t calculate Relative risk
Case-control studies
Case-control studies Limitations
___ outcome
High risk for ___
High risk for ____ variables
Other factors may exist that influence outcomes
Can’t determine ____
Temporality
- –Can’t make ___ interpretations
- –Can’t determine ___
- –Can’t calculate ____
Limitations-
Single outcome
High risk for bias
High risk for confounding variables
Other factors may exist that influence outcomes
Can’t determine prevalence
Temporality
- –Can’t make causal interpretations
- –Can’t determine incidence
- –Can’t calculate Relative risk
Potential Biases in Case-Control Studies?
Selection Bias
Information Bias
Researcher/Observer Bias
Voluntary Response Bias`
Case-Control Studies
Selection Bias?
Selection Bias: inappropriate selection of cases or controls.
Cases: Can be selected from a variety of sources: Hospitals, Clinics, Registries. If cases are selected from a single source, and risk factors from that facility may not be generalizable to all patients with that disease.
Controls: Ideally, you want controls to come from the same reference population that cases are derived from. An inappropriate control group can have the opposite effect and obscure an important link between disease and its cause.
Case-Control Studies
Information Bias?
Information Bias
Recall Bias (Subject Bias) is the main form of information bias in case-control studies. Occurs when there is a differential recall of exposure between cases and controls.
Case-Control Studies
Researcher/Observer Bias:
Researcher/Observer Bias:
Occurs when the researcher/observer evaluates cases vs controls differentially.
Case-Control Studies
Voluntary Reponses Bias
Voluntary Reponses Bias
Arises when case subjects who think they have been exposed to responds at a higher rate to controls.
case may not be generalizable to all patients with that disease
Selection Bias of the CASE
Potential Biases in Case-Control Studies
where do you want your controls to come from ideally?
Why?
Ideally, you want controls to come from the same reference population that cases are derived from. An inappropriate control group can have the opposite effect and obscure an important link between disease and its cause.
What is the main form of information bias in case-control studies?
Recall Bias (Subject Bias)
Information bias with a recall bias (subject bias) occurs when…
Occurs when there is a differential recall of exposure between cases and controls.
Potential Biases in Case-Control Studies:
Occurs when the researcher/observer evaluates cases vs controls differentially.
Researcher/Observer Bias:
Potential Biases in Case-Control Studies:
Arises when case subjects who think they have been exposed to responds at a higher rate to controls.
Voluntary Reponses Bias
Control Biases:
Process of selecting the controls so they are similar to the cases in certain characteristics, such as age, race, sex, socioeconomic status, and occupation.
Matching:
two subcategories of matching (a type of control bias)?
Individual: For each case selected for the study, a control is selected who is similar to the case in terms of the specific variable.
Group-based: Select controls with a certain characteristic that is identical to the proportion of cases with same characteristic.
Problems with matching:
If you select too many matching characteristics it is difficulty to find an appropriate control.
You lose the ability to study a matched variable.
Offers independent estimates of exposure among different samples of non-cases. Increases strength of the study.
Multiple Controls: Employ multiple control groups
Other Types of Case-Control Studies?
Case-crossover
Nested Case-Control
Case-Cohort
A variant of a case-control study
Each case becomes their own individual control
Used for transient exposures during a discrete occurrence
Case-crossover
A case control study within a large cohort
Typically seen with large enrollment studies
Controls are a sample of individuals who are at risk for the disease/outcome at the time each case of the disease develops.
Nested Case-Control
Same as nested case-control design, expect controls are randomly chosen from the cohort at the beginning of the study.
Case-Cohort
Cohort studies
Cohort – a group of people who share a common characteristic or experience and all remain in the group for a period of time
Cohort Study – an epidemiologic investigation that follows groups with common characteristics, strongest observational study
Prospective – identify a group of patients who are already taking a particular treatment or have an exposure, follow them forward over time, and then compare their outcomes with a similar group that has not been affected by the treatment or exposure being studied
Retrospective – start with a cohort and go back in time to evaluate past exposures to risk factors
– a group of people who share a common characteristic or experience and all remain in the group for a period of time
Cohort
– an epidemiologic investigation that follows groups with common characteristics, strongest observational study
Cohort Study
– identify a group of patients who are already taking a particular treatment or have an exposure, follow them forward over time, and then compare their outcomes with a similar group that has not been affected by the treatment or exposure being studied
Prospective
– start with a cohort and go back in time to evaluate past exposures to risk factors
Retrospective
Look at slide 20 to reinforce cohort studies
Job well done
Potential Biases in Cohort Studies
Selection Bias - (lost to follow up)
Information Bias - quality of info between exposed vs non-exposed AND Observer bias
Potential Biases in Cohort Studies
Selection Bias -
Lost to follow up ?
People with disease are selectively lost to follow-up, and those lost to follow-up differ from those not lost to follow-up.
Potential Biases in Cohort Studies
Information Bias?
Quality and extent of information is different for exposed person than for non-exposed person, a significant bias can be introduced.
OBSERVER BIAS – Occurs when the observer decides whether the disease has developed in each subject also knows whether that subject was exposed.
Strengths of cohort studies?
Temporal relationships identified
Confirm Cause and Effect (& magnitude of effect)
Measures Incidence Rate
- Can calc Relative Risk
- HIGHEST VALIDITY OF OBSERVATIONAL STUDY DESIGN**
Highest validity of observational study design?
measure of the incidence (rate) of disease
Strengths-
May study multiple effects of a single exposure
Can identify a temporal relationship between exposure and disease (outcome)
Help confirm cause and effect of disease and the magnitude of the effect
Can measure incidence (rate) of disease
- –Can calculate Relative Risk
- –Highest validity of observational study design
Cohort studies
Limitations-
Expensive and time consuming
Inefficient for studying rare diseases
Case-control more appropriate for rare diseases
Lose participants to follow-up
Risk of confounding variables
Retrospective studies require presence of records or recall
Cohort studies
Limitations of Cohort Studies?
Expensive and time consuming
Inefficient (rare diseases)
Lose participants (to follow up)
Risk of confounding variables
Require presence of records or recall
Which study is better for rare diseases… cohort or case control?
CASE-CONTROL
Study comparison
Cohort vs. Case Control
Cohort studies:
Start with exposure, look for disease
Prospective or retrospective
Common diseases
High risk for drop out
$$$
Case-Control studies:
Start with disease, look for exposure
Retrospective
Rare disease
Recall and selection bias
$
Randomized control studies
“Randomized” Allocation/Assignment
The main purpose of randomization is to prevent any potential biases on the part of…
the investigators from the influencing the assignment of participants into different treatment groups.
May be done by assigning random numbers or by a program that generates random assignments
Randomized control studies
Each subject has an equal chance of being assigned to each group (control or intervention)
Randomized control studies
Randomized control studies
Randomization strives for comparability of the different treatment groups; however…
its not guaranteed.
Randomized control studies
“Controlled” implies predefined:
Specified hypotheses
Primary and secondary endpoints to address hypotheses
Methods for enrollment and follow up
Eligibility/Exclusionary criteria
Rigorous monitoring
Analysis plans and stopping rules
Randomized control studies
Why Controlled?
Seek to eliminate confounding variables
Attempt to minimize bias
Look at table on slide 28
Did ya?
As far as enrollment,
Criteria for determining selection must be specified
before the study is begun.
As far as enrollment,
Want to ensure that participants actually
have the disease of interest.
As far as enrollment,
Carefully select sample based on
a reference population.
As far as allocation,
______ is the best approach in the design of a trial, and the critical element of _____ is the unpredictability of the next assignment.
Randomization
the critical element of _____ is the unpredictability of the next assignment.
Randomization
As far as allocation,
If conducted properly we don’t have to worry that any….
subjective biases of the investigator, either overt or covert, may be in introduced into the process of selecting patients.
How is randomization accomplished:
Computer programs
Envelope System – The treatment assignment that is designated by a random number is written on a card, and this card is placed inside an envelope. Each envelope is labeled on the outside: Patient 1, Patient 2, Patient 3…..etc. When the first patient is enrolled and consented the investigator opens the envelope and the treatment assignment is determined.
Only open the enveloped after a subject is consented and meets eligibility criteria!
When do we open the envelope in the randomization process of the envelope system?
Only open the enveloped after a subject is consented and meets eligibility criteria!
We hope that randomization achieves comparability of characteristics between the treatment groups
however, this not guaranteed!
– utilized when we are concerned about the comparability of the groups in terms of one or a few important characteristics. This is conducted by stratifying our study population by each variable that we consider important, and then randomize participants to treatment groups within each stratum.
Stratified Randomization
Treatment (Assigned vs Received)
Important to know if the patient was assigned to receive treatment A, but did not comply.
A subject may agree to be randomized, but may later change his or her mind and refuse to comply.
Conversely, it is also clearly important to know whether a patient who was not assigned to receive treatment A may have taken treatment A on his or her own, often without realizing.
As far as Outcome,
Comparable measurements in all study groups.
Improvement
Side Effects or Adverse Reaction
As far as Outcome,
___ ___ ____ for all outcomes to be measured in a study
Explicitly stated criteria
As far as Outcome,
Potential pitfall is outcomes being measured more carefully in…
How is this prevented?
those receiving a new drug than in those receiving currently available therapy must be avoided.
Blinding can prevent much of this problem; however, blinding is not always possible.
Behavioral Interventions
As far as Randomized control studies,
What is blinding?
The concealment of group allocation from one or more individuals involved in a clinical research study.
As far as Randomized control studies,
Usually is used in research studies that compare two or more types of interventions.
Blinding
As far as Randomized control studies,
Blinding is Used to make sure that knowing the type of treatment does not affect:
A participant’s response to the treatment
A health care provider’s behavior
The assessment of the treatment effects
After being observed for a certain period of time on one therapy; any changes are measured; patients are switched to the other therapy.
Planned Crossover
Planned Crossover
Each patient can serve as his or her own ____
control
Planned Crossover
holding constant the variation between individuals in many characteristics that could potentially affect…
a comparison of effectiveness of two agents.
Planned Crossover
Must have a
washout period!
Unplanned crossover
Occurs when subjects who are randomized
cross-over to the other group.
Unplanned crossover
If we analyze according to treatment that the patient actually receive, we will have
broken and therefore lost the benefits of randomization.
Unplanned crossover
Current practice to perform the analysis by ____ _ ___-according to the original randomized assignment.
What happens if bias occurs?
intention to treat
If bias occurs typically biases towards the null; typically provides a more conservative estimate
If bias occurs typically biases towards the null; typically provides a more conservative estimate
Unplanned crossover
Randomized control studies
Blinding types?
Single
Double
Triple
Allocation is concealed from only one group (researchers or subjects)
Single blinding
Randomized control studies
Allocation is concealed from both groups (researchers and subjects)
Double blinding
Randomized control studies
Allocation is unknown to the subjects, the individuals who administer the treatment or intervention, and the individuals who assess the outcomes.
Triple blinding
Randomized control studies
Subjects may agree to be randomized, but following randomization they may not comply with the assignment treatment.
May be Overt or Covert!
Noncompliance
The net effect of non-compliance on the study results will be to reduce __________, because the treatment group will include some who did not receive the therapy, and the no-treatment group may ____________
any observed differences
include some who received the treatment.
Randomized control studies
Strengths?
When combined-
Double-blinded Randomized Control Trial is typically referred to as the Gold-standard
Minimizes the chance for bias if randomization and blinding are done correctly
what is the gold standard of randomized control studies?
Double-blinded Randomized Control Trial is typically referred to as the Gold-standard
Randomized control studies
Limitations-
Large trials (may affect statistical power) Long term follow-up (possible losses) Compliance Expensive Possible ethical questions Primum Non Nocere / ‘First Do No Harm’
– Attempted to learn if the drug, surgical procedure, or administrative program works under ideal circumstance.
Efficacy Trial
– Within the confines of the study, results appear to be accurate and the interpretation of the investigators I supported.
Internal Validity
– Ability to apply results obtained from a study population to a broader population. Also called generalizability.
External Validity
Also called generalizability.
External Validity
External Validity also called…
generalizability.
Look at slide 41 to understand external vs. internal validity
It’s a PHENOMENAL visual reference
Designs that summarize the work of other studies
—-Takes the results of a large numbers of primary research studies and combines them into one
Systematic Reviews and Meta-analyses
The top two levels of the EBM pyramid
Generally represents the strongest evidence
Systematic Reviews and Meta-analyses
Both are subject to bias based on the inclusion and/or exclusion criteria
Systematic Reviews and Meta-analyses
What is the difference between a “systematic review” and a “meta-analysis”?
A “systematic review” is a thorough, comprehensive, and explicit way of interpreting the medical literature
A “meta-analysis” is a statistical approach to combine the data derived from several selected studies
A “_______” is a thorough, comprehensive, and explicit way of interpreting the medical literature
systematic review
A “_______” is a statistical approach to combine the data derived from several selected studies
meta-analysis