Unit 2 Flashcards
What are the factors and examples of a quantitative design?
Numbers are used to represent data
ex: scales, surveys, pain scales
What are the factors and examples of a qualitative design?
Words are used to represent data
ex: word clouds, small group open ended commentary session
What are the 2 types of quantitative designs?
Interventional and Observational
Interventional Design
Forced allocation into groups
- researchers intervene when assigning groups
Experimental design
Investigator selects the intervention
The only research design that can be used to show causation
Types: Phase 0, Phase 1, Phase 2, Phase 3, Phase 4
Observational Design
No forced allocation into groups
Natural design
- can do experimental type things
Researchers observe subjects/ elements occurring naturally or selected naturally by the individual
Used when it could be unethical to assign people to groups based on what you’re studying
Cannot be used to prove causation
Types: Cross-sectional, Case- control, Cohort
When would one use an observational design over an interventional design?
When it could be unethical to assign people to groups based on what you’re studying
When cost needs to be considered
What is the most useful and appropriate study design?
The one that answers the research question
Depends on question being asked and the desired perspective
What are the elements of a study design?
Research Question
Research Hypothesis
Selecting study subjects
Sampling Schemes
Research Question
“I wonder if …” statement
Frames study intent
Directs researcher to selecting and developing an effective study design to answer a question
Null Hypothesis
Research perspective that states there will be no true difference between the groups being compared
- says there is no association - will either reject or not reject this perspective based on results
Most conservative and most commonly used hypothesis
Statistical Perspectives = Superiority vs Noninferiority vs Equivalency
What are the 3 statistical perspectives of the Null Hypothesis?
Superiority
Noninferiority
Equivalency
Studies usually only look at 1 of these
Superiority
Used in drug vs placebo experiments
Asks “is this better?”
Null = this drug will not be superior to the placebo
Noninferiority
Used to compare drug to an efficient, gold standard drug already on the market
Asks “am I at least as good?”
Null = I am worse than the other.
Equivalency
Null = I am not equal
How to select study design?
Perspective of research question (hypothesis)
Ability/ desire of researcher to force group allocation (randomization)
Ethics of methodology
Efficiency and practicality (time and resource commitment)
Costs
Validity of acquired information (internal validity)
Applicability of acquired information to non-study patients (external validity)
Population
All individuals making up a common group
Can be divided into a smaller set (sample)
Sample
Subset or portion of the full, complete population
- representatives
Useful when studying the complete population is not feasible
How is the study population different from the population?
SP = the final group of individuals selected for a study
SP is a sample of the larger population
What is study subject selection based on?
Research hypothesis/ question Population of interest - people who are most useful and applicable to answer the research question Group selection criteria - Inclusion and exclusion group - Case and control group - Exposed and non-exposed group - Desired vs logical vs plausible selection criteria - Impacts generalizability
What are the two broader examples of Sampling Schemes?
Probability Samples
Non-probability Samples
Probability Samples + examples
Every element in the population has a known probability of being included in sample
- non-zero probability
Simple Random, Systematic Random, Stratified Simple Random, Stratified Disproportionate Random, Multi-stage Random, Cluster Multi-stage Random
Simple Random Sampling
- Assign random numbers then take randomly- selected numbers to get desired sample size
- Assign random numbers then sequentially list numbers and take desired sample size from top/ bottom of listed numbers
Systematic Random Sampling
Systematically sampling within groups
Assign random numbers then randomly sort the numbers and select the highest or lowest number
- systematically and by a pre-determined sampling interval take every Nth number to get desired sample size
Stratified Simple Random Sampling
Stratify sampling frame by desired characteristic
- use simple random sampling to select desired sample size
Desired characteristic may be a confounder
Have an equal number of strata in each group
Stratified Disproportionate Random Sampling
Disproportionately uses stratified simple random sampling when baseline population is not at the desired promotional percentages to the referent population
- stratified sample is weighted to return the sample population back to baseline population
Used for over- sampling
Multi-stage Random Sampling
Uses simple random sampling at multiple stages towards patient selection
- SRS at different levels
Regions/ counties = primary sampling unit
City blocks/ zip codes = secondary sampling unit
Clinic/ hospital/ household
Individual/ occurrence
Cluster Multi-Stage Random Sampling
Same as multi-stage random sampling but all elements clustered together (at any stage)
- ex: all clinics in a zip code, all households in a community
Non-probability Sampling
Quasi-systematic/ Convenience Sampling
Not completely random or fully probabilistic
Researchers decide what fraction of the population is to be sampled and how they will be sampled
What is a concern with using non-probability sampling?
There is some known or unknown order to the sample generated by the selected scheme which may introduce bias
- selection bias
Outcomes of Study
Patient oriented vs disease oriented
PO is more important and useful
Patients want to know what an influence will be on them (don’t care about numbers)
What are the easiest outcomes to generate?
Physiological Outcomes (numbers, levels, etc)
What do are the characteristics of the assessments we want to use to ensure internal validity?
Scientifically rigorous and standardized
Objective assessments are between than subjective assessments
Accurate, reproducible, and scientifically
What is the study population selection based on?
Ethics
Principles of bioethics must be met
What is equipoise?
Genuine confidence that an intervention may be worthwhile in order to use it in humans
Worthwhile = risk vs benefit
What are the 4 key principles of bioethics?
Autonomy
Beneficence
Justice
Nonmaleficence
Autonomy
Self-rule/ self- determination
Patients must decide for ones-self without outside influences
- no coercion, reprisal, financial manipulation
Patients need to have full and complete understanding of risks and benefits
- no misinformation, incomplete information, or ineffectively- conveyed information - need to account for language and education level
Beneficence
To benefit or do good for the patient
Not society
Justice
Equal and fair inclusion and treatment regardless of patient characteristics
Nonmaleficence
Do no harm
Researchers must no withhold information, provide false information, exhibit professional incompetence
Belmont Report
Issued in 1978 by National Commission for Protection of Human Subjects of Biomedical and Behavioral Research
Based on Tuskegee Syphilis Study
Principles:
- Respect for persons
- research should be voluntary and subjects should remain anonymous
- Beneficence
- research risks are justified by potential benefits
- Justice
- risks and benefits of the research are equally distributed
Consent
Agreement to participate, based on being fully and completely informed
Given by mentally-capable individuals of legal consenting age
- adults; age 18
Assent
Agreement to participate, based on being fully and completely informed, given by mentally- capable individuals not able to give legal consent
- ex: children and adolescents
Children or adults not capable fo giving consent requires the consent of the parent or legal guardian and the assent of the potential study subject
IRB
Institutional Review Board
Determines if a study is ethical and safe
Role = protect human subjects from undue risk
All human subject studies must be reviewed by an IRB prior to study initiation
- observational and interventional studies
Regulated by federal statutes developed Department of Health and Human Services (DHHS)
Rules referred to by Common Federal Rules (CFR)
Applies to all studies funded by federal government
Regulations enforced by Office of Human Research Protections
Office of Human Research Protections (OHRP)
The agency that administers and enforces the regulations
Can sanction/ close down/ stop
The teeth of the IRB
What are the levels of IRB review and what are the main differences between the levels?
Full Board
Expedited
Exempt
Number of members for committee review/ approval
Time for committee review/ approval
Level of detail in documentation needed for review
Full Board
Used for all interventional trials with more than minimal risk to patients
Needs more time and is labor intensive
Used when researchers are interacting with people
Expedited
Used for minimal risk and when there are no patient identifiers
Risk/ trauma can be triggered
- ex: survey brings up a traumatic past experience
Exempt
Used when there are no patient identifiers, low/ no risk, de-identified dataset analysis, environmental studies, use of existing data/ specimens
Data already exists in records
- could be preexisting data
- may not have contact with patient
Who determines the level of review?
Data Safety and Monitoring Board (DSMB)
Semi-independent committee not involved with the conduct of the study but charged with reviewing study data as study progresses to assess for undue risk/ benefit between groups
Use pre-determined review periods
Can stop study early, for overly positive or overly negative findings in 1+ groups compared to the others
This was the group that shut down women’s postmenopausal study in estrogen/ testosterone group
What is the key difference between interventional and observational studies?
Investigator selects interventions and allocates study subjects to forced intervention groups
More rigorous in ability to show cause- and- effect
- can demonstrate causation
What differs between each phase of interventional studies?
Purpose/ Focus
Population studied (healthy/ diseased)
Sample Size
Duration
Pre- Clinical Stage
Prior- to human Investigation
Bench or animal research
Occurs before human receives intervention
Phase 0
Exploratory, Investigational New Drug
Not to see if drug is effective or safety
Does it do what we said it did?
Most phase 0 studies are used for oncology
Purpose/ Focus:
- assess drug- target actions and possibly pharmacokinetics in single or a few doses - first in human use
Population studied:
- healthy or disease patients (oncology) volunteers
Sample Size:
- very small N ( < 20)
Duration:
- very short duration (single dose to just a few days)
Do all interventional studies start at phase 0?
No
Phase 1
Investigational New Drug
Purpose/ Focus:
- assess safety/ tolerance and pharmacokinetics of 1+ dosages - can be first in human use/ early in human use - primary purpose is not to look at the efficacy of disease
Population studied:
- healthy or disease patients volunteers - depends on the disease
Sample Size:
- small N (20 - 80)
Duration:
- short duration (few weeks) - variable
What does pharmacokinetics look at?
How does the body handle the drug?
How does the drug get in?
How long does it take to get in?
Where does it go?
Phase 2
Investigational New Drug
Purpose/ Focus:
- assess effectiveness - continues to assess for safety/ tolerance but this isn’t the primary purpose - Need to use placebo/ comparison group
Population studied:
- diseased volunteers - may have narrow inclusion criteria for isolation of effects
Sample Size:
- larger N ( 100 - 300)
Duration:
- short to medium duration (few weeks to a few months)
Phase 3
Investigational new drug or indication/ population study
Last phase before FDA approval
- need minimum of 3 out of 5 trials to be positive to show that it wasn’t any better than the equivalent or comparison
Purpose/ Focus:
- assess effectiveness - continues to assess for safety and tolerability
Population studied:
- diseased volunteers - may expand inclusion criteria and comparison groups for delineation of effects - can use different statistical procedures - superiority vs noninferiority vs equivalency
Sample Size:
- larger N (500 - 3000)
Duration:
- longer duration (a few months to a year or more)
Why can various statistical perspectives be taken in phase 3 studies?
In some studies, it is unethical to give placebo vs something else. In this case, both groups would get a baseline pharmacological drug
Ex: you wouldn’t ask someone with asthma to stop taking their medication
Phase 4
Post marketing and FDA approval
Purpose/ Focus:
- assess long-term safety, effectiveness, optimal use (risk/ benefits)
Population studied:
- diseased volunteers - expand use criteria (comorbidities/ concomitant medication) for delineation of long-term safety/ effects
Sample Size:
- Population N (few hundred to a few thousand)
Duration:
- wide range of durations (few weeks to several years) - ongoing - used in interventional/ observations designs - FDA may make companies use a registry in order to follow patients/ effects/ outcomes
Advantage of Interventional Trials
Cause precedes effect (can prove causation)
Only designs used for FDA approval process
Controlling exam environment
Can avoid certain biases
Disadvantages of Interventional Trials
Cost
Complexity/ time
Ethical considerations (risk vs benefit)
Generalizability
Can be over controlling and not true clinical practice
Very regimented and prescriptive in what we do
Pragmatic Studies
Explanatory
Intervention- like but tells us how to treat patient and disease
Gives us flexibility to change dose/ care to treat each patient as needed
- more flexible in exam environment and makes it closer to clinical practice
What are limitations of pragmatic studies?
Makes it hard to compare groups at the end
Flexibility can introduce extraneous factors/ confounds/ etc
What are differences between simple and factorial interventional designs based on?
Differ based on number of randomization steps patient goes through before being put into final study group
Comes down to how much control should we really give to researchers
Simple Interventional Design
Randomizes subjects exclusively into 2+ groups
1 randomization process (no subsequent randomization)
Commonly used to test a single hypothesis at a time
Asks if drug A is better/ worse/ equal to drug B
Factorial Interventional Design
Randomizes subjects into 2+ groups and then further randomizes each of the groups into 2+ additional subgroups
Allows us to ask more research questions
- is drug A better/ worse/ equal to drug B? - is drug A alone better? - are additional combinations better than 1 drug alone?
Used to test multiple hypotheses at the same time
What does testing multiple hypotheses at the same time do for a factorial interventional design?
Improves efficiency for answering clinical questions
Increases study population sample size
- due to increased group number
Increases complexity
Increases risk of drop outs
May restrict generalizability of results
Parallel Interventional Design
Regardless of simple/ factorial, once patients get into final study group, they do not change groups
Groups are simultaneously and exclusively managed
No switching of intervention groups after initial randomization
Cross- Over Interventional Designs
Also known as self- control
Groups serve as their own control by crossing over from 1 intervention to another during the study
- subjects get to be their own control - works because they are matched on demographics because it is themselves
Allows for smaller total sample size
- caveat: participants have longer participation time - each participant contributes additional data
Uses wash-out and lead- in
Wash- out
Period of time where we don’t give patients drugs
Allows drug to wash out from system so they can start subsequent trials/ treatment
Washes out pharmacological/ psychological effects of study before subsequent treatments
Lead- in
Wash out period that occurs before the study starts
Ex: when patient is on drugs but cannot necessarily take them during the study. This allows drug to leave the system before the study starts
Way to test patients ability to follow directions and see if they meet requirements
- if cannot meet requirements, they can be dropped from the study
Disadvantages of Cross- over designs
Only suitable for long-term conditions which are not curable or which treatment provides short-term relief
Duration of study for each subject is longer
Carry-over effects during cross- over
- wash out is required when prolongs study duration
Treatment- by- period interaction
- differences in effects of treatments during different time periods
Smaller N requirement only applicable if within-subject variation is less than between- subject variation
Complexity in data analysis
Run in/ lead in phase
All study subjects blindly given 1+ placebos for initial therapy (defined time period) to determine baseline of new disease
Standardization
Can assess study protocol compliance
Can wash out existing medication
- reduces at least 1 possible common exclusion criteria
Can determine amount of placebo- effect
What is the difference between primary and secondary outcomes?
Primary are the most important/ key outcomes.
-main research question used for developing/ conducting study
Secondary/ tertiary are less important and can be used for future hypothesis generation
What is a composite outcome?
Combines multiple endpoints into single outcome
Patient- Oriented Endpoints
Most clinically relevant
Death
Stroke/ Myocardial Infarction
Hospitalization
Preventing need for dialysis
Disease- oriented endpoints
Surrogate markers
- elements used in place of evaluating patient- oriented end points
Blood pressure - for risk of stroke
Cholesterol - for risk of heart attack
Change in SCr- for worsening of renal function
Non- Random Group Allocation
Subjects don’t have an equal probability of being selected or assigned to each intervention group
Ex: the first 100 patients admitted to the hospital
- patients attending morning clinic = group 1, patients attending evening clinic assigned to group 2