Critical appraisal Flashcards
What is meany by the Number Needed to Treat (NNT)
The NNT measures the number of patients who need to receive a treatment to prevent one additional bad outcome
equation for NNT
In studies it is calculated by 1 / (EER - CER)
i.e. NNT = 1 / ARR
what is meant by relative risk
RR = Probability of an event when exposed/Probability of event in control group
Also called risk ratio.
measure of proportionate increase in exposed group
RR = EER / CER (= (a / a+c) / (b/b+d) )
what is meant by absolute risk?
Absolute risk is likelihood of developing a disease over a time period
what is meant by hazard ratio
A hazard ratio considers your absolute risk to be 1.
If something you do / take doesn’t change your risk, then the hazard ratio is 1.
If something you do lowers your risk by 30% compared to not doing it then that action makes your hazard ratio 0.70 = the risk is 70% of what it was (30% lower).
If something you do triples your risk, then your hazard ratio is 3.0 (risk is 3 times greater than it was before).
Experimental event rate calculation
EER = a/ (a+c)
a = exposed and diseased c = exposed and not diseased
A measure of how often a particular event occurs within the experimental group of a trial.
what is the Absolute risk reduction
ARR (RD) = CER - EER
i.e. (a/a+c) / (b/b+d)
absolute risk reduction is the same as risk difference. Comes from subtracting the risk in one group from the risk in the other group.
High risk patients show a bigger risk difference than low risk patients. Patients who are unlikely to experience the outcome will need more patients to be treated for one outcome to be avoided, and the risk difference is smaller.
what does it mean if the relative risk is 1
no risk difference
no causation
what does it mean if the relative risk is > 1
Increased risk amongst those exposed
i.e. it is a risk factor
what does it mean if the relative risk is < 1
decreased risk amongst those exposed
i.e. it is a protective factor
what is relative risk reduction
Relative risk reduction is the proportional reduction in risk between active and control participants in a trial.
If the relative risk reduction is 10%, the risk in the active treatment group will be 90% of that in the control group.
what makes the NNT larger?
Less effective treatments
i.e. prevent fewer events, so more patients need to be treated to prevent a single event.
what makes NNT smaller?
The NNT gets smaller for longer durations of treatment.
Or for more effective treatments
Which will appear more impressive of the relative risk or the absolute risk?
The relative risk will always be a larger percentage figure than absolute risk, so relative risk seems more impressive.
What impact does the framing of research results have
The framing of results is the way that results are presented and this can influences doctors’ attitudes about a treatment.
what is EER
EER = experimental event rate (incidence in group receiving intervention) EER = a/ (a+b)
what is CER
CER = control event rate (incidence measured outcome in control) CER = c / c+d
What is meant by odds ratio
Odds Ratio is a method of comparing how likely events are between 2 groups.
odds of event occurring in one group divided by the odds of event occurring in the other group.
OR = a x d / b x c
calculation for odds of a positive outcome in exposed patients
odds f a positive outcome in exposed patients = a/b
e.g. odds of rolling a 1 on a dice = 1/5 = 0.2
what is a Student’s t-Test
Students T-test compares two means (averages) and tells you if they are different from each other.
And how significant the differences are.
what is Chi Squared test
Chi Squared test is a
Nonparametric test used to compare numerical or categorical data sets.
what is categorical variable
ategorical variables represent types of data which may be divided into groups.
Examples of categorical variables are race, sex, age group, and educational level.
what is meant by Nonparametric data
Does not fit a normal distribution.
Nonparametric statistics uses data that is often ordinal, meaning it does not rely on numbers, but rather on a ranking or order of sorts.
e.g. a survey conveying consumer preferences ranging from like to dislike would be considered ordinal data.
what is a numerical / quantitative (Non-categorical) variable
Numerical (Non-categorical) variables are usually referred to as range variables and are expressed as numbers within the set of the Reals, usually varying from negative infinity to positive infinity
what statistical tests can be done with data that is normally distributed
Students T test
ANOVA (analysis of variance)
what statistical tests can be done with data that is not normally distributed
nonparametric tests - which dont assume anything about the population parameters.
chi-square,
Fisher’s exact test
Mann-Whitney test.
what is a regression analysis used for
A regression equation is used in stats to find out what relationship, if any, exists between sets of data
Regression analysis is also used to understand which among the independent variables are related to the dependent variable.
In restricted circumstances a regression analysis can be used to infer causal relationships between the independent and dependent variables.
what does simple linear regression result in
A linear relationship between one dependent variable and one independent variables = a straight line of best fit
Like an average of where all the points line up.
In linear regression, the regression line is a perfectly straight line
what does polynomial regression result in
A polynomial regression results in a curved line of best fit .
polynomial regression is considered to be a special case of multiple linear regression
what does multiple linear regression result in
Also known as multiple regression
A statistical technique to model the linear relationship between the 2 pr exploratory (independent) variables and the response (dependent) variable.
linear relationship between one dependent variable 2 or more independent variables.
What are Rank Sum tests?
Wilcoxan and Mann Whitney U tests are both rank sum tests.
These are Nonparametric tests
Does not require the assumption of normal distributions.
What are Bradford Hills criteria and what are they for?
The criteria for causation
- Temporality - time sequence
- plausability
- consistency
- strength of association
- dose - response gradient
- reversibility
- specificity
- coherence
- analogy
points to look at when appraising a case control study?
- focused aim / issue
- Is the method appropriate for the question
- Recruitment - case definition, cases representative of population, system for case selection, are cases incident or prevalent, time frame of stuy relevant to disease?, power calculation
- contol selection - representative and matched?
- Exposure accurately measured? recall bias, subjective, is the measure validated
- blinding
- confounders
- results
- strenght of association, OR, P-value, CI
what is a consort flow diagram
a flow diagram to provide a broad overview of how the trial was conducted
Concise method to report research method and protocol
Shows progress through phases of an RCT of each trial arm
Advantage of case control studies
cheap Quicker than cohort requires smaller sample size not prone to loss to follow up study rare outcomes
Define positive predictive value
how likely someone who tests positve actually has the disease
= true positive
PPV = A/A+B
(where A is screen +ve has disease and B is screen positive no disease)
Define negative predictive value
How likely someone who tests negative actually does not have the diease
= true negative
PPV = D/C+D
(where D is screen -ve no disease and C is screen -ve has disease)
what is the attributable risk
Same as the risk difference.
difference between incidence rates in the exposed and non exposed groups
calculation for control event rate (CER)
CER = b / b + d
b = not exposed and diseased c = not exposed and not diseased
calculation for estimated population exposure
a + c / a + b + c + d
calculation for (population attributable risk percent) PAR%
PAR% is calculated by
dividing the population attributable risk (PAR) by the incidence in the total population
then multiplying the product by 100 to obtain a percentage
How is relative risk different to attributable risk?
Relative risk helps determine whether and how strongly a precursor is associated with a particular outcome.
Attributable risk helps determine how much of an
outcome may be attributable to a particular risk factor (i.e. an estimate of the excess risk) in a
population exposed to that factor.
what is a population attributable risk?
The proportion of all cases of an
outcome in the total population that could be attributed to the exposure to the risk factor.
what factors help distinguish cause from association?
strength of association (relative risk) time sequence - cause MUST precede outcome distribution - geographical gradient - dose and duration correlation with outcome consistency specificity biologically plausable experimentally reproducable precentative trials
what is the absolute risk?
Number of events (or disease) / total number in the group or population
uses of descriptive studies
guidance on association
demonstrate a broad geographical difference
determine relative frequency of dieases or factors
service planning
evaluating service effectiveness
types of sampling methods for observational studies
simple random sampling - e.g. random number generator
systematic sampling - seclect person at regular intervals
stratified sample - propabbility of patient selection varies by a pre-determined characteristic to ensure a subgroup is represented
cluster sample - groups are the sampling units, randomly selected
continuous sampling
convenience sampling
sources of bias in sampling
deviation from sampling methodology
omission of people who are hard to identify as belonging to the population
large numbers declined to participate
self selection or volunteer patients
excessive exclusion criteria
Berkson bias - selection taken from a sub-population who do not reflect the whole population (e.g hospital patients)
What does CONSORT stand for?
Consolidated Standards Of Reporting Trials
what is CONSORT used for
Consolidated Standards Of Reporting Trials
A statement introducing a set of recommendations to improve RCT reporting
Protocol to identify problems from conducting RCTs and assist with reporting them fully and clearly
what are the 4 stages of an RCT listed in a CONSORT flow diagram?
- Enrollment
- Intervention allocation
- Follow - up
- Analysis of data / results
The first part of a CONSORT flow diagram is ‘enrollment’
what 3 things should this include?
Enrollment - include
1 - Number assessed for eligibility
2 - Number excluded and why - not meeting inclusion criteria / decline / other reasons
3 - Number randomised (study population)
The second part of a CONSORT flow diagram is ‘allocation’
what should this include?
Allocation includes
- number of patients allocated to intervention
- number of patients in each arm who receive the intervention
- number in each arm who do not receive the intervention