Critical appraisal / QIP Flashcards
What is absolute risk reduction?
Measure of effect
Incidence of outcome in experimental group minus the incidence of outcome in the control group
= CER - EER
Of 100 patients in the treatment group, 20 died. 30 of 100 died in the placebo group. What is the absolute risk reduction?
30/100 (0.3) - 20/100 (0.2) = 10/100 or 0.1 or 10%
What is bias?
Systematic difference in the way a study is conducted that leads to less valid results
What is bias ascertainment?
Bias when measurements are performed differently
What is bias expectation?
Bias when those collecting data are influenced by their own knowledge
What is bias follow up?
When loss to follow up differs between two groups
What is bias inclusion?
When subjects included in groups are not at random
What is a confidence interval?
Confidence an estimated effect is between two values - 95% normally chosen confidence interval
What value makes a confidence interval statistically significant?
<1
What is a confounding variable?
Variable associated with both the exposure and outcome of interest which can lead to inappropriate conclusions re: association
What is effectiveness?
How well an intervention works in the real world
What is efficacy
How well an intervention works under ideal conditions
What is heterogenecity?
The amount of variation of results of trials included in systematic reviews. Less heterogenecity increases likelihood of results being true
Describe intention to treat analysis
Patients analysed by which group they end up in, not where they were allocated.
I.e if patients stopped take the treatment for whatever reason, they are still analysed in the intervention arm. This increases chance of type 2 error (i.e. less likely to show a difference) but takes into account what happens in real life.
What is JADAD score?
Rank of methodological quality (0-5)
What is kappa?
Concordance between observers.
1 = perfect agreement
0 = absolute disagreement
What is a negative likelihood ratio?
how likely is a negative test to be found in a person without the disease than in a person with the disease?
How good a test is at excluding a disease
How is a negative likelihood ratio calculated?
(1 - sensitivity) / specificity
i.e. false negative / true negative
What values of a negative likelihood ratio show a useful test?
Number will be <1.0
<0.2 useful
<0.1 very useful
What is a positive likelihood ratio?
How much more likely is a positive test to be found in a person with the disease than in someone without the disease
ie. How good is a test at ruling in a disease
How is positive likelihood ratio calculated?
(sensitivity / (1- specificity)
i.e. true positive/ false positive
What positive likelihood ratios values show usefullness?
Value will be >1.0
5-10 useful
> 10 very useful
What is sensitivity?
How many true positives does a test pick up as a proportion of all positives
How is sensitivity calculated?
A/ A + C
What is specificity?
How many true negatives dose a test pick up, as a proportion of all negatives?
How is specificity calculated?
D / B + D
What is negative predictive value?
If a patient has a negative test, how likely are they not to have the disease?
How is a negative predictive value calculated?
D/ C + D
How is positive predictive value calculated?
A / A + B
What is positive predictive value?
If a patient has a positive test what is the probability of them having the disease?
What is number needed to treat?
Inverse of absolute risk reduction
(1/ARR)`
How is NNT calculated?
1/absolute risk reduction
or 100/ ARI as a %
How is number needed to harm calculated?
1/ absolute risk increase
or 100/ ARR as a %
What is an odds ratio?
Measure of effect from case control studies
Odds in experimental group / odds in control group
What does an odds ratio of 1 mean?
No effect
How is an odds ratio calculated?
Odd of risk in exposed group / odds of risk in non-exposed group
= (a/b) / (c/d)
What is a type 1 error
Finding a truth, when in fact there is none
What is a type 2 error
Failing to find a difference, when in fact there is one
ie. accepting the null hypothesis, when it is correct
What is regression?
Statistical technique where all known confounders are held constant so that an association between variables can be examined
What is a relative risk and how is it calculated?
It is a measure of effect
Incidence of outcome in experimental group / incidence of outcome in control
EER / CER
What is a case control study?
Type of observational study. Researchers look at a set of patients with a certain disease and then looks to what risk factors/exposures might have led to the disease.
What is a cohort study?
Type of observational study. Patients exposed to treatment/risk factor are identified and followed up to see what happens.
NB: the researchers do not affect who gets exposure/medicine, which is what makes it observational
What is an observational study?
Study where researchers do not ‘do’ anything to the patients or objects. Merely observe and record what happened, has happened
What is a ROC curve?
Graphical plot of sensitivity against (1-specificity) for the range of possible cut off values for the test.
What does an increase in area under the curve represent in a ROC curve?
More sensitive test
What is the optimum value for area under curve?
What is the AOC value for a useless test?
- 1.0
- 0.5
What is a forest plot
Graphical representation of meta-analysis showing results of RCT
Demonstrates degree of data overlap and therefore heterogenecity
When is a case control study useful?
If the disease is rare
When is a cohort study useful?
When the you want to known about of lot of different outcomes about a particular exposure/medicine.
What is a cross sectional study?
Researchers look at either exposure or disease, or both at a single point in time. Most commonly used to demonstrate prevalence. ‘Snapshot’ of population
What is a confounder?
An extraneous factor that can affect the outcome and lead to invalid inferences
e.g. age, gender, smoker etc.
How do we calculate risk?`
Risk = number of times an event occurs / total number of events
How do we calculate relative risk?
Risk in experimental group / risk in control group
EER / CER
How do calculate relative risk reduction?
Difference in risk between tx and control group / risk in control group
= (CER-EER) / CER
= ARR / CER
How do we calculate odds in treatment group?
Positive outcome treatment group/ Negative outcome treatment group
= a/b
How do we calculate risk in control group?
Number with outcome in control group / total number in control group
CER = c/(c + d)
How do we calculate risk in experimental group?
Number with outcome in experimental group / total number in experimental group
EER = a/(a+b)
How do we calculate odds in control group?
Positive outcome in control group / negative outcome in control group
= c/d
What is on the x and y axis of a ROC curve?
x = sensitivity (true positive)
y = (1 - specificity) or false positive
What part of a ROC curve shows statistically most sensitive value?
Area closest to top left corner
What is Lean process?
Lean uses process mapping with associated stakeholders to identify inefficiencies in care, enabling actions for improvement.
What is Six Sigma?
Six sigma uses DMAIC and control charts are used to study adjusted processes over time.
What is DMAIC?
Define
Measure
Analyse
Improve
Control
What type of QIP design works in partnership with patients and families to improve services from their perspective.
Experience Based Co-Design (EBCD)
What is are run charts and statistical process charts used for?
Plots data over time in order to show the effect of interventions
What is the difference between run charts and statistical process charts?
Run charts simply data plotted over time, SPC uses statistical processes as well.
With regards to a run chart what is a ?
1. Shift
2. Trend
3. Run
- 6 or more points above or below median line, signifies change unlikely to be chance
- 5 or more points consecutively increasing or decreasing
- Indicates if sufficient data points exist. Number of times the data crosses the median line. Depending on data set, will have prescribed number of runs needed for data to be sufficient
What are the 6 S’s of analysis and options (QI )
- Strategy
- Skills
- Style
- Shared Values (indefinable)
- Structure (allocation of staff)
- Systems (budgets, training, audit, communication
What is a SWOT analysis?
Strengths
Weaknesses
Opportunity
Threats
What is a stakeholder analysis used for?
Establishing how stakeholders will affect change process, and how they should be ‘managed’.
What is a forcefield analysis?
Method of establishing the drivers and resistors for change (and the magnitude), to assist with planning of change process
What is a Healthcare Failure Mode and Effects Analysis (HFMEA)
QI method base on asking staff - what could go wrong?
What is a Ishikawa (Fishbone) diagram?
Visual representation of causes and sub-causes and what actions could be considered to affect change (or could have led to an error)
What is the ‘5 whys’ method of root cause analysis?
Ask why 5 times, the answer to the fifth is the root cause
How do you calculate the false positive rate?
1 - specificity
How do you calculate the false negative rate?
1 - sensitivity