AAAA Therapy Flashcards

1
Q

Objectives:

A

❖Introduce a framework for using population based research in clinical practice (Assess-Access-Appraise-Act)
❖Rehearse the framework for a question about the effectiveness of a treatment
❖Understand key methodological aspects of studies used to evaluate effectiveness of a treatment
❖Calculate and interpret common ‘effectiveness’ outcome measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the 4 elements of the aaaa framework

A

❖Assess: what type of healthcare question – what type of study?
❖Access: finding the ‘best’ evidence (validity/ trustworthy and relevance)
❖Appraise: evaluating the quality of the evidence & interpreting the results
❖Act: is this evidence relevant to my clinical practice. Should this evidence change my practice?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Why is aaaa important

A

❖An essential professional and academic skill
❖Medical knowledge is continually evolving.
❖The medical profession frequently fails to use effective treatments even when they are available.
❖Keeping up to date is a lifelong commitment for every doctor.
❖You need to develop and use the skills to find, appraise and act on research evidence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is evaluation bypass

A

Avoid evaluation bypass
Where interventions adopted with unevaluated procedure
With only enthusiasm, convictions, and commercial pressure
And no good evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Example of RCT which was planned to address gap in evidence

A

❖Corticosteroids had been used to treat acute head injury for more than 30 years
❖MRC-CRASH Randomised Controlled Trial aimed to solve remaining uncertainty of benefit
❖International trial n=20,000 planned
❖Trial stopped early (n=10,000) – evidence of harm
❖Mortality at 2 weeks -21.1% with steroids -17.9% with placebo
❖Hundreds of thousands harmed (killed) internationally

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What study design is used for a effectiveness question

A

RCT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Cause and effect their is a hierarchy of evidence. Three key characteristics that determine validity of study:

A

Casual agent - treatment
Effect - benefit to patient

  1. Temporality - whether cause proceeds the outcome. RCT and cohort studies high in hierarchy
  2. Experimental evidence - RCT less biased than observational studies
  3. Evidence from several studies rather than one - systematic reviews are best
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What to do when assessing clinical question

A
  • Effectiveness is a balance btw benefits and harm
  • Potential side effects
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are clinical components of an effectiveness question

A

❖Population: those who are eligible for treatment with the intervention / comparator
❖Intervention: New treatment
❖Comparator: Existing treatment / usual care (may be no
treatment)
❖Outcome(s): Mortality / morbidity / physiological measure (BP)
Formulating PICO is important for:
• Efficient searching for evidence in electronic bibliographic databases such as MEDLINE
• Assessment of the applicability of research to your patients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is access in the framework

A

How to find the best study
That are clinically relevant to the question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How to access specific RCTs

A

❖Use the components of your question-specific PICO
❖Start with terms for Intervention of interest. If necessary to increase
specificity of the search combine with terms for the Population
❖Often more than one one term to describe question components which can be taken from:
-bibliographic database thesaurus’ (MEdical Subject Headings) -non MESH terms for the question component (free Text
terms)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are Boolean operators

A

❖Combine terms using Boolean operators:
-“AND” gives search results which include both search terms
-“OR” gives search results which include either one or other or both search terms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is appraise in the framework

A

Quality of the conduct of the study
Interpretation of the results

❖Does the study address a research question which is relevant to my clinical problem
(is there a match between my PICO & the study question?)
❖Did reserchers use the study design most likely to provide a valid answer to the clinical question
(for effectiveness was it an RCT?)

❖Was the study done well / is the study trustworthy ? (were steps taken to reduce bias?)
❖If the study was done well (valid), what were the results?
(direction, size, precision and statistical significance of results)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is bias

A

If pattern of deviation has a systematic pattern

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Key Features of an RCT

A

Prospective
Exposure (treatment) comes before we measure the outcome
New treatments/ comparator
Randomisation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Why do we have a control group

A

Having a control group allows us to evaluate whether patients would get better anyway - the comparator treatment /no treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Why do drug manufactures not allocate treatment

A

Patients have different abilities to benefit from treatment
Manufacturer may be inclined to select patients with a better prognosis to have new treatment
May make new treatment look better than actually is
Removes selection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Why cant patient/ dr allocate treatment

A

Patients and doctor may choose for more severe patients to receive the new treatment
Skews the results and data
Imbalance between group with treatment and control
So removes selection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is randomisation

A

Every person has equal chance
Allocation decided by chance
Minimises the chance of selection bias
Minimised differences btw groups being compared at the start of the trail
At end of trail any differences observed should be due to differences in intervention and comparator only

20
Q

What is allocation concealment

A

❖Allocation concealment hides the allocation of trial participants from participants and those recruiting participants so that this knowledge cannot influence (as per previous slides) who actually receives which treatment. Minimises the chance of selection bias
❖How:
-a computer generated random sequence should be
performed distant to where the trial is being conducted
-where possible, treatment allocation should be concealed until its administration (sealed envelopes, similar packaging etc)

21
Q

Why can allocation concealment be hard

A

Hard to conceal interventions sometimes
E.g. physical activity

22
Q

What is the placebo effect

A

‘a beneficial effect produced by a placebo drug or treatment, which cannot be attributed to the properties of the placebo itself, and must therefore be due to the patient’s belief in that treatment’.

23
Q

Why is blinding important

A

To avoid measurement bias
And prevent performance bias

24
Q

What is measurement bias

A

❖Patients may offer socially desirable responses if they know they are in the intervention arm

❖Observers (those measuring outcomes) may have preconceived ideas about how effective a treatment is. This can influence how they measure subjective outcomes

25
Q

What is performance bias

A

❖Healthcare professionals may have preconceived ideas about how effective a treatment is. This can influence (consciously or subconsciously) how they deliver treatments, and may lead to participants in either the intervention or comparator arm receiving ‘extra’
❖Study participants may be disappointed about which arm they are randomised to which may lead to them behave differently, for example not engaging with treatment

26
Q

What is blinding?

A
27
Q

What are the levels of blinding

A

Who can be blinded:
- Participants
- clinicians delivering treatment
- researchers measuring outcomes
- statisticians undertaking analysis

Depending on how many types of participants are blinded:
- single blind
- double blind
- triple blind

28
Q

What are the 2 elements of follow up of participants

A
  1. Follow up should be complete.
    -Patients may be lost to follow up at different points in a trial
    -Patients may be available for outcome measurement but are not adhering to the trial protocol (not taking/receiving allocated treatment)
  2. Follow up should be long enough for outcome to be measured. Dictated by type of outcome.
    E.g.
    Infection - days/ weeks
    Recovery from cancer - years
29
Q

What scenario is least likely to undermine the validity of RCT

A

Where there is a similar loss from both treatment arms
Not about the total loss - about whether proportion of loss is balanced

30
Q

What is attrition bias

A

a type of selection bias due to systematic differences between study groups in the number and the way participants are lost from a study.

31
Q

What may be a common pattern of drop out in RCT

A

Drop out of patients with severe disease in control
Drop out of patients with mild disease as have more to loose due to side effects

32
Q

In an RCT, if patient drops out of intervention arm what should be the follow up

A

Intention to treat:
Patients who did not take the new drug should be analysed with the group allocated the new drug (ignoring the fact they did not take the new drug)
To uphold the validity of the RCT

If you exclude the patients - causes imbalances in arms. Undoes randomisation.

33
Q

Design features of RCT that minimise bias

A

Randomisation - selection bias
Allocation concealment - selection bias
Blinding - performance and measurement bias
Complete follow up
Intention to treat

34
Q

How to interpret results

A

❖Direction of effect:
-Do we want more or less of the outcome? -Have we got more or less of it?
❖Size of effect estimate ❖Precision of effect estimate
❖Statistical significance of effect estimate:
-Is any difference between groups likely to be real or due to
chance?
❖Clinical significance of effect
- If the difference is statistically significant, is it large enough to be clinically important (signficant)?

35
Q

What do you use to compare interventions

A

2 by 2 table

36
Q

What is risk difference

A

Percentage of patients that will benefit compared to control
First divide the patients that benefited by the total number of patients separately in both arms
Risk of benefit in intervention group minus risk of benefit in comparator group

37
Q

What is relative risk

A

Risk of benefit or harm
First divide the patients that benefited by the total number of patients separately in both arms
Ratio
Divide risk benefit of intervention group by comparator group

38
Q

What are 2 ways you can statistically compare risk benefits

A

Risk difference
Relative risk

39
Q

What is NNT number needed to treat

A

How many patients we need to treat with intervention for one more person to benefit compared to comparator
1/ risk difference

E.g.
4.5….. An extra 5 patients would need to be treated with chiro compared to physio to achieve one more patient with no pain at 3 months in the chiro group.
(NOTE: Unit of NNT is people and so need to round to a whole number – convention is to round up)

40
Q

What are the interpretations of results for relative risk

A

RR = no difference between groups
RR>1: more outcomes in treatment (chiro) group compared to comparator (physio) group.
RR<1 :less outcomes in treatment (chiro) group compared to comparator (physio) group.

41
Q

What are the interpretations of results for risk difference

A

RD = 0: no difference between treatment (chiro) and comparator
(physio) groups.
RD> 0 (+ve): more risk of outcome in treatment (chiro) group compared to comparator (physio) group.
RD<0 (-ve): less risk of outcome in treatment (chiro) group compared to comparator (physio) group.

42
Q

What are statistical tests

A

the probability of observing a false positive result/ it being due to chance

Hypothesis testing: p values
A p-value = 0.05 = 5% probability that the observed result is due to chance (a false positive result)
A p-value = 0.01 = 1% probability that the observed result is due to chance (a false positive result)

43
Q

How is precision of results calculated

A

Using confidence intervals
an estimation of the range within which the true size of effect lies

-EG a 95% CI for a RD of +22 (+18 to + 26) = if we repeated the trial 100 times, 95/100 times we would observe a RD between +18 and +26

If the RD lies within the range then we can deduce that it is statistically significant

44
Q

What is act in the aaaa framework

A

Whether we should change practice due to evidence that study presents

45
Q

How do consider whether to act

A

Refer back to pico
How close the study participants match the patients in healthcare
What is the cost of the intervention?
What other treatments are available? What is their cost?
Were all important outcomes (including harms) considered?