RCTs Flashcards

1
Q

What needs to be considered if RCT findings are valid and applicable?

A

Eligibility criteria, randomisation method, allocation concealment, blinding, follow-up

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is scientific method?

A

Ensuring research is not shaped by personal belief but grounded in measurable (empirical) evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Which types of bias can be present in experimental studies?

A

Selection, performance, detection, attrition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is internal validity?

A

Extent to which a causal conclusion is warranted, determined by the extent to which the study minimises systematic error (bias, confounding, chance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is external validity?

A

Extent to which study can be generalised to different situations and people regardless of internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the 3 types of intervention studies?

A
  1. Uncontrolled before and after
  2. Controlled before and after
  3. RCT
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the benefit of a controlled compared to an uncontrolled intervention study?

A
  1. Regression to the mean could give an appearance of improvement in an uncontrolled study which is minimised with control groups
  2. Some confounding factors may be accounted for with comparing to a control group (eg seasonal)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How are RCTs beneficial to controlled clinical trials?

A

Participants in a controlled clinical trial are assigned to new treatment or control by themselves, dr or researcher - this could introduce selection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How could participants choosing their assignment to groups impact the study?

A

Selection bias - participants choosing active treatment might differ to those who do not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How could doctors choosing assignment to groups impact the study?

A

Might put those frail or unlikely to withstand new treatment in controls, or younger or sicker people in active treatment to give them a better chance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How could researchers choosing assignment to groups impact the study?

A

Might only select those who will do well to be in active groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the key features of an RCT?

A

Randomisation of allocation to groups, allocation concealment, blinding and intention to treat analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the 3 sections of the CASP tool for RCTs?

A

Are the results valid?
What are the results?
Will the results help locally?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How do you look at choice of outcome measure of a study?

A
  1. Is it relevant to patients (clinical effectiveness or patient experience)
  2. If proxy, does it measure what it should?
  3. Type
  4. Needs to be reliable, valid, responsive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What makes an outcome measure reliable?

A

Able to produce consistent, reproducible estimates of true effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What makes an outcome measure valid?

A

Measures the construct it claims to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What makes an outcome measure responsive?

A

Detects changes in construct to be measured over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What ethical issues are related to RCTs?

A

Equipoise (reasonable belief that interventions are equal) is required to ethically randomise participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the different choices of controls in RCTs?

A
  1. Current best practice
  2. No treatment: only if no current best practice and do not feel new treatment is effective!
  3. Placebo
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What is allocation concealment?

A

The person recruiting to a trial does not know which group the participant will be assigned to

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What can a lack of allocation concealment lead to?

A

Confounding (imbalance of characteristics between study arms) and selection bias

22
Q

Which problems with RCTs can be avoided with blinding?

A
  1. Non-adherence
  2. Performance bias:
    A) comparator group gets extra, contamination if gets treatment anyway, seek other treatments etc
    B) intervention gets extra as more regular contact with health service
23
Q

What are the 4 degrees of blinding?

A
  1. Unblinded/open label
  2. Single blinded
  3. Double blinded
  4. Triple blinded
24
Q

What does it mean if research will single blinded?

A

Participant is blinded to treatment or control

25
Q

What does double blinded mean?

A

Participants and HCPs/researchers are blinded to treatment or control

26
Q

What does triple blinded mean?

A

Participants, HCPs/researchers and statisticians blinded to treatment or control

27
Q

What is the benefit of blinding statisticians?

A

Avoid bias in measuring or interpreting outcomes

28
Q

Which study features make cross-over and contamination a particular issue?

A
  1. Information/education as intervention

2. Cannot treat people differently in same clinic

29
Q

What is cluster randomisation?

A

Groups/clusters are randomised instead of individuals

30
Q

What are benefits and disadvantages of cluster randomisation?

A
  1. Reduces contamination

2. Needs bigger study and statistical significance is more complex

31
Q

How should you analyse RCTs irrespective of if people receive differently from their group allocation? What does this prevent?

A

Intention to treat analysis preserves randomisation and therefore reduces allocation bias.
This could underestimate an effect

32
Q

What is per protocol analysis?

A

Estimating effect of adhering to interventions, only include those to adhered to randomisation assignment. This should be exploratory not main analysis!!

33
Q

What is detection bias and how can it be prevented?

A

A systematic difference between groups in how outcomes are determined. This can be reduced by triple blinding.

34
Q

When do losses to follow-up affect results?

A

If losses are related to treatment allocation and outcome

Those who drop out are systematically different

35
Q

What will high losses to follow up lead to?

A

Incomplete outcome data affecting generalisability, and whether or not believe results

36
Q

Which type of bias relates to losses to follow-up?

A

Attrition bias: systematic difference between groups in withdrawals from study

37
Q

How can attrition bias be prevented?

A

Big number of participants, analyse attrition rates and compare characteristics of those lost to follow-up

38
Q

How can attrition bias be related to outcome?

A

Sicker people more likely to drop outn

39
Q

How can attrition bias be related to allocation?

A

Not liking intervention, disappointment in allocation to control group

40
Q

What are ways to interpret outcomes of RCTs?

A

Mean difference
Relative risk
Odds ratio
Survival analysis (time until event)

41
Q

Do larger or smaller sample sizes have greater precision?

42
Q

What are sample size calculations based on?

A
  1. Expected effect size (smaller need larger samples)
  2. Variation in measured outcome - imprecise measurements need larger
  3. Significance level
  4. Power - how certain do we want to be to find a difference if their is one - usually 80% or 90%
43
Q

How would you analyse RCT results?

A
  1. Work out absolute risk in treatment and controls
  2. Relative risk in treatment vs controls (<1 is likelihood of outcome less in treatment)
  3. Calculate absolute risk difference (difference of …% risk of dying in treatment vs controls)
  4. NNT
44
Q

Which risk statistic do you use to calculate NNT?

A

Absolute risk difference

45
Q

What determines whether RCT results can be applied locally?

A

Population of trial compared to usual practice, usual care compared to control, cost
Randomise studies across countries

46
Q

What must be included in analysis for full ITT and how is this done?

A

Participants who did not receive assigned intervention according to protocol & those lost to follow-up.
Use imputed values

47
Q

What is the strength of ITT analysis?

A

Preserves effect of random allocation, and thus equal distribution of confounders is maintained. It also mirrors real-world situations.

48
Q

What control can be used for non-drug interventions?

A

Sham interventions

49
Q

If a baseline characteristics table shows no significant differences between groups can you assume no selection bias?

A

No:

  • table must include all pts recruited to trial
  • consort statement says do not depend on statistical significance
  • if smaller sample would have to have huge difference for it to be significant
50
Q

Who’s point of view should be considered for outcomes of an RCT?

A
  1. Individual
  2. Policy makers and professionals
  3. Family/carers
  4. Wider community
51
Q

What 3 questions should you ask to appraise loss to follow up?

A
  1. Was it high (>30%), low (<5%) or somewhere in between?
  2. Was it even across groups?
  3. Were reasons given? Are they reasons that occur ‘at random’?