Lecture 4 - Analytical Study Design Part 2 - RCT and NRCT Flashcards

1
Q

Randomized control studies

A

“Randomized” Allocation/Assignment

The main purpose of randomization is to prevent any potential biases on the part of the investigators from the influencing the assignment of participants into different treatment groups.

May be done by assigning random numbers or by a program that generates random assignments

Each subject has an equal chance of being assigned to each group (control or intervention)

Randomization strives for comparability of the different treatment groups; however, its not guaranteed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Randomized control studies

The main purpose of randomization is to….

A

prevent any potential biases on the part of the investigators

(from the influencing the assignment of participants into different treatment groups.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Randomized control studies

May be done by….

A

assigning random numbers or by a program that generates random assignments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Randomized control studies

Each subject has an equal chance of….

A

being assigned to each group (control or intervention)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Randomization _______ of the different treatment groups; however, its _____.

A

strives for comparability

not guaranteed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Randomized control studies

“Controlled” implies predefined:

A

Specified hypotheses

Primary and secondary endpoints to address hypotheses

Methods for enrollment and follow up

Eligibility/Exclusionary criteria

Rigorous monitoring

Analysis plans and stopping rules

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Randomized control studies

Why Controlled?

A

Seek to eliminate confounding variables

Attempt to minimize bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

LOOK AT FIGURE 7-1 ON SLIDE 9

A

UNDERSTAND THIS FLOW

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Enrollment in Randomized control studies

Criteria for determining selection must be…

Want to ensure that participants….

Carefully select sample based on a reference population.

A

… specified before the study is begun

…actually have the disease of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Allocation in Randomized control studies

Randomization is the best approach in the design of a trial, and the critical element of randomization is….

A

….the unpredictability of the next assignment.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

the best approach in the design of a trial?

A

randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Allocation in Randomized control studies

If conducted properly we don’t have to worry that…

A

…any subjective biases of the investigator, either overt or covert, may be in introduced into the process of selecting patients.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

How is randomization accomplished:

A

Computer programs

Envelope System – The treatment assignment that is designated by a random number is written on a card, and this card is placed inside an envelope. Each envelope is labeled on the outside: Patient 1, Patient 2, Patient 3…..etc. When the first patient is enrolled and consented the investigator opens the envelope and the treatment assignment is determined.

Only open the enveloped after a subject is consented and meets eligibility criteria!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

We hope that randomization achieves comparability of characteristics between the treatment groups; however….

A

this not guaranteed!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Envelope System:

Only open the enveloped after a subject is….

A

consented and meets eligibility criteria!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

– utilized when we are concerned about the comparability of the groups in terms of one or a few important characteristics.

A

Stratified Randomization

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Stratified Randomization:

This is conducted by stratifying our study population by each variable that we consider important, and then…

A

randomize participants to treatment groups within each stratum.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Treatment (Assigned vs Received)

Important to know if the patient was assigned to receive treatment A, but did not comply.

Why?

Conversely, it is also clearly important to know whether a patient who was not assigned to receive treatment A may have…

A

A subject may agree to be randomized, but may later change his or her mind and refuse to comply.

…taken treatment A on his or her own, often without realizing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

OUTCOME OF RANDOMIZED CONTROL STUDY:

Comparable measurements in all study groups in particularly true for measures of the outcome. So you can measure?

A

Improvement

Side Effects or Adverse Reaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

OUTCOME OF RANDOMIZED CONTROL STUDY:

Explicitly stated criteria for all outcomes to be measured in a study

Potential pitfall of outcomes being measured more carefully in those….

how do we avoid this problem?

A

…receiving a new drug than in those receiving currently available therapy must be avoided.

Blinding can prevent much of this problem; however, blinding is not always possible.
(Behavioral Interventions if not possible)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Randomized control studies

Blinding:

The ______ from one or more individuals involved in a clinical research study.

A

concealment of group allocation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Randomized control studies

Blinding:

Usually is used in research studies that compare….

Used to make sure that knowing the type of treatment does not affect: (three things)

A

…two or more types of interventions.

1) A participant’s response to the treatment
2) A health care provider’s behavior
3) The assessment of the treatment effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

After being observed for a certain period of time on one therapy; any changes are measured; patients are switched to the other therapy.

A

Planned Crossover

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Occurs when subjects who are randomized cross-over to the other group.

If we analyze according to treatment that the patient actually receive, we will have broken and therefore lost the benefits of randomization.

A

Unplanned crossover

25
Q

Each patient can serve as his or her own control, holding constant the variation between individuals in many characteristics that could potentially affect a comparison of effectiveness of two agents.

Must have a washout period!

A

Planned Crossover

26
Q

what must have a washout period?

A

planned crossover in the randomized control study

27
Q

Unplanned Crossover:

Current practice to perform the analysis by ________-according to the original randomized assignment.

If bias occurs typically biases towards the null; typically provides a more conservative estimate

A

intention to treat

28
Q

intention to treat in an unplanned crossover, typically biases that occur provide…

A

a more conservative estimate

29
Q

Randomized control studies

What are the blinding types?

A

Single Blinding
Double Binding
Triple Binding

30
Q

Blinding types

_______: Allocation is concealed from only one group (researchers or subjects)

_______: Allocation is concealed from both groups (researchers and subjects)

_______: Allocation is unknown to the subjects, the individuals who administer the treatment or intervention, and the individuals who assess the outcomes.

A

Single blinding

Double blinding

Triple blinding

31
Q

researcher OR subjects are blinded

A

single blinding

32
Q

researcher AND subjects are blinded

A

double blinding

33
Q

researcher AND subjects are blinded PLUS….

Individuals who assess outcomes are blinded

A

triple blinding

34
Q

What is noncompliance?

A

Subjects may agree to be randomized, but following randomization they may not comply with the assignment treatment.

May be Overt or Covert!

35
Q

The Net Effect of non-compliance on the study results will be to reduce any ________, because the treatment group will include some who did not receive the therapy, and the no-treatment group may include some who received the treatment.

A

observed differences

36
Q

what is the gold-standard of a trial?

A

Double-blinded Randomized Control Trial

37
Q

Double-blinded Randomized Control Trial is known as the….

A

gold-standard

38
Q

Double-blinded Randomized Control Trial AKA the gold-standard, minimizes….

A

the chance for bias if randomization and blinding are done CORRECTLY

39
Q

What are the limitations of Randomized control studies

A

Large trials (may affect statistical power)

Long term follow-up (possible losses)

Compliance

Expensive

Possible ethical questions (Primum Non Nocere / ‘First Do No Harm’)

40
Q

– Attempted to learn if the drug, surgical procedure, or administrative program works under ideal circumstance.

A

Efficacy Trial

41
Q

– Within the confines of the study, results appear to be accurate and the interpretation of the investigators I supported.

A

Internal Validity

42
Q

– Ability to apply results obtained from a study population to a broader population. Also called generalizability.

A

External Validity

43
Q

Efficacy Trial

A

– Attempted to learn if the drug, surgical procedure, or administrative program works under ideal circumstance.

44
Q

Internal Validity

A

– Within the confines of the study, results – appear to be accurate and the interpretation of the investigators I supported.

45
Q

External Validity

A

– Ability to apply results obtained from a study population to a broader population. Also called generalizability.

46
Q

Look at slide 22…. this will let you know external validity vs internal validity

A

YUP

47
Q

Non-randomized control studies

How are these different from RCTs?

1) Also called…
2) what’s predetermined?

A

1) Also called quasi-experiments

2) In non-randomized controlled trials, the control group is predetermined (without random assignment) and compared to a control group
- –Volunteer to join the study OR

—Are geographically close to the study site OR

—Conveniently turn up (at a clinic, school) while the study is being conducted

—Like the studies recruiting with fliers posted in the restroom

48
Q

There are several reason why a non-randomized control study may be conducted.

A

RCT are often logistically complex and very expensive

Sometime it’s not feasible to randomize all evaluation

Ethical problems may be perceived to occur in health services evaluation studies

By the time RTCs are completed and data analyzed results may not be relevant anymore

49
Q
Before-After Design (Historical Design)
---Pre/Post program evaluation
------Data may not be comparable. 
------Making casual inferences is very difficult
Simultaneous Nonrandomized Design
---Cohort-like design
---Difficulty to determine exposure/unexposed groups
---Difficult to make inferences

Comparison of Utilizers and Non-Utilizers

Comparison of Eligible and Non-Eligible Populations

A

Non-randomized control studies

50
Q

Non-randomized control studies

A

Before-After Design (Historical Design)

Simultaneous Nonrandomized Design

Comparison of Utilizers and Non-Utilizers

Comparison of Eligible and Non-Eligible Populations

51
Q

Non-randomized control studies:

Limitations

Study group characteristics may not be balanced at baseline… if this occurs it could?

A

Baseline differences between groups may confound the study’s results

52
Q

Non-randomized control studies:

Attempting to correct for baseline differences

-Among the strategies commonly used to ensure equivalence is a technique called ____

—–Matching requires selecting pairs of participants or clusters of individuals who are _______

—–Example: A researcher interested in comparing visual acuity among smokers and non smokers tries to balance the two groups by selecting pairs of smokers and non smokers who are same….

A

matching

comparable to one another on important variables

age, sex, and medical history

53
Q

Typical confounding variables include…

A

age, educational level, motivation, severity of illness, socio-economic status, income, comorbidities

54
Q

Randomized and Non-randomized control studies

Four major areas of methodological concern:

A

Enrollment – How was the study population chosen?

Allocation – How were the subjects assigned to their study group?

Follow Up – How long are patients followed for?

Analysis – How was the data collected analyzed?

55
Q

Randomized and Non-randomized control studies:

Enrollment - Understanding the study what would you want to know?

A

What were the inclusion and exclusion criteria?

Is the actual study population representative of the population to which the results will be applied?

Are controls similar to case subjects?

56
Q

Randomized and Non-randomized control studies:

Allocation - Understanding the study what would you want to know?

A

Was randomization and blinding conducted?

How was it done?

Was it done correctly?

Nonrandom sampling (consecutive or convenience) may not be generalizable and has strong potential for bias

57
Q

Randomized and Non-randomized control studies:

Follow Up - Understanding the study what would you want to know?

A

Adherence

How well did the study subjects adhere to the treatment protocol?

Was the intervention too difficult to continue to participate?

Attrition

How many subjects were lost to follow-up?

Why were they lost? Did they quit or die?

58
Q

Adherence are measured from the ____ of the Randomized and Non-randomized control studies

A

Follow up

59
Q

Randomized and Non-randomized control studies:

Analysis - What would you want to know about the anaylsis to evaluate the study?

A
  • Are the effects of the intervention clearly defined?
  • Is there a clearly defined end point?
  • Did they provide an “intent to treat” analysis?

—–Compares subject outcomes based on their original group assignment even if they dropped out or were non-compliant

—–Primary reason is to preserve randomization

-To what did they compare their data?