Exam 1 Flashcards

1
Q

What is a placebo? What is it not?

A

Something that is inert (inactive, not therapeutic) but use it because of that placebo effect (the thought in the mind that it is doing something)

  • It is not “nothing”
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What two individual are accredited for the development of evidence-based medicine?

A

Dr. James Lind

Dr. David Sackett

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe the relationship between Dr. James Lind and EBM

A
  • accredited for discovering scurvy
  • took 12 sailors, paired them, one got nothing and the other got oranges/lemons
  • ompared both groups
  • early version of a study
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe the relationship between Dr David Sackett and EBM

A
  • Father of EBM
  • Established core principles of EBM in a landmark article in 1996
  • Established 3 core principles:
    a) Research
    b) Clinical Expertise
    c) Patient
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define EBM.

A

Evidence-based medicine (EBM) is the integration of best research evidence with clinical expertise and patient values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

In EBM, what is a critical factor to evaluate effectiveness?

A
  • Must be applied to the patient
  • Although it may say in the guidelines, need to consider if it is useful for the patient
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why do we need EBM?

A

New therapies
New indications
New formulations
New “experts”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the five steps of EBM?

A

Ask: Develop your question
Acquire: Find the (best) solution
Appraise: critically evaluate the evidence for validity and usefulness
Apply: Use results in your practice
Assess: Evaluate your performance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

In Step 1 (ASK): one should develop the __________

A

Research Question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

A research question should be based on:

A

Population/Patient (Among….)
Intervention/Exposure (does…..)
Comparison (versus….)
Outcome (effect)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

In step 2 (Acquire), one should ….. Examples?

A

Get the evidence - literature search

Medline, pubmed, cocharnae database, socialmedia, google scholar

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

In regards to a question about therapy, the ideal study type is:

A

RCT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

In regards to a rsearch question about prevention, what is the ideal type of study?

A

RCT > Cohort Study > Case Control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

In regards to a diagnosis question, what is the ideal type of study?

A

Prospective, blind controlled trial comparison to gold standard

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

In regards to prognosis, what is the ideal study design?

A

Cohort Study > Case Control > Case scenario/case report

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

For a research question on etiology/harm, what is the ideal study design?

A

RCT > Cohort Study > Case Control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

For a cost analysis research question, the ideal study type is…..

A

Economic analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What often provides the best answers for clinical questions?

A

Meta-analyses and systematic reviews, when available, often provide the best answers to clinical questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is the benefit of a meta-analysis?

A

Meta-analyses and systematic review, when avilable, often provide the best answers to clinical questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Describe the different types of research study designs

A

Study the graph

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Describe the hierarchy of study design.

A

Study the pyramid

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Define descriptive study. What is it simply?

A

One that is designed to describe the distribution of one or more variables, without regard to any causation or other hypothesis. (Just a snap shot in time)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define analytic study.

A

Analytic studies test hypotheses about exposure- outcome relationships and measures the association between exposure and outcome throughout time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

How should one be able to distinguish and RCT?

A

Should be able to pick out RCT’s as should mention “randomization” in the methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

In step 3 (appraise), one should….

A

Critically Appraise: The process of carefully and systematically examining research to judge its validity, results and relevance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Why is critical appraisal important?

A

Study results are not always:

Valid (actually due to the intervention/exposure)

Safe (invalid results can be harmful/wasteful)

Useful (meaningful or applicable to your patient)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Define internal validity

A

The degree of confidence that the causal relationship you are testing is not influenced by other factors or variables

Are the results due to the intervention (or exposure) we are studying… or something else?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What are the 3 major threats to internal validity?

A

Chance
Confounding
Bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Define external validity . What does it depend on?

A

Are the results applicable (generalizable) to other populations (patients), settings and time?

Typically depends on study population (inclusion and exclusion criteria) and setting

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

Give an example of internal and external validity

A

Internal: Those who took Vitamin D scored 10% higher, is this due to the Vitamin D or something else

External: Depends on the exclusion and inclusion principles –> Can you apply those results of the Pharm.D. students to engineering students.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is chance?

A

Random error

Inherent in all measurements (we are only taking a sample of all the possible observations)

The more there is, the less precise the results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What is an example of chance? Can you fully eliminate chance?

A

In the Vitamin D group, exam results were higher. Can I take those results and apply them to every pharmacy student in Canada –> NO

If we measured all pharmacy students in Canada, results are more precise; however, never fully able to eliminate chance.

The more measurements we take the more precise and closer to the actual results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What is bias?

A

Any systematic (not due to chance) error in a study that results in an incorrect estimate of the association between the intervention or exposure and the outcome

…or…

Problems with the way a study was designed, conducted, or classified that leads to incorrect results or conclusions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What is confounding? What msut it be related to? Provide an example?

A
  • A confusion of effects
  • When some factor(s), other than the intervention or exposure under study, influences the observed outcome
  • The factor must be linked to the exposure and the outcome
  • Coffee causes heart attacks; however, coffee drinkers are more likely to be smokers. Therefore, may not be coffee at all.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

External validity is related to…… What is an issue associated with external validity?

A

Related to the inclusion/exclusion criteria

Studies (especially RCTs) are very specific about who is and isn’t allowed in the study

Often becomes an issue with drug studies:
Who should use the drug?
Who the drug is approved for?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is chance? Is it beneficial or detrimental to studies? How is chance calculated?

A

Random error – inherent in all measurement

Less random error = good
More random error = not good

Estimated and reported using statistics:

P-value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What does the P-value represent?

A

Probability representing the strength of evidence to support the null hypothesis

P value represents the probability the results are due to chance rather than a real treatment effect (want a low p-value)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What is the null hypothesis in studies? What is the alternative hypothesis?

A

Null Hypothesis: Set at showing no difference between the groups

Alternative Hypothesis: There is a difference between the groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

Describe the relationship between P-value, null hypothesis, alternative hypothesis?

A

Large P value (>0.05) = supports null hypothesis
There is no “statistically significant” difference between the groups’ results

Small P-value (<0.05) = reject the null hypothesis
There is a “statistically significant” difference between the groups’ results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

How can one deal witch chance within a study?

A

Increase the sample size (not always possible)

Recognize the extent (through statistics) and interpret the results accordingly

Recognize that Statistical significance ≠ clinical significance (do not go hand and hand)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

Is there a relationship between statistical significance and clinical significance? Example?

A

Statistical significance ≠ clinical significance (do not go hand and hand)

If a study concluded a 10 day difference in survival, this could be statistically signifiant but is not clincially significant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What are some examples of confounders?

A
  • Smoking
  • Age
  • Exercise Level/week
  • Blood pressure
  • Diet
    -Sex

Some may be hard to measure: stress, socioeconomic status, genetics

Can someone get some extra addictive dumauriers to smoke saturday

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

How can one deal with confounding?

A

1) Randomization (Gold Standard)
- Ensures groups are similar in all aspects (known and unknown factors equally distributed)

2) Stratification
- Stratify by a certain factor

3) Matching
- Observational studies (match by age and sex)

4) Statistical Models (multivariable models)
- “Controlled for” or “adjusted for” –> Attempts to adjust for confounding (only variable known and can measure)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

How can one indicate confounding? What should we do?

A

TABLE 1: BASELINE CHARACTERISTICS

  • use clinical judgement to determine if there is a difference between the groups

Importance of Table 1 (population characteristics):

1) Indicate confounding

2) Provides insight on external validity (gives insight on people studied and whether can apply to patients)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

What is bias? What usually causes it?

A

Problems with the way a study was designed, conducted, or classified that leads to incorrect results or conclusions

Usually because the groups were treated differently somehow

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

What are the two main types of bias? Where do they come from?

A

1) Selection Bias
- Problems with how the study subjects were selected
- Want everyone to be selected from the same patient population

2) Information Bias
- Problems with measuring, collecting or analyzing information (exposure and/or outcomes)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

Define selection bias? What does it effect? Types of selection bias?

A

Systematic error (or differences) in how the study subjects were selected or who participated

Primarily affects external validity

Self Selection/volunteer bias

Healthy Worker (adherer) Bias

Attrition Bias (lost to follow up)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

What is self-selection/volunteer bias? What bias is it?

A
  • People who volunteer/participate in studies are different from those who don’t
  • Selection Bias
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

What is healthy worker (adherer) bias?

A

Employed (higher SES-socioeconomic status) individuals are usually healthier

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
50
Q

What is attrition bias (lost to follow-up)? What is the main problem and when it is an issue? Why is this detrimental to a study?

A
  • People who leave study e.g. a/e, found process to rigorous, drop out of pharmacy, death
  • Main problem is when they drop out of one group (5 and 5 would be less concerned than 10 for 1 group)
  • Becomes an issue if there are differences between those who were lost and those who weren’t

a) Lose important data (why did they drop out/withdraw?)
b) If a whole ton drop out of one arm, lose benefit of randomization (not equal anymore)
c) Chance becomes more of an issue

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
51
Q

Define information bias.

A

Systematic errors in the way subjects were measured or classified

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
52
Q

What are the types of errors that lead to information bias? Examples?

A

Outcome errors (RCT and observational studies)
-Problems with measuring tools (one electronic bp monitor, one group manual)
-Problems with actual measurements

Exposure errors (more so with observational studies)
- Problems with how subjects are categorized (non- vit. D group taking a multivitamin)
- Problems with measuring tools

Subject or observer variation (interpretation of pain) – everyone different and unique

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
53
Q

When is information bias a concern?

A

Primarily a concern when the likelihood of being misclassified is unequal between groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
54
Q

What are some examples of information bias?

A

Recall Bias

Interviewer Bias (Minimized by standardized forms, questions)

Surveillance/detection bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
55
Q

Define recall bias

A

Individuals remember things differently

Subjects with the outcome (especially if negative) are more likely to remember their exposure – e.g. woman born with a baby birth defect (I did take that bp med one time, where as someone with a healthy baby would not)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
56
Q

Define interviewer bias? How can it be minimized?

A

Interviewer asks about exposure/outcome differently

Leading, probing or influencing questions

Multiple interviewers

Minimized by standardized forms, questions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
57
Q

Define surveillance/detection bias.

A

One study group followed more closely than the other
“If you look…you will find”
More outcomes identified because more follow-up, not necessarily because it occurred more in that group

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
58
Q

What is a goal of studies in regards to bias?

A

Goal is to minimize bias when designing the study
Will never completely eliminate

Recognize and acknowledge it

Study the Graph on Slide 16

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
59
Q

What are some strategies for reducing bias?

A

Clear definition of study and sample population

Ensure all groups are treated the same except for the intervention

Standardized measurements
- Same questionnaire for all subjects
- Same interviewers
- Automated devices
- Centralized labs (all analysis in same labs)

Collect the same information from all subjects in the same way

Blinding (pt or researcher or both are unaware of what group a t is)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
60
Q

What is publication bias? What does it effect? Example?

A

Authors and journals tend to publish positive findings, especially with drug trials

May lead readers to think there is a consistent association when it’s not really the case

Not effecting internal validity

E.g. Trial A finds that a new drug is effective (publish), Trial B shows significant adverse effects (not publish) potentially giving a misleadingly favorable impression of the new drug’s effectiveness and safety

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
61
Q

What is a randomized controlled trial?

A

Test whether an intervention works by comparing it to a control condition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
62
Q

How are subjects divided in an RCT?

A

Subjects assigned to a study group:

Intervention group
…or…
Control group (no intervention, alternate intervention)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
63
Q

In an RCT, what does it mean to be randomized? What groups are randomized?

A

Randomized = subjects assigned to study groups randomly

Have an equal probability of being assigned to any group

Can be more than 2 groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
64
Q

Randomization is critical for…..

A

Minimize confounding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
65
Q

Can randomization occur in an observational study?

A
  • No. Cannot occur in an observational study.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
66
Q

What are the different types of RCT types?

A

Parallel

Cluster Randomized

Cross-over

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
67
Q

Describe a parallel RCT study design?

A

A study sample is selected from a population. From the study sample, subjects are further divided into an intervention or control/comparison group. These groups are followed over time and monitored for the outcome.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
68
Q

Describe a clustered-randomized RCT study design?

A

Clusters of individuals are randomized instead of individuals (e.g. cities, classes, pharmacies, hospitals)

A cluster randomized trial (CRT) is a randomized controlled trial in which pre-existing groups, called clusters, of individuals are randomly allocated to treatment arms.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
69
Q

When is a cluster-randomized trial used?

A
  • Most commonly used when studying an approach to patient care
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
70
Q

Describe a cross-over RCT?

A

A study sample is selected from a population. From the study sample, subjects are further divided into an intervention or control/comparison group. These groups are followed over time and monitored for the outcome.

There is then a washout period in both study arms. After the washout period then the groups are flipped.

Intervention Group –> Control group
Control Group –> Intervention Group

We then follow the groups over time and monitor the outcome.

The outcomes are then compared. One is acting as their own control.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
71
Q

What is a beneficial characteristic of a cross-over RCT? What is the limitation?

A
  • The individuals act as their own control and therefore confounding is effectively minimized
  • This type of study does not require as many subjects
  • It is a more complicated study to run and the wash out period can be lengthy
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
72
Q

In regards to selecting an RCT design, what is a critical rule to follow? Why is this rule critical?

A

The study must be designed before it has begun

  • This limits bias and maintains integrity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
73
Q

How is the research question established for an RCT?

A

Population – who’s going to be included?
Intervention – what are we testing?
Comparison – what are we comparing it to?
Outcome – what outcome are we looking for?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
74
Q

When selecting a population for an RCT, what needs to be established?

A

1) Start with a defined population
- Who we want to study
- Where do we get them from (all subjects should be from the same population)
- e.g. Hospitals, clinics, advertisements

2) Specific inclusion and exclusion criteria
- Much more strict in RCT
- Can limit generalizability

3) Sample Size (n)

75
Q

What is the disadvantage of having specific inclusion and exclusion criteria?

A

Can limit generalizability

76
Q

Define sample size (n). How is the sample size (n) determined?

A

Sample Size: how many subjects are required
- This is determined by the study power

Study power = ability to show a difference between groups if a difference really exists

n too low = underpowered
n too high = unnecessary exposure, more resources

Optimal number is determined statistically (studies recruit around this power number)

Must be determined BEFORE the study starts

77
Q

Define study power

A

ability to show a difference between groups if a difference really exists

78
Q

An increase in a study size will diminish…..

A

CHANCE

79
Q

In an RCT, what is the intervention?

A

The exposure of the experimental group. Must be specific.

If it is a Drug must include:
Dose
Regimen
Delivery method/Formulation
Follow-ups
Length of intervention

If it is a Procedure (e.g., pharmacist counseling): must include

What’s involved
Timing
Follow-up
Length of intervention

80
Q

In an RCT, what is the comparison (control group)? What can it be? What should we consider?

A
  • What we are using to compare our intervention to

Nothing (placebo/usual care)
A different dose
A different drug/procedure
Standard treatment

  • We need to consider how many controls will be used
81
Q

In regards to the controlof an RCT, what is critical to ensure?

A

Controls must be treated exactly the same way as the intervention group – the only difference is the intervention

82
Q

In an RCT, how is the outcome of a research question divided?

A
  • Could be anything but must be clearly stated and logical
  • May be objective or subjective outcomes
  • Established hard or surrogate endpoints
  • Established primary endpoint or composite endpoint and may have potential secondary endpoints
83
Q

In an RCT, the outcome may be _________ or _________. Define.

A

Objective
Measurable (e.g., blood pressure, lipid levels)

Subjective
Subject’s interpretation (e.g., back pain)

84
Q

In an RCT, endpoints may be _______ or _______. Define.

A

Hard endpoints - Often used as big clinical outcomes
E.g., Death, stroke, MI

Surrogate endpoints - Used as a proxy or estimate of the hard endpoints
E.g., Blood pressure (…which can lead to stroke)

85
Q

In an RCT, what is a primary endpoint

A

Main result that is measured at the end of the study to see the effect of the intervention

86
Q

In an RCT, what is a secondary endpoint? Disadvantages and Advantages?

A

Additional results of interest, but not the main focus

Caution when interpreting as the study wasn’t designed around them (statistical issues)

NEVER make a decision based solely on a secondary endpoint

Allows for the formation of a hypothesis for future studies

87
Q

What is a composite endpoint? What is a classic example? What is the advantage? What is the disadvantage?

A

A primary endpoint that contains several events

E.g., MACE – Major Adverse Cardiovascular Events Instead of just looking at death as a primary outcome, you include MI, stroke and death together

Benefit = less subjects needed

Disadvantage = hard to determine the true effect of the intervention on each of the event types
- Must Look at specific results for breakdown

88
Q

Randomization helps to reduce…..

A

Confounding

89
Q

What makes RCT’s the gold standard for study designs?

A

Randomization

90
Q

What is the goal of randomization?

A

We want the groups to be as similar as possible, except for the intervention

Randomization (if done correctly) will ensure that the groups are similar in ALL aspects

Similar in things we can measure (E.g., age, sex, blood pressure)

Similar in things that are unknown (E.g., genetics)

91
Q

How may randomization be conducted? What is inappropriate randomization? What is a rule of the randomization PROCESS?

A

Coin toss, table of random numbers, computer generated, etc.

NOT by days of the week, alternating subjects, etc.

Must have an equal chance of being in either group
and should not be able to tell which group will be assigned next

92
Q

What are the main methods of randomization?

A

Complete
Block
Stratified

93
Q

What is complete randomization?

A

No limitations – straight up randomization
Won’t necessarily get equal numbers in each group

94
Q

What is block randomization?

A

Used to force balance in the number of subjects in each group

E.g., block of 6 = for every 6 subjects randomized: 3 in intervention group, 3 in control group

95
Q

Is a researcher involved with randomization?

A

NO

Researcher is not involved with randomization; someone outside the study to minimize bias

96
Q

What is stratified randomization used to achieve? What are some examples?

A

Used to achieve similarities in certain baseline characteristics

E.g., stratify by age = everyone under 65 is randomized and everyone over 65 is randomized
E.g., stratify by clinic = randomization is done at
each individual site

97
Q

Where does randomization occur?

A

Usually randomization is centralized and offsite

98
Q

What is allocation concealment?

A

Hides the sorting of trial participants into treatment groups so that this knowledge cannot be exploited

Refers to not disclosing the allocation (or randomization) scheme to researchers or participants.

Critical to the randomization process of an RCT

99
Q

In an RCT, is allocation concealment the same as blinding?

A

NO

Allocation concealment differs from blinding in that blinding is not disclosing the treatment allocation AFTER randomization has occurred.

100
Q

Give an example of allocation bias?

A

Blue Pill vs Red Pill in preventing death

  • If the researcher knew the randomization scheme, they may wait to randomize a particular individual into the intervention arm as they know they have a higher chance of death
  • Meredith Grey
101
Q

What is the benefit of allocation concealment?

A
  • helps to reduce selection bias and allocation bias

Allocation Bias: you can figure out the randomization scheme, so put patients into a specific group to get a certain treatment

102
Q

Define intention to treat (ITT). How can one tell if this was done?

A

Analyzing the data for ALL patients and according to the group they were originally randomized to

“Lost to follow-up”: Drop-outs, switch groups, deaths, etc.
- Need to include these people in our analysis. Baseline and results should match.

103
Q

Define “per protocol”

A

Analyzing data only from subjects who completed the study or followed protocol exactly

104
Q

What is the benefit of ITT?

A

ITT preserves the value of randomization (might be differences b/w those lost and those remaining)

Lots of important data in those lost to follow-up (adverse events)

105
Q

What is blinding?

A

Unaware of what study group a subject is in

106
Q

If one was to know an individual’s group assignment, it could cause:

A

Subjects may report outcomes or adverse effects differently or behave differently

Physicians/investigators may report outcomes or events differently or treat subjects differently

Researchers may collect data, classify outcomes or events and interpret subject response differently

Affects the internal validity of the study - BIAS

107
Q

A lack of blinding effects what:

A

Internal Validity - BIAS

108
Q

What types of RCT’s blinding is there? What is the most common?

A

Unblinded (open-label) –> Sujects, researchrs and evaluators are not blinded

Single blinded –> One group blinded (often the evaluators)

Double Blinded –> STANDARD Often subjecys and researchers blinded (may see evaluators blinded)

Triple Blinded –> All 3 groups blinded

109
Q

When does blindning become less critical?

A

The more objetcive the outcome is, the less critical blinding becomes (e.g. stroke vs pain severity)

110
Q

What does blinding reduce?

A
  • Blinding reduces bias
111
Q

What is the placebo effect? How does this occur?

A

Placebo – Latin “shall please”

Perceived or actual effect from an ineffectual or inactive treatment

Conscious belief about drug/treatment

Subconscious association between being “treated” and recovery

Can be positive (benefits) or negative (adverse event)

Sugar pill, saline, sham procedure

Effect of cost, “severity” of treatment…

112
Q

Define observational study?

A

Observe the effect of an exposure (or intervention) on an outcome without “interfering” with anything
Exposures: risk factor, drug, environmental, procedure, etc.

113
Q

What does an observational study set out to achieve?WHy is that?

A

Looks for associations (not causation)

Can not prove cause and effect

To prove cause and effect, need strong internal validity –> Does not have the randomization piece

Randomization minimizes confounding (primarily, as randomizes people into groups which allows us to distribute factors that are known and unknown)

114
Q

What are the benefits of an observational study?

A

Often more:
Practical / Feasible
Ethical
Real-world
–>Wider inclusion criteria (more generalizable)
–> Real-life situations (comorbidities, drugs, etc.)

115
Q

Why may one use a observational study over an RCT?

A

Because clinical trials evaluate such a small percentage of people who will eventually use a studied drug and are of relatively short duration, it is possible that unexpected or rare drug effects will not be detected during the investigative process

116
Q

What type of study’s help guide clinical decisions?

A

RCT’s

  • Cannot use observation studies to guide lcinical practice
117
Q

Obersavational study thrests? Internal validity?

A

Is the association real…or due to something else?

Is there internal validity?

3 major threats
Chance
Confounding
Bias

118
Q

What are the types of observational studies?

A

(Case reports / Case series)
Cross-sectional
Case-control
Cohort

119
Q

Define case report? What encompasses a case study?

A

Describes and interprets an individual case

Usually written as a narrative (e.g. story)
No predefined methods
No predefined outcomes

Patient described in detail

Observations described in detail
Exposure and outcome(s)

120
Q

What does a case study usually depict?

A

Unexpected events and adverse effects
Important variations of known diseases
Weird observations that can’t be explained by known disease

121
Q

What are the advantages of a case study?

A

Useful in identifying new or unusual trends or diseases

Useful in identifying new drug effects (good or bad)

Describe novel interventions:
–> Treatment
–> Diagnostic procedure

Suggest areas for further research (or “alarm”)

122
Q

What are some disadvantages of case studies?

A

Difficult to interpret
–> Spontaneous appearance and disappearance of signs/symptoms
–> Placebo effect
–> Other influences

Can’t confirm or prove anything

123
Q

What is a case series? What is its effect?

A

Collection of individual reports which typically occur within a fairly short period of time

Can be hypothesis forming…or world altering

124
Q

What is a cross sectional study?

A

Looks at population or study sample at one point in time

Snapshot of what is happening at that time

125
Q

What does a cross sectional study collect information on?

A

Exposure
Outcome
Health status
Health behaviours

126
Q

How can one collect information in a cross-sectional study?

A

Surveys / Questionnaires
Phone, mail, online
Chart reviews
Administrative data (governments, insurance agencies)

127
Q

What is an advantage (s) of cross sectional studies? What is a disadvantage?

A

Useful for describing prevalence
Proportion of a population or sample that has a condition (disease, risk factor)
E.g., The prevalence of MS in SK is 314/100,000

Can’t determine the incidence
Number of new cases (people) with a condition over a specific time
E.g., The annual incidence of MS in SK is 16.5/100,000

Can be analytical (looking for associations)
–> Factors that might be associated with one another
–> Can’t determine if an exposure causes the outcome though

128
Q

What is are the advantages of cross sectional studies?

A

Good for determining prevalence

Useful for quick examination of potential associations
Hypothesis generating…future research

Inexpensive

129
Q

What are disadvantages of cross-sectional studies?

A

Limited to what we know about the potential associations

–> Did the exposure precede the outcome?

–> Other contributing factors?
–> Transient effects

130
Q

What is a case control study?

A

Retrospective (looking back in time)

Compares 2 groups:

Cases = people with the outcome
Controls = people without the outcome

Compare the proportion of cases with the exposure to the proportion of controls with the exposure

131
Q

Important consideration in case-control selection?Why is this important?

A

Try to have the cases and controls as similar as possible except for the outcome (minimize confounding)

132
Q

Describe the process of case-control study?

A

Have cases and controls in present

Look back in time. Analyze to see whether the subjects in both arms had an exposure (e.g. drug)

Compare the rates

133
Q

What are the guidelines for selecting cases in a case-control study?

A
  1. Need to be very specific about the outcome
    –> Want a “validated” outcome
    –> It really is the outcome we think it is (e.g., actually had angina and not just chest pain)
    –> Use standardized, accurate measurement/tools, criteria, definitions, etc.

Ideally incident (new) cases over prevalent cases

134
Q

What is the difference between prevalent and incident cases?

A

–> Prevalent cases – don’t know when the outcome occurred, and if the exposure preceded it (has came after the outcome has occured)

–> Incident cases – we know when the outcome occurred and can be sure the exposure preceded it

135
Q

How should one select the controls for a case-control study?Why?

A

Want the exposed and unexposed groups to be as similar as possible (except for outcome)
–> Should come from same population as cases (e.g. not having control from Toronto, and case from Saskatoon)

Often use multiple controls for each case
–> Increase sample size….decrease random error
–> Increases the power of the study (but no benefit after more than 4 controls per case)

136
Q

What is the average number of controls to cases for a case-control study?

A

4:1 = 4 controls for every case

137
Q

How can we make sure the cases in case-control are similar to the controls?

A

Often use matching to help ensure groups are similar

Helps decrease confounding (known confounders)

Can only match on factors we know (or can measure)
Sex, age, location, baseline cholesterol levels, etc…

138
Q

What are the advantages of a case-control study?

A

Good for studying rare diseases or outcomes

Relatively quick to do since outcome has occurred already – data is already available

Good for establishing an association (leads to further research)

139
Q

What are the disadvantages of a case-control study?

A

Not randomized – susceptible to confounding

Susceptible to bias

Only suggest associations – can’t prove cause and effect

140
Q

What is a cohort study?

A

Groups (or cohorts) of subjects are created and compared according to exposure

Exposed vs. unexposed group

Groups followed over time to see if outcome occurs

141
Q

A cohort study is similar to….

A

Similar to an RCT but we didn’t randomize subjects into group or assign the exposure

142
Q

Why are cohort studies beneficial?

A

Best type of observational study for finding a valid association

143
Q

What is the best type of observational study for finding a valid association?

A

Cohort study

144
Q

What are the two types of a cohort study?

A

Propsective

Retrospective

145
Q

Describe a prospective cohort study?

A

At the start of the study, outcome hasn’t occurred yet

We have an exposed and unexposed group. We follow over time and identify the number of people who experienced the outcome over time.

Compare the rates.

146
Q

Describe a retrospective cohort study?

A

Outcome occurred before study started (uses retrospective data)

Start at a point in history with those exposed and those unexposed. Follow up to a a certain date. Analyze the number of people in both groups who have the outcome.

Compare the rates.

147
Q

Contrast prospective and retrospective cohort studies?

A

Prospective:

Conducted in real-time

Have some control over what data you want to collect and where it’s coming from
–> Pre-existing data sources (charts)
–> Subjects (interviews)

Retrospective:

Good for long follow-up studies (observation is already complete)

Use retrospective data collected prospectively

Data limitations
Accuracy or completeness
Missing information on important factors (e.g., lifestyle) – Big Gaps

148
Q

What is an exposure in a cohort study?

A

Drug
Procedure
Occupational
Environmental

149
Q

Rules of a cohort study

A

Exposure and outcome must be specifically defined
E.g., degree of drug exposure (dose and length)

Exposure must precede the outcome

150
Q

In an observational study, what is a benefit over RCT’s?

A

Chance is not as a major in the studies –> ONE THREAT MINIMIZED DUE TO LARGE NUMBERS

The numbers we get is significant as compared to an RCT so have less issues with chance

151
Q

How should a cohort be selected?Howdo we do this? How many comparator groups?

A

Groups (exposed and unexposed or “comparator”) should be as similar as possible

Select from same population

Can have more than one “comparator group”
E.g., Various levels of exposure
–> Potential unknown confounders even if groups are similar

152
Q

What are some advantages of cohort studies?

A

Provides highest level of evidence for observational studies

Can study multiple outcomes after a single exposure

153
Q

What are some disadvantages of cohort studies?

A

Susceptible to bias

Not randomized so susceptible to confounding

More resource intensive than other observational studies

154
Q

Define systematic review

A

A review of a clearly formulated question that uses systematic and explicit methods to identify, select, and critically appraise relevant research

Collect and analyze data from the studies that are included in the review

155
Q

Define meta-analysis

A

The use of statistical techniques (usually in a systematic review) to integrate the results of independent studies

156
Q

What are the two steps of a meta-analysis

A

Extract the data and main result from each individual study
Calculate a pooled average result
–> Greater weight given to studies that provide more information (e.g., studies with bigger sample sizes)

157
Q

What is the relationship between meta-anlyses and systematic reviews?

A

All systematic reviews are not meta-analyses and vice versa

Shouldn’t always statistically combine study results into one overall result

158
Q

Why can’t you combine study results into one overall result?

A

Clinical reasons
Do all the studies address the same question?
Similar populations?
Similar interventions and/or comparisons?
Similar outcomes?

Statistical reasons
Study “heterogeneity” (how different are the studies)
Are the results between studies consistent?
Q or I2 statistic

159
Q

WHy are meta-analysis and sytematic reviews done?

A

Tons of research

Systematic reviews provide opportunity and good summary of all clinical evidence out there

160
Q

Who does systematic reviews or meta-analyses?

A

Anyone can publish a systematic review and/or meta-analysis

~2500 SRs indexed annually on MEDLINE

Often found in specialty journals (increasingly more seeing them being published in medical journals)

161
Q

What is the cochrane collaboration?

A

1993 - Archibald Cochrane

Cochrane Collaboration

a compilation of high-quality, evidence-based medical research and systematic reviews

International network of 30,000+ volunteers in 53 review groups

Prepare, update and promote Cochrane Reviews

Internationally recognized as the highest standard in evidence-based healthcare (IMPORTANT)

No industry money

162
Q

Why are cochrane reviews so valued?

A

Robust/consistent and specific methodology for review
No industry money

163
Q

Outline the componenets of a systematic review?

A

Question of interest
–> Study protocol – inclusion/exclusion criteria
–> Decide if only RCT or also include observational studies

Comprehensive literature search – search terms (librarian involved)

Identify appropriate studies for inclusion
Go through abstracts
Scan the bibliography, reach out authors, research ongoing trials

Assess study quality

Extract data

Analyze data (if doing a meta-analysis)

Interpret results – write review

Questions can inform answers even although idiot

164
Q

When doing a review? How mnay people involved and in what steps?

A

Identify appropriate studies for inclusion
Go through abstracts

Assess study quality

Extract data

Should be done by at least 2 separate reviewers
3rd reviewer to break a tie

165
Q

What are some issues with meta-analyses?

A

Not all meta-analyses are done properly
Does the review address a clear question?
Did the authors look for appropriate papers?
Did the authors assess the quality of the included studies?
If there was a meta-analysis done, was it appropriate to do so? (Was a measure of heterogeneity reported? Q or I2 statistic?)
What is the overall result of the review?
Do these results apply to my patient(s)?
Who paid for the study?

166
Q

What is a critical part of systematic reviews?

A

Garbage in = garbage out
Including results from poor quality studies

167
Q

What is grey literature?

A

thesis, abstract, non-peer-reviewed (risks to this, not a necessity, useful if dealing with rapidly changing fields)

168
Q

What are clinical practice guidelines?

A

Systematically developed statements to assist practitioner and patient decisions about appropriate health care for specific circumstances

169
Q

What is the main point of a clinical practical guideline?

A

Get evidence into practice

170
Q

What do clinical practice guidelines define?

A

Describe a range of practices for the diagnosis, management, or prevention of specific diseases or conditions that meet the needs of most patients in most circumstances (NOT ALL CIRCUMSTANCES OR PATIENTS)

171
Q

What are the components of a clinical practice guideline?

A

Systematic review (+/- meta-analysis) of research
Focus on the strength of evidence (KEY) Need strong evidence

Set of recommendations
How to manage patient and/or condition

Describe target population
Should be specific
Inclusion and exclusion criteria

Describe target audience
Specialists / GPs
Other HCP
Patients
Administrators / Insurers

Expert Panel

Description of recommendation development
Actual methods
- Systematic review / Meta-analysis –> ESSENTIAL
- “Expert opinion” and “usual practice” SHOULD BE MADE CLEAR if lack of evidence for the opinion

External Review

Funding Statement

Some people always eat rice everyday for fun

172
Q

The expert panel should be comprised of:

What should be mentioned about them?

A

Range of experts should be used (such as):

Specialists / GPs
Nurses
Pharmacists
Other HCPs
Patients (SHOULD BE INCLUDED – family members, people caring for them) Important for asking questions, patient values and interests
Statisticians
Librarians
Ethicists

Information on each panel member (including conflicts of ineterst)

173
Q

What encompasses an external review?

A

Should be reviewed by individuals not involved in the development
Often sponsored or endorsed by organizations
Doesn’t always mean quality

174
Q

How often are CPG updated?

A

Most guidelines only produced every few years
Quicker in fast-moving fields

(Should state the next date at which the guidleines are to be reviewed)

175
Q

What are interim guidelines?

A

Focus around a specific clinical questions
Are subject to further updates, revisions, or developments
Often issued when there’s an urgent need for guidance in a particular area

(just a singular question)

176
Q

A funding statement should include:

A

Should report where funding came from
Funder(s) should have no influence on the content

177
Q

CPG recommendations should be:

A

Clear
Specific
Linked to evidence

178
Q

How can one determine the strength of a guideline?

A

Most use the GRADE system
(Grading of Recommendations, Assessment, Development and Evaluation)

Number (1 or 2) = strength of recommendation

Letter = quality of evidence supporting the recommendation

179
Q

What is the grading scale?

A

Study slides

180
Q

What is a critical thing to remember when interpreting guidelines?

A

Garbage in = garbage out
Studies of poor quality
Poorly done systematic review / meta-analyses

181
Q

What are some problems with CPG?

A

Poor quality studies (primary literature)
Incorrect or invalid information
Poorly conducted systematic review / MA
Publication bias
Self-serving / biased – drug company involved promoting their drug
Not user-friendly – readable and accesbible
Liability?

182
Q

How can one critically appraise a practice clinical guideline?

A

AGREE II
23 items – 6 domains:

183
Q

What are some barriers to guidelines?

A

Ultimate goal: want healthcare providers to use the guidelines
Barriers to healthcare providers using guidelines

Should be accessible free online
Guidelines should have summaries, decision aids, easy snapshots and tools to help apply the evidence