Lecture 5 - Study design Flashcards

1
Q

What is a clinical trial?

A

A planned experiment in humans designed to measure the effectiveness of an intervention

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is an intervention?

A

Usually a new drug, but the method can be applied to assessment of a surgical procedure/vaccine/complementary therapy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are experimental studies?

A

Different from observational studies as the investigator assigns groups with the risk factors e.g. one group smokes and the other doesn’t

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the features of a clinical trial?

A

Experimental study, must contain a control group, prospective (so participants followed through time), patients enrolled/treated/followed up at the same time, participants randomised to control/intervention groups, researches (ideally) are blinded

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How are clinical trials designed?

A

Defined popn> Randomised > a) intervention, b) control > a) and b) cured vs not cured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is control group?

A

Study participants who don’t receive intervention under assessment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Why should a control group be included?

A

Otherwise you can’t be sure of the result, why it happened > could be due to new treatment or may have happened anyway

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the control groups given?

A

Placebo or a standard treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How are tests randomised?

A

People eligible for the trial are recruited, consent obtained, and randomly allocated to the intervention and control groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Why is randomisation done?

A

To remove treatment allocation bias - can cause skewing of the data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Example of randomisation causing a skew in data?

A

BCG vaccine for TB in children- children with more ‘cooperative’ parents (more educated, health concious, so lower mortality even without vaccine) were put in the vaccination group and the control group were the others - the death rates were 5x higher in control group than vaccinated children

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What does blind/double blind mean?

A

Blind - patient doesn’t know if new treatment or placebo
Double blind - neither patient nor doctor knows which treatments being given
Triple - statistician doesn’t know different treatments

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Why do you blind in a trial?

A

Prevent bias in reporting/measurement of outcome > measurement bias - either patient or doctor may report signs that aren’t there

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How are trials maintained ethical?

A

Strictly regulated to ensure patients protected - all trials registered, reviewed by independent scientific committee , approved by research ethics committee, adhere to gov and international guidelines

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does the independent data monitoring committee do?

A

Group of independent researchers who check progress during trial - usually unblind the results to see if major difference in outcome and have power to stop the trial

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the rights of the patient in the trial?

A

They are provided with informed consent and are able to withdraw consent at any time without affecting their care

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What happens at the end of the trial?

A

Results are analysed and how their presented depends on the study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

How are the outcomes presented?

A

In terms of efficacy (true biological effect of treatment) or effectiveness (effect of treatment when actually used in normal practice)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the trial outputs?

A

Experimental event rate = incidence intervention arm
Control event rate = incidence in control arm
Relative risk = EER/CER
Relative reduction = (CER-EER)/CER
Absolute risk reduction = CER-EER
Number needed to treat = 1/ARR

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How are clinical trials expected to be reported?

A

According to CONSORT (consolidated standards of reporting trials) guidelines - ensures all papers contain the relevant info to critically appraise the paper

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How many clinical trials are there?

A

4

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What happens in Phase I?

A

Aim to test safety of new treatment - inc. looking at side effects of treatment > involves only a small number of people usually healthy volunteers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Give an example of a trial that was disastrous

A

Anti-inflammatory drug TGN1412 at Northwick Park hospital in 2006

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What happens in Phase II?

A

Test new treatment in a larger group of people who have the disease to see whether treatment is effective in short term > ~200 - also look at safety

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What happens in Phase III?

A

Test new treatment in an even larger group (~2000) of people - compare new treatment with treatment in use now or placebos > how well treatment works and side effects - smaller +ve effect then larger the cohort

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What happens in Phase IV?

A

Done after drug/treatment has been marketed to gather info on drug’s effect in various popn and any side effects with long term use

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the drug testing process?

A

Lab stage (Tissue samples - in vitro tests, Animal testing - mainly rodents for toxicity, MHRA and ethical bodies - drug cleared for human testing), Human testing (Phase I-III), Drug licensed (Phase IV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Give an example of a successful clinical trial

A

ACCOMPLISH hypertension treatment trial - RCT comparing benazepril+amlodipine (intervention) with benazepril+hydrochlorthiazide (control) - 1ry endpoint=vascular death > EER=9.6%, CER=11.8%, RRR=18.6% (reduction in events in people taking new treatment cf controls), ARR=2.2% (2.2% lower risk of event when taking new treatment), NNT=45 (need to treat 45 ppl with new treatment for average 3 yrs to avoid one additional vascular event)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What are cohort studies?

A

Observational analytical epi studies, cohort followed over time -> prospective design
Prospective cohort study ascertains disease during follow up
Exposure measured prior to disease and can measure incidence of disease in exposed/non-exposed and info can be used to calc rate ratios/risk ratios

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What are the strengths of cohort studies?

A

Can look at multiple outcomes, incidence can be calc, good to look at rare exposures, examine temporal relationship between exposure and disease, no ethical concerns, minimise bias in measuring exposure if prospective

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What are the weaknesses of cohort studies?

A

Time-consuming, expensive, loss of follow up may cause bias, healthy worker effect can cause bias in occupational cohorts, inefficient for studying rare diseases

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

What are case-control studies?

A

Observational analytical epi studies -> retrospective design, cases defined and exposures compared with controls, controls selected to represent source popn of cases, exposure determined post-diagnosis, odds ratio is only measure of relative risk that can be calc

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What are the strengths of case-control studies?

A

Quick and inexpensive, good for studying diseases with long latency period, good design to evaluate rare diseases, can examine effects of multiple exposures, can collect more detailed clinical info

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

What are the weaknesses of case-control studies?

A

Prone to bias, inefficient to examine effects of rare exposures, can’t calculate incidence rates directly, temporal relationship between exposure and disease is difficult to establish

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What are some cross-sectional survey examples?

A

2001 census, health survey for England, NHS inpatient survey on patient experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

What is routine data?

A

Data routinely collected and recorded in an ongoing systematic way - for admin and statutory purposes without any specific research question in mind at time of collection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

Name 3 types of routine data:

A

Health outcome data, Exposures and health determinant data, disease prevention data, demographic data, geographical data, births, deaths, cancer registrations, notifications of infectious diseases, terminations of pregnancy, road traffic accidents, prescriptions, GP consultation data, community systems, hospital admissions, congenital abnormalities

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

Why do we need a standardised mortality ratio?

A

Age is a key confounder that may vary in countries when finding out popn death rates - so age adjustment is needed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What is the standardised mortality ratio (formula)?

A

Number of observed deaths/number of expected deaths if experienced the same age specific rates as standard popn

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What is the standardised mortality ratio (in words)?

A

Ratio of no. of observed deaths in popn to the expected no. of deaths if the popn had the same mortality as a standard popn corrected for differences in age structure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What is bias?

A

A systematic error in design, conduct or analysis of a study which produces a mistaken estimate of treatment effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What is confounding?

A

When a variable is related to both the study variable and the outcome so the effect of the study variable on the outcome is distorted

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

What are the different types of randomisation?

A

Block (assign people to group A/B randomly), Stratification (by centre/ divided by patient characteristics), Minimisation (calculates imbalance and allocates to maintain balance)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

How do we minimize measurement bias?

A

Bliinding, endpoint selection (obj/subj, accurate/precise, consistent/repeatable, 1/2/3ry end points), loss to follow up (missing data, different between groups, intention-to-treat analysis)

45
Q

How do we evaluate drugs?

A

Efficacy vs effectiveness

46
Q

What is efficacy when evaluating drugs?

A

The biological effect - does it work and its tested in Phase II

47
Q

What is the effectiveness when evaluating drugs?

A

True OVERALL effect, does it work in real world and is it worth it? - tested in Phase III

48
Q

Sample size: Prospective power calculation - What is alpha?

A

=0.05, the chance of obtaining a difference in the trial is there was no real difference between groups - chance of false positive (type I error)

49
Q

Sample size: Prospective power calculation - what is beta?

A

=0.1-0.2, the chance of obtaining no difference in the trial if there WAS a real difference between the groups - chance of false negative (type II error)

50
Q

How is the power calculated in the prospective power calculation?

A

Power=1 - beta, usually 80-90%

51
Q

What is the number needed to treat (NNT)?

A

No. of patients that need to be treated for one to get benefit

52
Q

What are the 2 types of epidemiological studies?

A

Descriptive - to generate hypothesis and Analytical - to test hypothesis

53
Q

What are examples of descriptive epi studies?

A

Individuals: case reports/series, cross-sectional studies
Popn: ecological studies

54
Q

What are examples of analytical epi studies?

A

Observational (investigator observes w/out manipulating the exposure):case control/cohort
Experimental (investigator determines exposure and who receives intervention): RCT

55
Q

What do case control studies do?

A

Investigates relationship between risk factor and 1+ outcomes - ppl already have the investigated disease

56
Q

What do cohort studies do?

A

Follow a cohort to see who gets the disease - ppl don’t start with the disease

57
Q

What is the procedure to carry out a cohort study?

A

Follow cohort over time and determine no. of ppl with the disease, select ppl who are exposed/unexposed, compare risk of disease in exposed/unexposed cohorts

58
Q

How to assess exposure?

A

Self-reported, measured in clinic (BMI), existing records (medical/pharmacy records)

59
Q

How do you measure the outcome?

A

Binary (w/wout disease of interest) or continuous (BP, can use arbitrary cut point)

60
Q

What are retrospective cohort studies?

A

Determines at present the status of disease - uses data collected in past to ID the popn and exposure status

61
Q

Why do retrospective cohort studies take less time?

A

It takes little time to: assemble study popn from past data, determine disease status at present time

62
Q

What limitations do Retrospective cohorts have?

A

Exposure measures aren’t collected for the specific purpose

63
Q

What is the aim of analysis of cohort studies?

A

How much more likely is an individual to develop a disease if they are exposed to a particular factor?

64
Q

How do you measure association in a cohort study?

A

Relative risk/risk ratio - the likelihood of developing a disease if exposed relative to those unexposed

65
Q

What is the eqn for relative risk?

A

Incidence in exposed/incidence in the unexposed -> A/row total divided by C/row total

66
Q

How do you interpret RR

A

Exposure is associated with decreased risk of outcome

67
Q

How do you interpret RR=1?

A

Exposure is NOT associated with outcome

68
Q

How do you interpret RR>1?

A

Exposure is associated with an increased risk of the outcome

69
Q

What is the procedure of a case control study?

A

Select cases with disease and controls w/out disease, obtain info on past exposures, compare proportion w/exposure vs controls

70
Q

What is the definition of cases in case control studies?

A

Newly diagnosed (if possible), objective.strict diagnostic criteria, defined eligibility criteria, is it representative? (un/misdiagnosed, unavailable, dead)

71
Q

What is the definition of controls in case control studies?

A

Originate from same study popn as cases, at risk of disease, provide estimate of prevalence of exposure in study popn, defined eligibility criteria, sources: hospitals/clinics, community/popn

72
Q

What are the advantages and disadvantages of recruiting people from same hospital as cases (case control studies)?

A

Adv: match with cases in selection factors that bring ppl to certain hospitals/clinics + convenient/low cost
Disadv: medical conditions in control may be associated with investigated exposure

73
Q

What are the dis/advantages of controls from same geographic area (case-control studies)?

A

Adv: estimate of prevalence of exposure is popn-based rather than hospital based
Disadv: expensive, less motivation (lower response rates)

74
Q

What is a limitation of self-reported measurements?

A

Recall bias

75
Q

What types of bias cause measurement error in case-control studies?

A

Recall - patients w/disease respond more carefully
Interviewer - if known who has disease then over-report relevant exposures
Outcome - diagnostic bias, eg: women taking menopausal hormone therapy are screened more often (breast cancer)

76
Q

How is association measured in case control studies?

A

Start with disease status and then estimate exposure

77
Q

What is an Odds ratio?

A

Likelihood of having exposure if you have the disease relative to likelihood of having exposure if you DON’T have the disease

78
Q

What is the calc for odds ratio?

A

Odds that case was exposed/odds that control was exposed -> AD / BC

79
Q

How do you interpret OR=1?

A

No association

80
Q

How do you interpret OR>1?

A

Positive association between exposure and risk, so exposure asso with ^ risk of disease

81
Q

How do you interpret OR

A

Inverse asso between expo and disease, so expo asso with reduced risk of disease

82
Q

What are descriptive studies?

A

Aim to describe the distribution of factors of disease in relation to person (age, sex, race), place(w/in or between countries), time (time/season)

83
Q

What are cross-sectional studies?

A

Help in decision-making regarding allocation of resources, provide clues leading to hypotheses/analytical studies, describes status of individuals wrt absence/presence of both disease + exposure assessed at same point in time

84
Q

What can cross sectional studies NOT do?

A

Easily distinguish whether exposure preceded disease or not

85
Q

What are the aims of a survey?

A

Provide annual data about nation’s health, estimate proportion of popn w/health conditions, prevalence of risk factors asso w/conditions, assess freq w/which combinations of risk factors occur, examine differences between popn sub-groups, monitor targets in health strategy, measure height of children at diff ages

86
Q

What are the core topics of a survey?

A

General health, psycho-social indicators, smoking, alcohol, demographic/socio-economic indicators, Qs about use of health services and prescribed meds, measurement of height/weight/BP

87
Q

What are the adv of routine data?

A

Cheap, already collected and available, standardised collection procedures, relatively comprehensive, wide range of recorded items, available for past years, experience in use and interpretation

88
Q

What are the disadv of routine data?

A

May not answer q, incomplete ascertainment, variable quality/validity, disease labelling may vary over time/by area, coding changes could create artefactual ^/decreases in rates, need careful interpretation

89
Q

What are the top 5 diagnosed cancers in UK (male and female)?

A

Breast, lung, large bowel, prostate, bladder

90
Q

Why are single studies unable to conclusively answer a research question?

A

Poor study design/small numbers, study will often only look at one subset of potential study popn

91
Q

What is the structure of a systematic review?

A

Stage I: planning a review, Stage II: conducting the review, Stage III: Reporting and dissemination

92
Q

What is the Stage I of a systematic review?

A

Specify the q to be addressed -> framed around PICOS: Popn, Intervention/comparison, Outcomes, Study Design

93
Q

What is Stage II of a systematic review?

A

ID of research (clearly defined search criteria, search published medical lit/other sources) and missing studies=BIAS; Selection of Research, Study Quality Assessment, meta-analysis

94
Q

What is meta-analysis?

A

Use of statistical techniques in a systematic review to integrate the results of included studies (primary units of analysis)

95
Q

What is Stage III of a systematic review?

A

Study details tabulated in a meaningful way, including details of PICOS

96
Q

What are the issues in systematic reviews/meta-analyses?

A

Publication bias, inconsistency of results, low study quality, inconsistency of results (diff PICOS)

97
Q

Why is there publication bias?

A

Null/non-significant findings are less likely to be reported/published than statistically significant findings - distorting meta-analyses and systematic reviews

98
Q

How can publication bias be explored?

A

Using funnel plots - each study is a point and the plot point is determined by OR and study precision

99
Q

How to interpret funnel plots?

A

If symmetrical about mean effect, shaped like upside down funnel then no publication bias -> if missing a lower R/LHS corner then pub bias

100
Q

What is heterogeneity in systematic reviews?

A

Inconsistency of results - studies answering same q can differ in PICOS, and even when PICOS is same then still can be different due to clinical differences, methodological differences/unknown study characteristics

101
Q

What to do if too much heterogeneity exists?

A

May not be appropriate to pool the studies

102
Q

What are the adv of meta-analyses?

A

Generate a pooled overall risk estimate, produce a more reliable and precise estimate of effect, explore heterogeneity between published studies, ID if publication bias is occurring

103
Q

What is a systematic review?

A

A review of a clearly formulated q that uses systematic and explicit methods to ID, select and critically appraise relevant research and to collect and analyse data from the studies that are included in the review.

104
Q

What are the adv of systematic approach?

A

Transparent process (explicit methods ID and rejecting studies), meta-analysis enhances precision of estimates and prescription effects, may ID lack of adequate evidence and areas where research is needed

105
Q

What do meta-analyses do?

A

Combine published estimates of effect from each study and generate a pooled risk estimate

106
Q

What is a forest plot?

A

Common way of presenting the results from a meta-analysis - graphical representation of results from each study included, with the combined meta-analysis result

107
Q

Describe a forest plot?

A

Each study is represented by a box and line - size of box=weight given to study, length of lines= 95% CI
Overall estimate from meta-analysis is shown as diamond at bottom of plot, centre of diamond/dotted line=summary effect estimate , width of diamond=CI around estimate

108
Q

What is the Bradford-Hill criteria for causation?

A

Temporal relationship, Plausibility, Consistency with other investigations, Strength of the association, Dose-response relationship, Specificity, Experimental evidence, Coherence, Analogy