2 - Study Design Flashcards

1
Q

(OBJ) Describe the major types of research designs and when they are used.

A
  1. Descriptive study: no explicit comparisons; a mean, median, or probability is the goal
    - -Case reports/series
    - -Rates in population
  2. Analytic study: explicit comparisons; used to measure an association
    - -Observational
    - -Intervention
    - -use relative risks to assess the impact of some exposure on the risk of an outcome or correlations and regression to assess the relationship between two measurements
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

(OBJ) Describe the differences between observational and intervention studies.

A
  • -Observational: watching people, collecting information (cohort studies, etc)
  • -Intervention: randomized trial; doing something actively and watching results
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

(OBJ) Describe the differences between cross-sectional and longitudinal studies and discuss when each might be used.

A

Cross-sectional study:

  • -Single population
  • -No follow up
  • -Measurement of PREVALENT traits and diseases (not incidence)
  • -Performed at ONE point in time
  • -Common for studies of biology, diagnosis
  • -Direction of causality often unclear

Longitudinal studies:

  • -Follow over time
  • -Measure incidence (and prevalence)
  • -Require much more time and effort
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

(OBJ) Contrast the advantages and disadvantages of case-control studies.

A

Identify people with/without disease and ask about previous exposures (have disease = case, no disease = control)

Advantages:

  • -Relatively quick, easy, and inexpensive
  • -Good for very rare diseases
  • -Allows you to compute ODDS RATIO

Disadvantages:

  • -Reversal of causality
  • -Non-response
  • -No single measure of association (**cannot calculate risk!!)
  • -Selection bias: can be tough to select appropriate controls
  • -Response bias: measurement issues (have outcome before measuring exposures, so may bias recall), timing issues (cholesterol and BP after an MI would not be the same as before)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

(OBJ) Describe methods used to select appropriate controls in research studies.

A

Should represent exposure in source population for cases
Difficult to define in a hospital-based study (who WOULD have gone to DHMC vs Boston or Fletcher Allen if they got ALS?)
Easy to define in a population-based study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

(OBJ) Describe the features of cohort studies (retrospective and prospective); contrast their advantages and disadvantages.

A

Observe disease risk in exposed and unexposed
Prospective: following people in real time
Retrospective: all in the past (look at medical records)

Advantages:

  • -Can compute absolute risk/rate, risk ratio/rate ratio, and risk differences
  • -Natural logic: exposures, then outcomes
  • -Possible to study rare exposures
  • -Relatively free of some biases of case-control studies

Disadvantages:

  • -Work/time, especially for prospective (lots of subjects, lots of follow up)
  • -Rare outcomes need even more follow up and larger groups
  • -Drop-outs bad (want complete follow-up to observe risks)
  • -Outcome ascertainment - want unbiased follow up
  • -Outdated exposures with long follow up - exposures change with time (people stop smoking)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

(OBJ) Contrast the advantages and disadvantages of randomized controlled trials.

A

Advantages:

  • -No confounding
  • -No exposure measurement error
  • -No response biases
  • -Organized follow up for both treatment groups

Disadvantages:

  • -Patients must be eligible and willing for ALL study treatments & may not represent general population
  • -Treatments are uniform and rigid, not like real life
  • -Co-interventions
  • -Drop outs
  • -Difficult and expensive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

(OBJ) Describe the roles of randomization and blinding in clinical trials, including concepts such as subject selection, exposure allocation, stratification, self-selection, systematic assignment. (this is incomplete)

A

Subject selection:

Exposure allocation: FIXED, isolates treatment effect and limits confounding

Stratification:

Self-selection:

Systematic assignment:

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

(OBJ) Introduce the odds ratio as a measure of association.

A

Cross product: AD/BC

Provides a good estimate of relative risk, but is NOT a risk ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

(OBJ) Discuss intention-to-treat and as-treated analyses, and their impact on measures of effect.

A

Intention-to-treat analysis: includes everyone assigned to treatment group, regardless of drop outs or cross overs
–Must be your primary analysis, but will be more conservative

As-treated analysis: keep people in groups of what treatment they actually received (the people who completed the trial on the protocol)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

(OBJ) Discuss in detail the types of bias affecting the various study designs, and methods used to minimize bias. (descriptive, case-control, cohort, clinical trial, all)

A

DESCRIPTIVE:

  • -No comparisons; describe only what is possible, not what is better or worse.
  • -Concern is the precision (or lack of it) and bias in measurements.

CASE-CONTROL:

  • -Selection bias (do cases and controls correspond?).
  • -Information bias (did the presence/absence of the disease affect the data obtained?).

COHORT Follow-up: (were exposed and unexposed groups followed and endpoints determined with equal intensity, and without bias?).

CLINICAL TRIAL:

  • -What kind of controls (randomized is best)?
  • -Were all groups followed-up in the same (unbiased) way?
  • -Was the randomization concealed from investigators and subjects? (Blinding helps assure this.)

ANY STUDY:

  • -Adequate sample size to detect a meaningful effect?
  • -Is confounding present?
  • -Did people with the exposure of interest have the same chance to be detected to have the outcome as people without?

ANY VALID STUDY:
–Generalizability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

(OBJ) Explain the terms internal and external validity.

A

Internal validity: did study reach correct conclusions about the study population?

External validity: can results be applied beyond the study example (e.g. to the general population)?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define bias.

A

A feature of a study tending to distort its findings away from the true result for the population being studied.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Define blinding.

A

The process of keeping clinical trial subjects and/or study personnel unaware of the treatment assignments
Also used to describe the process of keeping study participants or personnel unaware of the hypotheses under study.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Define case-control study.

A

A research design in which subjects with a disease or outcome (cases) are compared to subjects without the disease/outcome (controls). (Improperly called a retrospective study.)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

(OBJ) Define case report. List its advantages and limitations.

A

An informal study in which the experience of a group of patients is described, without a comparison group.
AKA case series
–Describes what is possible, NOT necessarily what is likely
–Includes an IMPLIED inference, if any (“this is interesting”)

Advantages: trends in the data can be used to develop hypotheses that can be tested in larger, controlled studies
Limitations: lack of a comparison group makes it impossible to make statistical comparisons of risk

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define clinic-based.

A

A study in which all subjects are derived from patients seen at a medical facility.
A hospital-based study is an example
Typically used with regard to a case-control study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define clinical trial.

A

A formal intervention study, in which the investigators determine the treatments or exposures of the subjects (usually by randomization)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define cohort study.

A

A research design in which a defined group of subjects is followed over time for the occurrence of events

AKA follow-up study

20
Q

Define cross-sectional study.

A

A research design in which subjects are evaluated at only one timepoint

21
Q

Define double-blind.

A

A situation in which both subjects and investigators are unaware of the subjects’ treatments or exposures

22
Q

Define ecological study. What problem exists with ecological studies?

A

An investigation in which the unit of analysis is a group; good for generating hypotheses
–Ex: correlation of trends over time in disease rates with trends in cigarette sales, or association of disease rates in different countries with cigarette sales

–PROBLEM: ecologic fallacy - inferences from group level may not apply to individual level (individuals who eat meat may not be the ones getting breast cancer)

23
Q

Define efficacy analysis.

A

A statistical analysis of data from a randomized clinical trial in which the outcome is evaluated according to the treatment actually received
Loses some of the advantages of randomization
AKA as treated analysis

24
Q

Define external validity.

A

The ability of a study to apply to populations other than the one actually studied

AKA generalizability

25
Q

Define historical controls.

A

A control group comprised of subjects whose past experience is contrasted with those of currently observed subjects
Historical controls are generally considered inferior to concurrent controls.

26
Q

Define information bias.

A

A distortion caused by information provided by one group of subjects being systematically different than that provided by another group
Usually associated with case-control studies, in which case patients may provide systematically different information than controls
AKA response bias

27
Q

Define intention-to-treat analysis.

A

A statistical analysis of data from a randomized clinical trial in which outcome is evaluated according to the randomized treatment group, regardless of what treatment was actually received
Makes full use of the advantages of randomization

28
Q

Define internal validity.

A

The ability of a study to reach a correct conclusion about the population actually studied

29
Q

Define intervention study.

A

A study in which the investigators determine the exposures or treatments for subjects

30
Q

Define observational study.

A

A study in which the investigators do not determine the exposures or treatments subjects experience

31
Q

Define odds ratio.

A

A type of relative risk; the only type of relative risk possible in case-control studies
Calculated with a cross-product ratio from a 2 × 2 table

32
Q

Define placebo.

A

A sham drug used in blinded studies to keep subjects and/or investigators unaware of subjects’ treatment assignments

33
Q

Define prospective study.

A

An investigation in which the events studied occur during the time the research is conducted

34
Q

Define randomization.

A

A way of assigning treatments so that each subject has the same probability of receiving a particular treatment. Randomization makes treatment “independent” of the characteristics of the subjects, and thus effectively “prevents” confounding

35
Q

Define retrospective study.

A

An investigation in which all of the events studied have already occurred at the time the research begins; existing records provide the data

36
Q

Define retrospective cohort study.

A

A study in which the exposure and outcome have already occurred: exposed and unexposed subjects are “followed” through time afterwards e.g. through review of medical records

37
Q

Define selection bias.

A

A bias that arises because of the selection of subjects in a study

38
Q

Define single blind.

A

A situation in a clinical trial in which either the patient or the investigator group is unaware of treatment assignment, but not both
Best used to describe the situation in which the investigators evaluating endpoints are unaware of treatment assignment

39
Q

An odds ratio is the only valid estimator of relative risk in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b
e. RCT

A

A

40
Q

The absolute risks of the outcome (in the exposed & unexposed) can be calculated in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b

A

B (also in RCT)

41
Q

Confounding is a potential issue in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b
e. RCT

A

D

42
Q

To study factors which affect the incidence of diseases, we could use…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b

A

D

43
Q

Subjects who have the disease under study may provide distorted risk factor information in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b

A

A

44
Q

Data collected entirely in the past could be used for…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b
e. RCT

A

D

45
Q

Bias is virtually never a potential issue in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b

A

D

46
Q

The causes of rare diseases are best studied in…

a. A case control study
b. A cohort study
c. Neither a nor b
d. Both a and b

A

A