2. Study Design: Evidence for Global Health Flashcards

1
Q

Why may inconclusive study results arise?

A

Because avoidable flaws have arisen in:

  1. Study design
  2. Data Analysis
  3. Data Interpretation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the importance of the research questions?

A
The formulation of a problem is often
more essential than its solution, which
may be merely be a matter of
mathematical or experimental skill.
- Einstein

Thus vague problems will be difficult to answer.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is PICO?

A

P - What is the Patient, Problem or Population

I - Intervention or exposure or test being considered

C - Is there a Comparative intervention (Control)

O - What is the Outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How can a study performed on a small sample be generalisable to a population?

A

• For the study results to be generalisable, the
study should ideally be performed on a random
sample of the relevant individuals

• However, the target population may be too wide
ranging to do this

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is Sampling Bias?

A

In statistics, sampling bias is a bias in which a sample is collected in such a way that some members of the intended population are less likely to be included than others.

Occurs if some members of the eligible
population are more likely to be included
than others, i.e. the sample is not
random.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the ‘Healthy Worker Effect’?

A

“HWE is a phenomenon initially observed in studies of occupational diseases: Workers usually exhibit lower overall death rates than the general population because the severely ill and chronically disabled are ordinarily excluded from employment” – Last, 1995

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How can sampling bias be minimised?

A

To reduce sampling bias, the two most important steps when designing a study or an experiment are:

  1. To avoid judgment or convenience sampling
  2. To ensure that the target population is properly defined and that the sample frame matches it as much as possible.

Minimise it through careful study design

Record as much information as possible
about subjects that refuse to participate
– This will allow assessment of the extent to
which the study sample represents the target
population
– May allow adjustment for bias in analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are confounding factors?

A

Factors that interact with an exposure and can effect an outcome. In statistics, a confounder is a variable that influences both the dependent variable and independent variable causing a spurious association.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a descriptive study?

A

Descriptive studies are primarily designed to
describe the distribution of existing variables that
can be used for the generation of broad
hypotheses

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is an analytical study?

A

Analytical studies examine an association, i.e.
the relationship between a risk factor and a
disease in detail and conduct a statistical test of
the corresponding hypothesis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the aim of a comparison group?

A

The control group is defined as the group in an experiment or study that does not receive treatment by the researchers and is then used as a benchmark to measure how the other tested subjects do.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is an observational study?

A
The study has not
changed anything but
observes the situation
or differences
between groups/over
time.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Name an example of an observational study

A

cohort, casecontrol,
crosssectional,
ecological

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is an experimental study?

A

The researcher has

changed something

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Give an example of an experimental study

A

Randomised

Controlled Trials

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Name the difference between prospective and retrospective studies.

A

A prospective study collects information at the time of the study and so may be more reliable. Whilst a retrospective study looks back in time, this may be open to recall bias.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are Case Reports and Case Series?

A
A collection of patients with common
characteristics used to describe some
clinical, pathophysiological or operational
aspects of a disease, treatment or
diagnostic procedures.

Case reports are considered the lowest level of evidence, but they are also the first line of evidence, because they are where new issues and ideas emerge. This is why they form the base of our pyramid. A good case report will be clear about the importance of the observation being reported.

If multiple case reports show something similar, the next step might be a case-control study to determine if there is a relationship between the relevant variables.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Give an example of a case report or case study.

A

This case report was published by eight physicians in New York city who had unexpectedly seen eight male patients with Kaposi’s sarcoma (KS). Prior to this, KS was very rare in the U.S. and occurred primarily in the lower extremities of older patients. These cases were decades younger, had generalized KS, and a much lower rate of survival. This was before the discovery of HIV or the use of the term AIDS and this case report was one of the first published items about AIDS patients.
(Hymes et al. 1981)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are design pitfalls for case studies/reports?

A
  • The patient should be described in detail, allowing others to identify patients with similar characteristics.
  • Case reports could provide measurements and/or recorded observation that are wrong or subject to bias
  • The CR/S could confirm a phenomenom instead of infer (it cannot prove with no analysis)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are the advantages of Case studies/series?

A
  • Allows reporting of
    unusual medical cases, additionally, can help in the identification of new trends or diseases
  • Can generate
    hypotheses and
    indications of possible
    new diseases
  • Provides rapid
    feedback of events in
    the medical community
  • Can help detect new drug side effects and potential uses (adverse or beneficial)
  • Educational – a way of sharing lessons learned
  • Identifies rare manifestations of a disease
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are the disadvantages of Case studies/series?

A
  • Cases may not be generalizable
  • Not based on systematic studies
  • Causes or associations may have other explanations
  • Can be seen as emphasizing the bizarre or focusing on misleading elements
  • Cannot be used to
    test statistical
    relationships
  • Could just be medical
    oddities
22
Q

What are ecological studies?

A

A study in which at least one variable, either an exposure or the outcome, is measured at the population (not individual) level.

23
Q

Describe an example of an ecological study.

A

Examples of group-level measures include the incidence rate of cancer among a specific population, the mean level of blood pressure of patients seen at a clinic, the average sunlight exposure at specific geographic location on the earth, or even a preventive service included in a health insurance plan

24
Q

What is a summary measure in an ecological study?

A

A summary measure correlates an exposure to an outcome, e.g. the proportion of smokers in a country versus the number of deaths via cancer.

25
Q

What is an environmental measure?

A

Measuring the similarity in environmental exposure, e.g. is the level of sunlight the same in these populations?

26
Q

What is a global measure?

A

The size of the population

27
Q

What is the ecological fallacy?

A

Association observed at group level does not
necessarily represent the association that exists at
the individual level.

28
Q

Give an example of the ecological fallacy.

A

• Death rates from breast cancer are high in
countries where fat consumption is high compared
to those where it is low. This is an association for
aggregate (country-level) data. In countries with
more fat in the diet and higher rates of breast
cancer, women who eat fatty foods are not
necessarily more likely to get breast cancer.

29
Q

What are the advantages of an ecological study?

A
Inexpensive & quick
• Exposure information
often more readily
available by area
• Useful for generating
hypotheses
• Differences in
exposures may be
greater between areas
than between
individuals in one area
Inexpensive
- Less time-consuming
- Simple and easy to understand
- Examines community-, group-, or national-level data and trends

However, ecological studies should be seen as a means of generating hypotheses rather than deriving definitive information about associations between risk factors and health outcomes

30
Q

What are the disadvantages of an ecological study?

A
  • Subject to the ecological fallacy, which infers association at the population level whereas one may not exist at the individual level
  • Difficult to detect complicated exposure-outcome relationships
31
Q

What are cross-sectional studies?

A

Is a type of observational study that analyzes data collected from a population, or a representative subset, at a specific point in time. It can be both descriptive and analyical and analyses who is getting the disease, which can be useful for generating hypotheses regarding exposure-outcome associations (with care).

32
Q

How to cross-sectional studies work?

A
• Exposure and outcome measured at the
same time
• Often include retrospective questions
– Open to recall bias
• Outcome measurements:
– Point prevalence (Do you have a sore throat today?)
– Period prevelance
33
Q

What are the advantages of cross-sectional studies?

A
Can be used to determine
who is getting the
disease, where and how
the disease prevalence is
changing over time
• Relatively inexpensive
• Good first step in forming
hypotheses between
exposure and disease
34
Q

What are the disadvantages?

A
  • They are often based on a questionnaire survey. There will be no loss to follow-up because participants are interviewed only once. However, a cross sectional study may be prone to non-response bias if participants who consent to take part in the study differ from those who do not, resulting in a sample that is not representative of the population.
  • It is possible to record exposure to many risk factors and to assess more than one outcome in a cross sectional study. However, because data on each participant are recorded only once it would be difficult to infer the temporal association between a risk factor and an outcome. Therefore, only an association, and not causation, can be inferred from a cross sectional study.
  • Hard to make temporal
    associations
  • Not good to study rare
    exposures and rare
    outcomes
  • Possibility of recall bias
35
Q

What are demographic & health surveys?

A

Nationally-representative surveys that provide data
for a wide range of monitoring and impact
evaluation indicators in population, health &
nutrition.

36
Q

What are case control studies?

A

A comparison of the characteristics and exposures of
individuals with a disease/outcome (CASES) with
individuals without the disease/outcome (CONTROLS)

Compare the occurrence exposures (possible causes) in
cases and controls to measure the effect of the exposure
(ODDS RATIOS)

Collect data on disease occurrence at one point in time
and exposures at a previous point in time (i.e. longitudinal)

37
Q

How does one identify the cases & controls in a case control study?

A

Cases
– Incident cases (i.e. new cases) avoids the difficulty of
separating factors related to causation and survival (or
recovery)
– Prevalent cases

Controls
– Should represent people who would have been
designated study cases if they had developed the
disease (i.e. represent the population at risk of the
disease)
– May be ‘matched’ to cases to have the same values for
major confounding variables

38
Q

What are the advantages of CC studies?

A

Good for the study of:
– Rare diseases
– Diseases with long
latency period

• Can be used to
investigate multiple
potential risk factors

• Relatively quick

  • They are advantageous when exposure data is expensive or hard to obtain
  • They are advantageous when studying dynamic populations in which follow-up is difficult.
39
Q

What are the disadvantages of CCS?

A

• Can only look at a
single disease
outcome
• Susceptible to bias
and confounding
• Cannot directly
measure risk
- They are subject to selection bias.
- They are inefficient for rare exposures.
Information on exposure is subject to observation bias.
- They generally do not allow calculation of incidence (absolute risk).

40
Q

What are cohort studies?

A

Cohort studies are a type of medical research used to investigate the causes of disease, establishing links between risk factors and health outcomes.

They focus on a cohort. A cohort is a group of persons defined by their exposure. Comparison can be made with their external populations (e.g.
WHO Standard populations), or internally (exposed/not
exposed)

The study provides greater evidence when assessing causation

It also measures and compares INCIDENCE MEASURES,
RISKS and RATES

41
Q

What are the advantages of a cohort study?

A

It is a good measure of incidence, allowing you to calculate:

  • Absolute risk (incidence)
  • Relative risk (risk ratio or rate ratio)
  • Risk difference
  • Attributable proportion (attributable risk %)
- Good for aetiological studies
• Useful for measuring the
effect of rare exposures
• Multiple outcomes can be
measured
• Multiple exposures can be
examined for one outcome
• Direct measurement of
incidence
• Selection/Recall Bias
potentially very low
42
Q

What are the disadvantages?

A
- Prospective cohort
studies are time/resource
intensive
• Retrospective studies rely
on availability of accurate
records
• Risk of loss to follow-up
• Inefficient for the
evaluation of rare
diseases
43
Q

What is a Prospective Cohort Study?

A

A prospective cohort study is a longitudinal cohort study that follows over time a group of similar individuals (cohorts) who differ with respect to certain factors under study, to determine how these factors affect rates of a certain outcome.

The disadvantages associated with that is:

  • You may have to follow large numbers of subjects for a long time.
  • They can be very expensive and time consuming.
  • They are not good for rare diseases.
  • They are not good for diseases with a long latency.
  • Differential loss to follow up can introduce bias.
44
Q

What is a retrospective cohort study?

A

A retrospective study looks backwards and examines exposures to suspected risk or protection factors in relation to an outcome that is established at the start of the study.

The disadvantages associated with which is:

  • As with prospective cohort studies, they are not good for very rare diseases.
  • If one uses records that were not designed for the study, the available data may be of poor quality.
  • There is frequently an absence of data on potential confounding factors if the data was recorded in the past.
  • It may be difficult to identify an appropriate exposed cohort and an appropriate comparison group.
  • Differential losses to follow up can also bias retrospective cohort studies.
45
Q

What is a nested case control study?

A

A nested case control (NCC) study is a variation of a case-control study in which each case is matched to one or more controls based on participant characteristics, e.g. age. … Thus the nested case control study is less efficient than the full cohort design.

46
Q

What are the advantages of a Nested CC?

A

This design overcomes some of the disadvantages associated with case-control studies,2 while incorporating some of the advantages of cohort studies.

Selection bias is of particular concern in the traditional case-control study. A nested study removes this bias typically through collecting cases and controls from a database.

47
Q

What are the disadvantages?

A

he study design is prone to recall bias

48
Q

What is the importance of time in these study?

A
  • All research on causation involves time
    • Period of Follow-Up is important as exposures may
    change throughout history and over a life-course
    • Length of Follow-Up is related to the incidence of the
    disease (those with low incidence need a long followup
    in order to ascertain enough cases for statistical
    analysis)
    • Exposure time is an important consideration and is
    determined by the latency between exposure and
    development of a disease
49
Q

What is an RCT?

A

A study in which a number of similar people are randomly assigned to 2 (or more) groups to test a specific drug, treatment or other intervention. One group (the experimental group) has the intervention being tested, the other (the comparison or control group) has an alternative intervention, a dummy intervention (placebo) or no intervention at all. The groups are followed up to see how effective the experimental intervention was. Outcomes are measured at specific times and any difference in response between the groups is assessed statistically. This method is also used to reduce bias.

50
Q

RCT Advantages?

A
  • Examines cause and effect reliably
  • Specific recommendations can be confidently made regarding patient care for study population
  • Hypothesis will be clear
  • Good in situations where human behaviour can be predicted and controlled
  • Confounding variables can be controlled
  • Random allocaiton of subjects eliminates bias and creates comparable groups
51
Q

Disadvantages of RCT?

A
  • situation and condition studied focus on a narrow range and leave many clinical questions unanswered
  • Situation studied may not apply to all patients
  • Not good in areas where factors to be studied are unclear or poorly understood
  • Not good in situations were human opinion, culture and behaviour play an important role
  • Unknown confounders can create invisible bias
  • Often random allocaiton is neither ethical or feesible