STUDY DESIGN - LEARNING OUTCOMES Flashcards

1
Q

Describe the main features of case reports and series.

A

Most basic type of descriptive study and documents an individual’s medical experience. A clinician may see an interesting case and describe what he/she has seen. A case series is an extension of a case report and is based on a small group of individuals. These studies are useful for hypothesis generating, but because there is no comparison group, their use is limited and statistical relationships between exposure and outcome cannot be assessed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Describe the main features of ecological studies.

A

Ecological studies look at the association between exposure and disease on a population or area level rather than on an individual level. With ecological studies any associations seen are on a population level, and we cannot assume that this transfers to an individual level. To assume that associations seen on a population level apply to the individual level is called the ecological fallacy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe the main features of cross-sectional studies.

A

A cross-sectional study collects observations on people at one point in time, thereby providing a ‘snap shot’ of the health of the population. Cross-sectional studies only provide information about disease prevalence and not disease incidence. Study subjects should be selected so they are representative of the target population.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe the main features of case-control studies.

A

The case-control study design is useful for looking at risk factors for rare diseases. However, it cannot look at prevalence or incidence of disease. It only looks at whether associations with exposure exist. In a case-control study cases are selected on the basis or presence or absence of disease. A group of individuals with the disease are selected (cases), along with a group of individuals without the disease (controls). Disease frequency cannot be measured because subjects are chosen or sampled according to their disease status.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe the main features of cohort studies.

A

Cohort studies measure the incidence of disease. In the traditional prospective cohort study, the study population is ‘free of disease’ at the beginning and the exposure variables are measured and then the population is measured through time to determine their disease outcome, and to compare the risk of disease in those who are exposed and those who are unexposed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Describe the main features of randomised controlled trials.

A

Controlled trials are human experiment where an investigator implements the intervention (or exposure) or interest and determines which individuals are exposed and unexposed. Randomisation is often used within trials to ensure that the exposed and unexposed groups are similar with respect to all other factors (including other risk factors for the outcome). An RTC is thus equivalent to a laboratory experiment where the investigator changes one variable at a time, keeping all other variables constant.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When is it appropriate to use case reports and series?

A

Case reports and series are useful for generating a hypothesis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

When is it appropriate to use ecological studies?

A

Ecological studies are a good first step in investigating possible exposure-disease relationships especially when there are restraints on time and money.

They are good for hypothesis generating.

They are also good when investigating an exposure which has little variation between individuals within a population/area, but large variations between populations/areas (e.g. some dietary factors).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

When is it appropriate to use cross-sectional studies?

A

Cross-sectional studies are good for measuring prevalence of disease. Only measure prevalent (i.e. current) cases of disease.

Good for measuring some continuous measure such as blood pressure or level of a protein in serum.

Gives a snap shot of the health of a particular population at a particular point in time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When is it appropriate to use case-control studies?

A

Case-control studies are useful for looking at risk factors for rare disease.

A case control study is appropriate when you have a single disease of interest because that is how we are doing our recruitment - it is more difficult to look at multiple outcomes than it would be for a cross-sectional study for example.

When the disease may be rare and you would have to use a very large cross-sectional or cohort study to get anybody with your outcome of interest.

It is useful when we are only looking at associations rather than trying to assess prevalence.

Also useful when looking at exposure(s) that are relatively common.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

When is it appropriate to use cohort studies?

A

Cohort studies are appropriate when you want to measure the incidence of a disease. This would traditionally involve starting with a cohort that is free of disease and following them through.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

When is it appropriate to use randomised controlled trials?

A

Randomised controlled trials are appropriate in cases where you want to test the effect of a certain exposure in comparison to a control exposure or placebo.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

List the advantages and disadvantages of case reports and series.

A

Advantages:

  • Allows reporting on unusual medical cases
  • Results used to generate hypotheses
  • Generates evidence of possible new disease
  • Rapid feedback of current events in medical community

Disadvantages:

  • Cannot be used to assess statistical associations
  • Could just be reporting a medical oddity
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

List the advantages and disadvantages of ecological studies.

A

Advantages:

  • Inexpensive and quick to conduct
  • Exposure and disease information is often more readily available by area
  • Differences in exposures often greater between areas than between individuals in one area

Disadvantages:

  • Results cannot be extrapolated to the individual level
  • Systematic differences between areas in recording disease frequency can occur
  • Quality of diagnosis
  • Differences in classification
  • Completeness of reporting
  • Sampling of the population can distort the results of an individual
  • Data often not available on confounders
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

List the advantages and disadvantages of cross-sectional studies.

A

Advantages:

  • Can be used to examine how much disease there is in a population, and to look at cross-sectional associations between exposures and disease
  • Can look at more than one disease and more than one exposure
  • Can be relatively inexpensive and quick to conduct and drop-out is not a problem as no follow up

Disadvantages:

  • Disease and exposure are measured at the same time therefore no temporal association can be made
  • Not suitable for studying rare exposures or rare outcomes
  • High possibility of recall / reporting bias
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

List the advantages and disadvantages of case-control studies.

A

Advantages:

  • There is no need to follow people up over time which can be costly, time-consuming and subject to drop-outs
  • It reduces the number of disease free people that need to be studied – this is particularly important when the disease of interest is rare
  • It is possible to study multiple exposures

Disadvantages:

  • No estimate of disease frequency can be obtained
  • Bias can be a problem, particularly selection bias
  • It is possible to look at one outcome only
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

List the advantages and disadvantages of cohort studies.

A

Advantages:

  • Measures incidence of disease
  • Multiple disease outcomes can be examined relating to one exposure
  • Often multiple exposures for one disease can be examined
  • Exposure is measured before the development of the disease so we can assess the temporal relationship between exposure and disease
  • Good assessment of level / duration of exposure and therefore allows us to look at dose relationship between exposure and disease
  • Extremely useful for measuring the effect of rare exposures
  • Selection / recall bias could potentially be very low

Disadvantages:

  • Prospective studies are time consuming and extremely expensive
  • Retrospective studies rely on the availability of good and accurate records
  • Results can be effected due to loss of follow up (response rate)
  • Can be inefficient for the evaluation of rare diseases
  • Can be inefficient for exposure-disease relationships with a long latency period (i.e. it takes a long time for the exposure to influence the disease or the disease to develop after exposure)
  • Ascertainment of outcomes could be influenced by exposure
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

List the advantages and disadvantages of randomised controlled trials.

A

Advantages:

  • Rigorous evaluation of a single exposure or treatment
  • Prospective design (can assess causation)
  • Potentially eradicates bias and confounding

Disadvantages:

  • Expensive and time consuming. This means that many trials are never done, or completed trials are too small or have follow-up periods that are too short. It also means that most trials are funded by large research bodies or drug companies (who may dictate the research agenda)
  • There is a risk of hidden bias (e.g. did blinding really work?)
  • Limited generalisiability – often exclude high risk groups such as the elderly, children or pregnant women
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the design and analysis issues associated with case reports and series?

A

It is just a descriptive study and documents an individual’s medical experience. There is no comparison group so their use is limited and statistical outcomes between exposure and outcome cannot be assessed. Not really any analysis associated with case reports and series. Use limited - good place to start.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are the design and analysis issues associated with ecological studies?

A

Confounding variables are a problem for ecological studies. To do something about confounding at the analysis stage you have to have collected the data and if you are using previously published data this may be an issue as that info may not be in there. The fact they we are dealing with a population level rather than an individual level can also cause problems.

We display ecological data as a scatter plot. Each dot on the scatter plot will represent a population or area. For example one scatter plot for an ecological data may have cigarettes per capita plotted on x, CHD deaths plotted on the Y, and then the dot representing the pop or area.

We need to think about confounding factors for apparent associations between two variables found in ecological studies.

We need to conduct analysis and interpretation of ecological studies at a population level and not an individual level. We have no data at the individual level. Without the information at the individual level often the correct interpretation of any relationship found can’t be established. If we want to extrapolate findings to the individual we would need to conduct further studies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

How do we display ecological data?

A

We display ecological data as a scatter plot.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Why do we use case-control studies for rare outcomes?

A

Because if we used any of the other study designs we would have to use large populations to pick up enough cases to analyse to look for associations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is the usual analysis method for categorical variables?

A

chi-squared test and generation of odds-ratios

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Can you use the risk ratio in case control studies?

A

No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the purpose of a multivariate analysis?

A

A multivariate analysis takes into account more than one variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What could we deduce if our unadjusted and adjusted odds-ratios showed a big change?

A

We could deduce that the factors that were being taken into account for calculation of the adjusted odds ratio are having a confounding effect.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

How can you alter the study design of a case-control study to help control for confounding?

A

We can perform matching in case-control studies where one or more controls is paired to each case based on variables thought to be confounders. This helps control for confounding, but need to allow for matched design in the analysis. It does this by increasing precision of odds ratios. Shouldn’t match on exposure of interest. (always need variation in our exposure to detect any association).

28
Q

What types of studies are cheaper - cohort studies or case-control studies?

A

Case-control studies are cheaper.

29
Q

Why might one say that cohort studies are more valuable than case-control studies?

A

Case-control studies can only look at one outcome whereas cohort studies can look at multiple exposures and outcomes.

Case-control studies use retrospective measures of exposure whereas cohort studies use prospective measures.

For case-control studies exposure is measured at one time whereas for cohort studies we can measure changes in exposure.

Case-control studies are more susceptible to selection bias than cohort studies.

For cohort studies we can measure incidence of disease which is not possible using case-control studies.

30
Q

Why might case-control studies be said to be easier to complete than cohort studies?

A

Case-control studies use fewer people, are usually faster to complete and cheaper than cohort studies.

31
Q

What is the equation for incidence risk?

A

Incidence risk = Number of new cases of disease during given time period / number of people initially at risk

However, we need a closed cohort to be able to carry out incidence risk calculations.

32
Q

What is the equation for incidence rate?

A

Incidence rate = Number of new cases of disease / Total person-time at risk

33
Q

What are the 3 different interpretations of an incidence rate result of ‘7 per 100 person-years’?

A
  • 7 new cases of disease in 100 people followed for 1 year
  • 7 new cases of disease in 10 people followed for 10 years
  • 7 new cases of disease in 1 person followed for 100 years
34
Q

How is prevalence related to incidence?

A

Prevalence = Incidence x Average duration of study

P = I x D

35
Q

What measure of effect can we use to examine differences in incidence between two groups?

A

We can use the rate ratio.

Rate ratio = Rate of disease amongst exposed / Rate of disease amongst unexposed

36
Q

What do we use to adjust for the effects of confounders in cohort studies?

A

Poisson regression - Poisson regression can give you adjusted rate ratios to take into account confounding factors.

We need to always compare the unadjusted with the adjusted statistics to see if there is any difference - no difference means that confounding is probably not having any effect.

37
Q

How can you change the design of a cohort study to reduce the time it takes to conduct a study?

A

We could do a retrospective cohort study. Here we need to use a cohort where there is existing data on exposure and disease.

This overcomes the problems of loss to follow up, long latency periods and is cheaper and quicker to perform than prospective cohorts. However, we need good exposure data with low misclassification for it to be successful.

38
Q

Where might bias arise in cohort studies?

A
  • loss to follow up
  • selection bias (not so much - less than case-control studies)
  • healthy worker effect
39
Q

What are the advantages of cohort studies and why might we want to use them?

A
  • multiple disease outcomes can be examined
  • assesses temporal relationship between exposure and disease
  • good assessment of level / duration of exposure to look at dose / response
  • selection / recall bias could potentially be very low
40
Q

What are the disadvantages of cohort studies?

A
  • time consuming
  • extremely expensive
  • retrospective studies rely on availability of good and accurate records
  • results can be affected due to loss of follow up
  • inefficient if effect of exposure has long latency period (would need a long follow up which would increase the cost)
41
Q

How is chance minimised in a clinical trial?

A

Chance is minimised by estimating study power, i.e. studying enough people

42
Q

How is confounding minimised in clinical trials?

A

Confounding is removed by randomisation

43
Q

How is bias removed in clinical trials

A

Bias is removed by blinding

44
Q

Why might you want to use other study designs when clinical trials are accepted to be the gold standard?

A

Randomised controlled trials can only test beneficial intervention.

Clinical trials are expensive and can take a long time.

Clinical trials may not be generalisable as we use restricted samples in clinical trials.

45
Q

What are the objectives of a randomised control trial?

A
  1. To test for a causal hypothesis of a disease

2. To measure the effect of a particular intervention

46
Q

We can use randomised control trials to both test for a causal hypothesis and to measure the effect of a particular intervention. What types of randomised control trials could we use to measure the effect of a particular intervention?

A

Within this group of studies where you are measuring an effect there are two main types.

  1. Explanatory trials - the objective of these trials is to measure the efficacy of an intervention of a new drug before it is licensed to try and find the optimal conditions for that drug.
  2. Pragmatic trials - the objective is to measure the effectiveness of an intervention when actually implemented in practice.
47
Q

How can we increase generalisability in randomised control trials?

A

We can increase generalisability in randomised control trials by minimising exclusion criteria.

48
Q

How can we guard against Type I error in RCTs?

A

Type I error is when we reject the null hypothesis when it is actually true (i.e. we say results are statistically significant when they actually are not). We can protect against this by making our p-values smaller.

49
Q

How can we protect against Type II error in RCTs?

A

Type II error is when we we don’t reject the null hypothesis when it is false (i.e. we declare there is no statistical significance when there actually is). To protect against this we need to make sure our sample size is large enough by carrying out sample size calculations.

50
Q

How are subjects allocated to the intervention in randomised controlled trials?

A

Using the process of randomisation. Randomisation breaks confounding by randomly allocating the intervention.

51
Q

What are the possible methods of randomisation?

A
  1. Tossing a coin
  2. Random numbers
  3. Permuted numbers
  4. Minimisation

We can use systematic randomisation also.

52
Q

Even with randomisation we can still get differences between groups - how can we take this into account?

A

We need to take baseline measurements after subjects are recruited.

53
Q

Describe allocation concealment.

A

Treatment should be allocated after the subject is recruited to the study and after you have taken the baseline measurements. If the subjects are allocated to treatment groups in advance and these are known to the subject, investigator, or both, this may affect whether the individual is introduced into the study or not and you don’t want that to introduce bias.

What we should have is a blind randomisation sequence so that the investigator and the subjects don’t know which group they are going in to. This may be done using sequentially sealed opaque enveloped and it may be controlled by a central allocation office.

If we don’t blind the investigator and study subjects we may get bias.

54
Q

Who can be blinded when considering allocation into an RCT?

A
  1. Study subject
  2. People recruiting subjects and delivering the intervention
  3. People conducting the evaluation (outcome assessor)
  4. Those doing the analyses
55
Q

Summarise randomisation for RCTs

A

Randomisation is important because it eliminates the role of confounding factors (both known and unknown). There are many different methods of randomisation. We need to make sure the method of randomisation is truly random and won’t introduce bias into the study.

56
Q

Describe the most basic randomised control trial design type.

A

This is the parallel group design. Subjects are randomised wither to receive placebo or active drug.

57
Q

Describe the RCT crossover design.

A

The crossover design is an extension of the parallel group design.

  1. We first recruit or subjects and they are allocated to either the drug treatment or the placebo group.
  2. After a period of time the subjects swap treatment groups so essentially all of your subjects get both treatments. This is good for stable diseases like asthma or high blood pressure.

An important point to think about is the period of time between the two treatments. You want a ‘washout’ period of time where the patients return back to baseline before they start the new treatment.

The main benefit of this crossover design is that you only need half as many people because each person is participating in both groups just at a different time.

58
Q

Describe an RCT within patient design.

A

This is similar to a cross over trial but subjects get two treatments at the same time. This is only suitable for very specific conditions. For example if we were looking at a drug to treat skin problems on the scalp the randomisation would come in to determine which side of the scalp was being treated by which treatment for each person. The benefit of within patient design is that you need a smaller sample size and you also rule out some of the between individual differences because one person is receiving both treatments. The main advantage over the crossover trial design is that there isn’t any washout period because you are doing both treatments at the same time.

59
Q

Describe the equivalence trial design of RCT.

A

Equivalence trials aim to show whether a new treatment is as effective as a standard treatment. These trials are normally based on the standard parallel group designs to assess the difference between the two groups. Before you carry out an equivalence trial there needs to be some investigation in order to assess whether the new and old treatment are better than placebo (they might well be as good as each other but that doesn’t really mean much if they are no better than the placebo).

It is important to note that a non-significant p-value doesn’t necessarily mean that they are equivalent - it may mean that sample size wasn’t big enough resulting in lack of power.

60
Q

Describe the cluster trial design of RCT.

A

Cluster trials are similar to parallel group studies but here we look at groups rather than individuals which are randomised to an intervention.

61
Q

List the different types of RCT designs.

A
  1. Parallel
  2. Crossover
  3. Within patient
  4. Cluster
62
Q

What do you need to consider when you are analysing clinical trials?

A

We want to be very clear when reading these reports as to the author’s primary hypothesis and whether this matches the primary outcome measure. Have they actually just focussed on a secondary outcome that wasn’t really mentioned before they started the trial?

What was the evidence preceding this trial? does it match the primary hypothesis and the primary outcome?

There should be less emphasis on secondary outcomes than primary outcomes.

We also want to look at which people stuck with the trials and what they did about loss to follow up. Why did people drop out of the trials? was it related to the treatment they were receiving or to their final outcomes?

Intention to treat principle to get around loss to follow-up in RCTs.

63
Q

What is the intention to treat principle?

A

For pragmatic trials we want to analyse for the treatment group for which people were randomised to - although we get the initial randomisation at the beginning people may have stopped treatment or swapped group during trial (we need to think about people’s reasons for this).

With the intention to treat principle even though people may have swapped groups by the end of the trial, those people are analysed as if they have stayed in the initial treatment group.

The reason we do this is because people who do this may have important differences which are related to the outcome from those that were compliant and took the treatment for which they were first allocated. Excluding those people that have moved or analysing people according to their final group essentially takes out the benefits given to you by that initial randomisation. You would be introducing bias into your results by basing it on which group they actually ended up in.

If there are a large proportion of people swapping from one treatment to another that should be reported as part of the outcomes from that trial.

Pragmatic trials should always be conducted using the intention to treat principle.

There are however some instances where you might want to analyse the data based on the treatment actually received and that would be in explanatory or per-protocol analysis trials. This is where if some people do swap you would analyse them based on the group they ended up in rather than the group that they were initially allocated to. Explanatory trials are used to test the safety of a new drug before it is licensed and optimise the dose.

64
Q

Would you want to use the intention to treat principle in explanatory trials?

A

There are however some instances where you might want to analyse the data based on the treatment actually received and that would be in explanatory or per-protocol analysis trials. This is where if some people do swap you would analyse them based on the group they ended up in rather than the group that they were initially allocated to. Explanatory trials are used to test the safety of a new drug before it is licensed and optimise the dose.

65
Q

What kinds of RCTs would you not want to analyse using intention to treat?

A

Explanatory trials

66
Q

What are the advantages of RCTs?

A
  • Rigorous evaluation of a single exposure or treatment - experimental rather than observational
  • It is a prospective design so it can assess causation as we have temporal measure of exposure and final outcome
  • potentially eradicated bias and confounding using randomisation and blinding
67
Q

What are the disadvantages of RCTs?

A
  • RCTs are expensive and time consuming - can lead to sample sizes being too small or too short - can also mean they may be funded by a large body who has dictated the research agenda
  • Risk of hidden bias - was it actually properly blinded? who was blinded? did the blinding truly work?
  • Limited generalisability - often exclude high risk groups, elderly, pregnant women, children