Epidemiology 2.6 Flashcards

1
Q

How can sample size be determined?

A

several mathematical equations – depending on the type of study you’re running and the variables involved - while you don’t need to know how to calculate the sample size at this stage of training by hand, you should be aware of the factors that influence sample size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What are the three main statical factors that will push you sample size up or down?

A
  1. Difference between groups the you would be looking at
  2. The study power
  3. The study alpha
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How does the difference between the groups you are looking at affect sample size?

A
  • For example, if investigating blood pressure, we might want to look for perhaps 5 mmHg or 10 mmHg difference
  • A larger difference will require a smaller sample size – just like photographing a larger object doesn’t require as good a camera (as photographing a smaller object).
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How does the study power affect sample size?

A
  1. aim for 80%

2. as you increase your power, your sample size will increase.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

How does the study alpha affect sample size?

A
  1. how much you want to rule out chance causing a positive finding
  2. it’s the equivalent of specifying the p-value and it’s also connected with one- and two-tailed testing
  3. Decreasing alpha from 0.05 to 0.01 will increase your sample size.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What else effects sample size?

A
  1. consider loss to follow-up
  2. as a rule of thumb, it’s not unusual to lose 15% of your participants – and of course longer studies will have higher loss
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a type I error?

A

‘false positive’ finding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the p value?

A

the probability of obtaining a result as extreme as the observed results of a statistical test, assuming the null hypothesis is correct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does. the p value mean?

A
  • probability of getting your results if actually there’s no real difference
  • that means it’s the probability of a false positive
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When is there statical significance?

A

<0.05

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why are p values not so helpful?

A
  1. If you run multiple analyses, likely that one of your analyses will come back around the p = 0.05 mark - running multiple analyses on your data will eventually come back with something <0.05 when there’s no real underlying difference between your groups.
  2. The p-value is often mistaken as implying clinical significance. It doesn’t.
    - All a p-value tells you is how likely your findings are due to chance alone
    - It’s perfectly possible to have highly ‘statistically significant’ findings of a clinical difference which is entirely clinically meaningless.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

When are p values helpful?

A

consistent findings over multiple tests <0.05 or single tests <0.01 then it gives some reassurance that chance alone is less likely to be playing a part

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a type II error?

A

‘false negative’ finding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does going form 80% to 90% poor do to the risk of deriving false negative?

A

Halve, but need to increase sample size which increase cost and complexity of trial

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is narrative review?

A
  1. Brings together published literature into a single article enabling the reader to rapidly understand issues
  2. Sometimes referred to as a literature review, scoping review or non-systematic review
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a systematic review?

A
  1. Sets out highly structured approach to searching, sifting, including and summarising the literature
  2. Often presented as the basis for meta-analysis, but also exists separately
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the strengths of a narrative review?

A
  1. Agile, normally easier and faster to write; may often be more up to date than latest systematic review
  2. Particularly useful when looking at areas with limited research or in higher levels or variation in research approaches
  3. Can be useful where work from different discipline is being brought together with a less easily-answerable research question
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the limitations of a narrative review?

A
  • Subject to potential bias as
    1. Author free to select works (sometimes that may support their opinion): although ethical authors and robust peer review should prevent overly-speculative or unbalanced views
    2. With no search being specified it is possible that important evidence is omitted by chance (rather than. intent)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the strengths of a systematic review?

A
  1. Aims to collate all available evidence that relates to a highly focused research question
  2. Implements a highly specified protocol that enables reproducibility - this will usually involved a structured search
  3. ‘Includes’ evidence based on pre-specified criteria: inclusion criteria
  4. Can take many months to design the search, review all sources (often thousands) and then synthesise the findings
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What are the steps for a systematic review?

A
  1. Research questions
  2. Structured search
  3. Indices (categorise indices)
  4. Screening/inclusion
  5. Reporting
  6. Writing
  7. Submitting/revising/publishing
    - Can take 18-24 months
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is a structured search?

A
  1. approach enables transparency and future researcher to reproduce the approach
  2. Words and heading and apply to index e.g. med and give reproducible approach to finding literature
  3. Develop an approach and series of searches that combine later on and justify why used some articles and why omitted some
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Why are indices helpful?

A

It is always made clear which each indices were used and the time period involved (needs to be reproducible and transparent)

23
Q

What are indices?

A

based on published research

24
Q

What are registries?

A
  1. registration of research yet to be completed or published
  2. registries increasingly important to avoid duplication or omission
  3. interventional research register to prevent risk of publication bias (not reporting negative finding and over reporting positive findings )
25
Q

What is the screening process?

A
  • PRISMA diagram
    1. Identification
    2. Screening
    3. Eligibility
    4. included
26
Q

What does the screening process entail?

A
  1. How many articles found through initial search, or removed as duplicates
    Then look at abstract
    Then full text review
    And then how many studies included in meta-analysis
  2. Often systematic review will identify thousand of abstracts and articles in the early stages then like 10-30 in end as
    -very few may actually be revenant but applying inclusion and exclusion criteria is important to systematise the process
    -A PRISMA flow diagram often used to show the ’n’ at each stage
    2,500 down to 25
    -Find all evidence and then screen out the to get comprehensive review
27
Q

What are the limitations of a systematic review?

A
  1. Only as good as method employed: a less-than-comprehensive search structure may not return all the evidence
  2. Only as good as indices search
  3. Only as good as evidence it incorporates
  4. Very quickly. out of. date, often exacerbated by delay in publishing, look at search date not publication date
  5. Can take 18-24 months to. produce and a systematic review published only every 2-10 years
28
Q

What is grey information?

A

-Not. everything that is known is necessarily in the published literature: that has been reviewed and published within academic journals that can be searched via online indices

29
Q

What is an example of grey information?

A

government reports of evaluations of programmes

30
Q

When is grey information that makes up grey literature an issue?

A

In public health and global health areas, where many implementations and programmes might be reported but with varying degrees of accuracy

31
Q

How do you make decisions when so many papers are published every day?

A
  1. Narrative reviews and systematic review are helpful as starting point
  2. Can snow ball out from these reviews to find individual literatures
  3. Also look at more recent citations of these reviews using online indices
32
Q

What is a meta-analysis?

A

A quantitative, formal epidemiological study design used to systematically assess previous research studies to derive conclusions about that body of research

33
Q

What is the. relative risk?

A

numeral presentation of the finding which provides point estimate and confidence intervals around that which is the range of values of which we are 95% confident the true value/ point estimate lies

34
Q

What does meta analysis need?

A

requires that the pooled studies are sufficiently similar: or else you results are meaningless

35
Q

What are sources of heterogeneity in meta-analysis?

A
  1. Clinical: patients, selection criteria
  2. Methodological: study design, blinding, intervention approach
  3. Statistical: reporting differences
36
Q

Are there statistical ways of evaluating the heterogeneity between studies?

A

Yes

37
Q

When can meta analysis be limited?

A
  1. By quality of the studies included
  2. The statistical methods employed
  3. Often only possible after multiple interventional or observational studies have been undertaken
38
Q

What does a meta analysis need?

A
  • Almost always necessitates a systematic review to identify the papers/studies to be included in the estimates
  • Sometimes necessary to go back to original authors of included msyudieas to ask for more data, enabled the meta-analysis to be conducted
39
Q

What is another consideration in meta analysis?

A
  • Publication bias
  • Publication with more positive findings are more likely to be published by journals and more likely to be submitted for publication
40
Q

What is a publication funnel plot?

A

Can show the balance of evidence between studies assuming an overall effect size: more publications one side of lines may suggest that some studies may not have been reported

41
Q

What is the best thing for scientific evidence?

A

meta-analysis of randomised controlled trials

42
Q

What is a trial endpoint?

A

an outcome that usually describes a clinically meaningful outcome
e.g. cancer survival 12 months or 5. years

43
Q

What are two ways that trial outcomes can be determined?

A
  1. Efficacy – how well a therapy works in achieving a desired outcome
  2. Safety – how well a therapy works in not causing adverse events
44
Q

What is a primary endpoint in efficacy?

A
  1. the endpoint for which the study has been powered
  2. that is to say that the number of trial participants (sample size) will have been recruited on the basis of the pre-specified power and difference
45
Q

What is the secondary endpoint in efficacy?

A
  • common that a study will want to examine a slightly different endpoint in addition to the primary endpoint
  • E.g while a study seeks to examine survival often ‘softer’ - measure such as recurrence of disease or hospital admission might also be measured
  • If the secondary endpoint is proven but the primary endpoint is not, then the findings of the study may still contribute to the understanding of disease
46
Q

What are safety endpoints?

A
  1. potentially measuring commonly observed adverse events (AEs) and grading them into a hierarchy of significance
  2. A large proportion of patients reporting AEs will require investigation.
  3. Eventually a judgment will need to be made as to what extent the safety profile (or lack thereof) of a therapy is offset by the efficacy
47
Q

What is a composite endpoint?

A
  1. variation of the above and could potentially describe any endpoints - multiple potential endpoints have been added together
  2. particularly common when an outcome is uncommon
    - For example, one might combine myocardial infarction and ischemic stroke to give a new composite endpoint of ‘cardiovascular event’.
48
Q

What is survival analysis?

A
  1. for hazard ratio may happen at six months may not be the same at two years
    2 losing statistical precision by generating arbitrary timepoints
  2. If patient dies in 5 year (primary efficacy endpoint) then record when that death takes place so then range of survival times
  3. Compare likelihood of survival between two study. arms
49
Q

How do you represent survival analysis?

A
  1. The way that we display these findings is using the Kaplan Meier plot.
  2. On the Y-axis we have overall survival (OS)
  3. On the X-axis we have 60 months – that’s five years.
  4. The two coloured lines indicate the proportion of participant alive at any point in time
  5. You can see that at t=0, 100% of the participants were alive in either arm
    - Look at qs
50
Q

What is the alpha level?

A
  • Threshold for type 1 error

- How many type 1 error before rejecting null hypothesis

51
Q

Why do you want a lower alpha?

A
  • Harder to get false positives

- Ideal if severe consequences

52
Q

What is beta level?

A
  • Threshold our type 2 error

- Determines power of study = probability of getting a true negative

53
Q

How do you calculate power?

A

1-beta level so if beta 0.2 then power is 0.8 or 80%

54
Q

What is the relationship between beta and alpha?

A

Inversely proportional