Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

8) Analysis of Nutrition Data > Lecture 8: Hierarchies of Scientific Evidence > Flashcards

Lecture 8: Hierarchies of Scientific Evidence Flashcards

1
Q

What is the hierarchy of evidence?

A 
Meta analysis
Systematic review
Randomized controlled double blind studies 
cohort studies
case control studies 
case series 
case reports
ideas, editorials, opinions 
animal research 
in vitro research
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

How to select participants for a study?

A

o Participants recruited to represent a target population

o Can be randomly selected or selected based on specific exposure status or disease status

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are the possible timings for studies?

A

o “Prospective” - follows participants and observes exposure/outcome over time
o “Retrospective” – study begins and captures exposure/outcome that has already occurred
o “Cross-sectional”– study captures data at just one point in time
March 20th, 2019

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a prospective study?

A

follows participants and observes exposure/outcome over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a retrospective study?

A

study begins and captures exposure/outcome that has already occurred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a cross-sectional study?

A

study captures data at just one point in time

March 20th, 2019

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are cross sectional studies?

A
  • Observational study of a population (often selected for similar characteristic(s)) at one time point
  • Measures prevalence of an outcome
  • Collects information on exposure and outcome concurrently

EX: NHANES, CCHS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are the strengths of cross sectional studies?

A

Useful for developing hypotheses, discovering novel associations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the limitations of cross sectional studies?

A

Cannot establish temporal sequence between exposure and outcome, or causality.

Enables reporting of statistical associations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Prevalence vs Incidence?

A

Prevalence is the proportion of a population who have a specific characteristic in a given time period. Incidence in epidemiology is a measure of the probability of occurrence of a given medical condition in a population within a specified period of time. How many new cases of outcome over a period of time is incidence. The proportion of people who have the outcome at a certain time is prevalence.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are case control studies?

A
  • sample selection is based on disease status
  • cases and controls are usually matched for a number of characteristics (sex, age, presence of other conditions/disease)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the strengths of case control studies?

A
  • relatively efficient and inexpensive
  • more suitable to study fewer common disease/outcomes
  • allows multiple exposures to be studied.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the limitations of case-control studies?

A
  • only one outcome can be studied
  • temporal sequence difficult to establish
  • prone to recall bias
  • observational in nature.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is recall bias in case control studies?

A

Recall bias –> unique to case control studies. When they don’t really remember what they eat like if you ask a middle ages person what they were eating in high school. This is not exactly recall bias. Recall bias is something about the disease status that is affecting how the cases are recalling information. They might say they had a less healthy diet than they actually did bc they are biased by their disease status. Really difficult to control for this.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are cohort studies?

A

observational study that prospectively follows a group over time, some will be exposed to a risk factor and some will not (or high vs low exposure)

involves repeated measures of variables over time in the same individuals (sometimes over decade)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What are the strengths of cohort studies?

A
  • enables study of natural progress of outcome/disease
  • multiple outcomes can be incorporated
  • temporal sequence is established
  • allows measurement of incidence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What are the limitations of cohort studies?

A
  • inefficient for studying rare diseases
  • expensive and time-consuming
  • difficult to maintain cohort (loss to follow up)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Why are drop-outs problematic in cohort studies?

A

There might be differences between people who chose to not continue the study and people who stay in the study. When people drop-out of the study, it can bias the data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are randomized controlled trials?

A
  • gold standard of clinical trials
  • test efficacy of intervention on a population of interest
  • placebo compared with a treatment
  • causality can be determined
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

How is randomization beneficial?

A

randomization improves the design of the study because it controls for confounders which lets you determine causality bc you for sure know that there is no other confounders in this relationship

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is the reporting diagram that should be followed with RCTs?

A

CONSORT

Consolidated Standards of Reporting Trials

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is randomization?

A

Evenly distributes exposures of known and unknown factors that might affect study outcome.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What is blinding?

A
  • used to avoid bias in favour of an anticipated effect –> from study participant or researcher who is performing the measurement
  • “double blind” indicates that neither participant nor the investigator is aware of whether the participant is receiving the treatment of the placebo
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Is blinding possible in nutrition research?

A

It is possible but very hard to do because if the participant is following a fat free or high fat diet, they can tell the intervention but the researcher or the data analyst can be blinded for it. It is easier to do it for supplementation studies.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is the hierarchy in reviewing evidence?

A
  • narrative review
  • systematic review
  • meta-analysis
26
Q

What is narrative review?

A

A literature review or narrative review is a type of review article. A literature review is a scholarly paper, which includes the current knowledge including substantive findings, as well as theoretical and methodological contributions to a particular topic.

  • potential for bias
  • pick and choose articles (there is no systematic way of choosing articles)
27
Q

What is systematic review?

A

Systematic reviews are a type of literature review that uses systematic methods to collect secondary data, critically appraise research studies, and synthesize findings qualitatively or quantitatively.

28
Q

What is meta analysis?

A

the statistical analysis of a large collection of results from individual literature for the purpose of integrating their respective findings.

29
Q

What are the two purposes in combining data from independent clinical studies?

A
  1. Determine if a similar treatment effect exists for an intervention examined in independent studies. If so, can estimate net effect of the intervention
  2. If treatment if not similar across studies, can examine factor that may explain differing effects.
30
Q

What are the limitations overcome by meta-analysis?

A
  • small sample size in clinical trials (type II error)
  • increase precision of estimates
  • resolve discrepancies
  • observe if effects are similar or different across different subgroups (e.g. clinical populations, treatment duration, treatment dose)
31
Q

True/False

Meta analysis can be done on observational studies

A

True

Most people think that meta-analysis looks at only intervention studies which will show an effect, but you can do meta-analysis on observational studies and look at associations.

32
Q

What are the steps in meta-analysis?

A
  • formulate a research question
  • define eligibility criteria
  • identify studies and extract data
  • statistical analysis which include:
  • obtain measure of treatment effect for individual studies
  • combine studies for a measure of overall effect
  • assess study heterogeneity
  • assess publication bias
  • optional: perform subgroup analysis
  • report and interpret results
33
Q

What is the PRISMA statement?

A

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

  • initially published in 2009, updated in 2015 with new extensions
  • PRISMA network is when you are doing a meta-analysis that looks at different interventions for one treatment. Which one is the most effective? You see this a lot in pharmaceutical industry and not in nutrition really?
34
Q

How to formulate a research question?

A

PICO/PECO

35
Q

What does PICO/PECO stand for?

A

P problem
I/E intervention or Exposure
C comparison
O outcome

36
Q

Where to register a systematic review protocol?

A

PROSPERO

37
Q

What is on the PRISMA checklist?

A 
Title
Abstract 
Introduction
Methods
Results
Discussion
Funding
38
Q

How to measure the treatment effect for individual studies?

A

Report or compute results from individual studies:

  • means (standardized) and standard deviations
  • odds ratios or relative risk and confidence intervals

Weights applied to individual studies

  • Generic inverse variance method (1/var)
  • Larger studies assigned higher weights than smaller studies.
39
Q

How do you apply weights to individual studies?

A
  • Generic inverse variance method (1/var)
  • Larger studies assigned higher weights than smaller studies.
  • it is really based on sample size
40
Q

What are the two types of overall effect when combining studies for measure of overall effect?

A

fixed effects: assume all studies are evaluating one true underlying effect

random effects: assumes that studies are evaluating underlying effects

both analyses output Z score, p-value, overall RR and 95% CI

41
Q

What is fixed effects?

A

assume all studies are evaluating one true underlying effect

42
Q

What is random effects?

A

assumes that studies are evaluating different underlying effects

43
Q

How to assign weights to individual studies with fixed effects?

A

1/var

44
Q

How to assign weights to individual studies with random effects?

A

1/(var + t)

45
Q

What are the differences in assigning weights to individual studies in random and fixed effects?

A

Statistically we are doing the same thing, but the random effects model is more conservative. The constant t will be decided by the data analysis program depending on the CI and variabilities of the individual study results.

46
Q

How to interpret a forest plot?

A
  • each study is individually listed with their number of participants and relative risk (outcome measure or effect size)
  • the box is the actual relative risk for these individual studies and the size of the box corresponds to the study weight with largest sample size.
  • the whiskers on the boxes represent the confidence interval/variability of the study. If the confidence interval is wide, then that is an indication of imprecision of int he estimate.
  • the dashed line in the middle is the null value. Relative risk of 1 means that there is no significant difference. RR>1 adverse association, RR<1 protective effect.
  • the diamond is the pooled effect and if it crosses the null then, there is no significant association.
  • there is no whiskers on the diamond but the diamond itself is and indication of the confidence interval.
47
Q

How to determine the heterogeneity across studies?

A
  • look at the forest plot and where each study stands
  • Cochran’s Q statistics
  • I squared statistics
48
Q

Explain the Cochran’s Q statistics for heterogeneity?

A
  • chi squared test (p<0.05, reject null)
  • test for lack of heterogeneity
  • a significant Cochran tells you there is heterogeneity across studies
49
Q

Explain the I squared statistics for heterogeneity?

A
  • Ranges from 0-100% (<30% mild, 30-50% moderate, >50% substantial)
  • quantifies heterogeneity
50
Q

What type of biases does Cochran’s Risk of Bias Tool look at?

A
  • selection bias
  • performance bias
  • detection bias
  • attrition bias
  • reporting bias
51
Q

What is publication bias?

A

studies with statistically significant results are more likely to be published
- results of meta-analyses could overstate the effect of an intervention

52
Q

How to reduce publication bias?

A

aim to include unpublished data in meta-analyses (difficult to locate)

53
Q

What are the ways of evaluating publication bias?

A

funnel plots and egger’s linear regression test

54
Q

What are funnel plots?

A
  • asymmetric plot suggests studies with negative results are missing from the literature
  • asymmetry could be due to other factors (selective reporting)
  • the most precise studies are on the top of the triangle
55
Q

What is Egger’s regression test?

A
  • Plots the precision of the studies (weighted) against the standardized effect
  • Regression line originates at the zero point if publication bias is not present (also will get a non-significant p value for beta)
56
Q

What is subgroup analysis?

A

pool results in subset of study participants (e.g. disease status, men/women, duration of study)

57
Q

What are the criticisms of meta analysis?

A
  • comparing apples and oranges?
  • quality of meta-analysis only as good as the quality of the individual studies included
  • some argue that the most important advantage of a meta-analysis is the ability to assess why different studies produced different results rather than providing an ability to calculate a pooled summary of treatment effect
58
Q

What were the findings of Tsilas et al. article?

A

No significant effect between total sugars or fructose in type 2 diabetes but a significant protective effect of sucrose (relates to the purpose of the study was done). The authors commented on this: all sources of sugar in the diet are important to think about. Whole grain, yogurt etc. a lot fo them are sweetened with sucrose and in the results it shows that sucrose has protective effect towards type 2 diabetes. Competing interest, other nutrients in these foods. Reverse causality argument. maybe participants were who have risk of type 2 diabetes so they preferred to avoid these sugars.

59
Q

What is competing interest?

A

A competing interest is anything that interferes with, or could reasonably be perceived as interfering with

60
Q

What is reverse causality argument?

A

Reverse causation (also called reverse causality) refers either to a direction of cause-and-effect contrary to a common presumption or to a two-way causal relationship

8) Analysis of Nutrition Data (11 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions