Error & Bias in Epidemiological Studies Flashcards
How are the 2 types of error related to precision and accuracy?
- RANDOM ERROR due to chance has low precision but is accurate
- SYSTEMATIC ERROR not due to chance has low accuracy but is consistent (has a bias)
What is accuracy? Bias?
ACCURACY = whether there is agreement between a measurement made on an object and its true value
BIAS = difference between the average measurements made on the same object and its true value (not accurate = bias)
What are the 3 major types of bias?
- SELECTION BIAS - related to procedures used to selec units for the study —> study groups differed from source population
- INFORMATION BIAS - misclassification related to the information recorded for the study where units are incorrectly assigned positive/negative exposure or disease
- CONFOUNDING BIAS - some other factor changes or distorts the effect of exposure on the outcome (diseased vs. non-diseased)
What are the consequences of bias like in descriptive and explanatory studies?
DESCRIPTIVE = outcome only affected —> higher or lower estimates of disease frequency
EXPLANATORY = outcome and explanatory variables taken into account —> altered disease frequency moves effect estimate towards or away from the null (no statistical difference)
What does it mean to move toward or away from the null? Which is better?
TOWARD = bias causes the study to observe no real effect of exposure/risk factor on disease status
AWAY = bias causes the study to observe that exposure/risk factors have more effect on disease status than they actually do
TOWARD NULL - better to underestimate and do further studies
How is magnitude of bias calculated?
difficult —> sensitivity simulations can help
What is surveillance bias?
selection bias where mild/subclinical disease is more likely to be detected in animals under frequent medical surveillance and/or enrolled in surveillance programs
What is referral bias (admission risk bias/Berkson’s fallacy)?
selection bias where differential referral patterns are a source of bias in hospital-based case-control studies
- is the hospital population representative of the whole population?
- socioeconomic representation in hospital population
What is non-response bias?
selection bias where >20-30% of non-responses or refusal to participate in a study may contribute a bias
- only accounts for passionate people in the study
- high overall response = less bias
What is missing data bias?
selection bias where >20-30% of data is missing and an accurate result cannot be attained
- not enough serum from blood draw to run a test
- missing data does not confirm non-diseased state
What is loss to follow-up bias?
participants are dropping out of a study, which can alter the new group, making them less representative of the actual population
What is selective sentry (survival) bias?
traits are naturally selected when choosing a group of subjects and treatments that prolong lifespan increase prevalence of disease
- “healthy worker” effect in occupational health studies - those working tend to be more healthy than unemployed
In what 4 ways can selection bias be reduced? How can it NOT be corrected?
- random sampling - assesses probability of bias by distributing risk factors equally between groups
- maximize response rates - questionnaires are enticing to get more participants to respond
- minimize withdrawal rates - keep participants in study
- ensure equal responses/withdrawals from exposed/non-exposed and diseased/non-diseased
analytical techniques
How can selection bias be reduced in observational studies?
consider the forces at play with selecting individuals
- case-control: use incidental cases and get controls from the same source population as the cases
- cohort: persistent follow-up with creative strategies for maintaining full participation
How can selection bias be reduced in controlled trials?
RANDOMIZE allocation to intervention and comparison groups and BLIND recruiters and participants to allocation (exposed vs non-exposed), while minimizing withdrawals and maximizing retention
(randomize and blind…everything should be fine)
What is recall bias?
information bias where cases are better at recalling past exposure compared with non-cases
- Salmonella + cases are likely to remember what they last ate compared to Salmonella - cases
What is interview bias?
information bias where interviewers are privy to the hypothesis under investigation
- more likely to ask leading questions to support hypothesis
What is obsequiousness bias (Clever Hans effect)?
information bias where subjects systematically alter responses toward perceived desirable answers
- people commonly change answers based on welfare and hygiene/sanitation based on what should be
- Hans was a trained horse who could supposedly perform arithmetic, but it was found tat he was getting non-verbal cues from his trainer on when to stop stomping his hoof
Selection and information bias re-cap:
How do confounders compare to outcome and exposure?
causally associated with the outcome in non-exposed animals
non-causally associated with exposure and both are on 2 separate causal pathways to the outcome
Age-specific comparison of death from all cases for Tolbutamide and Placebo treatment groups:
- OUTCOME: survival during follow-up period = 409
- EXPOSURE: treatment (Tolb. [204] vs Placebo [205])
- CONFOUNDER: age (< 55y = 226; >55y = 183)
How can it be confirmed that age is a confounder?
- must be associated with the outcome in the non-exposed: 18.8 > 4.2 RR in placebo groups
- must be associated with exposure: despite randomization, there was still a difference of age by treatment (<55y on Tolb = 52%; <55y Placebo = 59%)
- must be on separate causal pathways: drug doesn’t change age of participants
How can you decide what RR to report on studies with confounders?
compare difference between Mantel-Haenszel combined OR of strata of confounders and the crude OR
- > 20-30% = significant confounder, should report combined OR
- <20-30% not significant and can report the RR of all participants
Tolbutamide and death study, Mantel-Haenszel vs crude OR:
What is the best way to control confounding bias? What are 3 examples?
ANALYTICAL MODELS
- standardization (human) - adjustment to an external standard
- STRATIFICATION - analysis within each strata separately and use Mantel-Haenszel to make a summary across strata
- MULTIVARIABLE - control for multiple factors using linear (continuous) and logistic (dichotomous) regressions
How does confounding compare to interaction?
CONFOUNDING = third factor distorts the true underlying relationship between an exposure and an outcome
INTERACTION = third factor is necessary to explain the relationship between exposure and outcome - outcome DEPENDS on both exposure and interaction factor
What are the 2 types of interactions?
- synergistic (positive) - joint effect is greater than the sum of independent (factor) effects (E + I = greater O compared to no I)
- antagonistic (negative) - joint effect is less than the sum of independent factor (E + I = less O compared to no I)
Interaction of Neomycin (G-) and Cloxacillin (G+) usage on Nocardia infection (G+):
Interactions vs. Confounding:
What results should be reported?
p > 0.05 —> HOMOGENOUS = no interaction, may be confounding
crude vs. M-H = (1.56 - 2.32)/1.56 = 0.487 = 48.7%
- > 20% = confirmed confounder, report summary measure of association adjusting for the presence of the factor - 2.32
What results should be reported?
p < 0.05 —> HETEROGENOUS = interaction
report separate measures of association for each level of the factor - 0.67 for puppy, 2.22 for adult —> age interacts with food to cause obesity
What results should be reported?
p > 0.05 —> HOMOGENOUS = no interaction, may be confounding
crude vs. M-H = (1.56 - 1.63)/1.56 = 0.045 = 4.5%
- < 20% = factor is not a confounder and can be ignored to report the crude OR - 1.56 (no significant difference compared to 1.63)
