Module 3 Flashcards

1
Q

What is QuODDID stand for?

A

Qu : Question of scientific interest

O; Outcome measures

D: Design

D: Data analysis

I: Interpretation

D: Dissemination

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the manual of operations?

A

A protocol/statistical analysis plan in which you write down exactly what you plan to do before beginning study. Document when and why you deviated from something

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Secondary questions involve _____(1) and can help paint a more complete picture of what’s going on.

A

(1) stratified subgroup analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are the three desirable characteristics of a research question?

A
  1. Relevant: Is the question related to the topic of interest?
  2. Precise: Is the population of interest specified? Is relationship of interest specified?
  3. Testable by the study: Can we actually assess and answer the question within our study

Remember: Can you Really Print That?
location: brody

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

A fuzzy research question can live one open to critiques about:

A
  1. Research methods not matching th question you intended to ask
  2. Methods selected to try and increase your chance of a significant finding after the fact
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What are the three desirable characteristics of outcome measures?

A
  1. Relevant
  2. Precise and accurate
  3. “Movable” : likely to be influenced by the interventions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Our ability to achieve accuracy and precision is impacted by _____(1).

A

(1) the level of granularity we use to measure things

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the difference between accuracy and precision?

A

Accuracy: All dots near the centre of the bullseye, but they are all not concentrated in one area.

Precision: All dots concentrated in one area but not near the centre of the bullseye

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

When we talk about precision and accuracy, what are the three methods we can use? Order them from best to worst.

A

Numerical measurement > ordered categories > binary categories

If we wanted to measure how fast someone could run:
1. Running speed
2. Is the subject fast/moderate/slow
3. Is the subject fast or not fast

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are the two types of study designs?

A
  1. Experiment: Assignment to treatment groups is controlled by the investigator
    - treatment assignment my be done using a randomized mechanism or not
    - treatment may be masked/blinded (single, double, triple) or not

2, Observational study: Assignment to treatment groups is not controlled by investigator. Participants usually self-select

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Who are the four stakeholders in experimental design?

A
  1. Investigator: Individual asking the question in design and designing the study to answer it
  2. participant: individual being observed to understand the impact of the intervention on the outcome measure
  3. Assessor: Individual evaluating the outcome measure for each of the participants
  4. Data analyst: Individual analyzing the data
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is single, double, or triple blinded?

A

Single: The participant doesn’t know which treatment group they are in. Assessor and data analysis know.

Double: Participant and assessor of outcome dont know which treatment group the participant was assigned to. Only the data analyst knows. This protects against assessor evaluating measures in a biased way

Triple: Assessor, participant, and data analyst dont know about treatment groups. This prevents bias from data analyst.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What are the two subcategories of experimental study design?

A
  1. Parallel group study: Subjects allocated to receive only one “level” of the treatment being compared. Comparison of outcomes is done ACROSS experimental units(people). Make comparison groups similar through randomization
  2. Cross-over study: Each subject gets multiple “levels” of the treatment. Comparison of outcomes is within experimental units(people). Each unit acts as “own control/comparator”. Randomization here occurs in terms of what treatment the groups receive first.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

In a cross-over study design, you no longer need to worry about comparing groups to groups. Comparison is within each participant. This minimizes _____(1) and there is thus less of a chance of _____(2).

A

(1) the external characteristics that can influence the primary relationship we care about

(2) confounders

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the challenge with cross-over studies?

A

WASH OUT

How do we ensure that the impact of the first exposure/intervention doesn’t linger and affect the outcome measure of their second exposure/intervention?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What two outcome measures did we use for the chocolate trial?

A
  1. Individual ratings for two chcolates
  2. Direct comparison of two chocolars
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a DAG?

A

Directed acyclic graph the illustrates relationships between various variables

18
Q

In a DAG, variables in rectangles are ___(1) while variables in ovals are ____(2)

A

(1) oberved/measured
(2) not

19
Q

In a DAG, lines(arrows) represents a _____(1) between variables.

A

(1) causal relationship

20
Q

Absence of lines in a DAG means _____(1) given the other vairbales

A

conditional independence

21
Q

Randomization can ____(1) from observed and measured variables, from unobserved and unmeasured variables, and even unknown variables

A

(1) mitigate confounding varibales

22
Q

What is the importance of removing confounding variables in an experiment?

A

Allows us to be sure that the associations we observe are reflective of the true relationship of the two variables we want to study

23
Q

In our chocolate trial, what were possible confounders and how did we remove them from out experiment?

A
  1. Tasting order
  2. Chocoholic gene
24
Q

When the outcome variable of interest is _______(1) instead of continuous, we talk about ______(2) instead of means

A

(1) dichotomous(binary)

(2) proportions

25
Q

How do you calculate the confidence interval for a single proportion?

A

Refer to module 3 cheatsheet in notes

just know how to calculate p hat, and be familiar with all the terms in the formula for SE

26
Q

How do you do a hypothesis test for a single proportion?

A

Calculate confidence interval as you would for a single proportion and then determine the all value and see if it is contained in the CI. If it is, then we fail to reject the null hypothesis

27
Q

The CI for a difference in proportions is used for questions that seek to compare groups and populations based on their proportions. How do you calculate the CI for a difference in proportions?

A

Refer to module 3 cheatsheet

28
Q

How do you do a hypothesis test for a difference in proportions?

A

Determine 95% CI for a difference in proportions and see if null value is contained within that interval.

29
Q

What is the three step process involved with hypothesis testing?

A
  1. Consider your research question
  2. Define null hypothesis
  3. Test you null using your observed data
30
Q

What is the Texas sharpshooter fallacy?

A

The name epidemiologists have given tot the tendency to assign unwarranted significance to random data by viewing it post hoc in an unduly narrow context.

31
Q

What is p hacking?

A

the misuse of data analysis to find patterns in data that can be presented as statistically significant

32
Q

What is the key idea behind multiplicity?

A

Events that are rare on an individual level are still likely to happen across a large group of individuals

33
Q

A type 1 error is rare on an individual hypothesis test, but ____(1) to happen at least once across a large group of tests.

A

likeyl

34
Q

Compare hypothesis generating vs hypothesis testing.

A

Hypothesis generating: Lots of questions, lots of tests

Hypothesis testing: few questions, few tests

35
Q

What are the bonferroni corrections?

A
  1. divide p-value by the number of comaprisons
  2. Or make a confdience interval
    thats like (100 - 5/(number of comparison)
36
Q

How would you do multiplicity problems

A

calculate the probability of the event happening independently and then apply a binomial distribution using that p value

37
Q

What is a confounding variable? Draw a diagram, and identify confounding, predictor, and outcome variables.

A

Look at diagram in the notes sheet

Factor Z would be a confounder if
- They differ between levels/categories of X
AND
- They have a causal relationship with Y

38
Q

What does it mean if something is stratified?

A

Creating subsets of the data and looking at data on those groups

39
Q

What is Simpsons paradox?

A

Simpson’s Paradox refers to a phenomenon in which a trend appears in different groups of data but disappears or reverses when these groups are combined. In other words, the overall percentages in two groups (the treatment and control groups) can be misleading because of a confounder.

Berkeley’s admission data is an example of Simpsons paradox

40
Q

What are two ways we control for confounders?

A
  1. “Control for” potential confounding variables: conduct out comparison of interest within confounding groups, like within a department fro the Berkeley admissions data or within a poverty group for our MSCD and medical expenditure question
  2. Design an experiment where the treatment and control groups are “otherwise similar” by design.
41
Q

What is effect modification?

A

Effect modification occurs when the effect of a single exposure on an outcome depends on the values of another variable

ex. in the chocolate trial it would be called effect modification if the effect of cocoa content on preference depends on a thrid variable

42
Q

Why is stratifying useful?

A

Reduce variance rather than bias

answer a secondary question of interest - stratify to look at difference in preference by third variable