Final Flashcards

1
Q

Logic most closely associated with the scientific method

A

Abductive

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What best defines the scientific method?

A

Proposes useful or predictive claims about the world and tests them by experience

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Hallmark global research study of the scientific method

A

Interventional study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What does random allocation in large research studies minimize?

A

Confounders

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Least likely to be a part of exploratory data analysis

A

Confidence intervals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

2 major types of data analysis in quantitative research studies: confirmatory and exploratory. What best characterizes the aim of exploratory data analysis?

A

Present the data in open-minded ways that reveal what the data might mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Probabilistic thinking comes into play in biomedicine most frequently when?

A

Two or more factors have a conditional relationship

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

2 major concepts commonly used in biomedical statistics

A

Central tendency and error analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Research design is biased under what conditions? (Review)

A

Design systematically favors one or some study outcomes over other outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Generally the most informative measure of error in a data set

A

Confidence interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Observational research studies lead to:

A

Correlations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What makes interventional research studies so powerful?

A

Order-dependence of intervention and outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Hypothesis-driven research cannot be?

A

Qualitative

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Common passageway from qualitative to quantitative studies:

A

Propositions from qualitative study are refined into hypotheses for quantitative study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Hypothesis generation is best characterized by

A

Imaginative combining of thoughts to explain a problem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What makes a hypothesis potentially innovative rather than simply new?

A

Hypothesis supported by test outcomes has implications far beyond originating field

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Simply pointing out a high correlation between selected factors are too frequently interpreted to be in a cause and effect relationship. This can be due to our minds being predisposed to?

A

Predict the future given the presence of one of the two factors in question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Factors A and B are known to occur independently of each other in each of the 50 US states. You observe factors A and B to be highly correlated in California but independent of each other in Iowa. Which of the following would be the most likely explanation for your observations?

A

A and B in California are each caused by C, but C is absent in Iowa

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

In interventional studies, the intervention is presumed to be…?

A

Cause

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

The best clinical research design is the Randomized Control Trial (RCT). At the heart of RCTs is an intervention and an outcome of interest. What is the logical role of the intervention in RCTs?

A

Presence of the intervention is a predictor of the outcome

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Baseline rate is determined in what design part of a research study? (Review)

A

Control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

The gold standard in research design = Randomized Control Trial (RCT). The design features to real with confounding factors that might contribute to the outcome. In an RCT, what gets randomly allocated?

A

Intervention & the control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Synonyms for causes and effects in research studies

A

Explanatory & response variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

At best, the findings of an observational study are

A

Necessary but not sufficient to establish causal relationships

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is a statistical factor altering precision in parameter measures?

A

Stochastic noise

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

Central tendency = a statistical analysis that determines a single or point value as representative of an entire data distribution. What is a advantage and a disadvantage of the mean versus the median as a measure of central tendency of a data set?

A

Easily calculated as arithmetic average and more sensitive to extreme values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

A great way to visualize both the central tendency and spread in a data set?

A

Five number summary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

Research studies are complex with lots of design, performance, and outcome parts. In published biomedical research studies, what is ultimately the most important outcome?

A

Effect size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is a statistic to analyze variation in measures of 2 categorical variables?

A

Chi-square

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

All research except qualitative studies generates results on a single group or multiple groups of events, objects, or subjects that can be quantified. When analyzing sets of quantitative data, what is usually the most important?

A

Differences between means

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

Statistical analysis of a categorical study of two groups needs how many cell counts of data?

A

4

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

Sensitivity and specificity are key concepts in understanding false discovery rates in screening tests. These tests can be in the context of basic science assays or clinical diagnostic tests. Which concept refers to true positives and which concept to true negatives?

A

Sensitivity refers to the true positives and specificity refers to the true negatives

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What do a coin toss, dice throw, and dealt cards from a shuffled deck share?

A

The specific outcome is unknowable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

Probabilistic thinking is very important to evidence-based medicine on an everyday level. This way of decision making relies on the strength to which two or more features are correlated or independent of one another. If 2 independent events each has a probability of 0.7, what is most likely?

A

Both events will occur together less than half the time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

Student’s t-test is a simple statistical test to determine the likelihood that…?

A

Random variability linked to your measures can account for your research study results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Statistical tests are not generally intuitive which leads to a lot of confusion as to what these tests tell us about research measures. The concept and meaning of values of p-values are not well understood generally, including by investigators who use p-values routinely, but must be if we are to decrease the rate at which we publish research studies that turn out to be false. A student’s t-test in a study giving a p-value of 0.001 means…

A

Difference between means has a 1 in 1000 chance of being random variability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What best conveys the magnitude of the outcome of interest important to the research study?

A

Mean differences or correlations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What concept is now used to indicate how likely the mean is what you think it is? (Review)

A

Confidence interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What combined with the p-value can indicate how likely your hypothesis is false?

A

Prior probability from other studies

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What accounts for the assessment that most claimed research findings are false?

A

Most experiments are under-powered and p-values acceptable for publication too low/high(?)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What do interventional studies research?

A

Cause of an outcome of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

Aim of an intervention research design is consistent with…?

A

When a factor is removed from the study, the outcome goes away

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

Critical advantage of an RCT study over all other designs is…?

A

Confounding factors influence on outcome differences across groups is minimized

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

Exclusion and inclusion criteria aim to optimize the possibility that…?

A

Intervention and control groups begin with the same prognosis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

It’s often key to design and perform case-control studies so…?

A

Past conditions of exposure to harm are similar for cases and control subjects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

A major limitation of case-control studies of decades-long exposure harm

A

Recall bias with subjects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

What distinguishes a cohort from a case-control study?

A

Outcome is absent at the beginning of a cohort study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
48
Q

In a cohort study design, what are the minimal cohorts and their outcomes?

A

Exposed and not exposed at start and disease and not disease at end

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
49
Q

Which of the following is methodologically similar to basic science hypothesis testing?

A

Diagnostic testing

50
Q

In diagnostic testing, sensitivity and specificity refer to…?

A

Fraction of sick people correctly identified as having the condition and the fraction of healthy people correctly identified as not having it, respectively

51
Q

Which medical topic is inappropriate to investigate by randomized controlled studies? (Review)

A

Harm exposure

52
Q

2 most important endpoint questions for studies about therapy

A

How large was the treatment effect and how precisely it was measured

53
Q

In prognostic research studies, what issue comes into play for disease whose onset have long latencies?

A

Bias due to subjects lost to follow up

54
Q

In research studies on prognosis, what is a major goal?

A

Help clinicians make the right treatment decisions

55
Q

Major difference between a systematic review and a meta-analysis

A

Data from different studies are statistically aggregated in meta analysis

56
Q

Which of the following biomedical concepts are unique to meta-analyses?

A

Independent study results are combined, converged, or both to advance findings

57
Q

What part of a study design should include the cause of the biomedical process investigated?

A

At risk group

58
Q

FINER framework for creating research questions

A
Feasible
Interesting 
Novel
Ethical
Relevant
59
Q

PICOT framework for creating research questions

A
Patient/problem/population
Intervention 
Comparison
Outcomes
Time
60
Q

What is excluded from qualitative study designs?

A

Variables

61
Q

Major factors in study designs providing strong evidence in support of a hypothesis

A

Temporality and dose response relationships between the candidate cause factor and the candidate outcome measure

62
Q

Student’s t-test is a relatively simple statistical test to determine the likelihood that…

A

Random variability linked to your measures accounts for your research study results

63
Q

P- values

A
  • Are calculated based on the assumptions that the null is true for the population and that the difference in the sample is caused entirely by random chance => p-values can’t tell you the probability that the null is true or false bc p-value is the probability that the null hypothesis is 100% true
  • Even low p-values cannot exclude the null hypothesis in a absolute sense. While a low p-value indicates that your data are unlikely assuming a true null, assuming a true null, it cannot evaluate which of the two competing causes* is more likely:
  • the null is true but your sample was unusual
  • the null is false
  • Medical literature in general is more and more emphasizing confidence intervals and effect sizes over p-values!
64
Q

2x2 table concepts

A
  • Sensitivity: the test’s ability to identify true positives
    TPR = TP/P = TP/(TP+FN)
  • Specificity: the test’s ability to identify true negatives
    TNR = TN/N = TN/(TN+FP)
  • Accuracy: combines above as follows
    Accuracy = TP+TN/(TP+FN+TN+FP)
  • Positive predictive value of test is how likely a positive from this specific test going to actually be a true positive
    PPV = TP/(TP+FP)
65
Q

In scientific communications, the rationale of the study is?

A

Often assumed by authors & not easily grasped by non-experts in the field

66
Q

What best conveys the magnitude of the outcome of interest important to the research study?

A

Mean differences or correlation coefficient

67
Q

Hypothesis generation classically is best defined by which of the following?

A

Preparation of precedence, incubation, and illumination

68
Q

Broad goal of an interventional study

A

Test for cause and effect relationships between measured outcomes and their causes

69
Q

5 numbers of box plot often featured in exploratory data analysis

A

Minimum, maximum, median, first quartile, and third quartile of a data

70
Q

What part of research study data results in probabilistic thinking being necessary?

A

The outcome being measured can be conditionally dependent on the independent variable

71
Q

Example of a biased sample in a research study

A

You set out to find whether all people like you and you report on only the people who do

72
Q

What kind of research is better done using an observational study design?

A

Research on a topic whose investigation by an interventional study would be unethical

73
Q

What broadly distinguished qualitative, opposes to hypothesis-driven studies?

A

Discovers, describes, and aims to understand psycho-social dynamics and meanings

74
Q

What makes a question a scientific hypothesis?

A

Testable by experience in a way that it is possible to be excluded

75
Q

Taking an exploratory data analysis approach to see if there’s any pattern of association between values from 2 parameters from an observational research study, you plot the values on the scatter plot. What are the most important questions to ask when looking at all scatter plots?

A

Do the data points linearly align? If so, is the line sloping upward or downward?

76
Q

To provide sufficient evidence supporting a cause and effect relationship between two quantitative variables, values of the outcome of interest variable is measured under what conditions of the candidate cause variable?

A

Comparative conditions of absence, varied amount, concentrations, or frequencies

77
Q

Baseline rates are important to understand whenever doing an interventional study bc the rate might be contributing to the measured effect. When should you control for baseline rate effects by making multiple outcome measures in the absence of the intervention?

A

In parallel with and before and after the intervention if applied

78
Q

You are reading a study that uses an observational study design to look at how feeding school children big breakfasts lowers obesity. The study looked at households in New York City only surveying the weight of school children and the size in calories of their breakfasts over a five-year period. The study’s chief finding made headlines because it was surprising and seems counter-intuitive. Which of the following about the study is most likely to be true?

A

Study is an observational study and therefore on its own the findings of cause are flawed

79
Q

You are the analyst collecting data from 100 international hospital sites each studying the exponential decay of tumor mass after applying a promising anti-tumor immunotherapy by plotting the size of the tumor by invasive imaging each week over the course of the six month study. Each site reports weekly to you the mean size of 100 or more of its patients’ tumors, with each patient’s tumor normalized to the initial size immediately before the drug intervention. Each week, the means of the fractional size of the tumors from the 100 hospital sites should show what kind of frequency distribution?

A

Normal

80
Q

Robustness is an important concept in EDA and descriptive statistics referring to measures of central tendency and spread in a data set or in multiple data sets being compared and contrasted. Which of the following are the most complete and robust measures characterizing data sets?

A

Median and inter-quartile range

81
Q

A data set of values of a single qualitative variable provides what kind of information?

A

Frequency of cases in any of two or more categories

82
Q

Two by two frequency tables can be used to compare?

A

2 categorical variables

83
Q

The fact that most diseases are rare tells you that:

A

A positive diagnostic test result is likely to be false

84
Q

Student’s t-test is a statistic that is one of the most common procedures in science and medicine. The t-test is the most common statistic of significance used when comparing the mean of two samples of quantitative, normally distributed data sets. The t-test provides statistical analysis of the difference in sample means normalized to the standard error of difference of sample means. The numerator relates to the explanatory variable, whereas the denominator relates to the random noise in the study results. The t-test is special and distinct from other statistics, in particular as opposed to the z-statistic or other statistics, because the t-statistic is valid for small samples. What is the n number of independent samples in a study where the t-test should be used to analyze the probability of the difference between the means of two samples being due to chance alone?

A

4-30

85
Q

When presenting figures showing analysis of your data, the 95% CI is preferred over the range, SD, and SE assessing your data values because:

A

CI is an easily understood indicator of how precise the mean of the values was determined

86
Q

What does the ‘p’ in p-value stand for and the numeric value indicate?What does the ‘p’ in p-value stand for and the numeric value indicate?

A

‘Probability’ of random variation accounting for the difference observed in test versus control cases

87
Q

What are likely the best sources for evidence supporting best clinical practice and what makes them so?

A

Biomedical journals reviewed by fellow clinicians and scientists published based on strength of evidence and reasoning

88
Q

Without a well-formulated question, we are likely to search data bases for:

A
  • Hours or even days
  • The too good to be true
  • Irrelevant facts and figures
  • Wherever it may lead, and more
89
Q

The time and effort spent searching data bases for biomedical articles can be cut ten-fold by first choosing to search based on:

A

Specific kind of clinical article specified by descriptors of the relevant type of clinical question

90
Q

At the stage of analyzing and evaluating the one or the few articles that survived your triage in Critical Appraisal, answering facets of your major formulated question and associated questions can be easier, faster, and more effective, taking advantage of the fact that:

A

Answers to the types of questions you will need to answer are located in typical sections of the article

91
Q

What would have been the Odds Ratio if the women in Europe aged 50-80 years on the combination drug therapy with hip fractures were 100 and without hip fractures were 1500, and what does that tell you about the influence of potential inaccuracy in the recording or reporting of the presence or absence of hip fractures due to recall bias or confounders?

A

Use of the combination drug therapy reduced the likelihood of hip fracture by 33% and the likelihood is very sensitive to misclassification of rather few subjects compared to the total subjects in the study

92
Q

What is the major distinction making Cohort studies at least by design better than Case-Control studies?

A

Cohort studies are prospective with participants not having the disease or medical condition at the onset of the study

93
Q

The Scientific Method is a strategy for generating new knowledge about the universe and features as part of its process tests by experience. You have a claim about say how the body works and you test that claim in the real world. If the results of the test exclude the claim, you discard it and find another. If the results of the test support the claim, you continue to use it and test it. In this process, what are the major cognitive steps?

A

Imaginative hypothesis generation and critical reasoning

94
Q

Medical outcomes are generally far more complex than those from basic science experiments. Large drug trials, for example, have a number of variables involving everything from the design of the trial to what often can be a wide range of differences in the patients enrolled. When comparing the outcome of a drug trial on patient groups, what can be difficult or impossible to know yet alters outcome measures?

A

Confounding factors

95
Q

Unlike Confirmatory Data Analysis (Statistical Hypothesis Testing), Exploratory Data Analysis embraces the 3 principles of critical reasoning. What principles are embraced by the Exploratory Data Analysis?

A

Analyzing the distribution of the data while suspending judgment as to the conclusion

96
Q

When one thinks of statistics in research studies, one often thinks of p-values. After all, they are nearly ubiquitous in published studies. The p-value quantifies the probability that the data in question can be the result of random variability alone. It doesn’t at all address the formulated research question or hypothesis being investigated. What could be combined with the p-value and would assess the likelihood of the hypothesis being tested in one’s research study?

A

Prior probability calculated from previous experiments or observations related to study

97
Q

When teachers and students are asked what is critical thinking, most typically, they go on for many minutes describing it. In a few words, how would you define critical thinking or critical reasoning?

A

Analyzing, evaluating, & integrating

98
Q

A common source of problems at the level of design originates from investigators using a “convenience” sample. This is a strategy to generate so that the data are robust. However, typically, these studies take the form of first presenting an issue of broad appeal then giving people in a high traffic area (popular internet site or place on campus) the option to take the survey. What is the likely source of bias in this approach?

A

People who are highly opinionated will be over-represented in the survey results

99
Q

In Study I, subjects were exposed to a naturally occurring environmental factor that is thought to block development of disease X in region I. The factor is absent from region II where disease X has its usual high prevalence. Study II was in region II where the isolated factor was given or not as interventions and disease X monitored. Given limited resources, what study design feature would cause you to choose Study I or Study II to determine whether the environmental factor prevents disease X?

A

Exposure of factor to a given subject is known and potential effect measured shortly after

100
Q

Francis Bacon, often referred to as a pioneering philosopher of the scientific method, did much to define its underlying logic. However, which of the following was the one most critical component that Bacon said little if anything about?

A

Interleaving of free imagination with coherent reasoning on the object of investigation

101
Q

What features are the most important advantage of interventional designs over observational design in research studies?

A

Multiple comparator groups to determine primary intervention effectiveness (?)

102
Q

What are major components to a logical argument that results from applying the scientific method?

A

Evidence from testing the hypothesis in experience

103
Q

Center stage in quantitative research are measures of how dispersed values in a data set are from its average value. Dispersion from the average value tells you about:

A

Confidence in its precision and likely distinctness from the average value of other data sets

104
Q

What are major advantages of using graphs that display box plots of a quantitative outcome for each of multiple qualitative explanatory variables in a quantitative research study?

A

Central tendency in the median and spread in interquartile range for each data set and visual comparisons and contrasts of medians for effect sizes and interquartile range for preciseness of measures across all explanatory factor variables

105
Q

What distinguishes qualitative research and qualitative variables?

A

Qualitative research has no numbers that are mathematically meaningful. Qualitative variable data has the number of cases, which are mathematically meaningful, which are scored for each category of the qualitative variable

106
Q

The first and most important step in scientific thinking, in contrast to pedestrian thinking, is to test whether your explanatory factor variable and your outcome variable are coincidental. Think of it as testing for the null hypothesis for causality in quantitative research. What do you need to test for independence in your data?

A

All cases when both, the one or the other, or none of your variables were present

107
Q

What are the reasons why a patient who tests for positive for a disease does not necessarily have a 100% probability of actually having the disease?

A

Diagnostic tests have a significant rate of false positives

108
Q

The student’s t-test boils down to a ratio of what statistical variables over what other statistical variables?

A

Effect size normalized by a weighted average of experimental error

109
Q

What is a strength and a weakness inherent with the one-way ANOVA statistic?

A

Allows statistical comparisons of two or more data sets but it does not itself indicate which pair(s) of data sets are likely to have real differences in means

110
Q

What are the advantages of presenting estimates of variability of a research study by 95% confidence intervals rather than p-values?

A

CI’s are straightforward visual and conceptual relationship to the point estimate of the central tendency of the data set(s)

111
Q

Why do physicians make sure that they know the epidemiology of the diseases in his/her area of practice?

A

A centerpiece of epidemiology is the prevalence, which is important in properly interpreting diagnostic test results

112
Q

When reading the primary biomedical literature, physicians & scientists should be?

A

Skeptical

113
Q

As a future clinician, scientist, or clinician-scientist, how many articles do you think will be published in your area of specialization per week?

A

100 or 1000(?)

114
Q

Given the deluge of daly publications in biomedicine, what will be your primary strategies to ensure that you learn important advances in your field for your patients and research?

A

Structured approach based on a structured question and study designs and types appropriate to that question

115
Q

What are major divide and conquer strategies associated with critical appraisal of the biomedical literature?

A

Investigate the type of research designs & study designs that are most relevant to your structured question

116
Q

What are over-arching topics to analyze and evaluate in any grant, publication or scientific dialogue?

A

Claim, Rationale, Evidence, Alternatives, Meanings

117
Q

After triaging the medical literature based on your PICOT question, while investigating the full article, what are you focusing on for evaluating the strength of the findings?

A

Effect sizes and associated confidence intervals

118
Q

When surrogate endpoints are used, which of the following properties might they have in an RCT?

A
  • Cost far less to measure compared to measuring the actual clinical outcome in the patient
  • Be an early change to allow for shorter trial times than the actual patient outcome measure
  • Exhibit dose-response relationship between the intervention and the surrogate outcome measure
  • Be more amenable to blinding compared to measuring the actual clinical outcome in the patient
119
Q

What feature distinguishes a cohort from a case-control study in such a way that makes the strength of evidence to be stronger by design in the former, compared to the latter study type?

A

Cohort studies are prospective, whereas case-control studies are retrospective

120
Q

What concepts are important in evaluating evidence for cause and association, over coincidence?

A
  • Strength of evidence, enormous increase in outcome in presence but not is absence of candidate cause
  • Reproducibility, under widely differing circumstances, observed repeatedly, k independently by different investigators, in different places, circumstances, and times
  • Specificity, of the association, limited to certain subjects or patients, to particular sizes, to certain types of disease, with no association between these and other modes of dying
  • Temporality, key, the candidate cause evident must occur before the outcome of interest, particularly important concept for diseases and conditions with long, years or decades latency
  • Biological gradient, or dose-dependent relationship between can dilate cause and outcome measure of interest
  • Biomedical plausibility and coherence with the framework of principles and facts known in the specific discipline or field
  • Intervention, when possible to directly test the candidate cause and measure the outcome of interest by studies designed to test for the concepts of association and causality above