Statistical thinking

Question 1

Cause-and-effect

Answer 1

Related to whether we say one variable is causing changes in the other variable, versus other variables that may be related to these two variables.

Question 2

Confidence interval

Answer 2

An interval of plausible values for a population parameter; the interval of values within the margin of error of a statistic

Question 3

Distribution

Answer 3

The pattern of variation in data.

Question 4

Generalizability

Answer 4

Related to whether the results from the sample can be generalized to a larger population.

Question 5

Margin of error

Answer 5

The expected amount of random variation in a statistic; often defined for 95% confidence level.

Question 6

Parameter

Answer 6

A numerical result summarizing a population (e.g., mean, proportion).

Question 7

Population

Answer 7

A larger collection of individuals that we would like to generalize our results to.

Question 8

P-value

Answer 8

The probability of observing a particular outcome in a sample, or more extreme, under a conjecture about the larger population or process.

Question 9

Random assignment

Answer 9

Using a probability-based method to divide a sample into treatment groups.

Question 10

Random sampling

Answer 10

Using a probability-based method to select a subset of individuals for the sample from the population.

Question 11

Reliability

Answer 11

The consistency of a measure.

Question 12

Sample

Answer 12

The collection of individuals on which we collect data.

Question 13

Statistic

Answer 13

A numerical result computed from a sample (e.g., mean, proportion).

Question 14

Statistical significance

Answer 14

A result is statistically significant if it is unlikely to arise by chance alone.

Question 15

Validity

Answer 15

The degree to which a measure is assessing what it is intended to measure.