Hypotheses

Question 1

Null hypothesis

Answer 1

Something that is assumed to be true

Question 2

Alternative hypothesis

Answer 2

That which is assumed to be true when the null hypothesis is false.

Question 3

p-value

Answer 3

The probability of erroneously rejecting the null hypothesis.
The probability of observing the data you observed when, in fact, the null hypothesis is true

Question 4

Significance level

Answer 4

A criterion for separating “small” p-values from “large” p-values.

Question 5

Test statistic

Answer 5

A statistic that can be compared to a probability distribution to find a p-value.
(A generic term for t-score, z-score, F-score, etc.)

Question 6

Confidence interval

Answer 6

A range over which observations of a random variable are likely to occur or a
range that is likely to contain a population measure. A confidence interval is:
estimate (plus over minus) (critical value) (standard error)

Question 7

Critical value

Answer 7

A criterion for separating “small” areas from “large” areas within a probability
distribution.