Hypothesis Testing

Question 1

What is: Probability of a Type 1 Error

Answer 1

Significance Level

Question 2

What is: probability of getting results at least as extreme as the current test

Answer 2

p - value

Question 3

If p-value is less than the alpha (a)(significance level) ie (p-value < a) or if the test statistic is greater than the critical value then do what?

Answer 3

Reject the null hypothesis

Question 4

Null is true, but reject

Answer 4

Type 1 Error / False Positive

Question 5

Null false, but fail to reject

Answer 5

Type 2 Error / False Negative

Question 6

Probability of avoiding a Type II error, and rejecting the null when it is indeed false

Answer 6

Power

Question 7

What is a Z-test

Answer 7

tests whether population means/proportions are different. Assumes test statistic is normally distributed and is used when n is large and variances are known. If not, then use a t-test

Question 8

What is a t-test

Answer 8

A typer of inferential statistic used to determine if there is a significant difference between 2 groups, which may be related in certain features

Question 9

What is the difference between a z-test and t-test

Answer 9

Difference between Z-test and t-test: Z-test is used when sample size is large (n>50), or the population variance is known. t-test is used when sample size is small (n<50) and population variance is unknown.

Question 10

What is ANOVA

Answer 10

analysis of variance, used to compare 3+ samples

with a single test

Question 11

What is Chi-Square Test

Answer 11

checks relationship between categorical
variables (age vs. income). Or, can check goodness-of-t
between observed data and expected population distribution.