1.6 the role of P-values Flashcards
The p-value
defined as the area in the probability distribution outside the test statistic
The p
-value is a helpful measure because it is the smallest level of significance at which the null hypothesis can be rejected (test statistic exceeds critical value)
how do we use the p value when we have to find a decision regarding the null hypothesis
p-value ≤ α: Reject the null hypothesis
p-value > α: Do not reject the null hypothesis
Type I error occurs when??
if a true null hypothesis is mistakenly rejected
This probability is represented by α, which is the level of significance
the false discovery rate (FDR).
The expected portion of the Type I error
the false discovery approach
can be used by adjusting the p-values of the tests
used to lower the risk of rejecting a true null hypothesis (Type 1 error)
the false discovery approach steps
- Perform the hypothesis tests and list the p-values from all tests.
- Rank the test results based on the p-values from lowest to highest.
- Assuming that i is the sorted ranking of the test, the adjusted p-value is calculated by:
p∗(i) = α*(i/Number of tests)
- Compare p∗(i) to the unadjusted p-value, p(i).
–> The Rank i hypothesis test is statistically significant only if p(i) ≤ p∗(i)
A t-test
commonly used to test the value of an underlying population mean
The t-distribution is similar to the standard normal distribution, but it is impacted by the degrees of freedom
–> Smaller degrees of freedom produce fatter tails
can be used for a population with unknown variance, provided the sample is large (≥ 30), or the population is approximately normally distributed
t-test formula with a single mean and unknown variance
tn-1 = X¯− μ0 / sX¯
sX¯ = s/√n
The hypothesized mean is denoted by μ0
The z-test
can also be used for a large sample even if the population variance is unknown
z-test formula with a single mean and unknown variance
z = X¯− μ0 / sX¯
sX¯ = s/√n
The hypothesized mean is denoted by μ0
z-test formula with known variance
z = X¯− μ0 / σX¯
where σX¯ = σ/√n
The following rejection points are commonly used for a z-test:
z0.10 = 1.28
z0.05 = 1.645
z0.025 = 1.96
z0.01 = 2.33
z0.005 = 2.575