chapter 17: tests of significance Flashcards
to assess the evidence provided by data about some claim concerning a population parameter, you _____
use a test of significance
null hypothesis H0
The claim tested by a statistical test of significance is called the null hypothesis. The test is designed to assess the strength of the evidence against the null hypothesis. Usually the null hypothesis is a statement of “no effect” or “no difference.”
significance tests, in a nutshell…
an outcome that would rarely happen if a claim were true is good evidence that the claim is not true
alternative hypothesis
The claim about the population that we are trying to find evidence for is the alternative hypothesis. The alternative hypothesis is one-sided if it states that a parameter is larger than or smaller than the null hypothesis value. It is two-sided if it states that the parameter is different from the null value (it could be either smaller or larger).
P-value
The probability that measures the strength of the evidence against a null hypothesis. Small P-values are evidence against H0 because they say that the observed result would be unlikely to occur if H0 were true. Large P-values fail to give evidence against H0
Ha
The alternative hypothesis, which sets the direction that counts as evidence against H0.
“Significant” in the statistical sense
“Significant” in the statistical sense does not mean “important.” It means simply “not likely to happen just by chance.” Significance at level 0.01 is often expressed by the statement, “The results were significant (P < 0.01).”
Significance at level a
If the P-value is as small, or smaller than, α, we say that the data are statistically significant at level α. The quantity α is called the significance level or the level of significance, and is often .05 (1 in 20 that a sample would give evidence this strong just by chance) or .01 (1 in 100).
Whenever P-value < α
we ca reject the null hypothesis
Why should you always check the conditions as the first step in the solve portion of the four-step process
There is no point in computing the test statistic and finding the P-value if the conditions are not met.
We always express hypotheses in terms of __________.
Hypotheses are claims about population parameters, never sample outcomes
If P-value > α, the decision we make is to ___________________
FAIL TO reject the null hypothesis
What does statistically significant mean in a test of hypotheses?
not likely to happen due to chance… Significant means that the difference between the observed sample statistic and the claimed parameter value is too BIG to be due to chance.
What should you include in the interpretation of a P-value?
- the probability is about getting the sample statistic
- the assumption is on the null hypothesis being true
An outcome that would rarely happen if a claim were true is good evidence that the claim is ___________.
not true