Chapter 2. Test for Significance Flashcards
the process by which we
determine the probability that there
is a significant difference between
two samples
Significance Testing (Hypothesis testing)
Indeterminate error is sufficient to explain any
difference in the values
being compared.
- no significant difference hypothesis
Null Hypothesis
The difference between the
values is too great to be explained by random error
and, therefore, must be real.
- have a significant difference
Alternative Hypothesis
A null hypothesis is retained whenever the evidence is insufficient to prove it is incorrect. Because of the way in which significance tests are conducted, it is impossible to prove that a null hypothesis is true.
the confidence level for retaining the null hypothesis (95%), or the probability that the null hypothesis will be incorrectly rejected
Significance Level
Retain Null = statistically the same
Reject Null = significant difference
If there is greater than a 5% chance of a result as extreme as the sample result when the null hypothesis is true, then the null hypothesis is retained. This does not necessarily mean that the researcher accepts the null hypothesis as trueโonly that there is not currently enough evidence to conclude that it is true.
Rejecting the null hypothesis means that a relationship does exist between a set of variables and the effect is statistically significant (p > 0.05)
The null hypothesis cannot be proven, although the hypothesis test begins with an assumption that the hypothesis is true, and the final result indicates the failure of the rejection of the null hypothesis. Thus, it is always advisable to state โfail to reject the null hypothesisโ instead of โaccept the null hypothesis.
Two-tailed test
- comparison
- key words: significant difference, same effect, generate the sameโฆ
One-tailed test
- key words: greater than, lower than, more effective, less effectiveโฆ
Type I Error
- The risk of falsely rejecting
the null hypothesis (๐ผ) - risk is always equivalent to ฮฑ
- false positive
Example:
Ho: he likes you back
Truth: he likes you back
Decision: falsely rejected Ho (missed your chance)
Type II Error
- The risk of falsely retaining
the null hypothesis (ฮฒ). - (ฮฒ) - depends on sample size and variance
- false negative
Example:
Ho: he likes you back
Truth: he doesnโt like you back
Decision: accepted Ho (wrongly invited him)
Minimizing a type 1 error by
decreasing ๐ผ, for example,
increases the likelihood of a type 2 error
F-Test
a test designed to indicate
whether there is a significant
difference between two
methods based on their
standard deviations.
Always write the formula Ysa!!!
F-Test
- higher value is always on the numerator
F is defined in terms of the
variances of the two methods, where the variance is the
square of the standard deviation
If ๐ญ๐๐๐๐ > ๐ญ๐๐๐๐๐, then the
variances being compared are
Significantly different