Hypothesis Testing: Flashcards
What are some limitations of hypothesis testing?
- Difficult to understand what a hypothesis test is telling you
- Cannot make scientific decisions based on hypothesis testing alone
- Have to consider how plausible the result is
Is 59 heads from 100 throws evidence of an unfair coin or Random variation?
Usually you would expect only getting 50 heads, but I don’t believe 59 heads is far enough from this statistic in order to be significant enough to suggest the coin is unbiased (therefore, I believe it is due to random variation)
What is the threshold used to determine whether the chances of something happening are due to chance or not? How is it determined?
This threshold is called the significance level
It depends on the experiment
What is the usual significance level?
5%
What is used to denote the proportion of false positives if the null hypothesis is true (the significance level)
α (alpha)
How do you calculate the critical value?
The critical value is the number marking the point where, above or below which, is one or both extreme(s) of the distributions. This usually covers a certain percentage (5% coverage = 0.05 significance level)
List the names of the two hypothesis:
- H0 (null hypothesis)
- HA (alternative hypothesis)
What is the null hypothesis?
There is no significance difference- no effect (the initial assumption that we make)
What is an Alternative hypothesis?
Suggests there is a significance in the results and is an alternative theory to the null hypothesis
What is the relationship between the null hypothesis and the alternative hypothesis?
They are mutually exclusive (can’t happen at the same time)
How does hypothesis testing work to prove a hypothesis?
It assumes that the null hypothesis is true until there is significance proof that the null hypothesis is false (this doesn’t prove that the alternative hypothesis is correct)
What is the name given to the percentage area of a distribution marked by the critical value?
The critical region
What happens if a value given falls within the critical region?
We reject the null hypothesis and accept the alternative hypothesis as there is a less than 5% chance of the results happening by chance, suggesting that the result is statistically significant
How does the alternative hypothesis vary in a two tailed test?
The alternative hypothesis is just any result other than the null hypothesis (one or the other extreme)
What happens to the significance level during a two tailed test?
It is split into half of the original significance level as the critical region has to be split between both tails of the distribution while covering the same area
What does it mean when a result doesn’t fall within the critical region?
The hypothesis test does not suggest the null hypothesis is false- there is no statistical significance
What is the use of the critical value?
To determine whether the probability of getting the observed result is significant or not
What function is used to carry out binomial tests in R?
Binomial.test ( x , n , p )
What do x, n and p parameters in the binom.test ( x , n , p ) function stand for?
- x is the observed number of successes
- n is number of trials
- hypothesised probability of success from null hypothesis
What results are given when the binom.test ( x , n , p ) is used?
- A title
- A summary of data input
- Description or alternative hypothesis
- States p value (this is to be compared to significance level)
What is a p value?
The probability of getting a result that extreme or more, assuming the null hypothesis is true
What is an assumption made when using the p value?
The p value assumes that the null hypothesis is true
What is a type 1 error?
A false positive
What is it called if the null hypothesis is true and our results are not statistically significant (so we don’t reject the null hypothesis)?
A true negative
