Hypothesis Testing Flashcards

1
Q

The null hypothesis (H0)(H0) is

A

a statement about a topic of interest about the population. It is typically based on historical information or conventional wisdom. We always start a hypothesis test by assuming that the null hypothesis is true and then test to see if we can nullify it using evidence from a sample. The null hypothesis is the opposite of the hypothesis we are trying to prove (the alternative hypothesis).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

The alternative hypothesis (Ha)

A

is the theory or claim we are trying to substantiate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

2 steps before conducting hypothesis test:

A

1) Determine whether to analyze a change in a single population or compare two populations.
2) Determine whether to perform a one-sided or two-sided hypothesis test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

To conduct a hypothesis test, we must follow these steps:

A

1) State the null and alternative hypotheses.
2) Choose the level of significance for the test.
3) Gather data about a sample or samples.
4) To determine whether the sample is highly unlikely under the assumption that the null hypothesis is true, construct the range of likely sample means or calculate the p-value.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

The p-value is

A

the evidence against the null hypothesis. the smaller it is, the stronger the evidence. the likelihood of obtaining a sample as extreme as the one we’ve obtained, if the null hypothesis is true.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does p-value of a one-sided test equal?

A

half the p-value of a two-sided hypothesis test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

When do we not have sufficient evidence to reject the null hypothesis?

A

If the sample mean falls in the range of likely sample means, or if its p-value is greater than the stated significance level,

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

When do we have sufficient evidence to reject the null hypothesis?

A

If the sample mean falls in the rejection region, or if it has a p-value lower than the stated significance level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

When can we accept the null hypothesis?

A

Never. We either reject them or fail to reject them

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are 2 errors that can occur?

A

A type I error is often called a false positive (we incorrectly reject the null hypothesis when it is actually true)

type II error is often called a false negative (we incorrectly fail to reject the null hypothesis when it is actually not true)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

EXCEL formula for calculating the range of likely sample means

A

CONFIDENCE.NORM or CONFIDENCE.T

=T.TEST(array1, array2, tails, type)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

A manager of a factory wants to know if a new quality check protocol has decreased the number of units a worker produces in a day. Before the new protocol, a worker could produce 27 units per day. What alternative hypothesis should the manager use to test this claim?

A

µ < 27 units
The manager wants to know if the new quality check protocol has decreased the average number of units a worker can produce per day. For a one-sided test, the manager should use the alternative hypothesis Ha: μ<27 units. This is the claim the manger wishes to substantiate.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

A manager of a factory wants to know if a new quality check protocol has decreased the number of units a worker produces in a day. Before the new protocol, a worker could produce 27 units per day. What null hypothesis should the manager use to test this claim?

A

µ ≥ 27 units

This is the null hypothesis. Remember that the null and alternative hypotheses are opposites.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

If you are performing a hypothesis test based on a 90% confidence level, what are your chances of making a type II error?

A

It is not possible to tell without more information. The confidence level does not provide any information about the likelihood of making a type II error. Calculating the chances of making a type II error is quite complex and beyond the scope of this course.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

If you are performing a hypothesis test based on a 90% confidence level, what are your chances of making a type I error?

A

10%
The probability of a type I error is equal to the significance level, which is 1–confidence level. A 90% confidence level indicates that the significance level is 10%. Therefore there is a 10% chance of making a type I error.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

If the one-sided p-value of a given sample mean is 0.0150, what is the two-sided p-value for that sample mean?

A

0.0300
The two-sided p-value is double the one-sided p-value. Since the one-sided p-value is 0.0150, the two-sided p-value is 0.0150*2=0.0300.

17
Q

A manager of a factory wants to know if the average number of workplace accidents is different for workers who attended an equipment safety training compared to those who did not attend. What alternative hypothesis should the manager use to test this claim?

A

µattended ≠ µdid not attend
The manager has reason to believe that the training has changed the average number of workplace accidents between the two groups of workers. For a two-sided test, the manager should use the alternative hypothesis Ha: µattended ≠ µdid not attend. This is the claim the manger wishes to substantiate.

18
Q

If you are performing a hypothesis test based on a 20% significance level, what are your chances of making a type I error?

A

20%

The probability of a type I error is equal to the significance level, which is 1–confidence level.

19
Q

If the two-sided p-value of a given sample mean is 0.0040, what is the one-sided p-value for that sample mean?

A

0.0020
The one-sided p-value is half of the two-sided p-value. Since the two-sided p-value is 0.0040, the one-sided p-value is 0.0040/2=0.0020.

20
Q

What is the rejection region?

A

The region outside the confidence % range is called the rejection region (e.g. 95% confidence, 5% rejection). If our sample mean falls in the rejection region, we reject the null hypothesis.

21
Q

How does p-value measure likelihood?

A

the smaller the p-value is, the stronger the evidence is against the null hypothesis.

22
Q

What is the significance level for a 95% confidence level?

A

5%

Significance level=1–confidence level. 1–0.95=0.05, that is, 5%.

23
Q

If we specify a 75% confidence level, what percentage of sample means do we expect to fall in the rejection region?

A

75%
The significance level equals the area of the rejection region. Remember that the significance level=1–confidence level and that the area under the normal curve is 1, or 100%.

24
Q

How do you calculate probability of type I error?

A

The probability of a type I error is equal to the significance level (which is 1–confidence level).

25
Q

Suppose we want to know whether students who attend a top business school have higher earnings than those who attend lower-ranked business schools. To find out, we collect the average starting salaries of recent graduates from the top 100 business schools in the U.S. We then compare the salaries of those who attended the schools ranked in the top 50 to the salaries of those who did not. Should we perform a one-sided hypothesis test or a two-sided test?

A

One-sided
Since we are interested only in whether the average salaries of people who attended the top 50 business schools are higher than the salaries of those who did not, we should perform a one-sided test. If we were interested in learning whether the salaries of the people who went to the top 50 business schools were different (either higher or lower) than those from the other schools, we would conduct a two-sided test.

26
Q

When do we perform a one-sided test?

A

We perform a one-sided test when we have strong convictions about the direction of a change—that is, we know that the change is either an increase or a decrease.

27
Q

When do we perform a two-sided test?

A

When we do not have strong convictions about the direction of a change. Therefore we test for a change in either direction