Hypothesis testing Flashcards

1
Q

What is the Central Limit Theorem?

A

If you repeatedly take samples form the same population at any given sample size, and calculate sample means and plot these means both these means are normally distributed

Population mean distribution = Population mean

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the standard error of the mean?

A

Measure of how much the sample means would on average differ from the population mean

Measure of just how variable the estimate of the mean is

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are confidence limits?

A

Limits between which estimated parameters have a defined likelihood of occurring e.g. 95% or 99%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How do you calculate a 95% confidence limit?

A

Need to know 3 things:

1) Sample mean
2) Estimated SE
3) The number of ±SE away from the estimate of the population mean within which the real population mean (μ) will be found 95 times out of 100 (found using the t-distribution)

Estimate of the population mean within which the real population mean will be found 95 times out of 100

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the formula for estimating standard error?

What is the formula for 95% CI?

A

LEARN IT ITS IN THE BOOK

SE is smaller than s (sample standard deviation) and gets smaller still as n increases

Have to use the t-distribution: Similar to normal distribution but accounts for the fact that we have to be more cautious because we have ESTIMATED our standard error

Increase sample size= Better confidence level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How do you carry out a null hypothesis test?

A

1) Formulate a null hypothesis
2) Calculate the test statistic- Measuring the size of any effect relative to the amount of variability there is in the sample
3) Calculate the significance probability. The probability of getting the effect measured just by chance, if the null hypothesis were true
4) If the test statistic is consistent with the null (95%)= Retain the null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is a null hypothesis (H0)?

A

A statement about the value of a population parameter. Your data may allow you to reject this hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the alternative hypothesis (H1)?

A

A statement that describes the value of the population parameter if H0 is rejected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is a hypothesis test?

A

A statistical test that tests the claim made about a parameter by H0 against that made by H1. Tests whether H0 should be rejected or not, based on evidence from sample data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is a test statistic?

A

A statistic calculated from sample data that is used to decide whether or not to reject H0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What does a One-sample t test test for?

A

Test whether the sample mean from a single population is different from an expected value (E)

Calculates how many standard errors the sampling mean is away from the expected value

The further away the mean is from E, the larger the value of t and the less probable it is that the real population mean could be the expected value= significant

If |t| > critical value, the difference is significant= Reject the null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the critical value?

A

Boundary between something that is rare and not rare

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What does the t-test strictly assumes?

When do you use this test?

A

The subjects come from a normal distribution

1540 and the data is roughly normal OR n>40 even if data is not normal as Central limit theorem= a big enough the sample size, the sample means tends to be normally distributed anyway even if the underlying data is not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are different types of errors?

A

Type I error (α): probability of rejecting the null hypothesis when it is true

Type II error (β): probability of failing to reject the null hypothesis when it is false

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What are independent samples?

A

Knowing a value form one sample gives no information about a value in the other sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the procedure for a t-test from 2 independent samples? (Unpaired t test)

A
  • 1) State the null and alternate hypothesis
  • H0: the mean of population 1 and population 2 are the same
  • H1: the mean of population 1 and the mean of population 2 differ
  • 2) State an acceptable type 1 error probability, a
  • 3) Randomly sample from population 1 and from population 2
  • Let n1 and n2 be the sample sizes from population 1 and 2
  • 4) Calculate the mean and sample standard deviation for both samples
  • 5) Calculate the t-statistic
  • 6) Find appropriate critical value- Use smaller (if sample sizes are different) N-1 as df
  • 7) If |t| > critical value= Significant
17
Q

What are some phrases to use when interpreting the results?

A

REMEMBER A STATISTICAL ANALYSIS NEVER PROVES ANYTHING

If you reject H0
There is sufficient evidence to reject the claim that (state claim) or
The data is inconsistent with the claim that (state claim)
If you do not reject H0
There is not sufficient evidence to reject the claim that (state claim) or
The data is consistent with the claim that (state claim)

18
Q

What does a t-test let you determine?

A

Lets you determine if the differences between the sample means is statistically significant