Hypothesis Testing Flashcards

1
Q

is it true that random samples don’t led to any sampling error

A

NO - they DO have sampling errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

why do random samples have sampling error

A

because we are taking a SAMPLE of the population to study NOT the entire population so there has to be chance differences between data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what does hypothesis testing compare

A

data to what we would EXPECT to see if a null hypothesis was TRUE (don’t reject)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

when is a null hypothesis rejected

A

if the data is TOO UNUSUAL compared to what we expected from if the null hypothesis was TRUE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what phrase is associated with parameter estimation

A

how large the effect is and what is the uncertainty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what phrase is associated with hypothesis testing

A

whether there IS an effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

why are null hypothesis made

A

for the purpose of ARGUMENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what view embodies null hypothesis

A

skeptical point of view

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is the null hypothesis FREQUENTLY based as

A

the population parameter has ZERO interest (ie. there is no effect, no correlation or no difference)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what happened to reject the null hypothesis (what kind of result)

A

an interesting result (ie. there was an effect, was a difference, was a correlation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what hypothesis is paired with null hypothesis

A

alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what does the alternative hypothesis represent

A

ALL the other parameters EXCEPT those stated by the null hypothesis (ie. there is an effect due to this parameter)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what hypothesis is tested with the data

A

NULL hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what hypothesis is not tested directly

A

the alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

when do we FAIL to reject a null hypothesis

A

when data is CONSISTENT with the expected data in null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

do we accept null hypotheses

A

NO

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

when do we reject null hypotheses

A

when data is NOT consistent with expected results in null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

if we reject the null hypothesis what is accepted

A

the alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

how does rejecting the null hypothesis help us identify the population parameter

A

helps identify which direction (according to alternative hypothesis) the true value of the parameter is

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what steps are done in the hypothesis testing

A
  1. state the hypotheses (both alternative and null)
  2. determine the test statistic
  3. determine null distribution
  4. quantifying uncertainty (based on p value)
  5. determining statistical significance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what does a two sided test mean

A

an alternative hypothesis has two outcomes to reject the null hypothesis

(ie. if null says expectation is for data to be equal, alternative can reject it by having data greater than or less than that value)

22
Q

what is the test statistic

A

a number calculated from the data that is used to evaluate compatibility of the results from null hypothesis expectation

(ie. if 14 of 18 frogs were right handed with 4 being left handed and the study was about proportion of righthand frogs than 14 is test stat)

23
Q

null distribution

A

the sampling distribution of outcomes for a test statistic based on null hypothesis being true

24
Q

what is the aim for a hypothesis test

A

to know how unusual our results are compared to the null hypothesis

25
Q

when should we reject the null hypothesis

A

when the data is less than the P value (0.05)

26
Q

when should we NOT reject the null hypothesis

A

when the data probability is LARGER than the P value (0.05)

27
Q

what is P value

A

the probability of obtaining the data (what was seen in the test) if null hypothesis was true

28
Q

what is significance level

A

the threshold used to determine how small P has to be to reject the null hypothesis

29
Q

when is a hypothesis “statistically significant”

A

when the null hypothesis is rejected (less than P)

30
Q

when is a hypothesis test “not statistically significant”

A

when the null hypothesis is NOT rejected (greater than P)

31
Q

what is always included in report of hypothesis test

A
  1. value of test statistic
  2. sample size
  3. P value
32
Q

if we reject a null hypothesis is it ALWAYS false

A

NO

33
Q

if we DO NOT reject a null hypothesis is it always true

A

NO

34
Q

what can lead to incorrect conclusions about statistical significance

A

sampling error (which happens because we are dealing with samples of population NOT the population itself)

35
Q

what is a type 1 error

A

when a null hypothesis is false but taken as true (hypothesis should be rejected but isn’t)

36
Q

what is a type 2 error

A

when a null hypothesis is true (not rejected) but taken as false (rejected)

37
Q

what error is associated with false positive

A

type 1 (rejecting a true null hypothesis)

38
Q

what type of error is associated with false negative

A

type 2 (when a true but gets rejected)

39
Q

what is the probability of making a type 1 error

A

the significance level (alpha)

40
Q

what happens if you try to lower the type 1 error

A

type 2 error rates rise

41
Q

can you reduce both types of errors in an experiment

A

NO - decreasing one causes the other to rise

42
Q

why is alpha (0.05) set so low

A

because type 1 errors (false positive - seeing effect when isn’t one) are seen as more serious than type 2 errors

43
Q

what is statistical power

A

Power is the probability of CORRECTLY rejecting a false null hypothesis

44
Q

do we want high or low power

A

HIGH - want to have high chance of correctly rejecting null hypothesis

45
Q

what does a lower power mean

A

there is a higher probability of committing a type 2 error

46
Q

how to improve statistical power

A
  • have large sample sizes
  • have a large effect size (large true differences from null expectation)
  • have low variability in population
47
Q

how long is the null hypothesis the default

A

until further data suggests otherwise

48
Q

what does a small and tight CI interval mean around null hypothesis

A

then deviation from null hypothesis is unlikely (more likely to stat not rejected)

49
Q

what are one sided tests

A

the alternative hypothesis has parameter value on ONE SIDE of the specified null hypothesis

50
Q

when is a null hypothesis rejected in a one sided test

A

if the data departs from the null hypothesis IN THE DIRECTION stated by the alternative hypothesis

51
Q

why are one sided tests used with caution

A

these tests have a P value way less than two sided tests (generally smaller sample size) so their power is lower and type 1 errors are more likely

52
Q

how are null hypothesis and confidence interval similar

A

when the null hypothesis parameter is OUTSIDE the 95% CI, the null hypothesis is generally REJECTED (smaller than alpha)

when the null hypothesis value is INSIDE the 95% CI than the hypothesis generally is NOT REJECTED