Hypothesis Testing Flashcards

1
Q

is it true that random samples don’t led to any sampling error

A

NO - they DO have sampling errors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

why do random samples have sampling error

A

because we are taking a SAMPLE of the population to study NOT the entire population so there has to be chance differences between data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what does hypothesis testing compare

A

data to what we would EXPECT to see if a null hypothesis was TRUE (don’t reject)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

when is a null hypothesis rejected

A

if the data is TOO UNUSUAL compared to what we expected from if the null hypothesis was TRUE

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what phrase is associated with parameter estimation

A

how large the effect is and what is the uncertainty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what phrase is associated with hypothesis testing

A

whether there IS an effect

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

why are null hypothesis made

A

for the purpose of ARGUMENT

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what view embodies null hypothesis

A

skeptical point of view

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

what is the null hypothesis FREQUENTLY based as

A

the population parameter has ZERO interest (ie. there is no effect, no correlation or no difference)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

what happened to reject the null hypothesis (what kind of result)

A

an interesting result (ie. there was an effect, was a difference, was a correlation)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what hypothesis is paired with null hypothesis

A

alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what does the alternative hypothesis represent

A

ALL the other parameters EXCEPT those stated by the null hypothesis (ie. there is an effect due to this parameter)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what hypothesis is tested with the data

A

NULL hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what hypothesis is not tested directly

A

the alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

when do we FAIL to reject a null hypothesis

A

when data is CONSISTENT with the expected data in null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

do we accept null hypotheses

A

NO

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

when do we reject null hypotheses

A

when data is NOT consistent with expected results in null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

if we reject the null hypothesis what is accepted

A

the alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

how does rejecting the null hypothesis help us identify the population parameter

A

helps identify which direction (according to alternative hypothesis) the true value of the parameter is

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

what steps are done in the hypothesis testing

A
  1. state the hypotheses (both alternative and null)
  2. determine the test statistic
  3. determine null distribution
  4. quantifying uncertainty (based on p value)
  5. determining statistical significance
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

what does a two sided test mean

A

an alternative hypothesis has two outcomes to reject the null hypothesis

(ie. if null says expectation is for data to be equal, alternative can reject it by having data greater than or less than that value)

22
Q

what is the test statistic

A

a number calculated from the data that is used to evaluate compatibility of the results from null hypothesis expectation

(ie. if 14 of 18 frogs were right handed with 4 being left handed and the study was about proportion of righthand frogs than 14 is test stat)

23
Q

null distribution

A

the sampling distribution of outcomes for a test statistic based on null hypothesis being true

24
Q

what is the aim for a hypothesis test

A

to know how unusual our results are compared to the null hypothesis

25
when should we reject the null hypothesis
when the data is less than the P value (0.05)
26
when should we NOT reject the null hypothesis
when the data probability is LARGER than the P value (0.05)
27
what is P value
the probability of obtaining the data (what was seen in the test) if null hypothesis was true
28
what is significance level
the threshold used to determine how small P has to be to reject the null hypothesis
29
when is a hypothesis "statistically significant"
when the null hypothesis is rejected (less than P)
30
when is a hypothesis test "not statistically significant"
when the null hypothesis is NOT rejected (greater than P)
31
what is always included in report of hypothesis test
1. value of test statistic 2. sample size 3. P value
32
if we reject a null hypothesis is it ALWAYS false
NO
33
if we DO NOT reject a null hypothesis is it always true
NO
34
what can lead to incorrect conclusions about statistical significance
sampling error (which happens because we are dealing with samples of population NOT the population itself)
35
what is a type 1 error
when a null hypothesis is false but taken as true (hypothesis should be rejected but isn't)
36
what is a type 2 error
when a null hypothesis is true (not rejected) but taken as false (rejected)
37
what error is associated with false positive
type 1 (rejecting a true null hypothesis)
38
what type of error is associated with false negative
type 2 (when a true but gets rejected)
39
what is the probability of making a type 1 error
the significance level (alpha)
40
what happens if you try to lower the type 1 error
type 2 error rates rise
41
can you reduce both types of errors in an experiment
NO - decreasing one causes the other to rise
42
why is alpha (0.05) set so low
because type 1 errors (false positive - seeing effect when isn't one) are seen as more serious than type 2 errors
43
what is statistical power
Power is the probability of CORRECTLY rejecting a false null hypothesis
44
do we want high or low power
HIGH - want to have high chance of correctly rejecting null hypothesis
45
what does a lower power mean
there is a higher probability of committing a type 2 error
46
how to improve statistical power
- have large sample sizes - have a large effect size (large true differences from null expectation) - have low variability in population
47
how long is the null hypothesis the default
until further data suggests otherwise
48
what does a small and tight CI interval mean around null hypothesis
then deviation from null hypothesis is unlikely (more likely to stat not rejected)
49
what are one sided tests
the alternative hypothesis has parameter value on ONE SIDE of the specified null hypothesis
50
when is a null hypothesis rejected in a one sided test
if the data departs from the null hypothesis IN THE DIRECTION stated by the alternative hypothesis
51
why are one sided tests used with caution
these tests have a P value way less than two sided tests (generally smaller sample size) so their power is lower and type 1 errors are more likely
52
how are null hypothesis and confidence interval similar
when the null hypothesis parameter is OUTSIDE the 95% CI, the null hypothesis is generally REJECTED (smaller than alpha) when the null hypothesis value is INSIDE the 95% CI than the hypothesis generally is NOT REJECTED