Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

Stats > Reading Quiz 11 > Flashcards

Reading Quiz 11 Flashcards

1
Q

steps/template used to conduct a significance test (aka hypothesis test)

A
  1. hypotheses
  2. conditions
  3. calculations
  4. interpretations
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

hypotheses step

A

identify population of interest and parameter you want to draw conclusions about
state null hypothesis (Ho), alternate hypothesis (Ha), and significance level (α)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

null hypothesis (Ho)

A

statement being tested in a significance test

significance test designed to assess strength of the evidence against the null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

null hypothesis usually statement of

A

no effect
no difference
no change from historical values

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

alternative hypothesis

A

the claim about the population that we are trying to find evidence for

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

significance level

A

denoted by α
represents the cutoff between rejecting and failing to reject the null hypothesis
most of time the specified, if not choose one
common = 1% and 5%

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

conditions step

A

state the appropriate inference procedure
verify the conditions for using it
SRS, Normality, independence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

SRS condition

A

data is obtained from an SRS of the population of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Normality condition (for means)

A

population distribution is Normal, large sample size (30+) to apply central limit theorem, or observe and sketch the shape of the histogram (it’s enough if the distribution is roughly symmetric and unimodal)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

independence condition

A

assume individual observations are independent

when sampling without replacement must verify that population size N is at least 10 times the sample size

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

calculations step

A

calculate test statistic and find p value of test statistic

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

test statistic general form

A

z = (estimate - hypothesized value)/(standard deviation of the estimate)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

test statistic for one sample z test for means

A 
z = (x̅-μo)/(σ/√n) 
μo= mu not
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

p value of a significance test

A

the probability, computed assuming that Ho is true, that the test statistic would take a value as extreme or more extreme than that actually observed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

interpretations step

A

interpret the results of the test (fail to reject or reject the null hypothesis)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

statistically significant

A

if the p value is less than or less than or equal to the significance level α, our data is statistically significant at this level and we reject the null hypothesis
if the p value is greater than the significance level α we fail to reject the null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

small p values are evidence…

large p values fail to give evidence…

A

against Ho because they say that the observed result is unlikely to occur when Ho is true
against Ho

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

tests that can also be performed by using a confidence interval

A

two tailed significance tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Ho true and reject Ho

A

type I error (α)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Ho true and fail to reject Ho

A

correct decision

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Ho false and reject Ho

A

correct decision aka power

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Ho false and fail to reject Ho

A

type II error (β)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

important information about type I and type II errors

A

if a significance test has a fixed significance level α then α is the probability of making a type I error
the probability of a type II error is denoted by the symbol β

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

there is a(n) … relationship between type I and type II errors

A

inverse

25
Q

power of a significance test

A

the probability that a fixed level α significance test will reject Ho, the null hypothesis, when a particular alternative of the parameter is true is called the power of that test against that alternative

26
Q

power of a significance test easier definition

A

the probability that the null hypothesis will be rejected if it is false
1 - P(type II error) = 1 - β

27
Q

two main ways to increase the power of a significance test

A
  1. increase the sample size
  2. increase the significance level
    there are other ways to do so too but these are the ways that are generally within the control of the experimenter
28
Q

increasing the significance level…

A

increases the probability of making a type I error, which decreases the probability of making a type II error, which makes 1 - β a larger quantity
the higher alpha, the lower beta, and vice versa

29
Q
  1. True or False: The significance test is designed to assess the strength of the evidence against the null hypothesis.
A

true

30
Q

In doing statistical tests, the first step is to identify what you want to make conclusions about. Are you making conclusions about sample statistics or population parameters? Is that always the case or does it depend upon the problem?

A

Population parameters. Always.

31
Q

What does a “null hypothesis” typically state?

A

That there is no difference between two parameters, or no effect, or no change (or that a parameter is equal to a certain value).

32
Q

A significance test works by assessing how likely the ______ _____ would be if the ____ _____ were true.

A

observed outcome, null hypothesis

33
Q

True or False: the p-value is the probability of getting exactly the results we observed, presuming the null hypothesis to be true.

A

False. The probability of getting exactly the results we obtained is almost always very small (or even theoretically 0 when dealing with continuous distributions). The p value is the probability of getting results as extreme, or more extreme, than the actually observed results; “extreme” means “far from what we would expect if the null hypothesis were true.”

34
Q

We are more likely to reject the null hypothesis of “no difference” or “no effect,” and infer that there is a difference or an effect, when the p-value is large, or small?

A

small

35
Q

The null hypothesis has to do with a population parameter; in analyzing your sample data you calculate a ______ that estimates that population parameter.

A

Statistic (the phrase, “sample statistic” is correct but redundant.)

36
Q

When a drug company researcher is hoping to find evidence that a drug is better than placebo, is the researcher wishing to reject, or fail to reject, the null hypothesis?

A

Reject. The null hypothesis would be that drug and placebo are equal in effect.

37
Q

What is the meaning of the significance level, or alpha?

A

It’s a threshold level for the p-value that we consider decisive, with which the obtained p-value is compared. We then decide whether to reject or fail to reject the null hypothesis.

38
Q

Do we reject the null hypothesis when the p value is less than alpha, or greater than alpha?

A

less than alpha

39
Q

If a test is statistically significant at the .05 level, what does that mean?

A

That the p-value obtained is less than or equal to .05.

40
Q

Someone finishes writing up a statistical test by saying, “In conclusion, p = .021.” What step of the
“inference toolbox” are they leaving out, that should come after what they said?

A

Interpreting the results in the context of the problem. So they should say something like, “Therefore we reject the hypothesis that drug and placebo are equal; our study gives evidence that our drug is more effective than the placebo.”

41
Q

When we are testing the hypothesis that a population mean is equal to a certain hypothesized value, in
the unlikely situation where we know the population standard deviation, what is our test statistic formula?

A

z = (xbar - mu not)/(sigma/sqrt(n))

42
Q

What distribution does the one-sample z statistic, a.k.a. the standardized sample mean, have when the null hypothesis is true?

A

the standard normal distribution

43
Q

Please explain why the two-sided p-value is double that of the one-sided p-value.

A

The p-value is the probability of getting results as extreme as, or more extreme than, the results obtained. For a two sided test, we add the probability of getting results extreme in both directions to get the total p value; for symmetrical distributions, those two probabilities are equal, thus amounting to twice the value for any single direction.

44
Q

True or False: If you obtained a 95% confidence interval for a mean that ranged from 10 to 30, then a
null hypothesis that the mean was equal to any value outside that range would be rejected and a null hypothesis of a mean within that range would not be rejected, at the .05 level, using a two-sided test.

A

true

45
Q

True or False: If you report the p-value itself, rather than saying, that p

A

true

46
Q

True or False: if the significance level is set at .05 then a p-value slightly less than .05 is technically considered statistically significant but should not be considered practically significant.

A

true

47
Q

If there are bad design problems, is it likely, or unlikely, that sophisticated inferential statistical analysis techniques can get around these problems to produce valid inferences?

A

unlikely

48
Q

Suppose the null hypothesis is that a drug has no effect. If this is true and our analysis yields the decision that the drug is effective, that is a _____ error; if the drug has an effect but our analysis concludes that there is no effect, that is a ______ error.

A

type I, type II

49
Q

If we set alpha at .01, what is the probability of a type 1 error given that the null hypothesis is true?

A

The probability is .01.

50
Q

The probability that a fixed level alpha significance test will reject the null when a particular alternative value of the parameter is true is called the _____ of the test against that alternative.

A

power

51
Q

The power of a test is what function of the probability of a type 2 error?

A

1 minus probability of type 2 error.

52
Q

True or False: the p-value tells what would happen if we tested many samples, when the null hypothesis is true; the power tells what would happen if we tested many samples, when a particular alternative hypothesis is true.

A

true

53
Q

What happens to power as you increase sample size, all other things equal?

A

it increases

54
Q

What happens to power as you increase the significance levels, all other things equal?

A

it increases

55
Q

when inside confidence interval vs when outside confidence interval

A

statistically significant = outside confidence interval

not statistically significant = inside confidence interval

56
Q

p value second

A

the likelihood of getting similar results assuming Ho is true

57
Q

p less than or equal to alpha

A

statistically significant

reject

58
Q

p greater than or equal to alpha

A

not statistically significant

fail to reject

59
Q

ART BFF

A

Alpha (type I), Reject Ho, actually True

Beta (type II), Fail to reject Ho, actually False

Stats (15 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions