PSYC*1010 Chapter 8: Intro to Hypothesis Testing Flashcards

1
Q

What is a hypothesis test?

A

A statistical procedure that uses sample data to evaluate a hypothesis about a population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the basic assumption about the effect of a treatment?

A

If the treatment has an effect, a constant amount will be added or subtracted from each score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is assumed about the shape and standard deviation of a population after treatment?

A

The shape and standard deviation for the population after treatment is the same as the original population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the unknown population?

A

The population after treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the four steps of a hypothesis test?

A
  1. State the hypothesis and alpha level
  2. Set the criteria for a decision
  3. Collect data and compute sample statistics
  4. Make a decision
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

How are hypotheses stated in a hypothesis test?

A

Stated as two opposing hypotheses in terms of population parameters about the unknown population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does the null hypothesis state?

A

That there is no change, difference, or relationship for the general population (the IV has no effect on the DV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What does the alternative hypothesis state?

A

That there is a change, difference, or relationship for the general population (the IV has an effect on the DV)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

T or F: The null hypothesis and alternate hypothesis are mutually exclusive and exhaustive

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which hypothesis is used to predict what type of sample should be obtained?

A

The null hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the notation used to state hypotheses for two-tailed tests?

A

H0: μ with treatment = μ without treatment
H1: μ with treatment ≠ μ without treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the alpha level?

A

The probability value used to define the concept of “very likely” in a hypothesis test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the critical region?

A

The extreme sample values that are very unlikely (as defined by the alpha level)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the conclusion of a hypothesis test if sample data fall in the critical region?

A

The null hypothesis is rejected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is used to define the exact location for the boundaries that define the critical region?

A

The alpha level probability and unit normal table

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

In a hypothesis test, how is the sample data compared to the hypothesis?

A

By computing a z-score that describes where the sample mean is located relative to the hypothesized population mean from H0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is the formula for calculating z-score of a sample mean?

A

z= (M-μ)/σM

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Which statistic is used to make a decision about the null hypothesis?

A

The z-score

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What are the two possible outcomes of a hypothesis test?

A
  • The null hypothesis is rejected
  • The null hypothesis fails to be rejected
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What conclusion is made about the hypothesis if the data are located in the critical region?

A

The null hypothesis is rejected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What conclusion is made about the hypothesis if the data are not located in the critical region?

A

The null hypothesis fails to be rejected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is a test statistic?

A

A statistic that summarizes the sample data in a hypothesis test and is used to determine if the data is in the critical region (ex. z-score)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

How can the z-score be stated as a ratio?

A

z= the actual difference between the sample (M) and the hypothesis (μ) / the standard difference between M and μ with no treatment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What does a large value for a test statistic indicate?

A

That the sample data are very unlikely to have occurred by chance alone

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

What is a type I error?

A
  • Occurs when a null hypothesis is rejected that is actually true
  • The conclusion that a treatment did have an effect when it actually had no effect
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

What is a type II error?

A
  • Occurs when a null hypothesis fails to be rejected but was actually false
  • The conclusion that a treatment did not have an effect when it actually did
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

Which type of error has the most severe consequences?

A

Type I

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is the probability of a type I error?

A

The alpha level

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

Is it possible to determine a single, exact probability for a type II error?

A

No

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

How is the probability of a type II error represented?

A

Represented by the symbol β

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is the primary concern when selecting an alpha level?

A

To minimize the risk of a type I error

32
Q

By convention, what is the largest permissible value for alpha?

A

0.05

33
Q

How does the size of an alpha level effect the demands of a hypothesis test?

A

The lower the alpha level, the more evidence the hypothesis test demands to reject the null hypothesis

34
Q

What are the two functions of the alpha level?

A
  • Determine the boundaries for the critical region
  • Determine the probability of a type I error
35
Q

In a statistical test, what does a significant result mean?

A

That the null hypothesis has been rejected

36
Q

What five things must be included when reporting a rejected null hypothesis in APA?

A
  • The word significant
  • The z-score (z= )
  • The alpha level (p<.05)
  • The type of test (ex. one or two tailed)
  • Cohen’s d value (d= )
37
Q

What four things must be included when reporting a null hypothesis that failed to be rejected in APA?

A
  • The z-score (z= )
  • The alpha level (p>.05)
  • The type of test (ex. one or two tailed)
  • Cohen’s d value (d= )
38
Q

Do sample means that fall into the critical region have a probability less than or greater than alpha?

A

Less than alpha (p<α)

39
Q

Do sample means that fall outside the critical region have a probability less than or greater than alpha?

A

Greater than alpha (p>α)

40
Q

In a hypothesis test, what is the conclusion if p<α?

A

Null hypothesis should be rejected

41
Q

In a hypothesis test, what is the conclusion if p>α?

A

Null hypothesis should fail to be rejected

42
Q

What is the most obvious factor influencing z-scores?

A

The difference between the sample mean and the hypothesized mean from H0

43
Q

How does increasing the variability of scores affect the standard error and z-score?

A

Increasing variability of scores increases standard error and decreases the z-score (value closer to 0)

44
Q

How does increasing the sample size affect the standard error and z-score?

A

Increasing sample size decreases standard error and increases the z-score (value farther from 0)

45
Q

In hypothesis tests with z-scores, what is assumed about sampling?

A

That participants in the study were selected randomly

46
Q

In hypothesis tests with z-scores, what is assumed about observations?

A

That the values in the sample consist of independent observations

47
Q

In hypothesis tests with z-scores, how is the assumption that observations are independent satisfied?

A

By using a random sample

48
Q

In hypothesis tests with z-scores, what is assumed about the standard deviation before and after treatment?

A

That the standard deviation for the unknown population (after treatment) is the same as the population before treatment

49
Q

In hypothesis tests with z-scores, what is assumed about the sampling distribution?

A

That it’s normal

50
Q

What is a directional/one-tailed test?

A
  • The statistical hypotheses (H0 and H1) make a statement about the direction of the effect
  • The critical region is only in one end of the distribution
51
Q

What is the notation used to state hypotheses for one-tailed tests?

A

H0: μ with treatment = μ without treatment
H1: μ with treatment </> μ without treatment

52
Q

For a one-tailed/directional test, do the two hypotheses concern the general population or the individuals in the sample?

A

The general population

53
Q

If the prediction in a one-tailed test is a decrease, in which end of the distribution is the critical region?

A

The left-hand tail of the distribution

54
Q

If the prediction in a one-tailed test is an increase, in which end of the distribution is the critical region?

A

The right-hand tail of the distribution

55
Q

How do the four main steps of a hypothesis test change when using a one-tailed test rather than a two-tailed test?

A
  1. Directional prediction is incorporated into the statement of H0 and H1
  2. Criteria for decision changes… Critical region is located entirely in one end of the distribution, rather than split between two
  3. Calculate z-score (same as two-tailed)
  4. Make a decision (same as two-tailed)
56
Q

What is the major distinction between one- and two- tailed tests?

A
  • The criteria used to reject H0
  • One-tailed: allow H0 to be rejected when the distance between the sample and population is relatively small
  • Two-tailed: require a relatively large distance between the sample and population to reject H0
57
Q

Which type of hypothesis test is more sensitive?

A

One-tailed

58
Q

Which type of hypothesis test is more precise?

A

One-tailed

59
Q

Which type of hypothesis test is more rigorous/requires more evidence to reject H0?

A

Two-tailed

60
Q

Generally, when are one-tailed tests used?

A

When there is a strong justification for making a directional prediction

61
Q

What are the two serious limitations when using a hypothesis test to establish the significance of a treatment?

A
  • That the focus is on the data rather than the hypothesis
  • That a significant treatment doesn’t necessarily indicate a substantial treatment
62
Q

What does effect size provide a measurement of?

A

The absolute magnitude of a treatment effect, independent of the size of sample(s) being used and the decision rule (alpha)

63
Q

What is cohen’s d?

A

A standard measure of effect size

64
Q

What does cohen’s d measure?

A

The size of the treatment effect in terms of standard deviation

65
Q

What is the formula for cohen’s d?

A

d= (μ with treatment - μ with no treatment)/σ

66
Q

T or F: Cohen’s d is an estimation value.

A

True

67
Q

Why is cohen’s d an estimated value?

A

Because the population mean after treatment is unknown, so the treated sample must be used in its place as an estimate of what it would actually be

68
Q

What range of values for cohen’s d indicate a small effect size?

A

0.2 ≤ d < 0.5

69
Q

What range of values for cohen’s d indicate a medium effect size?

A

0.5 ≤ d < 0.8

70
Q

What range of values for cohen’s d indicate a large effect size?

A

0.8 ≤ d

71
Q

When referencing overlapping distributions, what does cohen’s d help identify?

A

The degree of separation between two overlapping distributions

72
Q

What is the power of a statistical test?

A

The probability that the test will correctly reject a false null hypothesis

73
Q

As effect size increases, what happens to the power?

A

As effect size increases, so does the power of the test

74
Q

How does sample size affect power?

A

In general, a larger sample produces a greater power for a hypothesis test

75
Q

How does alpha level affect power?

A

Reducing the alpha level will reduce the power of the test

76
Q

What do confidence intervals measure?

A

Confidence intervals estimate the possible range of values for the potential mean of the unknown population that would correspond with the sample mean

77
Q

What is the formula for confidence intervals?

A

CI= M ± (critical z for that level of confidence) σM