Ch7 - Hypothesis Testing with z Tests Flashcards

1
Q

What are the 3 ways to identify the same point beneath the normal curve?

A

raw score, z score, and percentile ranking

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What information does the z table give us?

A
  • provides the % of scores between the mean and a given z value
  • how we transition from one way of naming a score to another
  • gives us a way to state and test hypotheses by standardizing different kinds of observations onto the same scale
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In using the z table, we can determine:

A
  • Percentile rank - the % of scores below the z score
  • % of scores above the z score
  • The scores at least as extreme as the z score, in both directions (Scores extreme enough to be below the z score or above - thus, can double the total percentage, due to the curve being symmetric)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

The z table and distributions of means: shift focus from…

A
  • the z score of an individual within a group to the z statistics for a group
  • Changes to the equation: we use means rather than individual scores
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are statistical assumptions?

A
  • Think of statistical assumptions as the ideal conditions for hypothesis testing
  • More formally - assumptions: the characteristics that we ideally require the population from w
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What other tests can the assumptions for the z test apply to?

A
  • parametric tests: inferential statistical analyses based on a set of assumptions about the population
  • in contrast - nonparametric tests: inferential statistical analyses that are not based on a set of assumptions about the population
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Assumption 1

A
  • the DV is assessed using a scale measure
  • If it’s clear that the DV is nominal or ordinal, we could not make this first assumption and thus should not use a parametric hypothesis test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Assumption 2

A
  • The participants are randomly selected
  • Every member of the population of interest must have had an equal chance of being selected for the study
  • This assumption is often violated - most likely, participants are convenience samples
  • Must be cautious of generalizing
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Assumption 3

A
  • The distribution of the population of interest must be approximately normal
  • Many distributions are approximately normal, but it’s important to remember that there’s exceptions to this guideline
  • Because hypothesis tests deal with sample means rather than individual scores, as long as the sample size is at least 30, it’s likely that this third assumption is met
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are Robust hypothesis tests?

A
  • produce fairly accurate results even when the data suggest that the population might not meet some of the assumptions
  • Many parametric tests can be conducted even if some of the assumption are not met, and are robust against violations of some of these assumptions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

The 6 steps of hypothesis testing

A
  1. Identify the populations, comparison distribution, and assumptions
  2. State the null and research hypothesis
  3. Determine the character
  4. Determine the critical values, or cutoffs
  5. Calculate the test statistic
  6. Make a decision
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

1: Identify the populations, comparison distribution, and assumptions

The 6 steps of hypothesis testing

A

We consider the characteristics of the data to determine the distribution to which we will compare the sample
- 1) First we state the populations represented by the groups to be compared
- 2) Second we identify the comparison distribution
- 3) Third, we review the assumptions of hypothesis testing

(The information gathered in this step helps us to choose the right hypothesis test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

2: State the null and research hypothesis

The 6 steps of hypothesis testing

A
  • Hypotheses are about POPULATIONS, not samples
  • State the null/research hypotheses in both words and symbolic notation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

3: Determine the characteristics

The 6 steps of hypothesis testing

A
  • State the relevant characteristics of the comparison distribution (distribution based on the null hypothesis)
  • For z tests, we will determine the mean and standard error of the comparison distribution
  • These numbers describe the distribution represented by the null hypothesis and will be used when we calculate the test statistic
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

4: Determine the critical values, or cutoffs

The 6 steps of hypothesis testing

A
  • Critical values/cutoffs: the test statistic values beyond which we reject the null hypothesis (indicate how extreme the data must be, in terms of the z statistic, to reject the null hypothesis)
  • In most cases, we determine 2 cutoffs: one for extreme samples below the mean and one for extreme samples above the mean
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

4: Determine the critical values, or cutoffs - CRITICAL REGION

A
  • Regardless of the chosen cutoff, the area beyond the cutoff, or critical value, is often referred to as the critical region: the area in the tails of the comparison distribution in which the null hypothesis can be rejected
  • These percentages are typically written as probabilities; that is, 5% would be written as 0.5
  • THE PROBABILITIES USED TO DETERMINE THE CRITICAL VALUES, OR CUTOFFS, IN HYPOTHESIS TESTING ARE ALPHA LEVELS (aka p levels)
17
Q

5: Calculate the test statistic

The 6 steps of hypothesis testing

A
  • Use info from step 3 to calculate the test statistic, in this case the z statistic
  • Can then compare the test stats to the critical values to determine whether the sample is extreme enough to warrant rejecting the null hypothesis
  • The p value: probability of finding this particular test statistic, or one even large, if the null hypothesis is true - that is, if there’s no difference between means
18
Q

6: Make a decision

The 6 steps of hypothesis testing

A
  • Using the statistical evidence, we can now decide whether to reject or fail to reject the null hypothesis
  • Reject: if the test statistic is beyond the cutoffs, OR
  • Fail to reject: if the test stat is not beyond the cutoffs
  • If we reject, we know that the p value associated with the test statistic is smaller than the alpha level of 0.05
19
Q

When is a finding statistically significant:

A

if the data differ from what we would expect by chance if there were, no actual difference

20
Q

Hypotheses have two possible sets:

A
  • Directional
  • Nondirectional
21
Q

Directional

Hypotheses have two possible sets

A
  • predicting either an increase or decrease
  • One-tailed test: a hypothesis test in which the research hypothesis is directional, positing either a mean decrease or a mean increase in the DV, but not both (ONE OR THE OTHER), as a result of the IV
22
Q

When is a one-tailed test used?

Hypotheses have two possible sets

A

Only used when the researcher is absolutely certain that the effect cannot go in the other direction or the researcher would not be interest in the result if it did

23
Q

Nondirectional

Hypotheses have two possible sets

A
  • Predicting a difference in either direction
  • Second set of hypotheses (the null) - nondirectional
  • Two tailed test: in which the research hypothesis does NOT indicate a direction of mean difference or change in the DV, but merely indicates that there will be a mean difference (very simplified, will there or won’t there be a mean difference)
24
Q

2 recommendations for reporting results:

Data ethics

A
  • Distinguish clearly between the original hypotheses and those developed after seeing the results
  • Report all variables, experimental conditions, and analyses
25
Q

p-hacking

Data ethics

A

the use of questionable research practices to increase the chances of achieving a statistically significant result

  • Combines the symbol p with “hacking”
  • EX: create criteria for removing scores - like outliers - after initial analyses have been performed, rather than before
  • Can explain the push to preregister studies
26
Q

LECTURES

27
Q

Can we use this same distribution (the normal distribution) to judge whether a sample group mean comes from a population? WHY?

A
  • YES
  • Central limit theorem: as N= a min. 30, sampling distribution of the mean is normally shaped even if actual population distribution isn’t normally shaped
  • Therefore, can use the normal distribution to model the sampling distribution of the mean
  • Helps us find out probabilities of getting various sample means under the null hypothesis, where the population mean is ZERO!
28
Q

What are two ways we can use the normal distribution?

A
  1. Raw scores => z scores => percentile
  2. Raw group mean => z statistic => percentile for the mean
29
Q

What model can we use to solve: “did this sample come from the same population as before? (the null hypothesis, average/”no effect”, population)? Or does it differ (AKA, is it an extremity/outlier)?”

A
  • Use the normal distribution to model the null hypothesis sampling distribution of the mean
  • This is where we can start plotting our p values to determine our answer - if the sample came from the null hypothesis, or extends into the critical regions (where we can then say it is NOT from the same population as before)
30
Q

Two-tailed null hypothesis, H0: μnew = μoriginal, means…

A

That the sample is just another random sample from the same parent population

31
Q

Two-tailed research hypothesis, H1: μnew DOES NOT EQUAL μoriginal, means…

A

That the sample is NOT just another random sample from the same parent population; can prove as statistically significant

32
Q

How do we know if we can reject the null hypothesis?

A
  • Alpha level: The proportion of scores that allows us to argue that a sample didn’t come from the null hypothesis population
  • THAT IT DIFFERS, allowing us to reject the null hypothesis
33
Q

Alpha of rejection cuts off what % of values?

34
Q

To calculate p value:

A

Can look at the z table at the “area beyond z”, and the p value is the number listed

  • Two-tailed tests - double the amount that’s beyond a certain z score
  • One-tailed - keep the amount that’s beyond a certain z score
35
Q

Difference between p value and alpha level:

A
  1. Choose an alpha level. For example, if you’re 95% confident, your alpha level is 0.05.
  2. Run the hypothesis test and calculate the p-value.
  3. Compare the p-value to the alpha level.
  4. If the p-value is less than the alpha level, reject the null hypothesis.
  5. If the p-value is greater than the alpha level, do not reject the null hypothesis.

NHST: determine alpha -> calculate z statistic -> using z, look up p value -> compare p value to alpha level to determine statistical significance

36
Q

Statistical significance:

A
  • A result that’s this extreme or more extreme is unlikely to occur by chance alone, if the null hypothesis is true
  • PASS/FAIL
37
Q

What are the only two outcomes of NHST?

A

pass/fail test - you either reject or retain the null ONLY

  • Null hypothesis: this sample came from the same population
  • Two-tailed research hypothesis: this sample came from a different population that is either shorter or taller than the existing population
38
Q

When do we choose the z test?

A
  • When we have a sample that we are comparing to a population for which we know the mean and SD
  • U and o are population parameters
  • z tests are a parametric test!
  • M and s are sample statistics