Summa Week 12 Flashcards

1
Q

The _________________ t-test evaluates whether two independent groups or samples come from the same population

A

independent-samples t-test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

A one-way between-subjects ANOVA is a generalization of a __________ t-test, and asks whether ___ or more (k) groups or samples come from the same ______

A

independent-samples t-test
three
population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What would a chart for a 1-way anova look like?

A

Subject Treatment 1 Treatment 2 Treatment 3
Subject 1 Subject 1 Subject 1 Subject 1
Subject 2 Subject 2 Subject 2 Subject 2

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

one-way anova summary table: between subjects

between group SSbetween?

A

dfbetween * MSbetween

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

one-way anova summary table: between subjects

dfbetween?

A

k - 1 (k = number of treatments)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

one-way anova summary table: between subjects

MSbetween?

A

SSbetween/(k-1)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

one-way anova summary table: between subjects

F-value?

A

MSbetween/MSwithin(or error)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

one-way anova summary table: between subjects

SSerror?

A

dferror*MSerror

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

one-way anova summary table: between subjects

dferror?

A

N-k

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

one-way anova summary table: between subjects

MSerror?

A

SSerror/(N-k)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

one-way anova summary table: between subjects

SStotal?

A

SSbetween subjects + SSerror

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

one-way anova summary table: between subjects

dftotal?

A

dfbetween + dferror

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the design for using a One-way within-subjects ANOVA?

A

subjects undergo multiple conditions over time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the most powerful analysis for a 2-sample design?

A

matched-pair samples t-test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

what is required for the matched-pair samples t-test to be the most powerful analysis for a 2-sample design?

A

if the samples are correlated. If they aren’t, then you can’t assume the difference is due to the conditions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

True or false: repeated-measures designs (ANOVA) ask whether three or more (k) correlated groups or samples come from the same population.

A

True!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

True or false: A One-way within-subjects ANOVA is a generalization of an independent samples t-test.

A

False! it is a generalization of a matched-pair samples t-test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

True or false: Repeated measures design can use family members instead of the same participants in research.

A

true. although the same participants is more helpful, similar individuals can be replaced, which refers to the whole “matched-pairs” idea

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What does the one-way within-subjects ANOVA summary table look like, particularly for between subjects?

A

between/inter-subjects

SS between subjects / SSs / dfb (n-1) / MSb = NO F-VALUE OF INTEREST

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What does the one-way within-subjects ANOVA summary table look like, particularly for treatment calculations?

A

treatment / differences due to treatment

SStreatment / SStreatment / dftreatment (k-1) / MStreatment / F=MStreatment/MSerror

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What does the one-way within-subjects ANOVA summary table look like, particularly for error?

A

error = within/intra-subjects (individual) differences

Sourceerror / SSerror / (n-1)(k-1) / MSerror = NO F-VALUE CALCULATED

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the difference between dfbetween for one-way between-subjects ANOVA and df between for one-way within-subjects ANOVA?

A
dfbetween-subjects = N-k
dfwithin-subjects = (n-1)(k-1)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What does the one-way within-subjects ANOVA summary table look like, particularly for total SS?

A

Source total / SStotal / dftotal (n*k-1)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

What is the difference between dftotal for one-way between-subjects ANOVA and dftotal for one-way within-subjects ANOVA?

A

dftotal between-subjects = N-1

dftotal within-subjects = n*k-1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

Why are repeated-measures designs often more powerful?

A

because participants are measured more than one in order to better detect the individual differences and remove them from the analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

How do you find individual differences in one-way within-subjects ANOVA?

A

subtracting them from the error term

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

What is the formula for repeated-measures design ANOVA (SS)?

A

SStotal = SSbetween subjects + SSwithin subjects (between treatments) + SSerror (individual differences)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

What is the F-value for between-subjects in a one-way within-subjects ANOVA?

A

who cares? it isn’t relevant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

What is the F-value for within-subjects in a one-way within-subjects ANOVA?

A

MSwithintreatment/MSerror(individual differences)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What the hell is Sphericity assumption?

A

tests for the null hypothesis that the error covariance matrix of the orthonormalized transformed dependent variables is proportional to an identity matrix (i.e. they are likely to occur from the same population)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What happens if a hypothesis of sphericity is not rejected (p > .05)?

A

we can conclude that sphericity assumption WAS met, and continue with repeated-measures ANOVA analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

How do you determine covariance for subjects in a repeated-measures ANOVA design?

A

checking for assumption of Mauchly’s Test of Sphericity before reporting ANOVA results

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
33
Q

What does Howell say sphericity assumption is?

A

the population variances of the repeated measurements are equal; the population correlations among all pairs of measures are equal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
34
Q

If a violation of the assumption of sphericity occurs, just write that it may have happened in results

A

False. It is a serious concern, which increases the potential for Type I error, so use a different estimate in determining new family-wise error for analysis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
35
Q

What are two estimates that can modify the severity of violation of sphericity assumption?

A

Greenhouse-Geisser, Huynh-Feldt and Lower-bound estimate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
36
Q

Which is more conservative: Greenhouse-Geisser or Huynh-Feldt for violation of sphericity assumption adjusted estimates?

A

Greenhouse-Geisser

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
37
Q

What do you multiuply adjusted estimates of sphericity assumption by to correct for the effect of sphericity?

A

degrees of freedom

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
38
Q

What do we assume about normality in one-way within-subjects ANOVA?

A

we assume they are normally distributed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
39
Q

What do we assume about independence in one-way within-subjects ANOVA?

A

it is NOT assumed that the scores are independent, since that’s what we’re basing our design off of

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
40
Q

What does a one-way within-subjects ANOVA gave>?

A

Source SS df MS F
(Between) Subjects 486.11 8 - -
Treatment 2449.20 4 612.30 85.04
(Within)Error 230.40 32 7.20 -
Total 3166.31 44 - -

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
41
Q

What are tests supplementing a within-subjects ANOVA similar to?

A

those for between-subjects ANOVA!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
42
Q

What is the difference in supplemental tets for within-subjects ANOVA and between-subjects ANOVA?

A

in the computational details in SPSS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
43
Q

True or false: When specific comparisons among means are made on between-subjects variables, an error term for each specific comparison is calculated. The same error term is used for all comparisons when the variable is within-subjects design.

A

False!
within-subjects variables need to compare each error term, whereas between-subjects designs are universally compared with the same error term

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
44
Q

True or false: it is easy to explain if you have significant higher-order trends in within-subjects design.

A

Hell naw

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
45
Q

Which factor do you use when reportin the results of within-subjects contrasts?

a) cubic
b) linear
c) quadratic
d) order 4

A

b) linear??????

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
46
Q

What is another name for order effects?

A

trial effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
47
Q

Does the order in which the participants receives a treatment affect how the participant behaves?

A

Yes!

48
Q

What could be a cause for order effect?

A

the impact of practice effect, or the act of repeating the same task over and over and improving it due to regular practice

49
Q

Other than practice, what can order effect do to repeated measures design tests?

A

the impact of fatigue effects, or decreased performance due to tiredness/less enthusiasm as the experiment continues, whether positive or negative

50
Q

Other than practice and fatigue, what can order effect do to repeated measures design tests?

A

create (treatment) carry-over effects, with that of a treatment administered earlier persisting longer after to also influence proceeding treatments

51
Q

Why do treatment carry-over effects create problems for within-subjects designs?

A

you may believe behaviour is due to treatment administered whereas it is due to a much earlier treatment influence still

52
Q

Other than practice, fatigue, and carry-over effects, what can order effects be due to?

A

sensitization - participant may become sensitive to what the hypothesis is, and/or may behave differently after knowing what the hypothesis really is

53
Q

Other than practice, fatigue, carry-over, and sensitization, what can order effect be due to?

A

sequence effects - if participant receives one sequence of treatments score differently than those participants who receive the treatment in a different sequence, there is an effect
e.g. the ability to assess the sequence effects can answer the question: “Does getting the treatments in one particular sequence cause a group to score higher than a groupgetting the treatments in a different sequence”?

54
Q

True or false?An ANOVA determines which group means significantly vary in the population, and also determines the size of the deviation in the population by comuting a measure of effect size called proportion of deviation

A

False. Although similar, it determines size of variance and proportion of variance

55
Q

What does proportion of variance measure in ANOVA?

A

how much variability in the DV can be accounted for by the levels of the factor

56
Q

What are two measures of proportion of variance used in within-subjects design?

A

partial eta-squared, and partial omega-squared

57
Q

What is the power of one-way within-subjects ANOVA based on?

A

the assumption that observing the same participants across groups will results in more consistent responding or changes in the DV, between groups

58
Q

T or F: the within-subjects design is associated with more power to detect an effect than the between-subjects design

A

true

59
Q

Why is the within-subjects design is associated with more power to detect an effect than the between-subjects design?

A

some of the error in the denominator of the test stat is remover, however it is only true when responding between-groups is CONSISTENT

60
Q

T or F: the within persons variation is measured and subtracted from the error term in the denominator for one-way within-subjects ANOVA.

A

false. the between-persons variation is eliminated, which increases the power of the test by looking only at individual differences

61
Q

True or False: For ANOVA, you can adjust the df so subtracting the between persons variation will not always increase the power of a one-way within-subjects ANOVA.

A

true

62
Q

How to support results of a one-way within subjects ANOVA (step 1):

A

report the test stat, df, and p value

63
Q

How to support results of a one-way within subjects ANOVA (step 2):

A

report the effect size for significant analyses (partial eta squared or partial omega squared)

64
Q

How to support results of a one-way within subjects ANOVA (step 3):

A

the means, SD measured in a study can be summarized in a figure or table or in the main text of the article

65
Q

How to summarize the results of a posthoc within-subjects design test:

A

identify which posthoc test you computed and the p value for significant results

66
Q

Example of reporting within-subjects one-way analysis of variance…

A

A within-subjects one-way analysis of variance showed that ratings of effectiveness for one or three advertisements significantly varied, F(2, 12) = 17.38, p < .05, np^2 = 0.69. Using the Bonferroni procedure, related sample t-tests showed that ratings of effectiveness were significantly greater for the ad with smoking-related cues compared to the ad with generic cues and the ad with no cues (p < .05). Otherwise, no significant differences were evident (p > .05). The means and standard deviations for each group are shown in table…

67
Q

CHI‐SQUARE TESTS

A

A general purpose test for use with discrete/nominal

variables

68
Q

Chi-square tests: Focus on the number of different categories

A

Categories have no order relation (larger/smaller) to each

other (e.g., male/female; university major)

69
Q

Chi-square tests: Focus on the number of different categories

A

Numbers representing categories (e.g., 1= psychology major,
2 = sociology major, 3 = other) cannot be added, subtracted,
multiplied or divided. BUT the counts of the number of
people in each category can be added, subtracted, multiplied
and divided

70
Q

Chi-square tests: assumptions of random sampling

A
Each sample is a random
sample from its population
Considered inappropriate to
conduct if violated, but
some argue it is robust if
violated
71
Q

Chi-square tests: assumption of independence of cases

A

each case is not influenced by other cases, not robust

72
Q

Chi-square tests: expected frequencies assumption

A
All cells must have
expected frequencies of at
least 5, or at least 5 times as
many individuals as
categories (or cells)
Not robust to violations
73
Q

Chi-square test formula (x^2)

A

x^2 = sum of (O-E)^2/E

observed - error

74
Q

Chi square distribution looks like

A

positively-skewed data that goes downward for 1, but then has hills from 0 up and then down as a positive skew

75
Q

Two kinds of chi square tests

A

Distribution shape tests
 Goodness of fit test or one way classification test
 Homogeneity test
 Independence tests
 Or contingency table tests (a*b tables)
 These are often incorrectly called ʺassociation testsʺ (they
are really another kind of goodness of fit test) or ʺTwoway
classificationʺ tests

76
Q

Both two kinds of tests compare the observed frequency of

categories with an expected frequency of categories

A

The expected frequencies are usually derived from the null
hypothesis. But they need not be derived from the null. They
can be derived from almost any theory you want to consider

77
Q

Chi square test levels of a single nominal variable

A

x^2 = sum of (O-E)^2/E

78
Q

Chi-square test in SPSS

A
  1. Data - Weight cases to determine influence

2. Analyze - nonparametric tests - legacy dialogs - chi-square

79
Q

What do you report from SPSS for Chi-square tests?

A

test statistics chi-square x.xxx^a, df 1, asympt. sig. (significance level!) = .xxx

80
Q

Do you indicate the observed or the expected in APA?

A

the expected, since you get the observed in your test

81
Q

Chi-square test calculation value (the goal of finding out the expected frequencies of = IV1 is associated with __times higher/lower than IV2)

A

x^2 = (observed1 - expected1)^2/expected1 + (observed2 - expected2)^2/expected2

82
Q

Can Chi-square tests be negative?

A

hell naw

83
Q

How do we determine independence in chi-square tests?

A

a contingency table between the two NOMINAL variables in the various categories

84
Q

Determining expected frequencies formula

A

E = (Row/N)Column
= (Rowmarginal mean/Ntotal)Column marginal mean
e.g. expected frequency of night people taking their own car
= (Night Row marginal mean 80/200 people total)
own car marginal mean 70
= 28

85
Q

What is the df for Chi-square tests?

A

df = (Ncolumn - 1) (Nrows - 1)

86
Q

What do you report for Chi square tests?

A

x^2(df) = x.xx

87
Q

What is an alternative to Pearson’s chi-square?

A

likelihood ratio test

88
Q

What is the likelihood ratio test based on?

A

a maximum-likelihood theory

89
Q

What is the first step for the likelihood ratio test?

A

create a model for which the probability of obtaining the observed set of data is maximized

90
Q

What is the second step for the likelihood ratio test?

A

this model is compared to the probability of obtaining those data under the null hypothesis

91
Q

What is the third step for the likelihood ratio test?

A

the resulting statistic compareds observed frequencies with those predicted by the model
i and j are the rows and columns of the contingency table, and ln is the natural logarithm
G = 2 (sum of observeij * (Observeij/Expectedij)

92
Q

What has a sampling distribution that approximates the Chi-square distribution?

A

the G statistic

93
Q

How does the G stat sampling distribution approximate the Chi-square distribution?

A

it approximates it with (r-1)(c-1) degrees of freedom when expected values in all cells >=5

94
Q

What are expected values in all cells when approximating the Chi-square distribution?

A

5

95
Q

What test is preferred with small sample sizes: Pearson’s chi-square or likelihood ratio test?

A

likelihood ratio test

96
Q

Using the following data, how would you compare Chi square and G?

O <25 y.o >25 y.o. Total
Male 31(27.7) 5(8.3) 36
Female 42(45.3) 17(13.7) 59
Total 73 22 95

A

X^2 = (31-27.7)^2/27.7 + (5-8.3)^2/8.3 + (42-45.3)^2/45.3 + (17-13.7)^2/13.7
= 0.40 + 1.34 + 0.25 + 0.81
= 2.80
G = 2 x (31ln(31/27.7) + 5ln(5/8.3) + 42 * ln(42/45.3) + 17ln(17/13.7))
= 2 * (3.49 - 2.53 - 3.18 + 3.67)
= 2.90
df = (r-1) (c-1) = (2-1)(2-1) = 1
1 = 1

97
Q

After entering data in SPSS for a likelihood-ratio test, what do you do next?

A

weight cases by selecting Data, then weight cases as the frequencies

98
Q

What do you do in SPSS for a likelihood-ratio test once you’ve weighed the cases?

A

Select Analyze, then descriptive statistics, and in the Crosstabs area put the variables into the boxes and click Statistics, and select “Chi-square and Phi and Cramer’s V”

99
Q

Why do we want to test Chi-square for Cramer’s V?

A

to determine the effect size when NOT using a 2x2 table

100
Q

What is a d-family effect size for Chi-square tests?

A

based on one or more measures of the differences between groups or levels of the independent variable

101
Q

What is an effect size for Chi-square tests that is some sort of correlation coefficient between two IVs?

A

an r-family effect size

102
Q

Who typically uses odds ratio tests?

A

medical professionals

103
Q

How do you determine the d-family effect size (risk ratio or relative risk) ?

A

RR = risk of no treatment / Risk with treatment
= proportion/proportion
= ____ times higher/lower if you DON’T use the treatment than if you

104
Q

What is an odds ratio?

A

An odds ratio, or effect size d-family refers to the odds of something occurring with treatment divided by the number with the result not occurring

e.g. the odds of having a heart attack for a member of the aspirin group is the number having a heart attack divided by the number not having a heart attack

105
Q

What is the odds ratio/d-family effect size formula?

A

OR = odds| no treatment/odds| with treatment
= the odds of a heart attack given that you did not take aspirin were 189/10,845 =0.0174. The odds of a heart attack given that you DID take aspirin were 104/10,933 = 0.0095. the odds ratio is simply the ratio of these two odds. The odds of a heart attack without aspirin are 1.83 times higher than the odds of a heart attack with aspirin.

106
Q

Why does Howell favour the odds ratio method?

A

a) the odds ratio method can calculate situations in which a true risk ratio cannot occur/low probability events, and
b) taking the natural log of the odds ratio [ln(OR)] gives a stat that is useful in a variety of situations such as logistic regression and log-linear models

107
Q

What is Phi effect size?

A

an effect size used in Chi-square tests (nominal x nominal) that represents the correlation between two variables and applies only to 2x2 tables

108
Q

In reporting the chi-square test, what do you report to summarize the goodness-of-fit?

A

test statistic, df, and p value

109
Q

In reporting the chi-square test, how can observed frequencies be summarized?

A

in a figure or table or in the main text

110
Q

In reporting the chi-square test, what else would you use to summarize the test for independence?

A

the effect size i.e. Cramer’s V or phi square test

111
Q

Written summary of a chi-square test for independence

A

The chi-square test for independence showed a significant relationship between the type of counseling and outcome, x^2 (1, N = 300) = 5.39, p = .020, Cramer’s V = 0.22. The data indicates that family involvement in counseling is associated with a greater number of patients completing counseling.

112
Q

____ and _____ frequencies are used in the calculation of the x^2 statistic.

A

observed and expected?

113
Q

When frequency data are collected, we use the _____ to determine how well an observed frequency distribution of two nominal variables fits some expected breakdown.

A

???

114
Q

True or false?: the value of df for a chi-square test does not depend on the sample size (n).

A

False?

115
Q

True or false?: A positive value for the chi-square statistic indicates a positive correlation between the two variables.

A

True?

116
Q

Which of the following is an assumption of x^2 tests?

a. it is a parametric test
b. it is appropriate only for ordinal data
c. the frequency in each cell should be less than 5
d. the sample should be randomly selected

A

c. the frequency in each cell should be less than 5

117
Q

The calculation of the df for the _____ is (r-1) (c-1)

a. independent-groups t-test
b. correlated-groups t-test
c. x^2 test of independence
d. Wilcoxon rank-sum test

A

c. x^2 of independence?