Week 11 Flashcards

1
Q

What are four inferential statistical tests?

A
  1. Correlation
  2. Simple Regression
  3. Chi-square
  4. t-tests
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What does correlation measure?

A

Are two variables related

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does simple regression predict?

A

Predicts one (continuous) variable from another (continuous) variable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are two types of chi-square?

A
  1. goodness of fit (on categorical variable)

2. test of independence (two categorical variables)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the three types of t-tests

A
  1. single sample (one continuous variable)
  2. independent groups (two levels of one continuous variable)
    - between subjects design
  3. paired-samples (two levels of one continuous variable)
    - within subjects design
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What does a confidence intervals show?

A

The range of plausible values for the parameter

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is shown in a between groups confidence interval?

A

If the CIs overlap <25% difference, then it is statistically significant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is shown in a within-groups confidence interval?

A

If CIs do not overlap then the difference is statistically significant
If CIs overlap, statistical significance cannot be inferred

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What does a confidence interval show in relation to effect size?

A

The magnitude of effect in standardised units

-emphasis on the data, not statistical significance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

When are t-tests used?

A

When we are interested in whether the means of two populations differ

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is done if there are multiple means to compare?

A

-could choose multiple t-tests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is a problem with conducting multiple t-tests (2)?

A
  • having to conduct many tests

- each test has a .05 probability of a type 1 error, so making many tests increases type 1 error rate

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is analysis of variance (ANOVA) used for?

A

Testing hypotheses involving multiple means in a single test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the simplest ANOVA test of variance?

A

One-way Anova

-One IV (factor) with two or more levels

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What type of test is a one-way ANOVA?

A

It is an omnibus test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does the null hypothesis tell us in a one way anova?

A

That all means are equal.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

In a one-way ANOVA, what does rejecting the null hypothesis mean?

A

Deciding that some means differ. A statistically significant result is ambiguous.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is total variance in terms of a one-way ANOVA?

A

Variance of all scores around the grand mean.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What does between-groups variance mean in a one way ANOVA?

A

Variance is due to the independent variable.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What does a variance in a within-groups (error) design mean?

A

Variance that is unaccounted for.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What are the three types of variance that ANOVA partitions into?

A
  • total variance
  • between groups
  • within groups (error)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

How do you total the whole variance of data in an ANOVA?

A

total=between groups + within groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Who is the statistic from ANOVA “F” named after?

A

Sir Ronald Fisher

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

In a one way ANOVA, what assumption is made about independence?

A

For a between-group Anova, each participant only contributes one score.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Q

In a one way ANOVA, what assumption is made about normality?

A

Data within groups should be normally distributed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
26
Q

In a one way ANOVA, what assumption is made about homogeneity of variance?

A
  • variance of scores within groups should be equal for all groups
  • tested using Levene’s test
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
27
Q

In a one-way ANOVA, what assumption is made about outliers?

A

There should be no outliers in any group’s scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
28
Q

If a homogeneity of variance is intact using Levene’s test, what will the p value be?

A

p>.05

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
29
Q

If the homogeneity of variance is violated using Levene’s test, what will the p value be?

A

p

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
30
Q

What can be used to assess the homogeneity of variance?

A

Levene’s test.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
31
Q

What is the homogeneity of variance decision based upon?

A

The p value.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
32
Q

In a homogeneity of variance, if p > .05, what do we infer?

A

We do not reject the assumption that variances are equal. Therefore we can conclude that the homogeneity of variance assumption is intact.

33
Q

What can also be used to ‘enhance’ Levene’s test?

A

Hartley’s F max.

34
Q

What are the two steps to find Hartley’s F max?

A
  1. Find group with largest variance (SD^2) and the group with the smallest variance
  2. Divide largest variance by smallest variance
35
Q

What is calculated in ANOVA tests?

A

Involves calculating sums of squares (SS)

36
Q

How do we calculate an ANOVA?

A

It is the sum of squared deviations of scores about their mean.

37
Q

What yields a mean square?

A

By dividing a sum of squares by its degrees of freedom.

38
Q

What is sample variance?

A

A mean square.

39
Q

What is the square root of variance in an ANOVA test?

A

The standard deviation

40
Q

What does SStotal mean?

A

The sum of squares of all scores from the grand mean

41
Q

What does SSBetween mean?

A

The sum of squares of group means from grand mean. Reflects variance due to IV (treatment)

42
Q

What does SSWithin mean?

A

The sum of squares of individual scores about their group mean. Reflects variance due to error (unaccounted for variance).

43
Q

How is the SStotal calculated?

A

SStotal=SSBetween+SSWithin

44
Q

With within-groups variance, how can some of the total variance be accounted for using Hartley’s F?

A

By differences among subjects

-random variance

45
Q

With between groups variance, how can some of the total variance be accounted for using Hartley’s F?

A

By effects of conditions

-variance due to condition

46
Q

Using Hartley’s F, if the variance that is associated with the IV is greater than the random variance, what will F exceed?

A

F will exceed 1.0.

47
Q

What are two things to remember when accounting for variability?

A
  1. random factors will create variability among subjects AND variability among group means
  2. Reject null when between-groups variance is so large relative to within-group variance that it would rarely occur if only purely random processes were working
48
Q

What does k stand for in an ANOVA test?

A

the number of groups

49
Q

What does n stand for in an ANOVA test?

A

the number of participants per group (assuming equal group size)

50
Q

What does N stand for in an ANOVA test?

A

the total number of participants

51
Q

A statistically significant F-test involving three or more means is what?

A

Ambiguous: which means differ? Follow up tests are pairwise, which is a series of t-tests between pair of means in the set

52
Q

What is a problem with multiple comparisons of an F-test?

A

Increases the chance of making at least one type 1 error

-family wise error rate

53
Q

What is a type 1 error?

A

Assuming that the null is actually true.

54
Q

What does a conservative multiple comparisons test do?

A

They maximally control Type 1 errors (false positives)

55
Q

What are the benefits and drawbacks of doing a conservative multiple comparison test?

A

benefit: risk of making at least one Type 1 error is no greater than 5%
drawback: minimising type 1 errors increases the risk of Type 2 errors (false negatives)

56
Q

What does a liberal test do?

A

Reduces the risk of Type 1 errors, but not as much as conservative tests

57
Q

What are the benefits and drawbacks of a liberal test?

A

Benefit: Greater statistical power to detect a true effect
Drawback: Risk of a false positive is higher than for conservative tests

58
Q

What is the most conservative of all multiple comparison tests?

A

The Bonferroni test. It is simple and effective.

59
Q

How does a Bonferroni test adjust p-values required for statistical significance?

A

By dividing desired alpha level by the number of tests performed

60
Q

How would a bonferroni test do a multiple comparison test with four IV levels?

A
  1. Six pairwise comparisons to test all possible differences

2. Bonferroni-adjusted so that p = .05/6 = .008.

61
Q

In a Bonferroni test, when are p-values declared significant?

A

When p-values are less than adjusted p values.

62
Q

When is a Bonferroni test best used and why?

A

Best used when the number of comparisons is small, because adjustment is severe when many comparisons are required.

63
Q

What are four characteristics of Tukey’s Honestly Significant Difference (HSD) test?

A
  1. Moderately conservative and very popular
  2. Required p value calculated using the studentised range statistic
  3. Test is performed by determining difference between means required for significance
  4. Great choice when number of required comparisons is relatively large
64
Q

What is the most liberal test?

A

“Fisher’s protected least significant difference test”

65
Q

Is there an adjustment to the p-value in a “Fisher’s protected least significant difference test?”

A

No.

66
Q

how does a “fisher’s protected least significant difference test” control the Type 1 error rate?

A

By requiring statistically significant omnibus test (ANOVA) before interpreting results

67
Q

Which two tests do not require ANOVA to be significant?

A

Bonferroni and Tukey.

68
Q

When should “Fisher’s protected least significant difference test” be used?

A

When ANOVA is significant and there are only three means.

69
Q

Where can we use “Fisher’s protected least significant difference test?”

A

In jamovi

-no correction option for post-hoc tests

70
Q

What are two examples of when repeated-measure ANOVA can be used?

A
  1. When IV is a within-subjects factor

2. extension of paired-samples t-test for three or more conditions

71
Q

What are two assumptions about Independence when using a repeated-measures ANOVA?

A
  1. Scores for different participants must be independent

2. BUT scores within a participant will NOT be independent

72
Q

What are two assumptions about normality when using a repeated measures ANOVA?

A

data within groups should be normally distributed

73
Q

What are two assumptions about sphericity when using a repeated measures ANOVA?

A
  1. variance of scores within groups should be equal for all groups
  2. tested using Levene’s test or (and) Fmax < 4.0 : largest variance/smallest variance
74
Q

What is the assumption about outliers when using a repeated measures ANOVA?

A

No outliers in any group’s scores.

75
Q

Repeated measures ANOVA has an assumption of sphericity, NOT:

A

homogeneity of variance

76
Q

What is sphericity?

A

Difference scores can be calculated between adjacent conditions. Sphericity requires equal variance for sets of difference scores.

77
Q

What are some steps to use repeated measures ANOVVA in jamovi?

A
  1. setup factors and levels
  2. move variables into repeated measures cells
  3. select options (e.g to test sphericity, post-hoc correction)
  4. results will show effect size, p value, df and whether the sphericity assumption has been violated
78
Q

In critically reviewing a repeated measures design, what needs to be assessed in terms of practise effects?

A
  • are different word lists used for the three conditions?

- if different lists have been used are they equivalent in terms of difficulty?

79
Q

In critically reviewing a repeated measures design, what needs to be assessed in terms of practise effects?

A

how was the potential for sequence effects controlled?