Research Methods B Flashcards

Be the best ever

1
Q

What do parametric tests assume (3)

A

Normal distribution
Homogeneity of variance (if comparing 2 or more groups)
Interval or ratio data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What do non-parametric tests assume

A

Nothing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Advantage and disadvantage of parametric tests compared to non-parametric

A

Adv: More powerful - can detect differences better
Disadv: Less flexible

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

How can a parametric test still be used if parametric assumptions are not met

A

Transform the data to normalise data distributions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Kolmogorov-Smirnov test (K-S)

A

Tests the probability the data belongs to a normal distribution

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Hypothesis and null hypothesis of Kolmogorov-Smirnov test

A

H1: Variable is not normally distributed
H0: Variable is normally distributed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Conclusion if p < 0.05 in Kolmogorov-Smirnov test

A

Significant, reject H0, therefore not normally distributed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Conclusion if p > 0.05 in Kolmogorov-Smirnov test

A

Not significant, accept H0, therefore is normally distributed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What should be reported if SPSS gives p = 0.000 and why

A

0.001, SPSS cannot round past 3 decimal places and p can never be 0

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Levenes test

A

Tests the homogeneity of variance, determines data sets are from the same population or not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Hypothesis and null hypothesis of the Levenes test

A

H1: Variance is not equal
H0: Variance is equal (homogenic)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Conclusion if p < 0.05 in the Levenes test

A

Significant, reject H0, variance is not equal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Conclusion if p > 0.05 in the Levenes test

A

Not significant, accept H0, variance is equal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

How to test whether to use a parametric test

A

Conduct a Kolmogorov-Smirnov test and Levenes test, if p > 0.05 in both then assumptions have been met and a parametric test can be performed

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What kind of data is needed for all parametric tests

A

Interval or Ratio

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Chi-squared ‘goodness of fit’’ test (GF)

A

Compares a samples proportions to that of the population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

How a Chi-squared test works

A

Frequencies of participants are compared to generated expected frequencies based on the null hypothesis (that nothing is going on). If significantly different from observed, results are significant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Different null hypothesis’ for Chi-squared goodness of fit (2) and examples

A

1) No difference between the categories
Eg - the number of men and women are equal
2) No difference between the categories’ frequency distribution
Eg - number of men and women in computing reflects the proportions at the university
(which one is chosen changes the expected frequencies)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Expected frequencies (for Ch-squared goodness of fit) = …

A

proportion of population x sample size

Proportion depends on which null hypothesis chosen

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Chi-squared (X^2) = …

A

sum of ( (frequency observed - frequency expected)^2 / frequency expected )

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Chi-squared ‘test for independence’ (TI)

A

Tells whether two groups are associated or independent of influence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Chi-squared ‘test for independence’ (TI) example

A

Does gender influence smoking frequency

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Chi-squared ‘goodness of fit’’ test (GF) example

A

Are there more men in the computing department than there would be by chance

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

How is expected frequencies calculated for Chi-squared test for independence

A

What the results would be completely down to chance…

= column total x row total / n

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Conclusion if Chi-squared value is lower than critical value found in the table
Results are not significant, accept H0 that nothing is going on
26
How many variables can a Chi-squared test compare at a time
2
27
T-tests
Compare the means of two groups, looking for differences between them (H1), telling us if the difference in means falls n the most extreme 5%
28
Types of t--test (3)
Independent, dependent, one sample
29
Other names for independent t-tests (2)
Unrelated, between groups
30
Other names for dependent t-tests (4)
Related, paired sample, within groups, repeated measures
31
Requirements to conduct a t-test (2)
Data meets parametric assumptions | and is interval or ratio data
32
Independent t-test example H1
Students who do extra reading for their module get higher grades (IV = extra reading, DV = Higher grades)
33
Conclusion if p < 0.05 for an independent t-test
There is an extreme, real difference in groups means, they are a part of different populations
34
Sample distribution of the difference between means
Theory that, if the null hypothesis is correct, plotting all the difference means of randomly selected participants from each group would form a normal distribution curve
35
What does the t statistic from t-tests show
How many standard deviations the difference between the means is from 0
36
One sample t-test
Compares the sample mean with that of a known populations'
37
One sample t-test example
Are 1st year psychology students more intelligent than the population in general (mean IQ = 100)
38
How to report t-tests
t (df) = t-value, p = p-value
39
What does a larger t-value mean
the larger the difference of the means
40
One sample Wilcoxon signed rank test
Tests if the median of the measurement is equal to a specific value (population median), determining whether the sample is part of the general population
41
Requirements for using the One sample Wilcoxon signed rank test (3)
Non-parametric, comparing independent groups (sample and population), interval or ratio data
42
Hypothesis and null hypothesis for the One sample Wilcoxon signed rank test
H1: Median significantly different from population median (can be one-directional) H0: Median similar to population median
43
Conclusion if p < 0.05 in the one sample Wilcoxon signed rank test
Significant, so the median is significantly different from the populations
44
Example of independent t-test
Is there a difference between male and female numerical ability scores
45
Requirements for an independent t-test (2)
Parametric assumptions met, interval or ratio data
46
Conclusion if p < 0.05 for an independent t-test
Significant difference between the groups, a part of different populations
47
For an independent t-test, when should the row 'equal variance not assumed' be used?
Questionable but can be in occasional circumstances when a Levenes test is significant so equal variance cannot be assumed
48
Requirements for Mann-Whitney test (2)
Interval, ratio data (sometimes ordinal) | Non-parametric so no assumptions
49
Mann-Whitney test (U)
Equivalent to independent t-test, it tests whether the distributions of both groups are equal or significantly different
50
What does the U value for Mann Whitney tests mean
the closer to 0, the more the groups medians are equal (H0 being true)
51
Conclusion if p < 0.05 for Mann Whitney test
Significant difference between the groups medians, reflecting a real difference in populations
52
When to use the 'exact sign.' U and p values in the table given for a Mann Whitney test
If the sample is less than 20 (small)
53
What to report when reporting Mann Whitney test results (4)
U-value p-value Z score Medians
54
Effect size (R) = ...
Z / square root N
55
Difference between N and n
``` N = number of all observations n = number of observations in the sample ```
56
Requirement for a dependent t-test (3)
Related groups Parametric assumptions met interval or ratio data
57
What do dependent t-tests typically measure
A sample doing the same thing twice (before and after doing something else) Can also be matched pairs of similar units
58
Example of dependent t-test
Amount of pull-ups done before and after participants train in a bootcamp
59
Conclusion if p < 0.05 in a dependent t-test
Significant, H0 rejected, a significant difference between samples before and after
60
Degrees of freedom = ...
(N.1 - 1) + (N.2 - 1)
61
What to do with results if we have a one-tailed hypothesis
divide the p-value by 2 and then see if its significant
62
When are effect sizes used a lot for comparisons
In medicine and forensics to compare with (eg) results of other drugs
63
Effect size is...
a way to quantify between two groups, it emphasises the size of difference without confounding with the sample The difference between two sample means
64
How effect size can be measured (2) and when should each of these be used
Pearson's r - for non parametric tests | Cohen's d - for parametric tests
65
Small medium and large for Pearson's r
Small: > 0.1 Medium: > 0.3 Large: > 0.5
66
How to calculate Cohen's d
Difference between means divided by the 'pooled' standard deviation for the means
67
Small, medium and large for Cohen's d
Small: 0.2 Medium: 0.5 Large: 0.8 (it can be over 1)
68
What would a small Cohen's d likely mean
A larger sample is needed
69
Wilcoxon signed rank (matched pairs) test
Non-parametric equivalent to repeated measures t-test, it tests the difference of medians for repeated samples
70
Requirements for Wilcoxon signed rank (matched pairs) test (3)
Non parametric Ordinal data or above Repeated samples
71
Conclusion if p < 0.05 for Wilcoxon signed rank (matched pairs) test
Significant difference between the samples medians, accepts H1. They are from different populations
72
What to report for a Wilcoxon signed rank (matched pairs) test (3)
Z value P-value Medians
73
What does N equal for repeated measures design
Still means both samples, so is participants x 2
74
Df =... for chi squared tests
(Number of Rows - 1) x (number of columns - 1)
75
Limitation of a p value
Only gives statistical significance, not real life significance
76
Other name for One sample Wilcoxon signed rank test
Wilcoxon rank sum test
77
z score = ...
x - mean / SD
78
What does a z score mean
The number of standard deviations that the score is away from the mean
79
How to report Chi-squared
X^2(df) = Value, p = p-value
80
How to report a Wilcoxon signed rank / rank sum test
T = T-value, p = p-value... (state medians before) | Slides say only p-value essential for APA format
81
How to report a Mann-Whitney U test
U = U-value, Z = Z-value, p = p-value... state medians before
82
How to report a Wilcoxon signed rank (matched pairs) test?
Z = Z-value, p = p-value... state medians before
83
Different null hypothesis' for Chi-squared test of independence
No relationship between categories | Proportions are the same for the categories
84
Hypothesis for Mann-Whitney test
Probability of observation from one population exceeding the other is more than 0.5
85
Null hypothesis for Mann-Whitney test
Equal distribution of both groups, probability of observation from one group exceeding the other equals the probability of the reverse