Research methods - Inferential testing Flashcards
How do you see if our result is significant?
- Work out the probability that what we have found is due to chance.
- This is expressed as a value, p.
- The smaller the value of p is, the more significant your results are.
What are the steps to find out if your data is significant?
- Collect your data
- Carry out a statistical test
- This gives you the calculated value
- Compare calculated value with the critical value in a statistics table
- Read the table to see if your data is significant, and if so, what level of significance (p)
In psychology, what percentage do we usually aim to be sure that our results are due to a real effect?
- 95% sure
- 5% probability that the null is true
- This is expressed as p=<0.05. This is known as the significance level.
- So p=<0.05 means there is an equal to or less than 5% probability that our results are due to chance.
What does it mean by ‘the results were significant at p<0.05’?
- This means that the result is significant at 0.05 level
- This means there is a less than 5% probability that the difference/relationship found was due to chance
What is a type 1 error?
This is a false positive.
It is accepting the alternate when we should have accepted the null.
What is a type 2 error?
This is a false negative.
It is accepting the null when we should have rejected it.
Why are statistical tests used in psychological research?
Statistical tests are used to determine the likelihood that the effect they have found is due to chance by allowing a significance level to be determined.
What do statistical tests for correlations give us?
A correlation coefficient
calculated value
What is the sign test?
- A test of difference
- Use it for nominal data
- Used to analyse repeated measures or matched pairs design (related)
How do you carry out the sign test?
- For each participant, note whether the sign is +, - or = depending on whether the score in each condition goes down, up or stays the same.
- Count N, which is the number of participants, excluding those with equal (=) scores.
- Count the number of the least frequent sign (- or +).
- This is s.
- Use the sign test table
- See whether the results are significant by seeing the number of N, whether the hypothesis is 1 or 2 tailed and at what level of significance it is at.
What test is used if:
- It is a test of difference
- It is unrelated
- It uses nominal data?
Chi-squared
What test is used if:
- It is a test of difference
- It is related
- It uses nominal data?
Sign test
What test is used if:
- It is a test of difference
- It is unrelated
- It uses ordinal data?
Mann-Whitney
What test is used if:
- It is a test of difference
- It is related
- It uses ordinal data?
Wilcoxon
What test is used if:
- It is a test of difference
- It is unrelated
- It uses interval data?
Unrelated t-test