Issues in Psychology NAMES Flashcards
Open Science Forum Collaboration (2015)
Out of 97 attempts to replicate a significant findings, only 36% of replicated this finding.
Social psychology is the worst - 23%
Cognitive articles were the best (still bad) - 48%
Shanks et al (2013)
Football hooligan vs proffessor priming - Failed to replicate
Sheilds (2000) (6)
- Psychology has become too preoccupied with ‘attention grabbing findings’
- The media has driven a thirst for controversial publications
- Perhaps the researchers performing the replication studies lack expertise and methodolgical skill
- The original studies may have had smaller sample sizes (false positive is more likely to have occured). Or the sample was (very unlikely) but out of chance and pure luck, unrepresentative.
- Junior researchers publish null findings because they need to become ‘known’, but senior academics may ignore null findings because they are uninteresting.
- The results may have changed over time! E.g., in the 50’s attitudes towards female army officers would be different to today.
Cancer Epidemiology
Published all findings (incluing null). Condensed all findings to a single page to improve consumerability. Plus, more likely that null findings will be read if they are not so dense!
Sheilds, 2000 (3 facts)
- Sig findings published faster
- Sig findings 2x more likely to be published in the first place
- Smaller sample sizes are likely to last longer as ‘relevant’ and be published
Cleophas (1999)
- If everything is published, it will devaluate the existing literature?
- May be a waste of time, null findings are unlikely to be read.
WHO
1/10 people suffer from some kind of mental illness
Keogh & Daly (2009) (avoid mental health p)
- Difficulty getting ethical approval
- Need more resources / time
- May underestimate their cognitive ability and contribution as valid
Keogh & Daly (2009) - gatekeepers
- Act as a middle man
- Uphold the integrity of the methodology
- Prevent the participant being over taxed
- Make sure the research demonstrates an understanding of their responsibilites and provide adequate support
Rivers & Sharman (2018)
Using four popular priming methods from both cognitive and social psychology, they found that using a within-subjects design a) required between 12-72 participants and b) was continually replicated.
However, all but one of the same priming methods were replicated when using a between-subjects design, and the N ranged to nearly a thousand.
This highlights that in fact, the priming content is reliable but the experimental design in which it is used is not.
Also highlights the underappreciated importance of experimental design in considering power and reliability of priming effects.