Replication Crisis Flashcards
1
Q
What is replication?
A
For evidence to be considered evidence, it is important that independent labs can run the same experiment and get the same results over and over again. When a paper is published, it has to have been reviewed by other experts to make sure that it is replicable.
2
Q
What and when was the initial spark of the replication crisis?
A
- Feeling the Future (Bem, 2011, JPSP)
- This study was researching pre-cognition or psi
- In this study, 100 participants were shown erotic and non-erotic photos and there were 36 trials where the person had to guess which door the erotic stimulus was behind.
- The actual location of the stimulus wasn’t there until after the participants had made their guess (and was randomly generated by a computer).
- Bem followed all the rules, and his study was published, but the phenomena was something that people didn’t believe.
- So if he was able to publish this rubbish study, what else had been published that was also rubbish?
3
Q
What percent of literature is “real”?
A
The current estimate is 50-60%
4
Q
What are some of the factors that led to ‘less-replicable’ science?
A
1) Institutional pressures to publish
2) You needed to have flashy and significant effects for papers to publish your work
3) There were lots of ways to analyze data, which led to p-hacking
5
Q
What were the solutions to the replication crisis?
A
- Establishing the best statistical and methodological practices to avoid p-hacking
- Revisiting established effects and support for replicating what we thought of as real things
6
Q
What is a stereotype threat?
A
- The concern about confirming a stereotype leads to confirmation of that stereotype
- Evidence of this is mixed, but it’s hard to test
