Replication Flashcards
what is meant by HARKing?
hypothesising after the results are known which increases the chances of false positives
what is meant by replication?
Repeating research to examine the extent to which original research findings generalise across time and situations
What is meant by conceptual replication?
Scientist tried to confirm that finding using a different set of methods of measures that has the same hypothesis
What is meant by the replication crisis?
An ongoing crisis in science where researchers find that the results of many scientific studies are difficult or impossible to replicate
What three things influence a replication crisis
A history the incentive structure of academia Questional research practices including: 1) P-hacking 2) garden of forking paths 3) HARKing
what does incentive structure of academia lead to?
Publication bias - phenomenon that significant results have a better chance of being published
what else can incentive structure lead to?
psychologists chasing positive findings p
what is P-hacking?
It occurs when someone overly influences the data collection process or statistical analyses performed in order to produce a statistically significant result
what do psychologists do that cause phacking?
change criteria
run different analyses
drop pps
collect extra data and
what is a RRR?
registered replication report
developed to aid replication - authors submit a detailed description or method and analysis for study and then peer reviewed
Who developed the open science framework? OSF
Brian Nosek
what is meant by a sample size?
the number of pps in a study, small sample sizes may have contributed to the replication crisis because there is a greater chance of type 1 errors - false positives
how many psychology studies successfully replicated in the 2015 many labs study
36%
