Replication crisis Flashcards
Define falsifiability
Conduct studies with potential to disprove the hypothesis
Conformation bias is…
The tendency to seek out information that verifies your theory and not seek information that falsifies it
Compare science with pseudoscience
Science = systematic, consider all, positive criticism, repeatable. Pseudoscience = Anecdotal, considers positives, dismisses criticism, non-repeatable
Define reproducibility
The extent to which consistent results are observed when scientific studies are repeated
What makes psychology a science?
Observation as preferred way of knowing, precision + control of measures, systematic, testability
Define pseudoscience
Claim, belief or practice which is presented as scientific, but lacks valid scientific methodology or supporting evidence
List examples of pseudoscience (4)
Astrology, graphology, phrenology, intelligent design theory
Provide examples of failed replication studies
Facial feedback hypothesis, power pose, priming pose
What are the solutions to solving the crisis? (8)
Replicate, p-hacking, boost power, open data & analysis, pre-registered confirmatory, open science practices, reward open science, open science in hiring decisions
What are the incentives to pursue new ideas? (5)
Publications/publicity, grant income, employment, promotion, fame
Describe p-hacking
Researcher degrees of freedom and decisions made. Increases chances of finding false positive.
Name the 5 ways to make data significant
Stop collecting data at p<0.05, report only p<0.05, use covariates to get p<0.05, exclude participants to get p<0.05, transform data to get p<0.05
List the 3 solutions to p-hacking
Pre-registered analysis plans, transparency in data reporting, increase power/sample size
Why open materials, data and analysis?
Others can replicate work, check data and reproducibility of analysis.
Describe confirmatory research (4)
Theory-driven, hypotheses formed a priori, methods decided a priori, analytical methods decided a priori
