Open Science Flashcards
Open Science is about increased ______, re-use, participation, cooperation, _______ and __________ for research.
transparency
accountability
reproducibility
what does open science aim to improve?
The quality and reliability of research
Name 4 principles of open science
Inclusion
Fairness
Equity
Sharing
What happened in the Open Scince Collaboration 2015?
They couldn’t replicate a lot of studies published in the most prestigious journals :(
What is p hacking?
When people manipulate results to get it just under .05!
Name ways you can get your p under .05
Conducting one or more alternative analyses
Transforming data
Removing/including outliers
Adding additional terms in your statistical model
Collecting more data, and retesting, until p < .05
we must decide what we do with our outliers ______ our study to avoid ______________ ______________.
BEFORE
academic dishonesty
What is another name for publication bias?
The file drawer problem
Explain the file drawer problem.
results not supporting the hypotheses of researchers often go no further than the researchers’ file drawers, leading to a bias in published research
What does a small p value indicate?
It indicates strong evidence against the NH.
The smaller the p value the ______ the evidence behind rejecting NH.
stronger
Why does everyone want their study to be “significant”?
Seen as successful, might become famous
Who decided the p <0.05?
Fisher
What can peer reviews do?
They basically double check everything seems good with the study BUT this can still be bias.
Name a possible solution to all this - to do with NH!
Ban NH significance testing.
Too easy to pass
Serves as an excuse for lower quality research
Who is banning NH significance testing?
BASP - Basic and Applied Social Psychology.
What were Wagenmakers suggestions to improve research?
Not pretending that small studies are definitive
Improving reporting standards
Publishing non-significant results
What do we need to enforce new rules about research?
A researchers code of conduct!
What are APS journal badges?
They are badges that tell us things about that study e.g.
Open data
Open Materials (detailed enough to replicate)
Pre-registered
Open access (not doing it for money)
As a solution research needs to be more ______.
transparent
Who promotes transparency?
The Open Science Framework
What are ways students can be honest/transparent in their work?
Pre-plan sample sizes.
Pre-plan analyses in as much detail as possible. Stick to that plan as closely as possible.
Share as many materials and as much data as possible.
Be as clear and transparent in reporting as possible.
