Open science Flashcards
What term is used to describe a methodological crisis in which the results of the studies were unable to be replicated/reproduced when tested again?
Replication crisis
Describe the Replication Crisis
A methodological crisis in which the results of the studies were unable to be replicated/reproduced when tested again
What happens when an experiment faces a replication crisis?
Inaccurate/not trustworthy = affects several scientific disciplines
What influences a replication crisis in an experiment?
- Researchers feel pressured to publish a novel of sensational findings (their work won’t be published if the study isn’t unique and interesting)
- Sometimes researchers manipulate their results/hypothesis if they don’t get the results they wanted; in order for their work to appear as sensational and will later be published
Match the items.
a. research focused on testing hypotheses and research questions
b. research that checks whether using the same experimental methods produces the same results
c. research that checks whether using the same analyses and the same data produces the same results
d. research focused on generating hypotheses and research questions
- Replication research
- Reproduction research
- Confirmatory research
- Exploratory research
- B
- C
- A
- D
Which of the following is NOT one of the basic principles of Open Science?
a. Open Access
b. Replication Research
c. Teaching Open Science
d. Exploratory Research
D
For how many years does the APA require researchers to make data available post publication?
a. 0 b. 1 c. 5 d. 10
C
Pre-registration refers to…
a. Making research questions and planned analyses clear prior to data collection
b. Making sure that you keep datasets clearly annotated for future reference
c. Making sure you get an independent researcher to check all analyses performed
d. Making data, code and methods clear and available for wider public use
A
What is an open science?
“Transparent” research
What research is considered “Transparent” research?
When the research has more processes involved in coming up with the research (e.g. a lot of thought went into thinking of the hypothesis, methods etc)
What are the 2 most important aspects of open research?
1) Must have good reproducibility
2) Must have good replicability
Define reproducibility
Getting the same results if we do the experiment ourselves using the SAME DATA and perform the SAME ANALYSES as the study we are trying to reproduce
Define replicability
Getting the same results if we do the experiment ourselves following the SAME METHODS as the study we are trying to reproduce
What term is used to describe this:
Getting the same results if we do the experiment ourselves following the SAME METHODS as the study we are trying to reproduce
Replicability = SAME METHODS
What term is used to describe this:
Getting the same results if we do the experiment ourselves using the SAME DATA and perform the SAME ANALYSES as the study we are trying to reproduce
Reproducibility = SAME ANALYSES and SAME DATA
What is the term used to refer to unrestricted public access to research?
Open access
Define open access
The unrestricted public access to research
What are the benefits of open access? List 4 benefits
1) Accumulation of knowledge
2) Increased citation of work (work will be more likely to be recognised)
3) More media coverage
4) Support meta-research practice (reanalyse data with data received from other published studies; larger data set)
What must researchers share if they want to publish their work, according to the APA guidelines? List 3 requirements
1) Data
2) Protocols
3) Code for experiments and analyses
What are the benefits of open data, materials/protocols and code?
1) Verification = results can be checked to minimise errors and biases
2) Analytic reproducibility = checking which steps were taken to prepare and analyse the data
Define Verification
Verification = results can be checked to minimise errors and biases
Define Analytic reproducibility
Analytic reproducibility = checking which steps were taken to prepare and analyse the data
What term is used to describe when results can be checked to minimise errors and biases?
Verification
What term is used to describe checking which steps were taken to prepare and analyse the data?
Analytic reproducibility
