Open Science Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

Open Science is about increased ______, re-use, participation, cooperation, _______ and __________ for research.

A

transparency
accountability
reproducibility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what does open science aim to improve?

A

The quality and reliability of research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Name 4 principles of open science

A

Inclusion
Fairness
Equity
Sharing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What happened in the Open Scince Collaboration 2015?

A

They couldn’t replicate a lot of studies published in the most prestigious journals :(

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is p hacking?

A

When people manipulate results to get it just under .05!

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Name ways you can get your p under .05

A

Conducting one or more alternative analyses
Transforming data
Removing/including outliers
Adding additional terms in your statistical model
Collecting more data, and retesting, until p < .05

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

we must decide what we do with our outliers ______ our study to avoid ______________ ______________.

A

BEFORE

academic dishonesty

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is another name for publication bias?

A

The file drawer problem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Explain the file drawer problem.

A

results not supporting the hypotheses of researchers often go no further than the researchers’ file drawers, leading to a bias in published research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does a small p value indicate?

A

It indicates strong evidence against the NH.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

The smaller the p value the ______ the evidence behind rejecting NH.

A

stronger

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Why does everyone want their study to be “significant”?

A

Seen as successful, might become famous

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Who decided the p <0.05?

A

Fisher

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What can peer reviews do?

A

They basically double check everything seems good with the study BUT this can still be bias.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Name a possible solution to all this - to do with NH!

A

Ban NH significance testing.
Too easy to pass
Serves as an excuse for lower quality research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Who is banning NH significance testing?

A

BASP - Basic and Applied Social Psychology.

17
Q

What were Wagenmakers suggestions to improve research?

A

Not pretending that small studies are definitive
Improving reporting standards
Publishing non-significant results

18
Q

What do we need to enforce new rules about research?

A

A researchers code of conduct!

19
Q

What are APS journal badges?

A

They are badges that tell us things about that study e.g.
Open data
Open Materials (detailed enough to replicate)
Pre-registered
Open access (not doing it for money)

20
Q

As a solution research needs to be more ______.

A

transparent

21
Q

Who promotes transparency?

A

The Open Science Framework

22
Q

What are ways students can be honest/transparent in their work?

A

Pre-plan sample sizes.

Pre-plan analyses in as much detail as possible. Stick to that plan as closely as possible.

Share as many materials and as much data as possible.

Be as clear and transparent in reporting as possible.