Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

SEM 1 Research Methods > Open science > Flashcards

Open science Flashcards

1
Q

What term is used to describe a methodological crisis in which the results of the studies were unable to be replicated/reproduced when tested again?

A

Replication crisis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Describe the Replication Crisis

A

A methodological crisis in which the results of the studies were unable to be replicated/reproduced when tested again

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What happens when an experiment faces a replication crisis?

A

Inaccurate/not trustworthy = affects several scientific disciplines

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What influences a replication crisis in an experiment?

A
  • Researchers feel pressured to publish a novel of sensational findings (their work won’t be published if the study isn’t unique and interesting)
  • Sometimes researchers manipulate their results/hypothesis if they don’t get the results they wanted; in order for their work to appear as sensational and will later be published
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Match the items.

a. research focused on testing hypotheses and research questions

b. research that checks whether using the same experimental methods produces the same results

c. research that checks whether using the same analyses and the same data produces the same results

d. research focused on generating hypotheses and research questions

  1. Replication research
  2. Reproduction research
  3. Confirmatory research
  4. Exploratory research
A
  1. B
  2. C
  3. A
  4. D
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Which of the following is NOT one of the basic principles of Open Science?

a. Open Access

b. Replication Research

c. Teaching Open Science

d. Exploratory Research

A

D

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

For how many years does the APA require researchers to make data available post publication?

a.	0

b.	1

c.	5

d.	10
A

C

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Pre-registration refers to…

a. Making research questions and planned analyses clear prior to data collection

b. Making sure that you keep datasets clearly annotated for future reference

c. Making sure you get an independent researcher to check all analyses performed

d. Making data, code and methods clear and available for wider public use

A

A

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is an open science?

A

“Transparent” research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What research is considered “Transparent” research?

A

When the research has more processes involved in coming up with the research (e.g. a lot of thought went into thinking of the hypothesis, methods etc)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What are the 2 most important aspects of open research?

A

1) Must have good reproducibility
2) Must have good replicability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define reproducibility

A

Getting the same results if we do the experiment ourselves using the SAME DATA and perform the SAME ANALYSES as the study we are trying to reproduce

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define replicability

A

Getting the same results if we do the experiment ourselves following the SAME METHODS as the study we are trying to reproduce

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What term is used to describe this:

Getting the same results if we do the experiment ourselves following the SAME METHODS as the study we are trying to reproduce

A

Replicability = SAME METHODS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What term is used to describe this:

Getting the same results if we do the experiment ourselves using the SAME DATA and perform the SAME ANALYSES as the study we are trying to reproduce

A

Reproducibility = SAME ANALYSES and SAME DATA

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the term used to refer to unrestricted public access to research?

A

Open access

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define open access

A

The unrestricted public access to research

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What are the benefits of open access? List 4 benefits

A

1) Accumulation of knowledge

2) Increased citation of work (work will be more likely to be recognised)

3) More media coverage

4) Support meta-research practice (reanalyse data with data received from other published studies; larger data set)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What must researchers share if they want to publish their work, according to the APA guidelines? List 3 requirements

A

1) Data

2) Protocols

3) Code for experiments and analyses

20
Q

What are the benefits of open data, materials/protocols and code?

A

1) Verification = results can be checked to minimise errors and biases

2) Analytic reproducibility = checking which steps were taken to prepare and analyse the data

21
Q

Define Verification

A

Verification = results can be checked to minimise errors and biases

22
Q

Define Analytic reproducibility

A

Analytic reproducibility = checking which steps were taken to prepare and analyse the data

23
Q

What term is used to describe when results can be checked to minimise errors and biases?

A

Verification

24
Q

What term is used to describe checking which steps were taken to prepare and analyse the data?

A

Analytic reproducibility

25
Q

What are reproducible analyses?

A
  • Data must be organised
  • The study must provide materials to enable others to generate the same exact results as those reported
26
Q

How do you provide materials to enable others to generate the same exact results as those reported?

A

Adequate documentation must be kept such as:

1) Provide clear annotations of what the documents are

2) Store original data files separately

3) Record all steps of data processing

4) Use open-source software where possible

27
Q

When wanting to publish studies, what do researchers need to do in order to be considered for publishing (to ensure ethical experiments and results)?

A

Pre registration

28
Q

What is preregistration?

A

When researchers are encouraged to submit their plans for their specific research questions that they wish to address and the analyses they will conduct prior to data collection

29
Q

What is it called when researchers are encouraged to submit their plans for their specific research questions that they wish to address and the analyses they will conduct prior to data collection?

A

Preregistration

30
Q

What are the 2 types of research?

A

1) Confirmatory research

2) Exploratory research

31
Q

What is Confirmatory research?

A

Research that focuses on CONFIRMING hypotheses or research question

32
Q

What is Exploratory research?

A

Research that focuses on GENERATING hypotheses or research questions

33
Q

What type of research focuses on GENERATING hypotheses or research questions

A

Exploratory research

34
Q

Why type of research focuses on CONFIRMING hypotheses or research question?

A

Confirmatory research

35
Q

Which type of research (confirmatory/exploratory) can be preregistered?

A

Confirmatory

36
Q

Why can’t exploratory research be preregistered?

A

Because it does not have a set, structured plan unlike confirmatory research (exploratory research relies on exploring data and conducting as many analyses as possible to create a hypothesis)

37
Q

What is replication research?

A

The process of repeating research to verify findings (using the same methods)

38
Q

What is the purpose of preregistration?

A

Reduce risks of false positive results

39
Q

What will replication research do?

A

Enables confidence in results and helps build theories

40
Q

What are the 2 types of replication research?

A

1) Direct replications

2) Conceptual replications

41
Q

Define Direct replications

A

Repeat everything done in the original study exactly (reproduce the elements that produced the original findings)

e.g. Use the same number of participants, exact same stimuli and the same number of trials as the original study

42
Q

Define Conceptual replications

A

Repeat the original study but change at least 1 aspect of it

e.g. Use a different sample or a different stimuli to the original study

43
Q

What type of replication involves repeating everything done in the original study exactly as it was done (reproducing the elements that produced the original findings)?

A

Direct replication

44
Q

What type of replication involves repeating the original study but changing at least 1 aspect of it?

A

Conceptual replication

45
Q

What is the purpose of direct replications?

A

To assess whether similar findings are produced in subsequent attempts

(whether you get similar results to the original study if you use the same exact methodology over and over again)

46
Q

What is the purpose of conceptual replications?

A

To assess whether similar findings are produced under different conditions (whether you get similar results to the original study if you change some parts of the study methodology)

47
Q

Why do we teach open science?

A

1) To promote the best ethical practice
2) To increase critical evaluation of research

SEM 1 Research Methods (14 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions