Psych 124 Flashcards

You may prefer our related Brainscape-certified flashcards:
1
Q

what is NOT recommended to decrease the rate of false-positive findings that researchers report:

A

researchers should only publish results that are statistically significant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

They hypothesised that amateurs would score more highly than professionals. Their results found the opposite. They write up a paper for publication in which they state that they hypothesised that professionals would outscore amateurs. This is an example of which QRP

A

HARKing

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

In terms of null hypothesis significance testing (NHST), a false-positive result can be defined as:

A

The incorrect rejection of the null and the incorrect acceptance of the alternative hypothesis

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

The results obtained indicated that participants in the control group (read pop-culture magazines for 1 hour) were the least accepting of violence and displayed the most violent tendencies. This result was not what Alice was expecting, so she chose not to report this control condition in her paper. By not reporting this condition which QRP is Alice guilty of?

A

Outcome reporting bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Various biases, cognitive and systemic, can lead to negative impacts in terms of the quality of research produced. From the following list, select all biases that would reduce the quality of research for a given domain:
a. Automation bias
b. Publication bias
c. Reporting bias
d. Gender bias
e. Citation bias
f. Confirmation bias

A

b,c,e,f
Publication bias
reporting bias
citation bias
confirmation bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Conducting a rigorous meta-analysis can be extremely challenging. From the list below, select the features that can cause problems for a meta-analysis or otherwise reduce the quality of the meta-analysis:
a. Incomplete reporting
b. Publication bias
c. Outcome switching
d. Transparent materials and data
e. Studies published as registered report format articles
f. Following reporting guidelines, such as PRISMA.

A

a, b, c
incomplete reporting
publication bias
outcome switching

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

From the list below, select the examples that only apply to Registered Reports:

a. Methods can be submitted in full or in part.

b. Publication of the full study is guaranteed if the first version is accepted.

c. All the hypotheses must be in the first version.

d. Alterations from the first published version of the methods should be stated in the final published version.

e. It is still possible for p-hacking to take place.

A

b, c
publication of the full study is guaranteed

all hypotheses must be in the first version

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

According to Martinson et al. (2005) which of the following was not true?:

a. The most common questionable research practice was inadequate record keeping

b. Mid-career scientists were significantly more likely to report having engaged in some questionable research practices.

c. Failure to report an association with a funding body was more common than changing results to satisfy a funding body.

d. Falsifying research data was the least common questionable research practice

A

c
Failure to report an association with a funding body was more common than changing results to satisfy a funding body.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

John et al. (2012) also looked at the prevalence of questionable research practices and found which of the following:

a. The prevalence of QRPs was not significantly different between domains of Psychology

b. Deciding to collect more or to collect less data than planned were both common.

c. Participants who were offered a sliding scale of charity donation admitted to more QRPs than those who were not

d. The most common QRPs were HARKing and p-hacking.

A

b,c
Deciding to collect more or to collect less data than planned were both common.,

Participants who were offered a sliding scale of charity donation admitted to more QRPs than those who were not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Anna is a developmental psychologist who conducted a study in 2015 on infants’ response to adult speech and found that 3-month-old infants prefer infant-directed speech to adult-directed speech. In 2020, she ran a study online using a modified experimental paradigm Carrying out a study in this way (with slight modifications) is an example of

A

A partial replication

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Anna, in the study on infants’ preferences for different types of speech, despite the changes to the design, still found infants preferred for infant-directed speech. These results are most likely:

A

Generalisable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

School A- improvement
School B – no change
School C – improvement
School D – worsening
School E – no change

Based on these results, the occupational therapist starts to write up their data and decides to publish only results from schools A, B and C. This is an example of

A

The file drawer problem
bias away from the null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Select any reasons why she might decide on a meta-analysis over a systematic review
a. A meta-analysis will include publishing the reasons for selection of studies to be included.

b. A meta-analysis might include unpublished studies as well as published ones.

c. In a systematic review, she might still be citing studies based on whether they agree with her predictions or not.

d. In a meta-analysis statistical comparisons will be carried out between datasets that may have different outcomes.

e. A meta-analysis must include more than 10 studies whereas a systematic review can include fewer than this.

A

d
In a meta-analysis statistical comparisons will be carried out between datasets that may have different outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Various biases, cognitive and systemic, can lead to negative impacts in terms of the quality of research produced. From the following list, select all biases that would reduce the quality of research for a given domain:

a. Confirmation bias

b. Gender bias

c. Publication bias

d. Reporting bias

e. Citation bias

f. Automation bias

A

a, c, d, e
Confirmation bias
publication bias
reporting bias
citation bias

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Which of the following types of files indicate good data sharing practices:

a. PDF data files

b. Meta-data files

c. Supplementary materials files hosted by the publishing journal

d. Raw data files

e. README files

f. Software-specific data files

A

b,d,e
raw data
meta data
README

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Which of the following are examples of negligent errors.
a. Flawed research design

b. Poor measure selection

c. Coding errors

d. Failure to calculate the minimum sample size required

e. Rounding errors

f. Typos

A

a, b, d

Flawed research design
poor measure selection
failure to calculate the minimum sample size

17
Q

Which of the following are examples of careless errors?

a. Flawed research design

b. Rounding errors

c. Failure to calculate the minimum sample size required

d. Poor measure selection

e. Typos

f. Coding errors

A

b, e, f
Coding errors,

Typos,

Rounding errors

18
Q

What is the purpose of assigning a DOI?

A

It provides a digital ID for intellectual-property trading

It facilitates digital data preservation over the long term

It facilitates data sharing and transparency.

19
Q

What is automation bias?

A

The tendency to favour suggestions from automated systems, and to ignore contradictory info made without automation

20
Q

What is Confirmation Bias?

A

The tendency to seek out and interpret information to confirm our existing beliefs

21
Q

What is outcome reporting bias?

A

When researchers select outcomes for publication based on the knowledge of the results and statisitcal significance level

22
Q

What must be included in a pre-registered report?

A

All hypotheses must be in the first version

publication of the full study is guaranteed if the first version is accepted

23
Q

What is citation bias?

A

The tendency for articles to observe positive results and be cited over those that don’t

24
Q

What is publication bias?
(file drawer problem)

A

The idea that journals are more likely to publish studies with type 1 errors, rather than those that are correctly non-significant

25
Q

What causes false positives? (4)

A

Publication bias
Researcher degrees of freedom
lack of transparency
Human error

26
Q

What are the FAIR principles?

A

Findable
Accessible
Interoperable
Reusable