Chapter 14 exam

Question 1

________________ is a replication study in which researchers repeat the original study as closely as possible to see whether the original effect shows up in the newly collected data.

Answer 1

Direct replication

Question 2

__________________ is a replication study in which researchers examine the same research question (the same conceptual variables) but use different procedures for operationalizing the variables.

Answer 2

Conceptual replication

Question 3

________________ is a replication study in which researchers replicate their original study but add variables or conditions that test additional questions.

Answer 3

replication-plus-extension

Question 4

___________________ is a series of related studies, conducted by various researchers, that have tested similar variables.

Answer 4

Scientific literature

Question 5

A ____________________ is a way of mathematically averaging the effect sizes of all the studies that have tested the same variables to see what conclusion that whole body of evidence supports.

Answer 5

Meta-analysis

Question 6

The __________________ is when one might overestimate the support for a theory because studies finding null effects are less likely to be published than studies finding significant results, and are thus less likely to be included in such reviews.

Answer 6

File drawer problem

Question 7

_________________ is when researchers create an after-the-fact hypothesis about an unexpected research result, making it appear as if they predicted it all along.

Answer 7

HARKing

Question 8

________________ is a family of questionable data analysis techniques, such as adding participants after the results are initially analyzed, looking for outliers, or trying new analyses in order to obtain a p value of just under .05, which can lead to nonreplicable results.

Answer 8

p-hacking

Question 9

_____________________ is the practice of sharing one’s data, hypotheses, and materials freely so others can collaborate, use, and verify the results.

Answer 9

Open science

Question 10

_______________________ is when psychologists provide their full data set on the Internet so other researchers can reproduce the statistical results or even conduct new analyses on it.

Answer 10

Open data

Question 11

_______________________ is when psychologists provide their study’s full set of measures and manipulations on the Internet so others can see the full design or conduct replication studies.

Answer 11

Open materials

Question 12

_____________________ is a term referring to a study in which, before collecting any data, the researcher has stated publicly what the study’s outcome is expected to be.

Answer 12

Preregistered

Question 13

___________________ is the extent to which the tasks and manipulations of a study are similar to real-world contexts; an aspect of external validity.

Answer 13

Ecological validity

Question 14

__________________ is a researcher’s intent for a study, testing association claims or causal claims to investigate support for a theory.

Answer 14

Theory-testing mode

Question 15

______________________ is the intent of researchers to generalize the findings from the samples and procedures in their study to other populations or contexts.

Answer 15

Generalization mode

Question 16

______________________ is the extent to which a laboratory experiment is designed so that participants experience authentic emotions, motivations, and behaviors.

Answer 16

Experimental realism

Question 17

A _________________ is a real-world setting for a research study.

Answer 17

Field setting