Chapter 14

Question 1

A study must be ____ to be ____, but may not need to be ____ or have ____ to have importance.

Answer 1

replicated to be credible

may not need generalizable or have applicability to have important

Question 2

direct replication

Answer 2

replicates original study exactly

Question 3

conceptual replication

Answer 3

uses same conceptual variables as original but operationalizes them differently

Question 4

replication plus extension study

Answer 4

repeats original and introduces new participant variables, situations, or IV levels

Question 5

meta analysis

Answer 5

collects and averages effect sizes from all studies that have tested the same variables

Question 6

What do psychological scientists now do to strengthen the verifiability and replicability of studies?

Answer 6

Promote open data, open materials, and preregistration

Question 7

what are some questionable practices that may produce findings that cant be replicated

Answer 7

underreporting null results, p hacking, hypothesizing after results are known (HARKing)

Question 8

Importance of external validity depends on ..

Answer 8

whether researchers are operating in generalization mode or theory testing mode

Question 9

theory testing mode

Answer 9

Researchers design studies that test a theory, leaving generalization for future studies
In this case external validity less important than internal validity
Lab studies conducted in this mode may have strong experimental realism

Question 10

generalization mode

Answer 10

researchers focus on whether their samples are representative, whether the data from sample apply to population of interest, and if data may apply to new population of interest

Question 11

what mode are researchers in who make frequency claims

Answer 11

generalization mode

Question 12

true or false; Research does not need to be conducted in a field setting to have ecological validity

Answer 12

true

Question 13

p hacking

Answer 13

A family of questionable data analysis techniques, such as adding
participants after the results are initially analyzed, looking for
outliers, or trying new analyses in order to obtain a p value of just
under .05, which can lead to nonreplicable results.

Question 14

what does HARKing stand for?

Answer 14

(hypothesizing after results are known)

Question 15

what is HARKing

Answer 15

A questionable research practice in which researchers create an afterthe-
fact hypothesis about an unexpected research result, making it
appear as if they predicted it all along.

Question 16

preregistration

Answer 16

A term referring to a study in which, before collecting any data, the
researcher has stated publicly what the study’s outcome is expected to
be.

Question 17

Experimental realism:

Answer 17

The extent to which a laboratory experiment is designed so that
participants experience authentic emotions, motivations, and
behaviors.