Chapter 14: Replication, Transparency, and Real - World Importance

Question 1

Direct Replication

Answer 1

• Researchers repeat an original study as closely as they can to see whether the effect is the same in the newly collected data
• It can never replicate the initial study in every detail

Question 2

Replicable

Answer 2

• Results has been reproduced
• It makes sense that a finding should be replicated in order to be considered important
• Replication gives a study credibility and it is a crucial part of the scientific process

Question 3

Conceptual Replication

Answer 3

Researchers explore the same research question but use different procedures

Question 4

Replication plus Extension

Answer 4

Researchers replicate their original experiment add variables to test additional questions

Question 5

Why Might Replication Studies Fail?

Answer 5

1. Selctive publication
2. Problems with original study/questionable research practice
   - Sample size
   - Harking
   - P-hacking
3. Contextually sensitive effects
4. Number of replication attempts

Question 6

Harking

Question 7

P - Hacking

Question 8

Improvements to Scientific Practice

Answer 8

1. Larger sample sizes
2. Reportes all anayses and variable
3. Open Science Collaboration
4. Prergistration

Question 9

Scientific Literature

Answer 9

• Nice review of the literature
• Consists of a series of related studies conducted by various researchers that have testes similar variables
• It is composed of several studies on a particular topic, often carried out by many different researchers

Question 10

Meta Analysis

Answer 10

• Calculate the average effect size
• Create a mathematical summary of a scientific literature

Question 11

File Drawer Problem

Answer 11

The ideal that a meta - analysis might be overestimating the true size of an effect because Null result and opposite results rarely published

Question 12

Theory - Testing Mode

Answer 12

• External validity often matters less than internal validity
• hey are usually designing correlational or experimental research to investigate support for a theory

Question 13

Generalization Mode

Answer 13

• When researchers want to generalize the findings from the sample in a previous study to a larger population
• They are careful to use probability samples, with appropriate diversity of gender, age, ethnicity and so on
• Frequency claims: always in generalization mode
• Association and causal claims: sometimes in generalization mode

Question 14

Theory Testing Using WEIRD Participants

Answer 14

• Most research in psychology has been conducted on North American college students
• WEIRD = Westestern, educated, industrialized, rich and democratic

Question 15

Ecological Validity

Answer 15

An aspect of external validity in which the focus on whether a laboratory study generalizes to real work settings