Chapter 9: Drawing Conclusions

Question 1

An experiment is __________ _____ when the effects on the dependent variable are due to the independent variable.

Answer 1

Internally valid.

Question 2

An internally valid experiment is free of ___________.

Answer 2

Confounding.

Question 3

This evaluates how well the experimenter manipulated the experimental situation.

Answer 3

Manipulation check.

Question 4

This determines whether subjects followed directions and were appropriately affected by the treatments.

Answer 4

Manipulation check.

Question 5

Three (3) mistakes that produce a threat to internal validity.

Answer 5

1. Selecting the wrong statistical test.
2. Improperly using a statistical test.
3. Drawing the wrong conclusions from a test.

Question 6

This is when the findings of an experiment can be extended to other situations and populations.

Answer 6

External validity.

Question 7

This refers to the extent to which the findings of a study can be generalized to, or have relevance for, settings, people, times, and measures beyond the specific conditions of the study.

Answer 7

External validity.

Question 8

The three (3) key components of external validity.

Answer 8

1. Population validity.
2. Ecological validity.
3. Temporal validity.

Question 9

A key component of external validity; asks whether the study participants are representative of the broader population.

Answer 9

Population validity.

Question 10

A key component of external validity; asks whether the study conditions reflect real-world situations.

Answer 10

Ecological validity.

Question 11

A key component of external validity; asks whether the findings are applicable over time.

Answer 11

Temporal validity.

Question 12

To improve external validity, researches can do these three (3) things, which are?

Answer 12

1. Use diverse samples (include participants from various backgrounds, age groups, and settings).
2. Conduct field studies (perform research in natural settings rather than controlled lab settings).
3. Replicate studies (conduct the same study in different contexts to see if findings hold true across various conditions).

Question 13

The two (2) requirements that an externally valid study must satisfy.

Answer 13

1. The experiment must be internally valid.
2. The experimental findings can be replicated.

Question 14

Four (4) reasons for bias in samples.

Answer 14

1. Convenience sampling.
2. Self-selection (individuals who are particularly interested in a topic are more likely to participate, leading to overrepresentation in the group).
3. Limited age range.
4. Explain generalizing from procedures to concepts.

Question 15

A study achieves this when its findings clarify or extend knowledge gained from previous studies and raise implications for broader theoretical issues.

Answer 15

Research significance.

Question 16

When should we question novel (new) findings?

Answer 16

When they contradict prior findings that have been successfully replicated.

Question 17

In 1980, he found that more laboratory than field studies reported a positive correlation between reported attitudes and behavior.

Answer 17

Hanson.

Question 18

This refers to the grouping together and averaging of data to increase external validity.

Answer 18

Aggregation.

Question 19

This uses statistical analysis to combine and quantify data from many comparable experiments to calculate an average effect size.

Answer 19

Meta-analysis.

Question 20

This design studies multiple dependent variables (DVs).

Answer 20

Multivariate design.

Question 21

The method used to analyze multivariate experiments.

Answer 21

Multivariate analysis of variance (MANOVA).