Lecture 10

Question 1

What does significance mean?

Answer 1

• statistical significance

- although scores may look different, they might not be statistically different

Question 2

What is the significance’s impact?

Answer 2

• practical significance

- practical decisions are more subjective and based on the reasons for conducting the study in the first place

Question 3

Practical significance can be described as ____ ____ in research.

Answer 3

effect sizes

Question 4

Internal validity:

Answer 4

• can you conclude that the findings are based on the manipulation of the independent variable?
• is the relationship causal?

Question 5

External validity:

Answer 5

is there an interest in generalizing the findings to other populations or settings?

Question 6

Construct validity:

Answer 6

can we generalize to the constructs?

Question 7

Logical validity:

Answer 7

have the researchers provided a convincing justification for all aspects of the research project?

Question 8

Logical validity refers to:

Answer 8

• the quality of the researchers’ arguments
• their application of theory to support the needs of for the study
• the appropriate interpretation of results based on the data

Question 9

Logical validity relates to:

Answer 9

• purpose statement
• research question/hypotheses
• methodological coherence

Question 10

To assess logical validity, we must examine the ____ ____ of researchers arguments and ____ ____ from the beginning to the end of their research.

Answer 10

• logical flow

- decision making

Question 11

In assessing logical validity, we need to read and critically evaluate the entire research report, which includes:

Answer 11

• intro and lit review
• study purpose
• hypotheses
• research methods (study design, participants, measures, data analysis)
• results
• conclusions

Question 12

_____ and _____ error play a role in logical validity.

Answer 12

• type I

- type II

Question 13

Another way to support logical validity is to ensure ____ research is being ____ appropriately.

Answer 13

• previous

- cited

Question 14

6 steps to ensuring previous research is being cited appropriately:

Answer 14

1. read and critically evaluate all literature to be cited
2. clearly note the kind of evidence claimed for each citation
3. clearly summarize experimental effects
4. critically present all sides and consensus in research
5. emphasize reliable sources and original evidence
6. strive for perfection in referencing details

Question 15

_____ is at the heart of quantitative research.

Answer 15

measurement

Question 16

Without strong measures of variables, the resulting research findings are…

Answer 16

of little use

Question 17

We want measures that are both ____ and ____.

Answer 17

• reliable

- valid

Question 18

5 potential ways to evaluate construct validity:

Answer 18

• have the tool reviewed by experts in the field
• examine consistency in the scores across multiple measurements
• compare groups with known differences to detect differences on the tool
• correlate the tool with other measures that already have well-established construct validity evidence
• test how sensitive the tool is