Module 5 Flashcards

1
Q

What is scientific rigor?

A

Internal precision of the exact-ness of the research study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the difference between a nondirectional and a directional hypothesis?

A

Nondirectional hypotheses state the existence of a relationship between variables, a directional hypotheses states the existence, direction, and magnitude of a relationship between variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

The statistical hypothesis is also known as the ______ .

A

Null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a null hypothesis?

A

A hypothesis that states that there is no relationship between variables. The goal of a research study is to accept or reject the null

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Extraneous variables are also known as what type of variable?

A

Confounding

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is research validity?

A

The approximate truth of an inference

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What are the four major types of validity?

A
  1. Internal
  2. External
  3. Statistical conculsion
  4. Construct
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How can internal validity be described?

A

The degree to which it can be inferred that a study’s independent (predictor) variable actually caused the dependent (outcome) variable and that it was not a result of an extraneous (confounding) variable(s)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Which validity improves our ability to infer cause-and-effect relationships and improves control of extraneous factors?

A

Internal validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What are examples of threats to internal validity?(6)

A
  1. History
  2. Maturation
  3. Mortality
  4. Selection bias
  5. Testing
  6. Instrumentation
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Which type of internal validity threat can be described as the occurrence of external events that take place concurrently with the independent variable and that can affect the outcome variable?

A

History

Ex- 9/11, election

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Which type of threat to internal validity refers to processes occurring within participants during the course of the study as a result of the passage of time rather than as a result of the independent variable?

A

Maturation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Which type of threat to internal validity arises when participants drop out, pass away, etc during the course of a study?

A

Mortality (also known as Attrition)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What does the threat to internal validity, selection bias, refer to?

A

Also known as Selection. Refers to biases resulting from preexisting differences between groups. When participants are not randomized to groups there is a great risk for this

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What does the threat to internal validity, testing, refer to?

A

Testing refers to the effects of taking a pretest on people’s performance on a posttest. The initial test may sensitize participants

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does the threat to internal validity, instrumentation, refer to?

A

This refers to the bias that comes from changes in measuring instruments or methods of measurement between two points of data collection
Ex-poorly calibrated thermometer

17
Q

What is external validity?

A

Generalizability of findings to a target population, a key component of EBP.
Whether inferences about observed relationships will hold over variations in persons, setting, time, or measures of the outcomes.

18
Q

What are 3 threats to external validity?

A
  1. Selection effects
  2. Reactive effects
  3. Measurement effects
19
Q

Which threat to external validity can be due to researchers not having access to an adequate number of individuals who meet study criteria (access to target population)?

A

Selection effects

20
Q

What do the reactive and measurement effects refer to as a potential threat to external validity?

A

Participants may react or act differently to being measured/assessed, to novel exposure to intervention or questionnaire, and therefore the data collection will be in some way flawed/skewed.

21
Q

Internal and external validity share a ________ relationship. Why?

A

Inverse
To increase internal validity researchers exert control on study participants to reduce extraneous influences which increases threats to external validity (less representative condition or sample). If researchers relax their sample requirements to be more representative of target population that creates a threat to internal validity

22
Q

What is statistical conclusion validity?

A

The degree to which inferences about relationships from a statistical analysis of the data are correct

23
Q

What is a Type I error?

A

A false positive

Rejecting a null hypothesis that is, in fact, true

24
Q

What is a Type II error?

A

A false negative

Accepting a null hypothesis that is, in fact, false

25
Q

Threats to statistical conclusion validity include: (3)

A
  1. Low statistical power
  2. Excessive homogeneity
  3. Lack of treatment fidelity
26
Q

When does statistical power tend to be low?

A

When samples sizes are small

27
Q

When does the threat to statistical conclusion validity, excessive homogeneity, occur?

A

When study participants are too alike. This happens when great control is exerted to increase internal validity and creates a situation where the sample is not representative of the target population (dec. external validity)

28
Q

What does the threat to statistical conclusion validity, lack of treatment fidelity, refer to?

A

Variance in the way an intervention is used or applied. This non-standardized method of intervention application threatens statistical conclusion validity

29
Q

What is construct validity?

A

The degree to which evidence about study particulars supports inferences about the higher order constructs they are intended to represent; in measurement, the degree to which a measure truly captures the focal construct

(*how accurately what is meant to be measured is being measured)

30
Q

Threats to construct validity include:(4)

A
  1. Poor construct definition
  2. Researcher expectancies
  3. Novelty effects
  4. Mono-method bias
31
Q

What are novelty effects?

A

Participants and research agents altering their behavior in reaction to a new treatment

32
Q

What is mono-method bias, a threat to construct validity?

A

Researchers assessing a key category in the research design using only one method. This decreases scientific rigor and threatens construct validity

33
Q

What is the most effective method for controlling for extraneous variables and individual characteristics?

A

Randomization

34
Q

What are 6 ways of controlling participant characteristics- characteristics that could compete with the independent variable as the cause of the outcome?

A
  1. Randomization
  2. Crossover
  3. Homogeneity
  4. Stratification/Blocking
  5. Matching
  6. Statistical Control
35
Q

How is homogeneity used to control participant characteristics?

A

Used when randomization and crossover aren’t feasible. Using a sample that is homogeneous with respect to confounding variables (ex- only men used in sample)

36
Q

How is stratification/blocking used to control participants characteristics?

A

This refers to including the confounders into the research design through stratifications. (ex-randomized block design–> if gender was the confounding variable, men and women are assigned separately to treatment groups).

37
Q

How is matching used to control participants characteristics?

A

This refers to using information about people’s characteristics to create comparable groups (ex-matching a participant from the intervention group with one of the same age and gender in the control group)

38
Q

What is an example of a method used to control participant characteristics using statistical control?

A

ANCOVA- does this by statistically removing the effect of confounding variables on the outcome

39
Q

What is the Hawthorne effect?

A

The alteration of behavior by the subjects of a study due to their awareness of being observed.