week 5 / chapter 10 cards

Question 1

what does rigor mean?

Answer 1

the strength of the methodology of the study

Question 2

what does bias mean?

Answer 2

unseen errors/ design flaws

looking at how much bias was involved

Question 3

validity means in terms of quantitative study

Answer 3

the appropriate truth of an inference

Question 4

what is meant by a threat to validity

Answer 4

means hen the inference could go wrong

Question 5

what is a general idea of a threat to validity

Answer 5

confounding variable

Question 6

how do we best handle confounding variables

Answer 6

randomization

Question 7

other then randomization, how can we eliminate confounding variables

Answer 7

crossover, matching, blocking, statistical control

Question 8

what is the definition of homogeneity

Answer 8

standardization of a study (can be done by restricting to a specific domain, and is done to eliminate variability on the confounding characteristics)

Question 9

name the 4 types of validity that affect the rigor of a quantitative study:

Answer 9

1. statistical conclusion validity
2. internal validity
3. external validity
4. construct validity

Question 10

what are we looking for when thinking about statistical conclusion validity

Answer 10

a true empirical relationship!!!

is there actually a relationship between cause and effect

Question 11

how could the statistical conclusion validity be impacted?

Answer 11

• low statistical power
• low precision
• if the independent variable operailation is impacted

Question 12

what is the main thing to think about with the internal validity?

Answer 12

was it actually due to the intervention!!!

Question 13

what does independent variable stand for?

Answer 13

intervention

Question 14

how can the internal validity be impacted?

Answer 14

temporal ambiguity 
selection 
history 
maturation 
mortality 
testing 
instrumentation

Question 15

what does construct validity deal with?

Answer 15

thinking about the setting / other people / and their possible impact on the study

Question 16

what effect do we need to be aware of in terms of construct validity

Answer 16

Hawthorne effect

Question 17

what is the Hawthorne effect

Answer 17

how the participants may react different knowing they are being watched/ studied

Question 18

what word should we think about when we hear external validity

Answer 18

generalizable

Question 19

so external validity is concerned with:

Answer 19

can this study be recreated

Question 20

what is the number one threat to statical conclusion

Answer 20

statistical power

Question 21

reliability and validity can also be known as

Answer 21

trustworthiness

Question 22

internal validity can also be known as

Answer 22

credibility

Question 23

reliability can also be known as…

Answer 23

dependability

Question 24

confirmability is also known as …

Answer 24

objectivity

Question 25

external validity is also known as …

Answer 25

transferability

Question 26

the extent to which the appropriate inferences can be made is known as

Answer 26

validity

Question 27

why your inferences may be wrong is due to

Answer 27

threats to validity

Question 28

the conclusion that there is actually a relationship that exists between variables is known as

Answer 28

statistical conclusion validity

Question 29

how confident are we in the independent variable

Answer 29

internal validity (credibility)

Question 30

does your test accurately assess what it is supposed to do

Answer 30

construct validity

Question 31

generalizability of results (is the sample representative)

Answer 31

external validity

Question 32

what are 6 ways to control the confounding variable

Answer 32

1. randomization
2. crossover
3. homogeneity
4. blocking/ stratification
5. matching
6. statistical control

Question 33

the best way to control confounding variables is through

Answer 33

randomization or crossover

Question 34

threats to internal validity include

Answer 34

temporal ambiguity 
selection
history 
maturation 
attrition