Exam 2: Research Control - Internal and External Validitiy

Question 1

What is rigor?

Answer 1

rigorous adherence to rules, procedures, and techniques during research.

Question 2

how do researchers ensure adequate rigor?

Answer 2

• understand rules and procedures
• understand approaches
• adhere to methods
• inform others about problems and limitations.

Question 3

What are 4 issues of rigor in quantitative designs?

Answer 3

1. quality of design
2. quality of instrument
3. rigor of procedure
4. adequacy of sample

Question 4

What are 3 issues of rigor in qualitative designs?

Answer 4

1. depth and comprehension of data obtained.
2. procedures used to engage with participants
3. reflexivity and analysis of themes.

Question 5

What does measurement mean in quantitative research?

Answer 5

translating what has been observed into numerical values.

Question 6

what does validity mean in quantitative research?

Answer 6

• establishing the strength of a relationship between a measurement indicator and the underlying concept
• are we measuring what we say we’re measuring?

Question 7

what does reliability mean in quantitative research?

Answer 7

• the consistency of the measures.

Question 8

What are some criteria for choosing a good instrument? (3)

Answer 8

• is it widely used?
• does procedure fit the study?
• is there info. on reliability and validity of scores?

Question 9

What are the 4 levels of measurement?

Answer 9

1. Nominal
2. ordinal
3. interval
4. ratio

Question 10

What is nominal measurement?

Answer 10

• Categorical
• describes traits or characteristics
• no ranking of data.
• gender, ethnicity, religion

Question 11

What is an ordinal measurement?

Answer 11

• Categorical
• data ranked from smallest to largest
• interval between data may not be equal
• rating scale: strong agree, agree, etc.

Question 12

What is an Interval measurement?

Answer 12

• continuous
• equal intervals bt data categories
• date, temperature

Question 13

What is a Ratio measurement

Answer 13

• continuous
• interval scale with an absolute zero
• weight, income

Question 14

T/F: Categorical data can’t compute in addition, subtraction, multiplication, division.

Answer 14

True

Question 15

Name an example of an interval instrument

Answer 15

• equal spacing bt measures
• purdue pegboard test
• focus on speed of performance
• does not start with zero point

Question 16

name an example of a ratio instrument

Answer 16

• scale beings with absolute zero

- grip test: start at zero to grip strength

Question 17

Reliability

Answer 17

-consistency of an instrument
- degree to which random error exists in instrument
O (observed score) = T (true score) + E (error score)
R = .80 or above is acceptable

Question 18

Threats to reliability

Answer 18

• random error

- i.e. misreading questionnaire, observer interprets incorrectly, fatigue

Question 19

Types of reliability (3)

Answer 19

• stability
• internal consistency
• equivalence

Question 20

Stability

Answer 20

test-retest; consistency of repeated measures

Question 21

internal consistency

Answer 21

test homogenity; uses split half consistency ( split test in half; evens/odds)

Question 22

equivalence

Answer 22

agreement bt two measurement events; inter-rater, alternate forms, etc.

Question 23

Validity

Answer 23

What is being measured true to the concept

Question 24

What are two threats to validity?

Answer 24

• systematic bias
• non-random error
  less systematic error = more validity

Question 25

Internal validity

Answer 25

are we measuring what we want to measure/manipulate?

Question 26

external validity

Answer 26

generalizability; can we generalize our study to larger population

Question 27

What are the 3 types of validity?

Answer 27

1. construct 2. content 3. criterion

Question 28

Construct validity

Answer 28

how the instrument is designed; independence, happiness, etc

Question 29

Content validity

Answer 29

how the assessment covers the relevant information

Question 30

criterion validity

Answer 30

predictive validity; how it can predict the outcome.

Question 31

Ways of strengthening internal validity designs (4)

Answer 31

1. randomization 2. homogenity 3. matching characteristics 4. stratification; separate by gender

Question 32

Ways of strengthening external validity

Answer 32

- replication

Question 33

What are the 4 criteria for merits of trustworthiness in qualitative inquiry

Answer 33

- credibility - transferability - dependability - confirmability

Question 34

Name the Truth value criterion in qualitative and quantitative approach

Answer 34

- credibility | - internal validity

Question 35

name the applicability criterion in qualitative and quantitative approach

Answer 35

- transferability | - external validity

Question 36

name the consistency criterion in qualitative and quantitative approach

Answer 36

- dependability | - reliability

Question 37

name the neutrality criterion in qualitative and quantitative approach

Answer 37

- confirmability | - objectivity

Question 38

Credibility

Answer 38

- true value | - are informants believable

Question 39

transferability

Answer 39

- applicability | - can this be repeated in a different situation

Question 40

dependability

Answer 40

- consistency | - can the findings be repeated if replicated

Question 41

confirmability

Answer 41

- neutrality of data

Question 42

Methods to enhance trustworthiness

Answer 42

- prolonged (breadth) and persistent engagement (depth) - time sampling - reflexivity - triangulation

Question 43

time sampling

Answer 43

sample all possible situations, times, and groups

Question 44

reflexivity

Answer 44

diary, notes, peer interview, group participation

Question 45

triangulation

Answer 45

convergence of multiple perspectives to ensure all aspects have been investigated

Question 46

member checking

Answer 46

ask participants to review and react to study data

Question 47

structural coherence

Answer 47

analysis to explain contradictions

Question 48

audit trails

Answer 48

review process notes, raw data

Question 49

sources of bias in qualitative research

Answer 49

- researcher presence - over reliance on accessible participants - influence of participants and site on researcher

Question 50

procedural challenges

Answer 50

- entering study site - establishing rapport and respect - balancing professionalism and familiarity with participants