Exam 2: Research Control - Internal and External Validitiy Flashcards

1
Q

What is rigor?

A

rigorous adherence to rules, procedures, and techniques during research.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

how do researchers ensure adequate rigor?

A
  • understand rules and procedures
  • understand approaches
  • adhere to methods
  • inform others about problems and limitations.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What are 4 issues of rigor in quantitative designs?

A
  1. quality of design
  2. quality of instrument
  3. rigor of procedure
  4. adequacy of sample
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What are 3 issues of rigor in qualitative designs?

A
  1. depth and comprehension of data obtained.
  2. procedures used to engage with participants
  3. reflexivity and analysis of themes.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What does measurement mean in quantitative research?

A

translating what has been observed into numerical values.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what does validity mean in quantitative research?

A
  • establishing the strength of a relationship between a measurement indicator and the underlying concept
  • are we measuring what we say we’re measuring?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what does reliability mean in quantitative research?

A
  • the consistency of the measures.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are some criteria for choosing a good instrument? (3)

A
  • is it widely used?
  • does procedure fit the study?
  • is there info. on reliability and validity of scores?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the 4 levels of measurement?

A
  1. Nominal
  2. ordinal
  3. interval
  4. ratio
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is nominal measurement?

A
  • Categorical
  • describes traits or characteristics
  • no ranking of data.
  • gender, ethnicity, religion
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is an ordinal measurement?

A
  • Categorical
  • data ranked from smallest to largest
  • interval between data may not be equal
  • rating scale: strong agree, agree, etc.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is an Interval measurement?

A
  • continuous
  • equal intervals bt data categories
  • date, temperature
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a Ratio measurement

A
  • continuous
  • interval scale with an absolute zero
  • weight, income
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

T/F: Categorical data can’t compute in addition, subtraction, multiplication, division.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Name an example of an interval instrument

A
  • equal spacing bt measures
  • purdue pegboard test
  • focus on speed of performance
  • does not start with zero point
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

name an example of a ratio instrument

A
  • scale beings with absolute zero

- grip test: start at zero to grip strength

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Reliability

A

-consistency of an instrument
- degree to which random error exists in instrument
O (observed score) = T (true score) + E (error score)
R = .80 or above is acceptable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Threats to reliability

A
  • random error

- i.e. misreading questionnaire, observer interprets incorrectly, fatigue

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Types of reliability (3)

A
  • stability
  • internal consistency
  • equivalence
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Stability

A

test-retest; consistency of repeated measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

internal consistency

A

test homogenity; uses split half consistency ( split test in half; evens/odds)

22
Q

equivalence

A

agreement bt two measurement events; inter-rater, alternate forms, etc.

23
Q

Validity

A

What is being measured true to the concept

24
Q

What are two threats to validity?

A
  • systematic bias
  • non-random error
    less systematic error = more validity
25
Q

Internal validity

A

are we measuring what we want to measure/manipulate?

26
Q

external validity

A

generalizability; can we generalize our study to larger population

27
Q

What are the 3 types of validity?

A
  1. construct
  2. content
  3. criterion
28
Q

Construct validity

A

how the instrument is designed; independence, happiness, etc

29
Q

Content validity

A

how the assessment covers the relevant information

30
Q

criterion validity

A

predictive validity; how it can predict the outcome.

31
Q

Ways of strengthening internal validity designs (4)

A
  1. randomization
  2. homogenity
  3. matching characteristics
  4. stratification; separate by gender
32
Q

Ways of strengthening external validity

A
  • replication
33
Q

What are the 4 criteria for merits of trustworthiness in qualitative inquiry

A
  • credibility
  • transferability
  • dependability
  • confirmability
34
Q

Name the Truth value criterion in qualitative and quantitative approach

A
  • credibility

- internal validity

35
Q

name the applicability criterion in qualitative and quantitative approach

A
  • transferability

- external validity

36
Q

name the consistency criterion in qualitative and quantitative approach

A
  • dependability

- reliability

37
Q

name the neutrality criterion in qualitative and quantitative approach

A
  • confirmability

- objectivity

38
Q

Credibility

A
  • true value

- are informants believable

39
Q

transferability

A
  • applicability

- can this be repeated in a different situation

40
Q

dependability

A
  • consistency

- can the findings be repeated if replicated

41
Q

confirmability

A
  • neutrality of data
42
Q

Methods to enhance trustworthiness

A
  • prolonged (breadth) and persistent engagement (depth)
  • time sampling
  • reflexivity
  • triangulation
43
Q

time sampling

A

sample all possible situations, times, and groups

44
Q

reflexivity

A

diary, notes, peer interview, group participation

45
Q

triangulation

A

convergence of multiple perspectives to ensure all aspects have been investigated

46
Q

member checking

A

ask participants to review and react to study data

47
Q

structural coherence

A

analysis to explain contradictions

48
Q

audit trails

A

review process notes, raw data

49
Q

sources of bias in qualitative research

A
  • researcher presence
  • over reliance on accessible participants
  • influence of participants and site on researcher
50
Q

procedural challenges

A
  • entering study site
  • establishing rapport and respect
  • balancing professionalism and familiarity with participants