Exam 2: Research Control - Internal and External Validitiy Flashcards
What is rigor?
rigorous adherence to rules, procedures, and techniques during research.
how do researchers ensure adequate rigor?
- understand rules and procedures
- understand approaches
- adhere to methods
- inform others about problems and limitations.
What are 4 issues of rigor in quantitative designs?
- quality of design
- quality of instrument
- rigor of procedure
- adequacy of sample
What are 3 issues of rigor in qualitative designs?
- depth and comprehension of data obtained.
- procedures used to engage with participants
- reflexivity and analysis of themes.
What does measurement mean in quantitative research?
translating what has been observed into numerical values.
what does validity mean in quantitative research?
- establishing the strength of a relationship between a measurement indicator and the underlying concept
- are we measuring what we say we’re measuring?
what does reliability mean in quantitative research?
- the consistency of the measures.
What are some criteria for choosing a good instrument? (3)
- is it widely used?
- does procedure fit the study?
- is there info. on reliability and validity of scores?
What are the 4 levels of measurement?
- Nominal
- ordinal
- interval
- ratio
What is nominal measurement?
- Categorical
- describes traits or characteristics
- no ranking of data.
- gender, ethnicity, religion
What is an ordinal measurement?
- Categorical
- data ranked from smallest to largest
- interval between data may not be equal
- rating scale: strong agree, agree, etc.
What is an Interval measurement?
- continuous
- equal intervals bt data categories
- date, temperature
What is a Ratio measurement
- continuous
- interval scale with an absolute zero
- weight, income
T/F: Categorical data can’t compute in addition, subtraction, multiplication, division.
True
Name an example of an interval instrument
- equal spacing bt measures
- purdue pegboard test
- focus on speed of performance
- does not start with zero point
name an example of a ratio instrument
- scale beings with absolute zero
- grip test: start at zero to grip strength
Reliability
-consistency of an instrument
- degree to which random error exists in instrument
O (observed score) = T (true score) + E (error score)
R = .80 or above is acceptable
Threats to reliability
- random error
- i.e. misreading questionnaire, observer interprets incorrectly, fatigue
Types of reliability (3)
- stability
- internal consistency
- equivalence
Stability
test-retest; consistency of repeated measures