Measurement & Collection of Data/Reliability & Validity Flashcards
produce sound data; the assignment of numbers to objects according to specified rules to characterize qualities of some attribute
measurement
providing consistency and guides development and use of measurement tools
measurement theory
directness of measurement, measurement error
measurement theory concepts
accuchecks, BP = CONCRETE
direct measurement
pain scale (objective)
indirect measurement
spans across entire sample
systematic error
skewed based on someone specific
random error
An evaluation of the measurement properties of a measure, such as its reliability and validity.
Psychometric assessment
The extent to which a measurement is free from measurement error; more broadly, the extent to which scores for people who have not changed are the same for repeated measurements; a measure of the amount of potential random error in the measurement technique
reliability
stability, equivalence, homogeneity
types of reliability
same over and over; The type of reliability that concerns the extent to which scores for people who have not changed are the same when a measure is administered twice; an assessment of a measure’s stability.
test-retest reliability; stability
the degree to which two raters or observers, working independently, assign the same ratings or values for an attribute being measured
equivalence; interrater reliability
the degree to which objets are similar (characterized bt low variability); sometimes, a design strategy used to control confounding variables; Cronbach’s alpha
homogeneity; internal consistency
measures extent to which performance on any one item is a good indicator of performance on other items; 70-90
Cronbach’s alpha
the extent to which an instrument reflects the concept being examined; measures the use of the instrument for a specific group, not the instrument itself; content, criterion-related, construct
validity
measurement includes all major elements; the degree to which a multi-item measure has an appropriate set of reliability
content validity
measurement is consistent with what is already known
criterion-related validity
measures how well the conceptual and operational definition match the variables
construct validity
measurement methods used to quantify the level of significance and functioning of the participants
physiologic measures
types of physiological measures
accuracy
selectivity
precision
sensitivity
sources of error
environmental factors operation of equipment machine error biological variability human errors
physiological measures
microbiological (smells, cultures) physical measurement (EKG, BP, I&O)
spontaneously observing and recoding what is going on
unstructured observations
carefully defines what is to be observed and how observations are to be made
structured observations
“tell me about…”
“what has been your experience with…”
unstructured (open-ended) interview
structured questions without room for variable answers ; x or y?
structured (closed-ended) interview
measures attitudes and beliefs; asked to select one of seven points (good…very good…)
semantic differentials
provides a line with two different meanings on each end; indicate where you are on the line
visual analog scale (VAS)