10-8b Principles of Measurement Flashcards
What do tests and measures encompass?
body structure & function, activities, participation, outcome measures
What do tests and measures’ properties rely on?
Psychometric properties of tools:
reliability, SEM, MDC, MCID, validity, etc.
What are some questions you should be asking yourself about a measurement?
Do I understand what I am measuring?
How confident should I be about the result?
What can I infer from this measurement?
How well does this measurement represent my patient’s capacity/ability/impairment/status/etc?
What are the different levels of measurement?
Nominal
ordinal
interval
ratio
What is a nominal scale? Examples?
names Categories without order (Frequency, tallies, counts, percentage, mode) Falls risk vs. non-falls risk Practice setting insurance
What is an ordinal scale? examples?
order but no consistent intervals (can have mode, median, and range)
MMT as “poor, fair, normal”
Categories with order
Involves central tendency: mode, median range
Mid mod max assistance model
Box and whiskers
BMI classifications
What is an Interval scale? Examples?
order and equal intervals
The time between values is meaningful
Can be negative
What is a ratio scale? example?
has order, intervals, and true 0 TUG HR VO2 max Goniometry 6MWT
What do Interval and Ratio scales involve?
Central tendency: mean
Variability: SD
Only forms of data we can find an MDC on
What can you report from nominal data?
in each group
% in each group
mode (soccer)
What can you report from ordinal data?
in each category
% in each category
Mode
Median
Inter quartile range (IQ) (upper quartile - lower quartile)
Box represents middle 50% and whiskers measure upper and lower 25% in a box and whiskers plot
What is precision?
how close/small/precise a measurement can be
What is the measurement value equal to?
true value + error
What are the types of error?
patient, examiner, environment, instrument
What is SEM? What is it based on?
an estimate of the average variability expected around a measurement
Variability in patient performance
Variability in measurement process
what is CI in regards to SEM?
95% CI = X +/- ~2 SEM
95% CiM?
Measurement +/- 1.96 SEM
68% confidence = 1 SEM
Calculating MDC?
First, use SEM to det. CI around a measurement 95% CiM MDC95 = CiM95 * sqr root of 2 = (1.96 * sqr root of 2) * SEM = 2.77 SEM
What do you need to calculate SEM?
variability of measures for a tested group (s)
reliability coefficient for tested group (r)
SEM = s * square root of 1 - r
How do you calculate intervention effect error?
SEMean
StdError = SD/square root of n
How do you calculate Measurement error?
SEMeasurement
SEM = s * square root of 1-r
What is reliability?
value that quantifies consistency of a tool
not sufficient for a measure to be valid
What is ICC?
Intraclass Correlation Coefficient (variability b/w subjects - variability within subjects)/variability between subjects
measures reliability of a tool
you want to be as close as possible to 1
Inter-rater
between different raters
intra-rater or test-restest
within a single rater
what is reliability/consistency quantified by?
ICC = 1 = perfectly reliable ICC = 0.5 = no better than chance
What is validity?
whether it measures what it says it measures
criterion, construct validity est. by comparing the measure to something else