IOA Flashcards
IOA
Interobserver agreement
Benefits:
a. certain level of IOA can be used as a basis for new
observers
b. can detect observer drift
c. increases confidence that definition was clear
d. consistently high levels of IOA increase confidence
between observers
e. allows for believability that data is trustworthy
IOA requisites
- must use same measurement system
- must measure same event
- must be independent
Total Count IOA, Interval by Interval, Point by point
Simplest and Crudest
smaller/larger
Mean Count IOA
Average each interval add together then divide by total number of intervals. %
Exact Count IOA
MOST STRINGENT
Total number of intervals in agreement by both observers then divide by total number of trials/intervals
Scored Interval
Low Rates of bx
number of intervals both scored divided by at least one scored
Unscored Interval
High Rates of bx
number of intervals with no occurrences divided by at least on unscored
How often should IOA be obtained?
during each phase of a study
across days of the week, times of day, setting, observers
20% (minimum sessions)
How should IOA be recorded?
Narrative description (most common/simplest)
Table
Graphic Display
Acceptable scores
Closer to 100%
No less than 80%