6. Inter-rater reliability Flashcards
What are the four scales of measurement? (Inter-rater Methods)
- Nominal
- Ordinal
- Interval
- Ratio-interval
What is nominal data? (Inter-rater Methods)
Categorical (non-parametric)
What is ordinal data? (Inter-rater Methods)
Ranking (non-parametric)
What is interval data? (Inter-rater Methods)
Difference between value points (parametric)
What is ratio-interval data? (Inter-rater Methods)
Continuous (parametric)
What are the four sampling rules? (Inter-rater Methods)
- Ad libitum
- Focal
- Scan
- Behavioural
What is the ad libitum sampling rule? (Inter-rater Methods)
Preliminary observations
What is focal sampling rule? (Inter-rater Methods)
A specific individual is isolated for observation
What is the scan sampling rule? (Inter-rater Methods)
A number of individuals are sampled, typically in rapid succession
What is the behavioural sampling rule? (Inter-rater Methods)
All occurrences sampling
What are the two recording rules? (Inter-rater Methods)
- Timing sampling
- Continuous sampling
What is the time sampling rule? (Inter-rater Methods)
Periodically sample where:
A = instantaneous sampling
B = one-zero sampling
What is the continuous recording rule? (Inter-rater Methods)
Records absolute frequencies and durations of behaviours
What is intra-observation reliability? (Inter-rater Methods)
Same observer coded the same behavioural record at different times
What is inter-observer reliability? (Inter-rater Methods)
Different observers independently code the same behavioural record, either at the same time or at different times
