Reliability Flashcards
Reliability
-how consistent the findings are when repeated
Ways of assessing reliability
List
Test-retest reliability
Inter-observer reliability
Test-retest reliability
-a method of assessing the reliability of a questionnaire or psychological test by assessing the same person on two separate occasions
Test-retest reliability
Procedure
-appropriate amount of time between two tests
-two scores correlated
-if correlation is a significant positive correlation
└=good reliability
Inter-observer reliability
-the extent to which two or more observers agree
Inter-observer reliability
Procedure
(total number of agreements)/(total number of observations > 0.080 = high inter-observer reliability
Inter-rater reliability
-applies to content analysis
Inter-interviewer reliability
-applies to interviews
Improving reliability
Questionnaires
-use test-retest method
-correlation should be more than +0.80
-if unreliable
└don’t overuse jargon
└don’t use emotive language or leading questions
└don’t use double-barrelled questions and double negatives
Improving reliability
Interviews
- use same interviewer
- use structured interviews
- don’t overuse jargon
- don’t use emotive language or leading questions
- don’t use double-barrelled questions and double negatives
Improving reliability
Experiments
- lab experiments most reliable
- same conditions each time they are tested
Improving reliability
Observations
-operationalize behavioural categories
└so are measurable, non-overlapping and self-evident