reliability Flashcards
reliability
Consistency – a measurement made twice should produce similar results each time (correlation coefficient of +.8 or more).
2 ways of assessing reliabilty
test-retest, inter-observer
test-retest
A test/questionnaire used on two occasions is reliable if it produces similar outcomes/scores each time.
inter-observer
Two observers of the same behaviour make reliable observations if they interpret the behaviour in the same way (also inter-interviewer and inter-rater).
improving questionnaires and interviews reliability
Rewrite or remove ambiguous questions, use more closed questions, use structured interviews, train interviewers.
improving observations reliability
Operationalise behavioural categories, avoid overlapping, train observers, discuss decisions.
improving experiment reliability
use standardised procedures