Reliability Flashcards
Reliability
Refers to how consistent a measuring device is
What are the 4 ways to assess reliability
- Test-retest reliability
- Inter-observer reliability
- Inter-rater reliability
- Inter-interviewer reliability
Test retest reliability
Assess reliability of a questionnaire by assessing the same person on two separate occasions
Inter observer reliability
Extent to which there is a agreement between two or more observers involved in observations of behaviour
Inter rater reliability
A research technique that indirectly studies behaviour by examining communications that people produce
Inter interviewer reliability
Measured during interviews, where he interview is conducted by two or more different people and then will compare conclusions
How to measure reliability
Through correlation coefficient
Correlations and reliability
If a study is reliable it will produce a correlation coefficient of 0.8 (strong relationship)
Ways to improve reliability in questionnaires
- Test retest
- If low retest reliability, sme items need to be rewritten or deselected
- Closed, fixed choice questions
Ways to improve reliability in interviews
- Same interviewer(s)
- Train all interviewers
- Provide the interviewer with a list of questions to ask
Ways to improve reliability in observations
- Behavioural categories
- Ensure categories don’t overlap
- If reliability is low ten observers may require further training
Ways to improve reliability in experiments
- Procedure is the focus
- Standardised instructions