Reliability across all methods of investigation. Flashcards
What is reliability?
Consistency - how consistent a measuring device is. A research method is considered reliable if we can repeat it and get the same results.
What are the ways of assessing reliability?
- Test-retest
- Inter-observer reliability
Explain test-retest
- Carry out the test first time
- Carry it out again on the same people at a later date (i.e. re test)
- Correlate to check that they are similar
- Reliability = correlation of +0.8 or more
Explain inter-observer reliability
• Have a second researcher to carry out the research too
• They both observe the same thing but do it separately
• Correlate their results looking for a +0.8 correlation
How to improve reliability of questionnaires
remove some questions, rewrite some e.g. if they are ambiguous. Could replace some open questions with closed to reduce ambiguity
How to improve reliability of interviews
use same interviewer each time if possible. If not, train all interviewers to avoid things like leading questions. Could use structured to have more control over the questions.
How to improve reliability of experiments
use a lab experiment so it has control and is consistent so allows method to be replicable. Make sure it is standardised.
How to improve reliability of observations
make sure behavioural categories are operationalised i.e. measurable and self-evident. Make sure they don’t overlap and all behaviours are covered on the list. Train observers too.