Reliability Flashcards
Reliability
measure of consistency.
Types of Reliability
External - extent that measuring instruments is consistent across different times and situations.
Internal - extent that a measuring instrument is consistent within itself.
Most Reliable -> Least Reliable
Experiment, Correlation, Content Analysis, Observation, Self-Report, Case Study.
Ways Assessing Reliability
Test-Retest Method - use same measure on two different occasions to same people to see if get same results. If reliable results should be the same. Check using statistical correlation test if correlation coefficient 0.8 or more then reliable.
Inter-Rater/Observer/Interviewer Reliability - Compare findings between researchers using same measure and if high level of agreement then reliable. Check using statistical correlation test if correlation coefficient 0.8 or more then reliable.
Improving Reliability of Questionnaires
Closed ended questions = less room for misinterpretation.
Improving Reliability of Interviews
Same interviewer or train the same = don’t ask leading or ambiguous questions.
Structured Interview = more controlled by fixed questions.
Improving Reliability of Observations
Operationalised behavioural categories = don’t overlap and all behaviours covered so observers don’t make own judgements leading to inconsistencies.
Improving Reliability of Experiments
Lab experiments = introduce lots of control making it easier to be replicated.