Reliability Flashcards
What is reliability?
Reliability is a measure of consistency. For example, if you are using a tape measure, you expect to get the same results every time you measure a certain object.
What is test-retest reliability?
the same person or group of people are asked to undertake the research measure, e.g. a
questionnaire, on different occasions.
What should researchers be aware of with test-retest reliability?
Demand characteristics as the same P’s are used twice
What happens after the measure has been completed in test-retest reliability?
The two scores are then correlated. If they are significant, then the measure has good reliability
What is inter-observer reliability?
The extent to which two or more observers are observing and recording
behaviour in a consistent way. For example, if a psychologist was making a diagnosis for a mental health
condition, it would be a good idea for someone else to also make a diagnosis to check that they are both in
agreement.
In psychology studies where behavioural categories are being applied, why is inter-observer reliability so important?
To make sure that the categories are being used in the correct manner. Psychologists would observe the event separately then correlate their results to see if they are suitably similar.
What are the 4 ways of improving reliability?
Questionnaires, interviews, experiments, observations.
How to improve reliability in questionnaires?
Identify which questions have the biggest impact upon the reliability and adjust as necessary. Eg changing an open question to a closed one
How to improve reliability in interviews?
Ensure the same interviewer is conducting all interviews to reduce researcher bias.
How to improve reliability in experiments?
The level of control that the researcher has over variables is one way reliability is influenced. They could take more control over extraneous variables.
How to improve reliability in observations?
Observations can lack objectivity. Therefore when behavioural categories are being used, the researcher should try to refrain from subjectivity and operationalise the behavioural categories.
