reliability Flashcards
reliability
Refers to how consistent a measuring device is
Test-retest reliability
a method of assessing the reliability of a questionnaire or psychological test by assessing the same person on two separate occasions. This shows to what extent the test produced the same answers.
Inter-observer reliability-
the extent to which there is agreement between two or more observers involved in observations of a behaviour. This is measured by correlating the observations of two or more observers.
reliability explanation
Reliability is a measure of consistency. So if a measure of something can be replicated then it is reliable →eg a ruler should always be reliable/consistent with its measurements
But psychologists tend to not measure concrete things such as height but prefer more abstract concepts.
test-retest reliability explanation
- Administer the same test or question to the same person on different occasions
- For the test to be reliable, then the answers should be near enough the same
- Commonly used with questionnaires and psychological tests
- Must be sufficient time between test and retest to ensure that recall of answers is not possible.
- The sets of scores would be correlated
- If the correlation is significant then the reliability is assumed to be good
inter observer reliability explanation
- Subjectivity is an issue in observational research
- A pilot study may be used to ensure that the observers are applying behavioural categories
- All data should be reported separately to assess reliability
measuring reliability
- Measured using correlational analysis
- The correlation coefficient should exceed +.80 for reliability
improving reliability of quesionnaires
A questionnaire with low test-retest reliability may need some items to be deselected or rewritten. Complicated questions may be interpreted differently by the same person on different occasions. Therefore some questions need to be replaced.
improving reliability of interviews
The same interviewer should be used every time. Or all interviewers must be properly trained so that no interviewers are asking leading questions. This is easily avoided in structured interviews as unstructured interviews are less likely to be reliable.
improving reliability of observations
Behavioural categories must be properly operationalised. Categories should not overlap and all possible behaviours must be accounted for.If reliability is low, observers need further training.
improving reliability of experiments
The procedures must be standardised to allow for easy comparison.