reliability Flashcards
define reliability
how consistent a measuring device is, including psychological tests or observations which assess behaviour.
A measuring device is said to be reliable if it produces the same consistent results every time
4 ways of assess reliability
- test - retest reliability
- inter - observer reliability
- inter - rater reliability
- inter - interviewer reliability
define test - retest reliability
participants take the same test on different occasions
( a high correlation between test scores indicates the test has good external reliability)
what is test - retest reliability used with
questionnaires
psychological tests
interviews
why is a an appropiate time frame needed between the distribution of the 2 tests
to ensure participants cannot recall answers but not so long that their attitudes, opinions or abilities have changed
when is inter - observer reliability used
in observations
define inter - observer reliability
the extent to which there is an agreement between 2 or more independent observers involved in observing behaviours
why is inter - observer reliability used
when there are 2 observers who have undertaken a pilot study to ensure that they agree they are observing behaviour by using the same behavioural categories in the same way
they must record their observations independently and come together at the end to see if they are correlated
define inter - rater reliability
measured during content analysis
( a research technique that indirectly studies behaviour by examining communication that people produce e.g: text, emails, films)
define content analysis
a research technique that indirectly studies behaviour by examining communication that people produce e.g: text, emails, films
define inter - interviewer reliability
measured during interviews if these are conducted by different people
how to improve reliability in questionnaires
- use fixed choice and close questions
(as they are less ambigious)
how to improve reliability in interviews (3 marks)
- no leading questions or ambiguous questions
- use structured interviews with fixed questions
- use same interviewer each time or 2 people conducting an interview at the same time
how to improve reliability in observations (1 mark)
- operationalise behavioural categories so they don’t overlap
how to improve reliability in experiments (3 marks)
- consistent procedures
- standardised procedures
- standardised instructions