Assessing Reliability Flashcards
inter-rater reliability, test-retest, split half
what are the two types of reliability
internal and external
external reliability
the extent to which a test produces consistent
results over several occasions.
internal reliability
the extent to which a test or measure is consistent
within itself e.g. the use of standardised instructions and procedures for
all participants.
what are reliability issues
- Lack of operationalisation of the variables
- order effects
- lack of standardised procedures
- inconsistency of measuring tools
- uncontrolled environment
how can order effects be combatted
counterbalancing
what is counterbalancing
This involves splitting
the population/sample into two halves; the first half complete condition one
followed by condition two, the second half complete condition two followed
by condition one. This in effect negates the impact of order/practice effects, as both conditions are affected equally, and increases internal reliability
why is lab environment better
helps to overcome most reliability issues. The
greater the level of control, the lower the risk of extraneous variables effecting
results.
split half reliability
splitting a participant’s test answers in
half and seeing whether s/he got the same or similar scores on the two halves. If so,
internal reliability is high/individual questions would need to be
re-ordered or redesigned to improve reliability
test retest reliability
testing and retesting the same participants over
time, with the same test, and comparing their scores. If the scores are the same, the
test has external reliability
inter-rater reliability
where two or more psychologists produce consistent
results by using a standardised procedure, agreed coding system, or correlation of
their data.