Reliability Flashcards
Reliability
Refers to how consistent a measuring device is - this includes psychological tests or observations which assess behaviour
What are the 3 ways to test reliability and name an example for each
External reliability e.g test-retest
Researcher reliability e.g interrater reliability
Internal reliability e.g split half technique
Internal reliability
The extent to which different parts of a measure are consistent with itself
External reliability
The extent to which a measure is consistent when repeated
Researcher reliability
How consistently does the researcher gather data
Assessing internal reliability
Split half technique: assess measures that test one variable with multiple questions
- Split the test into two parts
- Participants complete both parts
- Test the strength of the correlation between the two parts of measure
- A strong correlation indicates internal reliability
Assessing external reliability
Test-retest: Repeat the study using the same procedures/measuring devices at different times and test the correlation between the two versions
Assessing researcher reliability
Inter-rater reliability
- Tests the accuracy of observations
- If the same behaviour is categorised by two different observers it is said to be reliable
Improving reliability: observation
Improving the training given to observers can improve their accuracy in assigning a particular observed behaviour to the correct behavioural category
Making sure that these categories have been properly operationalised, that they are measurable and self evident
Pilot studies can identify poorly defined behavioural categories
Improving reliability: Interviews
Use structured interview instead of unstructured interviews
The interview will then include a script the interviewer can follow, ensuring each participant has a similar experience and provides answers
Researcher can compare the responses from each participant
Improving reliability: Questionnaires
Use close ended questions to reduce the range of possible answers, if there is an established questionnaires that tests for what you need to measure, use that rather than creating a new test
Improving reliability: Experiments
Use standardised procedures for each participant - all have the same experience
e.g Keep what is said to the participants the same (using a script) and environmental conditions the same
Use established tests as measures rather than creating a new test
