RELIABILITY Flashcards
1
Q
Define reliability
A
The consistency of a procedure, test or measure.
2
Q
External reliability
A
- The extent a measure is consistent over time
3
Q
Internal reliability
A
- The extent a test measure is consistent with itself.
4
Q
IntrA-rater reliability
A
The consistency of one researcher’s judgments or measurements over time.
5
Q
Inter-observer reliability
A
- The level of consistency between two or more trained observers when they conduct the same observation.
6
Q
Inter-rater reliability
A
The extent to which different independent raters produce similar ratings, when judging/ coding the same set of data or phenomena
7
Q
Test-retest reliability
A
- Involves presenting the same ppt
- With the same test on 2 seperate occations.
- A reliable measure/test should give similar results.
8
Q
Split-half method
A
- Involves splitting the items of a test into 2 halves.
- Then comparing the results on each part.
- To see whether the results taken from each part are similar. (correlation co-effiecent)
9
Q
How to improve relaibility?
A
- Operationalisation.
- Standardised procedures.
- Pilot testing.
- Training.
- Multiple raters.
- Statistical analysis
- Replication
10
Q
Why is reliability important in experiments?
A
- If the measures used are inconsistent, differences across conditions may be due to poor measurments rather than the effects of the IV.
- If the Dv isn’t measured reliably that the results cannot be used to test/ establish a casual effects.
11
Q
Why is it important (for reliability) to use multiple observers/ raters in an observation?
A
- Subjectivity: A single observer may have a subjective interpretation/ biases
- Human error: Accuracy cannot be verified so Errors such as misinterpreting behaviours, inaccurate recording of data may occur.
- Observer fatigue: Observing behaviours over long periods is taxing. (could lower attension)