RELIABILITY Flashcards

1
Q

Define reliability

A

The consistency of a procedure, test or measure.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

External reliability

A
  • The extent a measure is consistent over time
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Internal reliability

A
  • The extent a test measure is consistent with itself.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

IntrA-rater reliability

A

The consistency of one researcher’s judgments or measurements over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Inter-observer reliability

A
  • The level of consistency between two or more trained observers when they conduct the same observation.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Inter-rater reliability

A

The extent to which different independent raters produce similar ratings, when judging/ coding the same set of data or phenomena

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Test-retest reliability

A
  • Involves presenting the same ppt
  • With the same test on 2 seperate occations.
  • A reliable measure/test should give similar results.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Split-half method

A
  1. Involves splitting the items of a test into 2 halves.
  2. Then comparing the results on each part.
  3. To see whether the results taken from each part are similar. (correlation co-effiecent)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

How to improve relaibility?

A
  • Operationalisation.
  • Standardised procedures.
  • Pilot testing.
  • Training.
  • Multiple raters.
  • Statistical analysis
  • Replication
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Why is reliability important in experiments?

A
  • If the measures used are inconsistent, differences across conditions may be due to poor measurments rather than the effects of the IV.
  • If the Dv isn’t measured reliably that the results cannot be used to test/ establish a casual effects.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Why is it important (for reliability) to use multiple observers/ raters in an observation?

A
  • Subjectivity: A single observer may have a subjective interpretation/ biases
  • Human error: Accuracy cannot be verified so Errors such as misinterpreting behaviours, inaccurate recording of data may occur.
  • Observer fatigue: Observing behaviours over long periods is taxing. (could lower attension)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly