Improving Reliability

Question 1

correlation onlys show the …. and NOT the ….

Answer 1

correlation only shows the relationship between 2 variables not the cause

Question 2

how many ways are there for improving reliability?

Answer 2

4

Question 3

what are the 4 ways of improving reliability?

Answer 3

1.When possible take more than one measurement from each participant.
2. Pilot studies.
3. Standardise the way in which researchers collect data (consistency) e.g inter-rater reliability for an observation.
4. Reliability can be improved by making sure the raters are trained in the use of a checklist.

Question 4

how would you improve the inter-rater reliability of an observation study? (3 ways)

Answer 4

• standardised how the observers record results - use a checklist of clearly defined objectives behaviours
• train the observers in how to use a checklist
• carry out a pilot study to see if the checklist is suitable and allow the observers to compare their interpretations of the same behaviour

Question 5

how do we improve the test- retest method?

Answer 5

Any items where there is a low correlation should be removed from the questionnaire

Question 6

how do we improve the split-half method?

Answer 6

Any areas where there is a low correlation should be removed from the questionnaire

Question 7

Name an assessment of a questionnaire’s EXTERNAL reliability

Answer 7

Test-retest reliability

Question 8

Name an assessment of a questionnaire’s INTERNAL reliability

Answer 8

Split-half reliability

Question 9

Which assessment of reliability is designed to detect observer bias

Answer 9

Inter-rater / inter-observer reliability