Reliability

Question 1

different ways of assessing reliability

Answer 1

• test-retest
• pilot study

Question 2

assessing reliability in observations

Answer 2

• test re-test
• pilot study

Question 3

assessing reliability in self-reports

Answer 3

• test retest
  Give a self-report to a group pf participants and collect the results
  = Give the same participants the same self-report to complete a second time (a short interval of time should be left between the first and second test e.g. a few weeks)
  = Compare results from the first self-report to the second self-report
  = results from the first and second self-report should be very similar/consistent
  = We should gain a correlation coefficient of +0.8 or more if the self-report is reliable

Question 4

assessing reliability in experiments

Answer 4

• test re-test
  = Conduct the experiment once and collect the results
  = Repeat the experiment again a few weeks later with the same participants who will be tested in exactly the same way
  = Compare the results gained from both occasions
  = the results should be similar from both occasions in order for the experiment to be reliable. A correlation coefficient of +0.8 or more should be gained

Question 5

improving reliability - observations

Answer 5

• inter-observer reliability = two or more psychs
• inter-observer reliability is low = operationalise properly
• pilot study training

Question 6

improving reliability - self-report

Answer 6

• questions used in the interview
• inter-researcher reliability

Question 7

improving reliability - experiments

Answer 7

• standardised instructions:
  If an experiment is conducted twice, then the procedures are repeated twice
  = Procedures should be exactly the same for each participant that takes part in the experiment
  = this will help ensure that reliable results are gained.
• Standardised instructions should be used
• key concepts and variables should be operationalised

Question 8

assessing reliability - observations = test-retest

Answer 8

= Repeat the observation a second time using the same participants
= compare results gained from the second observation, with the results gained from the first observation (this can be easier if the observation is recorded)
= The results from the first and second observation should be very similar and should produce a correlation coefficient of +0.8 or more in order to be reliable

Question 9

assessing reliability - observations = pilot study

Answer 9

• pilot study
  Conduct a small trial run of the observation, before the main research study is carried out
  = Pilot studies can ensure that procedures and resources used in the research can improve precision when measuring behaviour
  = might include standardised instructions, debriefing, and planning procedures properly.
  = This will minimise human error and variation

Question 10

improving reliability = observations - inter-observer reliability

Answer 10

= Make sure the observation is not biased
= Use more than one observer/psychologist to observe and record the behaviours separately
= The results from both psychologists could be compared
= should gain a positive correlation coefficient of +0.8 or more if the observation is reliable

intra-observer reliability = observation is video recorded + can be watched several times

Question 11

improving reliability = observations - pilot study

Answer 11

If the results from the pilot study are not very clear, then the reliability could be improved by:
- giving more training and practice to the observers
- they can become more familiar with the behavioural categories
= can respond more quickly when they are observing participants.

Question 12

improving reliability - self-reports = questions used in interviews

Answer 12

We must make sure that the interview questions are not ambiguous:
= should be very clear so that participants understand them and can give the same answers if the questions were asked again in the future
= Ambiguous questions might need to be rewritten if necessary or removed

Question 13

improving reliability - self-reports = inter-researcher reliability

Answer 13

Make sure the self-report is not biased. If conducting an interview, it is possible to use more than one psychologist to interview participants separately or together and record answers separately. The researchers need to act in similar and consistent ways, and each researcher needs to carry out the procedure and design in exactly the same way so as to make the research consistent. The results from both psychologists could be compared and should gain a positive correlation coefficient of +0.8 or more if the interview is reliable

Question 14

internal reliability

Answer 14

the extent to which a measure is consistent within itself

e.g. whether the different questions in a questionnaire are all measuring the same behaviour, attitudes etc..

• done through split-half method

Question 15

external reliability

Answer 15

the extent to which a measure varies from one use to another