lesson 3 - Reliability: Assessing and improving reliability

Question 1

how can you asses reliability when observing behaviour

Answer 1

test retest
Pilot study

Question 2

test retest

Answer 2

Repeat the observation a second time using the same participants and compare results gained from the second observation, with the results gained from the first observation (this can be easier if the observation is recorded). The results from the first and second observation should be very similar and should produce a correlation coefficient of +0.8 or more in order to be reliable

Question 3

pilot study

Answer 3

Conduct a small trial run of the observation, before the main research study is carried out. Pilot studies can ensure that procedures and resources used in the research can improve precision when measuring behaviour. This might include standardised instructions, debriefing, and planning procedures properly. This will minimise human error and variation. All key concepts and terms need to be operationalised so that all researchers know what they are defining, measuring and observing. Operationalise the behavioural categories and make sure that all observers have been properly trained to look for the appropriate behaviour that fits into each category.

Question 4

how to improve self reports reliability

Answer 4

1) Test retest:
Give a self-report to a group pf participants and collect the results. Give the same participants the same self-report to complete a second time (a short interval of time should be left between the first and second test e.g. a few weeks). Compare results from the first self-report to the second self-report. The results from the first and second self-report should be very similar/consistent. We should gain a correlation coefficient of +0.8 or more if the self-report is reliable

Question 5

how to improve reliability of experiments

Answer 5

Experiments are reliable if psychologists can conduct the experiment again and gain the same/similar results.
1) Test retest:
Conduct the experiment once and collect the results. Repeat the experiment again a few weeks later with the same participants who will be tested in exactly the same way. Compare the results gained from both occasions. The results should be similar from both occasions in order for the experiment to be reliable. A correlation coefficient of +0.8 or more should be gained.

Question 6

how to improve reliability when observing behaviour

Answer 6

1) Inter observer reliability:
Make sure the observation is not biased. Use more than one observer/psychologist to observe and record thehow behaviours separately. The results from both psychologists could be compared and should gain a positive correlation coefficient of +0.8 or more if the observation is reliable
2) If Inter observer reliability is low, then the reliability could be improved by ensuring that the behavioural categories have been operationalised properly and clearly so that each observer understands the categories properly when recording data. The observers might need further training about which behaviours to observe and how they should be measured.
3) If the results from the pilot study are not very clear, then the reliability could be improved by giving more training and practice to the observers. They can become more familiar with the behavioural categories and can respond more quickly when they are observing participants.

Question 7

how to improve reliability in self reports

Answer 7

1) Questions used in the interview: We must make sure that the interview questions are not ambiguous. They should be very clear so that participants understand them and can give the same answers if the questions were asked again in the future. Ambiguous questions might need to be rewritten if necessary or removed

2) Inter researcher reliability:
Make sure the self-report is not biased. If conducting an interview, it is possible to use more than one psychologist to interview participants separately or together and record answers separately. The researchers need to act in similar and consistent ways, and each researcher needs to carry out the procedure and design in exactly the same way so as to make the research consistent. The results from both psychologists could be compared and should gain a positive correlation coefficient of +0.8 or more if the interview is reliable

Question 8

how to improve reliability of experiments

Answer 8

1) Standardisation of instructions –If an experiment is conducted twice, then the procedures are repeated twice. Procedures should be exactly the same for each participant that takes part in the experiment, this will help ensure that reliable results are gained. Standardised instructions should be used and key concepts and variables should be operationalised.