Reliability

Question 1

What is the definition of reliability ?

Answer 1

How consistent the findings from a research investigation or psychometric test are

Question 2

What are the two ways that researchers can assess if findings are reliable ?

Answer 2

• Test-tester reliability
• Inter-observer reliability

Question 3

What is test-retest reliability ?

Answer 3

• When the same test or questionnaire is conducted again after an interval of time and finds the same results
• Once scores are generated, the results are correlated from both attempts to test the significance of reliability
• If reliable, the score will be over +0.8

Question 4

What is inter-observer reliability ?

Answer 4

• the extent of agreement between two or more observer during an observation
• An observation may first use a pilot study to make sure the behavioural categories can be consistent
• Behavioural categories should be used to operationalised
• Aiming for at least +0.8
• Observers observe the same act but they record separately

Question 5

How can you improve reliability of questionnaires ?

Answer 5

• specific questions
• close questions
• check test-retest reliability

Question 6

How can you improve reliability of interviews ?

Answer 6

• closed questions
• structured interviews
• avoiding leading questions
• trained interviewer

Question 7

How can you improve reliability of experiments ?

Answer 7

• allow replication of methods
• see if results are consistent
• standardised procedure

Question 8

How can you improve reliability of observations ?

Answer 8

• operationalised behavioural categories
• film observations