reliability and validity

Question 1

what is reliability

Answer 1

consistency of a measure at different times and circumstances

Question 2

what is test retest reliability

Answer 2

useful for constructs that are stable over time (e.g., intelligence, personality traits)

measure at time 1, then at time 2. do tests have similar answers at both times?

Question 3

what is internal consistency

Answer 3

participants should give similar answers to all items that access similar constructs

Question 4

how to assess internal consistency

Answer 4

split half reliability - calc score for 1st half and second half, check if scores for each are similar

odd-even reliability - calc score for odd and even numbered items, and check if scores are similar

Chronbach’s alpha - check for correlations of every possible half with every other half, take average

Question 5

what is reliability across researchers

Answer 5

check if different researchers rate the behaviours in the same way

Question 6

what is validity

Answer 6

test measures what it is intended to measure (accuracy)

Question 7

what is construct, convergent and divergent validity

Answer 7

does our measure relate to the construct we are interested in

convergent validity - compare measure with other measures designed to assess the same construct

divergent validity - compare measures with measures designed to assess something different

Question 8

what is statistical validity

Answer 8

are our statistical methods accurate (adequate sample size, correct statistical test, adequate control of error, stats performed and reported correctly)

Question 9

what is internal validity

Answer 9

do the observed relationships include only the intended variables