Reliability and Validity of Psychometric Tests

Question 1

What is a psychometric test? What are some general weaknesses of them?

Answer 1

Lecture 2, slide 4

Question 2

How are IDs treated in psychometric tests and why?

Answer 2

Lecture 2, slide 5

Question 3

What are some psychometric tests that are designed to be susceptible to IDs?

Answer 3

Lecture 2, slide 6

Question 4

What is standardization? Why is it done? What are some things to consider when standardizing a test?

Answer 4

Lecture 2, slide 7-9

Question 5

What is validity?

Answer 5

Lecture 2, slide 11

Question 6

What are some methods for studying validity?

Answer 6

Lecture 2, slide 12

Question 7

What is content validity? Give an example?

Answer 7

Lecture 2, slide 13

Question 8

What is criterion-related validity? What are some of the different types of criterion-related validity? What is concurrent validity? Give an example of deviance?

Answer 8

Lecture 2, slide 14

-types: concurrent and predictive

Question 9

What is predictive validity? Why do you need to be cautious when interpreting it?

Answer 9

Lecture 2, slide 15

Question 10

What is incremental validity? What is it used for? Give an example.

Answer 10

Lecture 2, slide 16

Question 11

What is construct validity?

Answer 11

Lecture 2, slide 17

Question 12

What are the steps in describing a construct? Give ‘aggressiveness in school children’ as an example.

Answer 12

Lecture 2, slide 18-21

Question 13

What are the steps to establish construct validity?

Answer 13

Lecture 2, slide 22

Question 14

What is reliability? Why may it be hard to determine?

Answer 14

Lecture 2, slide 24

Question 15

What are systematic and unsystematic errors? What is error variance?

Answer 15

Lecture 2, slide 25

Question 16

What are some sources of error variance?

Answer 16

Lecture 2, slide 26

Question 17

What is time sampling errors? What is test-retest reliability (how do you account for time sampling errors)?

Answer 17

Lecture 2, slide 27

Question 18

How do you account for content sampling errors?

Answer 18

Lecture 2, slide 28

Question 19

What is the best procedure for estimating reliability?

Answer 19

Lecture 2, slide 29

Question 20

How may content heterogeneity arise? How can it be accounted for?

Answer 20

Lecture 2, slide 30

Question 21

What is inter-rater (inter-scorer) reliability? What does this tell us and what does it not tell us??

Answer 21

Lecture 2, slide 31

Question 22

How may a reliability coefficient be interpreted?

Answer 22

Lecture 2, slide 32

Question 23

How do you increase reliability?

Answer 23

Lecture 2, slide 33

Question 24

What are the different types of reliability coefficients and what do they account for?

Answer 24

Lecture 2, slide 34-35

Question 25

Summarise the different types of reliability.

Answer 25

Lecture 2, slide 36