Quality of Data

Question 1

No judgement necessary

Answer 1

Objective

Question 2

Requires judgment and interpretation, may vary between individuals

Answer 2

Subjective

Question 3

Definition of a variable in quantifiable/measurable terms

Answer 3

Operational definition

Question 4

How consistent scores on a test are

Answer 4

Reliability

Question 5

Performance should be consistent across items

Answer 5

Internal reliability

Question 6

How well two halves correspond with one another (form of internal reliability)

Answer 6

Split-half reliability

Question 7

Internal reliability can be measured with…

Answer 7

Correlation coefficient

Question 8

If internal reliability is low, the correlation coefficient will be…

Answer 8

Under 0.6

Question 9

If internal reliability is good/high, the correlation coefficient will be…

Answer 9

0.7 or above (0.7/0.8 are typical reliable scores)

Question 10

Correlations between different occasions of testing

Answer 10

Test-retest reliability

Question 11

What aspect of personality must be taken into consideration when examining test-retest reliability?

Answer 11

Personality can change; It’s a pattern of the construct, not necessarily an issue with the test.

Mental health concerns can impact personality test results

Overall, there might be changes but there should still be long-term consistency

Question 12

Similarity of rating by various testers

Answer 12

Inter-rater reliability

Question 13

If inter-rater reliability is low…

Answer 13

Re-evaluate operational definition

Better train the observers

Question 14

Accuracy of the test; Is it measuring what we want it to measure?

Answer 14

Validity

Question 15

Extent to which a test truly measures a theoretical construct

Answer 15

Construct validity

Question 16

Type of construct validity featuring consistent results between tests measuring the same construct

Answer 16

Convergent validity

Question 17

Type of construct validity in which scores should not correlate with results of tests measuring other constructs

Answer 17

Discriminant validity

Question 18

Does the test measure the full characteristic it’s supposed to?

Answer 18

Content validity

Question 19

Does the test predict behaviour or ability?

Answer 19

Criterion validity

Question 20

Criterion validity can be…

Answer 20

Predictive (future performance)
Concurrent (Current performance)

Question 21

Does the test appear to measure what it’s supposed to measure?

Answer 21

Face validity (not a technical measure of validity)