Quality of Data Flashcards
No judgement necessary
Objective
Requires judgment and interpretation, may vary between individuals
Subjective
Definition of a variable in quantifiable/measurable terms
Operational definition
How consistent scores on a test are
Reliability
Performance should be consistent across items
Internal reliability
How well two halves correspond with one another (form of internal reliability)
Split-half reliability
Internal reliability can be measured with…
Correlation coefficient
If internal reliability is low, the correlation coefficient will be…
Under 0.6
If internal reliability is good/high, the correlation coefficient will be…
0.7 or above (0.7/0.8 are typical reliable scores)
Correlations between different occasions of testing
Test-retest reliability
What aspect of personality must be taken into consideration when examining test-retest reliability?
Personality can change; It’s a pattern of the construct, not necessarily an issue with the test.
Mental health concerns can impact personality test results
Overall, there might be changes but there should still be long-term consistency
Similarity of rating by various testers
Inter-rater reliability
If inter-rater reliability is low…
Re-evaluate operational definition
Better train the observers
Accuracy of the test; Is it measuring what we want it to measure?
Validity
Extent to which a test truly measures a theoretical construct
Construct validity
Type of construct validity featuring consistent results between tests measuring the same construct
Convergent validity
Type of construct validity in which scores should not correlate with results of tests measuring other constructs
Discriminant validity
Does the test measure the full characteristic it’s supposed to?
Content validity
Does the test predict behaviour or ability?
Criterion validity
Criterion validity can be…
Predictive (future performance)
Concurrent (Current performance)
Does the test appear to measure what it’s supposed to measure?
Face validity (not a technical measure of validity)
