Chapter 5 Flashcards
Content validity is often described as what with regard to test validity?
A poor guide - as it is not sufficient to provide the evidence necessary to demonstrate test validity
Define predictive validity
The extent to which scores on the test allow us to estimate scores on a criterion external to the test itself
What is concurrent validity?
A form of predictive validity in which the index of social behaviour is obtained close in time to a score on the psychological test
What is incremental validity?
The extent to which knowledge of a score on a test adds to that obtained by another, pre-existing test score or psychological characteristic
What is the standard error of estimate?
A measure of the error associated with predicting the score on one variable from the score on another
What is the standard error of measurement?
An expression of the precision of an individual test score as an estimate of the trait that it purports to measure
What encouraged interest in predictive validity?
The use of psychological tests in industrial and educational settings after the First World War
What is the ‘simplest decision that can be made with a test’?
When it is used to decide which of two categories a person belongs to
Define sensitivity and specificity
Sen - the proportion of those who have the behaviour of interest who are so predicted by the test or assessment device
Spec - the proportion of those who do not show the behaviour of interest who are so predicted by the test or assessment device
The receiver operating characteristic plots what?
Valid positives against false negatives at each of a number of cutting scores
The area under the curve (AUC) of the ROC is an index of what?
Sensitivity independent of the cutting score
Tests that use the same _____ will ____ to some degree because of _____. But tests of the same construct using different _____ should _____ if the underlying dispositional _____ is properly reflected by the tests
Method; correlate; their shares method variance; methods; correlate to an even greater extent; variance
Thurstone generalised Spearman’s method by doing what?
Considering the matrix as a whole rather than as sets of 4 elements, and by proposing that there may be a number of ‘somethings’ rather than just one that made for patterns of greater and lesser relationships in the matrix
What was the name of the statistical technique of database analysis, proposed by Thurstone?
Centroid method
Prediction (predictive validity) introduces _____ than is the case in concurrent assessment of validity
Potentially more error
