Chapter 5 Flashcards
Content validity is often described as what with regard to test validity?
A poor guide - as it is not sufficient to provide the evidence necessary to demonstrate test validity
Define predictive validity
The extent to which scores on the test allow us to estimate scores on a criterion external to the test itself
What is concurrent validity?
A form of predictive validity in which the index of social behaviour is obtained close in time to a score on the psychological test
What is incremental validity?
The extent to which knowledge of a score on a test adds to that obtained by another, pre-existing test score or psychological characteristic
What is the standard error of estimate?
A measure of the error associated with predicting the score on one variable from the score on another
What is the standard error of measurement?
An expression of the precision of an individual test score as an estimate of the trait that it purports to measure
What encouraged interest in predictive validity?
The use of psychological tests in industrial and educational settings after the First World War
What is the ‘simplest decision that can be made with a test’?
When it is used to decide which of two categories a person belongs to
Define sensitivity and specificity
Sen - the proportion of those who have the behaviour of interest who are so predicted by the test or assessment device
Spec - the proportion of those who do not show the behaviour of interest who are so predicted by the test or assessment device
The receiver operating characteristic plots what?
Valid positives against false negatives at each of a number of cutting scores
The area under the curve (AUC) of the ROC is an index of what?
Sensitivity independent of the cutting score
Tests that use the same _____ will ____ to some degree because of _____. But tests of the same construct using different _____ should _____ if the underlying dispositional _____ is properly reflected by the tests
Method; correlate; their shares method variance; methods; correlate to an even greater extent; variance
Thurstone generalised Spearman’s method by doing what?
Considering the matrix as a whole rather than as sets of 4 elements, and by proposing that there may be a number of ‘somethings’ rather than just one that made for patterns of greater and lesser relationships in the matrix
What was the name of the statistical technique of database analysis, proposed by Thurstone?
Centroid method
Prediction (predictive validity) introduces _____ than is the case in concurrent assessment of validity
Potentially more error
What is the difference between concurrent and predictive validity?
Predictive - the test is administered before the criterion is evaluated and the test is predicting a future event
Concurrent - characterises those situations when a test and criterion are administered jointly
What is validity?
The extent to which the test measures what it purports to measure
(The degree to which accumulated evidence and theory support specific interpretations of test scores entailed by proposed uses of a test)
Define construct validity
The meaning of a test score made possible by knowledge of the pattern of relationships it enters into with other variables and the theoretical interpretation of those relationships
Define content validity
The meaning that can be attached to a score on a psychological test on the basis of inspection of the material that constitutes the test
What is the multitrait-multi method matrix?
The pattern of correlations resulting from testing all possible relationships among two or more methods of assessing two or more constructs
