Utility Flashcards
Usefulness or practical value of a test, training program, intervention
Utility
Factors that affect a test’s utility
psychometric soundness, costs, benefits
Family of techniques that entail a cost-benefit analysis designed to yield info relevant to a decision about the usefulness or practical value of a tool or assessment
Utility analysis
Ratio of benefits to costs
Ratio on investment
Increase base rate of successful performance that is associated with a particular level of criterion-related validity
taylor-russell tables
Facilitates decision making with regard to test use or recruitment to lower the selection ratio
taylor-russell tables
Likely average increase in criterion performance as a result of using a particular test or intervention
Naylor-shine tables
Facilitates decision making with regard to likely increase in performance with test use or recruitment needed to lower selection ratio
Naylor-shine tables
Refers to an estimate of the benefit (monetary) of using a particular test or selection method
The Brogden-Cronbach-Gleser formula/utility gain
Estimated increase in work output
Productivity gain
Reference point in scoring a test
cut score
Set with reference to the performance of a group
Relative cut score
Set with reference to a judgment concerning a minimum level of proficiency required to be included in a particular classification
Fixed cut score (absolute cut score)
Refers to the use of 2 or more cut score with reference to one predictor for the purpose of categorizing testtakers
multiple cut score
Achievement of a particular cut score in one test is necessary in order to advance to the next stage of evaluation in the selection process
Multiple hurdle
An assumption us made that high scores on one attribute can balance out or compensate for low scores on another attribute
compensatory model of selection
Suitable statistical tool in making selection decisions
Multiple regression
A method of setting cut score in which experts in the area provide estimates regarding how testakers who at least minimal competence for the position should answer test items correctly
Angoff method
When there is low inter-rater reliability and major disagreement regarding how certain populations of testtakers should respond to items
Achilles heel of angoff method
Entails collection of data on the predictor of interest from groups known to possess and not to possess a trait, attribute of interest; cut score is set to discrimate 2 groups test performance
Known groups method (method of contrasting groups)
To pass, the testtaker must answer items that are deemed to be above some minimum level of difficulty which is determined by experts and serves as cut score
IRT-based method
Items with the same level of difficulty ievaluate sa experts whether a licensed individual maka-answer sa items correctly. Kadaghan mag rate until makaset ug cut score for that particular item
Item-mapping method
Expert places a bookmark between 2 pages that are deemed to separate testtakers who have minimal knowledge and skills from those who haven’t.
Bookmark method
Family of techniques typically used to shed light on the relationship between certain variables and 2 naturally occurring groups successfuk and unsuccessful on the job
Disriminant analysis
Norm referenced method by Thorndike
Method of predictive yield
