Utility

Question 1

usefulness or practical value of testing to improve efficiency

Can tell us something about the practical value of the information derived from scores on the test

Helps us make better decisions

Answer 1

Utility

Question 2

Higher criterion-related validity = _________

Answer 2

higher utility

Question 3

One of the most basic elements in utility analysis is _________ of the selection device

Answer 3

financial cost

Question 4

disadvantages, losses, or expenses both economic and noneconomic terms

Answer 4

Cost

Question 5

profits, gains or advantages

o The cost of test administration can be well worth it if the results is certain noneconomic benefits

Answer 5

Benefit

Question 6

family of techniques that entail a cost-benefit analysis designed to yield information relevant to a decision about the usefulness and/or practical value of a tool of assessment

Answer 6

Utility Analysis

Question 7

provide an indication that a testtaker will score within some interval of scores on a criterion measure – passing, acceptable, failing
Might indicate future behaviors, then if successful, the test is working as it should

Answer 7

Expectancy table

Question 8

provide an estimate of the extent to which inclusion of a particular test in the selection system will improve selection

Answer 8

Taylor-Russel Tables

Question 9

numerical value that reflects the relationship between the number of people to be hired and the number of people available to be hired

Answer 9

Selection Ratio

Question 10

percentage of people hired under the existing system for a particular position

Answer 10

Base Rate

Question 11

One limitation of Taylor-Russel Tables is that the relationship between the predictor (test) and criterion must be ______

Answer 11

linear

Question 12

entails obtaining the difference between the means of the selected and unselected groups to derive an index of what the test is adding to already established procedures

Answer 12

Naylor-Shine Tables

Question 13

used to calculate the dollar amount of a utility gain resulting from the use of a particular selection instrument

Answer 13

Brogden-Cronbach-Gleser Formula

Question 14

estimate of the benefit of using a particular test

Answer 14

Utility Gain

Question 15

an estimated increase in work output

Answer 15

Productivity Gains

Question 16

reference point derived as a result of a judgement and used to divide a set of data into two or more classifications

Answer 16

Cut Score

Question 17

reference point based on norm-related considerations (norm-referenced); e.g, NMAT

Answer 17

Relative Cut Score

Question 18

– set with reference to a judgement concerning minimum level of proficiency required; e.g., Board Exams

Answer 18

Fixed Cut Scores

Question 19

refers to the use of two or more cut scores with reference to one predictor for the purpose of categorization

Answer 19

Multiple Cut Scores

Question 20

multi-stage selection process, a cut score is in place for each predictor

Answer 20

Multiple Hurdle

Question 21

assumption that high scores on one attribute can compensate for lower scores

Answer 21

Compensatory Model of Selection

Question 22

setting fixed cut scores

low interrater reliability

Answer 22

Angoff Method

Question 23

collection of data on the predictor of interest from group known to possess and not possess a trait of interest

Answer 23

Known Groups Method

Question 24

The determination of where to set cutoff score is inherently affected by the composition of contrasting groups

Answer 24

Known Groups Method FACT

Question 25

cut scores are typically set based on testtaker’s performance across all the items on the test

Answer 25

IRT-Based Methods

Question 26

arrangement of items in histogram, with each column containing items with deemed to be equivalent value

Answer 26

Item-Mapping Method

Question 27

expert places “________” between the two pages that are deemed to separate testtakers who have acquired the minimal knowledge, skills, and/or abilities from those who are not

Answer 27

Bookmark Method

Question 28

took into account the number of positions to be filled, projections regarding the likelihood of offer acceptance, and the distribution of applicant scores
o Discriminant Analysis – shed

Answer 28

Method of Predictive Yield

Question 29

shed light on the relationship between identified variables and two naturally occurring groups

Answer 29

Discriminant Analysis