Chapter Two

Question 1

KSAOs

Answer 1

The knowledge, skills, abilities, and other attributes necessary for a new incumbent to do well on the job; also referred to as job, employment, or worked specifications

Question 2

Reliability

Answer 2

The degree to which observed scores are free from random measurement errors. Reliability is an indication of the stability or dependability of a set of a measurements over repeated applications of the measurements procedure

Question 3

True Score

Answer 3

The average score that an individual would earn on an infinite number of administrations of the same test or parallel versions of the same test

Question 4

Error Score

Answer 4

The hypothetical difference between an observed score and a true score

Question 5

Measurement Error

Answer 5

The hypothetical difference between an observed score and a true score; comprises both random error and systematic error

Question 6

Validity

Answer 6

The degree to which accumulated evidence and theory support specific interpretations of test scores in the context of the test’s proposed use

Question 7

Content Validity

Answer 7

Whether the items on a test appear to match the content or subject matter they are intended to assess; assessed through the judgments of experts in the subject area

Question 8

Construct Validity

Answer 8

The degree to which a test or procedure assesses an underlying theoretical construct it is supposed to measure; assessed through multiple sources of evidence showing that it measures what it intends to measure and not other constructs. For example, an IQ test must measure intelligence and not personality

Question 9

Criterion - related validity

Answer 9

The relationship between a predictor (test score) and an outcome measure; assessed by obtaining the correlation between the predictor and outcome scores

Question 10

Face Validity

Answer 10

The degree to which the test takers (not subject matter experts) view the content of a test or a test items as relevant to the context in which the test is being administered

Question 11

Predictive validation

Answer 11

Strategies in which evidence is obtained about a correlation between predictor scores that are obtained before an applicant is hired and criterion scores that are obtained at a later time, usually after an applicant is employed

Question 12

Concurrent Validation

Answer 12

Strategies in which evidence is obtained about a correlation between predictor and criteria scores from information that is collected approximately the same time from a specific group of workers

Question 13

Validity Generalization

Answer 13

The application of validity evidence, obtained through meta - analysis of data obtained from many situations, to other situations that are similar to those on which the meta - analysis is based

Question 14

Bias

Answer 14

Systematic errors in measurement, or inferences made from those measurements, that are related to different identifiable group membership characteristics such as age, sex, or race

Question 15

Fairness

Answer 15

The principle that every test taker should be assessed in an equitable manner