CHAPTER 6 SUMARRY

Question 1

There are three ways to measure reliability?

Answer 1

(a)
the test-retest method, which measures temporal stability;

(b)
the alternate-forms method, which measures forms stability; and

(c)
the internal consistency method (split-half, K-R 20, and coefficient alpha), which measures item homogeneity.

Question 2

Split-Half Reliability:

Answer 2

A method to assess the consistency of a test by splitting it into two halves (e.g., odd vs. even questions) and comparing the scores from both halves. If the results are similar, the test is considered reliable.

Question 3

Kuder-Richardson Formula 20 (K-R 20)

Answer 3

A measure of internal consistency reliability for tests with binary (true/false) items. It indicates how well the items on the test are measuring the same construct, with values closer to 1 suggesting better reliability.

Question 4

Coefficient Alpha (Cronbach’s Alpha):

Answer 4

A statistic used to measure the internal consistency or reliability of a scale or test, especially when there are multiple items. Higher values (typically above 0.7) suggest the items are consistent in measuring the same concept.

Question 5

Tests can be validated using five approaches:

Answer 5

content, criterion, construct, known-group, and face.

Question 6

Content

Answer 6

Content: Refers to the specific elements being measured, like aspects of job satisfaction (e.g., pay, work environment).

Question 7

Criterion.

Answer 7

: A standard or measure used to assess outcomes, such as job performance or employee satisfaction

Question 8

Construct

Answer 8

: An abstract concept being measured, like motivation or leadership, inferred from behaviors.

Question 9

Known-group:

Answer 9

A method to test if an assessment can differentiate between groups known to differ, such as high vs. low performers.

Question 10

Face:

Answer 10

The apparent validity of a test—how much it seems to measure what it’s supposed to, based on a casual look.

Question 11

Information about tests can be obtained from such sources as

Answer 11

Mental Measurements Yearbook (MMY) \
Tests in Print (TIP)

Question 12

Mental Measurements Yearbook (MMY)

Answer 12

is a comprehensive resource that provides reviews of commercially available standardized tests, primarily in psychology, education, and related fields. It offers detailed evaluations of test reliability, validity, and usage.

Question 13

Tests in Print (TIP)

Answer 13

is a companion resource, listing all known tests published in the United States, along with relevant information like test publisher and purpose. It is essentially a directory of tests, without the detailed reviews found in MMY.

Question 14

Taylor-Russell Tables:

Answer 14

Estimate the utility (value) of a test based on selection ratio and the validity of the test. It helps to predict how many successful employees will be hired using the test.

Question 15

Lawshe Tables:

Answer 15

Used for content validation, showing how well a test represents the content domain and the relevance of items in the test.

Question 16

Proportion of Correct Decisions:

Answer 16

Measures how often the test correctly classifies individuals (true positives and true negatives).

Question 17

Expectancy Tables:

Answer 17

Predict the potential success of individuals based on test scores and help forecast future performance.

Question 18

Utility Formulas:

Answer 18

Mathematical formulas used to quantify the cost-benefit analysis of using a test, considering factors like improvement in job performance and hiring costs

Question 19

Adverse Impact:

Answer 19

Tests if a particular group (e.g., based on race or gender) is unfairly disadvantaged by the test compared to others.

Question 20

Single-group Validity:

Answer 20

Assesses whether the test accurately measures what it’s intended to within a single group (e.g., a specific demographic).

Question 21

Differential Validity:

Answer 21

Checks if the test predicts outcomes differently for different groups, ensuring it works equally well for all.

Question 22

Selection decisions can be made in four ways:

Answer 22

top-down, rule of three, top-down with banding, or passing scores.

Question 23

Top-down:

Answer 23

Candidates are ranked, and the top ones are selected based on their scores.

Question 24

Rule of three:

Answer 24

Only the top three candidates are considered for selection, even if there are more qualified individuals.

Question 25

Top-down with banding

Answer 25

Candidates within a certain score range (band) are treated equally, and selections are made from the top-ranked band.

Question 26

Passing scores:

Answer 26

Candidates who meet a minimum threshold are selected, regardless of how they rank compared to others.