VALIDITY

Question 1

a judgment or estimate of how well a test
measures what it purports to measure in a particular context.

Answer 1

VALIDITY

Question 2

This is a measure of validity based on an
evaluation of the subjects, topics, or content covered by the
items in the test.

Answer 2

Content Validity

Question 3

This is a measure of validity that is arrived
at by executing a comprehensive analysis of how scores on the test relate to other test scores and measures, and how scores on the test can be understood within some theoretical
framework for understanding the construct that the test was designed to
measure

Answer 3

Construct Validity

Question 4

a judgment concerning how relevant the test
items appear to be.

Answer 4

Face Validity

Question 5

A judgment of how adequately a test
samples behavior representative of the universe of
behavior that the test was designed to sample

Answer 5

Content Validity

Question 6

A plan regarding the types of information to be covered by the items, the number
of items tapping each area of coverage, the
organization of the items in the test, etc.

Answer 6

Test Blueprint

Question 7

developed a method whereby raters judge
each item as to whether it is essential, useful but not essential, or not necessary for job performance.

Answer 7

Lawshe (1875)

Question 8

is the standard against which a test or
a test score is evaluated.

Answer 8

criterion

Question 9

is relevant for the matter at hand, valid for the purpose for which it is being used, and uncontaminated, meaning it is not part
of the predictor.

Answer 9

Adequate criterion

Question 10

judgment of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interest

Answer 10

Criterion-related Validity

Question 11

This is a measure of validity obtained
by evaluating the relationship of scores obtained on the test toscores on other tests or measures

Answer 11

Criterion-related Validity

Question 12

the process of gathering and evaluating
evidence about validity.

Answer 12

Validation

Question 13

an index of the degree to which a test
score predicts some criterion,
or outcome, measure in the
future.

Answer 13

Predictive validity

Question 14

a correlation coefficient that
provides a measure of the relationship between test scores
and scores on the criterion measure.

Answer 14

Validity Coefficient

Question 15

shows the percentage of people
within specified test-score intervals who subsequently
were placed in various categories of the criterion (e.g.
placed in “passed” category or “failed” category).

Answer 15

Expectancy Data

Question 16

the ability of a test to measure a
theorized construct (e.g. intelligence, aggression,
personality, etc.) that it purports to measure.

Answer 16

Construct Validity

Question 17

how uniform a test is in
measuring a single concept.

Answer 17

Evidence of homogeneity

Question 18

Some constructs are expected to change over time (e.g. reading rate)

Answer 18

Evidence of changes with age

Question 19

test scores change as a result of some experience between a pretest and a posttest (e.g. therapy).

Answer 19

Evidence of pretest/posttest changes

Question 20

scores on a test vary in a
predictable way as a function of membership in some
group (e.g. scores on the Psychopathy Checklist for
prisoners vs. civilians).

Answer 20

Evidence from distinct groups

Question 21

scores on the test undergoing construct validation tend to correlate highly in the predicted direction with scores on older, more established, tests designed to measure the same (or a similar) construct.

Answer 21

Convergent evidence

Question 22

validity coefficient showing little
relationship between test scores and other variables with
which scores on the test should not theoretically be correlated

Answer 22

Discriminant evidence

Question 23

an index of the degree to which a
test score is related to some
criterion measure obtained at
the same time

Answer 23

Concurrent validity

Question 24

a factor inherent in a test that systematically prevents
accurate, impartial measurement.

Answer 24

Bias

Question 25

a judgment resulting from the intentional or
unintentional misuse of a rating scale.

Answer 25

Rating error

Question 26

a tendency to give a particular person a higher rating
than he or she objectively deserves because of a favorable overall impression.

Answer 26

Halo effect

Question 27

The extent to which a test is used in an impartial, just, and equitable way.

Answer 27

Fairness