Validity

Question 1

a judgment or estimate of how well a test measures what it supposed to measure

Answer 1

Validity

Question 2

Evidence about the appropriateness of inferences drawn from test scores

Degree to which the measurement procedure measures the variables to measure

Answer 2

Validity

Question 3

logical result or deduction

Answer 3

Inferences

Question 4

the process of gathering and evaluating evidence about validity

Answer 4

Validation

Question 5

yield insights regarding a particular population of testtakers as compared to the norming sample described in a test manual

Answer 5

Validation Studies

Question 6

degree of control among variables in the study (increased through random assignment)

Answer 6

Internal Validity

Question 7

generalizability of the research results (increased through random selection)

Answer 7

External Validity

Question 8

focuses on individual with their unique histories and behaviors

Answer 8

Conceptual Validity

Question 9

Means of evaluating and integrating test data so that the clinician’s conclusions make accurate statements about the examinee

Answer 9

Conceptual Validity

Question 10

a test appears to measure to the person being tested than to what the test actually measures

Answer 10

Face Validity

Question 11

describes a judgement of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample

more logical than statistical

Answer 11

Content Validity

Question 12

when the proportion of the material covered by the test approximates the proportion of material covered in the course

Answer 12

Content Validity

Question 13

a plan regarding the types of information to be covered by the items, the no. of items tapping each area of coverage, the organization of the items, and so forth

Answer 13

Test Blueprint

Question 14

concerned with the extent to which the test is representative of defined body of content consisting the topics and processes
- panel of experts can review the test items and rate them in terms of how closely they match the objective or domain specification
- examine if items are essential, useful and necessary

Answer 14

Content Validity

Question 15

failure to capture important components of a construct

Answer 15

construct underrepresentation

Question 16

happens when scores are influenced by factors irrelevant to the construct

Answer 16

construct-irrelevant variance

Question 17

developed the formula of Content Validity Ratio

Answer 17

Lawshe

Question 18

exactly half of the experts rate the item as essential

Answer 18

Zero CVR

Question 19

more statistical than logical
- a judgement of how adequately a test score can be used to infer an individual’s most probable standing on some measure of interestꟷthe measure of interest being criterion

Answer 19

Criterion Validity

Question 20

standard on which a judgement or decision may be made

Answer 20

Criterion

Question 21

Characteristics: relevant, valid, uncontaminated

Answer 21

Criterion Validity

Question 22

occurs when the criterion measure includes aspects of performance that are not part of the job or when the measure is affected by “construct-irrelevant” (Messick, 1989) factors that are not part of the criterion construct

Answer 22

Criterion Contamination

Question 23

If the test scores obtained at about the same time as the criterion measures are obtained; economically efficient

Answer 23

Concurrent Validity

Question 24

measures of the relationship between test scores and a criterion measure obtained at a future time

Answer 24

Predictive Validity

Question 25

the degree to which an additional predictor explains something about the criterion measure that is not explained by predictors already in use; used to improve the domain

Answer 25

Incremental Validity

Question 26

related to predictive validity wherein it is defined as the degree to which an additional predictor explains something about the ____________ that is not explained by predictors already in use

Answer 26

criterion measure

Question 27

covers all types of validity logical and statistical - judgement about the appropriateness of inferences drawn from test scores regarding individual standing on variable called construct

Answer 27

Construct Validity (Umbrella Validity)

Question 28

an informed, scientific idea developed or hypothesized to describe or explain behavior; unobservable, presupposed traits that may invoke to describe test behavior or criterion performance

Answer 28

Construct

Question 29

One way a test developer can improve the homogeneity of a test containing dichotomous items is by ____________________________ that do not show significant correlation coefficients with total test scores

Answer 29

eliminating items

Question 30

If it is an academic test and high scorers on the entire test for some reason tended to get that particular item wrong while low scorers got it right, then the item is obviously not a ________

Answer 30

good one

Question 31

demonstrate that scores on the test vary in a predictable way as a function of membership in a group

Answer 31

Method of Contrasted Groups

Question 32

If a test is a _________ of a particular construct, then the scores from the group of people who does not have that construct would have different test scores than those who really possesses that construct

Answer 32

valid measure

Question 33

if scores on the test undergoing construct validation tend to highly correlated with another established, validated test that measures the same construct

Answer 33

Convergent Evidence

Question 34

a validity coefficient showing little relationship between test scores and/or other variables with which scores on the test being construct-validated should not be correlated

Answer 34

Discriminant Evidence

Question 35

Factor Analysis

Answer 35

designed to identify factors or specific variables that are typically attributes, characteristics, or dimensions on which people may differ

Question 36

Developed Factor Analysis

Answer 36

Charles Spearman

Question 37

Used to study the interrelationships among set of variables Identify the factor or factors in common between test scores on subscales within a particular test

Answer 37

Factor Analysis

Question 38

estimating or extracting factors; deciding how many factors must be retained

Answer 38

Explanatory FA

Question 39

researchers test the degree to which a hypothetical model fits the actual data

Answer 39

Confirmatory FA

Question 40

conveys info about the extent to which the factor determines the test score or scores can be used to obtain both convergent and discriminant validity

Answer 40

Factor Loading

Question 41

revalidation of the test to a criterion based on another group different from the original group form which the test was validated

Answer 41

Cross-Validation

Question 42

decrease in validity after cross-validation

Answer 42

Validity Shrinkage

Question 43

validation of more than one test from the same group

Answer 43

Co-Validation

Question 44

norming more than one test from the same group

Answer 44

Co-Norming

Question 45

factor inherent in a test that systematically prevents accurate, impartial measurement

Answer 45

Bias

Question 46

Prevention during test dev through a procedure called

Answer 46

Estimated True Score Transformation

Question 47

numerical or verbal judgement that places a person or an attribute along a continuum identified by a scale of numerical or word descriptors known as

Answer 47

Rating

Question 48

Rating Scale - intentional or unintentional misuse of the scale

Answer 48

Rating Error

Question 49

Rating Scale - rater is lenient in scoring (Generosity Error)

Answer 49

Leniency Error

Question 50

Rating Scale - rater is strict in scoring

Answer 50

Severity Error

Question 51

Rating Scale - rater’s rating would tend to cluster in the middle of the rating scale

Answer 51

Central Tendency Error

Question 52

One way to overcome rating errors is to use _____

Answer 52

rankings

Question 53

Rating Scale - tendency to give high score due to failure to discriminate among conceptually distinct and potentially independent aspects of a ratee’s behavior

Answer 53

Halo Effect

Question 54

the extent to which a test is used in an impartial, just, and equitable way

Answer 54

Fairness

Question 55

Attempting to define the validity of the test will be futile if the test is NOT reliable

Answer 55

FACT