Brainscape's Knowledge GenomeTM

Browse over 1 million classes created by top students, professors, publishers, and experts.


See full index

PS505 - Testing, Measurement, and Assessment > Ch. 6 - Validity > Flashcards

Ch. 6 - Validity Flashcards

1
Q

base rate

A

an index, usually expressed as a proportion, of the extent to which a particular trait, behavior, characteristic, or attribute exists in a population

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

bias

A

as applied to tests, a factor inherent within a test that systematically prevents accurate, impartial measurement

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

central tendency error

A

a type of rating error wherein the rater exhibits a general reluctance to issue ratings at either the positive or negative extreme and so all or most ratings cluster in the middle of the rating continuum

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

concurrent validity

A

a form of criterion-related validity that is an index of the degree to which a test score is related to some criterion measure obtained at the same time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

confirmatory factor analysis

A

a class of mathematical procedures employed when a factor structure that has been explicitly hypothesized is tested for its fit with the observed relationships between the variables

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

construct

A

an informed, scientific idea developed or generated to describe or explain behaviors…

i.e., intelligence, personality, anxiety, job satisfaction

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

construct validity

A

a judgement about the appropriateness of inferences drawn from test scores regarding individual standings on a variable called a construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

content validity

A

describes a judgement of how adequately a test samples behavior representative of the universe of behavior that the test was designed to sample

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

convergent evidence

A

with reference to construct validity…

data from other measurement instruments designed to measure the same or a similar construct as the test being construct-validated and that all point to the same judgement or conclusion with regard to a test or other tool of measurement

contrast with discriminant evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

convergent validity

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

criterion

A

the standard against which a test or a test score is evaluated

may take many forms, including a specific behavior or set of behaviors

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

criterion contamination

A

a state in which a criterion measure is itself based, in whole or part, on a predictor measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

criterion-related validity

A

a judgement regarding how adequately a score or index on a test or other tool of measurement can be used to infer an individual’s most probable standing on some measure of interest

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

discriminant evidence

A

with reference to construct validity…

data from a test or other measurement instrument showing little relationship between test scores or other variables with which the scores on the test bring construct-validated should not theoretically be correlated

contrast with convergent evidence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

expectancy chart

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

expectancy data

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

exploratory factor analysis

A

a class of mathematical procedures employed to estimate factors, extract factors, or decide how many factors to retain

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

face validity

A

a judgement regarding how well a test or other tool of measurement measures what it purports to measure that is based solely on “appearances”, such as the content of the test’s items

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

factor analysis

A

a class of mathematical procedures, frequently employed as data reduction methods, designed to identify variables on which people may differ (or factors)

20
Q

factor loading

A

in factor analysis, a metaphor suggesting that a test (or an individual test item) carries with it or “loads” on a certain amount of one or more abilities that, in turn, have a determining influence on the test score (or on the response to the individual test item)

21
Q

fairness

A

as applied to tests, the extent to which a test is used in an impartial, just, and equitable way

22
Q

false negative

A

a specific type of miss characterized by a tool of assessment indicating that the test-taker does not possess or exhibit a particular trait, ability, behavior, or attribute when in fact, the test-taker DOES possess or exhibit a particular trait, ability, behavior, or attribute

23
Q

false positive

A

an error in measurement characterized by a tool of assessment indicating that the test-taker possesses or exhibits a particular trait, ability, behavior, or attribute when in fact the test-taker does not

24
Q

generosity error

A

aka leniency error

a less than accurate rating or evaluation by a rater due to that rater’s general tendency to be lenient or insufficiently critical

contrast with severity error

25
Q

halo effect

A

a type of rating error wherein the rater views the object of the rating with extreme favor and tends to bestow ratings inflated in a positive direction

a set of circumstances resulting in a rater’s tendency to be positively disposed and insufficiently critical

26
Q

hit rate

A

the proportion of people who are accurately identified as possessing or not possessing a particular trait, ability, behavior, or attribute based on test scores

27
Q

homogeneity

A

describes the degree to which a test measures a single trait

28
Q

incremental validity

A

used in conjunction with predictive validity, and index of the explanatory power of additional predictors over and above the predictors already in use

29
Q

inference

A

a logical result or deduction in a reasoning process

30
Q

intercept bias

A

occurs when the use of a predictor term results in a consistent under-prediction or over-prediction of a specific group’s performance or outcomes

31
Q

leniency error

A

aka generosity error

32
Q

local validation study

A

the process of gathering evidence, relevant to how well a test measures what it purports to measure, for the purpose of evaluating the validity of a test or other measure tool

typically undertaken in conjunction with a population different from the population for whom the test was originally validated

33
Q

method of contrasted groups

A

aka known groups method

a system of collecting data on a predictor of interest from groups known to possess (and not possess) a trait, attribute, of ability of interest

34
Q

miss rate

A

the proportion of people a test of other measurement procedure fails to identify accurately with respect to the possession or exhibition of a particular trait, ability, behavior, or attribute

a “miss” in this context is an inaccurate classification or prediction, may be subdivided into false positives and false negatives

35
Q

multitrait-multimethod matrix

A

a method of evaluating construct validity by simultaneously examining both convergent and divergent evidence by means of a table of correlations between traits and methods

36
Q

predictive validity

A

a form of criterion-related validity that is an index of the degree to which a test score predicts some criterion measure

37
Q

ranking

A

the ordinal ordering of persons, scores, or variables into relative positions or degrees of value

38
Q

rating

A

a numerical or verbal judgement that places a person or attribute along a continuum identified by a scale of numerical or word descriptors called a rating scale

39
Q

rating error

A

a judgment that results from the intentional or unintentional misuse of a rating scale

two types of rating error are leniency (aka generosity) error and severity error

40
Q

rating scale

A

a system of ordered numerical or verbal descriptors on which judgments about the presence/absence or magnitude of a particular trait, ability, behavior, or attribute, emotion, or other variable are indicated by raters, judges, examiners, or (when the rating scale reflects self-reports) the assessee.

41
Q

severity error

A

less than accurate rating or error in evaluation due to the rater’s tendency to be overly critical

contrast with generosity error

42
Q

slope bias

A

it occurs when a predictor has a weaker correlation with an outcome for specific groups

43
Q

test blueprint

A

a detailed plan of the content, organization, and quantity of the items that a test will contain

44
Q

validation

A

the process of gathering and evaluating validity evidence

45
Q

validation study

A
46
Q

validity

A

a general term referring to a judgment regarding how well a test or other measurement tool measures what it purports to measure

judgment has important implications regarding the appropriateness of inferences made and actions taken on the basis of measurements

47
Q

validity coefficient

A

a correlation coefficient that provides a measure of the relationship between test scores and scores on a criterion measure

PS505 - Testing, Measurement, and Assessment (3 decks)

Brainscape helps you reach your goals faster, through stronger study habits.
© 2024 Bold Learning Solutions. Terms and Conditions