Chapter 5 Validity + Lecture 3

Question 1

________ can be defined as the agreement between a test score or measure and the quality it is believed to measure

Answer 1

Validity

Question 2

The psychometric standards are divided into three sections:
1 Found_____
2 Oper_______
3 Appli_______

Answer 2

Foundations; Operations; Applications

Question 3

F____ V______ is the mere appearance that a measure has validity

Answer 3

Face Validity

Question 4

C_____-realted v______ considers the adequacy of representation of the conceptual domain the test is design to cover

Answer 4

Content-related validity

Question 5

C_______ Val_______ evidence tells us just how well a test corresponds with a particular criterion

Answer 5

Criterion Validity

Question 6

Con_______-related evidence for validity comes from assessments of the simultaneous relationships between the test and the criterion

Answer 6

Concurrent

Question 7

The reliability between a test and a criterion is usually expressed as a correlation called a Va____ Co_______

Answer 7

Validity Coefficient

Question 8

The Va________ Co_________ tells us the extent to which the test is valid for making statements about the criterion

Answer 8

Validity Coefficient

Question 9

A variable has a “_______ ______” if all scores for that variable fall very close together

Answer 9

restricted range

Question 10

Before 1950, most social scientists considered only crit_____ and con_______ evidence for validity

Answer 10

Criterion and Content

Question 11

A c______ is defined as something built by mental synthesis

Answer 11

construct

Question 12

Con______ Val_______ ev_________ is established through a series of activities in which a researcher simultaneously defines some construct and develops the instrumentation to measure it

Answer 12

Construct Validity Evidence

Question 13

What test is used when there is no criterion or universe or content accepted as entirely adequate to define the quality to be measured?

Answer 13

Construct Validity Evidence

Question 14

Con______ validity shows that measures of the same construct converge, or narrow in, on the same thing

Answer 14

Convergent validity

Question 15

To demonstrate dis________ evi_________, a test should have low correlations with measures of unrelated constructs, or evidence for what the test does not measure

Answer 15

discriminant evidence

Question 16

All published tests have to meet the requirements outlined by the S_______ for Educational and p__________ Testing

Answer 16

Standards; Psychological

Question 17

What makes a good test?
1 Re______
2 Va________
3 St__________

Answer 17

Reliability; Consistency; Standardisation

Question 18

________ of a measure – extent of being free from measurement error

Answer 18

Reliability

Question 19

______ ______ _____ theory

Observed score = True score + Measurement error

Answer 19

Classical test score

Question 20

Errors assumed to be random in ______ ______ ______ theory

Answer 20

Classical Test Score

Question 21

Standard deviation of the distribution of errors shows magnitude of measurement error in ________ _______ ________ theory

Answer 21

classical test score theory

Question 22

Sources of Measurement Error
● _____ sampling - changes over time
● I____ sampling – different items used to assess the same attribute
● Internal consistency – consistency of items within the same test

Answer 22

Time; item