Validity - Doc Joyce Discussion

Question 1

what is validity?

Answer 1

validity is the degree to which a test measures what it is supposed to measure

Question 2

what are the three broad categories of validity?

Answer 2

1. Content Validity
2. Criterion-related Validity
3. Construct-related Validity

Question 3

this type of validity is the estimate of the sufficiency of the variable included in the test (test blueprint: syllabus/tos)

Answer 3

content validity

Question 4

this type of validity is an estimate of how well the test fits a hypothesized theoretical framework

Answer 4

construct-related validity

Question 4

this type of validity is an estimate of how well the test scores relate to a specific standard

Answer 4

criterion-related validity

Question 5

This type of validity is an estimate of how well the test’s appearance fits its intended purpose

How relevant the test items appear to be

(Questions that ask about actions vs Inkblots on The Introversion/Extraversion Test)

Answer 5

face validity

Question 6

this type of validity is an estimate of how well the test measures what it intends to measure at the time the variable is emitted

Answer 6

ecological validity

Question 6

for content validity, what is the source of evidence, procedure, and result?

Answer 6

source of evidence: test blueprint

procedure: Subject-matter experts’ review and/or Content Validity Ratio

result: more than 0.75 CVR is acceptable

Question 6

for criterion-related validity, what is the source of evidence, procedure, and result?

Answer 6

source of evidence: relationship with a criterion (standard)

procedure: correlate with a criterion presently available or will be available in the future (concurrent or predictive)

result: correlation is more than 0.60

Question 7

what is a construct?

Answer 7

a construct is an informed scientific idea developed or hypothesized to describe or explain behavior

Question 8

what are the two types of construct-related validity?

Answer 8

1. Convergent Validity
2. Divergent (Discriminant Validity)

Question 9

this type of validity is the degree to which a test correlates with other measures of the same or similar constructs

Answer 9

convergent validity

Question 10

this type of validity is the degree to which a test does not correlate with measures of unrelated constructs

Answer 10

divergent (discriminant) validity

Question 11

how do you measure the internal construct validity of a test?

Answer 11

check if the test is homogenous, measuring a single construct