011_Measurement Validity

Question 1

Measurement validity is the ____

Answer 1

degree to which a measurement instrument (or process) truthfully measures what it purports to measure.

Question 2

Validity refers to the results of the measurement: are ____

Answer 2

the interpretations of the results appropriate and accurate; AND are the results being used appropriately.

Question 3

Types of Validity

Answer 3

Surface Validity
Criterion-related Validity
Construct Validity

Question 4

Surface Validity

Answer 4

• Face:
The degree to which the instrument (process) logically appears to measure what it’s designed to measure.

• Content:
The degree to which the content of the measurement (interview questions, questionnaire items, etc.) match the construct(s) and purpose of the study.
•Relevance and representativeness 
•Alignment to theory, prior research 
•Panel of expert judges

Question 5

Criterion Validity

Answer 5

• Concurrent: A measure in the study is highly correlated with another measure that has previously established strong validity. (well established study to create a new one)
• Predictive: A measure is administered and then after a time elapse the criterion is measured.
• Correlation is often used to establish both concurrent and predictive validity.

Question 6

Construct Validity

Answer 6

• Convergent

* Divergent (aka Discriminant)

Question 7

Example

ABC Test of Vocabulary for 9th Grade Students

Answer 7

Content: Does it measure the achievement of vocabulary knowledge as reflected in the instructional objectives for teaching vocabulary?

Criterion: Do test scores predict who will not do well in English next year?

Construct: Does this test measure what we call ‘verbal ability’?

Question 8

Construct Validity

Answer 8

• Convergent Validity: The degree to which two different measures of the same construct are related.
• Divergent Validity: The degree to which the measures of two different constructs are unrelated.

• Established multiple ways
• Content analysis, factor analysis
• Correlation
• ANOVA studies (pre-posts, differential
groups)

Question 9

Validity refers to the degree to which a measurement instrument or process:

Answer 9

measures what is claims to measure

Question 10

A measurement tool or process can be reliable, but not be valid.

Answer 10

Example: I can reliably measure the head circumference of individuals. But if I assert that people with higher head circumferences have higher intelligence, this would be an invalid use of my measure.

Question 11

True or False: Validity resides in the interpretation and use of the results of a measure

Answer 11

True