Validity in assessments

Question 1

What is validity

Answer 1

The degree to which evidence and theory support the interpretations of test scores for the proposed uses of the test. Are we measuring what we are supposed to measure?

Question 2

What five sources of information are used to make an argument for validity

Answer 2

1) Test content
2) Response process
3) Internal structure
4) Relations to other variables
5) Testing consequences

Question 3

Why is validity important in the context of assessment?

Answer 3

Assessment results are use to make important decisions and sometime life-changing decision about an individual.

Question 4

What four things should we keep in mind when we use the term validity?

Answer 4

1) Validity refers to the appropriateness of the use and interpretation of TEST RESULTS, not the test itself.
2) Validity is a matter of degree - it does not exist on an all-or-nothing basis.
3) Validity is a unitary concept. It centers on construct validity, which is supported by sources of validity evidence. But many texts and researchers still refer to validity as a tripartite validity.
4) Validity is specific to some particular group, use, or purpose of the test scoter interpretation.

Question 5

We view validity as a unitary concept, but historically it was viewed as having three distinct types - This is called tripartite validity. What are three types of tripartite validity?

Answer 5

1) Content validity
2) Criterion validity
3) Construct validity

Question 6

What is a construct?

Answer 6

1) This is also called a latent variable. It is a scientifically developed concept, idea, or hypotheses that are used to describe or explain behavior.
2) They can be comprehensive and complex (e.g. personality) or narrowly defined (e.g., depressed mood).