Reliability

Question 1

How are predictive validity and concurrent validity different?

Answer 1

Predictive validity is assessed by calculating the correlation between a predictor and a criterion (with the criterion being obtained at a later point in time). *Wei says that this type of validity is of interest when the criterion can only be obtained at a later point in time*

Concurrent validity also is assessed by calculating the correlation between a predictor and a criterion, however, the two are both obtained at the same time.

Question 2

When should you assess predictive validity?

Answer 2

When you are interested in using a test (predictor) to predict future behavior (criterion).

Question 3

When should you assess concurrent validity?

Answer 3

When you are interested in assessing a criterion at the same time as the predictor. Also, is used if it is difficult, or impossible, to obtain predictor scores at a later point in time.

Question 4

Does concurrent validity tend to underestimate predictive validity? Why or why not?

Answer 4

Yes. It underestimates it because there is a range restriction on the criterion due to people being unavailable for testing.

Question 5

What are four ways to assess the construct validity of a measure?

Answer 5

1. See if there are any group differences
2. See if scores change over time or following an intervention (e.g., training, treatment, etc.)
3. See if scores correlate with related constructs and don’t correlate with unrelated constructs
4. See how people process or think about the measure

Question 6

What are two major types of construct validity?

Answer 6

1. Convergent
2. Discriminant

Question 7

What is convergent validity?

Answer 7

Convergent validity is present when two different measures of the same concept correlate with one another

Question 8

What is discriminant validity?

Answer 8

Discriminant validity is present when two measures of different concepts do not correlate with one another

Question 9

Is an instrument that is valid always reliable?

Answer 9

Yes

Question 10

Is an instrument that is not valid reliable?

Answer 10

It may or may not be reliable.

Question 11

Is an instrument that is reliable valid?

Answer 11

It may or may not be valid.

Question 12

Is an instrument that is not reliable valid?

Answer 12

No. An instrument must be reliable in order to be valid.

Question 13

What is necessary for a measure to be valid?

Answer 13

It must be reliable

Question 14

Describe the two types of content validity?

Answer 14

1. Face Validity - when a measure appears to measure what the trait is says it measures
2. Logical/Sampling Validity - when a measure contains all, or a good portion, of the content within the domain/trait of interest

Question 15

What are the two major types of criterion-related validity?

Answer 15

1. Concurrent
2. Predictive