convergent and divergent validity

Question 1

what is convergent and divergent validity?

Answer 1

reflects the degree to which test scores have the correct patterns of associations with other variables

Question 2

what does the conceptual foundation of a construct include?

Answer 2

the connections between the construct and a variety of other psychological constructs

Question 3

what are the interconnections between a construct and other related ones called?

Answer 3

nomological network

Question 4

what is predictive validity?

Answer 4

where a particular correlation between test scores and a specific criterion are make or brake

Question 5

what does it mean if the validity coefficient is large?

Answer 5

then we have more confidence in using the test for its intended purpose

Question 6

what is validity generalisation?

Answer 6

a process of evaluating a tests validity coefficients across a large set of studies

Question 7

what do validity generalisation studies evaluate?

Answer 7

the predictive utility of a test’s scores across a range of settings, times and siuations

Question 8

what are the three questions that validity generalisation studies address?

Answer 8

• the average level of predictive validity across studies
• the degree of variability associated with the validity coefficients
• identify sources of systematic variability in the coefficients

Question 9

what is a nomological network based on?

Answer 9

a large number of coefficients across a wide range of criteria

Question 10

once the coefficients are estimated what happens?

Answer 10

they are placed on a table for visual inspection then a subjective judgement is made about the pattern of coefficients with respect to whether a judgement construct validity is meritied

Question 11

what do multitrait multimethod matricies try to overcome?

Answer 11

the fact that a correlation between two scores may conflate two sources of variance

Question 12

what are the two scores of variance that MTMM’s deal with?

Answer 12

trait variance (good stuff)
method variance (bad stuff)

Question 13

what do we want to see in terms of trait and method variance?

Answer 13

hope to see larger correlations between the same traits, in comparison to correlations between scores based on just the same method

Question 14

do we want a lot of shared trait variance?

Answer 14

yes, particularly identical traits measured using different methods

Question 15

what does quantifying construct validity involve?

Answer 15

requires researchers to predict the magnitude of the correlation between their measure of interested and their selected criterion. then, the correlations between their measure of interest and these selected criteria are estimated. finally, the correlation between the predicted and estimated correlations is estimated.

Question 16

what are the factors affecting a validity coefficient?

Answer 16

pearson correlations, the magnitude affected by some statistical factors and some measurement related ones

Question 17

what is the measurement error for validity coefficients?

Answer 17

they will be biased downwardly to the extent that the measures are associated with scores with imperfect reliability

Question 18

what does it mean if your measures have internal consistency reliabilities in the area of .50-.60?

Answer 18

dont expect much in the way of validity coefficients

Question 19

what is restricted range?

Answer 19

the amount of variability in one or both distributions of scores can affect the correlation between the two sets of scores

Question 20

what are the two realistic cases where the amount of variablity is lower than it should or could be?

Answer 20

• the measures are not sensitive enough to distinguish people
• the same is more homogenous than the pop of interest