Chapter 5-construct validity-MTMM

Question 1

MTMM def

Answer 1

Multitrait-Multimethod Matrix.
Way of representing the relations between several constructs and several methods for measuring these constructs.

Question 2

Why do we Need a MTMM?

Answer 2

(1) Both convergent and divergent evidence of validity is needed.
(2) Each test is a construct-method unit: a combination of construct content and measurement procedures not specific to that content
(3) To examine divergent validity, convergent validity, and method variance, more than 1 construct and more than 1 measurement method are needed in the validation process → MTMM

Question 3

What does Method variance represent?

Answer 3

Systematic error
Characteristics of method that will influence how responders will respond to questions important for our attributes

Question 4

Test score variance is composed of ____ (3)

Answer 4

True score variance + Method variance + Random error

Question 5

MTMM presents all the interrelations resulting when__________

Answer 5

each of several constructs is measured by each of several methods

Question 6

If everything is good, we’re looking for: (3)

Answer 6

(1) High “trait variance”
(2) Low “method variance”
(3) Low “irrelevant variance”

Question 7

Trait variance def

Answer 7

Variance due to construct

Question 8

Method variance def

Answer 8

Variance due to method

Question 9

Irrelevant variance def

Answer 9

Variance shared with theoretically unrelated measures

Question 10

Minimum requirement of MTMM

Answer 10

At least 2 measures representing 2 different methods for each of 2 constructs.

Question 11

MTMM: Regions (6)

Answer 11

(1) Monomethod block
(2) Monotrait-monomethod values
(3) Heterotrait-monomethod triangle
(4) Heteromethod block
(5) Monotrait-heteromethod values
(6) 2 Heterotrait-heteromethod triangles

Question 12

What are the 2 diagonals that exist?

Answer 12

Reliability and Validity diagonals

Question 13

What is the Reliability diagonal?

Answer 13

Monotrait-monomethod values (in monomethod block).
Tell how reliably each construct (A, B, C) can be measured with each method.

Question 14

What is the Validity diagonal?

Answer 14

Monotrait-heteromethod values
Tell how well a construct is measured using different methods.
-> Convergent validity coefficients

Question 15

Rules for Evaluation of an MTMM (4) - expectations

Answer 15

(1) Validity diagonals (=convergent validity) should be HIGH
(2) Heterotrait monomethod values should be LOWER than convergent validity
(3) Heterotrait heteromethod triangles: LOW
(4) Reliability diagonal - monotrait-monomethod correlations: High/as expected

Question 16

What represents the discriminant validity in the MTMM matrix?

Answer 16

Heterotrait-heteromethod & Heterotrait-monomethod

Question 17

Advantages of the MTMM Approach (3)

Answer 17

(1) Allows examining convergent and discriminant validity simultaneously
(2) Stresses the characteristics that a good test should have
(3) Reflects nature of construct validation: Construct validity is not a single coefficient

Question 18

Disadvantages of the MTMM Approach

Answer 18

Sometimes not feasible