Chapter 5-construct validity-MTMM Flashcards

1
Q

MTMM def

A

Multitrait-Multimethod Matrix.
Way of representing the relations between several constructs and several methods for measuring these constructs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Why do we Need a MTMM? (3)

A

(1) Both convergent and divergent evidence of validity is needed.
(2) Each test is a construct-method unit: a combination of construct content and measurement procedures not specific to that content
(3) To examine divergent validity, convergent validity, and method variance, MORE THAN 1 CONSTRUCT & MORE THAN 1 MEASUREMENT METHOD (minimum 2) are needed in the validation process

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What does Method variance represent?

A

SYSTEMATIC error
Characteristics of method that will influence how responders will respond to questions important for our attributes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Test score variance is composed of ____ (3)

A

True score variance + Method variance + Random error

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

MTMM presents all the interrelations resulting when__________

A

each of several constructs is measured by each of several methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

If everything is good, we’re looking for: (3)

A

(1) High “trait variance”
(2) Low “method variance”
(3) Low “irrelevant variance”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Trait variance def

A

Variance due to construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Method variance def

A

Variance due to method

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Irrelevant variance def

A

Variance shared with theoretically unrelated measures

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Minimum requirement of MTMM

A

At least 2 measures representing 2 different methods for each of 2 constructs.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

MTMM: Regions (6)

A

(1) Monomethod block
(2) Monotrait-monomethod values
(3) Heterotrait-monomethod triangle
(4) Heteromethod block
(5) Monotrait-heteromethod values
(6) 2 Heterotrait-heteromethod triangles

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the 2 diagonals that exist?

A

Reliability and Validity diagonals

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the Reliability diagonal?

A

Monotrait-monomethod values (in monomethod block).
Tell how reliably each construct (A, B, C) can be measured with each method.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the Validity diagonal?

A

Monotrait-heteromethod values
Tell how well a construct is measured using different methods.
-> CONVERGENT validity coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Rules for Evaluation of an MTMM (4) - expectations

A

(1) Validity diagonals (=convergent validity) should be HIGH
(2) Heterotrait monomethod values should be LOWER than convergent validity
(3) Heterotrait heteromethod triangles: LOW
(4) Reliability diagonal - monotrait-monomethod correlations: High/as expected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What represents the discriminant validity in the MTMM matrix?

A

Heterotrait-heteromethod & Heterotrait-monomethod

17
Q

Advantages of the MTMM Approach (3)

A

(1) Allows examining convergent and discriminant validity simultaneously
(2) Stresses the characteristics that a good test should have
(3) Reflects nature of construct validation: Construct validity is not a single coefficient

18
Q

Disadvantages of the MTMM Approach

A

Sometimes not feasible