Kyriazos et al (Construct validity-MTMM) Flashcards

1
Q

Construct validity

A

How well a test measures the intended construct. Ongoing process.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Multitrait-Multimethod (MTMM) Matrix

A

Method to assessconstruct validityby evaluating convergentand discriminant validityusing multiple traits and methods.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

MTMM evaluates the validity of ____ using different ___.

A

traits, methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Traits def

A

Hypothetical constructs (e.g. cognitive abilities).
Can be assessed with methods like self-reports or interviews.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Four sets of correlations in MTMM

A
  1. Monotrait-monomethod
  2. Monotrait-heteromethod
  3. Heterotrait-monomethod
  4. Heterotrait-heteromethod
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Campbell and Fiske’s 4 rulesfor evaluating MTMM matrices

A
  1. MONOtrait-HETEROmethod correlationsshould be statistically significant and strong.
  2. HETEROtrait-HETEROmethod correlations should be weak or similar to HETEROrotrait-MONOmethod correlations.
  3. HETEROtrait-MONO method correlations should be smaller than MONOotrait-HETEROmethod correlations.
  4. The pattern of trait intercorrelations should be CONSISTENT across ALL blocks to ensurediscriminant validity.
    => I.e. The way DIFFERENT traits (like anxiety, self-esteem, depression) are related to each other should stayCONSISTENT whether you’re using the same method or different methods.
    -> This helps confirmdiscriminant validity, meaning the test isn’t mixing up or confusing different traits with each other.
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Trochim’s 5 guidelines

A
  1. HIGHEST correlations should be with same trait (mono-mono).
  2. Validity diagonal should be positive and strong. Shows convergent validity
  3. Validity coefficients should be the biggest in their block -> In each group of numbers (method block), the diagonal number (comparing the same trait across methods) should be the biggest. Shows that the trait is being measured accurately.
  4. Off-diagonal elements should be smaller. Proves that the test isn’t confusing different traits— key for discriminant validity.
  5. Consistent relationships between traits
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Validity diagonal

A

Same trait measured with different methods

How well did you know this?
1
Not at all
2
3
4
5
Perfectly