Lecture 3 Flashcards
Validity definition
The degree to which theory and empirical evidence support the interpretation of the test scores for proposed use
Content validity
Does the test fully cover all aspects of the construct which is being measured.
Construct underrepresentation and construct irrelevant content
Response process validity
Do the test users interpret the items as they are intended and use the response process which is intended
Threats to response process validity
- Poorly designed items
- Due to participants lack of motivation, guessing, social desirability etc.
Internal structure validity
- When number of factors matches theory
- Rotated factor loadings match the theoretical structure
- Factor correlations should match with the theory
Nomological network
Summarized all theoretical relations between the construct and other variables
Convergent and discriminant evidence
Convergent shows a correlation when there should be one and discriminant shows no correlation when there shouldn’t be one
Multitrait-multimethod matrices validity
Convergent validity on monotrait heteromethod correlation.
Discriminant validity on heterotrait monomethod and heterotrait heteromethod correlation.
Consequence of test use types
- Evidence of intended effects
- Evidence regarding unintended differential impact on groups
- Evidence regarding unintended systematic effects
Evidence regarding unintended differential impact on groups
Does the use of the test result in unintended benefits for a certain group