Scale Validity

Question 1

What is Validity

Answer 1

Degree to which a test measures what it is supposed to measure
- Also related to proposed usefulness of measures
- Legitimacy of ones interpretations of a test scores

Question 2

What is validity based on?

Answer 2

Empirical evidence and theory
ex. strong data supports Students who score better on SAT do better in college

Question 3

Are handwriting or color preferences meaningful tests and useful measures of personality?

Answer 3

No because there is a lack of scientific evidence for color preference or handwriting as valid measures of personality.

Question 4

What happens without test Validity?

Answer 4

test-based decisions about individuals could be misinformed, scientifically meaningless, and potentially even harmful

Question 5

What is the difference of validity in a study vs an individual

Answer 5

Study: Accuracy of interpretation of test results
Individual: Accuracy of interpretation on individuals scores

Question 6

What is the most important type of validity?

Answer 6

Construct Validity

Question 7

What is Construct Validity?

Answer 7

The degree to which test scores can be accurately interpreted as reflecting a particular construct.

Question 8

What is Construct Validity Factor Analysis (internal structure)

Answer 8

Statistical procedure used to evaluate the internal structure or dimensionality of psychological tests – Exploratory and Confirmatory

Question 9

What can Factor Analysis help us do?

Answer 9

• Identify presence and nature of factors existing within a set of items
• Reveal associations among factors. dimensions within a multidimensional test
• Understand the meaning of each factor within a test

Question 10

What is Content Validity?

Answer 10

• Degree to which actual content matches expected content.
• Degree to which the content of a measure truly reflects the full domain of the construct for which it is being used.
• Provided by experts who have a deep understanding of the content

Question 11

What is the content validity index?

Answer 11

Multiple experts provide quantitative ratings of test content
- Either a 5-7 point response scale rating: relevance, representativeness, specificity, clarity of items

Question 12

What score would Statistics have on a content validity index?

Answer 12

1

Question 13

Face Validity

Answer 13

The degree to which a measure appears to be related to a specific construct, in the judgment of nonexperts, such as test takers.

Question 14

Why is face validity important?

Answer 14

It might influence test takers’ motivation to respond in a serious and honest manner and question its legitimacy or relevance of the entire testing procedure

Question 15

What is associative validity?

Answer 15

Involves the match between a measure’s actual associations with other measures and the associations that the test should have with those other measures

Question 16

What is Convergent Validity

Answer 16

Degree to which test scores correlate (either positively or
negatively) with other measures that they should be correlated with.
- Criterion, Concurrent, and predictive validity are just varities of this
- Two measures of something like self esteem should have strong positive correlations with one another

Question 17

What is Criterion Validity?

Answer 17

The degree to which test scores are related to a particularly important criterion variable that they should be correlated with.
- Differentiates between groups of people or make predictions about the future

Question 18

What is Concurrent Validity?

Answer 18

The degree to which test scores are correlated (related to) with other criterion variables that are measured at the same time as the primary test is completed.

Question 19

What is Predictive Validity?

Answer 19

The degree to which test scores are correlated with criterion variable that is measured at a future time than when the primary test is completed.

Question 20

What is Discriminant Validity?

Answer 20

Degree to which test scores are uncorrelated (or weakly correlated) with other tests
of unrelated constructs (that they should not be correlated with).

Question 21

Reliability vs. Validity

Answer 21

Reliability: Degree to which differences in test scores reflect differences among people in a skill or trait

Validity: A property of interpretation of test scores; Tied to theory and implications of test scores

Validity requires reliability. Reliability is necessary but not sufficient for validity

Question 22

Ceiling Effect

Answer 22

person easily scores the maximum possible on a test so that the test no longer is able to measure the full higher extent of person’s ability
- A true score for a ceiling effect could be higher than the highest scale score