Scale development and Evaluation Flashcards

1
Q

Test construction Strategies (3)

A

(1) Correspondence Strategy
(2) Empirical Strategy
(3) Construct (Theoretical) Strategy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Correspondence Strategy

A

One-to-one correspondence between person’s verbal reports and internal states

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Correspondence Strategy was dominant in the _______

A

early 20th century

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Correspondence Strategy is ________ and _______

A

Intuitive; atheoretical

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Assumptions in Correspondence Strategy (4)

A

(1) Each item corresponds to a specific construct
(2) Item has COMMON MEANING for all test-takers
(3) A test-taker is able to accurately assess the requested information
(4) A test-taker will honestly report requested information

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Empirical Strategy def

A

Items selected on basis of relations to external criteria. (e.g., contrasted groups)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

In the empirical strategy, the meaning of an item is NOT equal to _________. It is determined by ______

A

the verbal content of the item; groups who endorse the item.
=> Interpretation of scores is by ‘cookbook“: empirically knowncorrelates of high and low scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Concerns in Empirical strategy (4)

A

(1) Are individuals in constrasting groups different as intended
(2) Unintended group differences
(3) Problem of generalization
(4) Item overlap

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Factor Analysis is used in _____

A

Empirical strategy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Factor Analysis def

A

Statistical procedure that aims to determine the number of distinct factors underlying.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

“Factors”, in Factor analysis means: ___

A

Hypothetical variable reflecting a latent construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Construct (Theoretical) Strategy originated in the ________

A

1950s; prominent from the 1960s to the present.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Construct strategy emphasizes ____________

A

theoretical definitions of domains to be measured

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Goal of construct strategy

A

Measure an attribute – a hypothetical construct

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Assumptions in Construct strategy (3)

A

(1) A person possesses some degree of a construct (e.g., sociability)
(2) Nontest behaviours can be identified which are referents (indicator) for the construct
(3) Test responses are referents (indicator) for the construct.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What does the construct strategy for reliability and validity?

A

Incorporates statistical methods

17
Q

How does the construct strategy evaluates the adequacy of a test?

A

Evaluates adequacy of test by how well test fits in with theoretical (nomologic) net for the construct

18
Q

7 Typical Steps in Theoretical Scale Construction Approach

A

(1) Define construct: Consider the literature for definition + theoretical relations with other constructs
(2) Gather/Write items
(3) Evaluate content validity: expert judgment to know if items are relevant
(4) Pre-testing of items: Administer initial pool to a small sample and conduct cognitive interviews
(5) Item reduction: Consider endorsement rate for items.
(6) Factor analysis: Determine the optimal number of factors underlying item response patterns
(7) Scale evaluation: test of dimensionality, reliability and validity