Decision Making and Tests Flashcards

1
Q

Classification def

A

A decision to assign an individual to one category rather than another

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

[Classification] Diagnosis def

A

Placing an individual to a category to identify some problem

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

[Classification] Selection def

A

Deciding on whom to hire, whom to admit to a university program

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Test information helps to (3)

A
  • Detect the presence or absence of a characteristic
  • Identify beneficial treatment/interventions
  • Improve the objectivity and accuracy of selection decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Statistical Determinants of Decision Quality (3)

A
  1. Validity of tests
  2. Base rate of the relevant attribute or characteristic
  3. Selection rate
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Base Rate (BR) def

A

What proportion of the population being examined ACTUALLY possesses the relevant characteristic?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Selection Rate (SR)

A

What percentage of the population will be selected

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Cutting score def

A

Score used to divide test scores into predictions about who has the characteristic and who does not

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Hits def

A

Correct predictions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Misses def

A

Incorrect predictions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

True positive def

A

A successfully predicted hit where the phenomenon is predicted and it occurs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

True negative def

A

A successfully predicted hit where the phenomenon is not predicted and it does not occur

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

False positive def

A

A miss where the phenomenon is predicted but it does not occur.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

False negative def

A

A miss where the phenomenon is not predicted to occur but it does occur

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

% of correct decisions will depend on: (3)

A
  • Test VALIDITY
  • BR
  • SR
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Tests work best when:

A

BR = 50%

17
Q

When BR is too LOW, test is best used to _____

A

rule OUT the characteristic

18
Q

When BR is too HIGH test is best used to _____

A

rule IN the characteristic

19
Q

When BR is very high or very low, test must be _____ to provide substantial incremental validity.

A

HIGHLY VALID

20
Q

When in doubt about test validity, ______

A

make the base rate prediction

21
Q

Where to Get Base Rate Information? (3)

A
  • Already available information
  • Review of historical records
  • Build a data base by collecting outcome information over time