Assessment and Selection Pt. 1

Question 1

Definition of recruitment

Answer 1

The process of attracting job applicants

Question 2

Definition of assessment

Answer 2

The process of evaluating applicants’ potential

Question 3

Definition of selection

Answer 3

The process of deciding which applicant to offer

Question 4

4 things that can affect a response

Answer 4

1. Target latent construct
2. Random error
3. Method effects
4. Construct irrelevant variance

Question 5

Definition of random error

Answer 5

Noise in the measurement

Question 6

Definition of method effects

Answer 6

Systematic effects of the method used; may lead to common method bias when correlating multiple constructs

Question 7

How to reduce common method bias

Answer 7

1. Using experimental designs
2. Using different sources of data

Question 8

Definition of construct irrelevant variance

Answer 8

Capturing an unintended construct

Question 9

2 subjective ways to assess validity

Answer 9

1. Face validity
2. Content validity

Question 10

Definition of face validity

Answer 10

Whether the test superficially looks like what you want to measure

Question 11

Definition of content validity

Answer 11

The measure contains all the representative sets of items within the construct space

Question 12

3 different types of reliability

Answer 12

1. Internal reliability
2. Interrater reliability
3. Test-retest reliability

Question 13

Definition of internal reliability

Answer 13

Consistency in participants’ responses to the various items in the measure

Question 14

How can internal reliability be mitigated?

Answer 14

1. Split-half reliability
2. Cronbach’s alpha (higher than .7)

Question 15

How to remedy poor Cronbach’s alpha?

Answer 15

1. drop items that cause low alpha
2. Increase sample size
3. Design test with more items

Question 16

Definition of interrater reliability

Answer 16

Consistency in scoring between multiple observers

Question 17

Definition of test-retest reliability

Answer 17

Consistency in participants’ aggregate score on the measure across repeated measures

Question 18

Important notes when conducting retest

Answer 18

1. Is this construct a trait or state
   -> Traits are more likely to be consistent
2. How far apart should you measure?
   -> 3 weeks ago

Question 19

Simple definition for 3 types of reliability

Answer 19

Internal reliability: Consistency across items
Interrater reliability: Consistency across raters
Test-retest reliability: Consistency across time

Question 20

3 empirical ways to demonstrate construct validity

Answer 20

1. Criterion validity
2. Convergent validity
3. Discriminant validity

Question 21

Definition of criterion validity

Answer 21

The extent that the measure is correlated with a relevant behavioral outcome

Question 22

2 subtypes of criterion validity

Answer 22

1. Concurrent validity
   -> The extent to which a new measure correlates with outcome measures administered at a similar time (It should be of the same construct)
2. Predictive validity
   -> The extent to which test scores correlate with an outcome measure administered in the future
3. Incremental validity
   -> The ability of a predictor to explain additional variance in the outcome above and beyond established predictors

Question 23

Definition of nomological network

Answer 23

A representation of constructs and a specification of interrelationships between them; a hypothesized map of several constructs

Question 24

2 validities related to the nomological network

Answer 24

1. Convergent validity
2. Discriminant validity

Question 25

Definition of convergent validity

Answer 25

Hypothesize theoretically related (similar) constructs and demonstrate that they are indeed empirically correlated

Question 26

Definition of discriminant validity

Answer 26

Hypothesize theoretically unrelated constructs and demonstrate that they are not correlated