I/O Flashcards
Developing criterion measures to evaluate
Want it not affected by
Most important validity is
For subjective criterion measures there are known issues
Biases: halo leniency central tendency and strictness
criterion contamination (when reater knows performance on predicter effects how rate on the criterion) – this then can inflate the predicters criterion related validity coefficient
Construct validity
Halo: judge all based in one attribute
Frame of reference
How to overcome reater biases
Personnel Psychology
Personnel specification
Evaluation selection of employees
Who can best do a job given the job description given the job analysis
Best way to test criterion and predictor
Critical incidents
Specific behaviors to rate employees on that reflect job performance
Personnel comparison systems
Rank ordered
Paired comparison system
Forced distribution
Advantages
Best to worst
Each compares to every other worker in pairs (somewhat impractical)
Ech worker in a limited number of categories based on normal distribution (10, 20, 40, 20, 10)
Reduce central tendency biases, strict, leniency
Name one Absolute rating measures
And one subjective measure
Critical incident technique
Subjective measure: behaviorally anchored rating scale or BARS
BARS behaviorally anchored rating scale
How does it compare to Lickart scale?
Disadvantage?
Develop several independent measures of job behavior ( knowledge, relationships with coworkers)
ID anchors or critical incedents
Rank behaviors from most to least important
Not choosing a number but rather a specific behavior - less subject to raters biases - disadvantage is takes time to develop and is very specific only to job developed for
Incremental validity or functional utility
Important coefficient is —?
Selection ratio
Base rate
Selection of workers
Increase in decision making ability by using predicter (if previous success rate is 50% and new predicter goes up to 70%, count as .20)
Validity coefficient
Selection ratio - openings to applicants - want LOW (many applicants per opening)
Base rate - % performing well without predicter (best incremental when close to 50% otherwise already selecting very well or very poorly)
Predictors
Validity for predicting success
Bio data - among best predictors However, depends on what?
Depends on the items included on application so need to use an empirical approach or other approach to select bio data of interest
Trainability test
Situational tests
Work sample when applicant does not have experience per se bit want to see if would benefit from tarainimg - great validity for some jobs if sample can be well defined
Situational = role play
In basket test
Realistic job preview
Documents similar to real - rates on productivity and skill
To prevent unrealistic views of the job to guard against turnover
Assessment centers are different how?
Incorporate many different predictors including everything talked about previously
Research shows very good predictor BUT some question criterion contamination
Also expensive to run
Job nterviews
Most used but generally poor predicter of success
- superficial
- impressions occur very early and are hard to change
- contrast effect
Training helps as do panel interviews esp when Rach individually evaluate and discuss after
Also structured interview better esp when based on job analysis
Wonderlich and Otis
Employment intelligence tests
Cognitive tests are the most valid across job settings
Validity increases as complexity of job increases
Mmpi -2 TAT 16PF epps coo
Contextual performance
Personality tests OK when measure specific traits that have been linked to job demands
Consciousness is highly important
Effort, enthusiasm