I/O Flashcards
Job Analysis
Purpose: to describe what is required for job
Job analysis can provide info that is job-oriented, worker-oriented, or a combo
- Job-oriented techniques focus on task requirements of job (e.g., lifting, repairing, installing)
- Worker-oriented techniques identify knowledge, skills, abilities, and personal characteristics that are required for successful job performance (e.g., high school education, manual dexterity, 20/20 vision, adaptability)
Methods: interviews, questionnaires (e.g., the Position Analysis Questionnaire), direct observation, work diaries
** most popular = Position Analysis Questionnaire (PAQ)
Performance Evaluation
How much money position worth (eVALU(E)ation)
- Done to see if a person should get a raises or bonuses, promotion, dismissals, provide employees with feedback about their performance
Measures of job performance (criterion measures) can be:
- Objective (data that can be easily quantified, such as dollar amount of sales and number of units produced) measures
- Subjective (ratings by supervisors, peers, or employees themselves) measures affected by rater biases (including halo effect, central tendency bias, leniency bias, strictness bias, and contrast effect)
Subjective rating methods include Personnel Comparison Systems, Critical Incidents, Behaviorally Anchored Rating Scales, Behavioral-Observation Scales, and Forced-Choice Checklists.
Objective Measures
Direct, quantitative measures of performance
E.g., a car salesman’s effectiveness can be measured by the number of cars sold, and a lawyer’s job performance can be assessed by determining the percentage of cases won.
Other objective measures include salary, number of work days missed, and number of absences
Disadvantages of objective measures –> do not measure many important facets of job performance, such as an employee’s motivation or ability to cooperate with or supervise others
Also, objective data are limited by situational factors (e.g., equipment difficulties, number of coworkers, the economy), and they may not be useful for evaluating performance in complex jobs.
Subjective (Rating) Measures
Rely on judgment of a rater; used to assess less concrete aspects of job
Useful for assessing complex, less concrete aspects of job performance, such as motivation, ability to supervise, problem-solving ability, and effectiveness when working with others
Disadvantages –> Raters are sometimes not motivated to provide accurate ratings or do not understand the rating scale; measures are also affected by rater biases (see below), which limit their reliability and validity
Subjective Ratings Techniques
(1) Personnel Comparison Systems
- involve comparing him/her to other employees on each job behavior (ranked best to worst)
- Paired Comparison – each employee is compared to every other employee)
- Forced Distribution system – rater categorizes employees into a predetermined distribution (e.g., top 10%, next 25%, middle 30%, bottom 10%, etc.)
- advantage: reduce effect of certain rater bias (e.g., central tendency, leniency and strictness)
(2) Critical Incidents
- likerty scale, each point is anchored with a description of a job behavior
- specific job behaviors associated with very good performance (talks about problems effectively) or poor performance (late to work)
(3) Behaviorally Anchored Rating Scales (BARS)
- employees rated on several dimensions of job performance (e.g., motivation, decision-making)
- set of “behavior anchors” (critical incidents) is created, w/ each anchor being tied to a numerical point on a likert scale
- supervisors responsible for identifying job dimensions
- differs from others bc involves many steps
- advantage: gives info useful for employee feedback
- disadvantages: time-consuming and position specific
E.g., An example for a clinical psychologist on a BARS for Rating Clinical Empathy:
7: Is very supportive and concerned if patient is distressed.
6: Makes appropriately-timed interventions.
5: Allows patient freedom to express him or herself.
4: Inquires if patient has any feelings he or she wishes to discuss.
3: Speaks a lot about him or herself.
2: Discusses patient with colleague in an exhibitionistic manner.
1: Is often late to begin sessions and/or often cancels sessions.
(4) Behavioral-Observation Scales (BOS)
- similar to BARS
- only rater indicates how often the employee performs each critical item (always, sometimes, never)
(5) Forced Choice Checklists (FCCL)
- presents the rater with a series of statements that have been grouped so that the statements in each group are similar in terms of social desirability
- advantage: helps reduce social desirability and other rater biases
Rater Biases
accuracy of subjective ratings can be limited by rater biases
1) halo effect - judge performance based on 1 ASPECT of person’s behavior
- E.g., if a supervisor gives a high rating to an employee on cooperation and, as a result, also gives the employee high ratings on other unrelated dimensions of job behavior, the supervisor is exhibiting a positive halo. In contrast, if the supervisor rates an employee low on cooperation and then also gives the employee low ratings on other dimensions, the supervisor is exhibiting a negative halo
2) central tendency bias - tendency to assign AVERAGE ratings to all ratees
3) leniency bias - gives all ratees POSITIVE ratings
4) strictness (severity) bias - gives all NEGATIVE ratings to all ratees
5) contrast effect - if first 3 are poor, make 4th higher than should be
- e.g., when rating employees, if the first 3 employees are very poor workers, the rater might give the fourth employee (who is actually mediocre) inaccurately high ratings
BEST WAY TO REDUCE BIAS = adequately train rater
-training most effective when focusing less on rating errors and more on accuracy (i.e., teaching raters to recognize the multiple contributors to good job performance and to evaluate behavior in an objective way)
Frame-of-Reference Training - teaching raters to recognize contributors for job performance and evaluate behaviors in an objective way; designed to ensure different raters have the same
conceptualizations of job performance and reduce rater bias
Rater Biases
accuracy of subjective ratings can be limited by rater biases
1) halo effect
- tendency to judge all aspects of a person’s behavior on the basis of a single attribute or characteristic
- E.g., if a supervisor gives a high rating to an employee on cooperation and, as a result, also gives the employee high ratings on other unrelated dimensions of job behavior, the supervisor is exhibiting a positive halo. In contrast, if the supervisor rates an employee low on cooperation and then also gives the employee low ratings on other dimensions, the supervisor is exhibiting a negative halo
2) central tendency, leniency, and strictness biases
- central tendency bias = tendency to assign average ratings to all ratees
- leniency bias = tendency to give all ratees positive ratings
- strictness bias = tendency to assign negative ratings to all ratees
3) contrast effect
- tendency to give ratings on the basis of comparisons to other ratees
- e.g., when rating employees, if the first 3 employees are very poor workers, the rater might give the fourth employee (who is actually mediocre) inaccurately high ratings
BEST WAY TO REDUCE BIAS = adequately train rater
-trainign most effective when focuses less on rating errors and more on accuracy (i.e., teaching raters to recognize the multiple contributors to good job performance and to evaluate behavior in an objective way)
Frame-of-Reference Training was designed to help raters recognize the multidimensional nature of job performance and to ensure that different raters have the same conceptualizations of job performance
Personal Selection
Personnel selection techniques = work samples, interviews, biographical inventories, assessment centers and standardized tests.
Cognitive Ability Tests (also called General Mental Ability and General Intelligence Tets) and Job Knowledge Tets have been shown to have the highest validity for job selection purposes across different jobs vs. Interest Inventories which have the lowest validity
- General mental ability = valid predictors of job performance across setting and increase as the complexity of job increases (.51 = Schmitt et al. 1998; .75 = Hunter and Hunter 1984)
General Mental Ability (also called cognitive ability and general intelligence) Tests
General mental ability (also called cognitive ability and general intelligence) are the most valid predictor of job performance across settings
+ increase as the complexity of job increases
(validity coefficients –> .51 = Schmitt et al. 1998; .75 = Hunter and Hunter 1984)
Job Knowledge Tests
used when individuals have previous experience or training; good predictors of performance
Work Samples
sample of work behavior in standardized, job-like conditions; reduces discrimination of minorities
E.g., carving dexterity test for dental students; shorthand and stenography tests; programming tests for computer programmers; and the in-basket test for managers
Roth, Bobko and McFarland (2005), an observed mean correlation between work sample tests and measures of job performance of .33 was found when measures of job performance (e.g., supervisory ratings) were corrected for attenuation. The research also suggests that work samples of motor skills have more validity than work samples of verbal skills (Asher and Sciarrino, 1974)
Advantages of work samples as a selection technique are that they are acceptable to applicants and are less likely than other methods to unfairly discriminate against members of minority groups
Also used as Trainability Test, designed to identify people who are likely to benefit from training
Work samples are sometimes part of a Realistic Job Preview, which may also include a written description of the job, interviews, group discussions with current employees, and other activities. The purpose of a realistic job preview is to prevent unrealistic expectations about a job in order to reduce turnover.
Interviews
Commonly used, but not accurate in prediction
Assessment Centers
interviews, tests, and simulated work situations; “in basket” test; evaluated by assessment team on series of dimensions, decision making, motivation, flexibility, etc
Personality Tests
“Big Five” – OCEAN –> Openness, Conscientiousness, Extraversion, Agreeableness, Neuroticism
Conscientiousness is an accurate predictor of job performance and training success
Integrity Tests
Used to reduce probability employees will steal, drink, fight, sabotage equip, etc.
Adverse Impact (Legal Issues in Personnel Selection)
Adverse Impact – occurs when minority group members are hired at a substantially lower rate than majority group members
80% or 4/5 Rule
(% majority hired x .80)
if % minority hired is less than this # = discrimination
- Causes:
1. Differential Validity - when selection procedure is a valid
predictor of performance in 1 group but not another - when validity coefficients for 2 groups differ sig
- e.g., selection test w/ very high validity for males but very low for females
2. Unfairness - when 1 group scores lower than another group - selection test might be a good predictor for both groups, but if 1 group consistently scores lower on test, they are less likely to be hired
When selecting or evaluating personnel, legal issues must be considered, especially those set forth in the EEOC’s Uniform Guidelines.
Methods to compensate for bias:
1) separate cutoffs
2) within group norming
3) banding
Score adjustments (when adverse impact)
1) separate cutoff - different cutoffs for different groups
2) within group morning - convert raw scores into standard scores varied by group
3) banding - treat scores in a given range as the same
- i.e., band 1 is 91-100, band 2 is 80-91
1) Incremental Validity
usefulness of a selection test in terms of decision-making accuracy
- subtract “base rate” from “positive hit” rate
- incremental validity is affected by the selection ratio (percentage of applicants to be hired), the base rate (proportion of current employees considered successful), and the measure’s validity coefficient
Unit of Analysis
assess the cost-effectiveness of a selection procedure; most common = dollar gain
Combining Predictors
provides more info about applicant than just 1 predictor
- to ensure each predictor is not providing redundant info, each predictor should have a low correlation w/ other predictors
Multicollinearity
when predictors are highly correlated
Multiple Regression
used to estimate an applicant’s score on a criterion on the basis of 2 or more predictors
if an applicant gets 1 low score, they can make up for it
Multiple Cutoff
applicants must score above a minimum cutoff point on each predictor to be hired
low score cannot be made up for and minimum competency is needed in all domain
Hurdle
(Multiple) Hurdle
also concompensatory; must meet minimum on 1 test, before going to other
unlike multiple cutoff, not all predictors are administered to all applications; can save time and money
Training
1st Step in developing training program = Needs Analysis
(1) organization analysis
(2) task analysis
(3) person analysis
2nd Step = Program Design
- involves choosing the appropriate training program format (e.g., on-the-job training, vestibule training, classroom training, or programmed instruction)
3rd Step = Program Evaluation
- Effectiveness of training is assessed
- Evaluations can be formative (which take place as the program is being developed) or summative (conducted after the program is complete)
Career Counseling
Tests used in career counseling:
- achievement tests (measure how much content a person has mastered in a particular content domain)
- aptitude tests (measure a person’s potential for learning)
- interest inventories
Theories related to career choice focus either on:
- Personality Variables that Affect Career Decisions
E.g., Holland’s Personality and Environmental Typology
- Stages of Career Development
E.g., Super’s Career and Life Development Theory
Theories of Career Choice
Holland’s Personality and Environment Typology
- 6 personlaity types
- (RIASEC) realistic (machinery or tools), investigative (analytic, curious, and precise), artistic (expressive, nonconforming, and introspective), social (enjoys working with others), enterprising (manipulate others to goals or gain), and conventional (data, filing, and records)
- congruence - fit between personality type and environment
- differentiation - high on only one, most accurate predictor of job related outcome
Roe’s Fields and Levels Theory
- vocational choice links to experience with parents
- 3 parenting types: (1) overprotective, (2) avoidant, and (3) acceptant
- 8 occupational fields, 6 occupational levels
- if they had to work hard to get childhood needs, they will have higher occupational level in their chosen field
Super’s Career and Life Development Theory
- sequence of 5 developmental stages, first one must be met to move to another
- growth, exploration, establishment, maintenance, and decline
-career maturity - extent to which the person has mastered tasks related to his developmental stage - life space - varied social roles adapted at different points during life span
- life career rainbow - nine major life roles that people adopt during the 5 different stages
Tiedeman and O’Hare’s Decision Making Model
- not only making a living, but making a life
- based their concepts on theory of ego identity
- posed careerrelated correlates to each of Erikson’s eight psychosocial crisis resolutions
Miller-Tiedman and Tiedeman’s Decision Making Model
- personal reality and common reality
- personal - thought, act, or behavior that the individual feels is right for himself
- common - what others say you should do