Industrial/Organizational Psychology Flashcards
Job analysis
Systematic method for collecting the information needed to describe job requirements
Serves as the basis for developing criterion measures, provides info for job redesign, helps to identify causes of accidents
Broad methods of job analysis
Observing employees performing the job
Interviewing employees and/or supervisors
Reviewing company records
Having employees keep a job diary
Two specific types of methods used for job analysis
Job-oriented methods (tasks required for the job)
Worker-oriented methods (attributes of the employee that would lead to success in that job)
Job-oriented methods of job analysis
Provide information about the characteristics of the tasks that are performed on the job
Worker-oriented methods of job analysis
Provide information about the knowledge, skills, abilities, and other characteristics (“KSAOs”) that a worker needs to perform the job successfully
Ex. Position Analysis Questionnaire
Strength to worker-oriented methods of job analysis
Produce data that is more helpful for designing training programs and deriving criterion measures that provide useful employee feedback
Job analysis v job evaluation
Job analysis - conducted to clarify the requirements of the job
Job evaluation - conducted to determine the worth of the jobs to set salaries and wages
Job analysis
Conducted to clarify the requirements of the job
Job evaluation
Conducted to determine the worth of the job for setting wages and salaries
Identify commendable factors: years of education, years of experience, degree of autonomy or responsibility, consequences of errors
Comparable worth
Determined through job evaluations
Ensures that people performing comparable work are receiving comparable pay
Usually done through some kind of performance evaluation (points system), so that salary is determined by the inherent value of the job
Criterion measures
Used to assess job performance
Two types of criterion measures
Objective - quantitative (don’t usually provide enough info)
Subjective - judgement-based rating scales (susceptible to bias)
Objective criterion measures
Qualitative measures of production
- ex. Number of units produced, number of units sold, absenteeism, tardiness, etc.
Disadvantages to objective criterion measurement
May be biased towards situational factors (differences in equipment, territory, supplies, etc.)
Many important aspects of job effectiveness can not be measured quantitatively (eg. working with peers, job motivation, etc.)
Cannot use these measures with complex professional, material or administrative jobs
Subjective criterion measures
Broadly
Evaluate employees based on ratings that reflect the judgement of the rater (usually a supervisor)
Peer, subordinate, and self-ratings can also be used when appropriate
Four characteristics of criterion measures
Ultimate v actual criterion - ultimate criterion is the conceptual and theoretical criterion, actual is the way performance is actually measured
Relevance - actual criterion’s construct validity (the degree to which it measures the ultimate criterion)
Deficiency - the degree to which the actual criterion does not reflect all aspects of the ultimate criterion
Contamination - when an actual criterion assess factors other than what it was designed to measure
Ultimate v Actual criterion
Ultimate - the theoretical or conceptual criterion (the accurate and complete measure of performance)
Ex. Psychotherapist ultimate criterion = provides effective treatment
Actual - the way performance is actually measured
Ex. Psychotherapist actual criterion = patient satisfaction with treatment
Relevance as it pertains to criterion measurement
Criterion relevance refers to the actual criterion s construct validity (the degree to which it measures the ultimate criterion)
Deficiency as it relates to criterion measures
Criterion deficiency is the degree to which an actual criterion does NOT measure all aspects of the ultimate criterion
(Limits criterion relevance)
Contamination as it relates to criterion measurement
Criterion contamination occurs when an actual criterion measures factors other than those it was designed to assess
Ex. Knowledge of an employees predictor performance
(Limits relevance of criterion measurement)
Two types of subjective criterion measurement
Relative (comparative) - compare 2+ employees to each other
Absolute - provide info on performance without comparisons
Advantages and disadvantages to absolute and relative techniques of subjective criterion measurement
Relative techniques can help alleviate rater biases
- BUT force the rater to rank employees (even if they’re all doing equally well)
Absolute techniques run the risk of rater bias
- BUT do not force you to unnaturally rank employees
Absolute techniques of subjective criterion measurement
Provide information on an employees performance without reference or comparison to other employees
Relative techniques for subjective criterion measurement
Require a rater to compare the performance of two or more employees
Two relative techniques for subjective criterion measurement
Paired comparison - rater compares each employee with every other employee on dimensions of job performance
Forced distribution - grade employees on a normally distributed curve
Paired comparison technique
(Relative technique for subjective criterion measurement)
Rater compares an employee to every other employee on one or more dimensions of job performance
Disadvantage: becomes increasingly difficult as the number of employee increases
Forced distribution technique
(Relative technique for subjective criterion measures)
Involves assigning grades and placing employees grades on a normal curve
Disadvantage: may yield erroneous data if the data are not normally distributed
Critical incident technique
(An absolute technique for subjective criterion measurement)
Derive a checklist of critical incidents needed for good and bad performance
Rater completes the checklist for each employee
Advantage: provides data to give feedback to the employee
Disadvantage: development is difficult, assesses only extreme (critical) job behaviors rather than typical ones
Four types of absolute techniques for subjective criterion measurement
Critical incident technique
Forced choice rating scale
Graphic rating scale
Behaviorally anchored rating scale (BARS)
Forced choice rating scale technique
(Absolute technique for subjective criterion measurement)
Consists of 2-4 selection alternatives, and the rater has to choose the one that best or least describes the employee
Advantage: can help reduce rater bias
Disadvantage: time-consuming to develop, disliked by raters
Graphic rating scale technique
(Absolute technique for subjective criterion measurement)
Requires the rater to indicate employee level of performance on several dimensions using a Likert scale
Disadvantage: highly susceptible to bias (accuracy improved with Likert items are anchored with examples)
Behaviorally anchored rating scale (BARS) technique
(Absolute technique for subjective criterion measurement)
Supervisors (1) identify dimensions of job performance, (2) identify behavioral anchors (critical incidents) for each dimension, (3) order the anchors from most to least desirable or vice versa, (4) choose the anchors that best describe the employee
Advantage: provides data for employee feedback
Disadvantage: time-consuming to develop, anchors are often made up of expectations (and not what the employee is actually doing)
Three kinds of rater bias
Leniency/Strictness - raters avoid the middle range of a rating scale
Central Tendency - raters only use the middle range of a rating scale
Halo Bias - evaluation of the employee on one dimension impacts ratings on others
Leniency/Strictness Bias
Occurs when a rater tends to avoid the middle range of a rating scale, rating all employees as high (leniency) or low (strictness) on all dimensions of performance
Central Tendency Bias
When a rater consistently uses only the middle range of a rating scale
Halo Bias
When a raters evaluation of an employee on one dimension, impacts ratings in others
OR
When a raters general impression of an employee influences their ratings
Can be positive or negative
How to eliminate rater biases in employee criterion measurement
Frame-of-reference training
Provides raters with common descriptions of what constitutes effective and ineffective performance on each dimension
Reliability
As it relates to predicting employee performance
The extent to which performance on a measure is unaffected by measurement error
Validity
As it relates to predicting employee performance
The degree to which the measure assesses what it is designed or supposed to
Three types of validity and which one is most important for employee performance prediction
Content
Construct
Criterion
Adverse impact
When a selection test (or other employment procedure) is discriminating against members of a legally protected group
80% rule
Used to determine if a procedure is having an adverse impact
Multiply employment rate of majority group by 80%, and that will give you the employment rate of the minority group (adverse impact will be below that figure)
Two main causes of adverse impact
Differential validity - measure of predicted performance is valid for one group but not another
Unfairness - when members of one group consistently underperforms on a measure (and the differences are not due to score differences on the criterion)
Differential validity
As a source of adverse impact
Occurs when a measure is valid for one group but is not valid for another group.
The characteristic that distinguishes between the two groups (eg. gender) is the moderator variable
Unfairness
As it relates to sources of adverse impact
Occurs when embers of o;e group consistently obtained lower scores on a predictor than members of another group
BUT, the difference between the groups is not related to the difference between groups on the criterion variable
Two ways to handle a discrimination lawsuit (Title 6)
The burden of proof is on the company to demonstrate there is no discrimination
- Argue the measure is a business necessity with no reasonable alternative
- Argue the discrimination is a bona fide occupational qualification (ex. Needing a woman as a attendant for a women’s restroom)
Incremental validity
Refers to the increase in decision-making accuracy an employer will achieve by using the predictor to make selection decisions
Incremental validity depends on what two factors
Base rate - number of employees performing satisfactorily without use of the proposed predictor
Selection ratio - ratio of job openings to number of applicants
Selection ratio
The ratio of job openings to job applicants
Low ratios are best (small number of openings and many applicants) because it means the organization can be more selective
Base rate
As it relates to incremental validity
The percent of employees who are performing satisfactorily without use of the proposed predictor
Moderate base rates ~.50 are associated with best incremental validity
Taylor-Russell Tables
Used to estimate the percent of new hires that will be successful given a combination of:
- validity coefficients
- selection rates
- base rates
Multiple regression (As it relates to employee selection)
When using a multiple regression for predicted job performance, you have predictor scores that are weighted and summed to yield an estimated criterion score
Multiple regressions are compensatory…so one high predictor score can offset a low predictor score
Multiple cutoff (As it relates to employee selection)
Noncompensatory
Applicants must reach minimum scores across the multiple predictors before they can be considered for selection
(May start with this, and then use multiple regression on the applicants that pass)
Three ways that predictors can be combined
As it pertains to employee selection
Multiple regression - combined and summarized scores on predictors
Multiple cutoff - applicants must pass cutoff scores on the predictors before being considered
Multiples hurdles - predictors are administered in a predetermined order, one at a time, and applicants must pass a hurdle before progressing to the next one
General Mental (Cognitive) Ability Tests (Predictors used in organizations)
Consistently produce the highest validity coefficients across jobs and job settings
Job Knowledge Tests
As they relate to predictors used in organizations
Measures of job knowledge are good (if not better) predictors of job performance (compared to GMAs)
These are only useful if the applicant has prior job training or experience
Personality Tests
As they pertain to predictors used in organizations
The Big Five trait of conscientiousness is most predictive of good outcomes
Research on personality scores and job performance is shaky
Biodata
As it relates to predictors used in organizations
Collection of employment history and other social history variables (health history, economic history, etc.)
One of the best predictors
Disadvantage: BIBs contain questions that are not face-valid, and some applicants may leave items blank feeling that the question is an invasion of privacy
Ways to improve validity of interviews (most common way predictors are measured)
Use a standardized interview
Train interviewers in observation and interpersonal skills
Combine the interview with other assessment matures (GMA, etc)
Use a single interviewer (better than a panel interview)
Realistic job previews
When a work sample is generated that includes a written description of the job
Helps to avoid turnover when the job does not reach expectations of the prospective employees
Two types of tests used at assessment centers
(When groups of applicants are evaluated by a panel)
In-basket test: take action on sample memos and reports
Leaderless group discussion: have 5-6 people work on a problem to solve or discuss a job-related issue
A needs assessment contains four elements:
Organizational analysis - what are the goals and is training needed to achieve them
Task analysis - what skills are needed by employees to succeed
Person analysis - to determine who needs the training (which workers)
Demographic analysis - which groups may need the training (eg. Age)
Two main principles of effective training
Overlearning - practice a task beyond mastery, leads to automaticity
Provision of identical elements - making training as identical to real world scenarios as possible
Two major methods of training employees
On-the-job (most widely used)
Off-the-job
Advantages to on-the-job training
Permit active participation
Allow for ongoing feedback
Are job-relevant
Examples of on-the-job training
Internships, apprenticeships, mentoring
Job rotation - working many roles within a job (for management)
Cross-training - teaching workers tasks that are performed in several similar jobs
Job rotation
Form of on-the-job training
Involves having trainees perform several jobs over time
Ordinarily used to train managers
Cross-training
Form of on-the-job training
Teaches workers tasks and activities that are performed in several, similar jobs
Advantages to off-the-job training techniques
Pro ide more opportunities for focusing on specific tasks
Flexibility to tolerate learning errors
Disadvantages to off-the-job training techniques
Low trainee motivation
Higher costs (due to time off for the training)
Types of off-the-job training
Lectures, conferences, computer assisted trainings
Vestibule modeling - simulation of a work scenario that is too dangerous or costly to do in real life
Behavioral modeling - watching a teacher perform the task to be learned
Vestibule modeling
Type of off-the-job training
Makes use of a physical replication or simulation of the work environment
Is useful when on-the-job training would be too costly or dangerous