ISEM and OSEM Flashcards
Reliabilty
Guion, R.M. (2002). Validity and Reliability
Campbell, J.P. (1976). Psychometric theory.
Concept of Validity
Sackett et al., 2012. The concept of validity and the process of validation.
SIOP Principles for Validation, 2003
Binning and Barrett, 1989
Are we really measuring what we say we’re measuring? Using video techniques to supplement traditional construct validation procedures
Podsakoff et al., 2012
Validation of selection systems
Sussman and Roberson, 1986; The validity of validity: An analysis of validation study designs
Van Iddekinge and Ployhart, 2008; Developments in the criterion-related validation of selection procedures.
Maier, 1988. Need for quality control
Self-selection
Kuncel & Klieger, 2007; law school study
Test taking dipositions
Schmitt & Ryan, 1992
Pub bias
McDaniel et al., 2006
Positive ManiFOLD
Murphy et al., 2009
Synthetic Validity
Johnson, 2010
Testing and Fairness
Uniform Guidelines on Employee Testing Procedures (1978). + McDaniel, M.A., Kepes, S. & Banks, G.C. (2011).
Pyburn et al., 2008). The diversity-validity dilemma: Overview and legal context.
Ployhart & Holtz, 2008). The diversity-validity dilemma: Strategies for reducing racioethinic and sex subgroup differences and adverse impact in selection.
Meade & Tonidandel, 2010). Not seeing clearly with Cleary: What test bias analyses do and do not tell us. Read all commentaries and author response.
Finch et al., 2009). Multistage selection strategies: Simulating the effects of adverse impact and expected performance for various predictor combinations.
Muchinsky, P. (2004). When the psychometrics of test development meets organizational realities: A conceptual framework for organizational change, examples, and recommendations.
Utility Analysis
Cascio, W. & Boudreau, J.W. (2011).
Job Analysis and Competency modeling
Harvey, R.J. (1991). Chapter 2: Job analysis.
Brannick et al., 2012). Job analysis for knowledge, skills, abilities, and other characteristics, predictor measures, and performance outcomes. In N. Schmitt (Ed.), The Oxford Handbook of Personnel Assessment and Selection.
Campion et al., 2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64, 225-262.
Signaling Theory
Bangerter, A., Nicolas, R., & Konig, C.J. (2012).
Constructs vs. Methods
Arthur & Villado, 2008
Recruitment
Breaugh, J.A. (2012). Employee Recruitment: Current knowledge and suggestions for future research.
Walker et al., 2012). Diversity cues on recruitment websites: Investigating the effects of job seekers’ information processing.
Zhao et al., 2011). Internship: A recruitment and selection perspective.
Cognitive ability
Schmidt, F.L. (2012). Cognitive tests used in selection can have content validity as well as criterion validity: A broader research review and implications for practice.
Berry et al., 2011). Racial/ethnic differences in the criterion-related validity of cognitive ability tests.
Integrity testing
Van Iddekinge et al..,. 2012 The criterion-related validity of integrity tests: An updated meta-analysis.
Work samples
Roth, P.L., Bobko, P. & McFarland, L.A. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature.
Biodata
Breaugh, J.A. (2009). The use of biodata for employee selection: Past research and future directions.
Bernerth et al., 2012). An empirical investigation of dispositional antecedents and performance-related outcomes of credit scores
Retesting
Van Iddekinge et al., 2011). Can I retake it? Exploring subgroup differences and criterion-related validity in promotion testing.
Personality
Barrick & Mount, 2012). Nature and use of personality in selection.
Roberts et al., 2005). The structure of conscientiousness
Shaffer et al., 2012). A matter of context
Le et al., 2011). Curvilinear relationships between personality traits and job performance.
van Hooft et al., 2012. Using eye-tracking to understand response processes when faking.
SJTs
Christian et al., 2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities.
McDaniel et al., 2011). Toward an understanding of situational judgment item validity and group differences.
Employment interviews
Dipboye, R.L., Macan, T., Shahani-Deming, C. (2012). The selection interview from the interviewer and applicant perspectives: Can’t have one without the other.
Podsakoff et al., 2011. Efects of organizational citizenship behaviors on selection decisions in employment interviews.
ACs
Thorton & Gibbons, 2009). Validity of assessment centers for personnel selection.
Lievens & Patterson 2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection.
Lance, C. (2008). Why assessment centers do not work the way they are supposed to. Read all commentaries and author responses.
Hoffman et al., 2011). Exercises and dimensions are the currency of assessment centers.
Perf. Appraisal - Theory
Campbell et al., 1993). A theory of performance.
Viswesvaran & Ones, 2000). Perspectives on models of job performance.
Pulakos et al., 2000). Adaptability in the workplace: Development of a taxonomy of adaptive performance.
Murphy, K.R. (2008). Explaining the weak relationship between job performance and ratings of job performance. IOP.
O’Boyle, E. Jr. & Aguinis, H. (2012). The best and the rest: Revisiting the norm of normality of individual performance.
Perf. appraisal issues
Weekley, J.A. & Gier, J.A. (1989). Ceilings in the reliability and validity of performance ratings: The case of expert raters.
Wang, X.M, Wong, K.F.E., & Kwong, J.Y.Y (2010). The roles of rater goals and ratee performance levels in the distortion of performance ratings.
Rudolph et al., 2012). Testing the structured free recall intervention for reducing the impact of bodyweight-biased stereotypes on performance ratings in immediate and delayed contexts.
Gorman & Rentsch, 2009). Evaluating Frame-of-Reference Rater Training Effectiveness Using Performance Schema Accuracy.
Reb et al., 2010). Understanding performance ratings: Dynamic performance, attributions, and rating purpose
Pulakos, E.D. & O’Leary, R.S. (2011). Why is performance management broken?. IOP
Motivation Review Day
- Jex & Britt Chapter 8 (pg. 233-268)
- Diefendorff & Chandler (2011 Handbook). Motivating Employees (71 pages).
Optional:
Sluss, van Dick, & Thompson (2011 Handbook). Role Theory in Organizations: A Relational Perspective. (22 pages)
Locke, E. A., Latham, G. P. (2002). Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, 57, 705-717.
Deci, R. M., & Ryan, E. L. (2000). Self-Determination Theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68-78.
Reich & Hershcovis (2011 Handbook). Interpersonal Relationships At Work (65 pages in Word).
Martocchio (2011 Handbook). Stragetic reward and compensation plans.
Motivation Studies Day
- Skarlicki, van Jaarsveld, & Walker (2008). Getting even for customer mistreatment: The role of moral identity in the relationship between customer interpersonal injustice and employee sabotage.
- Ambrose, M. L., & Schminke, M. (2009). The role of overall justice judgments in organizational justice research: A test of mediation.
- Shantz & Latham (2009). An exploratory field experiment of the effect of subconscious and conscious goals on employee performance.
- Klehe & Anderson (2007). Working hard and working smart: Motivation and ability during typical and maximum performance.
Attitude Review Day
Schleicher, Hansen, & Fox (2011 Handbook). Job Attitudes and Work Behaviors. (52 pages).
Kristof-Brown & Guay (2011 Handbook). Person-Environment Fit (50 pages).
Optional: Jex & Britt chapter on attitudes.
Attitude Studies Day
- Harrison et al., (2006). How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences.
- Boswell, et al., (2009). Changes in newcomer job satisfaction over time: Examining the pattern of honeymoons and hangovers.
- Schleicher, et al., (2004). Reexamining the job satisfaction-job performance relationship: The complexity of job attitudes.
- Bentein et al., (2005). The role of change in the relationship between commitment and turnover: A latent growth modeling approach.
Org. Stress and Safety Day
- Jex & Britt chapter 7
- Kaplan & Tetrick (2011 Handbook). Workplace Safety and Accidents: An Industrial/Organizational Psychology Perspective. (18 pages in Word).
- Griffin & Clarke (2011 Handbook). Stress and Well-Being at Work. (91 pages).
Optional:
Greenberg (2011 Handbook). Organizational Justice: The Dynamics of Fairness in the Workplace. (56 pages)
Kossek & Michel (2011 Handbook): Flexible Work Schedules. (84 pages with comment area).
George & Ng (2011 Handbook): Nonstandard Workers: Work Arrangements and Outcomes. (24 pages)
Hammer & Zimmerman (2011 Handbook). Quality of Work Life. (34 pages).
Stress and safety studies
- Bacharach, S. B., Bamberger, P. A., & Doveh, E. (2008). Firefighters, critical incidents, and drinking to cope: The adequacy of unit-level performance resources as a source of vulnerability and protection. JAP, 93(1), 155-169.
- Jones, F., O’Connor, B., Conner, M., McMillan, B., & Ferguson, E. (2007). Impact of daily mood, work hours, and iso-strain variables on self-reported health behaviors. JAP, 92(6), 1731-1740.
- Christian, Bradley, Wallace, & Burke (2009). Workplace Safety: A meta-analysis of the roles of person and situation factors. Journal of Applied Psychology, 94, 1103-1127.
- Probst, Brubaker, & Barsotti (2008). Organizational injury rate underreporting: The moderating effect of organizational safety climate. JAP, 93, 1147-1154.
Team Review
- Jex & Britt chapter 12 (pp. 375-409)
- Cannon-Bowers & Bowers (2011 Handbook). Team Development and Functioning. (46 pages).
Optional:
Kozlowski, S. W. J., & Ilgen, D. R. (2007/2008?). Enhancing the effectiveness of work groups and teams. Psychological Science in the Public Interest. Pp. 77-124
Klein, K. J., & Kozlowski, S. W. J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3, 211-Jackson & Joshi (2011 Handbook). Work team diversity. (36 pages)
Ferris & Hochwarter (2011 Handbook). Organizational Politics (26 pages).
De Dreu (2011 Handbook). Conflict at Work: Basic Principles and Applied Issues (33 pages).
Team Studies
Barnes et al., 2008). The costs of backing-up behavior in teams.
Humphrey, et al., 2009). Developing a theory of the strategic core of teams: A role composition model of team performance. JAP, 94, 48-61.
Mesmer-Magnus et al., 2009). Information sharing and team performance: A meta-analysis. JAP, 94, 535-546.
Bell, S. T. (2007). Deep-level composition variables as predictors of team performance: A meta-analysis. JAP, 92, 595-615
Leadership Reviews
Jex & Britt Chapter 10 (pg 303-338)
Barling, Christie, & Hoption (2011 Handbook). Leadership. 58 pages.
Optional:
Eby (2011 Handbook). Mentoring (54 pages)
Peterson (2011 Handbook). Executive Coaching. (32 pages).
Hogan, Hogan, & Kaiser (2011 Handbook). Management Derailment: Personality Assessment and Mitigation. (28 pages).
Yukl & Van Fleet (1991). Literature review on Leadership.
Leadership Studies
- Brown, M. E., & Trevino, L. K. (2009). Leader-follower values congruence: Are socialized charismatic leaders better able to achieve it?
- Erez, A., Misangyi, V. G., Johnson, D. E., LePine, M. C., & Halverson, K. C. (2008). Stirring the hearts of followers: Charismatic leadership as the transferal of affect.
- Rosette, A. S., Loenardelli, G. J., & Phillips, K. W. (2008). The White standard: Racial bias in leader categorization.
- Judge, T. A., & Piccolo, R. F. (2004). Transformational and transactional leadership: A meta-analytic test of their relative validity.
Entry, Exit, and other topics
Bauer & Erdogan (2011 Handbook). Organizational Socialization: The Effective Onboarding of New Employees. (14 pages)
Hom (2011 Handbook). Organizational Exit (52 pages)
Barclay & Aquino (2011 Handbook), Workplace Aggression and Violence (26 pages).
Other relevant O topics (optional readings)
Berdahl & Raver (2011 Handbook), Sexual Harassment. (30 pages).
Rousseau (2011 Handbook). The Individual-Organization Relationship: The Psychological Contract (30 pages).
Colella & Bruyere (2011 Handbook), Disability and Employment: New Directions for Industrial/Organizational Psychology. (81 pages in Word).
Martins (2011 Handbook). Organizational Change and Development.
DeMeuse, Marks, & Dai (2011 Handbook). Organizational downsizing, mergers and acquisitions, and strategic alliances: Using theory and research to enhance practice.
Leung & Peterson (2011 Handbook). Managing a Globally Distributed Workforce: Social and Interpersonal Issues.
Erez (2011 Handbook). Cross Cultural and Global Issues in Organizational Psychology.
Aguinis (2011 Handbook). Organizational Responsibility: Doing Good and Doing Well.
Writing Items
Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. [Good overview of the measure development process]
Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93-105. [Considerations for how to respondents generate answers, and how answers can be affected by the way you write the questions]
Henry et al., 1994). On the “remembrance of things past”: A longitudinal evaluation of the retrospective method.
Insufficient Effort Responding
Huang et al., 2011). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology.
Data cleaning
Rogelberg et al., 2007). Introduction: Understanding and dealing with organizational survey nonresponse.
Fishman et al., 2003). Multiple imputation for missing data: Making the most of what you know. ORM, 6, 282-308.
Internal Consistency Reliability
Ree, M. J., & Carretta, T. R. (2006). The role of measurement error in familiar statistics. ORM, 9, 99-112.
Schmitt, N. (2006). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 81-84.
Inter-rater Reliability and Agreement
Schmidt, F. L., & Hunter, J. E. (1989). Interrater reliability coefficients cannot be computed when only one stimulus is rated.
Read this one first – the Kozlowski and Hattrup article responds to this one and corrects their misperceptions.
Kozlowski, S. W. J., & Hattrup, K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus.
Generalizability Theory
DeShon, R. P. (2002). Generalizability Theory.
IRT
Embretson, S. E., & Reese, S. P. (2000). The new rules of measurement.
Zickar, M. J. (2002). Modeling data with polytomous IRT. In Drasgow & Schmitt, Measuring & Analyzing behavior in orgs. Pp. 123-155.
DIF
Raju, N. S., & Ellis, B. B. (2002). Differential item and test functioning.
SEM basics
Schumacker, R. E., & Lomax, R. G. (1996). Goodness-of-fit criteria. Chapter 7 in A beginner’s guide to structural equation modeling
CFA and EFA
Klein, R. B. (1998). Measurement models and CFA. Chapter 7 in Principles and practice of structural equation modeling.
Conway & Huffcutt, 2003). A review and evaluation of EFA practices in organizational research. ORM, 6, 147-168.
Hayton et al., 2005). Factor retention decisions in EFA: A tutorial on parallel analysis. ORM,
Measurement invariance
Vandenberg & Lance (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations.
Cross cultural and internet testing
Meade et al., 2007). Are internet and paper and pencil personality tests truly comparable? An experimental design measurement invariance study.
Schaffer & Riordan (2003). A review of cross-cultural methodologies for organizational research: A best-practices approach.
Method Variance
Podsakoff, P. M., MacKenzie, S. B., Lee, J-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903.
Spector, P. E. (2006). Method variance in organizational research: Truth or urban legend? ORM, 9(2), 221-232.
SJTs
McDaniel & Nguyen, 2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9, 103-113.
McDaniel et al., 2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60, 63-91.
Conditional Reasoning Tests
James, L. R. (1998). Measurement of personality via conditional reasoning. ORM, 1, 131-163.
Also CARMA (2012) -Aggression, personality, abusive supervision (other?)
