ISEM and OSEM Flashcards

1
Q

Reliabilty

A

Guion, R.M. (2002). Validity and Reliability

Campbell, J.P. (1976). Psychometric theory.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Concept of Validity

A

Sackett et al., 2012. The concept of validity and the process of validation.
SIOP Principles for Validation, 2003
Binning and Barrett, 1989

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Are we really measuring what we say we’re measuring? Using video techniques to supplement traditional construct validation procedures

A

Podsakoff et al., 2012

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Validation of selection systems

A

Sussman and Roberson, 1986; The validity of validity: An analysis of validation study designs

Van Iddekinge and Ployhart, 2008; Developments in the criterion-related validation of selection procedures.

Maier, 1988. Need for quality control

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Self-selection

A

Kuncel & Klieger, 2007; law school study

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Test taking dipositions

A

Schmitt & Ryan, 1992

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Pub bias

A

McDaniel et al., 2006

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Positive ManiFOLD

A

Murphy et al., 2009

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Synthetic Validity

A

Johnson, 2010

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Testing and Fairness

A

Uniform Guidelines on Employee Testing Procedures (1978). + McDaniel, M.A., Kepes, S. & Banks, G.C. (2011).

Pyburn et al., 2008). The diversity-validity dilemma: Overview and legal context.

Ployhart & Holtz, 2008). The diversity-validity dilemma: Strategies for reducing racioethinic and sex subgroup differences and adverse impact in selection.

Meade & Tonidandel, 2010). Not seeing clearly with Cleary: What test bias analyses do and do not tell us. Read all commentaries and author response.

Finch et al., 2009). Multistage selection strategies: Simulating the effects of adverse impact and expected performance for various predictor combinations.

Muchinsky, P. (2004). When the psychometrics of test development meets organizational realities: A conceptual framework for organizational change, examples, and recommendations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Utility Analysis

A

Cascio, W. & Boudreau, J.W. (2011).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Job Analysis and Competency modeling

A

Harvey, R.J. (1991). Chapter 2: Job analysis.

Brannick et al., 2012). Job analysis for knowledge, skills, abilities, and other characteristics, predictor measures, and performance outcomes. In N. Schmitt (Ed.), The Oxford Handbook of Personnel Assessment and Selection.

Campion et al., 2011). Doing competencies well: Best practices in competency modeling. Personnel Psychology, 64, 225-262.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Signaling Theory

A

Bangerter, A., Nicolas, R., & Konig, C.J. (2012).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Constructs vs. Methods

A

Arthur & Villado, 2008

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Recruitment

A

Breaugh, J.A. (2012). Employee Recruitment: Current knowledge and suggestions for future research.

Walker et al., 2012). Diversity cues on recruitment websites: Investigating the effects of job seekers’ information processing.

Zhao et al., 2011). Internship: A recruitment and selection perspective.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Cognitive ability

A

Schmidt, F.L. (2012). Cognitive tests used in selection can have content validity as well as criterion validity: A broader research review and implications for practice.

Berry et al., 2011). Racial/ethnic differences in the criterion-related validity of cognitive ability tests.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Integrity testing

A

Van Iddekinge et al..,. 2012 The criterion-related validity of integrity tests: An updated meta-analysis.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Work samples

A

Roth, P.L., Bobko, P. & McFarland, L.A. (2005). A meta-analysis of work sample test validity: Updating and integrating some classic literature.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Biodata

A

Breaugh, J.A. (2009). The use of biodata for employee selection: Past research and future directions.
Bernerth et al., 2012). An empirical investigation of dispositional antecedents and performance-related outcomes of credit scores

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Retesting

A

Van Iddekinge et al., 2011). Can I retake it? Exploring subgroup differences and criterion-related validity in promotion testing.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Personality

A

Barrick & Mount, 2012). Nature and use of personality in selection.

Roberts et al., 2005). The structure of conscientiousness

Shaffer et al., 2012). A matter of context

Le et al., 2011). Curvilinear relationships between personality traits and job performance.

van Hooft et al., 2012. Using eye-tracking to understand response processes when faking.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

SJTs

A

Christian et al., 2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterion-related validities.

McDaniel et al., 2011). Toward an understanding of situational judgment item validity and group differences.

23
Q

Employment interviews

A

Dipboye, R.L., Macan, T., Shahani-Deming, C. (2012). The selection interview from the interviewer and applicant perspectives: Can’t have one without the other.

Podsakoff et al., 2011. Efects of organizational citizenship behaviors on selection decisions in employment interviews.

24
Q

ACs

A

Thorton & Gibbons, 2009). Validity of assessment centers for personnel selection.

Lievens & Patterson 2011). The validity and incremental validity of knowledge tests, low-fidelity simulations, and high-fidelity simulations for predicting job performance in advanced-level high-stakes selection.

Lance, C. (2008). Why assessment centers do not work the way they are supposed to. Read all commentaries and author responses.

Hoffman et al., 2011). Exercises and dimensions are the currency of assessment centers.

25
Q

Perf. Appraisal - Theory

A

Campbell et al., 1993). A theory of performance.

Viswesvaran & Ones, 2000). Perspectives on models of job performance.

Pulakos et al., 2000). Adaptability in the workplace: Development of a taxonomy of adaptive performance.

Murphy, K.R. (2008). Explaining the weak relationship between job performance and ratings of job performance. IOP.

O’Boyle, E. Jr. & Aguinis, H. (2012). The best and the rest: Revisiting the norm of normality of individual performance.

26
Q

Perf. appraisal issues

A

Weekley, J.A. & Gier, J.A. (1989). Ceilings in the reliability and validity of performance ratings: The case of expert raters.

Wang, X.M, Wong, K.F.E., & Kwong, J.Y.Y (2010). The roles of rater goals and ratee performance levels in the distortion of performance ratings.

Rudolph et al., 2012). Testing the structured free recall intervention for reducing the impact of bodyweight-biased stereotypes on performance ratings in immediate and delayed contexts.

Gorman & Rentsch, 2009). Evaluating Frame-of-Reference Rater Training Effectiveness Using Performance Schema Accuracy.

Reb et al., 2010). Understanding performance ratings: Dynamic performance, attributions, and rating purpose

Pulakos, E.D. & O’Leary, R.S. (2011). Why is performance management broken?. IOP

27
Q

Motivation Review Day

A
  • Jex & Britt Chapter 8 (pg. 233-268)
  • Diefendorff & Chandler (2011 Handbook). Motivating Employees (71 pages).

Optional:
Sluss, van Dick, & Thompson (2011 Handbook). Role Theory in Organizations: A Relational Perspective. (22 pages)
Locke, E. A., Latham, G. P. (2002). Building a practically useful theory of goal setting and task motivation: A 35-year odyssey. American Psychologist, 57, 705-717.
Deci, R. M., & Ryan, E. L. (2000). Self-Determination Theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55, 68-78.
Reich & Hershcovis (2011 Handbook). Interpersonal Relationships At Work (65 pages in Word).
Martocchio (2011 Handbook). Stragetic reward and compensation plans.

28
Q

Motivation Studies Day

A
  • Skarlicki, van Jaarsveld, & Walker (2008). Getting even for customer mistreatment: The role of moral identity in the relationship between customer interpersonal injustice and employee sabotage.
  • Ambrose, M. L., & Schminke, M. (2009). The role of overall justice judgments in organizational justice research: A test of mediation.
  • Shantz & Latham (2009). An exploratory field experiment of the effect of subconscious and conscious goals on employee performance.
  • Klehe & Anderson (2007). Working hard and working smart: Motivation and ability during typical and maximum performance.
29
Q

Attitude Review Day

A

 Schleicher, Hansen, & Fox (2011 Handbook). Job Attitudes and Work Behaviors. (52 pages).
 Kristof-Brown & Guay (2011 Handbook). Person-Environment Fit (50 pages).

Optional: Jex & Britt chapter on attitudes.

30
Q

Attitude Studies Day

A
  • Harrison et al., (2006). How important are job attitudes? Meta-analytic comparisons of integrative behavioral outcomes and time sequences.
  • Boswell, et al., (2009). Changes in newcomer job satisfaction over time: Examining the pattern of honeymoons and hangovers.
  • Schleicher, et al., (2004). Reexamining the job satisfaction-job performance relationship: The complexity of job attitudes.
  • Bentein et al., (2005). The role of change in the relationship between commitment and turnover: A latent growth modeling approach.
31
Q

Org. Stress and Safety Day

A
  • Jex & Britt chapter 7
  • Kaplan & Tetrick (2011 Handbook). Workplace Safety and Accidents: An Industrial/Organizational Psychology Perspective. (18 pages in Word).
  • Griffin & Clarke (2011 Handbook). Stress and Well-Being at Work. (91 pages).

Optional:
Greenberg (2011 Handbook). Organizational Justice: The Dynamics of Fairness in the Workplace. (56 pages)
Kossek & Michel (2011 Handbook): Flexible Work Schedules. (84 pages with comment area).
George & Ng (2011 Handbook): Nonstandard Workers: Work Arrangements and Outcomes. (24 pages)
Hammer & Zimmerman (2011 Handbook). Quality of Work Life. (34 pages).

32
Q

Stress and safety studies

A
  • Bacharach, S. B., Bamberger, P. A., & Doveh, E. (2008). Firefighters, critical incidents, and drinking to cope: The adequacy of unit-level performance resources as a source of vulnerability and protection. JAP, 93(1), 155-169.
  • Jones, F., O’Connor, B., Conner, M., McMillan, B., & Ferguson, E. (2007). Impact of daily mood, work hours, and iso-strain variables on self-reported health behaviors. JAP, 92(6), 1731-1740.
  • Christian, Bradley, Wallace, & Burke (2009). Workplace Safety: A meta-analysis of the roles of person and situation factors. Journal of Applied Psychology, 94, 1103-1127.
  • Probst, Brubaker, & Barsotti (2008). Organizational injury rate underreporting: The moderating effect of organizational safety climate. JAP, 93, 1147-1154.
33
Q

Team Review

A
  • Jex & Britt chapter 12 (pp. 375-409)
  • Cannon-Bowers & Bowers (2011 Handbook). Team Development and Functioning. (46 pages).

Optional:
Kozlowski, S. W. J., & Ilgen, D. R. (2007/2008?). Enhancing the effectiveness of work groups and teams. Psychological Science in the Public Interest. Pp. 77-124
Klein, K. J., & Kozlowski, S. W. J. (2000). From micro to meso: Critical steps in conceptualizing and conducting multilevel research. Organizational Research Methods, 3, 211-Jackson & Joshi (2011 Handbook). Work team diversity. (36 pages)
Ferris & Hochwarter (2011 Handbook). Organizational Politics (26 pages).
De Dreu (2011 Handbook). Conflict at Work: Basic Principles and Applied Issues (33 pages).

34
Q

Team Studies

A

Barnes et al., 2008). The costs of backing-up behavior in teams.

Humphrey, et al., 2009). Developing a theory of the strategic core of teams: A role composition model of team performance. JAP, 94, 48-61.

Mesmer-Magnus et al., 2009). Information sharing and team performance: A meta-analysis. JAP, 94, 535-546.

Bell, S. T. (2007). Deep-level composition variables as predictors of team performance: A meta-analysis. JAP, 92, 595-615

35
Q

Leadership Reviews

A

 Jex & Britt Chapter 10 (pg 303-338)
 Barling, Christie, & Hoption (2011 Handbook). Leadership. 58 pages.

Optional:
Eby (2011 Handbook). Mentoring (54 pages)
Peterson (2011 Handbook). Executive Coaching. (32 pages).
Hogan, Hogan, & Kaiser (2011 Handbook). Management Derailment: Personality Assessment and Mitigation. (28 pages).
Yukl & Van Fleet (1991). Literature review on Leadership.

36
Q

Leadership Studies

A
  • Brown, M. E., & Trevino, L. K. (2009). Leader-follower values congruence: Are socialized charismatic leaders better able to achieve it?
  • Erez, A., Misangyi, V. G., Johnson, D. E., LePine, M. C., & Halverson, K. C. (2008). Stirring the hearts of followers: Charismatic leadership as the transferal of affect.
  • Rosette, A. S., Loenardelli, G. J., & Phillips, K. W. (2008). The White standard: Racial bias in leader categorization.
  • Judge, T. A., & Piccolo, R. F. (2004). Transformational and transactional leadership: A meta-analytic test of their relative validity.
37
Q

Entry, Exit, and other topics

A

 Bauer & Erdogan (2011 Handbook). Organizational Socialization: The Effective Onboarding of New Employees. (14 pages)
 Hom (2011 Handbook). Organizational Exit (52 pages)
 Barclay & Aquino (2011 Handbook), Workplace Aggression and Violence (26 pages).

38
Q

Other relevant O topics (optional readings)

A

Berdahl & Raver (2011 Handbook), Sexual Harassment. (30 pages).

Rousseau (2011 Handbook). The Individual-Organization Relationship: The Psychological Contract (30 pages).

Colella & Bruyere (2011 Handbook), Disability and Employment: New Directions for Industrial/Organizational Psychology. (81 pages in Word).

Martins (2011 Handbook). Organizational Change and Development.

DeMeuse, Marks, & Dai (2011 Handbook). Organizational downsizing, mergers and acquisitions, and strategic alliances: Using theory and research to enhance practice.

Leung & Peterson (2011 Handbook). Managing a Globally Distributed Workforce: Social and Interpersonal Issues.

Erez (2011 Handbook). Cross Cultural and Global Issues in Organizational Psychology.

Aguinis (2011 Handbook). Organizational Responsibility: Doing Good and Doing Well.

39
Q

Writing Items

A

Clark, L. A., & Watson, D. (1995). Constructing validity: Basic issues in objective scale development. [Good overview of the measure development process]

Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93-105. [Considerations for how to respondents generate answers, and how answers can be affected by the way you write the questions]

Henry et al., 1994). On the “remembrance of things past”: A longitudinal evaluation of the retrospective method.

40
Q

Insufficient Effort Responding

A

Huang et al., 2011). Detecting and deterring insufficient effort responding to surveys. Journal of Business and Psychology.

41
Q

Data cleaning

A

Rogelberg et al., 2007). Introduction: Understanding and dealing with organizational survey nonresponse.
Fishman et al., 2003). Multiple imputation for missing data: Making the most of what you know. ORM, 6, 282-308.

42
Q

Internal Consistency Reliability

A

Ree, M. J., & Carretta, T. R. (2006). The role of measurement error in familiar statistics. ORM, 9, 99-112.

Schmitt, N. (2006). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 81-84.

43
Q

Inter-rater Reliability and Agreement

A

Schmidt, F. L., & Hunter, J. E. (1989). Interrater reliability coefficients cannot be computed when only one stimulus is rated.
Read this one first – the Kozlowski and Hattrup article responds to this one and corrects their misperceptions.

Kozlowski, S. W. J., & Hattrup, K. (1992). A disagreement about within-group agreement: Disentangling issues of consistency versus consensus.

44
Q

Generalizability Theory

A

DeShon, R. P. (2002). Generalizability Theory.

45
Q

IRT

A

Embretson, S. E., & Reese, S. P. (2000). The new rules of measurement.

Zickar, M. J. (2002). Modeling data with polytomous IRT. In Drasgow & Schmitt, Measuring & Analyzing behavior in orgs. Pp. 123-155.

46
Q

DIF

A

Raju, N. S., & Ellis, B. B. (2002). Differential item and test functioning.

47
Q

SEM basics

A

Schumacker, R. E., & Lomax, R. G. (1996). Goodness-of-fit criteria. Chapter 7 in A beginner’s guide to structural equation modeling

48
Q

CFA and EFA

A

Klein, R. B. (1998). Measurement models and CFA. Chapter 7 in Principles and practice of structural equation modeling.

Conway & Huffcutt, 2003). A review and evaluation of EFA practices in organizational research. ORM, 6, 147-168.

Hayton et al., 2005). Factor retention decisions in EFA: A tutorial on parallel analysis. ORM,

49
Q

Measurement invariance

A

Vandenberg & Lance (2000). A review and synthesis of the measurement invariance literature: Suggestions, practices, and recommendations.

50
Q

Cross cultural and internet testing

A

Meade et al., 2007). Are internet and paper and pencil personality tests truly comparable? An experimental design measurement invariance study.

Schaffer & Riordan (2003). A review of cross-cultural methodologies for organizational research: A best-practices approach.

51
Q

Method Variance

A

Podsakoff, P. M., MacKenzie, S. B., Lee, J-Y., & Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903.

Spector, P. E. (2006). Method variance in organizational research: Truth or urban legend? ORM, 9(2), 221-232.

52
Q

SJTs

A

McDaniel & Nguyen, 2001). Situational judgment tests: A review of practice and constructs assessed. International Journal of Selection and Assessment, 9, 103-113.

McDaniel et al., 2007). Situational judgment tests, response instructions, and validity: A meta-analysis. Personnel Psychology, 60, 63-91.

53
Q

Conditional Reasoning Tests

A

James, L. R. (1998). Measurement of personality via conditional reasoning. ORM, 1, 131-163.

Also CARMA (2012)
-Aggression, personality, abusive supervision (other?)