Assessment and Selection Pt 2. Flashcards
Types of assessments
- Written materials
- Motor-sensory tests
- Honesty-integrity tests
- Interviews
- Situational judgment tests
- Assessment center exercises and role plays
Types of written materials
- Resumes and curriculum vitae
- Work samples
- Reference letter
- Biodata forms
Strengths of written materials
Education, experience, and past performance are often the best predictors of future performance
Limitations of written materials
- Often lacks standardized weightage of which aspects are more important
- Materials are usually positively biased
- Provides first impressions, which can bias subsequent assessments
Examples of work samples
- Designer’s portfolio
- Programmer’s app
- Researcher’s journal articles
- Etc.
Characteristics of reference letters
- The written content is often too positively biased to be useful for comparison
- Length and position of the referee are the main determinants
- Adding rating scale measures to reference letter requests to obtain more useful data
Definition of biodata forms
- Questions that ask about a personal event…
- that happened in the past
- Is about a specific event, not a generalized perception
Notes on motor and sensory ability tests
Usually outsourced to a medical examination or evaluated as part of a work sample test
Problems with honesty integrity tests
- Construct validity issues
- Faking and social desirability issues
3 types of interviews
- Conventional interviews
- Behavioral interviews
- Situational interviews
Characteristics of conventional interviews
- Unstructured
- Self-reports about your life experiences, values, beliefs, and self-concept
- Typically can be addressed like a conversation with elements of self-presentation
Characteristics of behavioral interviews
- Structured
- Asks you how you handled specific past incidents
Characteristics of situational interviews
- Structured
- Asks you how you will handle hypothetical situations
Tips for designing structured interviews
- Design questions focused on only work-related characteristics
- Standardized questions for all candidates
- Develop a scoring matrix for each question
- Use multiple raters
What is the STAR approach?
- Situation
- Task
- Action
- Result
Different types of situation tests, from low fidelity to high fidelity
- Paper-pencil situational judgment tests (SJT)
- Video-based SJTs
- In-basket exercises
- Leaderless group discussions
- Roleplays (Essentially Video-based SJTs minus MCQs)
- Work sample tests
- Performance tests
Definition of situation judgment tests
Typically contextualized within a job-related situation where applicants evaluate the effectiveness of presented multiple-choice responses in resolving a dilemma
Schema of situation judgment tests
- Item stem
- Response instructions/modality
- Response options
Strengths of situation judgment tests
- Contextualized to various job situations
- Captures complex situations
- High realism (ecological validity) and face validity
- Can double up as a realistic job preview
Limitations of situation judgment tests
- Poort psychometric properties
- Heterogenous composite scores
- SJTs are developed based on critical incidences and may not adequately reflect the day-to-day job
2 methods of situation judgment tests
- Critical incident method
- Construct-oriented approach
Characteristics of Critical Incident Method
- Documents the antecedent-behavior-consequences (ABC) of major incidences in the past and use them as test items
- High realism
- Predicts job performance well
- But leads to heterogeneous composite scores, meaning that it may capture too many constructs
Characteristics of a construct-oriented approach
- Articulate a construct, then write items that capture that specific construct
- Both item stem & response must align with the construct
- Difficult to develop and may end up with generic items not relating to the work context
What are assessment centers?
Uses a combination of a standardized set of tests to hire for a given job
What are in-basket exercises?
Usually, a stack of 10-14 memos/emails that you have to review, prioritize, and address
What are leaderless group discussions?
It checks whether one has social skills and is different from a real case group discussion as the results is not the key virtue
2 types of SJT responses
- Would-do instructions
->Evaluate the following options and indicate which action you would have done in a similar situation
-> Elicits typical performance
-> May have lower construct validity - Should-do instructions
-> Evaluate the following options and identify the most and least effective options
-> Elicits maximum performance
2 types of performance
- Can do (Ability)
-> Maximum performance; - Will do (Will do)
-> Typical performance
2 types of tests
- Speed tests
- Power tests
Characteristics of speed tests
- Very limited time
- Easy-moderate difficulty questions
- Results reflect typical performance
Characteristics of power test
- Sufficient time
- Will include more difficult questions
- Results reflect maximum performance