problem 2 - selection Flashcards

1
Q

what is the design & validation process in selection?

A
  1. job analysis to define a competency model & create a person specification
    - used to identify the selection & assessment criteria
    - used to decide which selection methods to use
    - selection methods then piloted & validated
  2. prospective candidates engage in self-selection: they make judgements about whether the role suits them & their abilities/skills
    - once candidates apply – a selecting out process may take place based on eligibility before the selecting in process
  3. after some time, info on work performance of workers can be used to examine the validity of the selection methods and decisions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

what is validity?

A

The extent to which the observed test score is a good indicator of the construct you intend to measure/predict
- Based on the test scores, to what extent are you able to make statements about the construct that you intend to measure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

what are criteria?

A

a measurement used to analyze the performance of a worker/employee
- creativity, task perf, OCB, CWB

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

what are predictors?

A

a variable used to estimate, forecast, or project future job performance
- interviews, work-sample, biodata, psychological tests, etc.
- Used to decide whether or not a candidate is suitable for the job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

what is criterion-related validity?

A

the extent to which a measure is related to an outcome

can be concurrent validity or predictive validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

what is concurrent validity?

A

predictor & criterion are measured at the same point in time. Can be done in 2 ways:
- In job incumbents: correlate predictor and criterion in a sample of individuals already working for the org
- Use a proxy for future job performance (e.g., work-sample test)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

what is predictive validity?

A

The predictor is measured at time 1, criterion measured at time 2 (aka later time) - measured at different points in time

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

what is construct validity?

A

if the test measures what is should measure – use several methods to measure the same thing, then check if the results are the same

e.g. does an intelligence test actually measure someone’s intelligence?

can be convergent or divergent (discriminant)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

convergent vs divergent (discriminant) validity

A

convergent = the degree to which the measure is related to other measures of similar construct
- e.g. a correlation between conscientiousness and related concepts like punctuality

divergent = the degree to which the measure is unrelated to measure of distinct constructs
- e.g. the absence of a correlation between conscientiousness scores on unrelated concepts like creativity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is content validity?

A

a test is content valid when it contains all the components of the behavior that is measured
- whenever an important component is missing, the test is no longer valid
- Aka whether the content of the test overlaps with what must be measured
- E.g. a driving exam without a parking exercise is incomplete

can be faith or face validity

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

what is faith validity?

A

when an organization believes that the selection method is valid, because it is, for example, sold by a known organization or because its framed in a way that sounds valuable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

what is face validity?

A

the extent to which a test is perceived as measuring what it is supposed to measure
- e.g., at the end of the exam, the students feel as though it measured our knowledge of org psych, it has high face validity

Important for applicant reactions in job selection

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

what is reliability?

A

the consistency or repeatability of the measures, the extent to which a measurement tool gives consistent results
- tests should give the same results when used multiple times

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

what is adverse impact?

A

an unwanted side effect – e.g. a test that (unintentionally) distinguishes between races, genders or ethnicities

direct or indirect discrimination

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

direct vs indirect discrimination

A

Direct discrimination = rejecting someone on the basis of their characteristics, intentionally

Indirect discrimination = rejecting someone without the intention to discriminate, e.g. by determining criteria which exclude certain groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

what is impression management?

A

when people are trying to leave a certain impression – sometimes it even occurs that applicants feign certain characteristics bcuz they believe these are expected of them for a certain job
- It is the interviewers task to see through the phony behavior & detect the true nature of the candidate

17
Q

what is an unstructured interview?

A

Interviewer conducts it without having a plan before, random, different for everybody, does not have a structure
- predictive validity: low
- user acceptance: positive
- construct validity: inconclusive
- adverse impact: yes
- used most frequently

18
Q

what is a structured interview?

A

the interviewer asks set questions focused on main competencies and behaviors
- higher reliability than unstructured
- predictive validity: high
- user acceptance: moderate/positive
- construct validity: inconclusive
- adverse impact: little

19
Q

what is a behavioral interveiew?

A

(past) - behavioral pattern description interviews: applicants are asked to recount their professional past + relevance of each experience to the current job
- assumes that past behavior is a good predictor of future behavior

20
Q

what is a situational interview?

A

(future) - is based on goal-setting theories: applicants are told examples of work-related situations & are asked how they would manage
- The intention of the behavior should predict future behavior
- The response of the applicant is compared to combined responses of experts & ranked accordingly as bad, average or good
- Criticism: people who are not experienced but have a strong potential to learn are disadvantaged

21
Q

what is the neg information error

A

when the interviewer memorizes mostly or merely the negative information collected in the interview

22
Q

what is a psychological test?

A

a standardized series of problems or questions that estimate certain characteristics
- multiple items increase higher reliability & validity, few items decrease reliability & validity due to the risk of misinterpretation or misreading of the results

  • psychomotor ability, personality, integrity, interests, physical ability
23
Q

what is a cognitive ability test?

A

individuals can demonstrate what they know, perceive, memorize, understand what they can mentally work with
- Includes problem solution and the development of new ideas
- Advantages: its valid, cost effective and applicable on a large scale

  • predictive validity: high
  • user acceptance: neg to moderate
  • construct validity: clear
  • adverse impact: yes - bias between minorities
24
Q

what is a personality test?

A

Measure the big 5 (openness, conscientiousness, extroversion, agreeableness & neuroticism)
- O, C & emotional stability: pos correlation with job performance
- Extroversion: pos correlation with job perf on certain jobs, e.g. salesman
- C: a valid predictor of job performance, mostly correlates with general job performance

  • predictive validity: moderate
  • user acceptance: neg/moderate
  • construct validity: clear
  • adverse impact: little
25
Q

what is biodata?

A

Organizations collect personal info about the clients – can be info about previous jobs, education & specialized training
- hard items: objective data, facts
- soft items: own experience, hobbies, interest etc.

  • predictive validity: moderate
  • user acceptance: moderate
  • construct validity: inconclusive
  • adverse impact: little
26
Q

what is a work sample test?

A

a simulation, person has to perform the future job tasks, role-play
- Situational judgement test = the candidate receives a written scenario & is asked to select the best response from a set of alternatives

  • predictive validity: high
  • user acceptance: pos
  • construct validity: inconclusive
  • adverse impact: little
27
Q

what is an assessment center?

A

a collection of procedures for an evaluation - multiple tests administered at once
- different exercises: in-basket, leaderless group, problem-solving & role-play

  • predictive validity: moderate
  • user acceptance: pos
  • construct validity: inconclusive
  • adverse impact: little
28
Q

what is test-retest reliability?

A

correlation between 2 scores on the same test at 2 measurement points
aka repeatability

29
Q

what is internal reliability?

A

the consistency of results across different items in a test

30
Q

what is inter-rater reliability?

A

the degree of agreement between 2 or more raters