Careers and Organisational Testing Flashcards

1
Q

Define

Work sample tests

A

based on the assumption that current, observed behaviour will predict future behaviour, they require job applicants to carry out tasks that mirror those that will be required on the job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define

Vocational interests

A

interests with specific relevance to the workplace, which tend to be stable over time, influence motivation and behaviour, and indicates the type of activities and environments the person prefers

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Define

Validity generalisation (VG)

A

the demonstration that validity generalises across job selection exercises for different jobs by conducting meta-analyses of studies reporting validity coefficients

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Define

Task performance

A

the core technical aspects of basic tasks that comprise a job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Define

Selection on the criterion

A

in personnel selection, the process of appointing all job applicants for a trial period and then retaining only those who have performed satisfactorily

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Define

Selection interview

A

usually included as part of any selection exercise, interviews generate ratings based on job applicant responses to questions, which are used to predict success on the job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Define

RIASEC

A

John Holland’s codes for the six types of individual and workspace ‘personalities’ that he identified (Realistic, Investigative, Artistic, Social, Enterprising and Conventional)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Define

Reference check

A

a means of verifying job applicant information provided in a resume and collected in an interview; typically done by contacting past employers and/or individuals who can vouch for the applicant

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Define

Personnel selection

A

the process of choosing which job applicants should receive an offer of employment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Define

Person-organisation fit

A

compatibility between the individual and organisations that occurs when one of the parties can satisfy the needs of the other, or both have their needs satisfied

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Define

Peer rating

A

a rating of the KSAOs of an internal job applicant by the job applicant’s co-worker/s

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Define

Performance appraisal

A

the assessment of a worker’s job performance, typically carried out on a regular basis, such as six-monthly or annually

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Define

KSAOs

A

the knowledge, skills, abilities and other characteristics of an employee or prospective employee needed to be able to undertake their job satisfactorily

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Define

Job tryout

A

hiring someone for a short period of time to determine how well they fit in and perform on the job; a probationary period has a similar purpose

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Define

Job knowledge test

A

a test designed to assess knowledge, such as specific technical or professional knowledge, required for a job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Define

Job analysis

A

the process of gathering detailed information about the main tasks and contextual responsibilities for a particular job

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Define

Industrial and organisational (I-O) psychology

A

the study of job performance and worker health issues to assist individuals, groups and organisations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Define

Integrity test

A

wither a specific type of personality test or a direct measure to assess a job applicant’s honesty, trustworthiness and reliability

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Define

Holland’s hexagon

A

a mode that indicates the relationships among Holland’s personality types and environments, with similar types placed closer to one another and dissimilar types placed father away

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Define

Graphic rating scale

A

a simple rating device used to elicit human judgment, typically complete by marking a point on a line or by circling a number (say from 1 to 10) to indicate the strength of agreement with the item

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Define

Critical incident

A

an example of extreme levels of behaviours or performance (both poor and exemplary behaviours), which are usually key determinants of subsequent outcomes

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

Define

Counter-productive behaviours

A

behaviours that are largely under the control of the individual or reflect problematic employee characteristics, and which impede the progress and success of the organisation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Define

Contextual performance

A

discretionary social behaviours directed at successful performance of the work group or organisation; sometimes referred to as ‘citizenship behaviours’

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Define

Content analysis

A

the process of analysing textual information, either written or oral by, for example, searching for themes, examining frequencies of key words or constructs, and identifying repeating relationships; the procedure can be carried out manually or with computer-based software

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
# Define Biographical data (biodata)
measures of past activities, effort and interests that reflect motivation, personality, values and interest, which assume that past behaviours will be consistent with future behaviours
26
# Define Behaviourally anchored rating scale (BARS)
a rating scale that includes actual behaviours to indicate the response
27
# Define Behavioural observation scale (BOS)
questions used in a rating scale that are based on actual behaviours; they are rated for their frequency of occurrence (e.g. from '1 = almost never displayed' to '5 = almost always displayed')
28
# Define Assessment centre
a comprehensive testing procedure applied to groups that includes a diverse range of testing tools and techniques
29
# Definition based on the assumption that current, observed behaviour will predict future behaviour, they require job applicants to carry out tasks that mirror those that will be required on the job
Work sample tests
30
# Definition interests with specific relevance to the workplace, which tend to be stable over time, influence motivation and behaviour, and indicates the type of activities and environments the person prefers
Vocational interests
31
# Definition the demonstration that validity generalises across job selection exercises for different jobs by conducting meta-analyses of studies reporting validity coefficients
Validity generalisation (VG)
32
# Definition the core technical aspects of basic tasks that comprise a job
Task performance
33
# Definition in personnel selection, the process of appointing all job applicants for a trial period and then retaining only those who have performed satisfactorily
Selection on the criterion
34
# Definition usually included as part of any selection exercise, interviews generate ratings based on job applicant responses to questions, which are used to predict success on the job
Selection interview
35
# Definition John Holland's codes for the six types of individual and workspace 'personalities' that he identified (Realistic, Investigative, Artistic, Social, Enterprising and Conventional)
RIASEC
36
# Definition a means of verifying job applicant information provided in a resume and collected in an interview; typically done by contacting past employers and/or individuals who can vouch for the applicant
Reference check
37
# Definition the process of choosing which job applicants should receive an offer of employment
Personnel selection
38
# Definition compatibility between the individual and organisations that occurs when one of the parties can satisfy the needs of the other, or both have their needs satisfied
Person-organisation fit
39
# Definition a rating of the KSAOs of an internal job applicant by the job applicant's co-worker/s
Peer rating
40
# Definition the assessment of a worker's job performance, typically carried out on a regular basis, such as six-monthly or annually
Performance appraisal
41
# Definition the knowledge, skills, abilities and other characteristics of an employee or prospective employee needed to be able to undertake their job satisfactorily
KSAOs
42
# Definition hiring someone for a short period of time to determine how well they fit in and perform on the job; a probationary period has a similar purpose
Job tryout
43
# Definition a test designed to assess knowledge, such as specific technical or professional knowledge, required for a job
Job knowledge test
44
# Definition the process of gathering detailed information about the main tasks and contextual responsibilities for a particular job
Job analysis
45
# Definition the study of job performance and worker health issues to assist individuals, groups and organisations
Industrial and organisational (I-O) psychology
46
# Definition wither a specific type of personality test or a direct measure to assess a job applicant's honesty, trustworthiness and reliability
Integrity test
47
# Definition a mode that indicates the relationships among Holland's personality types and environments, with similar types placed closer to one another and dissimilar types placed father away
Holland's hexagon
48
# Definition a simple rating device used to elicit human judgment, typically complete by marking a point on a line or by circling a number (say from 1 to 10) to indicate the strength of agreement with the item
Graphic rating scale
49
# Definition an example of extreme levels of behaviours or performance (both poor and exemplary behaviours), which are usually key determinants of subsequent outcomes
Critical incident
50
# Definition behaviours that are largely under the control of the individual or reflect problematic employee characteristics, and which impede the progress and success of the organisation
Counter-productive behaviours
51
# Definition discretionary social behaviours directed at successful performance of the work group or organisation; sometimes referred to as 'citizenship behaviours'
Contextual performance
52
# Definition the process of analysing textual information, either written or oral by, for example, searching for themes, examining frequencies of key words or constructs, and identifying repeating relationships; the procedure can be carried out manually or with computer-based software
Content analysis
53
# Definition measures of past activities, effort and interests that reflect motivation, personality, values and interest, which assume that past behaviours will be consistent with future behaviours
Biographical data (biodata)
54
# Definition a rating scale that includes actual behaviours to indicate the response
Behaviourally anchored rating scale (BARS)
55
# Definition questions used in a rating scale that are based on actual behaviours; they are rated for their frequency of occurrence (e.g. from '1 = almost never displayed' to '5 = almost always displayed')
Behavioural observation scale (BOS)
56
# Definition a comprehensive testing procedure applied to groups that includes a diverse range of testing tools and techniques
Assessment centre
57
What do I-O psychologists study?
organisations and seek ways to improve the functioning and human benefits of business.
58
How do organisations and seek to improve the functioning and human benefits of business.?
– Helping people decide on their careers – Recruiting people that best fit the organisation – Selecting the best people – Retaining the best people – Improving the skills of the people
59
What are some examples of job selection methods?
Ability Tests Job Knowledge Tests Performance Tests and Work Samples Personality Tests Integrity Tests Structured Interviews Assessment Centre
60
What is an interest measure?
an instrument designed to evaluate test takers’ likes, dislikes, leisure activities, curiosities, and involves in various pursuits for comparison with groups of various occupations and professions
61
True or False: Personal interest is closely related to occupational success
True
62
An individual’s interests may be sufficiently solidified by age __ that they can be useful in career planning.
An individual’s interests may be sufficiently solidified by age **15** that they can be useful in career planning.
63
What are some psychological inventories based on John Holland's theory of types?
Self Directed Search (SDS) and Vocational Preference Inventory
64
What are the six types of workers according to John Holland?
R: Realistic (Doers) I: Investigative (Thinkers) A: Artistic (Creators) S: Social (Helpers) E: Enterprising (Persuaders) C: Conventional (Organisers)
65
What are used to screen out applicants who don’t meet minimum qualifications in terms of education, experience, etc.?
Application blanks and resumes
66
What is the validity of application blanks like?
Poor (typically r \< .20)
67
What are the problems with application blanks and resumes?
– Lack of agreement what to look for – Possible discrimination – Need to cross validate – Keys are not stable over time, need to update
68
What type of selection method do these questions fit into? ## Footnote * Did you ever build a model airplane that flew?* * When you were a child, did you collect stamps?* * Do you ever repair mechanical things in your home?*
Biodata questionnaires
69
What is the validity of biodata questionnaires like?
moderate (r ≈ .30)
70
What type of selection method do these questions fit into? * Describe the types of IT systems problems you have encountered.* * Describe your experience in testing hardware, software, or systems.*
Experience questionnaires
71
What is the validity of experience questionnaires like?
moderate (typically content validity)
72
What are the problems with interviews?
* Unstructured & Unplanned * Untrained & Biased Interviewers * Same Sex Bias * Structured Means Standardised or Artificial & Inflexible * Validity as typically done: poor (r \< .20)
73
Why Interviews are often not Valid Assessments?
* Poor wording of questions * No systematic scoring system used by interviewers—very subjective * Applicants have been trained to give the appropriate responses to such open-ended questions * Interviewer has no way to verify this information in short period of time of interview
74
What do ability tests measure?
* Measure what a person has learned up to that point in time (achievement) * Measure one’s innate potential capacity (aptitude)
75
Up to \_\_% of companies use some ability testing
Up to **50**% of companies use some ability testing
76
What are the four types of ability tests?
Mental (Cognitive) Ability Tests Mechanical Ability Tests Clerical Ability Tests Physical Ability Tests
77
What is the main purpose of Cognitive Ability Tests?
* to determine one’s level of “g” or aptitudes depending on setting * Measure aptitudes relevant to the job * short, group administration * excellent predictor of job and training performance
78
What are the Advantages of Cognitive Ability Tests?
* Efficient * Useful across all jobs * Excellent levels of reliability and validity (.40 - .50) * Highest levels than any other tests * Estimated validity: * .58 for professional/managerial jobs * .56 for technical jobs * .40 for semi-skilled jobs * .23 for unskilled jobs * More complex job = higher validity
79
What are the Disadvantages of Cognitive Ability Tests?
* Lead to more adverse impact * May lack face validity * Questions aren’t necessarily related to job * May predict short-term performance better than long-term * can do vs. will do
80
What are the Frequently Used General Mechanical Ability Tests?
Bennett Mechanical Comprehension Tests MacQuarrie Test for Mechanical Ability
81
What do General Mechanical Ability Tests generally measure?
Spatial visualization Perceptual speed and accuracy Mechanical information
82
What do Clerical Ability Tests measure?
Predominately measures perceptual speed and accuracy in processing verbal and numerical data
83
What are the areas of concern for Physical Ability Tests?
Female applicants Disabled applicants
84
What do physical ability tests measure?
Most measure muscular strength, cardiovascular endurance, and movement quality
85
When is measuring personality useful for employee selection?
Useful when dependability, integrity, responsibility are determinants of job success
86
What are the dimensions of personality of the Myers-Briggs Type Indicator (MBTI)?
Introversion - Extroversion: source of energy Intuition - Sensation: innovation vs. practical Thinking - Feeling: impersonal principles vs. personal relationships Judging - Perceiving: closure vs. open options
87
What is the validity of the Myers-Briggs Type Indicator (MBTI) like?
poor for selection; might be okay, if carefully used, to help a team work better together
88
What is the validity of The Big 5 Personality Dimensions like?
typically moderate for selection (r ≈ .25 with measures of overall job performance)
89
Why is validity of personality inventories hard to generalize?
* Some dimensions of personality may correlate more strongly with particular aspects of a particular job * Extraversion → success in sales * High conscientiousness & high openness to experience → success in job training * Low agreeableness, low conscientiousness, & low adjustment → more likely to engage in counterproductive work behaviors (e.g., abuse sick leave, break rules, drug abuse, workplace violence)
90
What are the Advantages of Personality Inventories?
* Intuitively appealing to managers (e.g., MBTI) * No adverse impact – Don’t show rates of differential selection * Efficient * Moderate reliability and validity –Validity = .20 - .30
91
What are the Disadvantages of Personality Inventories?
* Response sets * Lie or socially desirable responding * All traits not equally valid for all jobs
92
What are the advantages of work sample tests?
Highest validity levels (r = .50s) High face validity Easy to demonstrate job-relatedness
93
What are the disadvantages of work sample tests?
Not appropriate for all jobs Time-consuming to set up and administer More predictive in short-term Cannot use if applicant is not expected to know job before being hired
94
What are assessment centres appropriate for?
appropriate for upper-level management selection, development purposes and career advancement
95
What factors affect the validity of assessment centres?
inadequate rater training and construct definitions, and inappropriate rating scales, ranking procedures and test construction increasing reliance on computer-based systems to train raters and score tests