08 Training Design and Evaluation Flashcards
Refers to the process of providing new employees with basic background info about the org, along with its culture and values
employee orientation
Employee orientation is also known as (blank)
onboarding
2 officers usually involved in employee orientation
HR officer and supervisor
2 main roles of the HR officer in onboarding
- explain basic rules and regulations
2. introduce the new employee to his/her supervisor
4 main roles of the supervisor in onboarding
- explain the organization of the department
- introduce the new employee to his/her colleagues
- familiarize the new employee with the workplace
- help reduce first-day jitters
2 main content of a typical onboarding program
company-level and department-level information
Refers to training designed to change employee attitudes about diversity or develop skills needed to work with a diverse workforce
diversity training
Refers to increasing awareness of cultural and ethnic differences, and with personal and physical characteristics
attitude change
Refers to teaching skills for constructively handling communication barriers, conflicts, and misunderstandings
behavior change
Refers to an organization’s planned efforts to help employees acquire job-related knowledge, skills, abilities, and behaviors, with the goal of applying these on the job
training
What is the goal of employee training?
increase profit
True or False – Training has the most significant effect on performance
false, goal-setting has a more significant effect than training
Training is the (blank) of skills, rules, concepts, or attitudes that result in improve performance
systematic acquisition
A critical component in ensuring the success of a training program is the support of (blank)
upper management
5 steps for an effective organizational training program
- conduct training needs analysis
- set objectives
- design training
- deliver training
- evaluate training
Refers to a computer application that automates the administration, development, and delivery of training programs
learning management system
Refers to evaluating the org, individual employees, and employees’ task to determine what kind of training is needed
needs assessment
True or False – Conducting a needs assessment always requires the administration of training
false, training is only given as necessary
3 types of needs assessment
- organizational analysis
- task analysis
- performance analysis
[Needs Assessment]
Aims to determine organizational factors that either facilitate or inhibit training effectiveness
organizational analysis
[Needs Assessment]
3 main focus of organizational analysis
- goals the org wants to achieve
- the extent to which the training will help achieve those goals
- the org’s ability to conduct training
[Needs Assessment]
This is usually done for newly created positions and jobs
task analysis
[Needs Assessment]
3 main purposes of task analysis
- identify the tasks to be performed
- the conditions under which these tasks are performed
- competencies needed to perform the tasks under the identified conditions
[Needs Assessment]
4 common methods of conducting task analysis
- interviews
- surveys
- observations
- inventories
[Needs Assessment]
This is usually done for existing positions and jobs
performance analysis
[Needs Assessment]
2 main purposes of performance analysis
- verify performance deficiency
2. determine whether the deficiencies should be corrected through training or other means
[Needs Assessment]
5 common methods of conducting performance analysis
- performance appraisal
- surveys
- interviews
- skill and knowledge tests
- critical incidents
[Needs Assessment]
What do low scores in performance appraisal indicate?
additional training for identified dimensions may be needed
[Needs Assessment]
How do surveys help in performance analysis?
employees can share which knowledge or skills they think should be included in the training
[Needs Assessment]
This method of performance analysis yields more in-depth answers about training needs
interviews
This method of performance analysis will show dimensions with many examples of poor performance
critical incidents
4 steps in designing training programs
- set performance objectives
- create a detailed training outline
- choose a program delivery method
- verify the overall program design with upper management
Refers to the overall goal of the training program with a general and broad statement of intent
training aim
How are objectives different from training aim?
objectives are for a particular learning session
Vision is to (blank) while mission is to (blank)
vision is to training aim while mission is to objectives
Determining the learning objectives must account for (blank) and (blank) constraints
financial and time constraints
Learning objectives are stated in the POV of the (blank)
learner/trainee
3 main components of a learning objective
- performance
- condition
- standard
Performance describeses (blank) that participants will be able to do after the training
observable behaviors
Refers to the circumstances under which the participant will perform the activity
condition
Refers to the specific level or degree of proficiency necessary to perform the task or job
standard
True or False – Standard also describes the equipment, supplies, job aids, and any given information to direct action
false, these refer to condition
Standards may involve the following (4):
- speed
- accuracy
- productivity level
- degree of excellence
Refers to the expectation that employees apply knowledge and skills learned on the job
transfer of training
3 factors affecting trainees’ learning
- trainee characteristics
- training design
- work environment
Trainee characteristics account for individual differences in (blank) and (blank)
abilities and motivation
2 ways to keep participants motivated in training
- rewards for successful completion
2. make the training design interesting
4 design factors affecting training
- feedback
- general principles
- identical elements
- overlearning
Refers to giving trainees practice beyond what is necessary to reach automaticity
overlearning
[Training Methods]
Refers to a presentation by a trainer to a group of trainees
lectures
[Training Methods]
2 main advantages of lectures
- economical
2. saves time
[Training Methods]
Main disadvantage of lectures
boring
[Training Methods]
Refers to trainees being presented with a written description of an org problem
case study
[Training Methods]
Case studies are referred to as (blank) in an organizational context
living cases
[Training Methods]
Main advantage of living cases
allows the diagnosis of realistic cases and presentation of proposed solutions
[Training Methods]
Refers to the use of electronic learning aids that has stop-action, instant replay, and slow-motion capabilities
audio-visual instruction
[Training Methods]
2 main advantages of audio-visual instruction
- easy to illustrate how to follow a certain sequence
2. trainers do not have to demonstrate the task repeatedly
[Training Methods]
Refers to assuming specific roles in a realistic situation
role playing
[Training Methods]
Role-playing is effective in training (blank) skills
people/interpersonal
[Training Methods]
3 main advantages of role-playing
- develops perspectives
- trains people to be more sensitive to others’ feelings
- can trigger spirited discussion
[Training Methods]
Refers to watching someone perform a task them having trainees model the task
behavior modeling
[Training Methods]
Behavior modeling is inspired from (blank)
Bandura’s Bobo Doll experiment
[Training Methods]
2 main advantages of behavior modeling
- high level of feedback
2. provides practice for new skills
[Training Methods]
Refers to having a person learn a job by actually doing it
on-the-job training
[Training Methods]
Main advantage of on-the-job training
high level of transfer
[Training Methods]
2 forms of on-the-job training
apprenticeship and internship
[Training Methods]
Refers to a work-study training method that teaches job skills through a combination of on-the-job and classroom training
apprenticeship
[Training Methods]
Refers to on-the-job learning sponsored by an educational institution as a component of an academic program
internship
[Training Methods]
Refers to real-life situations where trainees make decisions resulting in outcomes that mirror what would happen in the job
simulation
[Training Methods]
Main advantage of simulations
provides a risk-free environment for trainees to commit mistakes
[Training Methods]
Refers to learning on the actual or stimulated equipment to be used in the job but trained off the job
vestibule training
[Training Methods]
Vestibule refers to (blank)
separate or adjacent room
[Training Methods]
Vestibule training is used when?
when it’s too costly or dangerous to train employees on the job
[Training Methods]
Refers to online courses done through the employee’s intranet or from online training vendors
internet-based training
[Training Methods]
Refers to interactive computer-based systems that increase knowledge or skills
computer-based training or CBT
[Training Methods]
Refers to delivering learning content on-demand via mobile devices
mobile learning
[Training Methods]
Top 6 most used training methods
- lectures
- blended
- online or computer-based
- virtual classroom
- social network
- mobile
[Training Methods]
Refers to a special work relationship between two employees where the more experienced one serves as a role model and offers guidance and advice
mentoring
[Training Methods]
Mentors can be found (blank)
within the company
[Training Methods]
4 main advantages of mentoring
- helps employees develop their careers
- improves job performance and attitudes
- quicker promotion
- less turnover
[Training Methods]
Refers to high-level executives being paired with a consultant to help improve performance
executive coaching
[Training Methods]
Coaches are usually (blank)
consultants from a coaching firm
[Training Methods]
Why is executive coaching employed?
the incumbent has performance deficiencies and the costs of finding a replacement are too high
[Training Methods]
Main advantage of executive coaching
trainee and coach may work for an extended period, providing continuous feedback and advice
[Training Methods]
Main disadvantage of executive training
expensive
Refers to a piece of research conducted to determine whether the training program had its intended effects
evaluation
5 steps in program evaluation
- set criteria
- select study design
- select assessment measures
- collect data
- analyze and interpret data
Refers to standards of comparison that determines the effectiveness of a program
criteria
2 levels of criteria
training-level and performance-level
Concerned with the abilities learned and applied in the training environment rather than on the job
training-level criteria
Concerned with performance on the job rather than in training
performance-level
This criterion is a better measure of transfer of training
performance-level
Refers to a structure of a study specifying how data are collected
design
2 most popular research designs
pretest-posttest and control group designs
Main advantage of a pretest-posttest design
practical and efficient
Main disadvantage of pretest-posttest design
difficult to attribute changes to training itself
4 levels of Kirkpatrick’s training evaluation
- reactions criteria
- learning criteria
- behavior application criteria
- results criteria
[Kirkpatrick’s Training Evaluation]
Refers to how much trainees like the training or perceived benefits to be gained from it
reactions criteria
[Kirkpatrick’s Training Evaluation]
Reactions criteria are given in a (blank) at the end of the training
questionnaire
[Kirkpatrick’s Training Evaluation]
2 main criticisms against reactions criteria
- too subjective
2. may become a popularity contest
[Kirkpatrick’s Training Evaluation]
2 limitations of reactions criteria
- does not measure learning or ability to apply learning
2. cannot measure changes in attitudes or beliefs
[Kirkpatrick’s Training Evaluation]
7 components of reactions criteria
- content
- materials
- instructional method
- trainer
- environment
- logistics
- recommendations
[Kirkpatrick’s Training Evaluation]
6 common formats of reactions criteria
- two-choice questions with room for explanation
- short answers
- complete the sentence
- ratings
- rankings
- checklists
[Kirkpatrick’s Training Evaluation]
Refers to the extent to which participants change attitudes, improve knowledge, or increase skills as a result of training
learning criteria
[Kirkpatrick’s Training Evaluation]
3 ways to determine learning criteria
- tests
- observations
- interviews
[Kirkpatrick’s Training Evaluation]
Refers to the assessment of how training affects the way participants perform on the job
behavior application criteria
[Kirkpatrick’s Training Evaluation]
Behavior application generally refers to (blank)
performance appraisal
[Kirkpatrick’s Training Evaluation]
3 main challenges in behavior application criteria
- time-consuming
- costly
- requires good organization and follow-up skills and processes
[Kirkpatrick’s Training Evaluation]
3 methods for assessing behavior application criteria
- observations
- interviews
- control group comparison
[Kirkpatrick’s Training Evaluation]
Refers to determining the impact of the training on the org and whether the training had its intended effects
results criteria
[Kirkpatrick’s Training Evaluation]
3 limitations of results criteria
- time-consuming
- costly
- difficult to control extraneous variables