Chapter 7 (Exam) Flashcards
According to Nickolas, what is a stakeholder
A person or group with an interest in seeing an endeavor succeed and without whose support the endeavor would fail
What are Kirkpatrick’s four R’s in his Framework for Evaluation
Reaction, Recall, Reactivity, and Results
Who created the framework for evaluation (Four R Model)
Kirkpatrick
The learner’s emotional response to the course (from the Kirkpatrick’s 4 R’s)
Reaction
What are some issues when choosing data collection methods?
Validity, Reliability, and Practicality
What is the term that is taken out or received from the training
Inducements
How can data be collected
by Interviews, Questionnaires, Direct observations, Tests & simulations, and Archival performance data.
What are the shortcomings of Kirkpatrick’s Framework
lack of explicit causal relationships among different levels, lack of specificity in dealing with different types of outcomes, lack of direction concerning which measures are appropriate to assess which outcome measures
What is the purpose of evaluation
the systematic collection of descriptive and judgemental information necessary to make effective training decisions related to the selection, adoption
What are the three vital issues to consider when deciding which data collection method to use?
Reliability, Validity, and Practicality
Define reliability
the consistency of results and the freedom from error and bias in a data collection method
What is the focus of the CIPP model and what does it measure?
It measures Context, Input, Process, and Product when evaluating training
Define Validity
Whether or not the data collection method actually measures what we want it to measure
What can improve the decision making process of HRD efforts?
having accurate, meaningful information available throughout the process
What are the steps of Brinkerhoff’s training evaluation model, and which model does it build off of?
Goal Setting, Program Design, Program Implementation, Immediate Outcomes, Intermediate or Usage Outcomes, Impacts and Worth. It applies overlapping steps to Kirkpatrick’s model.
A model of evaluation outlines the criteria for and focus of an evaluation.
The specification of the number of considered perspectives is important because of the scope of some HRD programs.
Define practicality
concerns how much time, money, and resources are available for an evaluation method
The guidelines for writing effective questionnaires include
1.write simply and clearly, and make the meaning obvious 2.ask discrete questions 3.provide discrete response options and explain them 4. Limit the number of response options 5. Match the response mode to the question 6. Get all of the important information
Define questionnaire
is a standardized set of questions intended to assess opinions, observations, and beliefs
Three important aspects of providing information for HRD evaluation include
data collection methods, types of data, and the use of self report data
Which of these derive from costs that are not directly related to a training program
Overhead costs
What are the three types of data for evaluating HRD effectiveness
individual performance, systemwide performance, and economic.
What are the two problems with self-report data
Mono-method bias and socially desirable response
Which of the following costs derive from costs that are incurred during the development of the program
Development costs
Which of these costs are incurred in support of learning activities, but can’t be identified with any specific program
Indirect Costs
What are the issues involved in choosing data collection methods?
reliability, validity, practicality
What is the most commonly used form of evaluation?
participant reaction
HRD Evaluation is
the systematic collection of descriptive and judgemental information necessary to make effective training decisions related to the selection, adoption, value, and modification of various instructional activities
What are problems related to effectiveness?
may only achieve parts of effectiveness
Kirkpatrick’s Framework for Evaluation 2 ideas
If you achieve first level of evaluation you will be able to achieve the second level, The further you go in evaluation the more beneficial it will be to the organization
What are four critical stakeholders for any HRD intervention?
Senior Management, trainees, trainers, and the trainees’ manager
What is economic data?
the bottom line for the organization, revenue increase or decrease through training
Jack Phillips proposed modifying Kirkpatrick’s four-level evaluation model and adding ______ as Level 5.
ROI
What is utility analysis?
A formula to compute the dollar value of improved performance due to training
How does an organization measure their effectiveness?
measure in terms of productivity, timeliness, & cost savings
Which of these costs are directly associated with the delivery of the learning activities
Direct Costs
What are 4 different types of cost?
Direct Cost, Developement Cost, Evaluation Cost, Indirect Cost
