Chapter 7 (Exam)

Question 1

According to Nickolas, what is a stakeholder

Answer 1

A person or group with an interest in seeing an endeavor succeed and without whose support the endeavor would fail

Question 2

What are Kirkpatrick’s four R’s in his Framework for Evaluation

Answer 2

Reaction, Recall, Reactivity, and Results

Question 3

Who created the framework for evaluation (Four R Model)

Answer 3

Kirkpatrick

Question 4

The learner’s emotional response to the course (from the Kirkpatrick’s 4 R’s)

Answer 4

Reaction

Question 5

What are some issues when choosing data collection methods?

Answer 5

Validity, Reliability, and Practicality

Question 6

What is the term that is taken out or received from the training

Answer 6

Inducements

Question 7

How can data be collected

Answer 7

by Interviews, Questionnaires, Direct observations, Tests & simulations, and Archival performance data.

Question 8

What are the shortcomings of Kirkpatrick’s Framework

Answer 8

lack of explicit causal relationships among different levels, lack of specificity in dealing with different types of outcomes, lack of direction concerning which measures are appropriate to assess which outcome measures

Question 9

What is the purpose of evaluation

Answer 9

the systematic collection of descriptive and judgemental information necessary to make effective training decisions related to the selection, adoption

Question 10

What are the three vital issues to consider when deciding which data collection method to use?

Answer 10

Reliability, Validity, and Practicality

Question 11

Define reliability

Answer 11

the consistency of results and the freedom from error and bias in a data collection method

Question 12

What is the focus of the CIPP model and what does it measure?

Answer 12

It measures Context, Input, Process, and Product when evaluating training

Question 13

Define Validity

Answer 13

Whether or not the data collection method actually measures what we want it to measure

Question 14

What can improve the decision making process of HRD efforts?

Answer 14

having accurate, meaningful information available throughout the process

Question 15

What are the steps of Brinkerhoff’s training evaluation model, and which model does it build off of?

Answer 15

Goal Setting, Program Design, Program Implementation, Immediate Outcomes, Intermediate or Usage Outcomes, Impacts and Worth. It applies overlapping steps to Kirkpatrick’s model.

Question 16

A model of evaluation outlines the criteria for and focus of an evaluation.

Answer 16

The specification of the number of considered perspectives is important because of the scope of some HRD programs.

Question 17

Define practicality

Answer 17

concerns how much time, money, and resources are available for an evaluation method

Question 18

The guidelines for writing effective questionnaires include

Answer 18

1.write simply and clearly, and make the meaning obvious 2.ask discrete questions 3.provide discrete response options and explain them 4. Limit the number of response options 5. Match the response mode to the question 6. Get all of the important information

Question 19

Define questionnaire

Answer 19

is a standardized set of questions intended to assess opinions, observations, and beliefs

Question 20

Three important aspects of providing information for HRD evaluation include

Answer 20

data collection methods, types of data, and the use of self report data

Question 21

Which of these derive from costs that are not directly related to a training program

Answer 21

Overhead costs

Question 22

What are the three types of data for evaluating HRD effectiveness

Answer 22

individual performance, systemwide performance, and economic.

Question 23

What are the two problems with self-report data

Answer 23

Mono-method bias and socially desirable response

Question 24

Which of the following costs derive from costs that are incurred during the development of the program

Answer 24

Development costs

Question 25

Which of these costs are incurred in support of learning activities, but can’t be identified with any specific program

Answer 25

Indirect Costs

Question 26

What are the issues involved in choosing data collection methods?

Answer 26

reliability, validity, practicality

Question 27

What is the most commonly used form of evaluation?

Answer 27

participant reaction

Question 28

HRD Evaluation is

Answer 28

the systematic collection of descriptive and judgemental information necessary to make effective training decisions related to the selection, adoption, value, and modification of various instructional activities

Question 29

What are problems related to effectiveness?

Answer 29

may only achieve parts of effectiveness

Question 30

Kirkpatrick’s Framework for Evaluation 2 ideas

Answer 30

If you achieve first level of evaluation you will be able to achieve the second level, The further you go in evaluation the more beneficial it will be to the organization

Question 31

What are four critical stakeholders for any HRD intervention?

Answer 31

Senior Management, trainees, trainers, and the trainees’ manager

Question 32

What is economic data?

Answer 32

the bottom line for the organization, revenue increase or decrease through training

Question 33

Jack Phillips proposed modifying Kirkpatrick’s four-level evaluation model and adding ______ as Level 5.

Answer 33

ROI

Question 34

What is utility analysis?

Answer 34

A formula to compute the dollar value of improved performance due to training

Question 35

How does an organization measure their effectiveness?

Answer 35

measure in terms of productivity, timeliness, & cost savings

Question 36

Which of these costs are directly associated with the delivery of the learning activities

Answer 36

Direct Costs

Question 37

What are 4 different types of cost?

Answer 37

Direct Cost, Developement Cost, Evaluation Cost, Indirect Cost