Chapter 4 Flashcards

1
Q

What is not a key benefit of the elevation function?

A

Determining the cause of the performance gap and appropriate remediation.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What best describes a reliable evaluation instrument?

A

The extent to which an instrument is consistent enough that the subsequent measures of an item give the same approximate results.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What best describes construct validity?

A

The extent to which the instrument represents the content of the program.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What best describes formative evaluation?

A

Assessing the effectiveness of a training program while its being developed.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What best describes concurrent validity?

A

The extent to which an instrument agrees with the results of other instruments administered at approximately the same time to measure the same characteristics.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What best describes summative evaluation?

A

Assessing the effectiveness of a training program when its completed and has been test piloted.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Which of Kirkpatrick’s 4 levels of evaluation assesses the learners ability to transfer learning on the job and usually occurs a few weeks to 3 months after the training event.

A

Level 3

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Which of Kirkpatrick’s 4 levels of evaluation assesses the learners reaction to the training program and is usually administered at the end of the training event?

A

Level 1

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Which evaluation methods encourages the analysis of each step to ensure the quality of the evaluation?

A

Meta

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Which evaluation method focuses on converting data into monetary values and comparing it to costs?

A

Phillips ROI Methodology

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is an example of a learning (Level 2) evaluation?

A

Paper and Pencil Test

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

An assessment of on the job performance is an example of which level of evaluation?

A

Behavior (Level 3)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What measures the central tendency reflecting the most frequently occurring score in a distribution?

A

Mode

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What best describes a situation where the mode

A

Positive Skewness, refers to assembly in the distribution of sample.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What best describes a normal distribution?

A

The way which observations tend to gather around the mean, also known as a bell shaped curve.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What best describes dispersion?

A

Variation in values that could be widely scattered or tightly clustered.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What best describes an outlier?

A

An observation in a data set that’s further from others in the data set.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What types of data make it possible to rank order items measured by which has less or more quality represented?

A

Ordinal

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What identifies an absolute zero point?

A

Interval

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

For which reasons do TD professionals convert raw scores to standard scores?

A

To reflect where they fall with respect to the mean to allow scores to be compared and interpreted.

21
Q

A relational study statistic that measures the relationship between 2 variables is a…

A

Correlation Coefficient, describes the strength and direction of the relationship.

22
Q

What is not a major problem regarding the use of evaluation data?

A

Organizations do not apply confidence intervals.

23
Q

What are measures of central tendency?

A

Mean, Median, Mode

24
Q

In a measurement of the distribution of a group of numbers, which represents the middle number where half of the numbers are above half are below?

A

Median

25
Q

What is controlled by the evaluator when splitting groups into treatment group and control groups?

A

Independent Variable

26
Q

Sampling methods does each person in the population have an equal chance of being chosen for the sample?

A

Random Sampling

27
Q

Process of finding the sample of people for a study from the population?

A

Random Selection

28
Q

Source of bias may be a source of measurement error when participants know they are being watched?

A

Observation Bias

29
Q

Source of bias be a source of measurement error because participants are hesitant to choose either end of a measurement scale and instead respond in near the middle?

A

Bias of central tendency

30
Q

Helps identify the item maintaining the status quo and helps clarify approaches needed to facilitate change?

A

Force Field Analysis

31
Q

Best described as planning and organizing an experiment to ensure that the right type of data, and enough of it, is available to answer questions of interest as clearly and efficiently as possible?

A

Experimental Design

32
Q

Characteristic of hard data?

A

Objective

33
Q

NOT an example of descriptive statistic?

A

Analysis of variance

34
Q

Method provides the most compelling evidence for the effect of online learning but is sometimes infeasible in a business environment?

A

Using a control group to isolate the effects of online learning.

35
Q

Most impact on the extent to which a research study’s results can be generalized?

A

Sampling

36
Q

What formula can forecast how long it will take for a training program to return the investment?

A

Program costs/total benefits

37
Q

What analysis method includes variables such as the standard deviation of job performance and the true difference in job performance between average trained and average untrained employees?

A

Utility Anlysis

38
Q

How can TD professionals use statistical forecasting models to improve training evaluation?

A

Predict future performance levels

39
Q

When calculating the BE (Break-Even) of a project the resulting value is 1.0 What is the meaning of that value?

A

When BE is 1.0 it indicates it will take one year for the program to return the investment.

40
Q

What best describes utility analysis?

A

Measures a programs economic contribution according to how effective the program was in identifying and modifying behaviors.

41
Q

What best describes a forecasting model?

A

Isolates the effects of training when mathematical relationships between input and output variables are known.

42
Q

Most inaccuracies in survey completion occur because of what?

A

Respondents misrepresentation of the directions

43
Q

What is not one of the major tasks in analyzing data?

A

Developing spreadsheets

44
Q

What synthesis model contains input-process-output items, decision points, and direction of flow to organize and synthesize information.

A

Flowchart

45
Q

Synthesizes model used by Chris Argyris and is a way to approach ambiguous pieces of information by fitting data into 2 mutually exclusive groups or contradictory positions.

A

Dichotomy

46
Q

What best describes an executive summary?

A

Brief overview of the entire report, explaining the basis for the evaluation and significant conclusions and recommendations, and is designed for those who only need the most important information.

47
Q

When presentation evaluation results, it is important for the TD professional to do what?

A

Use a presentation style that matches the purpose of the presentation

48
Q

What is NOT one of the assumptions for the Chi-square test for single variance?

A

The respondents opinions must be cross-tabulated

49
Q

What is NOT one of the primary considerations when planning and disseminating learning impact study results?

A

Include testimonials in the evaluation results report always has a profound effect on how effectively messages in the learning study are received,