Chapter 10: Evaluation and Policy Analysis

Question 1

Research that has an impact on policy and can be immediately utilized and applied

Answer 1

Applied Research

Question 2

This type of evaluation occurs when an evaluation of program outcomes ignores, and does not identify, the process by which the program produced the effect

Answer 2

Black Box Evaluation

Question 3

Group producing systematic reviews of programs and policies in many areas including criminal justice, social work, and education

Answer 3

Campbell Collaboration

Question 4

A type of evaluation research that compares program costs to the economic value of program benefits

Answer 4

Cost-Benefit Analysis

Question 5

A type of evaluation research that compares program costs to actual program outcomes

Answer 5

Cost-Effectiveness Analysis

Question 6

A type of evaluation research that compares program costs to program effects; it can be either a cost-benefit analysis or a cost-effectiveness analysis

Answer 6

Efficiency Analysis

Question 7

A type of evaluation research conducted to determine whether it is feasible to evaluate a program’s effects within the available time and resources

Answer 7

Evaluability Assessment

Question 8

A policy that has been evaluated with a methodologically rigorous design and has been proven to be effective

Answer 8

Evidence-Based Policy

Question 9

Information about service delivery system outputs, outcomes, or operations that is available to any program inputs

Answer 9

Feedback

Question 10

Analysis of the extent to which a treatment or other service has the intended effect

Answer 10

Impact Evaluation

Question 11

Resources, raw materials, clients, and staff that go into a program

Answer 11

Inputs

Question 12

An orientation to evaluation research that expects researchers to respond to concerns of people involved with stakeholders as well as to the standards and goals of the social scientific community

Answer 12

Integrated Approaches

Question 13

A type of evaluation research that attempts to determine the needs of some population that might be met with a social program

Answer 13

Needs Assessment

Question 14

A quasi-experimental design in which there are experimental and comparison groups that are designated before the treatment occurs but are not created by random assignment

Answer 14

Nonequivalent Control Group Design

Question 15

The impact of the program process on the cases processed

Answer 15

Outcomes

Question 16

The services delivered or new products produced by the program process

Answer 16

Outputs

Question 17

A process in which research results are used to provide policy actors with recommendations for action that are based on empirical evidence and careful reasoning

Answer 17

Policy Research

Question 18

Evaluation research that investigates the process of service delivery

Answer 18

Process Evaluation (Program Monitoring)

Question 19

The complete treatment or service delivered by the program

Answer 19

Program Process

Question 20

A descriptive or prescriptive model of how a program operates and produces its effects

Answer 20

Program Theory

Question 21

A research design in which there is a comparison group that is comparable to the experimental group in critical ways, but subjects are not randomly assigned to the comparison and experimental groups

Answer 21

Quasi-Experimental Design

Question 22

A procedure by which each experimental and control group subject is placed in a group randomly

Answer 22

Random Assignment

Question 23

An orientation to evaluation research that expects researchers to emphasize the importance of researcher expertise and maintenance of autonomy from program stakeholders

Answer 23

Social Science Approaches

Question 24

An orientation to evaluation research that expects researchers to be responsive primarily to the people involved with the program

Answer 24

Stakeholder Approaches

Question 25

Individuals and groups who have some basis of concern with the program

Answer 25

Stakeholders

Question 26

Summary review about the impact of a program wherein the analyst attempts to account for differences across research designs and samples, often using statistical techniques such as a meta-analysis

Answer 26

Systematic Review

Question 27

A program evaluation that is guided by a theory that specifies the process by which the program has an effect

Answer 27

Theory-Driven Evaluation

Question 28

A quasi-experimental design consisting of many pretest and posttest observations of the same group

Answer 28

Time Series Design (Repeated Measures Panel Design)Term 28 of 28