Chapter 10: Evaluation and Policy Analysis Flashcards
Research that has an impact on policy and can be immediately utilized and applied
Applied Research
This type of evaluation occurs when an evaluation of program outcomes ignores, and does not identify, the process by which the program produced the effect
Black Box Evaluation
Group producing systematic reviews of programs and policies in many areas including criminal justice, social work, and education
Campbell Collaboration
A type of evaluation research that compares program costs to the economic value of program benefits
Cost-Benefit Analysis
A type of evaluation research that compares program costs to actual program outcomes
Cost-Effectiveness Analysis
A type of evaluation research that compares program costs to program effects; it can be either a cost-benefit analysis or a cost-effectiveness analysis
Efficiency Analysis
A type of evaluation research conducted to determine whether it is feasible to evaluate a program’s effects within the available time and resources
Evaluability Assessment
A policy that has been evaluated with a methodologically rigorous design and has been proven to be effective
Evidence-Based Policy
Information about service delivery system outputs, outcomes, or operations that is available to any program inputs
Feedback
Analysis of the extent to which a treatment or other service has the intended effect
Impact Evaluation
Resources, raw materials, clients, and staff that go into a program
Inputs
An orientation to evaluation research that expects researchers to respond to concerns of people involved with stakeholders as well as to the standards and goals of the social scientific community
Integrated Approaches
A type of evaluation research that attempts to determine the needs of some population that might be met with a social program
Needs Assessment
A quasi-experimental design in which there are experimental and comparison groups that are designated before the treatment occurs but are not created by random assignment
Nonequivalent Control Group Design
The impact of the program process on the cases processed
Outcomes
The services delivered or new products produced by the program process
Outputs
A process in which research results are used to provide policy actors with recommendations for action that are based on empirical evidence and careful reasoning
Policy Research
Evaluation research that investigates the process of service delivery
Process Evaluation (Program Monitoring)
The complete treatment or service delivered by the program
Program Process
A descriptive or prescriptive model of how a program operates and produces its effects
Program Theory
A research design in which there is a comparison group that is comparable to the experimental group in critical ways, but subjects are not randomly assigned to the comparison and experimental groups
Quasi-Experimental Design
A procedure by which each experimental and control group subject is placed in a group randomly
Random Assignment
An orientation to evaluation research that expects researchers to emphasize the importance of researcher expertise and maintenance of autonomy from program stakeholders
Social Science Approaches
An orientation to evaluation research that expects researchers to be responsive primarily to the people involved with the program
Stakeholder Approaches
Individuals and groups who have some basis of concern with the program
Stakeholders
Summary review about the impact of a program wherein the analyst attempts to account for differences across research designs and samples, often using statistical techniques such as a meta-analysis
Systematic Review
A program evaluation that is guided by a theory that specifies the process by which the program has an effect
Theory-Driven Evaluation
A quasi-experimental design consisting of many pretest and posttest observations of the same group
Time Series Design (Repeated Measures Panel Design)Term 28 of 28
