Chapter 21: Comprehensive Evaluation Flashcards
what will a single technique not do
address all evaluation questions
comprehensive evaluation requires that an agency use
several different techniques
how to implement a comprehensive evaluation
The agency must allocate resources, including staff time, training and materials required to conduct the evaluation.
Agency managers need to create an open evaluation atmosphere.
The agency needs to assess how it is currently evaluating. All agencies make judgements about the worth of a program.
5 components of a comprehensive evaluation system
Formative Evaluation
Summative Evaluation
Ongoing In-Depth Analysis
Evaluation Database
Strategic Evaluation
formative evaluation
Occurs while the program is being implemented; its purpose is to enhance new programs.
summative evaluation
Occurs at the end of the program to provide the data needed to make a final, summative judgement about worth of the program and to assist with future operations.
ongoing in depth analysis
Involves using evaluation techniques to thoroughly investigate and judge the worth of a program.
evaluation database
An evaluation system must also provide the agency with an evaluation database
strategic evaluation
The database is used in preparing strategic evaluation reports.
5 evaluation techniques
Importance-Performance Evaluation
NRPA Park Metrics Evaluation Plan
Satisfaction-Based Evaluation
Goal and Objective Evaluation
Triangulated Evaluation
importance performance evaluation
Using this method, participants take a test before participating in a program; this test determines which program attributes are important to them. Participants also take a post-program test with the same items as the pre-program test. The post-program measurement determines how well the agency delivered the identified program attributes.
most useful feature of importance performance evaluation is
how it reports results
plotted on a matrix, where each piece of data is a function of both its importance to the participants and their judgement about how well the agency delivered
what is assumption of satisfaction based evaluation
agencies can best determine the worth of the programs by identifying the degree to which programs have provided leisure experiences for participants.
in satisfaction based evaluation, an after the fact evaluation is
well accepted as a measure of leisure outcomes and worth.
purpose of satisfaction based evaluation
evaluation provides theoretically valid measures of the outcome of leisure engagement. Agencies can use these data to develop program services and to account for the outcomes resulting from participation in program services.
goal and objective evaluation
This method examines the difference between the programs goals and what actually occurred in the program.
for goal and objective evaluation to be effective
goals and objectives need to be well written and SMART
Question of goal and objective evaluation
did the agency achieve what it set out to achieve?
what does goal and objective evaluation method encourage
an expansive view of a program including its inputs, processes, and outcomes
what does goal and objective evaluation assume
This method assumes that the standards you developed are indeed standards you plan to accomplish (S)
During and after a program you observe or measure actual performance (P)
Discrepancy (D), is the variation between standard and performance, that is, S-P=D
Performance could exceed the standard, in which case there is no discrepancy.
triangulated evaluation
assumes the gathering of the data from multiple perspectives and with multiple methods.
purpose of triangulated evalaution
:To provide the programmer with information for determining whether to drop, modify, or discontinue a program service. Helps with program development and organizational management.
