Chapter 3 - Principles of Program Evaluation Flashcards
What should you evaluate?
knowledge, skills and behaviors
The knowledge, skills and behavior should be directly related to what?
vision and goals
What is a vision statement?
it is a shared expression of a program staff
what does vision describe?
what a team wants the program to accomplish by focusing on the end result
A vision statement needs to be what?
ambitious, dynamic, and be a big picture
vision statements are developed by who?
people who have a stake in the program such as program staff, partners, recipients of service
Sometimes you need to create what so that everyone can agree?
a broad statement
After creating a vision you can create what?
program goals and objectives
A good objective is what?
tied to the goal
specific
describes an action or knowledge that the participant will gain
mentions a time span
Objectives must match what?
the program mission
the evaluation must mach what?
the objectives
the program must match what?
the objectives and evaluation
why gather evaluation data?
to assess progress
guide decisions
refine program
what are some common questions to guide evaluation?
how will participants function better in their lives because of our program?
what needs remain unaddressed?
what evidence do we have that our program satisfies the objectives?
jacob’s 5 tiered approach to program evaluation
- preimplementation
to establish fit between community need and program
-assessment and revise program plans based on assessment
jacob’s 5 tiered approach to program evaluation
- accountability
determine who is getting the program and if its reaching intended audience
-determine number and characteristics of people
jacob’s 5 tiered approach to program evaluation
- program clarification
gather feedback from Staff and participants on how to improve
-collect data
jacob’s 5 tiered approach to program evaluation
- progress toward objectives
document program effectiveness and short term outcomes
jacob’s 5 tiered approach to program evaluation
- program impact
document program effectiveness and long term outcomes. recommend model programs for widespread dissemination
what is the logic model?
a popular method for conceptualizing program and evaluation efforts
- description of situation and priorities
- specify inputs
- divide inputs into activities and participants
- divide outcomes into short, medium, long term outcomes
what is pretest
test given before an experimental treatment begins
what is a posttest?
a test given after an experimental treatment ends
what is a retrospective survey?
test given after an experimental treatment ends that asks participants to compare their skills before and after the program
what is transformative learning?
interview participants
what are results mapping?
portraits of success
