Program Planning and Evaluation Flashcards
Action Plan
how objectives will be accomplished
Social Assesment
Phase 1 of PRECEDE-PROCEED planning model.
Examines Quality of Life
Epidemiological Assessment
Phase 2 of PRECEDE-PROCEED planning model.
Examines how genetics, behaviors, and environments impact health.
Educational + Ecological Assessments
Phase 3 of PRECEDE-PROCEED planning model.
Examines predisposing, enabling, + enforcing factors of health behaviors.
Administrative + Policy Assessment
Phase 4 of PRECEDE-PROCEED planning model.
Develop educational strategies, budgets, and resources.
Program Implementation (PP)
Phase 5 of PRECEDE-PROCEED planning model.
Program Evaluation (PP)
Phases 6-8 of PRECEDE-PROCEED planning model.
- Process evaluation
- Impact evaluation
- Outcome evaluation
predisposing factors
knowledge, beliefs, etc. that predisposes one to change
enabling factors
resources and new skills to enable behavior change
reinforcing factors
feedback and rewards system for change
process evaluation
measures and describes how a program operates;
occurs during program implementation;
examines the degree that activities are being 1) implemented and delivered as planned; 2) if they are reaching the intended target audiences; 3) producing the desired outputs;
provides feedback on implementation, content, methods, participants, presenters, stakeholder engagement;
impact evaluation
examines whether change occurred as a result of the intervention; assesses whether goals were met
outcome evaluation
assess the effectiveness of a program in producing change; may take many years to properly assess;
are summative in nature
needs and resource assessment
used to identify, analyze, and prioritize the needs of a population
stakeholder involvement and feedback
is critical to the development of the program and VMOSA (vision, mission, objectives, strategies, and action plans)
objectives
answers Who? What? How much? By when?
should be SMART.
SMART
Specific, Measurable, Achievable, Realistic, and Time-Limited.
Ex: Bicycle helmet use will increase (what) among children ages 5-11 (who) by 25% (how much) by the end of the program (when).
General Model of Planning
- Understand community strengths + weaknesses (SWOT, asset mapping)
- Needs and resource assessment
- Goals + Objectives
- Develop intervention with theory and logic
- Implement intervention
- Evaluate results
PATCH
(1983) Planned Approach to Community Health
CDC-state-local partnership
APEX-PH
(1987) Assessment Protocol for Excellence in Public Health
used by CDC, APHA, NACCHO.
replaced by MAPP
MAPP
Mobilizing for Action through Planning and Partnerships
- Organize for Success + Partnership Development
- Visioning
- 4 MAPP Assessments
- Identify strategic issues
- Formulate goals + strategies
- Action Cycles: Plan, Implement, Evaluate
4 MAPP Assessments
- Community themes + strengths
- Local PH system
- Community health status
- Forces of Changes
MAP-IT
(2010) Mobilize Assess Plan Implement Track
implements adaptation of healthy People
Intervention Mapping
expands upon PRECEDE-PROCEED
central focus is community involvement at every step
Intervention Mapping Steps (6 steps)
- Logic Model of Problem
- Logic Model of Change
- Program Design
- Program Production
- Program Implementation Plan
- Evaluation plan
pre-test
measures effectiveness of adapting or creating program materials
strategy
general plan of action; should consider the population
methods
systematic approach or procedures used to share information
pilot testing
measures effectiveness of adapted or created intervention
benefits of pilot testing or pre testing
saves money, time, and resources
fidelity
describes whether a program is being implemented as planned
Ways to improve program fidelity
training and observation of staff
program sustainability
ensures program continues to operate effectively over time;
intervention mapping helps plan for sustainability
ensuring sustainability requires…
preparing planning models to educate folks who will oversee sustainability
program evaluation
systematic investigation of the merit, worth, or significance of a program
formative evaluation
gathers information during early stage of implementation ore redesign;
focus on whether program is being implemented as planned;
done to identify program strengths and weaknesses to guide improvement.
process evaluation
measures and describes how a program operates;
occurs during program implementation;
provides feedback on implementation, content, methods, participants, presenters, stakeholder engagement;
examines the degree that activities are being 1) implemented and delivered as planned; 2) if they are reaching the intended target audiences; 3) producing the desired outputs;
summative evaluation
occurs after program components have been implemented;
assess impact and outcomes of program;
conducted as a pass or fail examination that can lead to program termination.
CDC Evaluation Framework
- Stakeholder Engagement
- Describe the program
- Focus the evaluation design
- Gather credible evidence
- Justify conclusions
- Ensure use and share lessons learned
Reports should be…
clear, simple, action-oriented, tailored for each audience
CDC standards of evaluation
- utility
- feasibility
- propriety
- accuracy
utility
ensures the evaluation is relevant and useful to program participants and stakeholders
feasibility
ensures the scope and activities within an evaluation are not over-reaching
propriety
addresses ethical considerations on behalf of those involved
accuracy
addresses validity and adequacy of information used and conveyed
community
a group of people that share a sense of collaborative identity, common values, goals, and institutions
defined by geographic, administrative, cultural, or social boundariesq
Community Coalition Action Theory
stages for coalition development
includes engagement and consensus-building efforts
requires trust and representation of priority population
Stages of Coalition Development (Community Coalition Action Theory)
- Formation
- Maintenance
- Institutionalization
stakeholders
represent diverse organizations, factions, or groups that work together for the purpose of achieving a common goal
gatekeepers
those who formally or informally control access to a priority population or control specific aspects of a community or decision process
opinion leaders
respected community members who represent the view of the priority population
Collaboration Tips
- Have a shared mutually agreed upon vision
- Determine the best strategy/approach
- Include multiple perspectives
- Maintain open and clear communication
- Delineate roles and responsibilities
- Have formal and informal agreements if needed
- Rely on collaborative and transformational leadership
community development
aims to develop community capacity
community capacity
skills, resources, relationships to support shared goals
community organizing
identify common problems and goals, mobile resources, and determine ways to meet goals
social planning
relies more on experts to solve problems
social action
addresses social inequities within a community
mobilization plan components
- roles and responsibilities
- action steps of stakeholder engagement
- planning models
- evaluation plans
Methods to Keep Coalitions on Track
Review VMOSA;
Provide agendas and clear purposes;
follow-up to maintain engagement;
