Lecture 4: Evaluating a Surveillance System Flashcards
Research VS Evaluation: (Research)–> “research seeks to prove and evaluation seeks to improve”
- Production of generalizable knowledge
- research-derived questions
- paradigm stance
- more controlled setting
- clearer role
- published
- clearer allegiance
Research VS Evaluation: (Evaluation)–> “research seeks to prove and evaluation seeks to improve”
- Knowledge intended for use
- program or funder derived questions
- judgemental quality
- role conflicts
- often not published
- multiple allegiances
Definition: Goal
general, big-picture statement of desired results
- specifies expected program effect
- identifies target population
- in the form of a declarative statement
- free of jargon
- short and concise
- easily understood
- stated in positive terms
- provides framework for strategies and objectives
Definitions: Objectives
specific activities you will engage in to achieve the goal (ex: SMART objectives)
- Specific
- Measurable
- Achievable
- Realistic
- Time-based
SMART objectives
- Specific
- Measurable
- Achievable
- Realistic
- Time-based
Definitions: Surveillance
tracks disease or risk behaviors
Definitions: monitoring
tracks changes in program outcomes over time
Definitions: Evaluation
seeks to understand specifically why these changes occur
Why Evaluate Surveillance Systems?
- ensures efficient monitoring (of PH issues)
- assess effects (to see how well the surveillance systems are meeting their objectives)
- improve practice (to modify or adapt the surveillance systems to enhance their quality, efficiency and usefulness)
Types of Evaluations
- Needs/assets evaluation
- Process evaluation
- Outcome evaluation
- Impact evaluation
Four standards for effective evaluation
- Utility (ensures that the information needs of intended users are met)
- Feasibility (ensures that evaluation is realistic, prudent, diplomatic and frugal)
- Propriety (ensures evaluation is conducted legally, ethically and with regard for welfare of all involved
- Accuracy (ensures that the evaluation reveals and conveys technically accurate information)
Steps in Evaluating a Surveillance systems
- Engage stakeholders
- Describe the surveillance system to be evaluated
- Focus the evaluation design
- Gather credible evidence regarding the performance of the surveillance system
- Justify and state conclusions and make recommendations
- Ensure use of evaluation findings and share lessons learned
Engage stakeholders
- people who use the data to promote healthy lifestyles and the prevention and control of disease
- PH practioners
- Health care providers
- Government
- NGO’s
Describe the surveillance system to be evaluated
- describe ph importance (use indices of frequency, severity, disparities, costs, public interest, preventability)
- describe purpose and operation of the surveillance system (draw flow chart, describe components of the system)
- describe the resources used to operate the surveillance system (direct costs, indirect costs, or costs from societal perspective
- -> use SurvCost to calculate)
Logic Model
a systematic and visual way to present and share your understanding of the relationships among the resources you have to operate your program, the activities you plan and the changes or results you hope to achieve.
