Exam 1 - Evaluation and Outcome Assessment Flashcards
What is evaluation?
A systematic method for collecting, analyzing, and using data to examine the effectiveness and efficiency of programs to contribute to continuous program improvement.
T/F: Health programs are population focused, while health services are on an individual level.
TRUE
What is included in the Public Health Social Model?
- Individual
- Relationship
- Community
- Societal
What is the term for biological and personal characteristics and behaviors for the social-ecological model?
INDIVIDUAL
What is included in the community part of the social-ecological model?
Organization and institutions including schools, workplaces, and neighborhoods
What is the purpose of evaluation?
To measure the effects of a program against goals set for it and thus contribute to subsequent decision making about the program
What do public health programs aim to do?
Prevent or control disease, injury, disability, and death
Name the five ways that public health programs operate, which has become more complex.
1) Socioeconomic
2) Demographic
3) Interpersonal
4) Inter-organizational
5) Fiscal/budgetary restrictions
What does evaluation allow?
- To monitor progress toward the program’s goals
- To determine whether program components are producing the desired progress on outcomes
- To permit comparisons among groups, particularly among populations with disproportionately high-risk factors and adverse health outcomes
- To justify the need for further funding and support
- To find opportunities for continuous quality improvement
- To ensure that effective programs are maintained, and resources are not wasted on ineffective programs
What could be evaluated?
- Direct service interventions
- Community mobilization efforts
- Research initiatives
- Surveillance systems
- Policy development activities
- Outbreak investigators
- Lab diagnostics
- Communication campaigns
- Infrastructure-building projects
- Training and educational services
- Administrative systems
When do you not evaluate?
- There are no questions about the program
- The program has no clear direction
- The stakeholders can’t agree on the program objectives
- There is not enough money to conduct a sound evaluation
What tracks disease or risk behaviors?
Surveillance
What tracks changes in program outcomes over time?
Monitoring
What seeks to understand specifically why these changes occur?
Evaluation
Name the seven types of evaluation.
1) Community needs assessment
2) Process evaluation
3) Effect evaluation (Outcome evaluation)
4) Cost evaluations
5) Comprehensive evaluations
6) Meta-evaluation
7) Summative evaluations
What does “My PECCCS” stand for?
My - Meta-evaluation
P - Process evaluation E - Effect evaluation (Outcome evaluation) C - Community needs assessment C - Cost evaluations C - Comprehensive evaluations S - Summative evaluations
What type of evaluation is performed to collect data about the health problems of a particular group?
Community needs (health) assessment
Which type of evaluation focuses on the degree to which the program has been implemented as planned and on the quality of the program implementation?
Process evaluation
The information obtained from a process evaluation is used to do what?
Plan, revise, and improve the program
What is the Outcome evaluation also referred to as?
Effect or impact evaluation
What key question does the Outcome evaluation seek to answer?
Did the program make a difference?
Which evaluation type is done by researchers because it requires expertise in economics?
Cost evaluations
T/F: Cost evaluations are performed late in the planning and evaluation cycle and are not likely to be available in time to make program improvements or revisions.
TRUE
Which type of evaluation involves analyzing needs assessment data, process evaluation data, outcome evaluation data, cost evaluation data as a set of data?
Comprehensive evaluations
T/F: Comprehensive evaluations are common.
FALSE
-Comprehensive evaluations are relatively uncommon due to the resources needed to integrate analysis of different data
How are meta-evaluations done?
By combining the findings from previous outcome evaluations of various programs for the same health problems
T/F: Meta-evaluations are most likely to be done by evaluation researchers.
TRUE
When is the summative evaluation done?
At the conclusion of a program to provide a conclusive statement regarding program effects
How many steps are there in the CDC’s Framework for Program Evaluation in Public Health?
6 steps
Name the 6 steps of the CDC’s Framework for Program Evaluation in Public Health.
1) Engage stakeholders
2) Describe the program
3) Focus the evaluation design
4) Gather credible evidence
5) Justify conclusions
6) Ensure use and share lessons learned
What are the purposes of the framework?
- Summarize the essential elements of program evaluation
- Provide a framework for conducting effective program evaluations
- Clarify steps in program evaluation
- Review standards for effective program evaluation
- Address misconceptions regarding the purposes and methods of program evaluation
Name the four standards of the CDC’s Framework for Program Evaluation in Public Health.
1) Utility
2) Feasibility
3) Propriety
4) Accuracy
Who are stakeholders?
People or organizations invested in the program, interested in the results of the evaluation, and/or have a stake in what will be done with the results of the evaluation
What is the term for the resources needed to implement the activities in step 2: describe the program?
INPUTS
What is the term for what the program and staff do with those resources in step 2: describe the program?
ACTIVITIES
What is the term for tangible products, capacities, or deliverables that result from the activities in step 2: describe the program?
OUTPUTS
What is the term for changes that occur in other people or conditions because of the activities and outputs in step 2: describe the program?
OUTCOMES
What is the term for the most distal/long-term outcomes in step 2: describe the program?
IMPACTS
What is the term for contextual factors that are out of control of the program but may help or hinder achievement of the outcomes in step 2: describe the program?
MODERATORS
What should gathering evidence include?
Consideration of indicators, sources of evidence (methods of data collection), quality, quantity, and logistics
What are the 4 parts of the public health social ecological model?
1) Individual
2) Relationship
3) Community/Aggregate
4) Societal
