(F) Lesson 1: Health Program Implementation and Evaluation Flashcards
T or F: It is unlikely that implementers will face challenges as long as they plan the program carefully
False (still likely)
What is necessary in order to consider the potential challenges of program implementation and how to best address them when they arise?
Preparation
T or F: Program implementation is done before the needs assessment and planning phase
False (after)
This refers to strategies or interventions to be conducted on the community in order to fulfill certain objectives
Implementation
This consideration refers to the involvement of the community together with other institutions, organizations, the government, volunteers (e.g. churches), etc.
Relationship with community partners
This consideration asks “are the connections strong or do they lack affiliations/involvements with other organizations?”
Relationship with community partners
These people are responsible for kick starting the program implementation
Program staff
T or F: If the activity is about nutrition, it is preferred that you recruit a radiologist in implementing the program
False (nutritionist)
This consideration wants you to figure out if any experts and manpower are available to help and be involved with the program and if there is sufficient budget to pay them
Recruitment of experts and program staff
This consideration refers to instructing staff on what they are going to do so that they can work harmoniously and synchronously in achieving the program objectives
Program staff orientation and training
T or F: In program staff orientation and training, figure out if there is sufficient budget to conduct trainings and seminars for the activity
True
T or F: In program staff orientation and training, find out if resources are available in order to conduct said orientations and trainings
True
This consideration takes into account safety training for home visits, travel, and transport and also risk management plans to mitigate responsibilities for potential cases
Liabilities
This determinant states that a program must be subjected into a study, research, or service to come up with good decisions about individual and community household care
Evidence-based
This determinants asks the questions:
→ are there street or group leaders (e.g. HOA or barangay captains)?
→ are the leaders functional?
→ are the households participative to their leaders?
Community Engagement
This determinant states that in order to seek and maintain support from partners, they must be involved in the missions or objectives of the program (could be schools, government organizations, church communities, etc.)
Strong Partnership
This determinant states that if one wants to achieve a long-term goal, the execution shouldn’t be a one time big time thing and that the relationships and services must be continuous
Sustainability Plans
This determinant involves the feedback received from the evaluation survey tools that can be used for reflection of what has been conducted
Evaluation support
T or F: In evaluation support, there should be a dialogue system or meeting among the community together with their group leaders
True
This determinant wants you to determine the strengths and weaknesses of the community in order to implement a fitting program
Common challenges and assets
This challenge refers to financial/monetary budgets—is it available or lacking? Is health NOT a priority for their community funding?
Resources and sustainability
This challenge takes into account the safety of the implementers/health workers when it comes to travel
Geographic limitations/hard-to-reach households and populations
This challenges asks the questions:
→ are people available?
→ why are they not available or willing to do the job?
→ are they hesitant with regards to the salaries and professional fees?
Recruiting staff
This challenge states that healthcare workers must take an effort to serve all household participants in the community while considering their differences
Cultural and social issues
This sub-challenge in cultural and social issues deals with nutrition
Deeply rooted traditions and cultures around food
This sub-challenge in cultural and social issues deals with the community’s trust issues
Lack of trust for medical professionals and outsiders
This sub-challenge in cultural and social issues deals with a difference in opinions, perspectives, and norms
Social beliefs around certain behaviors
This is used to measure the effectiveness of programs and policies to know whether it is moving steadily or successfully towards the goal
Health program evaluation
This refers to assessment or feedback and helps to show that a program is producing measurable outcomes (e.g. improving health access and other health outcomes)
Health program evaluation
T or F: A program evaluation can’t tell what works and what needs to be improved
False (it can)
T or F: A health program evaluation only requires qualitative data
False (may require qualitative or quantitative data)
The data used for health program evaluations come from who?
Different stakeholders
T or F: Health program evaluations should consider contextual factors that may affect program success
True
The following factors: quality, cost, impact, and areas of improvement, can be assessed by gathering information during what phase?
Implementation
T or F: Health program evaluation should provide transparency and accountability as it encourages community support and informs policy decisions
True
T or F: It is important to establish an evaluation plan after the program has started
False (before)
T or F: Make sure that the research questions, measures, and methods align with the evaluation’s goals
True
This refers to the schedule of activities from the planning to the execution to the evaluation
Timeline
This refers to what marks up on the progress of the program
Key milestones
This design determines whether a program is more effective than the current process; it is also considered to be the gold standard against other research designs as it offers a powerful technique for evaluation cause and effect scenarios
Experimental design
T or F: Experimental designs involve randomly assigning participants to a treatment or control group
True
This design is an alternative (but mimics) to the experimental design if it is not feasible
Quasi-experimental design
What two factors explain why some situations don’t recommend using an experimental design for the evaluation?
Impracticality and Unethicality
T or F: A quasi-experimental design has a random assignment component, just like the experimental design
False (does not)
This design compares a treatment group to a similar group not participating in the program
Quasi-experimental design
This design estimates the effect of a treatment, policy, or intervention when controlled experiments are not feasible (e.g. assessing the adverse reactions to a treatment before and after the intervention)
Quasi-experimental design
This design only measures the outcomes from those who were served by the program and may include pre- and post-intervention studies with no control or comparison group, case study approaches, and post-intervention-only approaches
Non-experimental design
T or F: A non-experimental design does not have a comparison group or a weak control group
True
T or F: Biases can be controlled hence it is expected that none will show up in a non-experimental design
False (cannot be controlled; expected to show up)
This framework is a systematic, focused plan for collecting data to determine whether the program model is implemented as originally intended—if not, how operations differ from those initially planned
Process evaluation
This framework answers “what services are actually being delivered and to whom?” and is able to gather information on stakeholders’ perceptions of the program
Process evaluation
A process evaluation explains how complex the interventions are and is also known as?
Formative evaluation
This framework describes the program, the process, how it will be implemented, and why it is important
Process evaluation
This framework:
→ examines how well a project achieved the outcomes set at the beginning
→ is a summative evaluation of the program which can be used for recommendations for future program improvements
→ measures the change and progress brought about by the implementation (e.g. health conditions, quality of life, or health behaviors)
Outcome evaluation
This framework:
→ evaluates the effect a program had on its participants and stakeholders of the project
→ measures outcomes but also changes that resulted from those outcomes usually from a long-time process
→ can also be used for recommendations in increasing positive health outcomes and minimizing adverse health outcomes
Impact evaluation
This framework:
→ is an ongoing evaluation that provides data at the baseline and at key milestones in the work plan done during the program
→ provides continuous, real-time feedback on program progress so that changes can be made to better align with the program objectives
Performance monitoring
This framework:
→ studies the cost-effectiveness of the program by reviewing the relationship of project costs and outcomes (or benefits/rewards)
→ uses data that is used to determine whether the program outcomes were worth the investment in program development and operation
→ assesses the projected/estimated costs together with the real expenses used
Cost-benefit evaluation
T or F: Data should align with the evaluation objectives and should answer the research questions
True
This data source refers to open or close-ended questions that can be administered face-to-face, via phone, mail, or online
Surveys or Questionnaires
This data source refers to documenting the knowledge gained on the progress of the program
Knowledge or Attitude tests
This data source refers to a more in-depth exploration of the issues or topics
Interviews
This data source refers to a group of experts that will review the policy options, provide feedback, or assess the pros and cons of the program
Technical expert panels
This data source refers to recording behaviors, situations, and events; a form of direct information on the ongoing event
Observations and progress tracking
This data source refers to utilizing record books or electronic record data
Program documentation
This evaluation measure assesses how a program is developed and implemented and can also investigate a program’s structures and operations
It also asks the following questions:
→ how is the program being implemented?
→ under what conditions does the program work?
→ is the intended population participating at expected levels?
→ can the program be replicated?
Process
This evaluation measure is a type of summative study that investigates whether the change occurs in a program and if it does, to what extent can the change be attributed to the program?
It also asks the following questions:
→ what is the impact of the program?
→ to what extent is the program meeting its intended goals and objectives?
Outcome
This refers to a change in attitude or feeling toward specific behavior; deals with mood, emotion, pleasure, and displeasure
Affective change
This refers to the adoption of new behaviors or lifestyles and change in interests such as increased frequency of exercise, healthier diets, reduced alcohol and smoking, etc.
Behavior change
This refers to the change wherein new knowledge and awareness is acquired
Learning change
This refers to change that reduces barriers toward healthier lifestyles (e.g. smoke-free policies, adoption towards clean air, increased plant biodiversity, pollution reduction, etc.)
Environmental conditions
This refers to change that improves health outcomes or indicators; it also refers to overall change: physical, mental, and social well-being, and has the goal for people to be free from illness or injury
Status change
This challenge is often difficult to determine if it is for long-term or short-term
Measuring outcomes
This challenge states that:
→ ultimate outcomes are not easily measurable
→ ultimate goals are usually for the prevention of the health concerns
→ positive results are not always guaranteed to happen in experiments—there could be errors or mistakes
Negative outcomes or those that “Did not happen”
This challenge states that there are other contributing factors to health evaluation: biological, genetic, environmental, socio-economic, education, employment, status, safety, etc.
Multifactorial nature of health issues
This challenge states that:
→ involvement of a lot of people means different goals and perspectives regarding health issues
→ coordination and collaboration is hard to accomplish
Diversity of sectors and stakeholders involved in program efforts
This challenge states that most programs are in combination in terms of the policy system, environment, and individual change, therefore the effectiveness of each is not easily measured
Determining the effectiveness of individual strategies
This challenge refers to remote areas pose a risk when it comes to geographical access (e.g. walking or traveling long distance, lack of transportation, and travel expenses)
Access challenges specific to rural communities
In this challenge, an example would be the demographic of minors who are dependent to their parents which means that permission is required in facilitating the evaluation process
Protected populations