Evaluation Flashcards
Evaluation
Describing the object of interest so its worth and merit can be judged
Worth
Whether or not a program is needed
Merit
Whether or not a program is good
5 things that evaluations help planners with
Make decisions based on systematically collected info
See if goals and objectives have been met
See if it is being implemented as intended
See if changes need to be made along the way
Develop cost effective strategies
2 critical purposes of evaluation
Assessing and improving quality
Determining program effectiveness
6 reasons stakeholders want evaluation
Determine achievement of objectives Improve implementation Make people accountable for their roles Raise community support Add to scientific knowledge and literature Inform policy decisions
When should the evaluation begin
When goals and objectives are developed
Who does the evaluation
Collaborative effort among stakeholders
5 threats to good evaluations
Fear of cuts if results arent good Political skewing Not reporting appropriate data Political ramifications of truthful events Implications for agencies
Evaluation during initial plannin
Needs assessment with market evaluation
Evaluation during development
Formative evaluation with market testing
Formative evaluation
Save money by figuring out what people will actually use
Evaluation during early implementation
Implementation evaluation
Implementation evaluation
Extent to which program conforms to original plan
Evaluation during routine operation
Process evaluation
Process evaluation
Appraisal of program delivery and usage under normal operation
Evaluation during stable operation
Outcome evaluation
Outcome evaluation
Appraisal of impact on clients in relation to level of participation and baseline characteristics to see if long term objectives were met
10 steps in evaluation
Clarify your program Engage stakeholders Assess resources Design evaluation Determine methods of measurement and procedures Develop workplan, budget and timeline Data collection Data analysis Interpret results Take action
3 issues with asking participants if they benefited from the program
Retrospective reporting bias
Assumption that change could only occur with intervention
Social desirability bias
Standards of accesibility
Minimum levels of effectiveness and benefits used to judge value
Formative Evaluation
Relates quality assessment and program improvement