Health Promo Unit 5

Question 1

Evaluation definition

Answer 1

A study that is designed, conducted, and reported to assist a client group to judge/improve the worth/merit of some object of interest

Question 2

Worth

Answer 2

Whether or not the program is needed

Question 3

Merit

Answer 3

Whether or not the program is good

Question 4

Why evaluate?

Answer 4

Help planners:
Make decisions based on systematically collected data
Determine if objectives are met and program is being implemented properly
Figure out if changes need to be made along the way

Question 5

Two purposes of evaluation

Answer 5

Assessing and improving quality

Determining program effectiveness

Question 6

6 Reasons stakeholders want program evaluation

Answer 6

1. Determine achievements
2. Improve implementation
3. Increase community support
4. To contribute to scientific base
5. To provide accountability
6. To inform policy decisions

Question 7

Stakeholder’s questions

Answer 7

Planners: did program meet needs of pop’n?
Administrators: Did it make money?
Facilitators: Was there beh. change?
Funding agency: Cost effective?

Question 8

Threats to good evaluations

Answer 8

Fear of cuts (eval not good, won’t want any)
Political skewing
Getting hard data - always good/appropriate?
Political ramifications (finds that a drug abuse program serving poor, pregnant minority should be eliminated?)

Question 9

Stage: Initial planning

Answer 9

T.O.E. Needs assessment

Question 10

Stage: Development

Answer 10

T.O.E. Formative eval with market testing

Appraisal of promotional and delivery strategies before implementation

Question 11

Stage: Early implementation

Answer 11

T.O.E. Implementation eval

Extent to which program conforms to original plan

Question 12

Stage: Routine operation

Answer 12

T.O.E. Process eval

Appraisal of delivery and usage under normal operation

Question 13

Stage: Stable operation

Answer 13

T.O.E. Outcome eval
Appraisal of program’s impact on clients in relation to level of program participation
Determines whether program met goals and objectives
Must conduct at least a year after

Question 14

Retrospective Bias

Answer 14

Problem of memory

Question 15

Social desirability bias

Answer 15

Being biased in that you’re going to give researcher what they want to hear

Question 16

Assumptions

Answer 16

That clients may not have changed without the intervention

Question 17

Stage: Further planning

Answer 17

T.O.E. Periodic needs assessment

Question 18

Stage: Initial planning, development, stable operation

Answer 18

T.O.E. Cost analysis

Question 19

Steps in Evaluation

Answer 19

1. Get ready
2. Engage stakeholders
3. Assesses resources for eval
4. Design eval
5. Appropriate methods of measurement
6. Develop timeline and budget
7. Data collection
8. Analysis
9. Interpretation of results
10. Take action

Question 20

Process evaluation

Answer 20

Assesses the implementation process in general, what went well/poorly

Question 21

Evaluation approaches

Answer 21

Formative, process, and summative evaluations

Question 22

Evaluation designs

Answer 22

relates specifically to summative eval

Question 23

Cost identification analysis

Answer 23

Determine which intervention would be the least expensive

Question 24

Cost benefit analysis

Answer 24

Dollar benefit received from the dollars invested in a program

Question 25

Cost effective analysis

Answer 25

How much it will cost to produce a certain effect

Question 26

Consumer orientation

Answer 26

Degree to which programs are adapted to the needs of the pop’n

Question 27

Accountability

Answer 27

Ensures that each partner organization performs its work as arranged

Question 28

Steps in selecting an Evaluation design

Answer 28

1. Orientation to situation
2. Defining the problem
3. Basic design decision
4. Plans for measurement, data collection, analysis, and reporting of results