Evaluation

Question 1

Define evaluation

Answer 1

the systematic collection of information about activities, characteristics and/or outcomes of programs to make judgements about the program, improve program effectiveness and/or inform decisions about programming.

Question 2

What are the steps in an evaluation (CDC)

Answer 2

1. Engage the stakeholders
2. Describe the program
3. Focus the design
4. Gather credible evidence
5. Justify conclusions
6. Report and disseminate findings

Question 3

How do you describe the program?

Answer 3

Review the aims and objectives

Is there program logic with pre-defined outputs or an existing evaluation framework e.g. in other states or territories

Question 4

How do you focus the evaluation design? (2)

Answer 4

1. Specify the design of the evaluation: process, impact or outcome
2. Specify data collection methods: quantitative, qualitative
3. Locate or develop data collection instruments

Question 5

Gather credible evidence to evaluate a screening program- what to consider (12)

Answer 5

1. Process indicators: was it implemented as planned? how were people recruited, how many etc.
2. Barriers and enablers to participation
3. Reach of the program
4. Effectiveness
5. Acceptability
6. Sensitivity, specificity, PPV, NPV
7. Number needed to screen
8. Consider biases (e.g. lead time, healthy screening effect)
9. Safety
10. Technology - best
11. Economic eval (cost benefit, cost effectiveness)
12. Capacity building and sustainability, how did it align with existing structures

Question 6

How do you justify the conclusions?

Answer 6

Synthesise findings and determine if it was succesful in reaching the goals and objectives. 
Make recommendations (e.g. continue as is or modify)