Evaluation

Question 1

Evaluation

Answer 1

Describing the object of interest so its worth and merit can be judged

Question 2

Worth

Answer 2

Whether or not a program is needed

Question 3

Merit

Answer 3

Whether or not a program is good

Question 4

5 things that evaluations help planners with

Answer 4

Make decisions based on systematically collected info
See if goals and objectives have been met
See if it is being implemented as intended
See if changes need to be made along the way
Develop cost effective strategies

Question 5

2 critical purposes of evaluation

Answer 5

Assessing and improving quality

Determining program effectiveness

Question 6

6 reasons stakeholders want evaluation

Answer 6

Determine achievement of objectives
Improve implementation
Make people accountable for their roles
Raise community support
Add to scientific knowledge and literature
Inform policy decisions

Question 7

When should the evaluation begin

Answer 7

When goals and objectives are developed

Question 8

Who does the evaluation

Answer 8

Collaborative effort among stakeholders

Question 9

5 threats to good evaluations

Answer 9

Fear of cuts if results arent good
Political skewing
Not reporting appropriate data
Political ramifications of truthful events
Implications for agencies

Question 10

Evaluation during initial plannin

Answer 10

Needs assessment with market evaluation

Question 11

Evaluation during development

Answer 11

Formative evaluation with market testing

Question 12

Formative evaluation

Answer 12

Save money by figuring out what people will actually use

Question 13

Evaluation during early implementation

Answer 13

Implementation evaluation

Question 14

Implementation evaluation

Answer 14

Extent to which program conforms to original plan

Question 15

Evaluation during routine operation

Answer 15

Process evaluation

Question 16

Process evaluation

Answer 16

Appraisal of program delivery and usage under normal operation

Question 17

Evaluation during stable operation

Answer 17

Outcome evaluation

Question 18

Outcome evaluation

Answer 18

Appraisal of impact on clients in relation to level of participation and baseline characteristics to see if long term objectives were met

Question 19

10 steps in evaluation

Answer 19

Clarify your program
Engage stakeholders
Assess resources
Design evaluation
Determine methods of measurement and procedures
Develop workplan, budget and timeline
Data collection
Data analysis
Interpret results
Take action

Question 20

3 issues with asking participants if they benefited from the program

Answer 20

Retrospective reporting bias
Assumption that change could only occur with intervention
Social desirability bias

Question 21

Standards of accesibility

Answer 21

Minimum levels of effectiveness and benefits used to judge value

Question 22

Formative Evaluation

Answer 22

Relates quality assessment and program improvement

Question 23

Summative Evaluation

Answer 23

Determining effectiveness

Question 24

Difference between formative and process evaluation

Answer 24

Formative focuses on improving quality during implementation while process measures degree to which program was successfully implemented

Question 25

2 parts of summative evaluation

Answer 25

Impact evaluation | Outcome evaluation

Question 26

Impact evaluation

Answer 26

Focus on intermediary measures such as change in behaviour or attitude

Question 27

6 steps in CDC framework

Answer 27

``` Engage stakeholders Describe program Focus evaluation design Gather credible evidence Justify conclusions Ensuring use and sharing lessons ```

Question 28

4 CDC standards of evaluation

Answer 28

Utility- information needs of users are satisfied Feasability- Realistic and affordable Propriety- Ethical Accuracy

Question 29

Baseline data

Answer 29

Reflecting initial status of population

Question 30

Designs

Answer 30

Summative evaluation

Question 31

Focus of formative evaulations

Answer 31

Quality of program content and implementation

Question 32

When does formative evaluation occur

Answer 32

From inception of program through implementation

Question 33

Cost identification analysis

Answer 33

Compare different interventions available for a program

Question 34

Cost effectiveness analysis

Answer 34

Quantify effects of a program in monetary terms

Question 35

Multiplicity

Answer 35

Multiple component programs cater more effectively to varied needs

Question 36

Adjustment

Answer 36

Planners make necessary changes based on feedback

Question 37

6 components of process evaluation

Answer 37

``` Fidelity Dose Recruitment Reach Response Context ```

Question 38

Fidelity

Answer 38

Programs are implemented as intended

Question 39

Dose

Answer 39

Number of program units delivered

Question 40

Recruitment

Answer 40

Degree that population is recruited for participation

Question 41

Reach

Answer 41

Proportion of population given opportunity to participate

Question 42

Response

Answer 42

Proportion of the population actually participating

Question 43

Context

Answer 43

External factors that may influence results

Question 44

Pre testing

Answer 44

Testing components of a program and collecting baseline data

Question 45

Quantitative method

Answer 45

Deductive in nature and produces numeric data

Question 46

Qualitative method

Answer 46

Inductive model produces narrative data

Question 47

Mcleroy model 1

Answer 47

Qualitative methods are used to help develop quantitative methods

Question 48

Mcleroy model 2

Answer 48

Qualitative results are used to help interpret a quantitative evaluation

Question 49

Mcleroy model 3

Answer 49

Quantitative results are used to help interpret qualitative results

Question 50

Mcleroy model 4

Answer 50

Qualitative and quantitative are used equally

Question 51

Posttest

Answer 51

Measurement after completion of the program

Question 52

Quasi experimental design

Answer 52

Interpretable and supportive evidence of program effectiveness but can not control confounding factors

Question 53

Non experimental design

Answer 53

Does not use comparison or control groups an has little control over confounding factors

Question 54

Internal validity

Answer 54

Degree to which change that was measured can be attributed to the program

Question 55

External validity

Answer 55

Extent to which program can be expected to produce similar effects in other populations