Evaluating Health Education March 17

Question 1

Five types of evaluation in order

Answer 1

Process/formatative 
Content
Outcome/summatative
Impact
Total

Question 2

Formatative definition

What is monitored on an ongoing basis

Answer 2

• making changes during or right after teaching

- teaching effectiveness, learner response, the elements of the education process

Question 3

Content evaluation and example (2)

Answer 3

• short term, immediate effects
• pre and post test
• evaluating a return demonstration of a skill prior to discharge

Question 4

Summative

• example
• questions to be assessed (acronym)

Answer 4

• long term
• evaluating competency after discharge at home
• PICO - Population, intervention, comparison outcome - does nurse-directed patient education on symptoms and related to treatment for heart failure provided to the adult outpatients with heart failure result in improved compliance with treatment regimens?

Question 5

Impact evaluation

Answer 5

Cos-benefit analysis

Question 6

Total program

Example

Answer 6

• evaluates if all activities in a program over a specific period of time meets the goals originally established
• how well did pt. education activities implemented throughout the year meet annual goals established for this institution

Question 7

Barriers to evaluation (3)

Answer 7

Lack of clarity - evaluation is difficult if purpose and what will be done with results is unknown
Lack of ability - lack of knowledge or sources ie. Lack of knowledge about evaluation techniques
Fear of punishment or loss of self-esteem - evaluation seen as how well pt. has learned and how well nurse has taught

Question 8

What is a pre-post test method

Answer 8

• both groups are pre-tested and post-tested, difference is one group is administered an intervention

Question 9

What is experimental method

Answer 9

Manipulation (subject), randomization and control

Question 10

Quasi-experimental

Answer 10

Looks like experimental but lacks randomization

Question 11

Reliability as a measurement

And example

Answer 11

• measurement is consistent

- use a scale to weigh potato, weight is the same every time

Question 12

Validity as a measurement and example

Answer 12

• the accuracy of an assessment

- just because a measurement is reliable, does not mean it’s valid

Question 13

Obesity prevention program

• participants
• program
• process evaluation
• outcome eval

Answer 13

• underserved adolescents girls
  Program
• 4 week program, activities chosen by children, discussion includes promoting physical activity in peers and coping with barriers to physical activity
  Process
• attendance
• percentage of sessions –> behaviour and motivational skills, incorporated friends in activities
  Outcome
• changes in physical activity –> observed and thru self report

Question 14

CVD Risk Reduction Program

• participants
• program
• process evaluation (2)
• outcome evaluation

Answer 14

• rural women with cardiac risk factors
• program - community health advisors led counselling
  Process
• pre and post questionnaire –> knowledge about manual and efficacy expectations in changing patient’s behaviours
• feedback to project coordinators
  Outcome
• prior interview vs telephone call 1 month later
• retention and changes in behaviour