5c Evaluation

Question 1

What is “structure”?

Answer 1

Organizational chart, number of beds/clients, committees

Question 2

What is “process”?

Answer 2

Communication mechanisms, allocation criteria, conform with policy

Question 3

What is “outcome”?

Answer 3

Impact on target group

Question 4

Who is involved in external assessment?

Answer 4

Patient/family/representatives
Advocates: Child & Family, Seniors, Informal
Rights and Decision Making
Peers - Accreditation Canada
Safety, etc :WCB, Elevators
Regulatory: Licensing, Pharmacy
Planning bodies, Academics
Public

Question 5

Who assesses rights and decision making?

Answer 5

Medical Appeal Board, Ombudsperson, Info & Privacy Commissioner, Review Panel

Question 6

What are three aspects of the health care system that are assessed (evaluated for outcomes)?

Answer 6

Structure
Process
Outcome

Question 7

What are four measures of economic evaluation?

Answer 7

Cost - minimization
Cost - benefit
Cost - effectiveness
Cost - utility

Question 8

What is cost - minimization?

Answer 8

Same outcome, different approaches, less $

Question 9

What is cost - benefit?

Answer 9

Outcomes quantifiable in terms of $

Question 10

What is cost - effectiveness?

Answer 10

Outcomes not quantifiable in terms of $

Question 11

What is cost - utility?

Answer 11

Utility measure (subjective)

Question 12

What is formative evaluation?

Answer 12

Formative evaluations focus on programs that are under development. It is used in
the planning stages of a program to ensure the program is developed based on stakeholders needs and that programs are using effective and appropriate materials and procedures.

Question 13

What is process evaluation?

Answer 13

Process evaluations focus on programs that are already underway. It examines the procedures and tasks involved in providing a program. It seeks to answer the question, “What services are actually being delivered and to whom?”

Question 14

What is summative evaluation?

Answer 14

Summative evaluations focus on programs that are already underway or completed. It investigates the effects of the program, both intended and unintended. It seeks to answer the questions “Did the program make a difference?”(impact evaluation)
and “Did the program meet its stated goals and objectives?”(outcome evaluation).

Question 15

What are three types of evaluation?

Answer 15

Formative
Process
Summative

Question 16

What are necessities for evaluation process?

Answer 16

Objectives
Inputs
Outcome

Question 17

What are five characteristics of objectives?

Answer 17

SMART acronym
Specific - X will achieve Y
Measurable - X will achieve Z units of Y
Attainable
Realistic
Timely

Question 18

What are objectives?

Answer 18

What is the intended outcome, what is the problem we are trying to address?

Question 19

What are inputs?

Answer 19

What measure? What source of data? What challenges in collection?

Question 20

What are outcomes?

Answer 20

What measure? What source of data? What challenges in connection?

Question 21

What are six questions to be asked when finding solutions?

Answer 21

1. Is there a problem? (How do we know? What data, from where?)
2. What is the intended effect of the proposed solution?
3. Who should lead on acting on this issue?
4. What’s the objective/desired outcome?
5. How can it be measured?
6. Type of inputs, types of benefits - (how can we measure - what data, from where?)