Lecture 6 (Oct 3)

Question 1

The Black Box Problem

Answer 1

Often (despite evidence) not details re: how
policy effect is intended to occur
* e.g. Nutrition labelling as obesity policy
response – but what are the mechanisms of
action?
* They are NOT the intervention per se, but the
response(s) the intervention generates

Question 2

What is a logic model?

Answer 2

“A logic model represents the chain of expected
effects that link a public policy to a health
problem it aims to solve. It goes beyond the
question “Does it work?” to gain a better
understanding of how it works, i.e., how the policy being studied is meant to operate.”

Question 3

What is a logic model?

Answer 3

• “Theory of change”
• Visual re: how a program is structured that shows:
  ▪ planned work and your intended results
  ▪ The rationale behind the program’s service delivery approach (i.e.,
  its goals)
  ▪ The key elements of a program (i.e., its activities and resources)
  and expected outcomes and how they can be measured
• The cause-and-effect relationships between the
  program and its intended results.
• Helps to identify the core elements of an evaluation
  strategy

Question 4

What does a basic program logic model look like? In Forward logic model (you can work backwards)

Answer 4

Evaluation
Inputs
Activities
Outputs
Short-term outcomes
intermediate outcomes
Long term outcomes
—- Feedback loop
Contextual Conditions

Question 5

Certain resources are needed to operate your program

Answer 5

Resources (inputs)

Question 6

If you have access to to them, then you can use them to accomplish your planned

Answer 6

activities

Question 7

In practice we often use both _____ and _____ logic models

Answer 7

Forward and backward

Question 8

If you accomplish your planned activities, then you will hopefully deliver the amount of product and or service that you intended

Answer 8

Outputs

Question 9

If you accomplish your planned activities to the extent you intended, then your participants will benefit in certain ways

Answer 9

Outcomes

Question 10

If these benefits to participants are acheived, then certain changes in organization, communities, or systems might be expected to occur

Answer 10

Impact

Question 11

Integration of evidence international factors

Answer 11

Globalization of markets
Industrialization
Media programs and marketing

Question 12

National/ regional factors involved in the integration of evidence

Answer 12

Education policies
Transportation policies
Urban Planning policies
Health-care policies
Food policies
Family policies
Cultural policies
Economic policies

Question 13

Community/locality factors

Answer 13

Public transportation
Public Safety
Urban Planning
Availability and accessibility of food
media and marketing
Income

Question 14

Individual factors

Answer 14

Employment
travel Leisure
Sports
Food
Body image
Genetics
Energy expenditure
Food intake

Question 15

Population factors

Answer 15

Prevalence of weight-related problems : Obesity and excessive weight preoccupation

Question 16

Inputs

Answer 16

Processes, techniques, tools, events,
technology, and actions of the planned program

Question 17

Activities

Answer 17

Processes, techniques, tools, events,
technology, and actions of the planned
program.
– Products – promotional and educational material
– Services – education and training, counseling, or
health screening
– Infrastructure – structure, relationships, and
capacity used to bring about the desired results.

Question 18

Contextual Conditions (or mediators)

Answer 18

• Resources and/or barriers, which potentially
  enable or limit program effectiveness.
• Protective factors or resources may include
  funding, partners, staff, time, etc.
• Limiting risk factors or barriers include such
  things as attitudes, lack of resources, policies,
  laws, regulations, and geography

Question 19

Outputs

Answer 19

• direct results of program activities
• size and/or scope of the services and products
  delivered or produced by the program.
• delivered to the intended audiences at the
  intended “dose?”
• e.g. number of classes taught, meetings held,
  materials produced and distributed, program
  participation rates and demography.

Question 20

Outcomes/ Impacts

Answer 20

• specific changes in attitudes, behaviors,
  knowledge, skills, status, or level of
  functioning
• organizational, community, and/or system
  level changes expected to result from program
  activities
  – improved conditions, increased capacity, and/or
  changes in the policy arena.

Question 21

Backwards logic

Answer 21

• Start with desired outcomes and work
  backwards from there to develop activities
  and inputs

Question 22

Forward logic:

Answer 22

• Start by identifying inputs and activities
• Move forward by asking “why” of each stage
  in the logic model (i.e. “if – then”)

Question 23

Benefits of logic models?

Answer 23

• Stakeholder understanding of purpose, resources,
  activities and ability to effect change
• Reference point
• Used for monitoring progress
• Identifying/prioritizing questions to ask in
  evaluation
• Identifying external factors that can facilitate or
  hinder a program
• Integrate planning and evaluation
• Articulate causal links

Question 24

Are resources adequate to implement program to implement program is

Answer 24

inputs

Question 25

Is program implemented as planned?

Answer 25

Activities

Question 26

How many, how much was produced? Is an indicator of the

Answer 26

Outputs

Question 27

Change in knowledge, policy, environment?

Answer 27

Short-term outcomes

Question 28

Change in system behaviour? Is an indicator of

Answer 28

Intermediate Outcomes

Question 29

Change in health status? Is an indicator of

Answer 29

Long term outcomes

Question 30

Change in population health status? is an indicator of

Answer 30

Impacts