Model for process evaluations of organizational-level interventions

Question 1

What are organizational level health interventions?

Answer 1

Planned, behavioral, science-based actions to remove or modify the causes of job demands

Question 2

Why are organizational level health interventions proactive?

Answer 2

They are proactive because they are focussed on reducing or eliminating the sources of job stress

Question 3

Why is there a need for process evaluations of organizational-level occupational health interventions (3)?

Answer 3

(1) Working mechanisms are unlikely to be separate from the systems within which they operate
(2) Changing complex systems requires wide-ranging multidimensional activities and diluted or disrupted intervention activities might not be intense enough to have an impact
(3) Evaluation models and methods are needed that can be used to identify how potential effects of interventions on health and well-being are moderated and mediated by the intervention process

Question 4

What is program failure in interventions?

Answer 4

The theory behind the intervention does not address the problem

Question 5

What is implementation failure in interventions?

Answer 5

The way the intervention was implemented was incomplete or poorly designed

Question 6

For what type of actions can you use process evaluations (4)?

Answer 6

(1) Providing feedback to improve intervention
(2) Replicate intervention in other settings minimizing associated pitfalls
(3) Interpret the outcomes of the intervention
(4) Conclude about generalizability, applicability and transferability of interventions

Question 7

What are the 3 groups of factors used in process evaluation of organization-level occupational health interventions?

Answer 7

1. Context
2. Intervention design and implementation
3. Mental models

Question 8

What are the aspects of the implementation of an intervention (4)

Answer 8

1. Did the intervention activities target the problems of the workplace
   (2) Did the intervention reach the target group
   (3) Who were the drivers of change
   (4) What kind of information was provided to participants during the study?

Question 9

Why is it PE on organization level occupational health interventions necessary (3)?

Answer 9

1. Evaluation of generalizability and transferability
2. Currently these type of interventions have been critiqued for lack of evidence, caused by little focus on process evaluation
3. Succes could have been negatively influenced by concurring changes

Question 10

What is an omnibus context?

Answer 10

How does the intervention fit in with the culture and conditions of the intervention group?

Question 11

What is a discrete context?

Answer 11

Which events took place during the intervention phase? (example; new project demands, conflicting priorities, multiple changes that are concurrent)

Question 12

What are participants mental models? (2)

Answer 12

1. What is participants’ readiness for change
2. What are perceptions of intervention activities?

Question 13

How do employees influence successful implementation of intervention?

Answer 13

(1) Participation in the decision making processes, improving satisfaction and successful implementation (participatory approach)

Question 14

How does senior management influence successful implementation of intervention? (2)

Answer 14

Senior management is involved in resource allocation
Senior management can serve as role models or can be actively involved

Question 15

How does middle management influence successful implementation of intervention?

Answer 15

Middle managers are subsequently responsible for communicating and implementing change

Question 16

How do consultants influence successful implementation of the intervention? (2)

Answer 16

(1) providing feedback on progress of change and group dynamics
(2) responsibilities for hand-over infrastructure and continuation of intervention after they leave

Question 17

What can you tell about information/communication about the intervention?

Answer 17

(1) Open communication helps employees to understand the intentions, thus improving commitment and participation

Question 18

Why is it important to collect data during the process and not only afterwards? (4)

Answer 18

(1) only afterwards may result in retrospective sense making
(2) Elements of the process may have changed over time
(3) Role of key stakeholders may have changed over time
(4) Participation may have changed over time

Question 19

Why is it important that employees participate in decision making on and design of organization level occupational health interventions? (3)

Answer 19

(1) Little formal educated employees require a more directive type of participation
(2) Employees act negatively to only having influence over parts of the intervention program
(3) Amount of participation is positively related to goal achievement and organizational commitment

Question 20

Draw the model used for process evaluation of organizational level interventions including it’s most important factors

Answer 20