Policy Evaluation

Question 1

Policy Evaluation is…

Answer 1

the last step of the policy cycle concerned in measuring legal frameworks and societal acceptance of the policy implemented

Question 2

Policy Evaluation
3 main questions (GPL)

Answer 2

1. goal achievement: did the policy work?
2. policy impact: was it successful?
3. legal framework: did it have enough support?

Question 3

Types of Policy Evaluation (6)

Answer 3

Ex-post: evaluation after policy implementation
Ex-ante: evaluation before policy implementation
Input Evaluation: resource evaluation (enough resources)
Throughput Evaluation: evaluate stakeholder engagement (did they know what and how to do it)
Output Evaluation: evaluate the extent of the goals achieved
Outcome Evaluation: evaluate the possible side effects

Question 4

Why carrying policy evaluation?
(FALAL)

Answer 4

1. Fact Finding
2. Accountability
3. Legitimacy
4. Attention
5. Learning

Question 5

Policy Evaluation
Rational Perspective
how does evaluate? (3)

Answer 5

1. Effectiveness: goal achievement
2. Efficiency: cost-benefit analysis
3. Consistency & Coherency: policy is CC over time
   - Internal CC: actors being coherent & engaged
   - External CC: policy alignment

Question 6

Policy Evaluation
Rational Perspective
who is the evaluator?
what he/she evaluates?(4) (CUIO)

Answer 6

The evaluator must be an external actor (researcher) who objectively evaluates the impact of the policy
1. Causality
2. (Un) Intended Effects
3. Incubation Time (political impatience)
4. Objectivity: value-free
(take into account Performance Paradox)

Question 7

Policy Evaluation
Political Perspective
what is evaluation based on?

Answer 7

evaluation is based on political interests to achieve support from other parties in order to achieve political feasibility

Question 8

Policy Evaluation
Political Perspective
who is the evaluator?

Answer 8

the evaluation can be an internal or external actor assuming while measuring that the evaluation process is one more step in the agenda to achieve political power and support

Question 9

Policy Evaluation
Political Perspective
types of evaluation (2)

Answer 9

Policy of Evaluation: is a type of evaluation based on normative statements by taking into account the evaluator’s position and status
Network Analysis: evaluate and take into account multiple stakeholders involved and their interests

Question 10

Policy Evaluation
Cultural Perspective
main assumptions

Answer 10

it evaluated based on problem and policy framing by considering personal stories and whether the policy has led to social shifts (interpretative approach)

Question 11

Policy Evaluation
Cultural Perspective
who is the evaluator

Answer 11

internal and external evaluators by measuring the extent to which the policy has achieved the goals based on a holistic approach to decode frames/interpretations

Question 12

Policy Evaluation
Cultural Perspective
frame reflection

Answer 12

a type of evaluation carried out to balance different evaluations and test whether the dominant view of the policy should be trusted, thus
evaluate policy based on its effectiveness & discrepancy

Question 13

Policy Evaluation
Institutional Perspective
who is the evaluator?
type of evaluation: Multiple Stakeholders Evaluation

Answer 13

is an internal actor carrying in-house evaluation based on institutional structures

Different actors, who are part of the institution, evaluate the policy in-house

Question 14

Policy Evaluation
Institutional Perspective
4 main questions (ELLS)

Answer 14

1. effectiveness: did it work?
2. legality: was it allowed?
3. legitimacy: was it appropriate?
4. support: was it applicable

Question 15

Policy Evaluation
Institutional Perspective
Multicultural Policy

Answer 15

consider whether the policy fits in the institutional context, but take into account if impartial evaluations can be carried out

Question 16

Policy Evaluation
Rational Perspective
Multicultural Policy

Answer 16

consider whether the policy focuses on integration outcomes
(lack of transparency)

Question 17

Policy Evaluation
Political Perspective
Multicultural Policy

Answer 17

consider whether the policy focuses on shifting the public mood and support

Question 18

Policy Evaluation
Cultural Perspective
Multicultural Policy

Answer 18

consider whether the policy provides accessible information to everyone to prevent group marginalisation (vs powerful groups)

Question 19

Models of Research Policy Relations
Englightment

Answer 19

Primacy of Research: Researcher
Role Differentiation: sharp boundaries

Question 20

Models of Research Policy Relations
Technocracy

Answer 20

Primacy of Research: Researcher
Role Differentiation: diffused boundaries

Question 21

Models of Research Policy Relations
Bureaucracy

Answer 21

Primacy of Research: Policymaker
Role Differentiation: sharp boundaries

Question 22

Models of Research Policy Relations
Engineering

Answer 22

Primacy of Research: Policymaker
Role Differentiation: diffused boundaries

Question 23

What does Fischer’s Multilayer Evaluation Approach argues?

Answer 23

evaluation is done in a changing society (leading to risk society) due to knowledge uncertainty and politicisation

Question 24

Fischer’s Multilayer Evaluation
Stages (4) (PISS)

Answer 24

1. programme verification: did it work?
2. situational validation: did it solve the problem?
3. societal vindication: did it contribute to society?
4. ideological choice: was it important/the right thing to do?

Question 25

Knowledge Utilisation focuses on…

Answer 25

on the way knowledge is used to evaluate policies
every evaluation provides new insights

Question 26

Knowledge Dissemination

Answer 26

open knowledge by sharing reports and findings

Question 27

Knowledge Utilisation
1. Instrumental
2. Symbolic

Answer 27

use the knowledge to go back to policy design)
1. build on or make new policies
2. use scientific knowledge to substantiate policies

Question 28

Non Utilisation

Answer 28

unavoidable knowledge use

Question 29

Evaluation & Accountability
3 premises

Answer 29

1. accountability objectifies policy input, output and outcome
2. accountability has legal & political implications: evaluation must be independent for it to be legitimate
3. establish commissions to promote accountability

Question 30

Passive Responsibility

Answer 30

ex post responsibility; being responsible as a consequence of the policy

Question 31

Active Responsibility

Answer 31

ex ante responsibility; taking actions to prevent situations

Question 32

Forms of Responsibility (5)

Answer 32

1. as a Cause
2. as a Virtue
3. as a Task
4. as Liability
5. as Capacity