Policy Evaluation Flashcards

1
Q

Policy Evaluation is…

A

the last step of the policy cycle concerned in measuring legal frameworks and societal acceptance of the policy implemented

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Policy Evaluation
3 main questions (GPL)

A
  1. goal achievement: did the policy work?
  2. policy impact: was it successful?
  3. legal framework: did it have enough support?
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Types of Policy Evaluation (6)

A

Ex-post: evaluation after policy implementation
Ex-ante: evaluation before policy implementation
Input Evaluation: resource evaluation (enough resources)
Throughput Evaluation: evaluate stakeholder engagement (did they know what and how to do it)
Output Evaluation: evaluate the extent of the goals achieved
Outcome Evaluation: evaluate the possible side effects

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Why carrying policy evaluation?
(FALAL)

A
  1. Fact Finding
  2. Accountability
  3. Legitimacy
  4. Attention
  5. Learning
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Policy Evaluation
Rational Perspective
how does evaluate? (3)

A
  1. Effectiveness: goal achievement
  2. Efficiency: cost-benefit analysis
  3. Consistency & Coherency: policy is CC over time
    - Internal CC: actors being coherent & engaged
    - External CC: policy alignment
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Policy Evaluation
Rational Perspective
who is the evaluator?
what he/she evaluates?(4) (CUIO)

A

The evaluator must be an external actor (researcher) who objectively evaluates the impact of the policy
1. Causality
2. (Un) Intended Effects
3. Incubation Time (political impatience)
4. Objectivity: value-free
(take into account Performance Paradox)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Policy Evaluation
Political Perspective
what is evaluation based on?

A

evaluation is based on political interests to achieve support from other parties in order to achieve political feasibility

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Policy Evaluation
Political Perspective
who is the evaluator?

A

the evaluation can be an internal or external actor assuming while measuring that the evaluation process is one more step in the agenda to achieve political power and support

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Policy Evaluation
Political Perspective
types of evaluation (2)

A

Policy of Evaluation: is a type of evaluation based on normative statements by taking into account the evaluator’s position and status
Network Analysis: evaluate and take into account multiple stakeholders involved and their interests

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Policy Evaluation
Cultural Perspective
main assumptions

A

it evaluated based on problem and policy framing by considering personal stories and whether the policy has led to social shifts (interpretative approach)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Policy Evaluation
Cultural Perspective
who is the evaluator

A

internal and external evaluators by measuring the extent to which the policy has achieved the goals based on a holistic approach to decode frames/interpretations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Policy Evaluation
Cultural Perspective
frame reflection

A

a type of evaluation carried out to balance different evaluations and test whether the dominant view of the policy should be trusted, thus
evaluate policy based on its effectiveness & discrepancy

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

Policy Evaluation
Institutional Perspective
who is the evaluator?
type of evaluation: Multiple Stakeholders Evaluation

A

is an internal actor carrying in-house evaluation based on institutional structures

Different actors, who are part of the institution, evaluate the policy in-house

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Policy Evaluation
Institutional Perspective
4 main questions (ELLS)

A
  1. effectiveness: did it work?
  2. legality: was it allowed?
  3. legitimacy: was it appropriate?
  4. support: was it applicable
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Policy Evaluation
Institutional Perspective
Multicultural Policy

A

consider whether the policy fits in the institutional context, but take into account if impartial evaluations can be carried out

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Policy Evaluation
Rational Perspective
Multicultural Policy

A

consider whether the policy focuses on integration outcomes
(lack of transparency)

17
Q

Policy Evaluation
Political Perspective
Multicultural Policy

A

consider whether the policy focuses on shifting the public mood and support

18
Q

Policy Evaluation
Cultural Perspective
Multicultural Policy

A

consider whether the policy provides accessible information to everyone to prevent group marginalisation (vs powerful groups)

19
Q

Models of Research Policy Relations
Englightment

A

Primacy of Research: Researcher
Role Differentiation: sharp boundaries

20
Q

Models of Research Policy Relations
Technocracy

A

Primacy of Research: Researcher
Role Differentiation: diffused boundaries

21
Q

Models of Research Policy Relations
Bureaucracy

A

Primacy of Research: Policymaker
Role Differentiation: sharp boundaries

22
Q

Models of Research Policy Relations
Engineering

A

Primacy of Research: Policymaker
Role Differentiation: diffused boundaries

23
Q

What does Fischer’s Multilayer Evaluation Approach argues?

A

evaluation is done in a changing society (leading to risk society) due to knowledge uncertainty and politicisation

24
Q

Fischer’s Multilayer Evaluation
Stages (4) (PISS)

A
  1. programme verification: did it work?
  2. situational validation: did it solve the problem?
  3. societal vindication: did it contribute to society?
  4. ideological choice: was it important/the right thing to do?
25
Q

Knowledge Utilisation focuses on…

A

on the way knowledge is used to evaluate policies
every evaluation provides new insights

26
Q

Knowledge Dissemination

A

open knowledge by sharing reports and findings

27
Q

Knowledge Utilisation
1. Instrumental
2. Symbolic

A

use the knowledge to go back to policy design)
1. build on or make new policies
2. use scientific knowledge to substantiate policies

28
Q

Non Utilisation

A

unavoidable knowledge use

29
Q

Evaluation & Accountability
3 premises

A
  1. accountability objectifies policy input, output and outcome
  2. accountability has legal & political implications: evaluation must be independent for it to be legitimate
  3. establish commissions to promote accountability
30
Q

Passive Responsibility

A

ex post responsibility; being responsible as a consequence of the policy

31
Q

Active Responsibility

A

ex ante responsibility; taking actions to prevent situations

32
Q

Forms of Responsibility (5)

A
  1. as a Cause
  2. as a Virtue
  3. as a Task
  4. as Liability
  5. as Capacity