Lecture Evaluation

Question 1

Evaluation basics

Answer 1

“Systemic and objective assessment of an on-going
or completed policy, program or project focusing on
its design, implementation and results.”

Question 2

Aim and purpose of evaluation

Answer 2

• To determine the relevance and results of policies, programs and projects
• incorporation of lessons
• To provide a basis for accountability to the public

Question 3

four dimensions of Results

Answer 3

 Effectiveness: the extent to which objectives are reached;

 Efficiency: how are resources converted into results;

 Impact: what are the broad (societal) effects of the intervention;

 Sustainability: do benefits continue after external assistance has ended

Question 4

Stakeholders may try to influence:

Answer 4

• Evaluation programming
• Content of the Terms of Reference
• Review of evaluation findings
• Attack independence of the evaluators & methods

Question 5

RANDOMISED CONTROL TRIALS (RCT’S)

Answer 5

• The Randomistas generate data on development effects
• External validity
  
  • If the results are different, ex-post analysis is speculative
• Often short term studies

Question 6

PROBLEMS in evaluation

Answer 6

• Simple models risk overstating causal contribution
• More likely to represent a single theory of change
• Anxiety provoked by uncertainty and ambiguity can lead managers and evaluators to seek the reassurance of a simple logic model

Question 7

Complexity science

Answer 7

• Theory transfer
  
  • Structural representation / surrogate reasoning
• Holistic / systems theory
• Two approaches for social
  scientists
• Main themes: non-linearity/
  emergence / far-from equilibrium

Question 8

Different Logic models (plus examples)

Answer 8

simple logic model (recipie)
complicated logic model (rocket to the moon)
complex logic model (raising a child)