Unit 9 M&E NGO Performance and Impact Flashcards
An NGO’s success can be measured in terms of…
- quality of its services
- the effectiveness and impact of its work
- its ability to sustain its work in line with its mission and objectives.
what is the tension field in M&E
M&E has two main functions:
- demonstrate accountability
- facilitate learning
What is monitoring?
- assessment of the progress over time
- check if things are going according to plan
- enables adjustments to improve project
- routine check of key elements
- record-keeping, reporting, surveillance systems
- a continuous process
- integral part of NGO management information system and feed into decision making processes
- focus on learning, but also for accountability
- Activities, outputs and the process is the focus
- internal
What is evaluation?
- Assessment of the change in targeted results that can be attributed to the project
- link particular output/outcome to intervention
- more summative
- accountability function dominates, also used for learning
- outcomes and impact is the focus
- external
- often ex-post evaluations
Barriers for M&E
- action oriented not reflection
- fear of failure
- cost and time involved
Development Assistance Committee (DAC) criteria to evaluations
- relevance
- effectiveness
- efficiency
- impact
- sustainability
two other types of evaluations
- reviews - a formative study carried out at one point in time during the implementation.
- impact assessment - systematic analysis of lastig or significant change - positive or negative, intended or not - in peoples lives
»> there is the challenge of attribution- difficulty in proving a clear link between the activity and the change
»> contribution analysis could address this
The Theory of Change approach involves analysis of the following areas of an intervention (4x)
- the context (social, political, environmental)
- the long term change the intervention seeks to achieve
- the processes necessary to the achievement of the desired change
- the critical assumptions relating to how the change might happen
The Logical Framework Approach (LFA)
a PME tool, 4x4 matrix
intervention, verifiable indicators, means of verification, assumptions/risks
- STUDY THE FIGURE AT PAGE 29!!
M&E participation of stakeholders
- can be seen as an end in itself - the right to have a voice in matters that affect your interests
- more instrumental - mobilize local knowledge and amake development efforts more relevan and effective.
Benefits:
- empowerment
- ownership
- accountability
- support replication and scaling up
necessary conditions to have succesful participatory approaches to evaluation in community based projects
- shared understanding among ALL about goal, objectives and methods
- willingness to allocate sufficient time/resources to the participatory M&E
- participatory approach to program management and learning (if that is top down, then participatory M&E will be challenging)
- reasonably open and egalitarian social structure
Challenges in participatory M&E (as recorded in Central asia by Adams and Garbutt (2008)
- lack of time in the planning process
- no opportunity to revise objectives
- lack of space for key programme stakeholders to be involved
- outcomes and impact to be measured by experts
Changing trends and practises in M&E
- focus on measuring complex change
- focus on the usage of the actual M&E information (learning)
- M&E needs to better support management and engage stakeholders in participatory learning processes
- a more unified language for M&E
6 steps of setting up a monitoring system
- establish purpose and scope
- identify performance questions, information needs & indicators
- plan info gathering and organisation
- plan critical reflection processes and events
- plan for quality communication and reporting
- plan for the necessary conditions and capacities
definition of an indicator (2x)
1) quantitative or qualitative factor/variable that provides a simple and reliable means to measure achievement, to reflect the changes connected to the intervention or to help assess the eprformance of a development actor
2) what things would make us feel we were making progress? how could we find out if these things were happening?