METR
Monitoring and Evaluation for Timely Responses
“Measuring the right things in the right way at the right time”
Briefing for Discussion at FEMA, IPB Dramaga
Wednesday 20th May 2015, v2
Documents also provided,
- METR two-page summary
- METR checklist
- METR team-building and project engagement
METR
 adds value to existing methodologies for M&E of development
projects
guided by project goals within wider development context
external
rapid project performance assessment (3-4 weeks)
World Bank (2004) Monitoring and Evaluation: Some Tools, Methods and Approaches, Section
14
extension of EuropeAID M&E
EuropeAid (2002) Project Cycle Handbook, Annex 5.3.3.
ex-post, midterm evaluation
METR Informs,
PROJECT IMPLEMENTERS
PROJECT DESIGNERS of donor agencies
PROJECT BENEFICIARIES / PARTNERS
POLICY MAKERS, directly or indirectly
Projects appropriate for METR
1)
2)
3)
4)
5)
6)
7)
Natural resource / environmental management
Fisheries, forestry, agroforestry, agriculture production and trade
Public health & education
Microfinance
Conflict resolution
Rehabilitation and Reconstruction after Natural/Human Disaster relief
Climate change adaptation
METR Team Resources to assess project interventions
 Science and Technology
 Economics
 Institutional Development
METR Emphasis
1.Impact-oriented, direct and proxy indicators
2.Clearly distinguishes between design and implementation
contribution to success/failure
3.Employs counterfactuals to assess attribution
4.Achieves understanding of the nature of the problem and its
solution ~ from Problem Tree to Program Logic
5.Follows objective yet appreciative inquiry
6.Assesses the crucial role of MUTUAL TRUST among key
stakeholders
7.Encourages Shared learning among not only project
beneficiaries/partners, implementers and donors but also policymakers
Five Guiding Questions about the Project
1. “Is there sufficient mutual trust among key stakeholders (ToT)?”
2. “What we thought we knew but experience taught us
otherwise?”
3. “Are lessons being learned and shared or just identified?”
4. “What was your best moment on the project?”
5. “What will happen on the first day after the last day of the
project?”
METR Report Structure covers
I. PROJECT DESIGN:
Understanding the nature of the problem ~ problem tree
Translating understanding into program logic ~ logical framework
II. PROJECT IMPLEMENTATION:
•
•
•
•
•
•
Efficiency of delivery of benefits
Effectiveness of outreach to targeted groups
Impact beyond set-up of projects with target groups
Sustainability beyond the project assistance lifetime (likelihood, if project still on-going)
Lessons Learned about unexpected outcomes of the project, good and bad
Recommendations for improvement addressed to donor provider
III. FEEDBACK: incorporating key stakeholder responses
Distinguishing
between
maximizing and
optimizing
productivity