3rd Results- Based M&E Workshop
3rd APCoP-MfDR
Results-Based M&E Workshop
Session 1
Finalizing the M&E Capacity Gaps on the Four Attributes covered
during the 2nd Workshop
Ballroom 1
Intercontinental Hotel
Phnom Penh, Cambodia
28-30 June 2011
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
1
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
2
Summary of 2nd M&E Workshop
Objectives: Institutionalizing M&E System
To assess the level of
understanding of MfDR
and M&E
To determine the gaps
in institutionalizing
M&E System
To identify Capacity Building
Strategies in institutionalizing
M&E System
Shared Knowledge-Resources
In RDMs
Plenary
Sessions
MfDR and M&E: Relational Function
Institutionalizing M&E System in
Country Settings
Briefers on
Core Attributes of M&E System
Break Out
Sessions
Identified
capacity gaps in
delivering M&E
functions
RDM Panel
Presentations
Capacity
Development Needs
M&E System by RDMs
Harmonized Capacity Building Strategies
for Institutionalized M&E System
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Complementary Roles of Results-Based Monitoring and Evaluation
2nd Results- Based M&E Workshop
Monitoring
Evaluation



Clarifies programme
objectives


Routinely collects data on
these indicators, compares
actual results with targets
Links activities and their
resources to objectives
Translates objectives into
performance indicators
and set targets
Reports progress to
managers and alerts them
to problems





Analyses why intended results
were or were not achieved
Assesses specific causal
contributions of activities to
results
Examines implementation
process
Explores unintended results
Provides lessons, highlights
significant accomplishment or
program potential, and offers
recommendations for improvement
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
4
With reference to APCOP MfDR Framework
Attributes of Results-Based Monitoring and Evaluation
Monitoring




2nd Results- Based M&E Workshop
Evaluation
Indicators from planning
Institutional
responsibilities defined
Data Management Systems
specified (Data encoding,
programming, processing and
reporting)
Analysis and reporting
specified




Methodology formulated or
designed
Institutional responsibilities
defined
Results dessiminated or shared
Stakeholders engagement
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
5
Level of Results
Impact
Outcome
Outputs
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
6
MfDR in Rural Development Workshop
6/7 December 2010
M&E System Defined
A paper or computer-based tracking
mechanism which is indicator-driven,
outcome-led and impact-based derived
from developed results of any specified
intervention strategy, capturing
changes contributing to the
effectiveness and efficiency of any
program development initiatives and
setting.
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
M&E System and Capacity Building Framework
3.
Results-Based
Management Logframe
1.
Project Goals, Purposes,
Objectives, and Specific
Objectives
Results
5.
Data Management : Data
Collection, Encoding and
Programming Information
Processing and Analysis
7.
Interim Evaluation:
Formative or
Summative
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
M&E System
Summary of the 2nd Workshop
Key Results
Capacity
develop
ment
gaps
identified
Covered
Four Core
Attributes
in M&E
Across RDMs,
Identified
Indicators
Database
Tools and Forms the Capacity Management
Database
needs a
Gaps by
Management
comprehensive
RDMs
Institutional
capacity plan
Responsibilities
Refine
the
Capacity
Development
Actions
Discussion on the capacity development actions
for each gap identified
Participants (27): MAFF, MRD, MOWRAM, MOP and ADB
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
9
7/28/2017
Institutionalizing M&E System in Cambodia
•The capacity gaps in delivering M&E system
were identified
•The attributes of M&E to the results-based
public sector management framework were
linked.
•The conduct of the workshop was effective,
timely and relevant to the need of the
ministries.
Participants’
Feedback
•The sessions facilitated their learning in
appreciating MfDR, Results-Based Public
Sector Management (RBPSM) and M&E
•The changes of their management in the
respective ministries should be encouraged
towards adopting the use of M&E system
specifically on tools and forms, among others;
•The discussions on M&E and Results-based
PSM should continue and the participants see
themselves as part of the country based
ADB Grant 0133-CAM: Public Financial Management
in Rural or
Development
Ministries for Component 1
networks
CoPs.
AP-CoP MfDR
Comments: 2nd M&E Workshop
A Monitoring and Evaluation System have not been established.
However, some components of the M&E system which have been
existing were not linked to each other’s functionality and in some
ways disjointed;
Current M&E staffs either delegated or appointed are
“trainable” individuals whose current skills could be
“up-scaled” if and when appropriate M&E learning
packages were to be designed;
Interfaces on the functionality of the M&E system
via institutional arrangement has to be integrated
within the line ministries, national agencies and
partners by adopting a common mechanism
across RDMs;
Despite an approved sub-decree creating Monitoring
and Evaluation System, as a function within the
Ministry of Planning and with the RDMs has not been
established
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
AP-CoP MfDR
Results-Oriented M&E Workshop
Welcome to the 3rd APCOP-MfDR
Results-Based M&E
Workshop for Rural Development
Ministries in Cambodia
Session 3 : Identifying Capacity
Development Gaps and Actions for
Institutional Logframe
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
12
Results-Oriented M&E Workshop
Elements
1
M&E Core Attribute 5:
Determining Capacity Gaps in
developing
Institutional Logframe
Program or Project goals are
clearly stated
Yes/
No
If YES,
Specific Capacity
Gap
No
Specific Action(s)
Remarks
ASDP, BSP
Linkage between activities,
No
results, purpose and objectives
of the program, project, or policy
in a hierarchy indicated
Some line
Departments
not link to
ASDP
Performance indicators of
projects or programs identified
No
3
No
4
Sources of information for the
indicators identified
Report not
reflect to the
Annual plan
Information by
report
No
5
Assumptions for the
performance indicator agreed
2
6
7
8
Need to update
Risks of achieving the
No
performance indicator
documented
The 4 x 4 (Four by Four) Matrix No
showing the methodical manner
and causal logic developed
Not align
Project or program operational No
plans assisted with reference to
the logframe developed
Need Update
Need
correction
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
Note(s):
7/28/2017
Institutionalizing M&E System in Cambodia
13
Results-Oriented M&E Workshop
Welcome to the 3rd APCOP-MfDR
Results-Based M&E
Workshop for Rural Development
Ministries in Cambodia
Session 5 : Identifying Capacity
Development Gaps and Actions for
Data Quality Assessment, Analysis
and Reporting
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
14
Results-Oriented M&E Workshop
Elements M&E Corel Attribute 6: Determining
capacity gaps in completing Data
Quality Assessment, Analysis and
Reporting
1
Critical indicators identified
2
Procedures to assess critical indicators
followed
Yes/
No
Specific
Action(s)
Remarks
No
No
Reporting
M&E Report
Completed
form M
3
Variables for the indicator(s) encoded
and processed
No
4
5
6
Variables validated
Sampling or selection strategy identified
Quantitative and or qualitative analysis
designs utilized
No
No
No
7
8
Linking quantitative and qualitative data
Statistical measures in quantitative data
used
No
No
9
Deductive or inductive method of
analysis in qualitative data used
No
10
11
12
13
Format of reporting of results agreed
Schedules of reporting specified
Reports published or shared
Implementing partner(s) or agencies
informed
No
No
No
No
Specific visit(s) or mission(s) scheduled
No
14
Note(s):
If YES,
Specific
Capacity Gap
Annual
Report
Report
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
15
Results-Oriented M&E Workshop
Welcome to the 3rd APCOP-MfDR
Results-Based M&E
Workshop for Rural Development
Ministries in Cambodia
Session 7 : Identifying Capacity
Development Gaps and Actions for
Evaluation Designs, Methodology
and Approaches
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
16
Results-Oriented M&E Workshop
Elements M&E Corel Attribute 7: Identifying
capacity development gaps in Evaluation
Designs, Methodology and Approaches
1
Evaluation designs or models determined
2
Evaluation methodologies specified
3
Evaluation plan matrix agreed
4
Parameters or measures established
5
Sampling methodologies identified
6
Baseline data collected
7
8
Critical data used for evaluation qualityassessed
Data analysis addressed
9
Results level subject to evaluation clarified
10
Changes in interventions documented
11
Indicators for evaluation exercise addressed
12
Statistical models for evaluation formulated
13
15
Evaluation conduct specified (sub-contract,
external, joint, etc)
Effectiveness, efficiency and relevance
directly responded
Presenting evaluation results planned
16
Evaluation results reported and shared
17
Ethical concerns (standards, guidelines, etc.
) addressed
14
Yes/
No
If YES,
Specific
Capacity Gap
Specific Action(s)
Remarks
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
17
Results-Oriented M&E Workshop
Welcome to the 3rd APCOP-MfDR
Results-Based M&E
Workshop for Rural Development
Ministries in Cambodia
Session 8 : Identifying Capacity
Development Gaps and Actions for
Feedback Mechanism
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
18
Results-Oriented M&E Workshop
Elements M&E Corel Attribute 8:
Feedback mechanism
1
Feedback questionnaires for
key stakeholders developed
2
Evaluation results supported
3
Evaluation results as tool for
decision making used
4
Assumptions and risks to
project implementation
reviewed
Key stakeholders’ opinions
shared
Exchange of opinions
documented
Feedback from stakeholders
available in customized eportals or other forms of
information sharing
mechanism
Response(s) on effectiveness
and efficiency of
projects/program recorded.
5
6
7
8
Yes/
No
If YES,
Specific Capacity
Gap
Specific
Action(s)
Remarks
Note(s):
ADB Grant 0133-CAM: Public Financial Management in Rural Development Ministries for Component 1
7/28/2017
Institutionalizing M&E System in Cambodia
19