PUBLIC SECTOR EVALUATION
BENCHMARKING EXERCISE
Prepared for ECG Meeting by K Chomitz for IEG
October 25 2013
Submissions received from CEDs at:
•
African Development Bank
•
Asian Development Bank
•
Council of Europe Bank
•
European Investment Bank
•
Interamerican Development Bank (note: practices currently under revision)
•
IFAD
•
Islamic Development Bank
•
World Bank
Distribution of responses
Fully compliant
Partially compliant
Not compliant
Not applicable
Note: excludes IADB – system under revision
Elements most frequently implemented
(7 CEDs fully consistent)
•
The CED has a strategy for its mix of evaluation products that
balances the two evaluation functions of accountability and
learning.
• Review: Draft evaluations are reviewed to ensure quality and
usefulness.
Elements frequently implemented
(6 CEDs fully consistent)
•
Performance Evaluation Reports (PERs): PERs are scheduled to ensure that sufficient time
has elapsed for outcomes to be realized and for the sustainability of the operation to be
apparent.
•
Stakeholders’ Consultation: Stakeholders are consulted in the preparation of evaluations.
•
Scope of Evaluation: Evaluations encompass all performance attributes and dimensions that
bear on the operation’s success.
•
The assessment of Relevance covers both the relevance of objectives and the relevance of
project design
•
The assessment of IFI Performance covers the quality of services provided by the IFI during all
project phases.
•
Borrower Performance assesses the adequacy of the Borrower’s assumption of ownership
and responsibility during all project phases.
•
Rules for assigning criteria ratings are clearly spelled out.
Elements infrequently implemented
(two CEDs fully consistent)
• The evaluation includes consideration of unanticipated
outcomes.
• If project objectives were revised during implementation,
the project is assessed against both the original and the revised
objectives.
•
The CED prepares a periodic synthesis report
• The CED follows up on IFI Management’s implementation of
recommendations made by the CED
Elements least implemented
(only one CED fully consistent)
• Sampling Methodology: The sampling methodology and
significance of trends are reported. (IFAD)
• Efficiency: : (i) Did the benefits of the project exceed project
costs; and (ii) Were the benefits of the project achieved at least
cost? (ADB)
Questions for discussion
• Do these results align with expectations?
• Are there OPs or EEs which need to be revisited?
• Do you agree that the next step is validation to ensure
consistency with GPs?
• Is there scope for sharing approaches to GPs?