Module I
Mainstreaming in country
monitoring systems
Towards Sustainable Development: greening
national development
Performance measurement and monitoring:
Key concepts
2
Process
Outcomes
Objectives and related indicators/milestones
Hierarchy of
objectives
Progress
measurement
Overall objective(s)
Impact indicators
Specific objective(s)
Outcome indicators
Intermediate results
Output indicators
Milestones
Inputs
Input indicators
Milestones
Adapted from: EC (2004), OECD (2002)
3
Control
Influence
Sources
Outcomes
Intermediate
Outcome(s)
Outputs/products
Activities
SDGs
National strategies
Sector Strategies
International indicators
(IOs, INGOs)*
“Project tailored”
(studies, internal
M&E, specific
surveys)
* An EU results framework is used in EU funded projects
Example: indicators in a logical chain
Action by
Environmental
Protection Agency
Response of
industries
Change in
discharge/pollution
Change in human
health
Change in
environmental
conditions
SMART indicators and targets
•Indicators and targets should be:
•Specific to the related objectives
•Measurable
•Available at a reasonable cost
•Relevant to information needs of decision
makers
•Time-bound
6
Source: EC (2004)
RACER indicators
• Relevant, i.e. closely linked to the objectives, should measure
the right thing
• Accepted (e.g. by staff, stakeholders), considering roles and
responsibilities for the indicator
• Credible for non-experts, unambiguous and easy to interpret.
Easy to monitor (e.g. data collection should be possible at low
cost).
• Robust, monitoring of changes and allowing adaptation of
intervention; and robust against manipulation, wrong
interpretation etc.
Source: EC (2004)
7
Examples
EU Result Framework
International indicators (e.g., MDGs)
Number of (i) deaths per
100,000 and (ii) economic
loss as a proportion of
GDP, from climate-related
and, natural disasters –
average over last ten
years
By 2030, significantly reduce the number
of deaths and the number of people
affected and decrease by [x] per cent the
economic losses relative to gross domestic
product caused by disasters, including
water-related disasters, with a focus on
protecting the poor and people in
vulnerable situations
Proportion of population
using an improved
drinking water source
By 2030, achieve universal and equitable
access to safe and affordable drinking
water for all
Rate of net forest cover
change
By 2020, promote the implementation of
sustainable management of all types of
forests, halt deforestation, restore
degraded forests and increase
afforestation and reforestation by [x] per
cent globally
Tips for the formulation of indicators
1. Project documents usually only use a short list of priority
indicators. A complete M&E system should use a fuller set of
indicators, corresponding to all your M&E objectives.
1. Outcome, Impact indicators:
…for accountability, communication purposes
Activity, Output indicators:
…for planning, daily management
3. Use an additional table to ensure sources of data, collection
methods and responsibilities are well defined.
4. Use data existing at national level, with easy access to past
temporal sequences, at different geographical levels. Check for
gaps and other potential inconsistencies.
Criteria for selecting Poverty-Environment
indicators in Rwanda
•
•
•
•
•
•
•
•
•
Policy relevance
Measurability
Clarity of P-E linkages
Sensitivity to changes in data
Degree of representation of priority issues
Cost-effectiveness in data collection
High quality and reliability
Appropriate spatial and temporal scale
Availability or ease of setting targets and
Source: Kenya Ministry of State for Planning, National Development
baselines
& Vision 2030 (2011) Poverty & Environment Indicators Report.
How difficult is it to use environment and
climate change indicators in sector
monitoring systems?
11
Environmental monitoring
A central analysis
Indicators from EIA, SEA, environmental reports
… their recommendations should be monitored!
Environmental effects
Environmental causes (pressure factors)
Remedial action. Distinguish:
what was identified as potential action (alternatives),
what was foreseen,
what is actually being done.
What should be monitored, and why?
What: environmental drivers
affecting society / leading to
poverty
Why: improve relevance of
interventions, revert adverse
trends
Vulnerability to climate change
• Prioritise actions re: adaptation to climate
change
Policy and institutional processes
• Identify and integrate environmental and
climate change response in public action
• Enhance transparency and accountability
of environmental and CC interventions
• Ensure inclusion of gender dimension
Policy/Strategy implementation and
outcomes
• Strengthen commitment to the objectives
set in policies and strategies
• Stimulate the achievement of tangible
outcomes
Stakeholders logic
• Identify potential barriers, and optimise
results with other public actors, private
13
interventions, final beneficiaries
Environment and climate change in a
national development monitoring system
• Environment and climate change monitoring should
be integrated into wider national and specific
development monitoring systems
=> Strengthen and adapt existing monitoring
systems (incl. statistical systems) to integrate
environment and climate change
• Build on existing institutions and sources of information...
• ... but adapt statistical systems and data sources
14
Levels at which to measure environmentand climate-related performance
Indicators and milestones related to the response
associated to environment/climate change challenges
can be included in environmental and climate change
strategies and actions plans, but also in:
•
•
•
•
National development strategies and programmes
Sectoral strategies and programmes
Sub-national (e.g. regional, local) development plans
Individual projects (logical framework)
This is part of
“mainstreaming”!
15
Monitoring environment & climate change
Meteorology,
climate variability,
environmental
parameters
• Data collection,
management and
dissemination
• Strengthening of
meteorological
information & systems
Climate
change
Mainstreaming
Is the
mainstreaming
process based on
reliable
information?
• New patterns
• Emerging trends
•Projections, scenarios
• Tools for assessing
impacts, vulnerabilities
& risks
16
Monitoring policy and institutional change
Institutional
capacity
Policy reform
• Integration of
environment/climate
change considerations in
national & sector
policies/strategies
• Development of
adaptation- & mitigationoriented policies & plans
(e.g. DRR, REDD
strategy)
•Development of
environment-specific
policies & plans (e.g.
IWRM, biodiversity)
Mainstreaming
Is mainstreaming
getting
institutionalised at
all levels?
• Political leadership
• Institutional
commitment
• Coordination &
participatory
mechanisms
•Procedures
• Systems
•Tools
•Capacity building
programmes
17
Monitoring policy implementation and
outcomes
Outcomes,
impacts
Implementation
(inputs, outputs)
• Increased allocation of
resources
• (Inclusion of)
environment/climate
change (measures in)
programmes/projects
• Implementation &
enforcement of
environment/climate
change measures &
regulations
Mainstreaming
Does the
mainstreaming
process produce
results and impacts?
• Reduced environmental
degradation and its incidence
on poverty/development
•Increased resilience of
vulnerable groups (women,
children, farmers, coastal
communities, ...)
• Increased resilience of key
sectors
• Green growth,
green jobs
• Environmentally
sustainable, climateresilient, low-emission
development
18
Monitoring and evaluation frameworks
in budget support operations
19
Budget Support and Policy Dialogue
• M&E is fundamental in EC budget support, as
performance against a chosen set of criteria and
targets determines the final amount of
disbursements
• Measure of progress is essential to feed policy
dialogue
• Increasingly, M&E systems in development
strategies are including environmental
sustainability, climate change adaptation, disaster
risk reduction, energy efficiency, etc.
20
BS indicators in
Solomon Islands
- Climate Change is mainstreamed in the National
Development Strategy and National Transport Plan
- The National Budget allocates at least 20 M SBD to the
implementation of NAPA priority 1
- Solomon Islands National Climate Change Strategy is
approved
- Identification and ranking of affected, high-risk communities
according to risk related criteria
- Realistic costing of climate change adaptation measures,
including relocation,
- Guidelines for Human Resettlement projects, including
safeguard standards, to minimize risks of conflicts due to
resettlement
References
• World Bank report on Mainstreaming Adaptation to Climate
Change in Agriculture and Natural Resources Management
Projects
• http://climatechange.worldbank.org/content/mainstreamingadaptation-climate-change-agriculture-and-natural-resourcesmanagement-project
• European Commission Guidance on the Integration of
Environment and Climate Change in Development
Cooperation
• http://ec.europa.eu/europeaid/infopoint/publications/europeai
d/172a_en.htm
• EC (2004) Project Cycle Management Guidelines. Aid
Delivery Methods series, Volume 1.
• http://ec.europa.eu/europeaid/infopoint/publications/europeai
d/documents/49a_adm_pcm_guidelines_2004_en.pdf
22