1
Why are Result & Impact Indicators Needed?
To better understand the positive/negative
results of EC aid.
The main questions are:
1. What change is needed?
2. For whom?
3. How to measure this change?
2
Why are Result & Impact Indicators Needed?
1. Assist EC country teams to develop a
set of indicators for the programming
level (e.g. to guide development and
monitoring of a Country Strategy Paper)
2. To fill, as much as possible, the
'missing middle' between implementation
indicators and global impact indicators
3
The Missing Middle
Outputs
Results
(Outcomes)
Implementation
Specific
Impacts
Intermediate
Impacts
Global Impacts
Programming
4
Education MDG’s
“More than 90% of
children in developing
countries are enrolled in
primary schools and
54% attend secondary
school.”
Quality
Learning/
Skills
EC India Evaluation, 2007
UNDP Website
MDG 3 Promote
Gender Equality &
Empower Women
“School enrolment has
increased …[but] weak
governance outcomes remain,
such as teacher absenteeism
and the associated lack of
teaching activity in schools.”
Access
“It is generally acknowledged
that Uganda has been
successful in improving access,
MDG 2 Achieve
Universal Primary
but it is felt that this was at the
Education cost of the quality of education.”
(at all
levels)
Netherlands Education Sector
Evaluation of Uganda, 2008
5
Education Intervention Logic
Output
Clusters
Institutional
Management
Specific
Impact
Results
(Outcomes)
Better
Allocation of
Educational
Resources
Increased
Affordability of
Education
Quality of
Education
Equitable
Access to
Education
MDG 2
Education
Facilities
Economic
Growth
Skills and
Learning
Enhancement
Health
Global
Impacts
Improved Family
Planning &
Health Awareness
Curricula &
Teaching
Materials
Teacher
Recruitment
& Training
Intermediate
Impacts
MDG 3
Improved
Participation in
Society
Poverty
Reduction
MDG 1
Social
Development
Greater Income
Opportunities
Optimal
Employment
6
Result (Outcome) Indicators 1
Output
Clusters
Institutional
Management
Results
(Outcomes)
Indicators
Better
Allocation of
Educational
Resources
1.
Transparent decision making
Increased
Affordability of
Education
2.
Cost for household
Curricula &
Teaching
Materials
Teacher
Recruitment
& Training
Health
Education
Facilities
Optimal
Employment
13. Employment: school/university
construction and maintenance
14. Employment: teachers and
government workers
7
Result (Outcome) Indicators 2
Output
Clusters
Institutional
Management
Results
(Outcomes)
Better
Allocation of
Educational
Resources
Increased
Affordability of
Education
Quality of
Education
Curricula &
Teaching
Materials
Teacher
Recruitment
& Training
Equitable
Access to
Education
Indicators
3.
Absenteeism & Drop Out
4.
Teacher ratios/rates
5.
Qualification of teachers
6.
Teaching material ratios
7.
Transition & Repetition
8.
Equitable education participation
9.
Enrolment rate
10. Completion rate
11. Distance to school/university
Health
12. School and university places
Education
Facilities
Optimal
Employment
8
Specific Impact Indicators
Output
Clusters
Institutional
Management
Results
(Outcomes)
Specific
Impact
Indicators
Better
Allocation of
Educational
Resources
Increased
Affordability of
Education
Quality of
Education
Skills and
Learning
Enhancement
Curricula &
Teaching
Materials
Teacher
Recruitment
& Training
Equitable
Access to
Education
15. Literacy &
Numeracy rates
16. Examination results
17. Social views
Health
Education
Facilities
Optimal
Employment
9
Intermediate Impact Indicators
Output
Clusters
Institutional
Management
Results
(Outcomes)
Specific
Impact
Better
Allocation of
Educational
Resources
Increased
Affordability of
Education
Intermediate
Impacts
Indicator
Improved Family
Planning &
Health
Awareness
Quality of
Education
Skills and
Learning
Enhancement
Curricula &
Teaching
Materials
Teacher
Recruitment
& Training
Equitable
Access to
Education
Improved
Participation in
Society
Health
Greater Income
Opportunities 18. Employability
Education
Facilities
Optimal
Employment
10
The Missing Middle
Outputs
Results
(Outcomes)
Implementation
Specific
Impacts
Intermediate
Impacts
Global Impacts
Programming
11
Attention
1. This is a simplified tool, not a template.
Intervention logic must be developed for each country
based on its context and existing government strategies
2. Indictors are not fixed but provide ideas on how to
set, monitor and evaluate CSP objectives
3. Crosscutting issues should be mainstreamed into
relevant indicators (e.g. disaggregation of data by gender)
4. Outcomes/Impact are not fully attributable to the EC
Outputs are 100% attributable to the EC but attribution
falls as you move up the chain of results
12
Affordability Result (Outcome) Indicators
11. Distance to school/university
List of Key Indicators (with examples)
- x% of students within x kilometre of a school
1. Transparent decision making
- Implementation of transparent mechanisms to allocate resources between
12. School and university places
- Educational places as an x% of eligible students
sectors (e.g. using tools such as average cost ratios per student for different
educational levels)
2. Cost for Household
- Cost of education (i.e. fees, materials/equipment, lunches etc) as a % of
household expenditure; cost per student as a % of income per capita
Optimal Employment Result (Outcome) Indicators
13. Employment: school/university construction and maintenance
- Number of people directly and indirectly employed in school/university construction and
Quality Result (Outcome) Indicators
3. Absenteeism and drop out
- Teacher/student absenteeism rates; drop out rates
maintenance
14. Employment: teachers and government workers
- Number of people directly & indirectly employed as teachers and
government workers linked to education sector
4. Teacher ratios/rates
- Student teacher ratio; rate of double shifting
5. Qualification of teachers
Specific Impact Indicators
- Average qualification of teachers at each educational level
15. Literacy and numeracy rates
6. Teaching material ratios
- Literacy and numeracy rates by age, sex and social group
- Student textbook ratio
16. Examination results
7. Transition and repetition
- Examination results for various educational levels and subject areas by age, sex & social
- Progression rates; repetition rates
group
17. Social views
Access Result (Outcome) Indicators
- Support for violent conflict; prejudiced views towards other social groups
8. Equitable educational participation
- Ratio of girls to boys in primary, secondary and tertiary education; ratio of other
Intermediate Impact Indicators
disadvantaged groups compared to x% of population
9. Enrolment rate
- Gross and net enrolment rates
18. Employability
- % of school leavers/graduates gaining paid employment (split by type of employment)
10. Completion rate
- Gross and net enrolment rates
13