European Commission
DG Budget – Evaluation Unit
European Commission
IDEAS - New Delhi 14 April 2005
European Commission
DG Budget – Evaluation Unit
Commission Communication on evaluation standards
and good practise
 Entry into force July 2003
Organisational context
• Main evaluation responsability on individual
Directorates General (evaluation functions)
• Centralised support and coordination
European Commission
DG Budget – Evaluation Unit
Regulatory context
• Previous good practise guidelines
• Commission Communications:
- on evaluation (2000)
- on Activity Based Management (2001)
• Financial regulation with rules on evaluation
• Internal Control Standards (evaluation is one of
24)
European Commission
DG Budget – Evaluation Unit
Purpose and scope
Purpose:
• Assist services in organising and managing their
evaluation activities
• Ensure quality of evaluation
• Achieve usefulness and use of evaluation
• Recognition of the importance of evaluation across
management levels and decision-making
European Commission
DG Budget – Evaluation Unit
Scope:
• "Evaluation principles", resources, processes
• Evaluation function in all Commission departments
and the preparation, management and use of
results of evaluation activities
• Type of evaluation:
- evaluations of policies, programmes, activities,
... (except individual projects)
- ex ante, interim and ex post
- internal and external
European Commission
DG Budget – Evaluation Unit
Structure
• 39 standards (binding) and 20 good practice
(recommended).
Main sections:
• Evaluation function: profile, role, tasks,
resources
• Evaluation activities: planning, feedback,
external communication
• Evaluation process: evaluation project, steering
groups, conduct of evaluations
• Quality of evaluation reports
European Commission
DG Budget – Evaluation Unit
Contents (1) – The evaluation function
• Profile, role, tasks and resources of the evaluation
function
- Evaluation function with clear role and visible in
the DG structure
- Support in the formulation of policies,
programmes and management processes
- Adequate human & financial resources
European Commission
DG Budget – Evaluation Unit
Contents (2) – Evaluation activities
•Management of Evaluation Activities
- Annual and multi-annual planning
- Feedback to decision-making process
- Action on conclusions and recommendations
- Dissemination of evaluation results
European Commission
DG Budget – Evaluation Unit
Contents (3) – The evaluation process
- Design of an evaluation project - terms of
reference
- Steering Group
- Managing evaluations: responsibilities, independence
European Commission
DG Budget – Evaluation Unit
Contents (4) – Quality of Report
• Quality of the reports.
- Substance of the report
- Conclusions and recommendations: non-interference
and unbiased
- Recommendations: clear, useful, applicable
European Commission
DG Budget – Evaluation Unit
Regulation vs. persuasion
• Binding minimum standards & auditable
• Combined with good practices
• Guidance on how to apply the standards
• Training & exchange of good practices
European Commission
DG Budget – Evaluation Unit
Acceptance and utilisation
In the establishment phase
• Drafted with the involvement of an interservice
working group
• Formal Interservice consultation (integration of
comments)
European Commission
DG Budget – Evaluation Unit
Acceptance and utilisation
In the application phase
• Self assessment by services
- Compliance with Internal Control Standards (89%
claim compliance)
- Annual reporting cycle
• Questionnaire by DG Budget
-open-ended with 2
questions:
- Useful?
- Changes needed?
• European Court of Auditors: auditing questionnaire
covering many standards