Overview
Overview
1. Background and Objectives
The Korea International Cooperation Agency (KOICA) considers the Philippines
as a high priority country to receive development assistance therefore a review
of the relevance, efficiency, and effectiveness of cooperative development
projects is needed.
In accordance with government policies, the Philippines is a corresponding country
to KOICA as well as to the International Development Cooperation Committee
(DAC) in terms of categorized as a partner country which to strengthen its
development and amongst the Association of Southeast Asian Nations (ASEAN),
The Philippines has been the second largest recipient country from KOICA's
assistance. By the year of 2010, KOICA assisted 13.01 million dollars of its
development assistance to the Philippines.
A comprehensive review is necessary due to the weak correlation and shortfall
of effectiveness between development projects and CAS. This evaluation is
needed to seek the effective and efficient solutions so that project planning,
implementation, and evaluation of CAS procedures could be effectively
interconnected in order to achieve strategic and consistent projects.
The objective of this research is to revise CAS by identifying tasks, which could
be used to improve the effectiveness of development projects.
- To do this, the following information is needed about the Philippines: the
development plan, the aid environment, the support strategy, and Korea’s
comparative advantage. After reviewing the relevance of the support direction,
main areas of support, and strategy, coordination between CAS and support
projects can be better established.
. Overview
Support projects with high priorities will be looked at to evaluate their relevance,
effectiveness, and efficiency. The flaws will be discovered along with reasons
for their existence. Detailed solutions will then be put forth in order to resolve
these issues by analyzing the relevance and effectiveness of KOICA’s project
implementation system and support environment for the Philippines. After the
analysis, short and mid-term tasks in stages will be presented.
2. Evaluation Goals and Scope
There is a need to analyze the aid implementation environment for the Philippines,
and evaluate strategies by country and support projects. But it should cover all
the process of project implementation by country across the board (establishment
of strategy, selection and formation of project, enforcement, monitoring and
evaluation).
A. KOICA’s Support Environment for the Philippines
- Recipient and Donor Environment
Recipient system, MDGs, activities and joint operation of recipient country
and donor organization to implement the Paris Declaration
B. Country Assistance Strategy (CAS)
- Procedures of CAS establishment and relevance and effectiveness of logical
framework
- Evaluation on the relevance of selection of prioritizing support fields
C. ODA Implementation System for the Philippines
- Project Selection and Analysis of its Formation Process
Analysis of the relevance and effectiveness on the selection of aid project
and its formation process driven by KOICA.
Evaluation of KOICA's Country Assistance Program for the Philippines
- Analysis of Project Implementation Process
Analysis of the relevance and effectiveness of aid project implementation
process conducted by KOICA
D. Evaluation of KOICA’s Support Project for the Philippines
- Evaluation on the recent project performance (2007~2009)
Relevance, efficiency, and effectiveness of support project by field and
type on CAS
Evaluation of the relevance, efficiency, and effectiveness of project system
and modality
- Case study on KOICA’s major priority support projects for the Philippines and
putting forth the performance and suggestions
Comparative analysis of successful and challenging case studies
Evaluation on the connected case study by type and field
Research and analysis of other donor organizations’ project performance
related with the Philippine development plan by field
- Implementation process of support project for the Philippines
Formation, enforcement, follow-up of the support project
Consultation with recipient country and its organization for the agreement
on the aid
Coordination with other donor country for the harmony of aid
Other consultation for the organic promotion between other support projects
for the Philippines
5 DAC evaluation criteria, the Paris Declaration, and project evaluation guidelines
of KOICA were applied to the evaluation criteria such as relevance, effectiveness,
efficiency, impact, sustainability, environment, partnership, and consistency for
the systematic evaluation of CAS and each project.
. Overview
3. The Philippines CAS Framework
Object of Evaluation
1.1.
Establishment
1.
Establishment
of CAS for
1.2.
the Philippines
Procedure
and its
and Main
Organization
Contents
Detailed Contents of the Evaluation
Evaluation Criteria
- Adequacy of Establishment
- Distribution of Role Sharing between the
Headquarters and Overseas Offices
- Distinctive Aid projects with other agencies
Adequacy/Paris
Declaration(PD)
-
Procedure of Establishment
Preparatory Guidelines
Required duration for projects
Collecting Opinions and Agreement Process
1.3. Evaluating Organizational Process
2.
CAS
Decision
Making
Adequacy/PD
Adequacy/PD
2.1 CAS Characteristics
Effectiveness/PD
2.2. CAS Goal and Strategy
Effectiveness/PD
2.3
CAS
Contents
- Reflecting Korean Government Policies
- Differences Between Development Plans of
Other Donor Countries
- Reflecting the Philippine’s Developmental
Situation
- Relationship in International Development
Cooperation
Adequacy/PD
2.4 Coordination between CAS goals and strategies
Adequacy/PD
2.5.
Goal
Attainment
of CAS
Adequacy/PD
- CAS Goal Attainment for Donor Countries
- CAS Goal Attainment for Recipient Countries
- CAS Goal Attainment for International
Development Cooperation
2.6 Directionality of CAS
3.
Implementation 3.1.
of CAS for
Project
the Philippines Selection
and
Organization
Effectiveness/PD
- Checking to See if International Aid Standards
were Met
- Evaluating Cooperation and Division of Roles
- Evaluating Coordination between the Recipient
Country’s Policies
- Evaluating the Connection Between KOICA’s
Polices and Strategies
Adequacy/PD
- Attainment of KOICA Project Objectives
- Goal Attainment of Individual Projects
- Goal Attainment for the Development of the
Recipient Country
- Meeting the Paris Declaration Standards for Aid
- Meeting Paris Declaration Standards for
Balanced Aid
Effectiveness/PD
Evaluation of KOICA's Country Assistance Program for the Philippines
Object of Evaluation
3.2.
Project
Implementation
Process
4.
Support
Strategy
Monitoring &
Evaluation by
Country
5.
Evaluation of
Programs
/Projects
Detailed Contents of the Evaluation
Evaluation Criteria
- Relevance of Project Procedures
- Relevance of Division of Roles
- Relevance of Cooperation With the Recipient
Country
- Relevance of project Cooperation with Other
Donor Countries
- Relevance of Project Management
- Relevance of Allocation on Manpower
Adequacy/PD
- Promoting compliance with certain degree of
project
- Effectiveness of Project Management
- Checking the Effectiveness of Other Donor
Countries’ Procedures
Adequacy/PD
4.1. CAS Systematic Management
Effectiveness/PD
4.2. Results Based CAS
Sustainability/PD
4.3. Systematic Monitoring and Evaluation
Sustainability/PD
4.4 Effectiveness of Evaluation System
Effectiveness/PD
5.1. Development Project for Early Warning and Response
System for Natural Disasters in the Philippines
DAC
Standard/PD
5.2. The 2nd Phase of Renovating Korea
Hospital in Cavite (new)
DAC
Standard/PD
Philippine Friendship
5.3. Improvement of Busuanga Airport facilities (continuous)
DAC
Standard/PD
5.4. Establishing Dagupan City Fish Processing Plant
DAC
standard/PD
5.5. Staff Training Program for the Philippines
DAC
standard/PD
4. Evaluation Methods & Phases
The 5 DAC principles and the Paris Declaration standards have been used in
conjunction with KOICA’s evaluative guidelines to review projects based on the
following areas: relevance, effectiveness, efficiency, impact, sustainability, gender
equality, local perspective, partnership, and continuity.
. Overview
In consultation with KOICA, the evaluation team looked at CAS’s objectives and
goals, strategies, and developmental areas of high priority in order to come up
with a balanced assessment based on different methodologies.
In order to conduct systematic research, the following steps were taken in Korea
and abroad:
- Work in Korea: relevant literature review/analysis and interviews and surveys
of development experts
- Work in the Philippines: survey of the Philippines and evaluative workshop
Major Activities by Evaluation Phase
Phase
Major Activities
Planning
- Establishment of the Philippine CAS and the evaluation team of the support
project
- Establishment of evaluation plan
· Researchers and experts’conference
· Specification of evaluation objectives, objects, and scope and establishment of
evaluation plan
- Literature survey, interview with the related persons from home
- Establishment of CAS, support project, ODA environment’s evaluation framework,
Preparation
and detailed evaluation plan
- Literature survey, interview with the related persons from home
- Establishment of CAS, support project, ODA implementation system’s evaluation
framework Workshop for the detailed evaluation plan
· Confirming the hierarchical structure of the evaluation objects
Expert
· Putting forth the logical structure of the evaluation objects
Workshop - Making evaluation design : selection of evaluation criteria, survey items, and
and Survey
evaluation method
- Making evaluation sheets
- Sending the questionnaire sheets : to officials of recipient country, project/volunteer
workers/trainees Related of the recipient organizations
- Domestic research : evaluation of CAS, support project, and ODA environment
1) Interviewees:
Research &
· Government officials of donor country (KOICA, the Ministry of Foreign Affairs
and Trade, National Affairs Coordination Office)
Analysis
· Government officials of recipient country (Philippine Embassy)
2) Workshop with donor country officials related
Research &
Analysis
- Local research : evaluation of CAS, support project, and ODA implementation
system
- Business trip : interviews and visits to the project sites, and workshop
Evaluation of KOICA's Country Assistance Program for the Philippines
Phase
Major Activities
1) Interviewees :
· Government officials of donor country (KOICA local office, Korean embassy
to Philippines, aid project staffs in the Philippines)
· Government officials of recipient country (NEDA, Ministry of Foreign Affairs
and Trade, Janjibar Ministry of Agriculture, forestry, and Livestock)
· Sample project (PAGASA, Civil Aviation Authority of the Philippines)
2) Workshop with related staffs from donor country and recipient country
3) Visit to project site: representative sample site (General Emilio Aguinaldo
Memorial Hospital)
Result
Analysis &
Evaluation
Report
-
Making evaluation report on CAS, support project, ODA environment
Analysis of the results of business trip to project site
Making a preliminary evaluation report
Presentation at international seminar
Internal review conference : putting forth improvements
Feedback, presentation of evaluation results
5. Evaluation Team
Establishment of Evaluation Team and its Role
Classification
Major Service
Chief Evaluator - Establishment of CAS, evaluation of the framework and M²&E
- Research and analysis on the Philippine development and aid implementation
environment
- Evaluation of CAS implementation system
Joint Evaluator
- Evaluation of each support project
- Establishment of CAS, evaluation of framework and contents
- Research on the project site, support of evaluation
Consultant
- Making a report
- Research on the project site, support of evaluation
Evaluation Period : June 2010~October 2010 (5months)
. Overview
6. Seminar & Workshop for CAS
Seminar for evaluation model of ODA Project in the Philippines
Topic : Evaluation model of ODA Project in the Philippines
Date : 2010. 7. 6 (Tue) 15:00 - 17:30
Venue : Dongguk University, Seoul, South Korea
Moderator : Kang, Sin-Taek (Seoul National University)
Speakers
1. Park, Byoun-Sik
2. Kim, Jong-Keun
3. Cho, Won-Guon
Discussants
1. Kim, Young-Gi (Hannam University)
2. Kim, In (KOICA)
3. Cho, Kyung-Sik (Yonsei University)
4. Kim, Tae-Eun (KOICA)
5. Park, Seung-Yung (Pengtaek University)
6. Lee, Hae-Kyoon (Korea University of Technology and Education)
Evaluation on KOICA's CAS and ODA Programs to the Philippines
Date : 2010. 8. 12 (Thursday) 13:00-17:30
Venue : Batanes Function Hall, Sangrilla Hotel, Manila, Philippiines
13:00~13:30
Registration
13:30~13:40
Welcoming Remarks
Kim, Jin-Oh (KOICA-Philippine office Chief)
Moderator : Brillantes, Alex B. Professor and Dean,
NCPAG, University of the Philippines
Presenter 1
Kim, Gil-Hong, Ph.D
Director,
Regional and Sustainable Development Department, ADB
13:40~14:20
Evaluation of KOICA's Country Assistance Program for the Philippines
Presenter 2
Corpus, Violeta
OIC, Assistant Director, NEDA
14:20~14:50
Discussant 1 Afable, Francis C. KOICA-Philippine officer
Discussant 2 Prof. Park, Byoung-sik, Ph.D
Discussant 3 Prof. Jung, Chul-ho, Ph.D
14:50~15:10
Coffee Break
15:10~16:10
Presenter 1
Mr. Roy Gamosa
Airport Manager, Department of Transportation
Civil Aviation Authority of the Philippines
Presenter 2
Dr. George Repique
General Emilio Aguinaldo Memorial Hospital
Presenter 3
Dr. Susan Espinueva, PAGASA
16:10~16:40
Discussant 1 Prof. Edwin Martin, Ph.D
Discussant 2 Prof. Kim, Jong-keun, Ph.D
Discussant 3 Prof. Park, Jung-hyun, Ph.D
16:40~16:50
Closing Remarks
Prof. Park, Byung-sik, Ph.D / Project Manager
The International conference of CAS Evaluation
Topic : Evaluation of CAS and ODA program to Philippines
Date : 2010. 10. 8 (Fri) 10:30-14:20
Venue : Seoul Center of Educational and Cultural Center
Moderator : Kang, Sin-taek
(Emeritus Professor, Seoul National University)
Speakers :
1. Kim, Cheol-ghee Michael (ADB): Evaluation practices and issues in ADB
2. Park, Byoung-sik (Dongguk University): CAS evaluation model of Philippines
3. Kim, Jong-keun (KIPPE): ODA program evaluation model of Philippines
. Overview
Discussants :
1. Park, Eun-hee (MOFAT)
2. Park, Suk-hyun (KOICA)
3. Labor Attache, Samonbe (Embassy of Philippines)
4. Park, Seung-yong (Pyungtaek University)
5. Amante, M. (Hanyang University)
6. Bang, N. C. (Hankun University of Foreign Studies)
7. Cho, Kyung-sik (Kukjea University)
Evaluation of KOICA's Country Assistance Program for the Philippines