Photo © Martin Aspin External Mid-Term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Funded by AECID Martin Aspin and Ella Jordan, Oct 2012 This report is commissioned by Action Against Hunger | ACF International. The comments contained herein reflect the opinions of the Evaluator only. TABLE OF CONTENTS LIST OF TABLES 2 LIST OF ACRONYMS AND ABBREVIATIONS 3 ACKNOWLEDGEMENT 4 EXECUTIVE SUMMARY 5 1.0 BRIEF BACKGROUND 8 2.0 METHODOLOGY 10 3.0 FINDINGS AND DISCUSSION 12 3.1 Quality of Program design 3.2 Sustainability 3.3 Relevance/Pertinence 3.4 Coherence 3.5 Effectiveness 3.6 Efficiency 3.7 Involvement/Participation 3.8 Control 3.9 Integrated focus 3.10 Cross Cutting Issues 12 16 19 22 24 33 35 37 38 40 4.0 CONCLUSIONS AND RECOMMENDATIONS 41 5.0 DAC GUIDELINES 46 6.0 GOOD PRACTICE IDENTIFIED FROM THE EVALUATION 47 ANNEXES Annex 1 – Key Informants and Documents reviewed Annex 2 – Sample of Most Significant Stories 49 52 LIST OF TABLES Table 1: Number SAM Cases Detected and Treated…………. ................................ 24 Table 3. Beneficiaries of 1st batch of Agriculture and IGA inputs............................. 27 Table 4. Status of Farm Plan and Business plans ................................................... 28 Table 5. Water Systems and Tap Stands Completion and Coverage ...................... 30 LIST OF FIGURES AND PHOTOS Photo 1: Functioning OTPs in Lanao Del Sur Province ........................................... 26 Photo 2: Farmer Help Groups ................................................................................. 29 Photo 3: Water planning .......................................................................................... 31 Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 2 List of Acronyms and Abbreviations ACF AECID BAWASA BDP BNS BHW CTF DoA DoH ENA FGD FSL GAM GOP IGA KAP MAM IMAM IMCI ITP IYCF LGU MAO M&E MoU NGO OTP PIMAM PMU RHU RUTF SAM UNICEF USD WASH WFP Action Contre la Faim (Action Against Hunger) Spanish Agency for International Development Cooperation Barangay (village) Water and Sanitation Association Barangay Development Plans Barangay Nutrition Scholar (Nutrition worker) Barangay Health Worker Coordinating Task Force (Provincial PMU) Department of Agriculture Department of Health Essential Nutrition Action Focus Group Discussion Food Security and Livelihoods Global Acute Malnutrition Government of The Philippines Income Generating Activity Knowledge, Attitude and Practice Moderate Acute Malnutrition Integrated Management of Acute Malnutrition Integrated Management of Childhood Illnesses In-Patient Therapeutic Program Infant and Young Child Feeding Local Government Unit Municipal Agriculturist Officer Monitoring and Evaluation Memorandum of Understanding Non-Government Organisation Out-Patient Therapeutic Program Philippines Integrated Management of Acute Malnutrition Program Management Unit Rural Health Unit Ready to Use Therapeutic Food Severe Acute Malnutrition United Nations Children’s Fund United States of America Dollars Water, Sanitation and Hygiene World Food Program Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 3 Acknowledgement Thank you to ACF Philippines for sharing their experiences and providing introductions to staff, partners and beneficiaries. It was great to meet those contributing to improving the socio-economic conditions of remote communities across Mindanao in the Philippines. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 4 EXECUTIVE SUMMARY Action Contre la Faim’s (ACF) four-year ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines’ Program, has contributed to reducing child malnutrition, provided improvements in household food security, and delivered greater access to water and sanitation facilities (WASH) to remote communities across Central Mindanao. The program has also established the foundations for stronger local governance and community engagement in the planning and delivery of social services across targeted municipalities in North Cotabato and Lanao Del Sur. Established in March 2010 and funded by AECID, the program is scheduled to be completed in July 2014 at a cost of approximately 3.2 million Euro with an additional 800,000 Euro co-contribution in kind or cash from partners, local governments and the communities. This mid-term evaluation examines the first two years of the program and provides recommendations for the remaining two years. The main focus of the evaluation was to examine the implementation strategies and approaches, and how key program activities are achieving the overall goal of contributing to poverty reduction in rural and peri-urban communities. The evaluation was conducted through a mix of focus group discussions (FGDs), learning workshops, semi-structured interviews, program document review and site visits across the provinces of North Cotabato and Lanao Del Sur in Mindanao, Southern Philippines. The program represents a new approach for ACF Philippines. It is the first time Good Governance has been incorporated as a cross-cutting issue into ACF’s traditional mix of Food Security, WASH and Livelihoods initiatives. For ACF Philippines, it is also the first time nutrition has been added for a more integrated approach to programming. This approach was encouraged by the donor AECID and which has already seen the establishment of several community and government groups with representation from key sectors including agriculture, health and water users. Moving forward, the program will need to ensure a more pro-active dialogue between ACF and its partners, local government and the community when it comes to planning, design and monitoring of activities. Newly formed governance and community groups were observed as only receiving program information from ACF and missed the opportunity to be fully engaged in the process. Good Governance as a cross-cutting issue is often time consuming and complex, which should be included in future planning. Activities should be initiated by ACF and co-led by local authorities in a complementary approach with ACF and its partners. This is not always easy bringing community and government together, however it should be an integral part of the learning process for developing good governance, transparency and community ownership. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 5 Overall, the community felt engaged with the program, highlighted by active water user and health care/nutrition groups; both leading activities such as the maintenance of new water infrastructure and detection and treatment of malnourished children. However, there still remains a level of community apathy and risk of dependence on outside assistance. ACF and its local partners Don Bosco and Maradeca should continue to advocate for community engagement, specifically to ensure that people pressure their leaders to be accountable and provide transparency in the planning and allocation of resources. Examining Nutrition and Care Practices, the evaluation found ACF has made significant progress in reducing child malnutrition with a significant drop in the number of screened severely acute malnourished (SAM) children in the program areas. Significant progress has also been made on the improvement and servicing of Out-Patient Therapeutic Program (OTP) and local health clinics. Local volunteers and paid health staff have been trained and were provided with equipment in partnership with UNICEF, German Doctors and Montaner hospital to effectively detect, treat and prevent child malnutrition. Moving forward, more education and advocacy in the community would help mothers better understand the link between good nutrition, sanitation, food security and a healthy child. Examining food security and livelihoods, the evaluation found that ACF’s program had faced several challenges including agricultural inputs, cropping delays and poor weather, however had made positive steps to increase household knowledge and ability to provide diversified food for the family. Further work in the coming years needs to focus on small household gardening, improved use of locally sourced nonhybrid seeds and production of organic fertiliser and natural pesticides. There are some opportunities to expand ACF’s farming initiatives to include seedling nurseries and demonstration plots. Both should be led and maintained by local farmers who would pass on practical skills to other farmers through formal and informal training. This would also make use of existing traditional indigenous farming methods, which are a valuable source of knowledge and experience. The provision of water sources to remote communities has had a positive impact on household’s day-to-day living and provided a key source of water for household daily use, home-gardens and farming. Before ACF’s water initiatives, households were forced to limit their water use or walk several kilometres and spend significant portion of the day bringing water for basic household needs and farming. Now, over 2000 households have improved water access. Regionally, there are differences between the two provinces of North Cotabato and Lanao Del Sur. North Cotabato experienced greater progress and was more effective at gaining the trust and openness of the people and local authorities. Long standing cultural and religious differences between communities and more regional conflicts could explain the slower progress of Lanao Del Sur, as may the positive environment and acceptance of good governance in the municipality of Arakan in North Cotabato. Program design was overall sound and is characterised by establishing community Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 6 and local government structures and partnering with NGOs such as Don Bosco, German Doctors and Maradeca. Both these design features assisted in the socialisation process and identification of vulnerable households across previously unassisted remote areas of Mindanao. In working with local authorities, ACF needs to continue to engage and be aware of government protocols, procedures and constraints regarding planning and budgeting of social services and infrastructure. Local and provincial governments were aware of poor basic services, but are constrained by poorly designed development plans, long lead times for processing infrastructure plans, limited tax revenue generated in remote areas and limited allocated budgets for their region. Moving forward, ACF need to identify these gaps when applying their programs and incorporating cross-cutting good governance initiatives. This will facilitate an approach that resolves issues with the entire community and encourages better delivery of local government plans. Overall, ACF has developed a solid model for integrating nutrition, food security, water and sanitation, and good governance. There is however, greater need to implement key services in partnership with local authorities, whilst ensuring transparency, to access the full potential of reducing poverty across Mindanao. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 7 1.0 Brief Background 1.1 Introduction ACF has been working in The Philippines since 2000 in both emergency and development settings. This new program ‘Support for the Socio-economic Development of the Communities within Spanish Development Cooperation’s Action Zones in the Philippines’ or simply called ‘The Convenio Program’ was developed to contribute to poverty reduction in vulnerable communities across Mindanao which has long been affected by conflict and limited access to basic services. Funded by The Spanish Agency for International Development Cooperation (AECID), the program set out to introduce a new approach to programming for ACF. Key to this new approach was integrating core ACF activities such as Nutrition, Food Security and Livelihoods and WASH together with the cross-cutting issue of Good Governance. The aim of the program is to provide basic services while developing the capacity of local institutions to deliver more effective service, whilst also encouraging community leadership in the development of local planning and ownership of activities and services. 1.2 Objectives of program1 1. To improve socio-economic conditions by facilitating access to services and means of food security, water and nutrition at household and community level through reinforcement of civil society. 2. To improve the delivery of basic services at local and national level through awareness and capacity building in good governance and advocacy in child malnutrition. 1.3 Target Areas The program covers several municipalities across Mindanao deemed to be the most vulnerable, remote and high risk of child malnutrition. They include: Kapatagan in Lanaodel Sur, with barangays (villages) Proper Kapatagan, Bongabong and Daguan; Arakan in North Cotabato with barangays Ganatan, Kinawayan, Maria Caridad and Tumanding; and President Roxas also in North Cotabato with barangays Bato-bato, Datu Inda, Datu Sundungan and Lama-lama. The map below illustrates the key project area across Mindanao visited by the evaluation. 1 Adapted from the Program Proposal 2010 Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 8 The evaluation was able to access Kapatagan in Lanao del Sur, Arakan and President Roxas both in North Cotabato, and Cotabato City for visits to beneficiaries, partners and local institutions. A trip to Manila enabled visits to the Department of Health, UNICEF, AECID and ACF Capital Coordination Office management and staff. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 9 2.0 Methodology 2.1 Evaluation Goals2 The evaluation will review the implementation strategy and progress up until July 2012. The analysis and findings contained in the evaluation is based on a review of the program documents and supported by concrete data and information, including site visits and interviews with a representative sample of collaborators and beneficiaries. The evaluation will make recommendations and lessons learnt for each sector and the program’s overall strategy. The evaluation will consider the program’s new integrated approach and its effects on achieving program goals. The evaluation should offer recommendations for measuring and demonstrating the impact on beneficiaries of this approach. The analysis should focus not only on the impact of the planned activities but also on the processes, strategies and methodologies followed, based on the criteria defined in the evaluation framework. The evaluation will provide an overview of the program’s main technical focuses: Nutrition, Food Security and Livelihoods, Water and Sanitation, and Good Governance. 2.2 Evaluation Criteria The evaluation will examine the following key criteria utilising DAC3guidelines. Quality of program design Sustainability Relevance/Pertinence Coherence Efficiency Effectiveness Involvement/Participation Control Integrated focus Cross-cutting elements and issues 2.3 Evaluation Tools The evaluation was conducted using a mixed qualitative method, utilising existing program documentation, focus group discussions, key informant interviews and site visits. These provided a thorough examination of program activities within the limited timeframe. The evaluation combined two consultants who examined contrasting regions of the program. Both consultants examined food security, water and sanitation, nutrition and good governance activities at local, municipal and provincial 2 3 Extracted from the Evaluation Terms of Reference OECD Development Assistance Committee developed guideline standards. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 10 levels using best practice participatory methods including group simulations, most significant stories and the ‘river of life’ mapping to assist the learning process. Interviews were conducted with ACF staff, local partners, community leaders and beneficiaries to obtain a comprehensive review of program activities. A full list of key informants interviews and documents reviewed is listed in annex 1. Semi-structured interviews were guided by targeted questions. Questions examined the outcomes and on-going strategy of the program in addition to program activities. Additional site visits across Mindanao provided the consultants an opportunity to inspect programs and meet communities. Following the fieldwork in Mindanao, learning workshops were conducted in North Cotabato and Lanao Del Sur for a mix of stakeholders at different levels, including community members and field staff to share in a series of learning and simulation planning activities. A report will be prepared and shared in early October 2012. Feedback and comments from ACF Headquarter Coordination staff will then be incorporated into the final evaluation report. Time constraints in the field resulted in the two consultants examining two different areas for the fieldwork. One consultant examined North Cotabato and the other visited Cotabato City and Lanao Del Sur, both for a period of one week only. Security issues restricted the time in the field meeting stakeholders, as the consultants had to return to a remote base daily. The consultants shared their findings and discussions from FGDs and key interviews. Both consultants met with Manila ACF staff, as well as Ministry of Health and UNICEF representatives. Lack of progress and success in agriculture activities and timing of cropping season resulted in very few examples of food security programs being examined by the consultants. The consultants were able to meet with farmers and representatives across government and partners to discuss FSL strategies and activities, however analysis of actual results was limited. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 11 3.0 FINDINGS AND DISCUSSION 3.1 Quality of Program design The evaluation found that program design consulted with community and government institutions, examined past ACF and partner experience, analysed risk and made preparatory assessments before establishing this new integrated approach to programming. Program goals and objectives provided a clear framework to deliver an integrated mix of traditional ACF initiatives including Nutrition, FSL, WASH and Good Governance. Stakeholder analysis reveals overall support from ACF partners has been sound and ready and able to continue over the next two years. 3.1.1 Stakeholder Analysis The following table summarises stakeholder involvement in the program. It identifies strengthens, weaknesses and opportunities for the next 24 months of the program. Stakeholders ACF Strengths Weaknesses Core values FSL and WASH. New using Nutrition + good governance Experience working with vulnerable communities across Mindanao New integrated approach for ACF Philippines AECID Madrid Donor Funding and past experiences Distance and timeliness of approval/requests. Maradeca Community development and local experience Strength working remote and vulnerable communities Adapting to new approach Don Bosco German Doctors/Montaner Hospital Food security experience Health and Nutrition focus Effective management of ITP Small team with large workload Little leverage over ACF to make changes Limited resources Links to Hospital UNICEF Supplier of good (UTF, medicines) and experience across the Philippines No exit strategy or historical plans to build capacity Opportunities Deliver complex program with full support and leadership of local institutions. Link core programs to demonstrate the benefits of an integrated approach. Continue support for vulnerable communities in Mindanao Implement and support ACF’s activities in an integrated approach. Work within tight deadlines to get program back on schedule. Build the capacity of local health clinics and skilled health professionals. Sustaining success in ITP services given sustained support Build a sustainable health service in the Philippines Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 12 Local Centers Health Able to provide health and nutrition essential services. Effective management of OTP Community Health Volunteers Ownership of activities and dedicated to helping their community Farmer Groups Sharing of farming techniques including indigenous methods BAWASAs Strong connection with community BMPU Ownership of WASH Representative of local interests and cross section of community. Lack of Doctors and limited resources and trained nurses and midwives Challenges to travel due to lack of funding. Limited Capacity Renting land, Low capital and limited resources to buy inputs. Limited capacity and Knowledge of hygiene practices Apathy towards government Lack of skills and access to training. MPMU Some technical skills and planning authority CTF Budget and planning power. Limited understanding of Development planning process. Slow bureaucracy Limited connection with local community Restricted budgets and poor timeliness of activities Limited transparency and accountability. Continue to deliver services and provide professionals post-ACF program Sustaining success in OTP given sustained support Continue to maintain up-to-date skills and provide volunteer services. Utilise new techniques in that may result in short term loss of income. Maintain existing water facilities and plan with local government for future works. Be effective in advocating local institutions provide social services. Connect with local communities and assist planning and provision of social services. Transparent and accountable Barangay Development Planning process and implementation. 3.1.2 Overall Program The design set out to create synergies in implementing the different program components to improve the delivery of basic services, which aims to reduce poverty in rural and peri-urban communities. The logic of the program is sound and attempts to save time and resources and link all activities to reducing poverty. Local, municipal and provincial working groups have supported the program. The design and structure of local stakeholder groups is representative and well positioned to help facilitate future ACF activities. Moving forward, theses groups need to feel connected with ACF so each level of bureaucracy can add some value. The evaluation observed PMUs working better at the local level where communities are able to make quick decisions and act immediately. The evaluation met with Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 13 provincial and municipal government PMUs and these groups felt somewhat disaffected, often only meeting once a quarter to receive reports from ACF. They have limited involvement in the programs and often representatives send proxies to the meetings. Better use of their time may be to include a case study from the program and examine best practices or critical issues that need resolving in their region. This promotes a more pro-active exchange and encourages fast solutions to community problems. The evaluation would discourage future meetings that simply lecture or present findings, but rather engage through participatory methods such as simulations or group sharing exercises. Included in the design of the cross-cutting issues such as good governance, is a ‘bottom up approach’, which translates to promoting community engagement and discourse in the planning process, with the key result the creation of local Barangay (village) development plans (BDPs). ACF’s design is to encourage greater transparency and accountability of authorities from the community by promoting involvement in the design and resourcing of key social services. ACF has a dedicated resource person who is responsible for encouraging this process. More education and advocacy is needed in the community to highlight the process of planning and allocation of resources. ACF should also motivate communities to pressure authorities to deliver planned services on time. At the community level, the design of the program has been effective in focusing on households with severely acute malnourished (SAM) children. ACF has designed its nutrition activities around these households and as a result has already made significant gains in reducing SAM children in the targeted areas. Other activities including food security and livelihoods and WASH are aimed at improving some of the underlying causes of poverty, which are poor household diet and limited access to water and sanitation. Food security activities were observed with farmer training and provision of some inputs (tools and seeds) already complete. However, due to late cropping seasons, poor harvest and some planning delays, the evaluation found farmers have made limited progress on increasing food security4. Further analysis from the monitoring and evaluation database indicates that no significant changes have occurred to productivity. More results however are expected in the coming months as more activities are rolled out. The evaluation recommends locally sourced and appropriate inputs such as non-hybrid native seeds, organic fertiliser and natural pesticides. Demonstration plots led by local farmers need to be supported as well as small home gardens for vulnerable households. ACF has already provided strong design to its WASH activities, indicated by significant number of households with reliable access to water and sanitation. Several schools have also benefited with over a thousand students are now able to drink clean water and access new sanitation facilities. The design of hygiene activities in the form of training and special events such as hand washing days in 4 Consolidated FGD and meetings with Farmer Groups during the evaluation period September 2012 Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 14 schools has helped reinforce the importance of hygiene and its links to good health and prevention of malnutrition. The design moving forward needs to focus on a strong exit strategy and handing over activities. This should be planned and co-led by local authorities in a complementary approach with local partners. ACF should be encouraged by the work at community levels and energy to move things forward. The big challenge will be getting local authorities moving and providing real outcomes at the Barangay level. Mentoring and a practical one-on-one approach would help engage busy local government and prepare activities for handover. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 15 3.2 Sustainability The sustainability of the program is still largely an unknown quantity and depends on how well local institutions and user groups will continue to maintain and lead key services established by ACF. This will be better known as the program is handed over in approximately 12 months. The evaluation does however recognise that sound decision-making and planning has provided the foundations for sustainable activities. The big push from ACF over the next 12-18 months should be on mentoring local partners and institutions by providing hands-on-leadership of program activities and building the technical and administrative capacity. This should be complemented with strong education and advocacy work in the following areas: Leadership and active planning for nutrition and care practices, food security, and WASH to address underlying causes of malnutrition. Effective governance from local and provincial authorities and in-line with best practice standards, Increasing community pressure on authorities to improve transparency, and Using performance indicators and audits to increase accountability. 3.2.1 Community Contributions and Counterparts Overall, water committees or BAWASAs have demonstrated positive signs across both regions by collecting funds to maintain existing water infrastructure as well as follow up local authorities to ensure water supply. For example in village Proper Kapatagan, the BAWASA committee has demanded support from the local government, particularly through the village council leaders, so that they can be allocated some budget for regular maintenance of the village water system and to ensure inclusion of the budget for water maintenance in the Barangay Development Plan (BDP). Other internal initiatives for financial and in-kind contributions among households have commenced. Some examples include: For maintenance of tap stands and pipes, some cluster groups starting collecting voluntary financial contributions (ranges from 5-20 Philippine Peso (Php) from households. One cluster collected 300 Php, which they used to buy rubber, couplings and faucet for repair of their tap stand. Other cluster also started to collect voluntary contributions just in case repair would be needed. The money is collected and held by the leader. A village chief in Kapatagan had initiated planting of bamboos around the main water source. He encouraged the BAWASA committee to take turns to take at least a monthly visit in the area to ensure that the bamboo is cleared from the water source. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 16 ‘The LGU of Kapatagan have allocated a monthly honorarium at least for meals and travel allowance of BHWs while at work. And, will be next lobbying for the honorarium for BNS’. Beneficiaries’ and Local partners Learning Workshop Kapatagan PMUs at all levels (Barangay, Municipal and Provincial) were informed of ACF’s activities and provided in-kind resources to the program. The majority of these groups recognised the need to address the key causes of poverty across vulnerable communities as well as improving important cross-cutting issues such as local governance. They recognise the need to strengthen government institutions capacity to deliver key services that reduce poverty. Nutrition, Food security and WASH are key areas they know they have to improve, however have historically struggled with planning and design, timeliness of implementation, and managing limited budgets. The PMUs established by ACF are keen to improve and represent an opportunity for ACF and its partners to build new skills and delegate responsibility of the program to local institutions over the next 12-18 months. 3.2.2 Government Focal points and skills transfer Focal persons in local government have been identified and so far been effective at setting up meetings and coordinating learning sessions. In terms of nutrition, the evaluation found the ACF nutrition team had transferred significant skills to the Rural Health Unit (RHU) staff across North Cotabato and Lanao Del Sur. This is particularly evident from working with the RHU doctor, nurse and midwife at municipal levels. Currently midwives provide direct support and supervision of Barangay Health Workers (BHWs) and Barangay Nutrition Scholars (BNS) who lead nutrition activities. This is a positive step in facilitating the delegation of tasks to local partners. Furthermore, nutrition screenings were already using MUAC and weight for height measurements and are now integrated with the regular weighing at RHU level. ACF nutrition staff is continuing to provide supervision and technical inputs, with gradual delegation of all supervision to local partners to be completed by end of December 2013. For the FSL program, ACF is striving to work in coordination with the Municipal Agriculturist Officer (MAO) and at the local government PMUs. These are areas that need to be strengthened in the case of Kapatagan and North Cotabato. In the case of President Roxas and Arakan situated in North Cotabato a representative from the Department of Agriculture has some disagreements with ACF’s approach to food security, specifically highlighting that inputs are not always sustainable and farming methods have been used before by other NGOs without success. Clearly there is an opportunity to build this relationship and provide a strong focal point for the future of ACF food security and livelihoods activities. For WASH, the focal persons in government seem more or less to be ineffective in both provinces proving little or no support in Arakan and President Roxas. In Kapatagan in Lanao Del Sur the position has been vacant highlighting the lack of priority for local government on WASH. There needs to be a push for ACF and its Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 17 partners to encourage the recruitment of a focal person, which should be the sanitary inspector, under the Municipal Health Office (MHO). 3.2.3 Cooperation with Other Strategic Partner Organizations At the community level, local partners such as MARADECA, Don Bosco, German Doctors and Montaner hospitals work tirelessly to complete the work demands from ACF. These partners provide a valuable connection with the local community and ability to assess and select vulnerable households. At national and international levels, the program coordinates effectively with the National Nutrition cluster and with government agencies including the Department of Health (DoH), Department of Interior and Local Government (DILG), and the Department of Agriculture (DoA). UNICEF is also a strategic partner that resources a proportion of the nutrition program. 3.2.4 Exit strategy and long-term approach ACF has developed an exit strategy, though continued emphasis should be placed on capacity building activities. An exit strategy should include extensive training and one-on-one mentoring with allocated counterpart government and partner staff. Potential strategies for reinforcing capacity building in local institutions to: Engage at the design phase of the program or specific activities to provide understanding on the principles and objectives of the program. Provide links to industry leaders and associations that support agricultural industries in The Philippines; so to strengthen local skills and opportunities for trade. Provide examples of best practice from other regions of The Philippines or similar programs from other countries; so to provide ideas, guidance and inspiration to community programs. Involve local partners and local authorities in monitoring and evaluation; so to provide understanding of program outcomes and impacts on the community Mentoring and coaching in on technical skills and program management; to improve ability to lead and implement programs. Field-based practical training to demonstrate the implementation of sustainable farming methods and construction of infrastructure. Conduct early labour-market assessment to identify successful local private and public enterprises. These entities could then be expanded or duplicated and help address the challenge of expanding and scaling up of agricultural output and identifying new market opportunities. Attract and establish private-public investment opportunities so investment can be made in business and public infrastructure. This will have a positive effect on local stakeholders, as they must be competitive and therefore improve their own capacity. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 18 Continue to advocate local and regional government to provide adequate infrastructure and provide financial and human resources to address a range of local capacities in the public and private sector. 3.3 Relevance/Pertinence ACF and its partners have delivered a much-needed program in remote areas with limited services and previously high incidence of poverty. ACF’s mix of core development initiatives is highly relevant to a population living in remote, poorly serviced regions affected by conflict and with limited access to economic resources. Lack of any real service delivery by local authorities and little confidence from the communities provide a good basis for initiating an integrated program with crosscutting themes of good governance. 3.3.1 Target Population Degree of Satisfaction The evaluation found a high level of satisfaction with ACF’s program. This is probably not surprising given the lack of real assistance or support communities have received. Nevertheless, ACF has provided real and relevant programming addressing immediate and basic health/nutrition, food security and water and sanitation needs of targeted communities across Mindanao. ‘Through the ACF program, our group members helped loan farm equipment to those doesn’t own. The program provided a forum where we can discuss and share our farming experiences with one another. It is a step towards developing mutual trust and caring that would result in complete peace in our place’. Norodin Mudag, farmer, Lanao Del Sur Target populations across Kapatagan, President Roxas and Arakan municipalities have been very satisfied with nutrition, FSL, and WASH services extended in their communities. Water infrastructure and farming activities had been all identified as the priority need by the communities at the Barangay level. Across both Arakan and Kapatagan there were some dissatisfaction with the delivery of some agriinputs, including use of non-native seeds to the area and purchase of expensive organic fertilizer. Looking forward there is obviously a need to push for locally sourced seeds and material for future farming activities. Parents of previous SAM children were very happy after almost all of the children were treated and returned to a healthy weight after admission to ACF’s nutrition program. The number of SAM children in all program regions has fallen significantly especially in second year of implementation, due mostly to early detection and treatment by local health centers and mobile health volunteers. ‘We have received good training and support from ACF and we are now putting it into practice. Local women and their children can now access health and nutrition services easily without long distance of travelling’. Health Workers FGD President Roxas Datu Sundungan Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 19 Working in challenging terrain and under limited budgetary conditions local health units supported by ACF and its partners have been able to provide health and nutrition services on a free or affordable basis to vulnerable households. In addition to treating SAM children, local health units have been able to provide nutrition education and advocacy in the community. This work has complemented the treatment and detection work being carried and contributed to reinforcing messages of good nutrition and care practices. 3.3.2 Program Assessments To ensure a more relevant program, ACF planned several assessments and surveys, including a SMART survey, KAP surveys, and the Household Economic Assessment. These were conducted by ACF or external organisations with some participation of local government and the community. These baseline data have been collected and were the basis in formulating appropriate and relevant program strategies as well as utilising for mapping data. Mapping SMART data has been well received and understood by local leaders who were able to easily understand progress through visual aids. 3.3.3 Operational Strategy & context ACF’s approach and methodology was relevant as it addressed key areas and is encouraging communities to become self-sustainable in household nutrition, food security and WASH. ACF’s activities are implemented with full consideration of local custom and culture and evaluation site visits illustrated appropriate construction of sanitation and WASH infrastructure. Use of local staff and engaging local NGOs to lead program activities has led to strong acceptance by the community. The evaluation recognises the challenges ACF faced at the end of 2010 when establishing programs at the same time as elections and high turnover of government administration and local staff. Beneficiaries, local institutions and industry stakeholders should continue to be engaged at the design phase of the program or activities, to increase ownership of issues and solutions. In Annex 2, local Health and WASH initiatives are highlighted by examples of local involvement in the design and delivery of successful community nutrition and WASH programs. ACF should improve the way they support their local partners. For example, the teams of Don Bosco in North Cotabato felt that ACF simply ‘downloaded’ their very busy work plan with limited support. Often the teams were only provided a tight work plan and had limited involvement in the planning and little time to understanding how integration fully works in the context of this program. Furthermore, various staff from both Don Bosco and ACF would request meetings with several different government officials to request the same information for WASH, FSL, Nutrition or Good Governance. Clearly there is room for better internal communication and integration of planning and administration of tasks. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 20 The evaluation believes ACF should continue with the planned gradual delegation to specialist NGOs such as Don Bosco and Maradeca in collaboration with LGUs. This provides greater learning and capacity across the NGOs and LGUs in design and delivery of basic services. Ultimately, ACF should be promoting LGUs and local institutions to lead programs and continue to step back from a reliance on NGOs in the long-term. 3.3.4 Knowledge of the community needs Overall, the program demonstrated sound knowledge and awareness of community needs, local custom and the needs in child malnutrition, household food security and access to water and sanitation. Through baseline assessment of program areas and strong community facilitation, ACF identified many households to be food insecure as a direct result of lack of diversify in household diet, poor agricultural output, and limited access to water and sanitation. 3.3.5 Geographical coverage and targeted population Geographical coverage was relatively spread covering an independent component city (Cotabato city) and two provincial areas (Lanao Del Sur and North Cotabato). The main provincial areas are relatively far apart but facilitated by sub-offices and guesthouses for staff to reside close to the program areas. The targeted population was selected despite being in remote location, highlighting ACF’s goal of reaching the most vulnerable. These communities represent some of the most vulnerable and most impacted by conflict and generations of poor access to basic services. 3.3.6 Identification and targeting of beneficiaries Beneficiary targeting amongst farming and water groups was sound and targeted vulnerable households through Household Economic Surveys and vulnerability assessment. Water infrastructure identification was supported well through village water committees (BAWASA), which have already helped to plan and maintain water tap stands, water sources and piping. Targeting of government institutions at local, municipal and provincial levels was effective and has provided representative bodies who are able to connect the realities and challenges from community to decision making at government levels. This structure is well established, however needs a big push moving forward to ensure these local institutions feel actively engaged and are held accountable for their actions. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 21 3.4 Coherence ACF has taken practical steps to deliver a program that is coherent and ensures different program components are integrated. ACF designed activities after sound community needs assessment and consultation with local institutions. It has provided some long-term strategic outputs including developing national nutritional protocols. 3.4.1 Formation of the Program Management Unit (PMU) at Different Levels In theory these groups are well structured, but in practice more needs to done to encourage more pro-active participation. This is particularly so at municipal and provincial levels, were local government agencies and officials are only told of program progress. This could be done by increasing the stake PMU and CTFs have in these activities and encouraging more transparency to the public. Specifically, ACF could encourage making meeting minutes, decisions and action-points public notice. They could also co-chair and mix up these different levels of PMUs to share different perspectives. For example, in the learning activities conducted in Arakan and President Roxas for the evaluation, different groups (LGU, PMU, CTF, BAWASA) were formed from a mix of participants. This provided a sharing exercise that highlighted the importance of different perspective and working with different levels of government and community. 3.4.2 Steps taken by ACF to integrate different program components ACF has successfully added nutrition into its programming within an integrated approach to tackling reducing child malnutrition. This has translated to a reduction in child malnutrition with further progress being made to develop the local capacity of health units to continue detection, treatment and prevention of malnutrition. ACF has actively participated in the national nutrition cluster meetings and in a series of workshops to draft and finalise The Protocol on Philippine Integrated Management of Acute Malnutrition (PIMAM). It has been submitted to the Department of Health (DoH) Secretary and is waiting approval. In the meantime, ACF promoted the use of Integrated Management of Acute Malnutrition (IMAM), which is being integrated to the existing IMCI services at local health centers, which include the midwives and community workers (BNS and BHWs) managing the OTP centers. ACF has also contributed in the development of a user-friendly pocket tool on nutrition management in emergency/ disaster, which will provide guidance on implementing nutrition responses in the field during emergencies. Food security activities experience mixed success to date with harvests impacted by poor weather, external inputs and lack of training on fertiliser production, limited seeds saving, and lack of demonstration plots. In the 2011 harvest, ACF was running short on time before the end of the planting season in Arakan, North Cotabato and encountered a lack of available seeds. As a result ACF was only able to source seeds from outside the region of Arakan. These seeds failed, coupled with application of too much fertiliser brought in from outside. Seed banking and seedling production could be utilised to mitigate these issues and provide a more food secure region. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 22 Moving forward, food security activities need to embrace more locally sourced and produced organic fertiliser, utilise seed saving initiatives and local farmer led demonstration plots. These FSL activities must be complemented with education and advocacy to link food security to household nutrition. WASH and hygiene promotion provided education on hand washing and proper sanitation, which complemented some of the nutrition and care practices. This component could be expanded further to include some related child health messages including anaemia, worm infection and dysentery. ACF has been careful to consider previous actions in the current intervention areas. Design and planning has taken into account previous work ACF has completed across the Philippines and in other regions. ACF has a strong track record of implementing Nutrition, FSL and WASH programs in vulnerable communities across development settings, so lessons learnt and case studies were examined early in the program. Following on from this assessment and understanding, a standard operating guideline was developed to provide a clear and defined set of rules and expectations for the program. ACF has coordinated well with other agencies, institutions, government entities, and NGOs. It has taken several steps to ensure activities are coordinated including formation of PMUs, participating and leading in cluster meetings for nutrition and agency meetings for Mindanao. ACF staff appeared to be well connected with local partners and indeed some have significant experience working with them in key sectors and regions of the program. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 23 3.5 Effectiveness The program over the last two years has built an effective foundation for improving socio-economic conditions that address malnutrition, food security, water and sanitation, and good governance for over 7000 vulnerable households across Mindanao. Targeted households now have reduced levels of child malnutrition by over 90%5 and now able to access more effective local nutrition and health services. Over 9006 farmers have received farming inputs (seeds and tools) and training in farm and business planning. Local water committees or BAWASAs have been established and are contributing to maintaining and providing communities and schools access to clean and safe water. Local institutions have started to get more involved with ACFs program with more work to follow to build strong apparatus that will deliver basic social services. 3.5.1 Nutrition Nutrition activities have contributed to significant reductions in child malnutrition. In the table below all three, municipal program areas have demonstrated a large drop in the number of severely malnourished children (SAM) detected. Municipality 2011 2012 SAM SAM SAM SAM Detected Treated Detected Treated Arakan 99 95 11 8 President Roxas 56 56 11 8 Kapatagan 52 52 7 7 Total 207 203 29 23 Table 1: Number SAM Cases Detected and Treated (taken ACF’s July 2012 Monitoring report) The evaluation recognises the success of this drop through the capacity building of local health clinics, provision of education and therapeutic feeding program, and development of human resources such as community volunteers in health and nutrition. 3.5.1.1 Nutrition before ACF Program Based on Household Economic Assessment conducted by ACF before the commencement of program activities, households were able to cover their food requirements but household diets are extremely high in carbohydrates (rice, corn, tuber), low in vegetables and protein. This shows a high risk of food insecurity during disasters or acute change and support initiatives that involve distribution of vegetable seeds, planting of leguminous seeds (for protein) and a variety of local fruits, and livestock development. 5 6 Based on figures collected in ACF July 2012 Monitoring data and discussion with Rural Health Units. Based on ACF 1st Monitoring July 2012 Progress Reporting Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 24 3.5.1.2 Tackling Malnutrition The program’s success is highlighted by a significant reduction of acute malnutrition in the target communities. In doing so, the program has effectively promoted the mainstreaming of IMAM (Integrated Management of Acute Malnutrition, within the IMCI (Integrated Management of Childhood Illnesses), which is a regular program of Department of Health’s – Rural Health Unit (RHU). This is also referred to as the integrated IMAM-IMCI, which includes prevention, detection, referral and treatment of acute malnutrition. Referral systems have been set up in the target municipalities through Out-patient Therapeutic Program (OTPs) integrated at the RHU and Health Centers/Stations of each target municipality and stabilization centers at hospitals serving as Inpatient Therapeutic Program (ITPs). SAM patients without complications were referred to OTPs and SAM patients with complications were referred to ITPs (i.e., Montaner hospital in Lanao del Sur and German Doctors hospital in North Cotabato). The implementation of the integrated IMAM-IMCI, in general resulted in strengthening the operations of the local health structures not only at RHU (municipal) level, but also at the Barangay health stations (BHS, village level). This includes enhanced capacity of the health staff, paediatric nurses, midwives and other volunteer staff at RHU, such as the BHWs and BNS. ACF nutrition team has provided effective trainings and necessary technical support, including the improvement of relevant recording and reporting needs. UNICEF has effectively supplied some basic medicines, therapeutic foods and anthropometric materials, though a long-term sustainable supplier is needed from local health and government authorities. 3.5.1.3 Functional OTP and ITP Success can be attributed to the increased nutrition screening and referral system of SAM (severe acute malnutrition) children. This process has now been institutionalised with the establishment of OTPs at the Rural Health Units and Health Centers/ and an ITP at German Doctors German Doctors’ Hospital (North Cotabato) and the Montaner government hospital (Lanao del Sur). The number of OTPs established has increased and shown in the table below. It demonstrated a significant increase in the number and access for communities who were previously isolated from basic health services. Municipality 2012 st nd Total 1 Qtr 2 Qtr Arakan 4 6 7 17 President Roxas 4 6 5 15 Kapatagan 3 0 0 3 Total 11 12 12 35 Table 2 Number of functioning OTPs set-up at RHUs and Health Centers/Stations with access to RUTFs and routine medicines 2011 Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 25 3.5.1.4 Improved Capacity of Health Center Staff Overall, Rural Health Unit staff expressed their confidence and improved knowledge in nutrition screening and treatment of SAM patients. Growth monitoring using the MUAC and weight-for-height/length are new technical skills they now utilise, and complemented their old system of weight-for-age only. Treatment of referred SAM patients had been effective, particularly with the availability of medicines, vitamins, weighing scales and Ready-To-Use-Therapeutic-Food (RUTFs), which had previously been in short supply. Moving forward, more training and one-on-one mentoring of BHWs and BNS through RHU staff is needed to reinforce and ensure best practice and a sustainable service is provided post ACF support. Photo 1: Functioning OTPs in Lanao Del Sur Province 3.5.1.5 Improvement of IYCF Practices The improvement of IYCF (infant and young child feeding) practices; particularly of SAM patients who have been treated and recovered will be an important measure for follow-up to assess program impact. There is no program data yet to validate the changes, however the next KAP survey will be conducted at the end of 2012 to provide data for analysis. For future monitoring of IYCF, SAM patients who have recovered and the MAM detected should be the main focus. The findings in the KAP survey should help define a simple set of verifiable indicators that can monitor changes in breastfeeding, complementary feeding practices of young children, and care of pregnant and lactating mothers. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 26 3.5.2 Food Security and Livelihoods As of July 2012, the program has provided 986 farmers with access to tools and typically provided seeds such as corn, rice and various vegetables seeds like eggplant, squash, okra, and bitter gourd. The table below illustrates the proportion of farmers selected in each municipality. Changes to date have been modest with production steady or down due to cropping failure, monsoon weather or program delays. Farmers have been overall happy with the program, which has provided new skills in organic and sustainable farming, fertiliser production, farm planning. Moving forward, greater focus should be placed on locally sourced inputs and organic farming. Furthermore, ACF should push advocacy for non-hybrid seeds and natural pesticides, and leadership from the DoA and supporting agencies. Municipality Target # of Beneficiaries 750 750 500 st 1 Batch Total # of Beneficiaries Agri IGA Arakan 235 129 364 President Roxas 135 240 375 Kapatagan 224 23 247 Total 594 392 986 st Table 3. Beneficiaries of 1 batch of Agriculture and IGA inputs 3.5.2.1 FSL situation Before ACF Prior to ACF programs, farmers have been using conventional ways of farming including: reliance and prolonged use of commercial fertilizers and chemical pesticides, mono-cropping (mainly corn and rice with coconuts, banana, cassava), and using slash and burn techniques. These have all contributed to poor soil conditions, an increased in pests and reduced long-term farm productivity. There was a lack of knowledge of other farming system and lack of support from local institutions. Typically less then 50% of farmers don’t own their own land and resort to borrowing money for farming inputs often resulting in large debts to the landowner. 3.5.2.2 Farm and Business Planning by Beneficiaries A total of 986 beneficiary farmers have been trained on sustainable agricultural techniques and developed farm and business plans. As indicated in the table below, over 95% of the target farmer beneficiaries who participated in the trainings have produced their farm and business plan. After developing these plans, ACF identified the relevant agricultural and off-farm needs to be provided to farmer beneficiaries. The majority of target farmer beneficiaries received various seeds, farm tools and sacks of organic fertilizers. Moving forward, ACF and its partners must ensure these plans are implemented. Support and leadership from DoA and local institutions need to assist to ensure crops are successful and marketed effectively. ACF needs to facilitate to reduce the perceived barriers between farmers and DoA caused by mistrust and lack of historical support from local government. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 27 Municipality Agri Beneficiary Farm Plan Developed Arakan 235 235 President Roxas 134 134 Kapatagan 224 224 Table 4. Status of Farm Plan and Business plans Beneficiary 129 240 23 IGA Farm Plan Developed 114 240 23 Total Plans Developed 349 374 247 3.5.2.3 Effects on Farmers’ Yield Up until August 2012, there has been mixed success in crop yields across all areas of the program. Many farmers had not yet planted their seeds due to an extended rainy season. Farmers who had planted after distribution noted poor results especially with corn when planted with purchased organic fertilizer sourced by ACF. Those who used the purchased imported organic fertilizer reported poor corn yields, which discouraged other farmers to try to use the organic fertilizers. Those who planted corn but did not use the organic fertilizer achieved better yields. Moving ahead, ACF should discourage the future purchase of imported organic fertiliser by NGOs, but instead provide training to farmers on the production and proper application of locally sourced organic fertiliser. ‘We used the fertiliser and seeds provided by ACF but our corn grew fast early, however turned yellow, died and produced no real crop’. Farmer from Farmer group Arakan, North Cotabato From discussions with Municipal PMUs the evaluation would recommend immediate follow-up to train famers on proper use/application on site. In addition farm site visits should be conducted by the PMU and MAO before production and application of fertiliser. The evaluation also recognises that ACF had to provide alternative seeds for vulnerable households when local seeds were not available, however would always encourage locally sourced non-hybrid and non-genetically modified (GM) seeds. There is an immediate and long-term need for seed savings and seedling production to mitigate shortages of essential crop seeds. This is something that is cheap and easy to replicate by local farmers and can be easily supported in ACF’s existing program. This would provide a short-term safety net for household food security to manage the risk of crop failures or loss of temporary livelihoods. 3.5.2.4 Formation of Farmer Self-Help Groups The formation of farmer groups was productive as it enabled sharing of issues and an association that is able to represent at various levels of government. The evaluation found these groups useful and should be encouraged. However, there is an underlying lack of connection between the farmer and key agencies such as the DoA. This is perhaps one challenging task, which ACF’s good governance activities need to address in order for better planning and support for many subsistence farmers. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 28 Photo 2: Farmer Help Groups participate in organic corn planting in Arakan Cotabato 3.5.2.5 Future FSL Opportunities Moving forward, more focus should be placed on developing demonstration plots and farmer field schools led by local farmers. Success is contagious, so demonstrating successful methods in the community will enable other farmers to learn and replicate. This process should be led by lead famers in the community, and supported by a partnership between farmer groups and the DoA. Often, successful indigenous practices are forgotten by local farmers and not considered by NGOs. ACF and its partners should assess existing successful practices and use locally available technologies when planning farming activities. These may include production of organic fertiliser with local manure and organic materials, natural pesticides and cross planting to discourage insects. The Program should consider supporting other Income Generating Activities (IGA) such as value adding support businesses. ACF conducted a household survey and market study but hasn’t fully utilised the findings. There must be several opportunities buried in these studies to develop more than just farming businesses. For example, Household Economic Study produced findings that recommended priority for alternative IGAs including livestock raising and post harvest businesses such as milling. These need prioritising in the next 12-18 months to expand livelihood opportunities. For the whole local economy to grow there must be a more diverse range of industry and supporting business. A good example of this is ACF’s ‘Solid Waste Management Program’ in Cotabato City, Mindanao. There is opportunity to expand this into other regions and material such as plastics and metal. The same applies to expanding agribusinesses to areas of Kapatagan, which currently have no added IGA activities up until July 2012. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 29 3.5.3 Water, Sanitation and Hygiene (WASH) ACF has provided essential water and sanitation facilities to remote communities across Central Mindanao in Lanao del Sur and North Cotabato that have shown significant impact. The table below illustrates completed work including six water sources and over 60 tap stands. The program has also supported six schools with toilet and sanitation facilities. The evaluation found these facilities to be in mostly good condition and functioning well in North Cotabato however in Kapatagan there was a school toilet with no faucet in tap stand for washing. Hygiene activities have impacted on the behaviour with teachers and health workers reporting reduced levels of dysentery and infection at schools and in the community. There is however improvements needed as the RHU in Kapatagan reported 24 cases of diarrhoea in 2011 and 30 cases as at June 2012 for children less than five years of age. This is still high and could be linked to the lack of toilet facilities in homes, threat of contamination due to lack of regular monitoring. Table 5. Water Systems and Tap Stands Completion and Coverage (taken from July 2012 monitoring report) 3.5.3.1 The Situation Before ACF’s program Many, families described their situation before ACF WASH activities in the community as difficult and very challenging, as they had no access to safe drinking water source. Typically families relied only on only one source of water or spring usually located in the highlands often an hour or more walk. Regular bathing of children was difficult with parents describing their children as always being dirty. Washing of clothes typically done by women was difficult, as they would have to physically walk up a hill to the main source. Household gardens were not possible as there was simply not enough water. 3.5.3.2 Impact on the Target Population Families, particularly women, were very happy that they are able to wash daily and supply clean water to their children. They could regularly wash their clothes and start planting small home gardens. Children are now clean and according to community leaders in PMUs and health workers incidence of diarrhoea has been reduced. The establishment of Water Committees (BAWASAs and cluster household users) has overall helped to maintain water tap stands. The groups have collected small funds to regularly clean and maintain community water infrastructure. There is an Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 30 increased sense of ownership and value of belonging to a trusted organisation providing an essential social service. The evaluation found that the communities were actively engaged in the planning and design of water infrastructure. In an exercise during the evaluation held in President Roxas, Arakan and Kapatagan, the BAWASA committee and households were able to demonstrate water plans and highlight the roles and responsibilities of the BAWASA and water users. The below figure illustrates the water planning evaluation FDG conducted in Kapatagan. Photo 3: Water planning during evaluation in Kapatagan (during Evaluation Learning session) 3.5.3.3 WASH in Schools Prior to new water supply and toilets established in several schools, teacher reported a high number of sick students and hygiene problems associated with defecating in open areas. Now, in most areas functioning toilets are impacting positively on over 12 school representing thousands of students as proper sanitation facilities keep students safe from disease. Access to clean and safe drinking water has also helped students stay healthy and reduce levels of dysentery and infection, which can be passed on in the household and lead to further malnutrition. This is less so in Kapatagan indicating more work is needed to reinforce messages and improve existing WASH infrastructure. Sustainability of hygiene promotion to date is sound, demonstrated by functioning facilities and demonstrated practice by students. However with initial support from ACF, messages need to be continued by teachers and school administrators for future students to continue good hygiene practices. The evaluation found one unresolved issue. In Kapatagan, a water pipe connection at a school had been deliberately cut off and a water tap stand faucet had been stolen. The school was forced to close the two toilets. ACF need to ensure ownership of these activities and any outstanding issues are addressed to avoid this in the Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 31 future. ACF are however hopeful that the landowner, school and the BAWASA can resolve these issues before the end of the year. ‘School Administrators should be able to maintain and look after toilet and water sources near their schools, just like household clusters to maintain local water and toilet facilities‘. Members of BLGU village Proper Kapatagan 3.5.3.4 WASH Opportunities WASH initiatives and its approach are good practices that can be replicated in other LGUs. Bringing water to communities has probably the most impact on household’s vulnerability. Water provides more opportunities for families to drink and use safe water, grow home gardens and have access to year round water supply. Within the WASH approach, the BAWASA with household user groups is a great forum for not only promoting ownership and maintaining tap stands but also a good connector for community dialogue and progress in other areas. These areas include but not limited to food security, good governance and peace building initiatives. 3.5.3.5 Most Significant Change in the Community Feedback from the community has been very positive. As part of the evaluation, staff and partners were asked to contribute by writing a ‘most significant change’ story, which reflected on their experience and highlighted the most significant changes in their household. ‘I thought my son had no hope of becoming healthy after being a SAM. Now, I ensure my children have nutritious food so the disease would not recur. If they feel something unusual I immediately bring them to the local Health Center. My knowledge has been enriched especially in the proper care of my children and how to be healthy and how my family avoid being sick’. Aileen Kasan, mother of the first SAM child identified in Barangay Daguan, Kapatagan ‘Now, I am able to conduct hygiene promotion sessions and I am also helping in Promotion of Good Nutrition (PGN)’. Dhalia Buned Local Health Volunteer, Barangay Datu Sundungan, Pres. Roxas ‘I received corn, farm tools, mung-bean and seven types of vegetable seeds. I learned practical technology for poor farmers and sharing my knowledge to other farmers.’ Leny Oyao , household farmer Centro, Ganatan, Arakan, North Cotabato Of the 30 responses collected, all indicated an overwhelming positive response to the program, highlighting improved child nutrition and health, access to water and increased opportunity to contribute to local decision making and planning in their communities. A sample of these stories is listed in Annex 2. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 32 3.6 Efficiency Overall, the program has been efficient with overheads at approximately 30%7 of total program costs and a sound beneficiary-cost ratio of approximately 1008 Euros. The majority of staff are locally engaged and reside close to the program sites for an effective field based approach. 3.6.1 General efficiency The program has not significantly increased any agricultural production or household income due to food security initiatives, however it has provided significant water and sanitation infrastructure with co-contributions (cash or in-kind) from communities across the program area. Malnutrition activities are very cost effective as provision of services is supported through a large local volunteer cadre. ACF staff reported efficient use of management tools to assist with administration, budgeting, and reporting. However too many activity based indicators and survey tools increased time pressure on local partners and ACF who spent a significant amount of time collecting data. The budget for the program (4,000,000 Euros) is cost effective and relevant when assessing the wide range of activities ACF implemented in the remote regions across Mindanao and coverage of over 7000 household beneficiaries. The evaluation considers program outcomes to date value for money, particularly when considering the long-term benefits of improved nutrition, access to water and food security for several thousand vulnerable households. Partnering with local NGOs Maradeca and Don Bosco has been efficient and enabled activities to be implemented and closely monitored. ACF provided training and field supervision to enable partner staff to lead and implement training capacity building activities. 3.6.2 Cost efficiency The average of cost of activities per beneficiary was appropriate compared to other regional ACF activities. The number of staff and local facilitators was appropriate and has helped to reach communities in remote areas. Overheads seem fair and reasonable and in-line with similar ACF development programs in The Philippines and across other regions. The program could reduce the cost per beneficiary by promoting further investment from the households and local institutions. This may also increase the buy in and ownership of agricultural activities, however household vulnerability may limit people’s ability to invest. 7 8 From ACF Program Proposal budget 2010 4,000,000 Euro divided by approximate 7000 Household (approximate 6 persons per family) =4,000,000 / 42,000 people equals 95.24 Euros Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 33 Logistical, financial and procurement is functioning well and ensuring best value for money materials and equipment were provided. Communities were overall satisfied with inputs such as seeds, tools and water infrastructure. The overall budget is moderately under spent due to program delays in the early part of 2010/11. Otherwise, budget was spent as intended and in accordance with the budget and program proposal. Nutrition, Food security and WASH teams worked well, however they need better communication and planning to avoid duplication when dealing with institutions such as municipal and provincial governments. Local partner should be involved in the initial planning and continue to be provided administrative and management support in the field to save time and resources and avoid any duplication. Sound systems in place to record, report and track spending and procurement systems to prevent and identify corruption. To improve efficiency of providing inputs, ACF plans to utilise vouchers. This would enable farmer beneficiaries to choose which seeds or agricultural tools were needed and the right timing. ACF would provide a list of reliable suppliers and time period for redeeming. The voucher would replace the direct distribution by ACF of agricultural inputs and tools to farmers, saving time and resources and providing some flexibility and shifting decision making and responsibility to farmers. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 34 3.7 Involvement/Participation The program has overall experienced strong participation and involvement from the community, through formation of community groups helping to implement, maintain and support activities. Outside of the traditional ACF activities, cross-cutting components such as good governance have developed the foundation for better delivery of social services. The formation of PMUs at various levels of government stakeholders has helped to facilitate the implementation of activities across the program. Nutrition has seen the formation and strengthening of community health and nutrition workers groups both volunteer cadre and paid staff. Community health volunteers have been well mobilised in coordination with RHUs, local partners Maradeca, Don Bosco and LGUs. Over 50 BHWs (Barangay Health Workers) and BNS (Barangay Nutrition Scholars) are now operating across targeted villages. Before ACF’s program, there was no real effective system or support for nutrition or basic care practices. The BHWs and BNSs have filled this gap and provided strong support especially in the key area of nutrition screening of young children (6-59 months) and referral of SAM patients to either the OTP or ITP. ‘We are happy that with the arrival of this Convenio Program, it has changed a lot of things among the communities and within RHU that resulted in greater access to health and nutrition for families and fewer cases of malnutrition’. Dr. Ashar Dimapanat, Municipal Health Officer, Rural Health Unit, Kapatagan, Lanao del Sur Food Security and Livelihoods activities have engaged over 900 household and working farmers to form small support groups, which have been active in attending technical and administrative training, and trying new techniques introduced by ACF and its partners. Moving forward the evaluation would recommend more demonstration plots and formation of identified successful lead farmers to teach other farmers. The basic principle of ‘see one - teach one - do one’, can be an effective approach to put FSL ideas into practice and demonstrate to the wider community. WASH activities have been successful in gathering community interest, forming water user groups (BAWASA) to maintaining the infrastructure and facilitate the provision of hygiene messages. Moving forward the BAWASA should continue to facilitate, particularly in areas of Kapatagan the monitoring of water quality inspections and encouraging ownership by schools of water piping and toilet facilities. Overall, communities were most engaged and enthusiastic about WASH as the benefits are immediate, lasting and impact on all aspects of household’s livelihoods. ‘We can organise to raise funds to maintain and clean the water source and tap stands. We are leaders in the community and are members also in the farming and LGU groups so we can share issues and concerns ’. BAWASA Tumanding Arakan North Cotabato Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 35 Key government stakeholders such as BPMU and MPMU participated well and helped facilitate a relatively smooth start to the program implementation. Specifically, they helped to involve different actors and mobilise communities. MOUs that were created demonstrate commitment from targeted BLGUs, government line agencies and local partners. The PMU meetings at different levels served as a good mechanism to raise and discuss program issues and solutions. Moving forward the evaluation would like to see more effective participatory approaches used to encourage activities to be led or co-led by relevant institutions. The program faces continuing challenges such as ensuring regular participation of representatives, ensuring a smooth transition of PMUs to the existing LGU structure and guaranteeing some form of ongoing accountability and transparency of government. Success in participation and community involvement has contributed to the development of Barangay Development Plans (BDP) and the Municipal Annual Investment Plans. The process was successful in facilitating participation with community groups in the design of social services including Nutrition, FSL and WASH initiatives. Groups were able to engage with local and municipal authorities to finalise the plan and provided community groups an opportunity to oversee and ensure all issues were debated and taken into account. ‘There is enhanced local skills from people in the community and direction from the local government. It is now a little easier to implement programs that address needs of communities, with emphasis on health and nutrition, livelihood, and WASH”. Local Government Representative at MPMU level in Arakan The local government recognises it must do more, however evaluation believes this area of the program needs a big push in terms of advocacy and human resource support in the next two years. This will help communities push government to be accountable and ensure they realise the dividends of local plans. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 36 3.8 Control The design of the program has established a wide range of activity monitoring and evaluation (M&E) indicators that is good for internal purposes but might detract from the goals of the program. The time taken to collect and analyse the information isn’t clearly defined in the design and may lead to partners and ACF staff spending a lot of time collecting data instead of managing the activities. The LFA itself (in terms of objectives and activities) does not need to be greatly modified, but only the amount of monitoring data collected. Monitoring data from ACF is fully reported up its institutional donor but is neither fully participatory and feedback from and to communities isn’t clear. The evaluation recommends (2-3) indicators for each sector to focus more on results based monitoring and answer the question of ‘Is this program succeeding?’ Indicators should directly address the two objectives of the program and measure key indicators such as the following example; a) % changes in acute & chronic malnutrition levels; b) % changes in water-related illnesses, and c) % changes of direct beneficiaries income/available food stock. Use of local communities, local facilitators or local PMUs for monitoring collection was not clear, as were any involvement in the design, management or implementation of monitoring and evaluation of the program. A more defined, focused and local stakeholder co-led M&E system would add value and increase ownership of delivery of social services. A good example of this would be the farm and business plans developed by farmers. If done well this could be a good initiative to start a monitoring tool that farmers in the field could follow up and monitor themselves. The evaluation was encouraged by the use of mapping data in the design, which has been well used to illustrate regional differences in malnutrition, something that is well utilised by local government leaders. Improvement to the health and nutrition monitoring may include measuring the success of the IMAM protocol integrated in the RHU. This can be used as a control tool developed into the system for measuring effectiveness. Efforts to promote and include PIMAM at a national level should also be measured and included in the overall impact of the program. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 37 3.9 Integrated focus Overall the program has established sound organisational structures and prepared staff and partners for this new integrated approach. Moving forward hard work will be needed to educate the wide range of stakeholders about the benefits of an integrated approach across this wide reaching program. Demonstrating results will be key as many communities and government groups may be cautious of new approaches and techniques. The program has experienced some delays in delivery of some activities and impacted on the integrated focus of the program. On several occasions activities have been put on hold due to circumstances beyond ACF’s control such as security and conflict, monsoon weather and political campaigning. Some programmatic delays have also occurred, mainly as a result of the extra time needed to gather groups and work with local government structures. The PMUs, represented by a range of local government and line agencies are not always available and willing participants, particularly at the municipal and provincial level. More work will be needed in the next two years on strengthening these areas to become pro-active and competent institutions. This is particularly a timely issue as the handover of activities fast approaches in mid 2013. The nutrition component has worked well to link local structures with locally appropriate practices ensuring communities have access to health and nutrition services. Links with food security are yet to be fully realised as many households are not yet involved with any home garden or livelihood activities or have seen the results of an improved harvest. However, the program has successfully provided some training in food diversity and care practices for mothers and their children. Food security initiatives particularly agricultural productivity has seen mixed success as poor seed choice, bad weather and new farming techniques are introduced and improved. There has been some success in developing small gardens but more will be needed particularly when linking household nutrition to diversified diets and home gardens. ‘People are realizing and are starting up backyard gardening, as a support to prevent malnutrition among children’. Beneficiaries’ and Local partners feedback during the Evaluation Learning Workshop in Kapatagan ‘Communities are working together to solve problem of malnutrition resulting in a more healthy family and peaceful community. More people are involved in community groups such as farmer groups, BAWASAs, BLGUs, and health committees’. Beneficiaries and local government from President Roxas. Moving forward ACF and its partners will need to be more effective in using locally available inputs and existing skills from local farmers and indigenous groups. ACF is Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 38 yet to fully realise the potential benefit of linking food security and nutrition. More education and advocacy needs to highlight these important links especially for households with SAM children or at risk of malnutrition. Water and Sanitation activities are progressing well with water infrastructure in North Cotabato province and some in Kapatagan already complete and community ownership established. Hygiene programs in communities and schools are underway and demonstrating sound results with generally lower rates of infection, diarrhoea and dysentery as reported by health clinics and school administrators. More work needs to be completed in Kapatagan as they attempt to complete all WASH infrastructure and maintain good hygiene practices. ‘My pupils were often absent or would dropout because they got sick. Sometimes they go to school without taking a bath. After ACF arrived, our school received a water supply and toilet. The pupils also no longer go home for them to urinate and defecate. They can concentrate more on their lessons’. Volunteer school teacher in Bongabong Elementary School and a Community Hygiene Promoter of ACF ‘There is increased knowledge on the importance of clean and safe water for personal sanitation and hygiene.’ Beneficiaries’ and Local partners feedback during the Evaluation Learning Workshop in Kapatagan Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 39 3.10 Cross Cutting Issues 3.10.1 Gender The program is overall sensitive to gender issues and female participation has been a central focus during program design and implementation. Over 50% of the BAWASA, farmer groups and local BLGUs are representative of women. Mothers and their children were a focus for the program particularly on nutrition and health initiatives and were well included in the planning and design. Women who were pregnant, lactating or the primary care taker were targeted for the nutrition and care practice and were central to the nutrition activities with measurements such as weight and health of their children a core part of program activities. ACF included gender when developing the contextual analysis for the program. It is very important to include women in food security activities, as they are generally the ones who work the gardens, manage the kitchen and prepare the meals. 3.10.2 Children Children are a main focus of program with detection, treatment and prevention of child malnutrition at the forefront of contributing to poverty reduction. Reducing child malnutrition is a central element factored into the design of the program. The program also provides school WASH activities including hygiene promotion and provision of clean drinking water and toilets. This has contributed to healthier children and clean and safer school environments. 3.10.3 Cultural Sensitivity ACF understands the cultural context of the different regions of the program, taking time to understand the local custom and language. It has demonstrated good cultural sensitivity and effectively utilised local staff and partners to lead appropriate and sensitive communication to build strong local relationships. 3.10.3 Disaster Risk Reduction (DRR) and Environment ACF spent considerable time at the commencement of the program to ensure DRR elements were incorporated into the program and in line with national DRR policy. These elements include watershed and water source management, which ensured water sources were kept clean and free from debris. Regular testing and maintenance in partnership with the BAWASA ensured water sources were safe and free of contamination. Furthermore, ACF ensured all WASH infrastructure was built not to cause damage to the environment. For example ACF built erosion control measures to avoid damage to the water source and mitigate the risk of landslides. Moving ahead, future DRR activities should include food security initiatives such as seed saving, seedling production and a bigger push for home gardens. This is particularly important for food insecure households with SAM children. Complimenting these activities is education in the growing, preparation and consumption of a nutritious and balanced household diet. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 40 4.0 CONCLUSIONS AND RECOMMENDATIONS Overall, ACF has provided a solid grounding for delivering an integrated mix of nutrition, food security, WASH and good governance initiatives to tackle poverty in rural and peri-urban communities. ACF and its partners have commenced a new approach to mainstream cross cutting issues such as good governance into its programming, which is encouraging local institutions to deliver social services. The program has taken positive steps to promote community empowerment and leadership in local planning and as well as accountability of local institutions. The following outlines key recommendations from ACF’s experience in Mindanao, which will drive planning and implementation strategy for the next two years of program. Nutrition and Care practices After discussions with health care professionals and community volunteers, ACF should advocate to RHU the use of the existing ECCD (Early Childhood and Development) card to include key nutrition information and enhance it by adding pictures of signs of SAM. Informing and guiding mothers on how to use it would increase the usability of the ECCD. A more visual and easy to use growth card is a good self-monitoring tool for all households and should be highly encouraged. However, parents that were interviewed often did not fill out the nutrition card, so more advocacy and education needs to support this initiative. After observing communities and examining current food consumption from the Household Economic Assessment, ACF should promote backyard gardening for multi-cropping of nutritious local leguminous seeds such as peanuts, mung beans, and variety of local vegetables and fruits to improve the dietary intake of households. All households with SAM children should be prioritised as beneficiaries for food security and WASH to reinforce ACF’s integrated approach at the household level. From discussions and observation with health care professionals, ACF should closely monitor SAM children through home visits and visits to the RHU. This will ensure a sustained recovery of SAM children. There is a need to follow-up child feeding and care practices to ensuring nutritious food is prepared for children, and adequate fruit and vegetables are being grown or sourced for household consumption. From observarions at health clinics improvements should be made to IYCF (infant and young child feeding) practices, to continue to promote early initiation of exclusive and continued breastfeeding; and appropriate, age specific complementary feeding and dietary diversity. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 41 Food Security and Livelihoods From observations and discussions with farmer groups, ACF needs to focus on using locally sourced input and appropriate technology. Encourage the use of native non-hybrid, non-GM seeds and source organic manure locally for production by local farmers. This will reduce costs to the farmer, ensure a sustainable approach to earning an income and will eliminate damage done to productive land. After site visits and discussions with farmers, there is a need to reinforce skills and training received on food security and agricultural activities. This can be done through demonstration-farming plots using a farmers-to-farmer approach for training. The approach should also utilise successful indigenous practices and locally sourced resources. From observarions and discussions at the Barangay level, households are yet to fully appreciate the links between nutrition and food security. Highlight the links between food security, specifically a balanced and nutritious diet and child malnutrition. Utilise cooking classes to show how to prepare good food, set up demonstration home gardens and follow up with plays or interactive learning on nutrition and food safety and hygiene. Expand livelihood opportunities such as the Cotabato City solid waste management program. More diversity is also needed in income generating activities, outside of traditional farming. Support businesses such as milling and drying of crops would increase income opportunities in the local economy. WASH After discussions with local communities and site visits of WASH facilities, ACF should continue to encourage BAWASA leadership in maintaining WASH facilities and include Water shed environmental management. This is needed to protect the water source, reduce risk of contamination and encourage all villages to fund maintenance activities. In some areas of Kapatagan ownership of facilities and a system for collecting funds for maintenance was not as effective. Observations of WASH sites and discussions with BPMUs indicated a lack of support from municipal government. ACF should advocate to Rural Health Units and Local Governments to maintain water quality monitoring. The regional sanitary inspector should ensure regular treatment and maintenance of the water quality. Accountability of these local government positions is currently poor, so a big push is needed from ACF and its partners to improve this component of WASH. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 42 Site visits revealed overall sanitation and hygiene practice is improving however some areas in Kapatagan were still poor. Also, preliminary findings from monitoring reports indicate there are still many households in need with limited sanitation facilities and practicing poor behaviours in hygiene. This will impact on household health and nutrition, especially amongst children under five years old. ACF should reinforce sanitation education and advocate for maintenance of toilet and latrines infrastructure. Good Governance and Integration Discussions with PMUs at various levels indicated a desire to be more involved with the design, planning and monitoring of activities. These activities should be co-led in partnership by user groups and institutions (groups such as: BAWASA, Farmer groups, Municipal Government, and the Department of Agriculture). This will increase ownership, provide on-the-job training and improve the likelihood of a social services being provided in the future. After reviewing the program design and implementation of activities, ACF should promote local institutions having key performance indicators to track progress and hold them accountable. This would provide some concrete benchmarks for local institutions to meet and provide incentives for better performance. It would also provide specific goals and objectives that communities can monitor and hold local government and agencies more accountable. This is good practice that should be encouraged across local institutions. Already some municipal government in Arakan are embracing good governance with an award from the National Government being proudly on display. After discussions with municipal government and local partners, ACF needs to lead by example on the integration process. Often different staff from ACF were asking the same government representatives for the same information. A common database for data and planning would assist the process of sharing across the sector and reduce duplication. After observations at BPMUs and local partners, capacity and skill development should continue to be important strategy for program implementation. Strengthening of community groups should be an important focus and should include leadership, problem solving and decisionmaking skills in addition to the core technical capacities. Reviewing the design and discussions with local leaders, ACF should encourage greater community involvement by supporting a ‘People’s Organisation’ to be a focal point to represent each village or cluster. This group will contribute to the Barangay Development Plan (BDP) and represent those without other representation in LGUs, BAWASAs or farming Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 43 groups. This will help include more vulnerable members of the community including Indigenous groups. Advocacy / Capacity Building Observing interaction between the local community and government at the three learning events in September, the evaluation recommends more is needed to empower community to hold local institutions accountable. ACF should support this ensuring communities know they rights and are engaged in planning activities and feel connected with decision makers in government. And, feel that they will listen to the community and debate development and planning issues in the transparent manner. After observing local partner approaches to delivering activities, ACF should ensure education messages are more participatory. Utilising participatory approaches that include river of life sharing techniques, simulations, pilot demonstrations, community theatre and documentary film are effective methods to deliver capacity building activities and messages. Observing local partners and government agencies capacity, ACF should provide opportunities for local partner and government staff to work inside agency program office to increase experience and skills of locally engaged practitioners. These mentoring opportunities will help build the confidence and ability of local capacity to lead future programs. Observations at local health centers reveal that health volunteers (BNS and BHW) have struggled to receive their small allowance to cover travel. ACF should advocate to local government to support this critical volunteer system. Monitoring and Evaluation There are too many indicators (over 50). ACF should focus on measuring what is the real indicator of success for their program. This can be measured with (2-3) indicators for each sector, focusing on results-based monitoring. As a result staff will reduce the time and resources spent collecting data and focus more on managing core activities. Provide a feedback mechanism for communities. Continue to keep open communication with program staff and committee leadership. These mechanisms add value to regular meetings with ACF facilitators. In conclusion, ACF is technically and administratively well equipped to address the dynamic challenge of reducing poverty in Mindanao. ACF has developed a sound Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 44 integrated approach and will over the next two years refine and reshape some of its implementation strategies outlined in this evaluation. Measuring the success of this integrated approach will be demonstrated in households combined vulnerability, specifically: does the household have reduced risk of malnutrition, does the household have a diverse healthy diet and does the household have access to clean drinking water and access to sanitation facilities. Then, the program will need to analyze the speed and efficiency at which these components were delivered together compared to a more component only driven program. Furthermore, it will need to assess change in behaviour, knowledge and practice by households in the key areas of nutrition and care practices, food security and livelihoods and WASH to assess whether these areas are naturally linked and adapted by communities. The mid-term evaluation finds some overall good trends for this integrated approach highlighted by reduced child malnutrition, improved knowledge and capacity of farmers, access to water and improved hygiene. Throughout discussions in communities, the evaluation observed some natural links starting to be made through the key component of Nutrition, FSL and WASH. The evaluation also finds that with the establishment of local PMUs, many of the same people are members on other health/nutrition, farmer and water groups, therefore there is inherent sharing in addition to informal sharing across these small communities. So, Interventions must continue to utilise local community groups and provide a participatory learning experience highlighting key success factors in overcoming poverty and the natural links between nutrition, food security and WASH. For nutrition, food security and livelihood interventions, ACF must rigorously assess each context for vulnerability and market conditions, so that interventions can be truly integrated and have a lasting impact. For long-term sustainability of this program, ACF and its partners should support and advocate for communities to demand accountability and better performance by local institutions and social service providers. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 45 5.0 DAC GUIDELINES As part of the evaluation each component has been scored and summarized utilising the DAC guidelines. Following this is an example of good practice, which could be replicated across other programs and regions. Criteria 1. Impact (OUTCOME) Rating 4 Rationale Established PMUs at provincial, municipal and village levels and MoUs with key local government officials/agencies and local partner NGO, INGO partners Recovery rate of SAM patient 56% in 2011, 71% in 2012 at OTP; and 88% at ITP Significant Water and Sanitation Access to communities and schools. 2. Sustainability 3.5 3. Coherence 4 4. Coverage 4 Functioning IMAM-IMCI at RHU level Community participation in decision making processes Initial cooperation with local government to delivery of basic servicies to communities. Multi-sectoral approach, including national (DOH, DoA) and international (AECID, UNICEF) stakeholders. Mainstreaming program components implementation within the existing local government bodies. ACF participated in the drafting of PIMAM development of Pocket emergency tool for Nutrition in emergency and awaiting approval from DOH and its implementation nationwide. Implementing an integrated IMAM-IMCI within the local health structures of RHUs and Barangay Health Stations. Need to strengthen proactive dialogue with government partners. Thorough assessment of remote and vulnerable areas. More community participation to identify and prioritize the needy and poor farmers in the target villages. Families identified with malnourished children, particularly with SAM families, should be inclusively given priority as beneficiaries on FSL and WASH initiatives. 5. Relevance/ Importance 4 Most vulnerable population assisted and provided key services in WASH, FSL and Nutrition. Malnourised children assisted. 6. Effectiveness 3.5 Delays in the implementation, however ACF is confident to complete before mid-2014 Local health structures and community structures set and functioning. Cross learning of experiences in North Cotabato and Lanao del Sur areas should be institutionalized and part of MEL (monitoring, evaluation and learning) process. 7. Efficiency 4 Nutrition screening and detection of malnourished children is a relevant entry point in communities and integration of FSL and WASH. Good software tracking for quantitative data in target areas. Use more simple (participatory) monitoring to be adapted to local government partners and communities for sustainability and learning. Good technical mix of staff. Sub-office in the program areas (in Lanao del Sur and North Cotabato) near the target villages. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 46 6.0 GOOD PRACTICE IDENTIFIED FROM THE EVALUATION Strengthening local structures through a community-based health system approach to address acute malnutrition Title of Best Practice Strengthening local structures through a community-based health system approach to address acute malnutrition ACF’s program has reduced malnutrition and is building a stronger local health capacity. The following outlines the key successes driving this integrated and community driven initiative. Innovative Features & Key Characteristics Overall the ACF program had been successful in strengthening the facility-based delivery/referral system, through health centers at Municipal Rural Health Units and Barangay Health Stations. It has mobilised community health structures that are now a central component of the IMAM-IMCI integrated approach towards better delivery in addressing child malnutrition. It not only covers acute malnutrition, which is the current focus of ACF’s work, but also for health center facilities and communities to find solutions for all types of malnutrition. Success has been achieved through a combination of local partnerships with organisations such as German Doctors, Don Bosco, Maradeca and Montaner Hospital; and support of health and nutrition volunteers who provide home visits and key nutrition and care practice education to households. ACF has contributed through deployment of nutrition and health specialists who are providing core capacity building training and currently transitioning skills and workload to local practitioners. Furthermore ACF and its partners are providing essential resources in the detection, prevention and treatment of malnourished children. Practical/Specific Recommendations for Roll Out For local staffing, the program has focused on improving the capacities of local health staff at health centers including municipal health doctors, nurses, and midwives. Health volunteers (BHW, BNS) have been provided training and partnered with local communities in the formation of local governance groups such as farmer groups, BAWASA and informal community health committees. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 47 For its advocacy work, ACF is utilising case studies alongside nutrition mapping data. Local government representatives such as Mayors and Barangay leaders were very responsive and took action when malnutrition levels in their municipalities and villages were mapped, ranked and compared with other regions. Moving forward ACF is advocating for continued support from local authorities in providing doctors, nurses and recruitment of sanitary inspectors. Improved conditions for volunteer staff are needed to ensure continuation of home visits to remote communities. Continuing to support an effective and affordable local community health care model alongside education are sound step toward building local government support for a functioning municipal health care system. Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 48 Annex 1 – Key Informants and Documents reviewed Key informants Organization/Village BAWASA Committee and cluster groups, Brgy. Proper Kapatagan, Name/Description of Respondents who were Interviewed or participated in the FGD Kapatagan Proper Elementary School BAWASA Committee officers (chairman, vice-chairman, treasurer, Auditor, Asst. Auditor) Cluster Leaders 3 female, 8 male RHM, Rural health midwife, Ruband Mascod (F) RHU Nurse (F) Municipal Health Officer (MHO) (M) BNS, Zenaida Aleman (F) BHW, Mariam Macatambeg (F) Kagawad on Health, Kayangga Bansil (F) Mother of SAM child undergoing treatment at OPT Grandmother of SAM child who was treated at OPT Randon home visit and interview with mother and father of 3 young children with normal status (age 7, 10, 12 years) Elementary principal (F) Elementary grade school teacher/adviser (F) A high school volunteer teacher (F) FGD with grade 7 students (4 girls, 2 boys) SitioTalbo, Brgy Proper Kapatagan BPMU level, Village Proper Kapatagan Municipal PMU level, Kapatagan 10 farmer cluster group members, Agri-inputs beneficiaries BPMU members = 5-M, 5-F Municipal Mayor Maglangit (M) SB Secretary Mama (M) Vice-Mayor, Paisal Bansil (M) Information Officer (M) Secretary to the Mayor, Renato Calunod (M) MPO, Bailanie de los Santos (F) Assistant HR, LGU, Marites Dinodol (F) LGU Representative = 6 M Community Organizer, Junaima Tanog (F) Community Organizer, Roxanne Pondiond (F) Staff, Faridah Salic (F) Administrative Officer, Safia Dumatingcal Staff Nurse, Rene Bustillo (F) FSL Head of Program, Rolando Albino (M) FSL Technical supervisor, Surafa Ebus (M) WASH Head of Program, Regina Paypa (F) WASH Engineer, Anwar Mokamad (M) Hygiene Promotion Officer, Marigold Feniza (F) Nutrition Head of Program, Oscar Fudalan (M) Nutritionist, Pete John Biscara (M) Nutritionist, Zahara Kamid (F) Head of Base, Javad Amoozegar M&E Officer, John Tamayo (M) Liaison Officer, Rosa May Maitem Country Director, Eric Fort (M) Technical Coordinator, Suresh Murugesh (M) Nutrition Coordiator, Martin Pareno (M) Advocacy Officer, Kristine Calleja (F) WASH Coordinator, Rasul Abdullah (M) FSL Coordinator, Damos Militante (M) Village Daguan reprepresentatives = 5-M, 2-F Village Bongabong representatives = 2-M, 1-F Village representatives = 4 M MARADECA = 1 F LGU Kapatagan representatives = 1-F, 1-M ABC Chairman = 1 M ACF Staff = 3-M, 3-F Kapatagan RHU Individual Interviews, Village Proper Kapatagan MARADECA, Inc Staff Montaner Hospital ACF Staff, Cotabato Base ACF, Makati Base Feedback & Learning Workshop, Kapatagan Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 49 Village Mother Bagua, Cotabato City Office of the Mayor, Cotabato City Farmer Group, Tumanding Arakan BAWAS (Water Committee) Tumanding Arakan Health Key Informant Interviews Tumanding Arakan BPMU Tumanding Arakan Farmer Group, President Roxas Datu Sundungan BAWASA, President Roxas Datu Sundungan Health Key Informant Interviews President Roxas Datu Sundungan Municipal PMU Arakan Población Municipal PMU President RoxasPoblación Provincial CTF Kidapawan (Amas) German Doctors Kidapawan (Amas) Don Bosco, Kidapawan (Amas) Learning Workshop Arakan Población Learning Workshop President Roxas Población AECID Department of Health, HEMS UNICEF Village Council member, Community Service (F) Village Council member, Finance (F) Village Council Secretary (M) Municipal Mayor (M) Secretary to the City Mayor (M) Ma. Rita Baraguin, PEO IV (F) Ronnie Cadorna (M) Oscar Rendon PO IV (M) Porfirio de los Santos, PO IV (M) Farmers and Household Members 13 (M-8) (F-5) including Chairman, 4 x Board of Directors, 4 x Tap Stand Leaders BAWASA Members x 12 (6 F, 6M) inlcuding; Vice Chiarman, 2 Team Leaders. Members x 5 (5 F) inlcuding; BNS, BHW x3, RHM Members x 20 (12M, 8F) inlcuding; Chairperson, Secretary, Famers x 4, Health Workers x4, BAWASA member x 4 Members x 15 (5M, 10F) including; BLGU Secretary, FSL Member x 3 Members x 13 (7M, 6F) including; Chairman, Secretary, Board of Directors x 4, 3 x Team leaders Members x 14 (F) including; Mid-Wife, BHW x 9, BNS, BHS Members x 13 (9M, 4F) inlcuding; President MayorLGU, Barangay Captain x 2, MoH, DoA Members x 10 (5M, 5F) inlcuding; ABC President, Nutritionist, Mid-Wife, Barangay Captain x2 11 Members including; Deputy Director, Nurse x 2, Provincial Health Officer and Nutritionist Doctor, Darel Quisil (F) Nutrition Nurse, Mia Gerigdig (F) Ward Nurse, Mariecris Jarales (F) Members x 7 inlcuding Community Faciltator x 5 Partner Liason Officer Executive Secretary / Administrative Officer Members x 40 representatives from previous meetings and FGDs Members x 26 representatives from previous meetings and FGDs Governance Advisor and Development Officer, Technical Staff on Nutrition, Florinda Panlilio Nutrition Specialist, Health & Nutrition Section, Henry Mdebwe (M) Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 50 Documents Reviewed Description Document Title Program Plans/Reports Annual Plan 2, year 2011 Annual Plan 3, Year 2012 PAC 1 Plan Report, Aug- Dec 2010 Annual Monitoring Report, PAC 2, Jan-Dec 2011 Activity Progress Report (FSL, WASH, NUT), July 2012 Convenio 1st Internal Monitoring Report, 2nd Quarter 2012 ACF Program Proposal, Central Mindanao, 2010-2014 Program Planning Matrix Household Economic Assessment, Arakan & Pres. Roxas municipalities of North Cotabato and Kapatagan of Lanao del Sur, Dec 2010 Anthropometric Nutrition and Mortality Surveys, Arakan and President Roxas, North Cotabato, Region XII, Kapatagan, Lanao Del Sur, ARRM, October-December 2010 Knowledge, Attitudes, Practices (KAP) Survey, Arakan and President Roxas, North Cotabato, Region XII, Kapatagan, Lanao Del Sur, ARRM, November 2010 Market Study of Poor Producers in Central Mindanao and ARMM, June 2011 Program Assessments/Surveys Partnership Contracts/Agreements Partnership Contract, Don Bosco Foundation Partnership Contract, German Doctors Partnership Contract, Maranao People’s Development Center (MARADECA) Partnership Contract, Montaner Hospital Memorandum of Agreement, ACF- DOH ARMM Memorandum of Agreement, ACF- DOH Region XII Memorandum of Agreement, ACF- LGU Kapatagan Memorandum of Agreement, Provincial LGU, Lanao Del Sur Memorandum of Agreement, LGU Arakan Memorandum of Agreement, Midsayap Mun, North Cotabato Memorandum of Agreement, Provincial LGU, North Cotabato Memorandum of Agreement, LGU President Roxas List of Target Villages and Intervention Areas ACF Cotabato Briefing Presentation Integration Matrix of Activities for PHJGAA, Sep 06, 2011 ACF Cotabato Base Organogram, Sep 2012 ACF Learning Review 2011 Comprehensive Development Plan (CDP), 2011-2013, Kapatagan 2011 FNRI Nutrition Data Guidelines for management of Severe Acute Malnutrition, In and Out patient treatment, ACF, January 2010 Capitalization Report, Solid Waste Management Program, Cotabato City, August 2010 Other Program-Related Docs Others Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 51 Annex 2 – Sample of Most Significant Stories (From contributions received from communities in the ACF’s program) 1. ‘Sufficient Knowledge on Nutrition Towards a Peaceful Community’ (sic) There are many malnutrition cases in our area. We do lack the capacity to address and manage it so we are happy with the arrival of this Convenio Program. It has changed a lot of things among the community and within RHU. One of those is the awareness of the community on the importance of nutrition. As a Municipal Health Officer, I have seen fewer cases of malnutrition and fewer cases of diseases. Dr. Ashar Dimapanat, Municipal Health Officer (for almost 6 years), Rural Health Unit, Kapatagan, Lanao del Sur 2. Change in the nature of BHW participation in development activities. (sic) Part of my role as a BHW to motivate our community for the process of behaviour change and that education is one of the finest ways. Now, I am able to conduct hygiene promotion sessions and I am also helping in Promotion of Good Nutrition (PGN). A breakthrough for me was the seminar on Home Water Treatment and Storage (HWTS) with Practicum on Water Analysis. All of the BHWs including our BNS participated with this. Now we go to the tap stand and get a water sample and get samples from the households to test. We did the actual water analysis and found our water was clean but when it reaches our house it was contaminated. We took this to our community then made a plan to fix with money collected. Dhalia Buned Local Health Volunteer, Barangay Datu Sundungan, Pres. Roxas 3. ‘Building good farming relationship’ (sic) I received an agrikit3A (corn, farm tools, mungbean and seven types of vegetable seeds). I am an enthusiast in volunteerism and a community volunteer. I am happy what I learned in terms of practical technology for poor farmers and I am willing to share my knowledge to other farmers. I now have more Indigenous friends now and happy that I can help them in a very little way. I recommend that learning site are located a more accessible location to increase participation of lactating and old people. Leny Oyao , household farmer Centro, Ganatan, Arakan, North Cotabato 4. ‘Leaving Behind the Road of Malnutrition’ (sic) My son was a child who was identified with SAM when ACF conducted a survey in Kapatagan. He was thin and sickly then. Now he has improved to a healthy weight and active. I’m happy because I thought my son had no hope of becoming healthy. I thought malnutrition was not a disease. It was in fact a life-threatening disease if it was not immediately attended to. Now, I ensure my children have nutritious food so the disease would not recur. If they feel something unusual I immediately bring them to the Health Center. My knowledge has been enriched especially in the proper care of my children and how to be healthy and how my family avoid being sick. Aileen Kasan, mother of the first SAM child identified in Barangay Daguan, Kapatagan Mid-term Evaluation ‘Support for the socio-economic development of the communities within the Spanish Development Cooperation’s action zones in the Philippines Program’ Oct 2012. 52
© Copyright 2026 Paperzz