Terms of Reference for End Project Evaluation
Chukua Hatua
June 2015 – December 2015
1.0 BACKGROUND
Oxfam Tanzania is planning to hire an experienced evaluator/team to carry out a final evaluation of a
project entitled Chukua Hatua (Take Action). The goal of Chukua Hatua is to achieve increased
accountability and responsiveness of government to its citizens through creating active citizenship;
that is citizens who know their rights and responsibilities, are demanding them, and are able to search
for and access information. There have been phases of implementation of Chukua Hatua since 2010,
however the evaluation will be focusing on the current phase namely Chukua Hatua 2 (CH2) which
has been implemented from June 2015 – December 2015.
The CH2 has been implemented in Geita, Simiyu and Shinyanga: in Bariadi, Maswa, Kahama,
Kishapu, Mbogwe, Bukombe, Shinyanga Rural, Itilima, Loliondo, Ngorongoro districts. The
implementation is done by four partners, namely: Capacity Building Initiative for Poverty Alleviation
(CABUIPA), Pastoralist Livestock Support and Empowerment Program (PALISEP), Ngorongoro
Youth Development Association (NYDA) and Taasisi ya Maendeleo ya Vijana Arusha (TAMASHA).
The objectives of CH 2 are as follows:
1. To strengthen and scale up the existing network of citizen activists, and to bring these activists
closer together and encourage them to speak up together and share strategies and skills.
2. To expand the training and mentoring of local government officials to ensure that barriers to
citizens and leaders working together are dismantled.
3. To put pressure on national leaders to hear about and take action on issues that is raised at the
local level.
4. To continue learning and evolving to build good programming around and continue to learn about
active citizenship and responsive government.
This Terms of Reference (TOR) defines the work to be carried out by the external evaluator.
It provides a brief outline of the project; specifies the scope of the evaluation and outlines the
evaluation method.
2.0 Outline of the project:
The following activities were implemented in a period of June to December 2015.
Animators Training Animators:
Partners identified animators who were trained in previous phases of Chukua Hatua. These animators
were provided with refresher training thereafter were involved in identification and training of new
animators. The logic is to build capacity of animators to recruit and train other animators to increase
their numbers as well as spreading animation approach to other community members. The process of
identification of new animators was done through engagement of local communities’ members and
leaders. Partners played the role of ensuring quality of training and providing feedback to animators in
the training of new animators.
Training of Sungusungu animators:
Sungusungu has been an influential group in Shinyanga which is formed by community to provide
general security support to the communities. TAMASHA extended animation training to Sungusungu
as an opportunity for building awareness on human rights; also providing opportunity for the group to
learn on various ways of supporting community’s initiatives without bringing fear with community
members.
Shaping Election Promises:
PALISEP was engaged in facilitating community dialogues to set agenda to be presented to election
candidates. The learning from previous year was that election candidate came with their own agenda
which was difficult to be tracked by communities. This phase of Chukua Hatua provided opportunities
for citizens to dialogue and come up with their priorities to be adopted by election candidate.
Animators Coalitions for change
Animator’s coalitions were built in Shinyanga in previous phases of Chukua Hatua. The CH2 plan was
to build animators coalition in Ngorongoro and Loliondo. The animator’s coalitions and the approach
of having animators train animators’ aims to build links between communities and animators for
security, but also for sharing of ideas and resources. The animation work in this phase focused on
strengthening the “power with” of citizens in order to build influence and spaces for participation in
decision making processes.
Local leaders training and mentoring
Local leaders’ trainings were done in Shinyanga and Loliondo whereas CABUIPA played major role in
this activity. CABUIPA is known to have great expertise in delivering local leaders training on good
governance. Therefore the organization trained and provided mentoring support to VCP in Shinyanga,
Geita, Simiyu and provided technical support to PALISEP for the same.
Linking rural issues with urban communities
Riwaya za Chukua Hatua newsletter has been developed and printed with success stories from
communities. Social media training to Oxfam staff and partners was among activities implemented.
Facebook, Twitter, blogging, were among the targeted social media in CH2. Other implemented
activities will be reviewed as part of document review in the evaluation process.
Target groups
The project targeted general population; however marginalised groups including women and young
people were given priority. The project also targeted Sungusungu as special group in Shinyanga
region in building awareness on human rights.
THE EVALUATION:
Objectives of the Evaluation.
The primary objective of the requested evaluation is to determine the results of the project,
specifically in reference to meeting the goal and objectives outlined in the proposal.

Assess implementation of the project during the period against the key targets evaluation
criteria (efficiency, effectiveness, sustainability, impact etc).

To assess the effects of the project to the target communities, particularly women and youth,
in the target regions.

To assess the quality of outputs, outcomes and results of the project against the proposal
outcomes.

To identify good practices and key lessons learnt and make recommendations for future
improvement of similar programmes based on evaluation findings.

To evaluate implementation methodologies, approaches and tools for individual partners.

To evaluate the efficiency and effectiveness of partners.
Key questions expected of the evaluation
Efficiency: relates to an analysis of the costs (money, people, time, materials, etc.) that are expended
as part of the program in comparison to either their benefits of their effectiveness.
The project efficiency will be evaluated through the review of project documents and interviews with
CH partners and staff on budget against planned activities, activity schedule, and by building an
understanding of the issues that delayed or stalled implementation. Anything which went wrong or
best practices should be highlighted through this evaluation. The assessment should go further to
build understanding about the use of project resources and evaluate whether they were used wisely.

Did the project implementation follow the agreed project timeframes? If not what factors led to
the change in its delivery?

Did the partners seek and receive cooperation from the relevant stakeholders? How did they
work to build stakeholder buy in? What could they have done better? Is there any best
practice to highlight?

Were partners and Oxfam considering the importance of value for money in their
implementation?
Effectiveness: relates to the level by which the activities of the program produced the desired effect.

To what degree were the expected results achieved against the objectives and indicators?

Did the activities listed in the proposals result in achievement of the specific objectives and
attainment of outputs?

How relevant was the envisaged theory of change in light of programme implementation?

What promoted or undermined the achievement of results?

Did partners have adequate technical expertise/capacity to implement the project?

How effective was the relationship among Oxfam, partners and other actors during the
programme implementation? Please provide examples of good practice and areas for
improvement.

To what extent was the project’s approach able to empower citizens (women and youths
particular) regarding their rights and responsibilities? Did it enhance their ability to hold duty
bearers to account/demand their rights/ access essential services? Was the set of activities
sufficient to meet the overall goal and objectives?

To what extent did the different categories of activities complement each other? Were
the selected implementing partners the most relevant to the problem being addressed? Was
partner’s capacity adequate to implement planned activities?

Did the project target the right group of beneficiaries? Was there an inclusion/exclusion bias
in
selection
of
stakeholders/animators
and
bias
in
selecting women and youth
participants involved in the project?

To what extent did the project achieve its intended results? (Refer animation work, social
media, CSO workshop, VCP trainings and mentoring support, etc)

Did the project foster dialogue between citizens and duty bearers?

What major factors contributed to or hindered the achievement of its objectives (factors of
success and challenges)?

Have there been any unexpected outcomes (positive and/or negative)?

Did participants’ knowledge and skills in animation, active citizenship, and accountability
improve, and to what extent did youth and women participants use the learned skills to
address issues in their communities?

What were the changes observed from training Sungusungu as compared to untrained?
Quality and contents of training materials? Motivation of Sungusungu? Scaling up?

How successful have the trained sungusungu practiced as positive leaders among their
communities? What successes and challenges did they experience in this regard?

What was the degree and quality of Oxfam and partner assistance to animators in helping
them fulfil that role?

What was the process of recruiting new animator? Was it inclusive? What were the feedback
positive and negative from old and new animators and local communities toward animators
and animation approach? Training materials quality of the contents? availability? Clarity?
Sustainability: refers to the probably of the continuation of benefits from a development intervention
after major development assistance has been completed.
Sustainability of the project is essential to Oxfam as far as the goal of ending poverty and suffering is
concerned, the consultant will be required to assess the involvement of the community and whether
the project has succeeded in maintaining a desirable level of participation of the community in the
project activities. Interviews with key programme staff will be essential to this work.

Are the positive effects or impacts sustainable? Do the local and community leaders support
the initiatives that were taken by the partners?

To what extent was the project linked to Oxfam’s existing programmes and strategic plan?

To what extent was the project linked to Country developmental strategies and global
conversional

To what extent were communities and other stakeholders involved in the project?

Was there any feedback mechanism for beneficiaries? Oxfam Vs members, members Vs
beneficiaries?

To what extend was the project engaged the government in implementation of the project?
Impact: refers to the positive and negative changes produced by a development intervention, directly
or indirectly, intended or unintended. This involves the main impacts and effects resulting from the
activity on the local social, economic, environmental and other development indicators. The
examination should be concerned with both intended and unintended results and must also include
the positive and negative impact.

What were the notable immediate impacts and likely long term impact of the project areas and
activities?

Animation training in an informal setting

Animators coalition for change

Sungusungu training

The use of social media

VCP training and mentorship support.

Were there any specific positive or negative gender impacts by the project?

Were there any unintended impacts from the project (both negative and positive)?

Are there any exceptional experiences that should be highlighted? e.g. case-studies, stories,
best practice?
Methodology
This evaluation will involve both qualitative and quantitative data collection. Interviews will be key to
the evaluation, but focus group discussions and document analysis will also be part of it. Meetings
and interviews with a broad range of stakeholders including CH partners, local government
representatives, beneficiaries, community members and leaders and other relevant stakeholders will
be necessary. Desk research on previous evaluations, quarterly reports, success stories and case
studies, training manuals, etc. A small survey aimed at the training participants to appraise the
effectiveness of the training and mentoring support.
Sample Size
The consultant(s) will determine the appropriate sample sizes in consultation with Oxfam, however
Oxfam preference will be reaching one district in each region at lake zone and Loliondo in Arusha.
These figures will take into consideration the activities carried out by partners and the project areas.
The survey sample should be designed at the district level. The consultant(s) will visit these sites and
interview the beneficiaries and partners on the relevant project objectives.
Audience
The primary audience of this evaluation includes:
The Oxfam staff and partner organizations: this audience segment can draw out reflections and
lessons from the project through the evaluations and to use recommendations for future project
designs.
The funding agency (KPMG): the evaluation will allow Oxfam to assess project impact as it relates to
the stated goal and objectives. Additionally, the evaluation will present a value for money analysis that
will help KPMG determine if the project could be part of a larger initiative.

Local government authority: The evaluation lessons will be used to improve accountability
and expand community engagement.
The secondary audience: includes Oxfam international headquarters, other Oxfam country
programs, external funders, and partner organizations who may be interested in the results and
lessons from the project evaluation.
Evaluation report
The production of the evaluation report will be the liability of the evaluator(s) covering all the
evaluation questions, objectives and areas outlined in the ToRs. Oxfam and CH partners will be
responsible for coordinating the evaluation exercise. The evaluation report shall be:

Produced in English language and should be simple in expression (jargon free).

Maximum of 50 pages including any annexes.

The report format and text should be an A4 paper size in Times New Roman font size 11.

The evaluator(s) will be liable to submit at least one hard copy and an electronic version of
the evaluation report in Word Version by the agreed deadline.
Outline of the Evaluation Report
The evaluation report should contain at minimum different elements mentioned below. All parts should
be clearly distinguished from each other and of sufficient quality.

Cover page

Table of contents

Executive summary that can be used as a complete document. The executive summary
should include the major findings of the evaluation and summarise conclusions and
recommendations.

Methodology, its justification and limitations if any.

Findings addressing all the evaluation questions as well as the unexpected outcomes.

Conclusions presenting summary of the findings on the basis of evaluation questions.

Lesson learned and recommendations which should be clearly related to conclusions.
Anticipated Outputs

Inception report including work plan for the evaluation

Evaluation tools.

Final evaluation report addressing all objectives, evaluation questions and including clear
recommendations.

Data in STATA file saved in SPSS).
Time Frame
The consultant will be required to submit an inception report with all the details including number of
days the whole program evaluation process will take, preparation, field work partners and report
writing. The expected date of the start of program evaluation is expected to be 24th Nov 2015.
Budget
The total budget for the evaluation is 56,240,000/= TZS inclusive of transport costs and withholding
tax of 5% for local registered organization and 15% for organization registered outside Tanzania.
Reporting lines
The consultant shall work under the supervision of Governance Programme Manager with strong
liaison with all partners and Oxfam Social Justice Programme Coordinator. This assignment is
scheduled to be done in 30 days including non working days.
Duration and Key Deadlines
The duration of contract will be a total of 30 working days between November 24th to 24th December
2015. Specific dates and deadlines are as follows
Activity
Advert for expression of interest
Bid analysis, selection and contract signing
Submission of evaluation plan and discussion with
Oxfam
The field work should take place between
Date
12 Nov 2015
20 Nov 2015
24 Nov 2015
The first draft of the report
21st Dec 2015
Make a brief presentation of findings and
recommendations
The final report should be submitted
22 Dec 2015
25Nov – 10 Dec 2015
31 December 2015 the latest
The evaluator(s) will be responsible for:

Developing a detailed evaluation inception report which will be shared and agreed upon with
Oxfam before commencement of the actual work.

Participate in initial briefings with Oxfam to ensure that the evaluation team is clear on the
expectations of this evaluation.

Developing evaluation tools which will review by Oxfam for discussion and agreed upon by the
two parties before the field work.

Reviewing of the project materials and other relevant literature in order to have adequate
understanding of the project and maximize incremental learning.

Conducting field visits to collect data through a combination of data collection methods. It is
expected that the team will incorporate gender and ensure representative involvement of the
beneficiaries and also non-beneficiaries in the evaluation.

Present to Oxfam the key findings and allow the team opportunities to give feedback and agree
on action points, lessons and recommendations.

Submit draft report to Oxfam for review, comments and inputs which will be taken into
consideration before submission of the final report.

Confidentiality of issues discussed shall be safeguarded by the evaluation consultant/s.
Bidding procedures
Interested consultant is requested to submit a proposal with following information through Oxfam
online application systems:
1. Introduction to the evaluator/evaluation team or organization
2. Profile of relevant skills and previous experience
3. Proposed methodology for undertaking the evaluation
4. Activity schedule
5. Proposed price schedule that covers all expenses