EMPOWERING WOMEN TO LEAD
TERMS OF REFERENCE – 14 FEBRUARY 2017
EVALUATION OF IWDA’S ANCP FUNDED SAFETY AND SECURITY PROGRAM – CAMBODIA PROJECT
SUMMARY
TITLE
EVALUATION OF IWDA’S ANCP FUNDED SAFETY AND SECURITY
PROGRAM 2013-2016
2013
– Cambodia Project


PURPOSE


OUTCOMES
To conduct an evaluation on the multi-year ‘Community Action Against
Gender Based Violence’ project implemented by Ba
Banteay Srei as part of
the broader multi-country
country evaluation of IWDA’s ANCP funded safety
and security program;
To identify how the specific service components are being implemented
and whether or not implementation is based on the initial proposal;
To identify Banteay Srei’s current technical support needs in relation to
the VAW work;
To determine what other opportunities there are for the adaptation of
those approaches determined as effective, into new locations and
contexts.
1. It is expected that this evaluation will identify what learnings have
occurred in relation to the provision of crisis support
support, counselling and
emergency accommodation/safe house and other relevant services to
victim/survivors of VAW.
2. The evaluation will provide IWDA with a measure
sure of how effectively the
direct service components are being provided using UN Women’s
Essential Services Package for Women and Girls Subject to Violence
(2015) as a comparative tool.
3. The evaluation will also identify how the Banteay Srei organisation are
delivering the prevention of VAW components by using as a comparison
contemporary evidence based guidelines on what works in violence
prevention (Vic Health Preventing violence before it occurs
o
and UN
Women’s A framework
ramework to underpin action to prevent violence
viol
against
women).
4. The evaluation will also provide Banteay Srei with key learning and tools
in relation to undertaking their own service evaluations in the future
(Program Logic and or Theory of Change).
5. The evaluation will help identify what an enabling environment looks like
in relation to the successful and effective provision of the services
described above, taking into account the internal organisational structure
and operations and the external system including all the key
stakeholders.
6. The evaluation will identify what, if any, primary or secondary prevention
of violence strategies and or activities are taking place and whether
these are evidence-based and to what extent are they connected to the
delivery of their support services.
EXPECTED DURATION
20
0 DAYS (14 days in country+ 6 days writing)
REPORTING TO
Tracy McDiarmid
McDiarmid, Senior Program Manager
LOCATION
Data collection in Cambodia
COMMENCEMENT
Early
Early-mid March 2017
COMPLETION
30 April 2017
BUDGET
AUD$400-600 daily rate commensurate with experience and expertise
INTRODUCTION
Lack of safety and security for women is both an abuse of human rights and a very significant barrier to social,
economic and political empowerment. IWDA’s approach to safety and security incorporates a focus on responding to
and preventing violence against women as well as gender issues relevant to living in settings experiencing or affected
by civil and political conflict. Both sources of insecurity profoundly shape women’s lives and opportunities, at great
cost to individuals, families, communities and economies. Women living in contexts of political, religious or inter-ethnic
violence and conflict are at heightened risk of violence yet are frequently denied the opportunity to participate in
processes which contribute to conflict prevention and resolution and to wider democracy.
IWDA is committed to supporting the work of our partner organisations in relation to the delivery of essential services
to support women and girls who have experienced gender based violence and in activities and strategies that work
towards prevention and reduction of the re-occurrence and perpetration of such violence. IWDA supports and
proposes a rights-based approach to the delivery of all services for women and girls based on the principles of safety,
a victim/survivor centred approach, advancing gender equality and women’s empowerment, culturally and age
appropriate and sensitive and perpetrator accountability for their partner organisations. For prevention strategies and
activities IWDA supports and proposes models that address the root causes as well as the risk and protective factors
associated with VAW.
PROGRAM OVERVIEW
Through the Australian NGO Cooperation Program (ANCP), IWDA has supported three multi-year projects to provide
support service for victim/survivors of violence against women (VAW) and implement prevention of VAW activities in
1
2
3
Cambodia, Myanmar and Papua New Guinea. In 2016 IWDA conducted individual evaluations of the projects in
Myanmar and PNG, this third evaluation in Cambodia will collect the final information prior to aggregation into a metaevaluation of the ANCP Safety and Security Program 2012-2016.
EVALUATION QUESTIONS
The overall key evaluation questions that the report seeks to answer are as follows:



What outputs and outcomes have been achieved? For whom?
Have the women and men (service users) felt listened to, respected, validated and supported by their
experiences of receiving a service from the organisation?
Have other key organisational stakeholders found working with the organisation a positive experience and
would they refer or continue to refer women or men to the service/organisation?
It is anticipated that some of the following evaluation questions will be addressed throughout the data collection
process during the in-country field visit, to be refined in consultation with IWDA and Banteay Srei.
 What significant changes have occurred in women’s lives as a direct result of the services they have received
and to what extent are these changes likely to be sustained?
 What changes in policies, practices, attitudes and gender relations relevant to women’s empowerment and
gender equality have happened as a result of the VAW work (either through the direct service provision or
prevention of violence and advocacy activities)?
 What are the impacts on the partner organisations from the inclusion of the funded service components?
 To what extent are projects meeting minimum standards for direct service responses to victim/survivors of
Violence Against Women (VAW)?
 In what areas could the partner organisations improve their responses to victim/survivors of VAW?
 How do key stakeholders experience the service delivery of our partner organisation?
 To what extent are partners using evidence based primary prevention strategies?
1
2
3
BanteaySrei, Cambodia: Community Action Against Gender Based Violence 2012-2016
Palaung Women’s Organisation, Myanmar: Promoting and Supporting Elimination of Violence Against Women 2011-2016
Eastern Highlands Family Voice, PNG: Promoting Women’s Development, Protection and Healing 2008-2016
2







How has the IWDA partnership model supported the organisations to work towards/achieve their service
outcomes?
Are the organisational operational structures and systems currently in place fit for purpose? E.g. are the staff
appropriately skilled and trained to enable them to work towards/achieve the identified outcomes? Are there
program manuals that provide an overview of the way the organisation undertakes service provision?
Are the approaches used in direct service provision based on rights and gender equality frameworks?
Where relevant what education and training providers and qualifications are, or could be, available and being
utilised?
What quality assurance/counsellor monitoring and support models are available and being utilised?
What good practices are in existence that could be replicated or scaled up, to strategically address gaps in
quality, accessible support services (i.e. counselling) for victim/survivors of VAW?
To what extent is the service model or approach being utilised able to be replicated or scaled up in another
organisation within the same country or in another country/context/setting?
METHODOLOGY
The evaluations will be undertaken using a mixed method approach that will combine both quantitative and qualitative
4
data collection. Specifically, the Process Evaluation approach will be used which assesses the project or program
implementation and whether or not it is being delivered as intended. Using this type of evaluation helps find the
answers about ‘how’ and ‘why’ a VAWG project or program for example, was implemented, ‘how’ and ‘why’ it is or isn’t
working and who the activities are reaching and whether inputs have been sufficient, for example, has there been
enough counselling training for the counsellors to enable them to provide quality counselling and do they receive
adequate monitoring and supervision.
As an overall guiding approach the evaluation will be led by what ‘feminist evaluation’ emphasises such as being
5
6
participatory, empowering and having a social justice agenda, and will demonstrate the BOND evidence principles.
The methods that will be used to gather data will be consistent with the evaluations conducted in MMR and PNG,
modified as appropriate for the Cambodian context and agreed in partnership with Banteay Srei and IWDA. The
methods will include Key Informant Interviews, Focus Group Discussions, Surveys (via Survey Monkey), secondary
data including annual reports, other organisational reports, case notes, implementation guidance/tools and case
studies.
Case studies and other relevant documentation will be collected to support the evaluation reports. At least two Case
Studies will be sourced and developed to provide evidence of the program’s effectiveness.
4
Process evaluation describes the programme and determines whether the programme is being delivered as intended. Process evaluations may
look at staffing, programme content and delivery, and the numbers and characteristics of participants (Valle et al., 2007).

Was the programme carried out as planned? How many activities were conducted (e.g. trainings, campaigns, workshops, etc.)?

Did the programme run into logistical or practical difficulties?

What modifications were made along the way and why?

Did the programme reach the number of women and girls, men and boys intended?

What are participants’ perceptions of and satisfaction with the programme?
5
The basic tenets of this approach are as follows, (Sielbeck-Bowen et al. 2002: pp. 3–4):

Feminist evaluation has as a central focus the gender inequities that lead to social injustice.

Discrimination or inequality based on gender is systemic and structural.

Evaluation is a political activity; the contexts in which evaluation operates are politicised; and the personal experiences, perspectives, and
characteristics evaluators bring to evaluations (and with which we interact) lead to a particular political stance. A feminist evaluation
encourages an evaluator to view her- or himself as an activist.

Knowledge is a powerful resource that serves an explicit or implicit purpose.

Knowledge should be a resource of and for the people who create, hold, and share it. Consequently, the evaluation or research process
can lead to significant negative or positive effects on the people involved in the evaluation/research. Knowledge and values are culturally,
socially, and temporally contingent. Knowledge is also filtered through the knower.

There are multiple ways of knowing; some ways are privileged over others.
6
BOND evidence principles,https://www.bond.org.uk/effectiveness/monitoring-and-evaluation
3
STAKEHOLDERS
The evaluation is primarily being undertaken for BanteaySrei, and IWDA to identify how the funded VAW components
that are supported through ANCP multi-year funding grants are being delivered. Other key stakeholders might include:



Service users (women and girls and their families who have experienced violence and or men who use
violence),
Key referral and partner organisations and agencies (other VAW services, police, other Non-government and
faith-based social service organisations, government departments and agencies, hospital and health
services, educational facilities and services and legal and court-based services);
National and international donors (including DFAT, UN Women and others).
ETHICAL CONSIDERATIONS
Ethical considerations: Gender Based Violence/ Family and Sexual Violence
The research must be guided by the following ethical considerations:

Informed, un-coerced and documented consent where it is clear that participants can withdraw from research
at any time;
 The best interests and safety of women should be at the centre of all decisions and discussions (Do No Harm)
 Inclusivity;
 Anonymity and confidentiality;
 Privacy;
 Rights-focused/beneficence-focused
Researchers are expected to read and adhere to ethical research guidance provided by IWDA, together with
Principles and Guidelines for Ethical Research and Evaluation in Development developed by the Australian Council
[1]
for International Development.
Further, it is expected the Consultant will ensure the methodologies adhere to international ethical and safety
guidelines in relation to conducting research on VAW, such as:


World Health Organization (2003) Putting Women First: Ethical and Safety Recommendations for Research
[2]
on Domestic Violence Against Women
Jewkes, R., E. Dartnall and Y. Sikweyiya (2012). Ethical and Safety Recommendations for Research on the
Perpetration of Sexual Violence. Sexual Violence Research Initiative. Pretoria, South Africa, Medical
[3]
Research Council
KEY DELIVERABLES
TARGET
DELIVERABLE
AUDIENCE
OBJECTIVES
TIMEFRAME
Banteay
Srei& key
stakeholders
A comprehensive Risk and Safety Plan,
which includes a risk assessment and
protocols, must be developed to ensure
women will be supported to participate in
the activities safely and in making
decisions in whether to provide sensitive
information.
The plan must clearly document
in detail anticipated ethical and
safety issues and demonstrate
clearly how they will be
addressed throughout the entire
research process. The Plan
should be informed using IWDA’s
Research Ethics Guidelines.
IWDA will work with the
consultants to identify the key
elements the Plan should
include.
March 2017
Brief Evaluation Plan
To outline methodology,
stakeholders, tool adaptation for
Cambodia context (as
March 2017
[1]
https://acfid.asn.au/sites/site.acfid/files/resource_document/Principles-for-Ethical-Research-and-Evaluation-in-Development2016.pdf.
http://www.who.int/gender-equity-rights/knowledge/who_fch_gwh_01.1/en/.
[3]
www.ru.ac.za/media/rhodesuniversity/content/studentzone/documents/Ethical%20%20safety%20recommendations%20for%20research%20on%
20the%20perpetration%20of%20sexual%20violence.pdf.
[2]
4
required),and timeline
Data Collection completed:
 Administration of a survey for key
stakeholders (via internet or using
printed copies);
 Key informant interviews with
organisational personnel, service
users & some key stakeholders;
 Focus group discussions with
service users;
To obtain data/information in
order to provide responses to the
evaluation questions from key
organisational and other relevant
personnel who are either
implementing the project, are
users of the services or are a key
partner/stakeholder organisation
(i.e. a referral point).
March/April 2017
Draft Evaluation report completed.
An Executive Summary of no
more than five pages, with no
acronyms and no footnotes,
should include a brief description
of the evaluation methodology in
addition to the summary of key
findings and five priority
recommendations. The report
body of no more than 30 pages
(excluding annexes) should
include an introduction, key
findings, conclusions and full
recommendations.
March/April 2017
Final Evaluation report
To provide a written presentation
of the findings in order to be a
useful resource for Banteay Srei
to synthesise learnings, gaps in
delivery and technical capacity
and recommendations for further
development.
By 30 April 2017
TIMEFRAME
It is anticipated that these deliverables will be provided through a maximum engagement of 20 days over the period
March 2017 to 30 April2017.
TASK
DAYS
TIMING
1. Risk and Safety Plan of anticipated ethical and safety issues
0.5 days
March 2017
2. Evaluation Plan, including timeline, stakeholders, methodology and tool
modification
0.5 days
March 2017
3. In-country (Cambodia) key informant interviews, focus group discussions,
survey, and partner meetings (data collection).
12 days
March 2017
4. Drafting the Cambodian evaluation report.
3.5 days
March/April 2017
5. Completion of the final evaluation report.
3.5 days
April 2017
Maximum
20 days
30 April 2017
APPLICATIONS
Applications are sought from qualified individuals and/or teams. Both international and Cambodian nationals are
eligible to apply. All Researchers must agree to comply with all IWDA, DFAT and ACFID child protection
5
requirements and must sign IWDA’s Child Protection Code of Conduct and adhere to IWDA’s Child Protection Policy
and supporting procedures.
Applications should include:




Covering Letter addressing previous experience and the Selection Criteria for each candidate
CV
Proposal for methodology (including brief timeline and budget)
One example of previous relevant written work, for example a research report
Applications are required by midnight, Sunday 26 February 2017 (Australian Eastern Daylight Savings Time).
Email enquiries and applications to Tracy McDiarmid, Senior Program Manager [email protected].
Interviews will be conducted on Tuesday 28 February 2017. Applicants will need to be available for field travel from
mid-March 2017.
SELECTION CRITERIA
ESSENTIAL
 Experience in the delivery of counselling or case work in Violence Against Women services with a high level
understanding of trauma and gendered practice
 Strong understanding of gendered norms, cultural practices and attitudes and behaviours that relate to
women, especially violence against women, preferably in Cambodia
 Experience in evaluation study designs and implementation underpinned by feminist values
 Extensive experience in conducting qualitative research in developing country contexts
 Exemplary cross-cultural communication skills
 Demonstrated understanding of the ethical considerations involved in GBV research, including considerations
of the specific needs of women participants with a disability, and proven capacity to incorporate these in the
research process;
 Strong oral communication and excellent English report writing skills.
DESIRABLE
 Khmer language skills desirable.
6