What to monitor? - Handicap International Seminars

HI Seminar on Impact Measurement, Phnom Penh
December 2013
Ulrike Last, TA Support to Civil Society and Inclusive Policies
Content

Recap: Links between policies, DPOs &
Access to services

Type of representative organizations, their role
in policies & access to services

Monitoring Effect & Impact of Capacity
Development of DPOs

Monitoring Policies and policies processes

Foci: Monitoring impact of policies project,
Rights monitoring, Tool development
processes

Conclusion
Introduction Support to Civil Society Unit

“Handicap International will
reinforce its action of developing
the capacities of representative
organizations and its national
partners. Our long-term aim is for
these organizations to be
autonomous and become
participants and influential
stakeholders in development
processes. ” Federal Strategy
 Capacity development in partnerships or through other means
 Strengthen organizations in management and their
representativeness
 Enhance technical expertise and legitimacy towards inclusive
policies, practice and programs
- Accessibility and Inclusive Local Development
 Human Rights Monitoring/ CRPD parallel reporting
 Empowerment of individual members
Background
Model for change – inclusion process
4) Implement disability, age &
gender inclusive measures for
making country/ sector/ services
or organization accessible
(training, coaching, advice)
3) Ensure sufficient decision
makers commitment and
allocation of necessary
resources (human, financial or
knowledge)
1) Participatory, multi-discipl. Inclusion Audit
of Country/ Sector/ Service or organization: To
understand & identify 1) disability, impairment
and/or gender gaps & status, 2) Disabling
Barriers & enabling Facilitators & Entry points
2): Decision making process on which barriers or
facilitators to address short/mid/long term at what
level and accordingly develop or adjust a strategy,
policy or disability inclusion action plan (with
indicators)
Inclusive Policies and Services –
a contract to describe below relationships & roles
Dev. or
humanitarian
actors
Policy makers/
Authorities
Advocate,
monitor,
claim,
input on
policy
Evaluate needs
and effects of
policies on needs
Make policies,
monitor & SPs needs,
finance
Use & /or finance
Monitor based on
policies
Users (PWDs &
families)
Dev. or
humanitarian
actors
Offer
service
program;
input on
policies
Service Providers
and developers
(private and public)
Serve according to policy/
implement provisions
Dev. or
humanitarian
actors
Representative organizations Who are they and roles in monitoring policies
Federations
of DPOs
• Members: DPOs
• Services: at times to members
• Registered
• Scope: national – regional - global
• Policy related action: influence & representation
in policy dialogues, input & monitoring or
advocacy
Disabled people
organizations
(DPOs)
Self Help Groups
(SHGs)
• Members: PWDs or family, or SHGs
• Services: at times to PWDs (rehab,
VT)
• Registered
• Scope: City to county level
• Policy related action: Input,
monitoring, awareness, civic
education, lobby or advocacy
• Members: PWDs or family
• Services: Peer support or
other
• Often not registered
• Scope: village to city
• Policy related action:
Input, monitoring,
awareness, civic education,
lobby or advocacy
Monitoring effects and impact of
Capacity Development of SHGs/ DPOs
1 Implementation of
participatory Baseline on
capacity of DPOs
5 Capacity
development
phase (integration
into organization)
4 Implementation of
support for capacity
development (training,
exposure, workshop ,
grant etc)
2 Consultation with DPOs
on which areas they
would like to improve
3 Identification of means
for capacity
development
Tools Available:
- Vida Brazil on
advocacy capacities
@ start and end
- DECISEPH:
Effect of capacity
development
- Organizational
Development Tool
(Steph)
-HI KenSom on
evidence, advocacy,
communication,
networking @start
and end
Challenges:
- HI is not the only
agency
-High number of
Contextual factors
- Difficulty to assess
political culture
versus short term
partnership versus
project mode versus
expectations
Introduction –
Policies & Inclusive policies
- Definition of situation with
evidence in given area and
legal framework (human
rights, etc.)
&
- Objective
-Target Group/ people to
benefit from the policy
- Specific groups
- Specific sub-sectors with
situation details & actions by
different actors
- M&E system
- Specified Duration of time
- Have a separate or integrated
Action Plan
- Related Resources
allocation
Define, coordinate
and guide the
response to a
specific issue
Policy design processes
and available monitoring tools
1 M&E; Data
collection Baseline
on individual/ SPs
& policy framework
5 Issuing,
dissemination and
enforcement
2 Consultation for
policy
Tools Available for
monitoring:
- OPERA Framework
on ESC rights to
monitor how state is
fulfilling obligations
(not used by HI yet)
- HI Mali
Monitoring the
implementation of
Local inclusive
Development plans
-HI KenSom
Individual rights
enjoyment &
Barriers and
Facilitators, SLand
Challenges
monitoring
impact:
4 Final Draft
Consultation
on Policy
3 Policy review
or new policy
formulation
- Sustainability &
Quality of tools
versus DPOs’
capacity to analyze,
input, comment and
reading culture
In focus:
Monitoring Policies - Inclusive Local Development
Research Project
WHO, WHEN?
- Research project with
CIEDEL, CIRRIS and HI,
Vida Brazil
- Implemented by the
DRT Support to Civil
Society Unit
- Official End: 06/2014
WHAT?
Analysis of 4
measurement axes to
understand levels of
A) Participation in local
decision making
B) Discrimination towards
PWDs
C) Disability
mainstreaming by LAs &
LDMs
D) Gender inclusion in
implementation of policies
WHAT OUCOME?
Tested measurement
package (tools and
guidance)
Four municipalities
Canada, Madagascar,
Brazil, France
In focus:
Tools for Rights monitoring: CRPD and/or equality
CRPD: National Legal and conceptual Framework for any
other law, policy and ultimately related services providers and
puts state as duty bearer for successive implementation
What to monitor?
- National data on
PWDs status
- Legal & Policy
Framework’s
compliance,
including Budgets&
Service provision
Who monitors?
- DPOs-Civil
Society
- Government
What tools available
and used in HI?
- HI Middle East: DRPI
tools used for MISAWA
- HI KenSom: A) Dadaab
rights and
discrimination
monitoring, used by
DPOs supported by HI
- HI China: Parallel
Reporting Tools
In focus:
How are tools for rights/ policy monitoring developed?
AIM: Aiming for sustainability of monitoring processes
through participatory processes with partners &
minimizing the complexity of tools
For which
user?
DPOs
Example of (short) process:
Which
1) Review guidelines and
Conceptual
evidence
Framework?
2) Reviewing legal and policy
National,
regional
With Who
framework and identify relevant
&
international
provisions
designed?
legal and policy
3) Develop related questionnaire
DPOs, academic
framework:
to identify status of PWDs and
or other key
Constitution,
in access
actors with equal National disability Barriers andtofacilitators
services
gender
policy; CRPD
4) Test, Train, roll out and review
presentation
Conclusion –
Future Action for common tools?
Standardize quality & systematize DPOs capacities,
rights monitoring and policy related tools
Comprehensive toolset macro & Simplified tools for micro for
actors with less abstract skills:
meso level:
- Use and develop Equiframe
work, DRPI and Opera further
- Budget monitoring tool
development
- Impact of Policies
- SPs’ Barrier & Facilitator
(Education UNICEF)
- Individuals’ Status (WG)
- On rights/ policy compliance for
different sectors from development
to refugee context:
- Community mapping of barriers
and facilitators
- Service providers barrier and
facilitators
- Policies & LAs
Develop related Training tools
Orkun Cheran,
Thanks, Merci, Gracias!
Resources, further reading & Study

CESR: http://cesr.org/section.php?id=179 on Opera Framework

Dr. Eilionoir Flynn (2011): From Rhetoric to Action Implementing the UN
Convention on the Rights of Persons with Disabilities. Cambridge: Cambridge
University Press

Mannan, H., Amin, M., MacLAchlan, M. & the EquitAble Consortium (2011): The
EquiFrame Manual: A tool for Evaluating and Promoting the Inclusion of Vulnerable
Groups and Core Concepts of Human Rights in Health Policy Documents. Dublin:
Global Press

Www.makingitwork.org on successful advocacy methods leading to inclusive or
specific policies

UNDG (2011): Including the Rights of Persons with disabilities in United Nations
Programming at Country Level. A Guidance note for UN country teams and
implementing partners.

UNOHCHR: Monitoring the Convention on the Rights of Persons with Disabilities.
Guidance for Human Rights Monitors.

WHO: WHO quality Rights Tool. Assessing and improving quality and human rights
in mental health and social care facilities.