Proposition of a methodology for the test of the standards

Regional Workshop to disseminate Water
Supply and Sanitation Standards of Service,
adapted to LDCs
Préparation to the ISO TC 224 Drafts Standards test in Africa.
WBI/NWSC WORKSHOP
OUGANDA, KAMPALA, JULY, 24th TO 27th 2007
Proposition of a methodology for
the test of the standards in
Africa
Ingrid PICARD
URBACONSULTING
WBI/NWSC Workshop, Kampala
2
Objectives for testing the standards
 To verify the relevancy of these standards in
Africa
 Are they considered useful by the stakeholders?
 Do they contribute to improve water and
sanitation services?
 To analyse the results of the test process of
the standards
 To propose changes which take into account
the specific context of African countries
WBI/NWSC Workshop, Kampala
3
Objectives for testing the standards
 To develop an ISO guidebook for the
application of the 24510/24511/24512
standards, specifically adapted to African
realities, and to facilitate the dissemination of
these standards
WBI/NWSC Workshop, Kampala
4
Objectives of the workshops
 To present the standards
 To present the proposed methodology for
testing the standards
 To discuss this proposition
 To verify the motivation of local stakeholders
 To propose a road-map for the next deadline
WBI/NWSC Workshop, Kampala
5
The global process
WBI/NWSC Workshop, Kampala
6
What does it mean ‘To test the
standards’?
 To test the standards means:
 To implement the standard as it stands, for a long
time period (+/- 2 years)
 To implement 2 or 3 of these standards:
o
o
ISO 25510 for each site
+ ISO 24511 for the sanitation service and/or ISO 24512 for the water
supply service
 To follow the 6 stages described below
WBI/NWSC Workshop, Kampala
7
Stage 1: Identification of the
stakeholders
 Stakeholders are numerous but it is essential to
have at least the participation of:




Users
Responsible bodies
Operators
Regulatory bodies
 A Test Pilot Comitee, including a representative of all
these stakeholders, will be created. It will be in
charge of the application of the test of the standards
on the site
WBI/NWSC Workshop, Kampala
8
Stage 2: Preparation of
implementation
 This stage will be essential for the test of the
standards. It will consist of:
 Analysing the whole standards
 Producing a shared vision of the objectives for
improving services
 Analysing gaps with regards to existing situation
 Identifying priority action plans
 Choosing indicators
 Designing a monitoring system
WBI/NWSC Workshop, Kampala
9
Partial evaluation
 At the end of stage 2 an evaluation will be
done
 The test will continue if consensus and realistic
action plans have been identified
 The test will end if not…
 An initial version of the Application
Guidebook could be draft at this stage
WBI/NWSC Workshop, Kampala
10
Stage 3: Implementation
 Stage 3 is the implementation phase of the
test. Actions will be:
 Implementation of priority action plans
 Monitoring the indicators
 Coordination with the African level and the
external partners
WBI/NWSC Workshop, Kampala
11
Stage 4: Analysis of the impact
 Evaluation of the activities undertaken during
the stage 3 will allow an analysis of the
progress made
 If possible, new objectives and action plans
could be identified (return to stage 2) to carry
out the improvement of services
WBI/NWSC Workshop, Kampala
12
Stage 5: Evaluation and global
synthesis for generalisation
 Local level evaluation
 Collect the opinions of the stakeholders involved
 Measure the effects of the implementation of the
standards on the water and sanitation services
 Global evaluation and analysis of the results
 Analysing the results of all the test sites
 Conclusion on the applicability of the standards in
African countries
 Composition of the ‘Standards Application
Guidebook’
WBI/NWSC Workshop, Kampala
13
Stage 6: Continuing with standards
implementation
 The implementation of the standards can be
carried out even after the end of the project
 The improvement of the service is a long
process, which never really end…
WBI/NWSC Workshop, Kampala
14
WBI/NWSC Workshop, Kampala
15
African specifics (1/2)
 Weak governance (unclear institutional
organisation) and lack of dialogue between
stakeholders
 Many informal operators (with poor
accounting, no contract…), even if they have
thousands of customers and a good quality
of service
WBI/NWSC Workshop, Kampala
16
African specifics (2/2)
 Monitoring systems are often weak or even
lacking: data collection is very difficult, then
calculation of performance indicators are not
easy to make
WBI/NWSC Workshop, Kampala
17
Forward-looking planning (1/3)
 Beginning of the test phase: early 2008
 Months 1 to 3: identification of the stakeholders and creation of the
test Pilot Committee;
 Months 3 to 4: analysis of the standards content; definition of
objectives / evaluation criteria and associated performance
indicators;
 Months 4 to 5: collection of available data, taking advantage of the
human resources found in the Pilot Committee;
 Months 5 to 6: evaluation of the initial situation and determination of
the « zero value » for each of the performance indicators that will
have been selected as relevant
WBI/NWSC Workshop, Kampala
18
Forward-looking planning (2/3)
 Months 6 to 24: application of the standard
 implementation of the procedures in order to obtain reliable data
with which calculate the performance indicators; standard should
be tested for 18 to 24 months
 Months 24 to 26:
 evaluation of the final situation and analysis of the contribution of
the standard to the improvement of the service;
 elaboration of recommendations to the ad hoc group for changes
to make to the standards as a function of the specific
constraints/difficulties at each site, whether they reflect, or no,
African realities
WBI/NWSC Workshop, Kampala
19
Forward-looking planning (3/3)
 Months 26 to 30:
 centralisation of the results from the whole of the group of test sites by
ad hoc DC group
 global synthesis of the results obtained at the test sites and formulation
of recommendations (final consolidated version) to the ISO technical
committee for eventual changes to the standards (for the review study of
the standards in 2010).
 This calendar will be refined and adapted for each site.
 Every six months, the meetings of the SC5 “Norms ISO TC224”
of the AfWA will be an opportunity to give updates on the
progress of the process in each single site.
WBI/NWSC Workshop, Kampala
20
Thanks for your attention!
Ingrid Picard
[email protected]
WBI/NWSC Workshop, Kampala
21