Cleanliness Best Value Performance Indicator 199
Background History:
The Government, through its ‘Cross-Cutting Review On Improving Public Space’,
identified Local Environmental Quality as one of the chief concerns of local
communities. This is supported by research undertaken by the Local Government
Association, who concluded that cleaner and safer streets are issues that are of
concern to almost everyone.
Until the introduction of BV 199, there was not a robust, reliable indicator covering
environmental cleanliness. The Government’s cross cutting review proposed that a
new Best Value Performance Indicator (BVPI) should be adopted to report on the
cleanliness of the street and local environment in local authorities.
The survey that forms the background to the Cleanliness BVPI has been developed to
measure the cleanliness of the local environment, as a member of the public would
perceive it.
It is based on the methodology of the Local Environmental Quality Survey of England
(LEQSE) developed by ENCAMS (Environmental Campaigns), for monitoring a
range of local environmental quality issues. The results will be comparable with the
overall national returns delivered to the Government every year.
The data from BV 199 surveys provide local authorities with valuable information on
the extent of litter, detritus, graffiti and flyposting, and therefore the success of their
cleansing regimes, over a variety of different land-uses in their authority.
What is BV199
BV199 requires Solihull MBC to carry out three comprehensive surveys on litter,
detritus, graffiti and fly posting, each survey consisting of 300 site assessments per
financial year. The 300 site assessment survey is carried out throughout a random
selection of five electoral wards across the borough.
The survey is then divided further into ten different land use classes e.g. main roads,
rural roads, parks and open spaces etc, equalling 30 site assessments per land use
class. This methodology provides the main structure for the three annual surveys and
provides an extremely accurate and extensive informative report, enabling Solihull
MBC not only to report these findings as a BVPI, but also to provide an extremely
versatile tool that we can utilise to scrutinise and alter our services.
Method to BV199
BV199 is split into three stages:
Planning
Site Assessments
Calculating Data
1
1. Planning:
i. Ward Selections
To ensure that the 300 survey assessments are evenly distributed across the borough
and the electoral wards to be assessed are selected using a random format. BV199
uses a systematic mechanism to list and select which of the wards will be assessed.
This system involves listing the boroughs electoral wards by the index of multiple
depravation scores, lowest at the top highest at the bottom.
ENCAMS prepared a set of estimated Indices of Multiple Deprivation at ward level,
based on the 2004 Indices of Deprivation published by the Office of the Deputy Prime
Minister (ODPM). This information is obtained from the ENCAMS web site and then
the wards are listed in order of lowest IMD first.
The list of wards are then split as evenly as possible into five groups, so that when
each survey is carried out one ward from each group is assessed on a rolling
programme. The ward selection table below shows how all this information is used to
select the survey wards.
Wards split
into five
groups
Index of multiple
depravation score
2
Each ward is selected on a
rolling programme each year
Using this selection method each ward is assessed evenly and the assessments should
in theory provide data from a range of wards ranging from high to low indices of
multiple deprivation. Therefore, the data gathered should represent a full cross section
of the current standard throughout the whole borough.
ii. Land Use Classes
Further to the wards selections BV199 requires the borough to be segregated into land
use classes, this again enables the survey to cover a widespread area. There are ten
land use classes, which together cover the vast majority of geographical areas within
the borough.
1) Primary Retail and Commercial Areas
2) Secondary Retail and Commercial Areas
3) Higher Density Housing Areas
4) Lower Density Social Housing Areas
5) Lower Density Private Housing Areas
6) Industry/Warehousing/Retail Sheds/Science Parks
7) Main Roads
8) Rural Roads
9) Other Highways
10) Recreation Areas
The map below shows how the borough is colour co-ordinated into these ten land use
classes. This format is then used during the survey planning process.
3
When the land use classes have been identified within the chosen wards the 300 site
surveys are then divided into 30 assessments per land use class. The aim is to try and
assess as many of the land use classes per ward. However, this is not always possible,
so there will then need to be a balance between the various wards, which may result in
a higher quantity of assessments in one ward compared to another. If none of the
wards selected have a particular land use class within there boundaries, then these
assessments can be carried out within an additional ward. The table below shows how
to balance this process.
2. Site Assessments
i. Transact Assessments
Once the planning is completed, the wards and land use classes have been selected
and the 300 site assessments have been divided and balanced out appropriately, the
site surveying or assessing can commence. When a site is surveyed it is split into
transect assessments, each transect approximately the same size in length and selected
using a random system.
The officers who carry out the surveys within Solihull use a simple yet effective
means of selecting a transect. For example: once an area has been highlighted they
visit a randomly selected road and using the nearest parked car the first number on the
number plate is highlighted and the officer then uses that number to count the number
of lamposts or properties down the particular road. The transect is then measured from
this point onwards and the process is then repeated.
4
Transects are roughly 50m long and should be as wide as the road. The widths will
vary depending on the land use class e.g. Parks and open spaces the footpath is used
and the transect is as wide as 2m either side of the footpath.
ii. Grading
The theory and development of the BV199 and the survey process is based on the
ENCAMS Local Environmental Quality Survey of England (LEQSE) which uses the
Environmental Protection Act (EPA) litter and detritus A, B, C and D guideline to
grade the condition of the area. ENCAMS since the BV199 came into effect have
developed the EPA litter and detritus guidelines further, to incorporate graffiti and fly
posting on the same basis. The Pictures below give an example of the grading
standards:
Litter Grading
A
B
C
D
5
Detritus Grading
A
B
C
D
6
Graffiti Grading
The transect is
completely free of
graffiti.
A
Some graffiti is present, but it is
minor in extent, and many people
passing through the transect would
not notice it.
B
Graffiti is present to the extent that
it would be clearly visible to people
passing through the transect, and
visible at a distance from at least one
end of the survey transect.
Graffiti is extensive over a large part
of the transect and is likely to be
clearly visible and obtrusive to
people passing through the transect,
and visible from any point on the
transect.
C
D
7
Flyposting Grading
The transect is
completely free from
flyposting
A
Some flyposting is present, but it is
minor in nature and it is likely that
many people would not notice its
presence. This can include tie-bands
or other forms of fastening which
remain after a notice has been
B
Flyposting is present on the transect
to the extent that it is likely to be
clearly visible to people using the
area, and visible at a distance from
at least one end of the survey
transect.
Flyposting is extensive throughout
much of the transect and is clearly
visible and obtrusive to people passing
through the transect, and visible from
any point on the transect.
D
C
8
ENCAMS have also incorporated an intermediate grade that fits between the current
A, B, C and D to allow more flexibility when grading an area that may not fall into
one of the current grading brackets, these include: B+, B/C and B-.
The grading information is inputted onto grading sheets along with various other
information and details on the location, land marks, where the transect starts, date,
time etc.
3. Calculating Data
The information gathered about the 300 site assessments is compiled onto a database
that has been specifically designed and developed for BV199 by ENCAMS. The
information that has been gathered on the grading sheets is inputted and the system
will automatically calculate the BVPI figure including all the information broken
down into various stages i.e. land use classes etc.
Solihull and BV199
Solihull MBC have been extremely successful in the development and
implementation of BV199. Before BV199 Solihull MBC were already carrying out
monitoring procedures using a very similar methodology to the current system.
Solihull MBC are also members of the ENCAMS people and places programme,
which included ENCAMS carrying out the Local Environmental Quality Survey of
England (LEQSE) within Solihull.
Solihull MBC has incorporated BV199 into the current working systems with ease
and identified from the start, that BV199 is potentially a very comprehensive tool that
can provide much needed information and aid in how Solihull MBC delivers the front
line cleansing services. BV199 is now starting to play an important role in gathering
and processing vital information and will continue to be used to continually scrutinise
the operational standards.
BV199 Results
Until April 2005 BV199 was purely based on litter and detritus and the results
provided a single calculated score. However since the introduction of graffiti and fly
posting in April 2005 BV199 is now effectively split into three areas, providing three
calculated scores.
BV199a = Litter and detritus combined score
BV199b = Graffiti score
BV199c = Fly posting score
There is a BV199d fly tipping. However this particular section has been separated and
works in conjunction with the flycapture national data base
9
1. BV199a Results
The last four surveys have been extremely successful and have provided excellent
results. The national benchmark target figures for BV199 for the following years are
as follows:
2001/2 = 28%
2002/3 = 26%
2003/4 = 22%
2004/5 = 16%
In 2003/04 the BV199 for Solihull MBC was 25.26% resulting in Solihull MBC
falling behind the national figure by 3.26%. However the internal target figure set by
Solihull MBC was 30% so the figure did fall within the target figure by 4.74 %
The BV199 figure for Solihull MBC for 2004/05 was 15%, resulting in an increase of
10.26% on the previous year and climbing above the national benchmark figure by
1%, as well as 15% above the internal target.
The BV199 figure for Solihull MBC for 2005/06 cannot be calculated as there is still
one survey to be carried out. However, from the two surveys that have been
completed, it is estimated that the BV199 figure for 2005/6 will be 4.5%. Therefore
out of 900 site assessments throughout Solihull 2005/06, 95.5% of the areas assessed
are a grade A to B standard. In fact the last three surveys show an exceptionally high
BV199a score for litter and detritus:
December to March 2004/05 =2%
April to July 2005 = 6%
August to November 2005 = 3%
%
Percentage of Site Assessments to Specification
from 2003
100
90
80
70
60
50
40
30
20
10
0
74.74
85
95.5
Series2
2003/04
2004/05
Year
10
2005/06
%
Pecentage Site Assessments to Standard (last three
surveys carried out)
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
98%
94%
97%
Series1
Dec to Mar
Apr to Jul
Aug to Nov
Survey Period
2. BV199b Results
Due to the implementation of graffiti into BV199 back in April 2005 and because
there is still the December to March survey remaining, there is no completed BV199b
figure. However, the previous two survey results show the following results:
April to July 2005 =1%
August to December 2005 = 2%
The national benchmark figure for BV199b graffiti is set at 4%. Using the figures
from the previous surveys, the estimated figure for Solihull MBC will be 1.5% which
will result in Solihull MBC falling 2.5% below the national standard. If you reverse
these figures this then means that out of 900 site transect assessments, 98.5% have
little or no graffiti within the transect and surrounding area.
3. BV199c Results
Again because the BV199c fly posting element was not introduced until April 2005
and because there is still a survey yet to be completed, there is no completed BV199c
figure. However, the previous two survey results show the following results:
April to July 2005 = 1%
August to December 2005 = 0%
The national benchmark figure for BV199c fly posting is set at 1%. Using the figures
from the previous surveys, the estimated figure for Solihull MBC will be 0.5% which
will result in Solihull MBC falling 0.5% below the national standard. If you reverse
11
these figures this then means that out of 900 site transect assessments 99.5% have
little or no fly posting within the transect and surrounding area.
BV199 Comparison Data
The following information compares the Solihull MBC BV199 results with the results
from our neighbouring local authorities for 2003/04 and 2004/05
BV199 2003/04 Figures
Local Authority
2004/05 BV199 Figure
Percentage of Areas to Standard
Solihull
Birmingham
Dudley
Sandwell
Walsall
Wolverhampton
Coventry
25.26%
23%
21%
10%
19.1%
34%
37.6%
Percentage of Sites
to Standard
74.74%
77%
79%
90%
80.9%
66%
62.4%
100%
90.0%
90%
80.9%
77.0% 79.0%
74.7%
80%
66.0%
70%
62.4%
60%
50%
40%
30%
20%
10%
0%
u
lih
o
S
ll
h
ing
m
Bir
am
d
Du
ley
nd
Sa
we
l
ll
lsa
a
W
Local Authority
12
rh
lve
o
W
p
am
to
C
en
ov
tr y
BV199 2004/05 Figures
Local Authority
Percentage of Areas to Standard
Solihull
Birmingham
Dudley
Sandwell
Walsall
Wolverhampton
Coventry
2004/05 BV199 Figure
15%
20.4%
24%
12%
19.5%
19%
37%
Percentage of Sites to
Standard
85%
79.6%
76%
88%
80.5%
81%
63%
100%
88%
85%
80.5% 81%
90%
79.6% 76%
80%
63%
70%
60%
50%
40%
30%
20%
10%
0%
ll
y
m
ull
we
dle
ha
lih
d
u
g
o
n
n
D
S
Sa
mi
B ir
y
ll
to
ntr
ls a
p
e
a
v
m
W
Co
rha
e
v
l
Wo
Local Authority
BV199 Evaluation
As shown in the information above, BV199 provides a measurable figure that can be
cross-referenced and compared with other local authorities across the board, enabling
us to monitor our standards against others
Solihull MBC has been recognised by DEFRA as a key authority within the
development and implementation of BV199 and subsequently Solihull MBC has
recently been put forward as a benchmark authority for best practice in the midlands
area.
13
BV199 is providing Solihull MBC with a comprehensive tool that portraits a clear
picture of the cleanliness quality of our roads, streets and neighbourhoods. More
importantly it enables us to monitor, evaluate and develop our cleansing services on a
regular basis.
The results show a significant increase in cleanliness standards since 2003, supporting
the fact that our current Streetcare contract is providing the high quality standards that
Solihull MBC require. However, there is always room for improvement and
development and the information from the BV199 surveys should continue to be
analysed and we should continue to scrutinise our cleansing service identify further
areas of improvement and providing best value.
14