ICAO State Safety Programme (SSP) Implementation Course

Module N° 5 – State ALoS
SSP – A structured approach
Module 7
SSP training
programme
Module 8
SSP familiarization plan
Module 4
ICAO SSP
framework
Module 5
State ALoS
Module 6
Prescription /
Performance based
environment
Module 1
Introduction to the
SSP familiarization
course
Module 2
Basic safety
management
concepts
Module 3
ICAO SARPs related
to safety
management
Objective
At the end of this module, participants will be familiar with the
concepts and dimensions underlying the acceptable level of
safety (ALoS) related to an SSP
Contents
Introductory concepts
Acceptable level of safety (ALoS)
ALoS related to an SSP
Summary
Questions
Introductory concepts
 The development and implementation of ALoS builds upon
certain basic concepts of systems theory
 There is a hierarchy underlying the progression of these
basic concepts towards the development and
implementation of ALoS
 Understanding of the concepts and hierarchy is an essential
foundation for the development and implementation of ALoS
and the SSP
Introductory concepts – The basic theory
1. Safety – as defined by Doc 9859
2. Level of safety – degree of safety of a system, representing
the quality of the system, safety-wise, expressed through
safety indicators
3. Safety indicators – parameters that characterize and/or
typify the level of safety of the system
4. Safety targets – concrete objectives to be achieved
5. Acceptable level of safety – minimum degree of safety that
must be assured by a system in actual practice
6. Value of a safety indicator – quantification of a safety
indicator
7. Value of a safety target – quantification of a safety target
Introductory concepts – Selection of safety indicators
 The selection of appropriate safety indicators is an essential
foundation for the development and implementation of ALoS
 The selection of safety indicators is a function of the detail to
which the level of safety of the system is to be represented
 Meaningful safety indicators must be representative of the
elements that characterise system safety
Accidents/accident rates
Incidents/incident rates
Level of regulatory compliance
…
Introductory concepts – The basic theory: examples
 Safety indicators
Fatal airline accidents/serious incidents
Runway excursion events/ground collision events
Development/absence of primary aviation legislation
Development/absence of operating regulations
Level of regulatory compliance
…
 Safety targets
Reduction in fatal airline accident/serious incidents
Reduction in runway excursion events/ground collision
events
Number of inspections completed quarterly
…
Introductory concepts – The basic theory: examples
Value of safety indicators
1. [Rate/number] Fatal airline
accidents per [number]
operations
2. [Rate/number] Runway
excursion events per
[number] operations
3. [Rate/number] Ground
collision events per [number]
operations
4. [Number] inspections to
operators completed
[timeframe] ...
1.
2.
3.
4.
Value of safety targets
[Reduction by/maximum] fatal
airline accidents per [number]
operations
[Reduction by/maximum]
runway excursion events per
[number] operations
[Reduction by /maximum]
ground collision events per
[number] operations
[Minimum number] of
inspections completed
[timeframe]…
Introductory concepts – A fundamental differentiation
 Safety measurement
Generally associated to the SSP
Quantification of outcomes of selected high-level or highconsequence events
Accident rates
Serious incident rates
Quantification of selected high-level State functions
Development/absence of primary aviation legislation
Development/absence of operating regulations
Level of regulatory compliance
 A measure of achievement of high-level safety objectives of
safety interventions and/or mitigations strategies
Introductory concepts – A fundamental differentiation
Safety performance measurement
Generally associated to an SMS
Quantification of the outcomes of selected low-level, lowconsequence processes
Number of FOD events per number of ramp operations
Number of ground vehicle events in taxiways per
number of airport operations
…
A measure of the actual performance of safety interventions
and/or mitigation strategies, beyond accident rates and
regulatory compliance
Introductory concepts – A fundamental differentiation
Safety measurement
Not a continuous process
A spot check
Conducted following pre-specified timeframes
Safety performance measurement
Continuous process
Monitoring and measurement of selected operational
activities necessary for the provision of services
Basic safety management SARPs
The acceptable level of safety (ALoS) to be achieved shall be
established by the State
When establishing ALoS, consideration must be given to
The level of safety risk that applies
The safety risk tolerance
The cost/benefits of improvements to the aviation system
The public expectations in civil aviation system
Expressing the ALoS
Values of safety indicators and values of safety targets
Initial ALoS – Quantitative action statements on selected
high level/high consequence outcomes (safety
measurement)
Mature ALoS – Quantitative action statements on
selected high level/high consequence events (safety
measurement) and low level/low consequence
outcomes (safety performance measurement)
Examples of values of safety indicators and safety targets
based on safety measurement
Values of safety indicators
1. [Number] CFIT and approach & landing
accidents per [number] departures
1.
2. [Number] runway excursions per [number] 2.
operations
3. [Number] ground collision accidents per
year on a [x-year] rolling average
3.
4. [Number] of high-severity events captured
4.
through the State MOR yearly
5. [Number] inspections to operators
completed quarterly
5.
6. [Number] AIS facilities with QMS
implemented
6.
7. Electronic filing of differences completed
within [number] months/weeks
7.
Values of safety targets
[Reduce by/maximum] CFIT and approach
& landing accidents per [number]
departures
[Reduce by/maximum] runway excursions
per [number] operations
[Reduce by/maximum] ground collision
accidents per year on a [x-year] rolling
average
[Minimum number] of high-severity events
captured through the State MOR yearly
[Minimum number] inspections to operators
completed quarterly
[Number] AIS facilities with QMS
implemented by [time]
Electronic filing of differences completed
within [revised number] months/weeks
Delivering ALoS – Safety action plans
Tools and means to deliver the safety targets of an SSP
Operational procedures
Technology
Systems
Training programmes
ALoS – Mature SSP
In the longer-term, once States develop safety data collection
and analysis capabilities under the Safety Assurance
component of the SSP, ALoS should reflect a combination of
safety measurement
safety performance measurement
Examples of values of safety indicators and targets based on
safety performance measurement
Values of safety indicators
1. [Number] level busts per [number]
operations
Values of safety targets
1. [Reduce by/maximum] number of level
busts per [number] operations by [date]
2. [Number] Cat B and C runway incursions 2. [Reduce by/maximum] Cat B and C
runway incursions in 5 international
in 5 international [State] airports per
[State] airports by [date]
[number] operations
3. [Reduce by/maximum] number of
3. [Number] TCAS/airprox events per
TCAS/airprox events per [number]
[number] operations
operations by [date]
4. [Number] non-conforming approaches
4. [Reduce by/maximum] number of non(NCA) at 5 international [State] airports
conforming approaches (NCA) at 5
per [number] operations
international [State] airports by [date]
5. [Number] apron FOD events at 5
international [State] airports per
[number] operations
5. [Reduce by/maximum] the number of
apron FOD events at 5 international
[State] airports by [date]
ALoS – Legal considerations
Establishing ALoS related to an SSP
does not replace legal, regulatory, or other already
established requirements, but it must support compliance
with them
leaves unaffected the obligations of States, and does not
relieve States from compliance with SARPs
ALoS – Initial (Safety measurement)
Values of
safety
targets
Action
plans
1. [Reduce by/maximum] CFIT and approach and landing accidents per
[number] departures
2. [Minimum number] inspections to operators completed quarterly
3. ...
1. CFIT training package distributed to industry and supported by training
courses
2. Revision and if necessary update of hiring policy. Inspection manual
updated
3. ...
Values of
safety
indicators
1. [Number] CFIT and approach and landing accidents per [number]
departures
2. [Number] inspection to operators completed quarterly
3. ...
State
Will comply all applicable international standards.
ALoS – Mature (Safety performance measurement)
Values of
safety
targets
Action
plans
1. [Reduce by/maximum] non-conforming approaches (NCA) at 5 international
airports per [number] arrivals by [date]
2. [Reduce by/maximum] Cat B and C runway incursions in 5 international [State]
airports per [number] by [date]
3. …
1. Constant Descend Arrivals (CDA) procedures implemented – Arrival procedures
charts designed for stabilized approaches
2. Installation of ASDE/X in 5 international [State] airports
3. ….
Values of
safety
indicators
1. [Number] non-conforming approaches (NCA) at 5 international airports [State] per
[number] operations
2. [Number] of Cat B and C runway incursions in 5 international airports [State] per
[number] operations
3. …
State
Will comply all applicable international standards.
Transition from initial to mature ALoS
Timeline
State safety assurance
Initial ALoS
(Safety measurement)
 Quantification of
outcomes of selected
high-level/highconsequence events
 Quantification of
selected high-level
State functions
 Safety oversight
 Safety data collection,
analysis and exchange
 Safety data driven
targeting of oversight
on areas of greater
concern or need
Mature ALoS
(Safety measurement and
safety performance
measurement)
 Quantification of
outcomes of selected
high-level/highconsequence events
 Quantification of selected
high-level State functions
 Quantification of
outcomes of selected
low-level/lowconsequence events
Summary
Set of activities
State accepts and oversees individual service providers’ SMS
(ALoS)
Aerodrome
operator
Aircraft
operator N° 1
AMO
Training
organization
SMS
SMS
SMS
SMS
SMS
Safety performance
Safety performance
Safety performance
Safety performance
Safety performance
State agrees and supervises individual service provider’s SMS safety performance
Set of activities
SSP
ATS Service
provider
Safety performance
Safety performance
Safety performance
Safety performance
Safety performance
SMS
SMS
SMS
SMS
SMS
Aircraft
operator N° 2
Aerodrome
operator
Training
organization
ATS Service
provider
AMO
State accepts and oversees individual service providers’ SMS
State acceptable level of safety (ALoS)
Questions?
Module N° 5 – State ALoS