"Safety Case"? - 34th International System Safety Conference

SAFETY CASES WITH THE HELP OF GSN
Tutorial at the
International System Safety Conference 2016
Orlando, Florida, USA
August 2016
Andreas Gerstinger
 Your competences after the workshop
 Understanding of the concept of safety cases
 Understanding of the benefits and potential pitfalls of safety cases
 Knowledge of the Goal Structuring Notation (GSN)
 Ability to read GSN
 Ability to create simple arguments in GSN
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 2
Presentation Date: August 2016
Author: Andreas Gerstinger
 Agenda
 What are Safety Cases?
 The Goal Structuring Notation (GSN)
 Common Errors in GSN arguments
 Case Study
 Concluding Remarks
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 3
Presentation Date: August 2016
Author: Andreas Gerstinger
 Acknowledgements
 The original work on GSN is Tim Kelly's doctoral thesis [Kel98]
 The GSN slides in this presentation are heavily based on [Spr12],
which we highly recommend as a very readable introduction to safety
arguments and GSN
 A useful web resource is http://www.goalstructuringnotation.info
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 4
Presentation Date: August 2016
Author: Andreas Gerstinger
 Literature
[Ade98] Adelard Safety Case Development Manual. 1998.
[EUR06] Eurocontrol. Safety Case Development Manual. DAP/SSH/091. 13 Oct 2006.
[Gre&06] William S. Greenwell, John C. Knight, C. Michael Holloway, Jacob J. Pease. A Taxonomy of Fallacies in System
Safety Arguments. Proceedings of the 24th International System Safety Conference, 2006.
[Kel98] T. P. Kelly, Arguing Safety – A Systematic Approach to Safety Case Management, DPhil Thesis YCST99-05,
Department of Computer Science, University of York, UK, 1998.
[Kel&04] Tim Kelly, Rob Weaver. The Goal Structuring Notation - A Safety Argument Notation. Conference on
Dependable Systems and Networks (DSN). Florence, Italy, 2004.
[Ori11] Origin Consulting. GSN Community Standard Version 1. November 2011. http://www.goalstructuringnotation.info/
[Spr12] John Spriggs. GSN - The Goal Structuring Notation: A Structured Approach to Presenting Arguments. Springer,
2012.
3 publicly available Safety Cases:
[EUR01] Eurocontrol. The EUR RVSM Pre-Implementation Safety Case. RVSM 691. 14 Aug 2001.
[Kin01] Steve Kinnersly. Whole Airspace ATM System – Preliminary Study. A report produced for EUROCONTROL
by AEA Technology. Report number AEAT LD76008/2. 2001.
[NAG02] NAGRA. Project Opalinus Clay Safety Report. TECHNICAL REPORT 02-05. December 2002.
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 5
Presentation Date: August 2016
Author: Andreas Gerstinger

INTRODUCTION TO SAFETY CASES
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 6
Presentation Date: August 2016
Author: Andreas Gerstinger
 What is a "Safety Case"?
?
 The "Robens Report" (1972)
– Balance between “prescriptive” and “goal setting” legislation needed to shift towards
the latter
 Piper Alpha Accident (1988)
– Conclusion that compliance with detailed prescriptive regulations was not sufficient to
ensure safety
 It is necessary to "make a case" for safety!
 "Make a case": to show that what you say is true
 Safety Case: shows that sufficient safety is given
 Term "safety case" has a legal origin
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 7
Presentation Date: August 2016
Author: Andreas Gerstinger
 Prescriptive vs. Goal-based Standards
Goal-Based
Prescriptive
 Describes what to do (way)
 Describes what to achieve (goal)
 Process-focus
 Product-focus
 Requires the application of
specific techniques and methods
 Less freedom, less responsibility
 Based on the assumption: "good
process leads to good product"
 (Generally) does not require a
safety case
 Requires certain product
characteristics
 More freedom, more responsibility
 Based on the general approach:
-
Determine hazards and safety
requirements
-
Design and implement them
-
Demonstrate achievement
 (Generally) requires a safety case
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 8
Presentation Date: August 2016
Author: Andreas Gerstinger
 IEC 61508 (2010)
 No safety case required
 Requires processes, documents, verification, validation and functional
safety assessment
 Requires detailed techniques and measures based on required safety
integrity
 Very prescriptive
© FREQUENTIS 2016
Safety Cases with the Help of GSN_2016_00.pptx
Page: 9
Presentation Date: August 2016
Author: Andreas Gerstinger
 DO-178C (2012)
 No safety case required
 A "software accomplishment summary" is required, which shows
compliance to the planned lifecycle
 Detailed documentation and processes required
 Very prescriptive
© FREQUENTIS 2016
Page: 10
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Def Stan 00-56, Issue 4 (2007)
 Safety Case required: "A structured argument, supported by a body of
evidence that provides a compelling, comprehensible and valid case that
a system is safe for a given application in a given operating environment."
 Safety Management Requirements for Defence Systems
 Strongly goal-based
 No specific processes or documentation structure suggested
 Safety Case is a major requirement
© FREQUENTIS 2016
Page: 11
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 CENELEC EN 50129 (2003)
 Safety Case required: "the documented demonstration that the product
complies with the specified safety requirements"
 Although detailed processes, documents, techniques and measures
are required, a safety case is also required
 But: A very prescriptive description of how a safety case shall be
structured, containing even the parts, sections and subsections of the
complete safety case
 Practically no freedom how to argue safety
© FREQUENTIS 2016
Page: 12
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 ISO 26262 (2011)
 Safety Case: "argument that the safety goals for an item are complete
and satisfied by evidence compiled from work products of the safety
activities during development"
 Required for ASILs B, C, D
 No detailed requirements on structure of safety case, but "the safety
case shall be sufficiently complete to evaluate the achievement of
functional safety of the item."
 Processes, documents, techniques and measures are nevertheless
required in detail
 Safety Case is a prerequisite for assessment
© FREQUENTIS 2016
Page: 13
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Comparison
Standard
Safety
Case
Comment
IEC 61508
No
-
DO-178C
No
-
Def Stan 00-56
Yes
• Very high level, very goal based
• Safety Case shall demonstrate safety
CENELEC 50129
Yes
• Prescriptive processes and prescritpive
safety case generation
• Safety case shall show that specified
requirements are met
ISO 26262
Yes
• Quite prescriptive processes, lots of freedom
for safety case generation
• Safety case shall show that safety goals are
complete and met
© FREQUENTIS 2016
Page: 14
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Content of a Safety Case
 Generally, a Safety Case is a document containing a top level claim
saying:
"The system is safe BECAUSE…"
… compelling and convincing arguments and evidence follow
Safety
Case
Report
HAZOP
FTA
……...
Test
Cases
 What "safe" means in the context has to be defined
 Often other documents and analyses are referenced
© FREQUENTIS 2016
Page: 15
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 General Form of a Safety Case
The claims, goals, etc. that we
want to prove
The valid arguments
The pieces of evidence
(documents, test results,…)
supporting the arguments
[Kel&04]
 Form:
– Can be simply textual
– But: Difficult to structure, difficult to read
© FREQUENTIS 2016
Page: 16
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Is a Safety Case a Proof?
 In an ideal world: Yes.
 In the real world: No.
 But it depends on your understanding of the word "proof"…
 A safety case is rarely as strong as a mathematical proof
 But it should be as strong as a proof in law
Law
Safety
Defendant is innocent until proven
guilty
System is dangerous until proven
safe
In case of the slightest doubts, the
defendant is not guilty
In case of the slightest doubts, the
system is not safe
– And of course, as all proofs: it can contain flaws…
© FREQUENTIS 2016
Page: 17
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Arguments vs. Rhetorics
 A Safety Case must be "convincing" (not merely "persuasive")
 It must contain good (valid, compelling, comprehensible) arguments!!!
 Good rhetorics is not necessary (but can help)
If you don't understand a safety case,
there is a high chance that it is crap!
© FREQUENTIS 2016
Page: 18
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Guidelines for a persuasive (not convincing)

Safety Case Report (1) ;-)
 Write a lot of text, e.g. copy the complete system description and safety plan into
the safety case document
 Don't be too clear – this allows you to always interpret the statements in your
preferred way
 Use many different terms for the same concept
 Use the same term for different concepts (the context helps to understand the
right meaning anyway)
 Use lots of technical jargon that has no relevance to the overall safety, but that
sounds professional
 Make the assessor look incompetent when questions are asked
 Include some easy to find typos and other irrelevant errors so that reviewers can
comment without understanding the contents
 Use a lot of marketing phrases from your products
 Write that your company is successful with the product
 Play bullshit bingo with your safety case
 Mention how hard everybody has worked
© FREQUENTIS 2016
Page: 19
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Guidelines for a persuasive (not convincing)

Safety Case Report (2) ;-)
 Use lots of references, so that readers are intimidated to check them
 References ad infinitum: always put lots of further references in your
referenced documents, so that readers have to hop many times before
finding the information they are looking for
 Circular references: You can design it that way that after some hops you
land at the originating document again
 Preferably reference books and papers that are out of print/not
available any more
 Always make conclusions from one to all
 Always extrapolate from some event in the past into the future
 Repeat invalid conclusions many times, then they will eventually be
believed
 Remember: "Tell a man that there is wet paint on a bench and he will
have to touch it to make sure. Tell a man there are 100 billion stars in the
universe and he will believe you."
© FREQUENTIS 2016
Page: 20
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Disclaimer and Warning
 Use the above guidelines at your own risk! We strongly advise not to
use a single one!
 If you work with people with only the slightest bit of experience with
safety cases, these guidelines will not work at all!
© FREQUENTIS 2016
Page: 21
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 The Safety Case is not a document!
 The Safety Case is "a structured argument, supported by a body of
evidence that provides a compelling, comprehensible and valid case
that a system is safe for a given application in a given operating
environment." [DS00-56]
 The Safety Case Report is the corresponding document, i.e. "a key
deliverable that summarises the Safety Case at a particular instant in
time" [DS00-56]
 A document-centric approach is not desirable
– "We need the safety case" is often misunderstood to mean "This annoying document
has to be written up by someone now"
© FREQUENTIS 2016
Page: 22
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Safety Argument
 "An argument is a connected series of statements intended to
establish a proposition" [Spr12, p.2]
 "You use an argument to persuade others of the validity of some
claim" [Spr12, p.2]
– My opinion: "persuade" should be replaced by "convince"
 Properties of a good safety argument presentation
– It has to be understandable
– It has to be easy to read
– Its logic correctness has to be verifiable
– Logical faults shall be easy to spot
– The notation shall be well defined and uniquely interpretable
– It has to be clearly visible if there are unfinished parts
– It shall be reusable
© FREQUENTIS 2016
Page: 23
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Textual Arguments
…can be good…
…but are more
often horrible!
© FREQUENTIS 2016
Page: 24
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Tabular Structure
 (+) Clear differentiation between elements of an argumentation:
– Claims
– Arguments
– Evidences
 (-) Not practicable for
large safety cases
 (-) Hierarchical Levels
not straightforward to
represent
[Kel98]
© FREQUENTIS 2016
Page: 25
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSNGOAL STRUCTURING NOTATION
© FREQUENTIS 2016
Page: 26
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN – Goal Structuring Notation
 Developed by Tim Kelly et al., University of York
 "Forces" author to develop clear arguments
 Graphical Notation
 Safety cases in GSN easier to read than text
 Reduces fault probability in safety cases
 Tool support available
 Currently being standardized
 Clearly shows
– Goals (aka "Claims")
– Arguments (aka "Strategies")
– Evidence (aka "Solutions")
© FREQUENTIS 2016
Page: 27
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN Symbols Overview (Subset)
© FREQUENTIS 2016
Page: 28
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "GOAL"
© FREQUENTIS 2016
Page: 29
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN GOAL
 A Goal is a proposition to be established.
– Is a statement that can be “TRUE” or “FALSE”
 Represents a claim, the truth of which is to be demonstrated by
argument
 The Goal text should be of the form subject-verb(-object)
© FREQUENTIS 2016
Page: 30
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Top Goal – your top level claim
 For a safety case, it is typically something like "The System is
acceptably safety for a given application in a given environment"
 The top goal is typically divided into several sub-goals, sub-sub-goals,
etc. which are easier to prove
 GSN development typically is a top-down approach – you start with
the top level proposition you want to show to be true
© FREQUENTIS 2016
Page: 31
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Excercise: Which of the following claims could

be used as a Top Goal?
1. Our Quality Management System is ISO9001:2008 compliant (ISO
2008)
2. My Business Plan is complete and ready for review by the Board
3. This burial site is probably that of Rædwald, King of the East Angles
4. This painting should be attributed to Albrecht Dürer
5. This equipment fulfils the essential requirements of the RTTE Directive
6. Beryllia is a carcinogen
7. Hazard Identification and Risk Assessment
8. Assurance is provided that safety requirements raised on the software
are valid
9. The GSN Symbol for a Goal is a rectangle
10. The colour of the sky
© FREQUENTIS 2016
Page: 32
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "CONTEXT"
© FREQUENTIS 2016
Page: 33
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN CONTEXT
 The truth of a claim depends on the context!
 What does a typical top level claim "The system is acceptably safe"
actually mean?
– What does safe mean here?
– How much/little safety is acceptable?
– In which environment?
– For which use or application?
© FREQUENTIS 2016
Page: 34
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 It all depends on context…
© FREQUENTIS 2016
Page: 35
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN CONTEXT
 Context provides, or references out to, definitions and other supporting
material
 Always on the end of an open-headed arrow
– Important: DO NOT hang other contextual information from them
 Environmental Context
 External References
© FREQUENTIS 2016
Page: 36
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN CONTEXT
 Another example
 Too much context probably means your goal uses too many vague
terms
 Makes GSN less readable
© FREQUENTIS 2016
Page: 37
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Context Excercise
My factory manager wants to persuade me that one of her preventative
maintenance procedures, known as PMP5, is adequate to keep the
factory power supply running. She claims, ‘‘PMP5 is fit for purpose’’. We
want to document the argument so that in future, if someone wants to
change the procedure, they will be able to ensure that they do not ‘‘break’’
it. Using GSN, how could the claim, ‘‘PMP5 is fit for purpose’’, and its
Contexts be presented?
© FREQUENTIS 2016
Page: 38
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "GOALS AND SUBGOALS"
© FREQUENTIS 2016
Page: 39
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN Goals and Sub-Goals
 Goals are typically decomposed into sub-goals
 Truth of Sub-Goals is sufficient to establish truth of Goal
 GSN is meant to be read in the deductive form
– "D is true because A, B and C are true"
 Not in the inductive form
– "Because A, B and C are true, we can conclude that D is true"
© FREQUENTIS 2016
Page: 40
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN Goals and Sub-Goals
 Similar to a mathematical proof, which is usually in the form: Theorem
– Proof
 Sub-Claims which are accepted by the reader without detailed proof
can be skipped by the reader
© FREQUENTIS 2016
Page: 41
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN does not preclude fallacies
 The reader must judge if the argument is logically flawed!
 Of course again, all depends on context (which is missing here)! Who
is meant by "Socrates" here?
© FREQUENTIS 2016
Page: 42
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 A more realistic example
 Important to add enough information into goals to make argument
understandable
© FREQUENTIS 2016
Page: 43
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Excercise
Adelle is the daughter of Bertrand and Celine. Celine’s parents are Didier
and Estelle. Construct a simple argument in GSN claiming that Adelle is
Estelle’s granddaughter.
© FREQUENTIS 2016
Page: 44
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Excercise
Adelle is the daughter of Bertrand and Celine. Celine’s parents are Didier
and Estelle. Estelle’s brother Frederic is married to Gabrielle; they have a
son, Henri. Construct an argument in GSN that Gabrielle is the great aunt
of Adelle by decomposing this Top Goal into two appropriate Sub-Goals,
and then decompose your Sub-Goals one level, as necessary.
© FREQUENTIS 2016
Page: 45
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "ARGUMENT STRATEGY"
© FREQUENTIS 2016
Page: 46
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN STRATEGY
 Part of the argumentation
– Contain a brief description of the argument approach
 Always links to Goals with a solid-headed arrow
– Only one incoming arrow from above
– Many outgoing arrows below
 Contextual information referenced with open-headed arrow
 Note that the symbol is optional, sub-goals can be linked directly to
goals
– Describes the rationale why goals are divided into the specific chosen sub-goals
– Massively improves readability and comprehensibility
© FREQUENTIS 2016
Page: 47
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
G0
 GSN STRATEGY
The system is
adequately safe to
operate
G0
S0.1
All functional requirements have
been successfully verified by
test or by demonstration
S0.1
Argue that the system is safe
to operate in normal
operation
S0.2
Argue in turn for each
automatic function
S0.2
Argue that the system
remains safe under failure
conditions
S0.3
Argue in turn for each
user-triggered function
Argue in turn for each
operator-initiated
function
G0
Option C is the
best of the
candidates
C0a
S0
The set of candidates
is [A, B, C, D, E]
Argument over the set
of candidates
G1
G2
Option C 2016
is better
Option Page:
C is better
© FREQUENTIS
48
thanwith
Option
A of GSN_2016_00.pptx
than Option B
Safety Cases
the Help
G3
G4
Option
C isDate:
better
Presentation
August 2016 Option C is better
than
Option
D Gerstinger
than Option E
Author:
Andreas
 Note: Numbering GSN elements
 It is convenient to give unique IDs to all elements in a GSN
 Makes references and reusing elements possible
 GSN does not specify how elements shall be numbered
 There are several methods, e.g.
– Unique Names
– Numerical sequential IDs
– Hierarchical numbering (preferred way, used here)
© FREQUENTIS 2016
Page: 49
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Security Example with Strategy
© FREQUENTIS 2016
Page: 50
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Excercise
 Is there anything missing from the top level of this Goal Structure?
 How would you express this example using Sub-Goals, rather than
multiple Strategies?
© FREQUENTIS 2016
Page: 51
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "JUSTIFICATION"
© FREQUENTIS 2016
Page: 52
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN JUSTIFICATION
 Provides extra explanation or rationale
– A reason for what you have done
 Is a contextual information
– Always associated with the element being justified
 We use it to say…
– Why the sub-goals have been chosen when others may have been more obvious
– Alternatively, a Justification may contain a simple “If A then B” argument
© FREQUENTIS 2016
Page: 53
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN JUSTIFICATION
 Refer out to an existing argument
C3a
G3
BP-02, "Procedure
for preparing
business plans"
Correctly following
Procedure BP-02
produces a complete
Business Plan
© FREQUENTIS 2016
Page: 54
Safety Cases with the Help of GSN_2016_00.pptx
J3a
Presentation Date: August 2016
Author: Andreas Gerstinger
This is argued in an
Annex to procedure
BP-02
J
G0
 GSN JUSTIFICATION
The system is
adequately safe to
operate
 Split-up
S0.1
Argue that the system is safe
to operate in normal
operation
S0.2
Argue that the system
remains safe under failure
conditions
G0
The system is
adequately safe to
operate
S0.1
Argue that the system is safe
to operate in normal
operation
{ Volume 1 }
G0
J0
That the system remains
safe under failure
conditions is argued in
Volume 2
The system is
adequately safe to
operate
{ Volume 2 }
J
J0
S0.1
That the system is safe
under in normal operation
is argued in Volume 1
J
© FREQUENTIS 2016
Page: 55
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Argue that the system
remains safe under failure
conditions
 GSN JUSTIFICATION
 If A than B
G0
Option C is the
best of the
candidates
S0
J0
If option C is better
than each candidate,
then it is best overall
Argument over the set
of candidates
G1
G2
G3
G4
Option C is better
than Option A
Option C is better
than Option B
Option C is better
than Option D
Option C is better
than Option E
© FREQUENTIS 2016
Page: 56
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
J

GSN "ASSUMPTION"
© FREQUENTIS 2016
Page: 57
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN ASSUMPTION
 An assumption is something taken to be true for the purpose of the
argument
 Simplify a situation
– Argument may be invalid in general, but perfectly adequate in the conditions you
assume.
– Argument is valid for specified conditions.
 It is very important to state your assumptions explicitly
 The symbol itself say “I assume that …”, so there is no need to repeat
it in the text.
 An assumption helps you to say that a statement in a Goal is TRUE
© FREQUENTIS 2016
Page: 58
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN ASSUMPTION
 Fragment of an argument about traffic lights at a road junction with
pedestrian crossings
 Exercise: Are the three assumptions appropriate?
C6.3
"All signal lights"
includes those for
pedestrians
G6.3
On detection of any of the
specified failure conditions,
all signal lights are
extinguished
A6.3a
It is assumed that
vehicle traffic is in the
junction
A
S6.3
A6.3b
The failure conditions
are specified in the
concept of operations
A
A6.3c
Argue over each failure
condition & any combination
thereof
The system fulfils its
electromagnetic interference
susceptibility requirements
A
© FREQUENTIS 2016
Page: 59
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN ASSUMPTION
 Revised fragment of an argument about traffic lights at a road junction
with pedestrian crossings
C6.3b
The failure conditions
are specified in the
concept of operations
C6.3a
G6.3
"All signal lights"
includes those for
pedestrians
On detection of any of the
specified failure conditions,
all signal lights are
extinguished
The system fulfils its
electromagnetic interference
susceptibility requirements
A
S6.3
Argue over each failure
condition & any combination
thereof
© FREQUENTIS 2016
Page: 60
Safety Cases with the Help of GSN_2016_00.pptx
A6.3
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN "SOLUTION"
© FREQUENTIS 2016
Page: 61
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Where is the final proof?
 Well, the argument is correct
 But who says that the premises are true?
– Are all men mortal?
– Is Socrates a man?
 Solutions provide the evidence that the lowest sub-goals are actually
true
 Without this evidence, the argument is not complete!
© FREQUENTIS 2016
Page: 62
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Solutions (aka Evidence)
G1
All men are mortal
J1
The Methusaleh Report
concludes, from
epidemiological studies,
that all men are mortal.
Sn1
The Methusaleh
Report
J
J1
Xanthippe is "Mrs.
Socrates" – she
should know...
G1
Socrates is a man
J
Sn1
Witness
statement from
Xanthippe
© FREQUENTIS 2016
Page: 63
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN SOLUTION
 A single Goal can have one or more evidences
– Do not bundle them
– Use separate Evidence symbol for each
 If an evidence supports more than one Goal
– Label each evidence item uniquely
– Use the same Evidence and not update the index
 Solutions or Evidences make no claim
– Simply references to evidence artefact that provide support for a particular claim
© FREQUENTIS 2016
Page: 64
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN SOLUTION
© FREQUENTIS 2016
Page: 65
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Where does Evidence come from?
 Direct Evidence
– tells something about the product
– e.g. product features, test results, static analysis results, formal proofs,...
 Backing (indirect) Evidence
– tells something about the process
– e.g. well established process according to ISO9000, reviews were conducted
properly,...
 Due to the difficulty of providing sufficient direct evidence for software,
backing evidence plays a crucial role
© FREQUENTIS 2016
Page: 66
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN RELATIONSHIP INDICATION
 GSN elements are intended to be combined to represent logical
structure. GSN provides two types of linkage between elements
1. SupportedBy
– Inferential relationships declare that there is an inference between goals in the
argument
– Evidential relationships declare the link between a goal and the evidence used to
substantiate it
– Goal-to-goal, goal-to-strategy, goal-to-solution, strategy to goal
2. InContextOf
– Declares a contextual relationship
– Goal-to-context, goal-to-assumption, goal-to-justification, strategy-to-context,
strategy-to-assumption and strategy-to-justification
© FREQUENTIS 2016
Page: 67
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

COMMON ERRORS
© FREQUENTIS 2016
Page: 68
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Confirmation Bias
 You look for what you want to find
 Searching for counter-evidence is crucial
 Somebody needs to challenge the safety case
© FREQUENTIS 2016
Page: 69
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Avoidance of Common Errors in GSN
 The statements made in GSN goal, context and solution elements
should be stated atomically
– A single node should contain exactly one claim or reference
– Goals should only contain claims
– Solutions should only refer to evidence
– Strategies should only summarise the argument approach
 The statements made in GSN goal elements capture the claims made
in the argument
– The statements should be expressed in the form <noun-phrase><verb-phrase>
 Similarly, assumptions should be stated atomically in GSN
© FREQUENTIS 2016
Page: 70
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Avoidance of Common Errors in GSN
 GSN strategy elements record the approach used in structuring the
argument
– It should be possible to remove all of the strategy elements without affecting the
logical flow of the claims being made
– Like "comments" in programming languages, they enhance readability
 Strategy elements are intended as a description of the argument
approach which has been carried out to relate claims stated at
different levels of detail
– For example, the strategy “Interlocks used” should be phrased “Argument by appeal
to the use of interlocks”, to focus the reader’s attention on the argument process,
rather than on the design of the system.
© FREQUENTIS 2016
Page: 71
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Avoidance of Common Errors in GSN
 Context elements should not be used to refer to information which is
intended to support the validity of a claim.
 Context elements are sometimes used where a GSN assumption or
justification may be more appropriate.
 Context and Solution elements in GSN should provide references to
artefacts stored elsewhere
– A single noun-phrase should be sufficient to identify these artefacts
– It is not necessary to summarize the content of the artefact in the GSN node
© FREQUENTIS 2016
Page: 72
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Fallacies in Safety Cases [Gre&06]
 A critical review of three publicly available safety cases showed that
fallacies are quite common
© FREQUENTIS 2016
Page: 73
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Safety Argument Fallacy Taxonomy [Gre&06]
 Circular Reasoning
– Circular Argument, Circular Definition
 Diversionary Arguments
– Irrelevant Premise, Verbose Argument
 Fallacious Appeals
– Appeal to Common Practice, Appeal to Improper/Anonymous Authority, Appeal to Money, Appeal to
Novelty, Association Fallacy, Genetic Fallacy
 Mathematical Fallacies
– Faith in Probability, Gambler’s Fallacy, Insufficient Sample Size, Pseudo-Precision, Unrepresentative
Sample
 Unsupported Assertions
– Arguing from Ignorance, Unjustified Comparison, Unjustified Distinction
 Anecdotal Arguments
– Correlation Implies Causation, Damning the Alternatives, Destroying the Exception, Destroying the
Rule, False Dichotomy
 Omission of Key Evidence
– Omission of Key Evidence, Fallacious Composition, Fallacious Division, Ignoring Counter-Evidence,
Oversimplification
 Linguistic Fallacies
– Ambiguity, Equivocation, Suppressed Quantification, Vacuous Explanation, Vagueness
© FREQUENTIS 2016
Page: 74
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Any fallacies here?
C0.1
"Sufficiently secure"
means that it is
guaranteed that no
unauthorised access
will ever take place
G0
InContextOf
SupportedBy
The computer system
is sufficiently secure
SupportedBy
InContextOf
C0.2
CIA computer system
storing all strategic
plans for future CIA
activities
SupportedBy
G1
G2
G3
The developer had
security know-how
No security leaks
were found during
analysis
A paid hacker could
not break into the
system
SupportedBy
SupportedBy
SupportedBy
Sn1.1
Training
Certificate
© FREQUENTIS 2016
Page: 75
Safety Cases with the Help of GSN_2016_00.pptx
Sn2.1
Analysis
Report
Presentation Date: August 2016
Author: Andreas Gerstinger
Sn3.1
Hacker Report
 Any fallacies?
C0.1
G0
A0.1
COMPANY shares are in
the Dow Jones
InContextOf
A
SupportedBy
Prices of COMPANY
shares will rise within
the next year
InContextOf
SupportedBy
"Rise" means that the
price at the end of the
last trading day is
higher than at the
beginning of the first
trading day in a year
SupportedBy
G1
G2
G3
Experts say COMPANY
has a bright future
The Dow Jones Index
will rise within the
next year
Interest rates are low
SupportedBy
SupportedBy
SupportedBy
Sn1.1
Newspaper
G2.1
The Dow Jones Index
has always risen
within a year in the
last 10 years
SupportedBy
Sn2.1.1
Historical
Records
© FREQUENTIS 2016
Page: 76
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Sn3.1
Bank
Commercials
 Any fallacies?
G0
MEDICATION X helps
to alleviate a common
cold
SupportedBy
SupportedBy
G1
G2
Dr. X confirms that
MEDICATION X works
There are several
success stories
available
SupportedBy
SupportedBy
Sn1
Dr. X's
testimonial
Sn2
Detailed doc of
three success
stories
SupportedBy
SupportedBy
G3
Last time when I had
a cold, I took
MEDICATION X and
my cold was gone
within three days
SupportedBy
Sn3
My own
testimonial
© FREQUENTIS 2016
Page: 77
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
G4
MEDICATION X does
not have any
unwanted side effects
SupportedBy
Sn4
Rigorous randomized
double blind evidencebased study about
absence of side effects
of MEDICATION X
Excerpt of EUR RVSM Safety Case – can you find

fallacies?
© FREQUENTIS 2016
Page: 78
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

UK DEF-STAN 00-56
© FREQUENTIS 2016
Page: 79
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger


13.2.1 The Contractor shall ensure that the Safety Case consists of a structured argument, supported
by a body of evidence that provides a compelling, comprehensible and valid case that a system is
safe for a given application in a given environment.

13.2.5 The Contractor shall provide evidence to demonstrate the competence of individuals and
organisations responsible for tasks that have a bearing on safety.

13.2.6 The Contractor shall develop, maintain and refine the Safety Case as defined in the SMP and
in developing the Safety Case the Contractor shall address the full lifecycle (CADMID/T) of the PSS.

13.2.7 Where practicable, the Contractor should provide objective evidence.

13.2.8 The Contractor should provide diverse evidence, to ensure that that the overall safety
argument is not compromised by errors or uncertainties in individual pieces of evidence.

13.2.9 The Contractor should demonstrate that the arguments and evidence in Safety Cases are
sound, comprehensive and trustworthy.

13.2.10 The Contractor should provide evidence to demonstrate the adequacy and suitability of the
methods and techniques used for safety and risk analysis and in safety engineering.

13.2.11 The Contractor should develop, maintain and refine the Safety Case through the life of the
Contract.

13.2.12 The Contractor should provide evidence of competency of those whose work could impact
safety and confidence in the Safety Case.

13.2.13 The Contractor should ensure that any related Safety Cases or information sets already in
existence and identified in the scope of analysis are utilised and integrated as necessary.
© FREQUENTIS 2016
Page: 80
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

 The Contractor shall produce Safety Case Reports that incorporate the
key elements of the safety argument and references to evidence so
that, in principle, it would be possible to access the complete Safety
Case, starting from the Report, or counter-evidence where it has been
identified.
 Where there are shortfalls in the evidence the Contractor shall ensure
that the Safety Case Report provides the rationale for operating the
PSS, and the ways of mitigating the residual risk.
 The Contractor should ensure that any related Safety Case Reports or
ISSSs already in existence and identified in the scope of analysis are
utilised and integrated as necessary.
 The Contractor should deliver the Reports incrementally, as
Contracted, to give the MOD visibilit of progress in safety engineering
and safety analysis.
© FREQUENTIS 2016
Page: 81
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

© FREQUENTIS 2016
Page: 82
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

CASE STUDY
© FREQUENTIS 2016
Page: 83
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Case Study
 Read the handout
 Create a GSN for a claim like
"The system is acceptably safe…"
 Please form groups of <=5 people
 Time: 40min for elaboration, 20min for discussion
© FREQUENTIS 2016
Page: 84
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

SOME FINAL NOTES
© FREQUENTIS 2016
Page: 85
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Problems with Traditional Safety Case

Development: "Retrospective Safety Case"
Too late!
[Kel98], p. 67
 Large amounts of re-design necessary because safety case cannot be constructed
 Less robust safety case – safety engineers have to live with the current design instead
of influence the design
 Lost safety rationales – rationales for certain design features might not be recorded and
therefore lost
© FREQUENTIS 2016
Page: 86
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Better: Evolutionary Safety Case Development
Continuous Safety Case
Development
[Kel98], p. 69
 (Intermediate) Safety Cases are produced at each major milestone in
a project
 GSN supports the evolutionary development of safety cases
© FREQUENTIS 2016
Page: 87
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Three publicly available Safety Cases
 Unfortunately, most safety cases are not publicly available
 Should safety cases affecting the public be publicly available? (cf.
sessions and decisions in a criminal court)
1. [EUR01] The EUR RVSM Pre-Implementation Safety Case
Reduced vertical separation safety case
GSN and text
2. [Kin01] Eurocontrol Whole Airspace ATM System Safety Case
Common airspace for all Eurocontrol member states
GSN and text
3. [NAG02] Project Opalinus Clay: Safety Report
Long-term radioactive waste storage facility
Text, heavy use of bullet points
© FREQUENTIS 2016
Page: 88
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Potential problems with Safety Cases
 Confirmation bias: People who have a vital interest that the top level claim is true
provide the evidence
 People who build the system also build the safety case, they only see the positive
evidence
 Re-inventing the wheel many times instead of using successful processes which are
successful over many years
 "The problem is that it is always possible to find or produce evidence that something is
safe." [Lev11]
 "Care should be taken when utilizing techniques such as Goal Structured Notation […]
to avoid falling into the trap of assuming the conclusion […], or looking for supporting
evidence for the conclusion instead of carrying out a proper analysis of risk." [Lev11]
[Lev11] Nancy Leveson. The Use of Safety Cases in Certification and Regulation.
Journal of System Safety, Vol. 47, No. 6, 2011.
 Active searching for counter-evidence is important! (and not
finding counter-evidence is no guarantee that it does not exist)
© FREQUENTIS 2016
Page: 89
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Some conclusions with my personal view
 Good processes, techniques and measures are necessary but not
sufficient to assure safety
 A Safety Case must be easy to follow and understandable
 The Safety Case is the most important document for assuring safety
 There shall be freedom in the design of the safety case
 ISO 26262 combines necessary prescriptions with the goal-based
approach of a Safety Case in the best way
 GSN improves readability of Safety Cases massively
 GSN is an excellent way to document or to support the documentation
of Safety Cases
© FREQUENTIS 2016
Page: 90
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Thank You!

DEVELOPING GOAL STRUCTURES
© FREQUENTIS 2016
Page: 92
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Developing - SIX STEP METHOD – Top Down
Elaborate
strategy
Step 5
STOP
Identify goals
to be
supported
Step 1
Define basis
on which
goals stated
Step 2
© FREQUENTIS 2016
Page: 93
Safety Cases with the Help of GSN_2016_00.pptx
Identify
strategy to
support
goals
Step 3
Define basis
on which
strategy
stated
Step 4
Presentation Date: August 2016
Author: Andreas Gerstinger
Identify
Basic
Solutions
Step 6
 Step 1: Identify Goals
5
 Goals should be phrased as propositions
 Statements that can be said to be
1
3
2
4
6
TRUE / FALSE
 Statement should be expressed as a single statement (1 sentence) in
the form
– NOUN-PHRASE : identifies the subject
– VERB-PHRASE : defines a predicate over the subject
 The objective of this step is to identify the top goal, the principal claim
that the remainder of the argument should support
© FREQUENTIS 2016
Page: 94
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 1: Identify Goals
5
 It is important that the claim made in the
top goal is stated at an appropriate level of
detail
1
3
2
4
 Correctly:
– The SR-SW is adequately safe.
– The insulin pump is adequately safe for routine use.
 Incorrectly:
– Fault Tree for Hazard H1.  !! Describes an entity !!
– How many failure modes does comp. X have?  !! Question !!
– All hazards have been mitigated. -> !! No over all top-goal !!
 Test: “CAN WE SAY THAT THE GOAL
ISAugust
TRUE
OR FALSE”
Presentation Date:
2016
© FREQUENTIS 2016
Page: 95
Safety Cases with the Help of GSN_2016_00.pptx
Author: Andreas Gerstinger
6
 Step 1: Identify Goals
5
 Running Example:
© FREQUENTIS 2016
Page: 96
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
Step 2: Definition of the Basis on

which Goals are Stated
5
 A claim can be evaluated as ‘true’ or ‘valid’
only if the basis on which it is stated is clear
1
3
6
2
– Ensure that the reader has an adequate and correct understanding
of4the context
surrounding the claim
– Identifying information required about the …
– system under discussion
– context of the system
– argument
© FREQUENTIS 2016
Page: 97
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 2: Definition of the Basis on

which Goals are Stated
5
 Contexts are used to refer
– System information
– Artefacts
– Processes
© FREQUENTIS 2016
Page: 98
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
Step 2: Definition of the Basis on

which Goals are Stated
5
 contextual information associated with a claim made
3
6
1 in a particular
goal is understood to be in scope for all sub-goals of that goal
2
4
 the objective of using context is to ensure that there is a clear
understanding of goal-statements between reader and writer
 definitions can be provided throughout the course of the argument
communicated by the goal structure
© FREQUENTIS 2016
Page: 99
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 2: Definition of the Basis on

which Goals are Stated
5
 Running Example:
© FREQUENTIS 2016
Page: 100
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
 Step 3: Identification of Strategy
5
 Work out how to substantiate the stated goal
– “What reasons are there for saying the goal is true!”
1
– “What statements would convince the reader that the goal is true?”
3
6
2
4
 Aiming for statements that are easier to support than the larger goal
– Breaking into a number of smaller goals
– Relating goal more closely to specific application in question ( e. g. – for a generic
requirement)
© FREQUENTIS 2016
Page: 101
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 3: Identification of Strategy
5
 Divide and Conquer Goal Decomposition
1
3
– decompose a high-level goal into a number of ‘smaller’ goals
2
© FREQUENTIS 2016
Page: 102
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
4
6
 Step 3: Identification of Strategy
5
 Interpretation, or Detailing, of a Goal
1
3
6
– Another approach is to attempt to re-state the original claim as one more closely
related to the specific application in question or to the evidence that will ultimately be
2
4
used to support the argument.
© FREQUENTIS 2016
Page: 103
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 3: Identification of Strategy
5
1
3
2
4
6
 The role of a strategy node is to clearly explain the relationship
between a goal and a set of sub-goals
 Strategy statements should describe the argument approach adopted
– “Argument by … <approach>”
– “Argue that … <approach>”
– …
© FREQUENTIS 2016
Page: 104
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 3: Identification of Strategy
5
 Running Example:
© FREQUENTIS 2016
Page: 105
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
Step 4: Definition of the Basis on

which the Strategy is Stated
5
 Identifying the contextual information required to understand
the
argument approach described by the GSN strategy node
3
6
1
2 the same
4 as that for
 The process of identifying context for strategies is
goals
– strategies should be examined and assessed for terms or concepts that have been
introduced but not defined explicitly
© FREQUENTIS 2016
Page: 106
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 4: Definition of the Basis on

which the Strategy is Stated
5 strategy
 Ask what information is required in order to expand / fulfil
outlined
3
6
1
2
4if the reader
 Add context information, justifications and/or assumptions
need more information
© FREQUENTIS 2016
Page: 107
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 4: Definition of the Basis on

which the Strategy is Stated
5
 Running Example:
© FREQUENTIS 2016
Page: 108
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
 Step 5: Elaborate Strategy
 Elaborating a strategy involves defining new goals, i.e.5 beginning the
argument development process again at Step 1, although this time
3
6
1 goal structure.
obviously the goals are one level further down the
2
4
 It should be noted that a sub-goal stated as part of a strategy in
support of a particular parent goal may also form part of the supporting
argument of other parent goals.
© FREQUENTIS 2016
Page: 109
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 5: Elaborate Strategy
5 until it is clear
 The goal structure continues to be developed in this way
that no further decomposition into sub-goals is necessary and the goal
3
6
1
can be directly supported by appeal to some evidence
artefact
2
© FREQUENTIS 2016
Page: 110
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
4
 Step 5: Elaborate Strategy
5
 Running Example:
© FREQUENTIS 2016
Page: 111
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
 Step 6: Identify Solutions
5
 A Solution is added to support the goal
 Provides a reference to some evidence
artefacts
1
3
2
4
6
– Refer unambiguously and precisely to the section in an evidence artefact which is
required to support the claim
© FREQUENTIS 2016
Page: 112
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 6: Identify Solutions
5
– Reference the whole document should be avoided where possible
© FREQUENTIS 2016
Page: 113
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
 Step 6: Identify Solutions
5
 It is possible to cite multiple solutions as providing evidential
support
for a particular parent goal.
3
6
1
2 evidential
4
 It should be noted that a solution stated as providing
support
for a particular parent goal may also form part of the cited evidential
support for other parent goals.
© FREQUENTIS 2016
Page: 114
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 6: Identify Solutions
5
 Note that peer goals do not always require the same level
of
decomposition.
3
1
6
2 it to a4point at
 Sometimes goals requires further argument to bring
which it can be supported directly by evidence.
 It is regarded as best practice that the goal most immediately
supported by a solution element should be an unambiguous assertion
of the property of the evidence item that is being referred to by the
argument.
© FREQUENTIS 2016
Page: 115
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 6: Identify Solutions
5
 Running Example:
© FREQUENTIS 2016
Page: 116
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
1
3
2
4
6
 Developing - Bottom Up
Step 1
Step 3
Step 2
Infer evidence
assertions
Identify
evidence
Step 5
Step 6
Check back
down
structure for
completeness
Derive
higher goals
Add required
context
Step 7
Join up to
known top
goal or set of
sub-goals
© FREQUENTIS 2016
Page: 117
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 4
Describe
strategy
 Step 1: Identify Relevant Evidence
1
2
3
 The starting point is to ascertain what evidence exists
5
6
4
 Consider what this evidence reveals why the analysis was originally
carried out
© FREQUENTIS 2016
Page: 118
Safety Cases with the Help of GSN_2016_00.pptx
7
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 2: Infer ‘Evidence Assertion’ Goals
 Examine each evidence
1
3
2
5
– “What safety claim or property of the system is demonstrated or
6 supported by 4this
item of evidence?”
7
© FREQUENTIS 2016
Page: 119
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 2: Infer ‘Evidence Assertion’ Goals
3 goals
2
 A give item of evidence may in fact provide support1 for several
5
– Each ‘evidence assertion’ should refer to the individual section 6of the evidence
4
7
© FREQUENTIS 2016
Page: 120
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 3: Adding Higher Sub-Goals
3 and
 Work higher in the argument to add a further hierarchy
1 of2 goals
strategies
5
6
4
 Do not jump too quickly to the ultimate objective of the top goal
7
 Goals should not be exclusively product-oriented
© FREQUENTIS 2016
Page: 121
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 4: Describe Strategy for
 Goal-Decomposition
 Describe how the sub-goals support the claim
1
2
3
5
6
 Should the decomposition strategy be obvious, it may not be
necessary to represent it explicitly as part of the goal structure
7
© FREQUENTIS 2016
Page: 122
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
4
 Step 5: Adding Contextual Information
3
2 have
 The creation of a goal structure from existing evidence
1 may
elicited contextual information
5
6
4
– including assumptions, definitions and references
7
© FREQUENTIS 2016
Page: 123
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 6: Check Back Down the

Goal Structure
 Each time a parent goal is created
3
2
1
– Re-examine the supporting sub-goals top-down
5
6
4
7
© FREQUENTIS 2016
Page: 124
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
Structure into Higher (Top-Down)

Argument
3a
2 form
 The bottom-up approach will rarely be used in isolation
1
to
complete goal structure
5
6
4
 Since the goal structure is developed from the existing evidence, you
7
should keep in mind where the argument is ‘aiming’
© FREQUENTIS 2016
Page: 125
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

EVALUATING GOAL STRUCTURES
© FREQUENTIS 2016
Page: 126
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 A Staged Argument Review Process
Step 1
Argument
Comprehension
Step 2
Wellformedness
(Syntax)
Checks
© FREQUENTIS 2016
Page: 127
Safety Cases with the Help of GSN_2016_00.pptx
Step 3
Expressive
Sufficiency
Checks
Presentation Date: August 2016
Author: Andreas Gerstinger
Step 4
Argument
Criticism &
Defeat
 Step 1: Argument Comprehension
 Argumentation presented textually
1
2
3
4
– Identify the key claims, strategies, context and evidence presented in the assurance
case
– Having identified the essential elements of the assurance case, it is then necessary
for the reviewer to identify the links between them
– This activity involves determining the argument approaches which are being used to
support the claims identified and the evidence items being used to support the
arguments
 Argumentation presented with GSN
– Check that the notation has been used in accordance to the standard
– Identify and weed out superficial arguments
© FREQUENTIS 2016
Page: 128
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 2: Well-Formedness Checks
2
1
 Identify structural errors in the argument under review
3
4
– For example: circular arguments
 It may be possible to identify claims for which no supporting argument
or evidence has been presented
– Check for items of evidence whose role in the argument is unclear
© FREQUENTIS 2016
Page: 129
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 3: Expressive Sufficiency Checks
2
3have4
 The purpose of this step is to assess whether the1arguments
been expressed sufficiently for the argument to be fully understood
 The purpose of a strategy element in GSN is to explain the
relationship between claims made in a parent goal and those in the
sub-goals related to it
 Explicit documentation of strategies is useful wherever this relationship
is unclear
© FREQUENTIS 2016
Page: 130
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 4: Argument Criticism and Defeat
2
3
 Are the premises of the argument strong enough 1
to support
the
conclusion(s) being drawn??
4
 The sufficiency of the relationship between premises and conclusion of
the argument can depend on a number of attributes
– Coverage – to what extent does the argument and/or evidence presented cover the
conclusion?
– Dependency – the level of assurance offered up by multiple forms of evidence or
strands of argument may not be so convincing if they are not truly independent
© FREQUENTIS 2016
Page: 131
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 4: Argument Criticism and Defeat
– Definition – it could be considered undesirable to over-constrain
2or under-constrain
3
4
1
the argument or the evidence being presented
– Directness – to what extent does the argument or evidence directly address the
conclusion being sought?
– Against a specific product claim, process evidence can be regarded as ‘indirect’
– Indirect arguments are often considered unconvincing
– Relevance – how relevant is a particular piece of evidence or line of argumentation
to the conclusion being sought?
– An argument that “the System is safe” because “the sky is blue” suffers from a
problem of relevance
© FREQUENTIS 2016
Page: 132
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Step 4: Argument Criticism and Defeat
– Robustness – how susceptible is the argument to changes1 in the2evidence
3 and4
claims arising from this?
 When providing feedback from this step in the review process, it is
advisable for the reviewer to be as specific as possible in identifying
the problems present in the argument
 It is important to recognise that criticisms of the argument at this stage
could simply relate to weaknesses of expression
© FREQUENTIS 2016
Page: 133
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

GSN ADDITIONAL ELEMENTS
© FREQUENTIS 2016
Page: 134
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN Additional Elements
© FREQUENTIS 2016
Page: 135
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

DATA DICTIONARY
© FREQUENTIS 2016
Page: 136
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 Data Dictionary
 Enumeration -> use unique IDs
– detailed explanation of the problem at hand
– assumptions that had to be done
– assessment and selection of solutions
– connection to relevant standards
– correctness of arguments/evidence
– validity of arguments/evidence
– sufficiency of arguments/evidence
– ...
© FREQUENTIS 2016
Page: 137
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN and Data Dictionary
 Combination of GSN and data dictionaries
– Result in a document (Safety Case Report)
– Allows the reader to fully understand the argumentation
– Evidences are proving the correctness of the argument
– Describes why those evidences are sufficient
– Show additional information for the whole argumentation
© FREQUENTIS 2016
Page: 138
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 GSN and Data Dictionary

Example:

G_0.3: “Traceability of safety requirements and safety evidence has been shown.” – The traceability of safety
evidence and requirements is an important aspect in the argumentation of the safety case and is therefore developed
in a separate sub-tree instead of being part of the engineering life cycle argumentation.
–
G_0.3.1: “Traceability concept was defined.” – A concept defining the scope and means of achieving traceability
must be provided.
–
–
Sn_0.3.1a: “Concept: Traceability_Concept.doc” – A document defining the traceability concept followed for
the example project.
G_0.3.2: “Traceability was enforced.” – It must be proven that the traceability as defined in the concept was
actually enforced over all life cycles and their resulting artefacts.
–
Sn_0.3.2a: “Traceability Matrix: Traceability_Matrix.xls” – A traceability matrix lists all artefacts and their links
to depict the traceability between them.
© FREQUENTIS 2016
Page: 139
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger

A FINAL EXAMPLE
© FREQUENTIS 2016
Page: 140
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 IsaPro® Safety Case Pattern
© FREQUENTIS 2016
Page: 141
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 IsaPro® Safety Case Pattern (M_0.1)
© FREQUENTIS 2016
Page: 142
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger
 IsaPro® Safety Case Pattern (M_0.2)
© FREQUENTIS 2016
Page: 143
Safety Cases with the Help of GSN_2016_00.pptx
Presentation Date: August 2016
Author: Andreas Gerstinger