Decision Analysis and Resolution (DAR)

Introduction to CMMI Process Areas:
Decision Analysis and Resolution (DAR)
Chien-Tsun Chen
[email protected]
Dec. 14 2005
1
References
1.
2.
3.
4.
5.
6.
CMMI for Systems Engineering/Software Engineering/Integrated
Product and Process Development Version 1.1, Carnegie Mellon,
Software Engineering Institute, 2002.
Bill Phifer, DAR Basics: Applying Decision Analysis and
Resolution in the Real World, http://www.sei.cmu.edu/cmmi/presentations/sepg04.presentations/dar.pdf, 2004.
Bill Phifer, DAR to be More Effective: Applying Decision Analysis
and Resolution with Good Sense,
http://www.sei.cmu.edu/cmmi/adoption/pdf/phifer.pdf, 2005.
Decision Making Techniques: How to make better decisions,
http://www.mindtools.com/pages/-main/newMN_TED.htm.
Nick McGinness, Decision Analysis and Resolution,
https://opal.msoe.edu/sdl/resources/CMMI20032004/McGinnessCMMI.pdf, 2004.
D. H. Stamatis, Six Sigma and Beyond: Foundations of Excellent
Performance, CRC Press, 2001.
2
1
This presentation introduces Decision Analysis
and Resolution (DAR) process area and
presents some examples
Why do we
need DAR
Contents of
DAR
Examples
Lessons
Learned
3
This talk introduces Decision Analysis and
Resolution (DAR) process area and presents
some examples
Why do we
need DAR
Contents of
DAR
Examples
Lessons
Learned
4
2
Software development involves different kinds
of activities that take place in different phases
„
We can say that
software is the
consequence of
decision making (do
the right thing) and
activities performing
(do the thing right).
DAR provides a formal evaluation process
to avoid making wrong decisions
5
Some dumb decisions we may make…
Used wrong software architecture
„ Chose wrong project life cycle
„ Bought the wrong COTS components
„ Selected wrong programming language
„ Hired wrong supplier
„ Tested too late
„
6
3
Issues that have multiple alternatives and
evaluation criteria lend themselves to DAR
Business Decisions:
„
„
„
„
Personnel
Requirements
prioritization
Supplier selection
Any business
problem
Technical Decisions:
„
„
„
„
„
„
Life cycles
Platforms
Architectures
Programming
languages
Technical solutions
Any technical
problem
Different people make different kinds of decisions
7
This talk introduces Decision Analysis and
Resolution (DAR) process area and presents
examples
Why do we
need DAR
Contents of
DAR
Examples
Lessons
Learned
8
4
Where we are
Organizational Process
Definition, OPD (3)
Project Planning, PP (2)
Requirements
Management, REQM (2)
Configuration
Management, CM (2)
Organizational Process
Focus, OPF (3)
Project Monitoring and
Control, PMC (2)
Requirements
Development, RD (3)
Process and Product
Quality Assurance, PPQA
(2)
Organizational Training,
OT (3)
Supplier Agreement
Management, SAM (2)
Technical Solution, TS (3)
Measurement and
Analysis, MA (2)
Organizational Process
Performance, OPP (4)
Integrated Project
Management for IIPD,
IPM (3)
Product Integration, PI (3)
Decision Analysis and
Resolution, DAR (3)
Organizational Innovation
and Development, OID
(5)
Risk Management, RSKM
(3)
Verification, VER (3)
Organizational
Environment for
Integration, OEI (3)
Integrated Teaming, IT
(3)
Validation, VAL (3)
Causal Analysis and
Resolution, CAR (5)
Engineering
Support
Integrated Supplier
Management, ISM (3)
Quantitative Project
Management, QPM (4)
Process Management
Project Management
9
Context diagram of DAR: from issues to solutions
through formal evaluation processes
Issues
from
other Issues
PAs
Formal Evaluation
Process
Recommended
Solution
10
5
Contexts of DAR- A static view (1/2)
11
Contexts of DAR- A static view (2/3)
12
6
Contexts of DAR- A static view (3/3)
13
The relationship among PAs makes applying
CMMI more difficult
A simplify model of CMMI
We need a dynamic representation of CMMI
14
7
A dynamic model of applying DAR- using the
UML activity diagram
15
Dependence between DAR and other PAs
Evaluate
Alternatives
Selected
Issues
RSKM
Process Management
Process Areas
TS
Engineering Process
Areas
Evaluation
Criteria
DAR
Recommended
Solution
IPM
PP
Project Management
Process Areas
Supporting Process
Areas
16
8
Generic Practices and DAR
„
GPs with special significance
… GP2.1:
Establish an organizational policy
… GP2.2: Plan the process
… GP2.3: Provide resources
… GP2.5: Train people
… GP2.6: Manage configurations
… GP2.7: Identify and involve relevant
stakeholders
17
This talk introduces Decision Analysis and
Resolution (DAR) process area and presents
examples
Why do we
need DAR
Contents of
DAR
Examples
Lessons
Learned
18
9
DAR Examples in Contexts
SP 1.1
SP 1.4
SP 1.3
SP 1.2
SP 1.6
SP 1.5
19
This talk introduces Decision Analysis and
Resolution (DAR) process area and presents
examples
Why do we
need DAR
Contents of
DAR
Examples
Lessons
Learned
20
10
Lessons Learned [2]: make quality
decisions rather than formal (superficial)
decisions
„
„
„
„
People are generally impatient in decision
making
Using a formal decision making process is not a
natural act
Make sure you have criteria in place for when to
invoke DAR
Implementing is easy- but institutionalizing takes
time
21
DAR supports other PAs by providing quality
decision making through a formal evaluation
process
Evaluate
Alternatives
Evaluation
Criteria
DAR
Issues from
other PAs
No
Selected
Issues
RSKM
Process Management
Process Areas
Yes
Applying DAR?
Recommended
Solution
IPM
SP 1.3
Identify
Alternative
Solutions
PM
Supporting Process
Areas
SP 1.2
Establish
Evaluation
Criteria
SP 1.4
Select
Evaluation
Methods
Project Management
Process Areas
TS
Engineering Process
Areas
SP 1.1
Establish Guidelines
for Decision Analysis
SP 1.5
Evaluate
Alternatives
SP 1.6
Select
Solutions
Question?
22
11
Linked Slides
23
SP 1.1: Establish Guidelines for Decision
Analysis
Definition:
Establish and maintain guidelines to determine
which issues are subject to a formal evaluation process
Typical guidelines:
„
„
„
Risk Driven
80/20 Rule
ROI (Decision Impact
vs. DAR’s Costs )
„
Change Impact
Analysis
…
…
…
Work products
Schedule delays
Project objectives
24
12
SP 1.2: Establish Evaluation Criteria
Definition:
Establish and maintain the criteria for evaluating
alternatives, and the relative ranking of these criteria
Typical guidelines:
„
„
„
„
Technology limitations
Environmental impact
Risks
Life-cycle costs
„
Reuse evaluation
criteria from other PAs
whenever it is possible
25
SP 1.3: Identify Alternative Solutions
Definition:
Identify alternative solutions to address issues.
Typical methods:
„
„
„
„
Brainstorming
Interviews
Working groups
Literature search
26
13
SP 1.4: Select Evaluation Method
Definition:
Select the evaluation methods.
Typical methods:
„
„
„
„
„
Simulations
Engineering studies
Manufacturing studies
Cost studies
Business opportunity
studies
„
„
„
„
Survey
Extrapolations based on
field experience and
prototypes
User review and comment
Testing
27
SP 1.5: Evaluate Alternatives
Definition:
Evaluate alternative solutions using the established
criteria and methods.
Significance subpractices:
„
Perform simulations, modeling, prototypes & pilots as
necessary to exercise the evaluation criteria,
methods, and alternative solutions
28
14
SP 1.6: Select Solutions
Definition:
Select solutions from the alternatives based on the
evaluation criteria.
Significance subpractices:
„
„
Assess the risks associated with implementing the
recommended solution
Document the results and rational
29
Applying Grid Analysis when a number of good
alternatives and many factors are available
Example:
Choose a project lifecycle
Alt
e
Fa
cto
r na
rs
tiv
es
Which to
be chosen?
30
15
We should further consider the project
attributes and apply Risk Analysis to
determine the final solution
Alt
e
Fa
cto
r na
rs
tiv
es
Project attributes:
„
Middle size
Risk:
„
Requirements
changes (high)
The winner is UP
31
When a course of action has been selected, PMI
is a technique to check that it is worth taking
Example:
Should we take UP?
16 – 5 + 5 = 16
32
16
Value Result
Basic decision making approaches [3,6]
33
Reuse evaluation criteria from Supplier
Agreement Management, SP 1.2- Select
Suppliers
„
„
„
„
„
Geographical location of the supplier
Supplier’s performance records on similar
work
Engineering capabilities
Staff and facilities available to perform the
work
Prior experience in similar applications
34
17
Brainstorming is a group approach to creative
thinking
35
Decision Analysis and Resolution Guidelines
Template [5]
36
18
Decision Analysis and Resolution Log
Template [5]
37
19