Procedure - The Process Group

Introduction
Decision Analysis and Resolution Procedure
Decision Analysis and Resolution Procedure
v1a
(Shared with permission of TPG client)
Table of Contents
Table of Contents ................................................................................................................................. 1
List of Figures .................................................................................................................................... 2
List of Tables ..................................................................................................................................... 2
Revision History ................................................................................................................................... 3
Plan Approvals ..................................................................................................................................... 3
1.
Introduction .................................................................................................................................. 3
1.1. Purpose .................................................................................................................................. 3
1.2. Scope...................................................................................................................................... 3
1.3. Audience ................................................................................................................................. 3
1.4. Ownership .............................................................................................................................. 3
1.5. Tailoring .................................................................................................................................. 3
1.6. Definitions ............................................................................................................................... 4
1.7. References ............................................................................................................................. 4
1.8. Roles and Responsibilities ..................................................................................................... 4
1.8.1. Decision Owner ................................................................................................................ 4
1.8.2. Decision Participant .......................................................................................................... 4
1.8.3. Decision Stakeholder........................................................................................................ 4
2.
DAR Process ................................................................................................................................. 5
2.1. Event Triggers ........................................................................................................................ 5
2.2. Solution Identification ............................................................................................................. 5
2.3. Evaluation Criteria .................................................................................................................. 6
2.4. Evaluation Method .................................................................................................................. 6
2.5. Solution Evaluation ................................................................................................................. 7
2.5.1. Computation Method ........................................................................................................ 7
2.6. Solution Selection ................................................................................................................... 7
3. DAR Training ................................................................................................................................ 7
4.
DAR Audits and Reviews............................................................................................................. 8
5.
Metrics ........................................................................................................................................... 8
Appendix A: DAR Worksheet .............................................................................................................. 9
1
Introduction
Decision Analysis and Resolution Procedure
List of Figures
None
List of Tables
Table 1
Table 2
Sample Evaluation Criteria .......................................................................................... 6
Sample Evaluation Table ............................................................................................. 7
2
Introduction
Decision Analysis and Resolution Procedure
Revision History
REV
1a
DATE
AUTHOR
9/27/05
NSP
NOTES
Changed appendix A table column from “Rank” to “Coefficient” to
match process definition. Removed title ‘Draft’.
Plan Approvals
REV
1.
1.1.
APPROVAL 1
DATE
APPROVAL 2
DATE
Introduction
Purpose
The purpose of this <division> Decision Analysis and Resolution (DAR) Procedure is to define the
minimum required activities for the DAR process in order to comply with the DAR policy as defined in the
YYY Policy document.
1.2.
Scope
This Decision Analysis and Resolution Procedure shall apply to <division> development projects.
1.3.
Audience
The primary users of this procedure are assumed to be those people making product-critical decisions
within the <division> organization and the process/quality team involved in process improvement
activities.
1.4.
Ownership
This <division> Decision Analysis and Resolution Procedure is owned and maintained by the YYY SEPG
in accordance with the YYY Process Improvement Standard.
1.5.
Tailoring
Tailoring of this <division> Decision Analysis and Resolution Procedure must be performed in accordance
with the YYY Tailoring Procedure.
3
Introduction
Decision Analysis and Resolution Procedure
1.6.
Definitions
Terms used in this document can be found in the YYY glossary.
1.7.
References
All references can be found on the YYY web site.
1.8.
Roles and Responsibilities
The roles and responsibilities defined here are intended for the context of this document. It is not
intended to be a complete set of roles and responsibilities.
1.8.1.
Decision Owner
The decision owner is the person ultimately responsible for making the final decision. The decision owner
is responsible for:



1.8.2.
Completing the DAR worksheet in Appendix A:
Ensuring the appropriate evaluation criteria and evaluation method(s) are identified for the
solutions under consideration
Ensuring a final decision is reached
Decision Participant
A decision participant is someone who participates in the decision making process. The decision
participant shall have the required knowledge and background required to assist in making an informed
decision. DAR participants shall have the appropriate organizational authority to make the required
decisions.
1.8.3.
Decision Stakeholder
A decision stakeholder is someone who is affected by the decision but does not participate in the decision
making process.
4
DAR Process
Decision Analysis and Resolution Procedure
2.
DAR Process
The Decision Analysis and Resolution (DAR) process is a formal method of evaluating key program
decisions and proposed solutions to program issues. This ensures a controlled decision process, rather
than a reactionary decision process, for critical program decisions.
The goal of a formal DAR process is to provide the program with carefully analyzed, informed decisions.
This can be an iterative process if additional information and analysis is required in order to make an
appropriately informed decision.
DAR can apply to all levels of decisions made within a program. However, care should be taken to limit it
to key program decisions (identified within the program through the event triggers defined in Section 2.1)
so as to not impede the program’s progress.
Completed DAR worksheets (see Appendix A: ) shall be stored in the approved program document
repository according to the CM Plan.
2.1.
Event Triggers
Due to the unique constraints associated with each program, no single set of DAR event triggers can be
created. As such, each program shall document the event triggers it will use to identify when the formal
decision process (DAR) is necessary to make program decisions. These triggers shall be specified in the
Software Management Plan.
Typical criteria for triggering DAR include, but are not limited to:









2.2.
A specified program cost increase threshold
Capital expenditures over a specified cost
Make/Buy/Reuse decisions
Significant architectural changes
Significant schedule slip
Addition of a new release family
Selection of third party solution providers
Selection of organizational tools
Modification of organizational processes
Solution Identification
As a guideline, there shall be no less than 2 and should be no more than five prospective solutions
identified for consideration.
If there are too many solutions under consideration, it is likely that time constraints will dictate that some
of them will not be given proper consideration. This in turn detracts from a more thorough analysis of the
other potential solutions.
Typical methods of solution identification include, but are not limited to:







Brainstorming
Question and Answer
Solution Solicitation
Market Research
Competitor Analysis
Customer Feedback
Analysis of similar problems solved on other programs and their solutions
5
DAR Process
Decision Analysis and Resolution Procedure
2.3.
Evaluation Criteria
As a guideline, there shall be no less than 2 and should be no more than 5 evaluation criteria.
Due to the unique constraints associated with each program, no single set of evaluation criteria can be
created. As such, each program shall document the evaluation criteria it shall use for DAR along with the
weighting factor, or coefficient, associated with each criteria. The coefficient is used to more accurately
reflect the driving factors of the program. Each evaluation criteria should have a unique coefficient. The
larger the coefficient, the more important that criteria is for the program. The evaluation criteria and
coefficients shall be documented in the DAR Worksheet.
Typical evaluation criteria used to evaluate potential solutions include, but are not limited to:










Cost
Schedule
Risk
Performance
Reliability
Reusability
Efficiency
Maintainability
Scalability
Portability
Table 1 illustrates an example of evaluation criteria. In this example, cost is ranked as the highest
priority, performance is the second highest priority and schedule is the lowest priority.
Table 1
Sample Evaluation Criteria
Criteria
Coefficient
Cost
5
Performance
4
Schedule
1
2.4.
Evaluation Method
Each program shall document the method used to evaluate each proposed solution. The evaluation
methods used shall be documented using the DAR Worksheet in Appendix A:
Typical methods used to evaluate potential solutions include, but are not limited to:






open discussion
use of simulations
use of trade studies
statistical analysis
use of prototypes
analysis of solutions to similar problems
6
DAR Training
Decision Analysis and Resolution Procedure
2.5.
Solution Evaluation
Each solution shall be evaluated by completing the DAR worksheet in Appendix A: This worksheet
documents the triggering event, the people performing the evaluation, the people making the final
decision, the method(s) of evaluation to be used, the evaluation criteria and the total score for each
solution, and the final solution selected.
Each solution shall be assigned a unique, sequential ranking for each evaluation criteria. As an example,
if there are four potential solutions, the rankings are 1, 2, 3 and 4; with 1 as the worst-ranked solution and
4 as the best-ranked solution.
2.5.1.
Computation Method
Once the solutions are ranked for each evaluation criteria, the total score for each solution is computed.
The total score shall be the weighted summation of the evaluation criteria. A higher score represents a
better solution choice.
The method used to compute the total score shall be:
Total Score = sum(rank * coefficient) for each evaluation criteria.
Table 2 provides an example of evaluating four potential solutions using the coefficients from Table 1 .
Table 2
Solution
Evaluation
Method
Sample Evaluation Table
Cost
Performance
Schedule
Total Score
Solution 1
Simulation
4
2
1
29
Solution 2
Discussion
2
3
3
25
Solution 3
Prototype
3
1
4
23
Solution 4
Discussion
1
4
2
23
In this example, Solution 1 was rated as the best “Cost” solution, Solution 4 was rated as the best
“Performance” solution and Solution 3 was rated as the best “Schedule” solution.
Using the rankings from Table 1 the “Total Score” for Solution 1 is (4*5) + (2*4) + (1*1) = 29. The Total
Score for Solutions 2, 3 and 4 are computed in the same manner.
2.6.
Solution Selection
The solution with the highest total score shall be selected.
In the event of a tie between multiple solutions, the solution with the best (highest) ranking for the most
important evaluation criteria shall be selected.
In the example shown in Table 2 Solution 1 would be selected since it has the best (highest) Total Score.
3.
DAR Training
The manager of the person responsible for performing the tasks in this document shall be responsible for
identifying recommended training and ensuring the training is completed. The manager shall keep a
training plan that adheres to the <division> Training Management Standard.
7
DAR Audits and Reviews
Decision Analysis and Resolution Procedure
4.
DAR Audits and Reviews
DAR Audits and reviews shall conform to the YYY Software Quality Assurance Audit Procedure.
Corrective actions identified by DAR audits shall comply with the <division> Change Management
Standard.
5.
Metrics
The minimum set of DAR-related metrics that are utilized is defined in the <division> Measurement and
Analysis Standard. Additional desired metrics, if any, shall be documented in the Software Management
Plan and shall be presented to the appropriate CCB to be considered for inclusion in the standard set of
organizational metrics.
8
Appendix A: DAR Worksheet
Decision Analysis and Resolution Procedure
Procedure
Appendix A: DAR Worksheet
DAR WORKSHEET
Decision Name/Title:
<Title>
D ate/Time:
Place:
DAR Event Trigger:
Decision Owner:
EVALUATION PARTICIPANTS:
(Status: P = Participant, N = No Participation)
Identify people who participated and those whose participation was sought but not received.
Name
Status
Name
Status
DECISION PARTICIPANTS:
(Status: P = Participant, N = No Participation)
Identify people who participated and those whose participation was sought but not received.
Name
Status
Name
Status
EVALUATION CRITERIA:
Criteria
Coefficient
SOLUTION EVALUATION:
Solution
Evaluation
Method
Criteria 1
Criteria 2
9
Criteria 3
Criteria 4
Criteria 5
Total
Score
Appendix A: DAR Worksheet
Decision Analysis and Resolution Procedure
Solution
Evaluation
Method
Procedure
Criteria 1
Criteria 2
FINAL SOLUTION:
SOLUTION JUSTIFICATION:
10
Criteria 3
Criteria 4
Criteria 5
Total
Score