CASE STUDY: CISCO IT
STORAGE STRATEGY
SESSION OPT-4052
OPT-4052
9628_05_2004.c
© 2004 Cisco Systems, Inc. All rights reserved.
1
The Cost of Poor Quality
• Most companies waste more than half their storage
• Between 1999 and 2002, estimated $35 Billion of
storage assets have gone unutilized*
• Approximately one quarter of all annual computerrelated U.S. revenues
*Worldwide OEM Revenues 1999-2002
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
2
Summary
• Falling disk prices = Increased TCO
• Create value with STORAGE STRATEGIES
• In order to take advantage we must:
Understand the problem
Visualize the impact
Use metrics and know TCO components
• Cisco has implemented a STORAGE VISION to
direct strategies for storage management
with significant impact
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
3
Agenda
• Part 1—Storage Strategies for Lowering TCO
Definitions
Strategies
Measurement
Metrics
QA
• Part 2—Cisco IT Storage Story
Environment Overview
Cisco IT Storage Vision
Strategies (Migration, Consolidation, Recovery)
ERP SAN Migration
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
4
PART 1: STORAGE STRATEGIES
FOR LOWERING TCO
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
5
DEFINING TCO TERMINOLOGY
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
6
Definition—Total Cost of Ownership (TCO)
• The sum total of all costs associated with
implementing a storage solution including
acquisition and depreciation of raw storage,
labor, support, maintenance, etc. over the
lifetime of the solution
• Provides for “apples-to-apples” comparisons
of different solutions
• Measures impact on environment and on
bottom line—real world costs
• Cash basis or depreciation?
Cash basis—present value of all acquisition costs**
Depex—matches budget structures
OPT-4052
9628_05_2004_c2
7
© 2004 Cisco Systems, Inc. All rights reserved.
Cash vs. Depreciation
Year 1
Year 2
Total
Cash Basis
Year 0
HW
$ 1.00
Maint
$ 0.20
Labor
$ 0.10
$ 0.09
$ 0.08
Total
$ 1.30
$ 0.09
$ 0.08
$1.47
Depex
Year 0
Year 1
Year 2
Total
HW
$ 0.33
$ 0.33
$ 0.33
Maint
$ 0.20
Labor
$ 0.10
$ 0.10
$ 0.10
Total
$ 0.63
$ 0.43
$ 0.43
$1.50
• Year 1 labor costs = $0.1*(0.9^1)
• Year 2 labor costs = $0.1*(0.9^2)
**Cash Basis—Present Value of Future Costs at 10% Discount Rate
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
8
STORAGE STRATEGIES
OPT-4052
9628_05_2004_c2
9
© 2004 Cisco Systems, Inc. All rights reserved.
Strategies
UtilityUtility-Like Storage Service
Storage
Demand
• ServiceService-Level Management
• Appropriate Hardware Tiers
Storage Recovery Program
• Best Practices and Processes
• Special Tools and Metrics
Storage
Management
Storage Resource Management
Virtualization
Storage
Supply
Framework
Information Lifecycle Management
Data Integrity and Resiliency
Management and Consolidation
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
10
Strategies
• Migration to storage networks
Increases allocation efficiency
Decreases management costs
• Storage consolidation
Fewer hosts and fewer frames
Reduce points of management
Reduce maintenance costs
• Storage recovery
Increases utilization efficiency
Reclaim unused storage
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
11
MEASUREMENT
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
12
Measurement
• Data collection
Asset reports
Accounts payable
Storage inventory
SRM
Spreadsheets
• Need measurement of “before” picture
• Key values
Allocation efficiency
Utilization efficiency
OPT-4052
9628_05_2004_c2
13
© 2004 Cisco Systems, Inc. All rights reserved.
Utilization
Allocation
Efficiency
Utilization
Efficiency
PROD
60%
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
40%
14
Allocation Efficiency
OPT-4052
9628_05_2004_c2
Storage Type
Industry Average
Allocation Efficiency
DAS
30%–40%
SAN
50%–60%
© 2004 Cisco Systems, Inc. All rights reserved.
15
Measurement Example: (DAS)
• Sample DAS TCO
Seven storage frames
7 x external RAID arrays (total 24,192 GB)
$350K purchase price
$2.45M total
One storage manager
$150K per year
Seven datacenter tiles
$10K per tile
$5K for cabling
$75K total
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
16
Measurement DAS (Cont.)
• Backups
Per GB
Plus tape costs per GB
Total per GB
Total
$0.086
$0.868
$0.954
$63,698
• Maintenance
$6K per frame per month
$42K per month
$504K total
• Utilization
Allocation efficiency factor (60%)
Utilization efficiency (40%)
OPT-4052
9628_05_2004_c2
17
© 2004 Cisco Systems, Inc. All rights reserved.
Sample DAS TCO
Sample TCO
Cash Basis
Seven Storage Frames
7 x External RAID Arrays (Total 24,192 GB)
$350K Purchase Price
$1.75M Total
$
2,450,000.00
Depex—Year 0
$
816,666.67
$150K per Year
$
398,160.00
$
150,000.00
$10K per Tile
$5K for Cabling
$
199,080.00
$
75,000.00
One Storage Manager
Seven Datacenter Tiles
Backups
Per GB
Plus Tape Costs per GB
Total per GB
Total
$0.086
$0.868
$0.954
$
63,698.51
$
23,079.17
$6K per Frame per Month
$42K per Month
$504000K Total
$
1,337,817.60
$
504,000.00
$
$
24,192,000
5,806,080
4,448,756.11
0.77
Maintenance
Utilization Rates
Allocation Efficiency Factor (60%)
Utilization Efficiency (40%)
Total Storage
Utilization Efficiencies
Total Cost
TCO Per MB
0.6
0.4
24,192,000
5,806,080
$ 1,568,745.83
$
0.27
*Expenses Not Depreciated, but Totaled over 3 Years
**Discount Rate Needed for Present Value—Years 2 and 3 Discounted at 12%
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
18
Measurement Example:
SAN Migration Strategy
• Sample SAN TCO
Seven storage frames
7 external RAID Arrays
(36 GB drives)
(total 24,192 GB)
$350K purchase price
$2.45M total
One storage manager
$150K per year
$15K for training
$165K total
Seven datacenter tiles
$10K per tile
$5K for cabling
$75K total
Maintenance
$6K per frame
$42K per month
$504K total
Backups*
Total
$63,698.51
*Significant Savings in Backups Possible—Not Analyzed Here
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
19
Measurement SAN (Cont.)
• FC switches
$500K total including maintenance
• Utilization
Allocation efficiency factor (75%*)
Utilization efficiency (40%)
*Assumes 15% Increase
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
20
Sample SAN TCO
Sample TCO
Cash Basis
Seven Storage Frames
7 x External RAID Arrays (Total 24,192 GB)
$350K Purchase Price
$2.45M Total
$2,450,000
Depex—Year 0
$816,667
One Storage Manager
$150K per Year
$15K for SAN Training
$165K Total
$437,976
$10K per Tile
$5K for Cabling
$75K Total
$199,080
$165,000
Facilities - Seven Tiles
$75,000
Backups
Per GB
Plus Tape Costs per GB
Total per GB
Total
$0.086
$0.868
$0.954
$61,261
$23,079
Maintenance
$6K per Frame per Month
$42K per Month
$504K Total
$1,337,818
$504,000
Switches
4 Director Class Switches (Inc. Maint.)
$500,000
$166,667
Utilization Rates
Allocation Efficiency Factor (75%)
Utilization Efficiency (40%)
Total Storage
Utilization Efficiencies
Total Cost
TCO per MB
OPT-4052
9628_05_2004_c2
0.75
0.4
24,192,000
7,257,600
$4,986,134
$0.69
35,040,000
10,512,000
$1,750,412
$0.17
21
© 2004 Cisco Systems, Inc. All rights reserved.
Consolidation Impact
Sample TCO
Cash Basis
Two Storage Frames
2 x External RAID Arrays (42,048 GB)
$750K Purchase Price
$1.5M Total
$1,500,000
Depex—Year 0
$500,000
One Storage Manager
$150K per Year
$15K for Training
$165K Total
Three Tiles
$10K per Tile
$5K for Cabling
$35K Total
Facilities
$437,976
$165,000
3
$92,904
$35,000
Backups
Per GB
Plus Tape Costs per GB
Total per GB
Total
$0.086
$0.868
$0.954
$61,261
$23,079
Maintenance
No Maintenance for 3 Years
$0
$0
$500,000
$166,667
Switches
4 x 32 Port Switches
Utilization Rates
Allocation Efficiency Factor (80%)
Utilization Efficiency (40%)
Total Storage
Utilization Efficiencies
Total Cost
TCO per MB
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
0.8
0.4
42,048,000
13,455,360
$2,592,141
$0.19
42,048,000
13,455,360
$889,746
$0.07
22
Recovery Impact
Sample TCO
Cash Basis
Two Storage Frames
2 x External RAID Arrays (42,048 GB)
$750K Purchase Price
$1.5M Total
$1,500,000
Depex—Year 0
$500,000
One Storage Manager
$150K per Year
$15K for Training
$165K Total
Three Tiles
$10K per Tile
$5K for Cabling
$35K Total
Facilities
$437,976
$165,000
3
$92,904
$35,000
Backups
Per GB
Plus Tape Costs per GB
Total per GB
Total
$0.086
$0.868
$0.954
$61,261
$23,079
$0
$0
Maintenance
No Maintenance for 3 Years
Switches
4 Direct Class Switches
$500,000
$166,667
Utilization Rates
Allocation Efficiency Factor (80%)
Utilization Efficiency (60%)
Total Storage
Utilization Efficiencies
Total Cost
TCO per MB
OPT-4052
9628_05_2004_c2
0.8
0.6
42,048,000
20,183,040
$2,592,141
$0.13
42,048,000
20,183,040
$889,746
$0.04
23
© 2004 Cisco Systems, Inc. All rights reserved.
Solution/Cost Comparison
Effect of Storage Program on TCO
$0.90
Cash
Basis
$0.80
Depex
$0.70
TCO/MB
$0.60
$0.50
$0.40
$0.30
$0.20
$0.10
$0.00
TCO per MB DAS
TCO per MB SAN
Solution
TCO per MB DAS
TCO per MB SAN
TCO per MB Consolidation
TCO per MB Recovery
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
TCO per MB
Consolidation
TCO per MB
Recovery
Cash Basis
Depex
$0.77
$0.69
$0.19
$0.13
$0.27
$0.17
$0.07
$0.04
24
METRICS
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
25
Metrics
• Project metrics
Payback method
ROI
NPV
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
26
Metrics Examples: Payback
• Pros
• Cons
“Napkin math”
Doesn’t work well for
large investments
Suitable for small
capital investments
Doesn’t work well for long
time horizons (>1 year)
Measures time to
recoup investment
Payback period = initial
investment/annual income
Example: $5000 for New Disk Infrastructure to
Increase Performance for Online Transactional
System which Increases Revenue by $2500
over Two Quarters
Payback Period Is One Year
$5000/$2500 = 4 Quarters = One Year
Reasonable Payback—Do the Upgrade
OPT-4052
9628_05_2004_c2
27
© 2004 Cisco Systems, Inc. All rights reserved.
Metrics Examples: ROI
• Pros
• Cons
“Napkin math”
Easy to manipulate
Suitable for large
capital investments
Maligned as a marketing tool
Well known
Does not account for
cost of capital
Does not account for
time value of money
Example: $5000 for New Disk Infrastructure
to Increase Performance for Online
Transactional System which Increases
Revenue by $2500 over Two Quarters
ROI = $2500/$5000 = %50
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
28
Metrics Examples: NPV
• Pros
• Cons
Accurate measurement
Definitely not “napkin math”
Suitable for large
capital investments
Accounts for cost of capital
and time value of money
Example: $5000 for New Disk Infrastructure to Increase
Performance for Online Transactional System which Increases
Revenue by $2500 over Three Years; Cost of Capital Is 12%
NPV = -$5000 + (833.33*(1.12^1)) + (833.33*(1.12^2))
(833.33*(1.12^3))
Excel = NPV (Rate, Value1, Value2...)
+
NPV = -$2998.47 (i.e. DON’T DO THE PROJECT)
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
29
Summary
• DAS to SAN migrations significant cost savers
• Coupled with consolidation and storage recovery
Programs greater reductions in TCO possible
• Use FC and IP networks as enabling technologies
for lower TCO
• Use strategies to adjust storage TCO FUNCTION
• Uptime and availability are part of TCO
• Use FC and IP storage networks to increase business
continuance, uptime, and availability in turn further
decreasing TCO
• Play WHAT-IF scenarios with uptime, availability,
backups, retention
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
30
PART 2: CISCO IT
STORAGE STORY
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
31
Summary
• Cost of raw storage has fallen while data has grown
at nearly exponential rates at Cisco
• Data center space is at a premium
• Poor utilization has created potential for significant
ROI
• Cisco IT is focusing on creating a consolidated
storage utility to raise utilization and lower TCO
• Cisco is well underway towards consolidating
storage into large SANs and providing storage
as utility-like service
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
32
Agenda
• Environment Overview
• Cisco IT Storage Vision
• Strategies (Migration, Consolidation, Recovery)*
• ERP SAN Migration
• Q&A
*Application of Concepts from Part 1
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
33
ENVIRONMENT OVERVIEW
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
34
Cisco IT Storage Landscape
2500
SAN
NAS
2000
DAS
• Cisco IT storage large
portion of data center
budget
1500
• 2001 and 2002 storage
growth > 120%
1000
• Currently, Cisco IT
supports 2.1 PB of
“raw” storage
500
0
FY ’01
FY ’02
FY ’03
FY ’04
• Along with
management and
facility costs, our
storage TCO
is ~.10 per MB*
* Based on January 2004 TCO Study Conducted
by the Cisco IT Storage Team (Bill Williams)
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
35
Cisco IT Storage Environment: 2001
• Predominantly DAS (estimated 600–700TB)
with SAN-islands interspersed
• Between 1999–2002—estimated 30+ SAN islands
created using 148 Brocade and McData switches—
2340 ports combined (mix of 16, 32, and
64-port switches)
• Virtual storage team of 10 individuals spending
10%–90% of their time on storage-related activities
• Absolutely no standards across verticals or
support groups
• Estimated TCO for storage $0.30–$0.40 per MB
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
36
Datacenter Storage Architecture (2001)
Cisco IP Network
Unix and NT Test,
Development, Stage,
Production, and DR
Hosts per Business
Vertical
IP Storage
NAS Filers
NAS
NAS
NAS
NAS
Local and Consolidated
SCSI Direct Attach
Storage (DAS) per
Business Vertical
Cisco Business Functions
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
37
Early 2001: Challenges
• Direct-attached model was not scaling
Management burden—too many points of management
Poor utilization due to port constrictions
FC switches used as “dumb hubs” to create SAN islands
Rapid consumption of data center resources
• Immaturity of storage management tools led
to inefficient business processes
Provisioning
Capacity planning
No cost visibility back to client base
• Poor storage utilization led to increased TCO
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
38
STORAGE VISION
OPT-4052
9628_05_2004_c2
39
© 2004 Cisco Systems, Inc. All rights reserved.
Cisco IT Storage Vision (2001)
Implement a
Network-Centric
Storage Model and
Offer Storage as a
Utility-Like Service
Business
People
Processes
Software
Vision
Hardware
Vision
Enablers
Goal: Reduce Points of Management and Implement
Storage as a Utility-Like Service to Improve Overall
Storage Utilization and Reduce TCO
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
40
Storage Vision Enabler: People
• Dedicated team formed in early 2002—Enterprise Storage
Systems (ESS)
Define the processes, architecture, technology, deployment, and support
of the storage and backup infrastructures required
to meet the needs of the business
Responsible for working on the projects required to achieve the
storage vision
Eight full-time storage managers and three full-time project managers
• Global, virtual storage team formed in mid 2002
High-level vision, strategies, migration plans
Global communication and coordination
• Executive sponsorship in 2001 nonexistent; 2002 director-level
sponsorship obtained
**Still Lacking Job Description for “Storage Administrator”
OPT-4052
9628_05_2004_c2
41
© 2004 Cisco Systems, Inc. All rights reserved.
Processes and Software
UtilityUtility-Like Storage Service
Storage
Demand
• ServiceService-Level Management
• Appropriate Hardware Tiers
Storage Recovery Program
• Best Practices and Processes
• Special Tools and Metrics
Storage
Management
Storage Resource Management
Virtualization
Storage
Supply
Framework
Information Lifecycle Management
Data Integrity and Resiliency
Management and Consolidation
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
42
Storage Vision Enabler: Processes
• Harden processes for client storage requests
Update web-based storage request tool
Create tiered storage based on client SLAs
• Consolidate budgets across business verticals
Single budget for all enterprise storage
• Create SLA framework based on services
provided by team:
OPT-4052
9628_05_2004_c2
Planning, design, consulting,
and reporting
Data integrity and resiliency
Capacity and performance
management
Financial planning
Provisioning
Problem and incident
management
Information lifecycle management
© 2004 Cisco Systems, Inc. All rights reserved.
43
Storage Vision Enabler: Software
• Storage Resource Management software (SRM)
key enabler
• SRM software critical to establish baseline and
metrics for application and hardware availability
• SRM required for inventory and capacity-planning
purposes
• SRM and SAN management software critical
for designing and measuring client SLAs
• Scalable software for provisioning, striping,
mirroring, multipathing, replication
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
44
Storage Vision Enabler: Hardware
• Robust platform, enterprise-level scalability
to one PB and beyond
• Multiple platforms needed to address tiered
storage requirements (i.e. optical solutions for
metro clustering, NAS, and ATA for lower tiers)
• Interoperability, standards aware
• Manageability key to success
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
45
Vision Inhibitors (2001)
• Financial
SAN costs (economy and the initial investments)
• New technology
SANs were in the “learning phase” for Cisco IT and the industry
• Company philosophy
Concept of network-centric storage and organization required
time to gain acceptance
• Immature storage management software
SRM, SAN management, virtualization, capacity planning, etc.
• Immature SAN hardware
Lack of SAN technology to support large, heterogeneous SANs
(lack of scalability = complexity = higher costs)
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
46
STRATEGIES AT CISCO
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
47
SAN MIGRATION
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
48
Migration of DAS to SAN
• Most critical piece of storage management vision
• All other strategies depend on moving storage
to storage networks
• Moving DAS storage and SAN islands into
consolidated datacenter SANs is relatively
easy to justify using very tangible metrics
• Cisco specific examples
DAS to SAN, SAN island to MDS consolidations
+52% ROI in FY ’03
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
49
CONSOLIDATION
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
50
Consolidation as a Catalyst
• Enhance storage vision built on storage
consolidation and storage recovery
• While consolidating, consolidate with a purpose—
make sure the consolidation efforts fit in with
your overall vision
• Cisco specific examples:
Enterprise Frame Consolidation Phase 1
+58% ROI in FY ’03
+51% ROI in FY ’04
Enterprise Frame Consolidation Phase 2
Estimated > 50% ROI in FY ’05
OPT-4052
9628_05_2004_c2
51
© 2004 Cisco Systems, Inc. All rights reserved.
Consolidate to Point of
Diminishing Returns
Diminishing Returns of Consolidation
$350,000
TCO Savings
NPV
$300,000
$250,000
$200,000
$150,000
TCO
Savings
NPV
Phase 1*
$315,360
$42,025
Phase 2
$283,824
$19,482
Phase 3
$236,520
-$14,333
$100,000
$50,000
$0
-$50,000
Phase 1*
Phase 2
Phase 3
*Investment at Each Phase—$1,500,000
**Increase in Utilization and Other Efficiencies Decrease as Disk Density Increases
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
52
RECOVERY
OPT-4052
9628_05_2004_c2
53
© 2004 Cisco Systems, Inc. All rights reserved.
Vision: ROI Potential (Utilization)
Assumptions
50
45%
Utilization
Increase
40
20%
Utilization
Increase
30
6%
Utilization
Increase
20
10
0
Present
Year 1
Year 2
Year 3
-10
Storage Type
DAS
SAN
OPT-4052
9628_05_2004_c2
Industry Average
Allocation Efficiency
• 1.1 PB of DAS/SAN
storage with current
growth rate of 24%,
decreasing to 20%
for years two
and three
• Storage TCO
(currently .10
per Mb) drops
by 20% per year
• Goal: once
utilization improved,
it is held there
30%–40%
50%–60%
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
54
Storage Recovery Program:
Addressing Storage Demand
• SRP started as strategy to address demand-side
issues of poor UTILIZATION EFFICIENCY
• SRP began in tandem with SAN migrations and
relied upon MDS rollout as enabling technology
(and ostensibly EMC storage scope)
• SRP application staff targeted application owners,
users, and abusers of storage and worked closely
with Enterprise storage staff to determine policies
and procedures for reclaiming storage
• SRP and ESS together outlined the “chevron” system
• SRP reclaimed roughly $2.9 million in the first year
OPT-4052
9628_05_2004_c2
55
© 2004 Cisco Systems, Inc. All rights reserved.
Storage Recovery Program: Chevrons
Physical
Storage
Configured
Storage
Addressable
Storage
Logical
Volume
Application
Allocation
Unit
Used
Storage
• Physical storage is the raw TB as shown on invoice
• Configured storage is configured LUNs
• Addressable storage—storage shown down multiple paths
• Logical volumes—(what the host sees)*
• Application allocation unit—raw volumes or file systems
• Used—consumed (what the application sees)**
*Allocation Efficiency
**Utilization Efficiency
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
56
Utilization and the Storage Lifecycle (2001)
Utilization Rate
Physical
Storage
40%
Configured
Storage
??%
Addressable
Storage
??%
Application
Allocation
Unit
Logical
Volume
30%
??%
Used
Storage
??%
Cumulative Utilization
Physical
Storage
??%
OPT-4052
9628_05_2004_c2
Configured
Storage
??%
Addressable
Storage
??%
Application
Allocation
Unit
Logical
Volume
??%
??%
Used
Storage
10%
57
© 2004 Cisco Systems, Inc. All rights reserved.
Utilization and the Storage Lifecycle
Utilization Rate
Physical
Storage
*100%
Configured
Storage
67%
Addressable
Storage
72%
Application
Allocation
Unit
Logical
Volume
88%
83%
Used
Storage
59%
Cumulative Utilization
Physical
Storage
*100%
Configured
Storage
67%
Addressable
Storage
48%
Logical
Volume
42%
Application
Allocation
Unit
35%
Used
Storage
21%
*Current (as of May 12, 2004)
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
58
STRATEGY TIMELINE
OPT-4052
9628_05_2004_c2
59
© 2004 Cisco Systems, Inc. All rights reserved.
Storage Management Timeline
Framework
Virtualization
Information Lifecycle Mgmt
Service Level Management
Storage Recovery Program
Storage Resource Management
Device Management
Data Integrity and Resiliency
2001
OPT-4052
9628_05_2004_c2
2002
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
2003
2004
2005
60
Hardware Strategy: Consolidation
• Local DAS (Baydel, Sun T3, local disk)
and NAS
Phase 0 (pre 2001)
• Consolidated DAS (EMC Symmetrix, HP XP)
and NAS
*Some iSCSI
• Consolidated DAS, small, FC SAN “islands”
and NAS
Phase 1 (2001–2002)
• Consolidated FC SANs (BUs per datacenter)
and NAS
Phase 2 (2003–2004)
• Consolidated FC SANs (datacenter, campus)
and NAS
Phase 3 (2004–2005)
• Consolidated FC SANs (FCIP on WAN)
and NAS
Phase 4 (2004–2005)
• All IP storage (NAS, FCIP, iSCSI SANs)
Phase 5 (2005+)
OPT-4052
9628_05_2004_c2
61
© 2004 Cisco Systems, Inc. All rights reserved.
Consolidated SAN Migration Timeline
Cisco IP Network
Cisco IP Network
Cisco IP Network
GOLD
SILVER
BRONZE
Cisco Data Center and
“Physical” Business Functions
Cisco Campus Data Centers and
“Logical” Cisco Business Functions
Timeline
Phase 1: Originally
Scheduled for One
Year (2001)
OPT-4052
9628_05_2004_c2
Phase 2: Predicted
to Take 12–18 Months;
Start Delayed for 12
Months (2003–2004)
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
Phase 3: Predicted
to Take 12–18 Months
(2004–2005)
62
SAN Lessons Learned
• PROS
Storage pools increase utilization potential
Provisioning simpler and faster
Consolidation = fewer management points
Reliability equal to or greater than direct and network attached
Added flexibility of fiber (distance)
SAN TCO at least 12% less than DAS
• CONS
Consolidation has been difficult, time consuming
Initially higher TCO, especially during transition
Increased workload and CAPEX—need to draw function
out over time
• Analysis
We proved to ourselves that our strategy and vision were sound
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
63
ERP SAN MIGRATION
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
64
Initial SAN Deployments: ERP LOB
Cisco IP Network
5 x ERP Manufacturing
D/R SAN
10.7
Dev SAN
Order Entry
Dev SAN
ERP 11i
Dev SANs
Keystone
Manufacturing
Dev SAN
• 14 SAN islands
D/R SAN
• 33 Unix hosts
• 38 storage frames
• Over 350 terabytes
Data Warehouse
Legacy Direct
Dev SAN
Attach Storage
Order Entry
D/R SAN
Data Warehouse
Dev SAN
Cisco ERP/DW
Business Function
OPT-4052
9628_05_2004_c2
65
© 2004 Cisco Systems, Inc. All rights reserved.
ERP 11i: Initial SAN Deployment
ERP Oracle 11i Development SAN Islands
Cisco IP Network
Unix
Hosts
4-Port ISL
2 McData
32-Port
SAN Switches
Unix
Hosts
4-Port ISL
Dual
Fabric
SAN
2 McData
32-Port
SAN Switches
11 External RAID Arrays (~ 90 Terabytes)
1 McData
32-Port
SAN Switches
Dual
Fabric
SAN
1 McData
32-Port
SAN Switches
1 External RAID Array (~ 10 Terabytes)
**Separated Due to Different Host and Disk Platforms
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
66
ERP 11i: Initial SAN Deployment (Stage 1):
January 2003
Cisco IP Network
Unix
Hosts
Unix
Hosts
2 Cisco
MDS-9509
SAN Switches
4-Port ISL
2 McData
32-Port
SAN Switches
1 McData
32-Port
SAN Switches
11 External RAID Arrays (~ 90 Terabytes)
1 External RAID Array (~ 10 Terabytes)
**Physically Separated Due to Different Disk Platforms
OPT-4052
9628_05_2004_c2
67
© 2004 Cisco Systems, Inc. All rights reserved.
ERP 11i Initial SAN Deployment (Stage 2):
March 2003
Cisco IP Network
Unix Hosts
2 Cisco MDS-9509
SAN Switches
*Logical Separation of Different Disk Platforms via VSANs
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
68
ERP 11i: Initial SAN Deployment
• 640 port SAN
• 33 Unix hosts
Two Fabrics:
2 Cisco MDS 9509
SAN Switches
on Each
• 5 VSANs
• 38 Storage frames
• Over 350 terabytes
DR Unix
VSAN*
DR Unix VSAN
Backup
VSAN
Development
Unix VSAN
Development
Unix VSAN*
*Separate VSANs per OS
OPT-4052
9628_05_2004_c2
69
© 2004 Cisco Systems, Inc. All rights reserved.
Phase 3 SAN Consolidation
RTP Production DC
MDS 9509
RTP5-ERP-SW1
4 Port (8 Gb/s)
Port Channel
MDS 9509
RTP5-ERP-SW2
MDS 9509
MDS 9509
RTP5RTP5-IOPS-SW1
CORPSYSCA-SW1
2 Port (4 Gb/s)
Port Channel
MDS 9509
RTP7-ITSAN-SW1
4 Port (8 Gb/s)
Port Channel
MDS 9509
RTP5-ERP-SW4
OPT-4052
9628_05_2004_c2
4 Port (8 Gb/s)
Port Channel
Fabric “A”
Approximately
1.5K
4 Port (8 Gb/s)
Port Channel
16 Port (32 Gb/s)
Port Channel
2 Port (4 Gb/s)
Port Channel
2 Port (4 Gb/s)
Port Channel
MDS 9509
RTP5-ERP-SW3
RTP Development DC
Single-Mode Fiber
MDS 9509
RTP5-ITSAN-SW1
Fabric “B”
2 Port (4 Gb/s)
Port Channel
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
MDS 9509
RTP7-ITSAN-SW1
4 Port (8 Gb/s)
Port Channel
4 Port (8 Gb/s)
Port Channel
MDS 9509
RTP7-ITSAN-SW2
70
Phase 3: Fabric Manager Screenshot
OPT-4052
9628_05_2004_c2
71
© 2004 Cisco Systems, Inc. All rights reserved.
Total MDS Ports Deployed
RTP
San Jose
London
Hong
Kong
Sydney
EMEA
MDS 9509
1440
2880
–
160
160
320
MDS 9216
16
16
–
–
–
–
MDS 9506
48
–
–
–
–
–
MDS 9120
–
440
80
–
–
80
1456
3336
80
160
160
400
Total
Total Number of Ports Deployed—5,640
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
72
Upcoming Initiatives
• Rollout of IPS (iSCSI and FCIP)—SAN Migration
• Further consolidation until break-even point is
reached—SAN Consolidation
• Further migration of DAS to SAN (either FC or IP)
—SAN Migration
• Metro HA clustering project to utilize CWDM
or DWDM (Q1 FY ’05)—Replication and
Tiered Services
• Pilot programs for virtualization (Veritas and
IBM SVC)—Replication and Tiered Services
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
73
Recommended Reading
• The Business Case for Storage
Networks [1-58720-118-6]
Available October 2004
• Cisco Storage Networking
Architectures Poster
[158720102X]
• Internetworking Technologies
Handbook, Fourth Edition [158705-119-2]
Available on-site at the Cisco Company Store
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
74
Online References
• Business Ready Data Center
http://www.cisco.com/go/datacenter
• Cisco Storage Networking Solutions
http://business.cisco.com (click “Storage”)
• Search Storage http://www.searchstorage.com
• Byte and Switch http://www.byteandswitch.com
• Storage Networking World Online
http://www.snwonline.com
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
75
Q AND A
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr
76
Complete Your Online Session Evaluation!
WHAT:
Complete an online session evaluation
and your name will be entered into a
daily drawing
WHY:
Win fabulous prizes! Give us your feedback!
WHERE: Go to the Internet stations located
throughout the Convention Center
HOW:
Winners will be posted on the onsite
Networkers Website; four winners per day
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
77
OPT-4052
9628_05_2004_c2
© 2004 Cisco Systems, Inc. All rights reserved.
78
© 2004 Cisco Systems, Inc. All rights reserved. Printed in USA.
Presentation_ID.scr