VIRTUAL TAPE: HOW, WHY –
AND A REAL-WORLD SCENARIO
Skip Tamke, Brocade Practice Manager - Data Protection
EMC Forum NYC
October 30, 2008
© Copyright 2008 EMC Corporation. All rights reserved.
Brocade Legal Disclaimer
All or some of the products detailed in this presentation may still be under development and
certain specifications, including but not limited to, release dates, prices, and product
features, may change. The products may not function as intended and a production version
of the products may never be released. Even if a production version is released, it may be
materially different from the pre-release version discussed in this presentation.
NOTHING IN THIS PRESENTATION SHALL BE DEEMED TO CREATE A WARRANTY OF
ANY KIND, EITHER EXPRESS OR IMPLIED, STATUTORY OR OTHERWISE, INCLUDING
BUT NOT LIMITED TO, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS
FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT OF THIRD PARTY RIGHTS
WITH RESPECT TO ANY PRODUCTS AND SERVICES REFERENCED HEREIN.
Brocade, the B-wing symbol, DCX, Fabric OS, File Lifecycle Manager, MyView, and
StorageX are registered trademarks, and DCFM and SAN Health are trademarks of Brocade
Communications Systems, Inc., in the United States and/or in other countries. All other
brands, products, or service names are or may be trademarks or service marks of, and are
used to identify, products or services of their respective owners.
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
2
DISK/VTL CONFIGURATION DECISIONS
Virtual Tape Configuration
y Once the Enterprise Backup/Recovery infrastructure has
been architected, sized and the technology installed
there is still a lot of planning and designing the must be
performed
y VTL and native disk configurations do require changes
in the EBR application configuration
y Storage decisions also have to be made that aren’t
required in physical tape environments
– How many virtual tape libraries should be created?
– How many virtual tape drives?
– Should virtual tape drives be shared?
– How many file systems for native disk and where will they
be assigned?
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
4
Virtual Tape Configuration (continued)
y For VTL systems, at least one virtual library must be created on each
engine
y A virtual library only exists on one engine (but it can move in a cluster
under failover conditions)
y Key configuration decisions are:
– Will a VTL engine be dedicated to one environment (e.g. TSM instance) or
shared by multiple environments?
– How many virtual libraries will be created?
– How much of the total VTL capacity (how many virtual volumes) are assigned
to each virtual library? Reassigning capacity later can be a real pain!
– How many drives within each virtual library and which media servers will “own”
the drives?
– What size virtual volumes will you use? Too small a size may impact your
ability to utilize all the VTL’s storage capacity. Too large may result in
inefficient reclamation of expired space.
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
5
Virtual Tape Configuration (continued)
y In a TSM shop you need to decide:
– Should a large, shared virtual library be used (which requires
the use of a TSM library manger) or should dedicated libraries
be configured?
– Should a DISK cache still be used and if so how big does it
need to be? Brocade recommends that a DISK cache still be
used but it may be much smaller.
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
6
A VTL Environment Can Get Complicated
• LAN-free data path can complicate things, as each client
needs dedicated virtual drives
• LAN-free clients have to get connected to the SAN - should
use separate HBA(s) (from disk I/O)
• Have to do lots of target/LUN masking to the virtual drives if
doing LAN-free
• Lots of LAN-Free clients means lots of SAN configuration
• E-vaulting further increases the number of server/library/drive
mappings that must be defined and managed
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
7
SAN Virtual Drive Mapping
LPAR
Access of
Virtual
Drives
VLIB22-1
VLIB21-1
Path 1
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
Logical
Library
Presentation
of Virtual
Drives
TSM CDL SAN Connectivity
HQ Remote DR Library Configuration
CDL HBA0
CDL HBA1
Path 1
Edge-11
3000
2x2
Edge-21
3000
2x2
Path 1
CDL HBA1
Path 3
CDL21
CDL HBA0
LPAR1
CDL HBA1
Path 3
CDL HBA0
Fabric A
VLIB21-2
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
CDL HBA0
Path 1
Path 3
Path 3
VLIB21-1
Fabric A
CDL HBA1
Path 2
Path 4
Path 4
Path 2
Fabric B
VLIB22-2
Path 2
VLIB21-2
Fabric B
Path 1
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
Path 1
CDL HBA0
CDL HBA0
Path 3
Edge-12
3000
2x2
LPAR2
CDL HBA0
Path 2
CDL HBA1
Path 3
Path 2
CDL HBA1
VLIB22-1
VLIB22-2
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
2
Drives
Path 4
Path 4
Edge-22
3000
2x2
CDL HBA1
CDL22
CDL HBA0
Path 2
Path 4
CDL HBA1
Path 4
Path 1
HQ
DR
Path 3
Path 2
Path 4
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
8
Case Study – Retail Company
Overview:
y $40B company
y Retail pharmacy and prescription benefits
y Rapid growth and acquisitions
y Multiple data centers and D/R sites
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
9
REAL-LIFE EDL CASE STUDY
Case Study – Retail Company
Operational Issues:
y Large TSM Backup/Recovery (B/R) and D/R
infrastructure
y Data growth was stressing the B/R and D/R
environment
y Tape cost was significant operational burden
y Recovery concerns were a key issue
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
11
Case Study – Retail Company
Tactical and Strategic Goals:
y Technical solutions that were financially sound
that addressed operational issues
y Robust and scalable B/R and D/R infrastructure
to meet growing data needs
y Cost containment with regards to physical tape
y Improved recovery performance
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
12
Case Study – Retail Company
What transpired:
y Brocade and EMC, long time trusted partners at
retail company combined their resources to
address retail company’s concerns and deliver a
solution
y Disk-based snap and replication solutions
y Oracle Level Recovery Solution
y Virtual Tape (VTL) based B/R and D/R solution
y Electronic vaulting to remote sites for D/R
y ROI to justify above solutions
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
13
Case Study – Retail Company
Methodology:
y Tool based data collection
y Client interviews
y Data analysis
y Design and modeling
y Solution options
y Recommended solutions
y TCO/ROI study
y Customer approval of recommended solution
y Funding secured
y Implementation plan
y Execution of implementation and integration plan
y Post implementation support
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
14
DATA ANALYSIS
Data Analysis
y Brocade’s tool-based TSM data collection
y Agentless and robust tools that collect TSM data
on any platform
y Modeling and sizing tools to provide various
technology options
y Identify performance, capacity and configuration
gaps
y Experienced consultants to analyze, interpret and
provide recommendations
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
16
TSM Workload – Production TSM
Environment
Total
Peak
Average
Peak
Average
% growth in
Utilized
nightly
nightly
nightly
nightly
TSM
Backup data
Client
Archive Archive Backup
Backup
Backup
(utilized) Number of
as recorded
Disk
workload workload workload workload Window
Database clients
by TRT over
Storage
(hrs)
(GB) over (GB) over (GB) over (GB) over
registered
Size
a 12-month
As seen
the last 30 the last 30 the last 30 the last 30
(GB)
period
by TSM
days
days
days
days
(GB)
PEAK
Daily
AVERAGE
Daily Volume Volume of
CopyPool
Data
of Data
Copypooled Copypoole Window
(hrs)
over the last d over the
last 30
30 days
days
(GB)
(GB)
TSM Server
Server
Platform
TSM
Server
Version
TSMS100
Solaris 9
5.2.4.5
0.3
0
0
0
0
0
0
TSMS101
Solaris 9
5.2.4.5
30
234
13,700
1,800
2,657
0
0
12
40
1,675
3,490
6
UNIX client backups.
TSMS102
Solaris 9
5.2.4.5
5.7
43
1,500
2,447
4,298
0
0
12
25
2449
4337
6
Sun-hosted Oracle; DR
site is Watertown
TSMS200
Solaris 9
5.2.4.5
0.2
0
0
0
0
0
0
TSMS201
Solaris 9
5.2.4.5
50
290
24,500
1,844
2,863
0
0
TSMS202
Solaris 9
Total Workload
October 30, 2008
5.2.4.5
28.3
47
114.5
614
25,900
5,786
21,191
65,600 11,877 31,009
EMC Forum NYC – Brocade
0
12
0
12
Comments on Peak
workloads
TSM Library Manager
(LM)
TSM LM
12
12
-
50
1836
6188
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
4609
10542
6
Windows clients primarily
6
Datawarehouse backups
LAN-free by two nodes
total 20+ TB on weekend,
and log archives on
weekdays + Exchange +
Fileservers copypool on
weekend 12+hours
17
EMC DL4100 with CX3-80 CLARiiON Disk Storage
CVS Rx Connect TSM Client Data Profile
TSM Processing Windows
NO Compression
Amount of
Type of TSM client Data
Client Data
(GB)
Backup
Methodology
Daily
Change
rate
(%)
Weekday
Workload
(GB)
Weekend
Workload
(GB)
Weekday
Backup
Window
(hours)
Weekend
Backup
Window
(hours)
Weekday
throughput
Requirements
(GB/hr)
Weekend
throughput
Requirements
(GB/hr)
1,936
19,358
12
12
161
1,613
283
283
12
12
24
24
2,219
19,641
185
1,637
DB
19,358
Daily
Incrementals
10%
and
Weekly Fulls
FS
5,661
Incremental
Forever
Total
October 30, 2008
5%
EMC Forum NYC – Brocade
WITH Compression
DL4100
throughput
(MB/sec)
DL4100
throughput
(GB/hr)
DL4100
throughput
(MB/sec)
DL4100
throughput
(GB/hr)
1,100
3,867
300
1,055
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
18
TSM Server
Total Net Copy
Total Backup Total Backup Total Backup Total Archive Total Archive Total Archive Total
Copy Occupancy
Primary
(Copy)
(Copy) (Primary + Copy) (Primary)
(Primary + Copy) (Primary)
Occupancy Occupancy Occupancy Occupancy Occupancy Occupancy Occupancy Occupancy Deficit
(GB)
(GB)
(GB)
(GB)
(GB)
(GB)
(GB)
(GB)
(GB)
TSMS101
126,855
63,448
63,407
TSM102
89,542
45,157
TSMS201
115,692
TSMS202
318,396
Total TSM
Occupancy
October 30, 2008
63,458
63,417
41
44,384
45,157
44,384
773
59,899
55,793
59,899
55,793
4,106
159,404
158,992
161,168
160,757
412
327,908
EMC Forum NYC – Brocade
20
3,529
10
1,765
1,774
10
1,765
329,682 324,351 5,331
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
19
Amount of
Type of
client Data
TSM Client
Data
(GB)
Backup
Methodology
Expected usable
Expected usable
Backup
DL4100 Usable
DL Storage
DL Storage
Expected TSM
Retention Daily
(NO
DL
Reclamation Scratch
Number Number of
(WITH
(NO
Primary
(DAYS) Change
Compression)
Compression
Factor
Factor
of FULL INCREMENTAL
Compression)
Compression)
Occupancy
to meet PIT rate
Capacity
Factor
(%)
(%)
Backups Backups
(GB)
(%)
Restore
(GB)
(GB)
(GB)
requirements
DB
Daily
Incrementals
19,358
and
Weekly Fulls
14
10%
4
18
112,275
5%
0.2
141,466
2
70,733
FS
5,661
Incremental
Forever
45
5%
1
44
18,115
20%
0.2
26,086
2
13,043
Total
October 30, 2008
130,390
EMC Forum NYC – Brocade
167,552
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
83,776
20
170,000
% Growth in
Total number
Onsite (Primary)
of Copy
tape volumes as
(Offsite) tape
recorded by TRT
Volumes NOT
over a 12-month
in CDL
period
% Growth in
Average
Average Number Total Number of
Offsite (Copy) Number of Tape
of Tape volumes Tape volumes
tape volumes as volumes
recalled from shipped offsite
recorded by TRT shipped offsite
offsite Daily over over the last 30
over a 12-month Daily over the
days
the last 30 days
period not CDL last 30 days
% growth in
% growth in Tape
Tape volumes
volumes recalled
Total Number of
shipped offsite
from offsite on a
Tape volumes
on a daily basis
daily basis over
recalled from
over the last 12the last 12-months
offsite over the
months as
as recorded by
last 30 days
recorded by
TRT
TRT
TSM Server
Total Number of
Primary Physical
(Onsite) Tape
Volumes NOT in
CDL
TSMS101
86
11
293
-44
19
19
621
627
-85
19
TSMS102
128
44
196
82
12
11
390
358
-81
38
TSMS201
140
-82
340
-59
30
30
976
981
36
-32
TSMS202
76
-34
803
252
59
61
1,893
1,965
90
369
Totals
430
120
121
3,880
3,931
October 30, 2008
1,632
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
21
Total Total
TSM Tape Library Number of Number
Library Model frames of
Name Type including Available
"L" frame Slots
LIB2
IBM 3584
CDLA1
CDLB1
3
Total
Total
Total Number of
Number of Number of TSM
Scratch
Data Database
Cartridges Cartridges Backup
tapes
Total
Number of
Open
Slots
Number of each of the following types of tape drives in the
library
Average
Number of
Daily
PHYSICAL
Tape
% growth Mounts
in total over the
Total tape drives Last 30
LTO-1 LTO-2 LTO-3 Number of over 12- Days
tape drives months as
seen by
TRT
542
Total
Number of
PHYSICAL
Tape
Mounts
over the
Last 30
Days
Average
Number of
Daily
VIRTUAL
Tape
Mounts
over the
Last 30
Days
Total
Number of
VIRTUAL
Tape
Mounts
over the
Last 30
Days
1,071
431
600
68
40
24
24
0
17,368
DL710
4,096
62
568
0
3,466
48
48
0
571
18,273
DL710
4,096
81
554
0
3,461
48
48
0
562
18,010
1,133
36,283
% growth
Average
in Tape
Number of
Mounts on
Tapes
a daily
Checked
Basis over
OUT Daily
a 12-month
over the
period as
last 30
recored by
days
TRT
62
122
Total
Number of
Tapes
Checked
OUT over
the last 30
days
3,942
Average
Total Number
Total
Number of
of Tapes
Number of
Tapes
Checked IN
Tapes at
Checked IN
over the last
OFFSITE
Daily over the
30 days
VAULT
last 30 days
1,668
121
3,931
0
Totals
0
3
October 30, 2008
574
EMC Forum NYC – Brocade
542
17,368
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
3,931
22
SOLUTION DESIGN
Solution Design
y Oracle level HA and replication solutions for critical
database servers
y Disk based image copies/snaps for critical clients
y TSM and VTL integration
y Electronic vaulting between three (3) sites for TSM copy
pools for D/R
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
24
Case Study – Retail Company
p5
p5
p5
p5
p5
p5
p5
p5
October 30, 2008
EMC Forum NYC – Brocade
p5
p5
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
25
Case Study – Retail Company (before)
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
26
Case Study – Retail Company (after)
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
27
Implementation Details
y TSM3 has 3 TSM instances
– 1 Library Manager for CDLD, CDLE and WTDLA
– 2 production client data instances
y TSM4 has 3 TSM instances
– 1 Library Manager for CDLA, CDLB, CDLC, SGDLA, SGDLB
and LTO3
– 2 production client data instances
y Clients for old TSM environment (SUN Servers) to move to
new environment
y TSM3 instances to copy data to Site 2 EDL and to local
physical tape
y TSM4 instances to copy data to Sungard EDLs and to
local physical tape
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
28
Implementation Details
y CDL configuration
– CDLA/CDLB is CLD 740
– CDLC is a CLD 710
– All others are EDL 4100 with hardware compression cards
y All virtual libraries are IBM 3584 with LTO2 virtual drives
– Stability of emulation and Atape/IBMTape driver
y Distances:
– Site 1 to Site 2: 50 Miles
– Site 1 to Sungard: 200 Miles
y Data replication between site is performed with the TSM
storage pool backups
y All Brocade 7500 FCIP devices had compression, fastwrite and tape-pipelining enabled
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
29
Things to watch for
y Once a virtual library is created, the following parameters
cannot be changed:
• Drive emulation
• Amount of slots in the library
• Virtual volume barcode label range
– If changes of these are required, you need to delete and
create a new virtual library
y Bandwidth availability between data centers needs to be
confirmed in order to avoid SCSI errors when writing to the
remote EDLs
– Commit Rate can then be set to the value of the available
bandwidth
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
30
END RESULT
End Result
y Retail Company
– Robust, scalable and tapeless Backup/Recovery and
D/R infrastructure
– Data never leaves secure datacenter or customercontrolled network
– B/R and D/R costs reduced
y EMC and Brocade
– Continued trusted partner for retail company
What’s next: Remote site Backup/Recovery using
DL3D technologies
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
32
BROCADE PS – WHAT YOU MAY NOT KNOW…
Capabilities
Technologies
yStorage
yNetwork
ySecurity
yVirtualization
y SAN
y Messaging
y IP Routing
y SAN Security
y Server Consolidation
y NAS
y Database
y IP Switching
y Intrusion Detection
y Migration/Replication
y Internet Services
y Storage Networking
y Business
Continuance
y High Availability
y Wireless Mobility
y Policy
Management
y Physical-to-Virtual
migrations
y Enterprise Backup &
Recovery
y Network
Management
y Directory Services
y Disaster Recovery
y Hierarchical Storage
Management
y Compliance
Pre-Sales
October 30, 2008
y HPCC
Assess
y Virtual Tape Solutions
y Firewall Services
y Storage Virtualization
y Capacity Planning
y Site Mirroring
y Patch
Management
y Optimization
y Encryption
y Green Datacenter
y ROI Proof of Concept
y Vulnerability
Assessment
y Datacenter
Relocation
y ILM
Services
ySystems
Design
Install
Operate
Train
Commercial Clients
Federal Clients
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
34
Workshop
Assess
Design
Implement
Manage
Duration: One day on site
y Focused on a subset of your entire EBR environment (usually one
backup server)
y Brocade proprietary tools used for data collection and analysis:
– IBM/Tivoli TSM
– Veritas NetBackup
y Top-Gun, senior consultants are used
Activities:
y Collect data
y Interview administrators and management
y Analyze data and develop presentation
y End-of-day meeting
y Immediate insight into your problems
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
35
Workshop (continued)
Data collection mechanism:
y TSM: Same day, Excel VB-based tool using TSM ODBC, Brocade
laptop
y NBU: Script sent 1-2 weeks ahead of time. Backup admin runs on
master server and FTPs results to Brocade
Workshop goals:
y Tactical findings / recommendations
y Strategic recommendations
y Demonstrate Brocade expertise
y Next steps
Deliverable: End-of-day presentation
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
36
Health Check
Assess
Design
Implement
Manage
Duration: Typically 2-4 weeks
(duration and cost is a function of the size of the
environment)
y Similar to our workshop but more comprehensive
Activities:
y Same set of EBR environments as the workshop:
1.TSM – Very comprehensive and detailed
2.NBU – Very comprehensive and detailed
y Same set of Brocade proprietary data collection
tools are used. Additional Brocade tool (TRT) is
used during TSM health checks.
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
37
Health Check (continued)
Objectives:
y Comprehensive analysis of current workloads
y Identify key bottlenecks
y Data protection risk analysis (operational and
disaster recovery)
y Technical optimization recommendations
y Some design, architectural and design
recommendations
Deliverable: Comprehensive presentation
October 30, 2008
EMC Forum NYC – Brocade
© 2008 Brocade Communications Systems, Inc.
All Rights Reserved.
38
Q&A
THANK YOU