StoreOnce 6500 (88TB) System
Capacity Expansion Guide
Abstract
This document explains how to install the StoreOnce 6500 System Capacity Expansion Kit, apply the new license, and
add the new storage to the existing system. It is intended for system administrators familiar with the StoreOnce 6500
System.
For the most recent user documentation, see the Hewlett Packard Enterprise Information Library website:
www.hpe.com/info/storeonce/docs
*BB897-90973*
Part Number: BB897-90973
Published: June 2016
Edition: 6
© Copyright 2013, 2016 Hewlett-Packard Enterprise Development Company, L.P.
The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services
are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting
an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein.
Warranty
WARRANTY STATEMENT: To obtain a copy of the warranty for this product, see the warranty information website:
http://h20564.www2.hpe.com/hpsc/wc/public/home
Links to third-party websites take you outside the HPE website. HPE has no control over and is not responsible for information outside of hpe.com.
Printed in
Revision History
Revision 1
November 2013
This is the first edition, issued with the launch of the HPE StoreOnce Backup system.
Revision 2
December 2013
This is the second edition, with updated licensing information and expansion timing considerations. (Only updated for web posting, January 2014.)
Revision 3
December 2014
Note added to emphasize that warranty serial number is not the same as the serial number required for licensing. (Only updated for web posting,
January 2015)
Revision 4
March 2015
Fourth edition, contains details of new licensing website and extra troubleshooting information.
Revision 5
August 2015
Fifth edition, small correction to repeat sequence numbering in instructions for installing drives.
Revision 6
Sixth edition, rebranding .
May 2016
Contents
1 Capacity Expansion Overview.............................................................................4
StoreOnce 6500 expansion options......................................................................................................4
Planning for the Capacity Expansion....................................................................................................4
Expansion process and time considerations...................................................................................4
Rack warnings......................................................................................................................................5
Front view of the StoreOnce 6500 System...........................................................................................5
2 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion .......................7
StoreOnce 6500 disk bay locations......................................................................................................7
Distributing the drives correctly.............................................................................................................7
Important Safety information.................................................................................................................8
Installing the drives...............................................................................................................................9
3 Applying the license and completing the RAID expansion................................13
Applying the license............................................................................................................................13
Discovering and adding storage.........................................................................................................13
4 Troubleshooting.................................................................................................16
Discover storage fails.........................................................................................................................16
Add storage fails.................................................................................................................................16
5 Support and other resources.............................................................................17
Accessing Hewlett Packard Enterprise Support.................................................................................17
Accessing updates..............................................................................................................................17
Remote Support .................................................................................................................................17
Product documentation.......................................................................................................................18
Contents
3
1 Capacity Expansion Overview
StoreOnce 6500 expansion options
Each StoreOnce 6500 System couplet consists of two nodes (head server units) that contain
operating system disks only, and two disk enclosures, each with an initial 44 TB of pre-configured
storage. Each disk enclosure is scalable from 15 to 140 disks.
There are two options for expanding storage:
•
BB899A: StoreOnce 6500 (88TB) Capacity Expansion
The StoreOnce 6500 (88TB) Capacity Expansion kit is a pack of twenty-two 4TB disks, which
are added to the original disk enclosures in the sequence described in this guide. A maximum
of five of these kits may be used with each couplet until all disk bays are full in both disk
enclosures.
•
BB897A: StoreOnce 6500 120TB System Capacity Expansion
Once all bays in all expansion shelves connected to a couplet are full, it may be possible to
add a couplet to your StoreOnce 6500 System. However, this task is always performed by
HPE service engineers and is not described in this guide. Contact Hewlett Packard Enterprise
Support for more information.
Planning for the Capacity Expansion
Although the StoreOnce System remains available and the existing storage remains accessible
during the expansion process, always schedule capacity expansion as a maintenance activity
in a quiet period. Make sure that host users are aware of the expansion process and check to
see how any scheduled jobs, such as replication and tape backup, may be affected by decreased
performance.
Expansion process and time considerations
•
Storage discovery and parity initialization can take up to 10 hours to complete on an
StoreOnce System with the maximum disk configuration.
•
File system creation and storage addition can take up to 4 hours on an StoreOnce System
with the maximum disk configuration.
IMPORTANT: If you add storage before parity initialization completes, the amount of time
required to complete parity initialization cannot be predicted because it depends upon the workload
of the system. Be aware that it may take several days to complete. Scheduled jobs can still be
run, but whilst parity initialization is running, performance may be impaired.
4
Capacity Expansion Overview
Rack warnings
For detailed safety information, refer to the rack documentation and the Safety Guide provided
with the product.
WARNING!
To reduce the risk of personal injury or damage to the equipment, be sure that:
•
The leveling jacks are extended to the floor.
•
The full weight of the rack rests on the leveling jacks.
•
The stabilizing feet are attached to the rack if it is a single-rack installation.
•
The racks are coupled together in multiple-rack installations.
•
Only one component is extended at a time. A rack may become unstable if more than one
component is extended for any reason.
Front view of the StoreOnce 6500 System
Figure 1 StoreOnce 6500 System, single couplet
1. Node 2
5. 1U support shelf
2. Node 1
6. Drawer 2 (right-hand side of enclosure)
Rack warnings
5
3. Disk enclosure 2
7. Drawer 1 (left-hand side of enclosure)
4. Disk enclosure 1
NOTE: Sufficient space, at least 12 inches (30 cm), is required to the right-hand side of the
rack to ensure that there is enough clearance to maneuver the disks in and out of drawer 2.
6
Capacity Expansion Overview
2 Installing the HPE StoreOnce 6500 (88TB) Capacity
Expansion
Each couplet in the StoreOnce 6500 System is connected to a minimum of two disk enclosures.
The initial installation populates each disk enclosure with 15 disks, as shown below.
Table 1 Disk bays populated at installation
Enclosure 1
Drawer 1
Initial storage
configuration
Enclosure 2
Drawer 2
Drawer 1
Two spare hot disks Two spare hot disks
in bays 34 and 35 and in bays 34 and 35.
eleven disks in slots
23-33.
Drawer 2
Two spare hot disks Two spare hot disks
in bays 34 and 35 and in bays 34 and 35.
eleven disks in slots
23-33.
StoreOnce 6500 disk bay locations
The following drawing identifies disk bay locations within a drawer.
Figure 2 Disk bay locations
NOTE:
1
8
15
22
29
2
9
16
23
30
3
10
17
24
31
4
11
18
25
32
5
12
19
26
33
6
13
20
27
34
7
14
21
28
35
Disk bays 1 to 7 are at the front of the drawer.
Distributing the drives correctly
There are 22 disks in the Capacity Expansion kit, which are shared across two disk enclosures.
•
Disks should be distributed equally across the two disk enclosures: 11 disks should always
be installed in one disk enclosure and 11 disks in the other disk enclosure.
•
Within each disk enclosure, disks are not distributed equally across the two drawers. Each
set of 11 disks will be installed either in Drawer 1 or Drawer 2 of the disk enclosure.
•
Each disk enclosure has a label that specifies the sequence in which each set of 11 disks
must be installed. This sequence is mandatory for the product to function because the
StoreOnce software expects the storage to be populated in this way.
StoreOnce 6500 disk bay locations
7
Table 2 Populating disk bays
Enclosure 1
Enclosure 2
Drawer 1
Drawer 2
Drawer 1
Drawer 2
+ Expansion kit 1
Do not change
Add eleven disks to
slots 23-33
Do not change
Add eleven disks to
slots 23-33
+ Expansion kit 2
Add eleven disks to
slots 12-22
Do not change
Add eleven disks to
slots 12-22
Do not change
+ Expansion kit 3
Do not change
Add eleven disks to
slots 12-22
Do not change
Add eleven disks to
slots 12-22
+ Expansion kit 4
Add eleven disks to
slots 1-11
Do not change
Add eleven disks to
slots 1-11
Do not change
+ Expansion kit 5
Do not change
Add eleven disks to
slots 1-11
Do not change
Add eleven disks to
slots 1-11
Important Safety information
CAUTION: Use extreme caution when installing and pulling units from the rack; they can slip
and fall, causing damage to the HP StoreOnce Backup system or injury. HP is not responsible
for any damage or injury caused by the mishandling of the HPE StoreOnce System.
Refer to your rack documentation for detailed safety instructions about working with units within
the rack and ensuring that the rack is stable.
WARNING! To reduce the risk of personal injury or damage to the equipment, ensure that
only one hard drive drawer is extended at a time.
When adding hard drives to the hard drive drawer, observe the following general guidelines:
•
When the drawer is opened, the cooling fans in the enclosure will run at full-speed. This is
normal.
•
Hard drives are sensitive to excessive vibration. Use care when opening and closing the
drawer.
•
Never leave the drawer open for any length of time. It should be opened only for maintenance
and storage expansion.
•
Verify that the drives are fully seated before closing the drawer.
•
The drawer is fully closed when the fans slow down to their normal speed.
•
The drawer should be closed with the handle in the released position.
NOTE:
8
Remember to close the handle after closing the drawer
Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
Installing the drives
Remember that you must install disks in both disk enclosures.
1. Use the StoreOnce System Graphical User Interface (GUI) to check what drives are already
installed. There is a Storage Cluster entry in the Hardware tree for each couplet. Expand
this entry to see the Disk Enclosures (2 per couplet). Remember to check the contents of
both disk enclosures.
To find out what disks are installed in drawer 1 of the first disk enclosure in couplet 1, expand
the Hardware tree as follows:
Hardware — Storage Clusters — Couplet 1 Storage Cluster 1 — Drive Enclosures —
Sub Enclosure (Drawer 1) — Drives
A list of installed drives is displayed with their disk bay locations. In the following example
only the base storage configuration for couplet 1 has been installed in Drawer 1.
2.
Use the StoreOnce System GUI to check what drives are installed in drawer 2, expand the
Hardware tree as follows:
Hardware — Storage Clusters — Couplet 1 Storage Cluster 1 — Drive Enclosures —
Sub Enclosure (Drawer 2) — Drives
A list of installed drives is displayed with their disk bay locations. In the following example
only the base storage configuration has been installed in Drawer 2.
Installing the drives
9
3.
4.
Having determined what disks are already installed, use the label on the disk enclosure to
determine which drawer in the first disk enclosure should be populated with the first set of
additional 11 disks. See Distributing the drives correctly (page 7). In our example, we have
established that this is Expansion #1, so the additional disks will go into drawer 2.
Open the hard drive drawer for drawer 2. Pull the handle up (1) and out (2) to extend the
drawer (3).
Figure 3 Opening the disk drawer
10
Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
5.
Pinch the levers (1) and remove the hard drive blank (2).
Figure 4 Removing the disk blank
6.
Press the button (1) to release the carrier handle (2). Insert the hard drive (3) and close the
carrier handle (4).
Figure 5 Installing the drive
Installing the drives
11
7.
Repeat steps 5 and 6 until all eleven disks are installed. Close the hard drive drawer. You
will hear it click into place when it is securely closed. The fans will return to normal speed
when both drawers are properly closed.
WARNING! Pinch hazard—Keep hands out of front and rear of chassis when closing hard
drive drawers.
CAUTION: To prevent improper cooling and thermal damage, do not operate the disk
enclosure for an extended period of time with the drawer open.
CAUTION: To prevent improper cooling and thermal damage, do not operate the disk
enclosure unless all bays are populated with either a component or a blank
8.
Repeat steps 4 to 7 to install the second set of 11 disks in the second disk enclosure. This
should be in the same sequence as you have just installed for the first disk enclosure.
If required, you can check the disks as they are installed by using the StoreOnce User
Interface:
Hardware — Storage Clusters — Couplet 1 Storage Cluster 2 — Drive Enclosures —
Sub Enclosure (Drawer 1) — Drives
and Hardware — Storage Clusters — Couplet 1 Storage Cluster 2 — Drive Enclosures
— Sub Enclosure (Drawer 2) — Drives
12
Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
3 Applying the license and completing the RAID expansion
When all the disks from the Capacity Upgrade Kit have been installed in the StoreOnce disk
enclosures, log on to the StoreOnce CLI as an Administrator to apply storage licenses and expand
the storage configuration. For more information refer also to the HPE StoreOnce CLI Reference
Guide.
Applying the license
1.
Access the StoreOnce CLI from an SSH terminal using an SSH client application (freely
available on the internet) using any configured IP address for the appliance and provide an
Administrator user name:
ssh <username>@<IP address>
At the next prompt, enter the Administrator's password.
2.
If you have saved the license to use as a DAT file, check that it is stored within the licenses
folder using the StoreOnce CLI command: system show licenses.
Look for the <LTU>.dat file.
3.
Apply the license using one of the following CLI commands:
•
Use license load to add all licenses in the licenses directory.
Or use license load <LTU>.dat to load a single license that has been saved as
a file. The file must exist in the StoreOnce System's licenses directory.
•
license add <string> to key in the license directly. If you used email or a temporary
file, cut and paste the string as you obtained it from the HPE Licensing website. (Verify
that the string contains only license keys and no descriptor text.) Entering the LTU
manually is not advised.
IMPORTANT: The key is specific to the StoreOnce System to which it applies. It cannot
be transferred.
4.
To ensure that the license has been applied successfully, run one of the following StoreOnce
CLI commands:
license show summary: to report the licensed capacity or
license show all: if you also wish to display full license keys
Discovering and adding storage
Be sure to apply the licenses for all Capacity Upgrade Kits before running the expansion process.
1. Access the StoreOnce CLI from an SSH terminal using an SSH client application (freely
available on the internet) using any configured IP address for the appliance and provide an
Administrator user name:
ssh <username>@<IP address>
At the next prompt, enter the Administrator's password.
2.
Check the status of the system and that the service set is running by sending the following
command:
system show status
3.
To discover the newly attached storage and create a new Logical Unit (LUN) on this storage
send the following command:
hardware discover storage
Applying the license
13
4.
Monitor the status of the LUN creation process using the StoreOnce CLI command:
hardware show storage status
Look for the Formatted and Discovered information under Status.
The following output is an example; the values shown may not match your appliance specific
values.
# system show status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB
Service Sets Status Notes
------------ ------ ----Set 1
Running
Set 2
Running
#
#
# hardware show storage status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB
#
#
# hardware discover storage
This command takes several minutes to complete execution.
storage discovery successfully completed
#
#
# hardware show storage status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB, Discovered 20,932.81GB to be added
#
IMPORTANT: It is recommended that at this stage the user waits until Parity initialization
is complete for all discovered enclosures before running the hardware add storage
command. Doing so significantly reduces the overall time for parity initialization to complete.
5.
Once the discovery process is complete, run the following command in order to format the
storage LUN with file system segments:
hardware add storage
This command will expand the file system to use the storage. The process can take up to
four hours to complete per file system on each couplet in the cluster and the new capacity
will not be available until it is finished.
IMPORTANT: If you run the hardware add storage command before the LUN creation
process completes, the amount of time required to complete parity initialization cannot be
predicted because it depends upon the workload of the system. It may take several days to
complete and performance will be impaired.
6.
Monitor the expansion using the following command:
hardware show status and hardware show storage status
The following output is an example; the values shown may not match your appliance specific
values.
# hardware show status
Name
—----—----–—–-–—––--
14
Dev—id
Status
----–----—----–—–-–—––------—----–—
Applying the license and completing the RAID expansion
–—––--–
hp9d6719fb08–1
hp9d6719fb08–2
p1228 Storage System
p1228 Storage System
HP 5920AF-24XG Switch
HP 5920AF-24XG Switch
31343337–3338–5A43–3233–323330314D38
31343337–3338–5A43–3233–323330314D37
041f40d4–0000–1000–b00c-533455303039
0442094b–0000–1000–b00c-533455303032
switch1
switch2
OK
OK
DEGRADED
DEGRADED
OK
OK
#
# hardware show storage status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB, Discovered 74,269.15GB to be added
#
#hardware add storage
This command takes several hours to complete execution
storage addition successfully started
#
# hardware show storage status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB, Adding 74,269.15GB...
#
# system show status
Storage Set
Status
—----—----–—------––
Service Sets 1, 2 Formatted 69,753.98GB, Adding 74,269.15GB...
Service Sets
-----------Set 1
Set 2
Status Notes
------ ----Running
Running
#
7.
Once the storage is available, performance will return to normal as long as parity initialization
was allowed to complete before the hardware add storage command was run.
Discovering and adding storage
15
4 Troubleshooting
Discover storage fails
The hardware discover storage command will fail if:
•
A previous discover storage command is already running.
•
There is no storage to be added.
•
There are insufficient expansion licenses applied to allow the entire expansion to complete
(in this case, no expansion will take place until sufficient licenses are present for all added
storage).
•
The storage is installed in the wrong disk bay locations for this expansion set.
•
There are any failed or predictive fail disks in either the existing or newly added storage.
•
The SAS cabling to the disk enclosures is incorrect.
•
There are foreign logical drives or volumes already present on the attached storage. These
are identified as an unsupported or invalid storage configuration and the dev-id of the
volume is provided in the error message. It is necessary to delete the storage, as shown in
the following example:
# hardware discover storage
This command takes several minutes to complete execution.
Error - Couplet 1: Node 1: Unable to provision command. Unsupported/Invalid
volume(s) found, Details: Volume vol003 62D48FB30D000010B026533657303552 is
INVALID.
# hardware delete storage node1 62D48FB30D000010B026533657303552
Warning - Data may be destroyed. Are you sture you want to delete
storage? [yes / no]: yes
Warning - Are you sure you want to continue? [yes / no]: yes
This command takes several minutes to complete execution.
Command Successful
Add storage fails
The hardware add storage command will fail if:
16
•
There is an outstanding discover or add command in progress.
•
Any of the error conditions described above for the hardware discover storage
command have not been rectified.
Troubleshooting
5 Support and other resources
Accessing Hewlett Packard Enterprise Support
•
For live assistance, go to the Contact Hewlett Packard Enterprise Worldwide website:
www.hpe.com/assistance
•
To access documentation and support services, go to the Hewlett Packard Enterprise Support
Center website:
www.hpe.com/support/hpesc
Information to collect
•
Technical support registration number (if applicable)
•
Product name, model or version, and serial number
•
Operating system name and version
•
Firmware version
•
Error messages
•
Product-specific reports and logs
•
Add-on products or components
•
Third-party products or components
Accessing updates
•
Some software products provide a mechanism for accessing software updates through the
product interface. Review your product documentation to identify the recommended software
update method.
•
To download product updates, go to either of the following:
◦
Hewlett Packard Enterprise Support Center Get connected with updates page:
www.hpe.com/support/e-updates
◦
Software Depot website:
www.hpe.com/support/softwaredepot
•
To view and update your entitlements, and to link your contracts and warranties with your
profile, go to the Hewlett Packard Enterprise Support Center More Information on Access
to Support Materials page:
www.hpe.com/support/AccessToSupportMaterials
IMPORTANT: Access to some updates might require product entitlement when accessed
through the Hewlett Packard Enterprise Support Center. You must have an HP Passport
set up with relevant entitlements.
Remote Support
Remote support is available with supported devices as part of your warranty or contractual support
agreement. It provides intelligent event diagnosis, and automatic, secure submission of hardware
event notifications to Hewlett Packard Enterprise, which will initiate a faster and more accurate
resolution of any issues based on the service level for your product. Hewlett Packard Enterprise
strongly recommends that you register your device for remote support.
Accessing Hewlett Packard Enterprise Support
17
The preferred HPE Remote Support solution for StoreOnce products is Service Tools and
Technical Support (STaTS), however Insight Remote Support is also available.
•
Service Tools and Technical Support (STaTS): HPE Remote Support monitors StoreOnce
appliances and allows the appliance to contact Hewlett Packard Enterprise proactively if
issues arise on the system. Site-specific data is used both proactively and reactively with
real-time monitoring and information extraction tools.
For information on Remote Support via STaTS, go to the following website: http://
www.hpe.com/partners/StoreOnceRemote
•
StoreFrontRemote Manager: StoreFrontRemote Manager is a reporting tool, where
customers are able to track their specific systems, showing additional reporting and analysis.
Registration is simple and can allow customers to view parametric information collected
about the configuration and performance of their products.
•
Insight RS: For information and device support details for Insight RS, go to the following
website:
http://www.hpe.com/info/insightremotesupport/docs
Product documentation
For the most recent user documentation, see the Hewlett Packard Enterprise Information Library
website:
www.hpe.com/info/storeonce/docs
Select StoreOnce System and then select your specific model.
18
Support and other resources