StoreOnce 6500 (88TB) System Capacity Expansion Guide Abstract This document explains how to install the StoreOnce 6500 System Capacity Expansion Kit, apply the new license, and add the new storage to the existing system. It is intended for system administrators familiar with the StoreOnce 6500 System. For the most recent user documentation, see the Hewlett Packard Enterprise Information Library website: www.hpe.com/info/storeonce/docs *BB897-90973* Part Number: BB897-90973 Published: June 2016 Edition: 6
Copyright 2013, 2016 Hewlett-Packard Enterprise Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein. Warranty WARRANTY STATEMENT: To obtain a copy of the warranty for this product, see the warranty information website: http://h20564.www2.hpe.com/hpsc/wc/public/home Links to third-party websites take you outside the HPE website. HPE has no control over and is not responsible for information outside of hpe.com. Printed in Revision History Revision 1 November 2013 This is the first edition, issued with the launch of the HPE StoreOnce Backup system. Revision 2 December 2013 This is the second edition, with updated licensing information and expansion timing considerations. (Only updated for web posting, January 2014.) Revision 3 December 2014 Note added to emphasize that warranty serial number is not the same as the serial number required for licensing. (Only updated for web posting, January 2015) Revision 4 March 2015 Fourth edition, contains details of new licensing website and extra troubleshooting information. Revision 5 August 2015 Fifth edition, small correction to repeat sequence numbering in instructions for installing drives. Revision 6 May 2016 Sixth edition, rebranding.
Contents 1 Capacity Expansion Overview...4 StoreOnce 6500 expansion options...4 Planning for the Capacity Expansion...4 Expansion process and time considerations...4 Rack warnings...5 Front view of the StoreOnce 6500 System...5 2 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion...7 StoreOnce 6500 disk bay locations...7 Distributing the drives correctly...7 Important Safety information...8 Installing the drives...9 3 Applying the license and completing the RAID expansion...13 Applying the license...13 Discovering and adding storage...13 4 Troubleshooting...16 Discover storage fails...16 Add storage fails...16 5 Support and other resources...17 Accessing Hewlett Packard Enterprise Support...17 Accessing updates...17 Remote Support...17 Product documentation...18 Contents 3
1 Capacity Expansion Overview StoreOnce 6500 expansion options Each StoreOnce 6500 System couplet consists of two nodes (head server units) that contain operating system disks only, and two disk enclosures, each with an initial 44 TB of pre-configured storage. Each disk enclosure is scalable from 15 to 140 disks. There are two options for expanding storage: BB899A: StoreOnce 6500 (88TB) Capacity Expansion The StoreOnce 6500 (88TB) Capacity Expansion kit is a pack of twenty-two 4TB disks, which are added to the original disk enclosures in the sequence described in this guide. A maximum of five of these kits may be used with each couplet until all disk bays are full in both disk enclosures. BB897A: StoreOnce 6500 120TB System Capacity Expansion Once all bays in all expansion shelves connected to a couplet are full, it may be possible to add a couplet to your StoreOnce 6500 System. However, this task is always performed by HPE service engineers and is not described in this guide. Contact Hewlett Packard Enterprise Support for more information. Planning for the Capacity Expansion Although the StoreOnce System remains available and the existing storage remains accessible during the expansion process, always schedule capacity expansion as a maintenance activity in a quiet period. Make sure that host users are aware of the expansion process and check to see how any scheduled jobs, such as replication and tape backup, may be affected by decreased performance. Expansion process and time considerations Storage discovery and parity initialization can take up to 10 hours to complete on an StoreOnce System with the maximum disk configuration. File system creation and storage addition can take up to 4 hours on an StoreOnce System with the maximum disk configuration. IMPORTANT: If you add storage before parity initialization completes, the amount of time required to complete parity initialization cannot be predicted because it depends upon the workload of the system. Be aware that it may take several days to complete. Scheduled jobs can still be run, but whilst parity initialization is running, performance may be impaired. 4 Capacity Expansion Overview
Rack warnings For detailed safety information, refer to the rack documentation and the Safety Guide provided with the product. WARNING! To reduce the risk of personal injury or damage to the equipment, be sure that: The leveling jacks are extended to the floor. The full weight of the rack rests on the leveling jacks. The stabilizing feet are attached to the rack if it is a single-rack installation. The racks are coupled together in multiple-rack installations. Only one component is extended at a time. A rack may become unstable if more than one component is extended for any reason. Front view of the StoreOnce 6500 System Figure 1 StoreOnce 6500 System, single couplet 1. Node 2 2. Node 1 5. 1U support shelf 6. Drawer 2 (right-hand side of enclosure) Rack warnings 5
3. Disk enclosure 2 4. Disk enclosure 1 7. Drawer 1 (left-hand side of enclosure) NOTE: Sufficient space, at least 12 inches (30 cm), is required to the right-hand side of the rack to ensure that there is enough clearance to maneuver the disks in and out of drawer 2. 6 Capacity Expansion Overview
2 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion Each couplet in the StoreOnce 6500 System is connected to a minimum of two disk enclosures. The initial installation populates each disk enclosure with 15 disks, as shown below. Table 1 Disk bays populated at installation Enclosure 1 Enclosure 2 Drawer 1 Drawer 2 Drawer 1 Drawer 2 Initial storage configuration Two spare hot disks in bays 34 and 35 and eleven disks in slots 23-33. Two spare hot disks in bays 34 and 35. Two spare hot disks in bays 34 and 35 and eleven disks in slots 23-33. Two spare hot disks in bays 34 and 35. StoreOnce 6500 disk bay locations The following drawing identifies disk bay locations within a drawer. Figure 2 Disk bay locations 1 8 15 22 29 2 9 16 23 30 3 10 17 24 31 4 11 18 25 32 5 12 19 26 33 6 13 20 27 34 7 14 21 28 35 NOTE: Disk bays 1 to 7 are at the front of the drawer. Distributing the drives correctly There are 22 disks in the Capacity Expansion kit, which are shared across two disk enclosures. Disks should be distributed equally across the two disk enclosures: 11 disks should always be installed in one disk enclosure and 11 disks in the other disk enclosure. Within each disk enclosure, disks are not distributed equally across the two drawers. Each set of 11 disks will be installed either in Drawer 1 or Drawer 2 of the disk enclosure. Each disk enclosure has a label that specifies the sequence in which each set of 11 disks must be installed. This sequence is mandatory for the product to function because the StoreOnce software expects the storage to be populated in this way. StoreOnce 6500 disk bay locations 7
Table 2 Populating disk bays Enclosure 1 Enclosure 2 Drawer 1 Drawer 2 Drawer 1 Drawer 2 + Expansion kit 1 slots 23-33 slots 23-33 + Expansion kit 2 slots 12-22 slots 12-22 + Expansion kit 3 slots 12-22 slots 12-22 + Expansion kit 4 slots 1-11 slots 1-11 + Expansion kit 5 slots 1-11 slots 1-11 Important Safety information CAUTION: Use extreme caution when installing and pulling units from the rack; they can slip and fall, causing damage to the HP StoreOnce Backup system or injury. HP is not responsible for any damage or injury caused by the mishandling of the HPE StoreOnce System. Refer to your rack documentation for detailed safety instructions about working with units within the rack and ensuring that the rack is stable. WARNING! To reduce the risk of personal injury or damage to the equipment, ensure that only one hard drive drawer is extended at a time. When adding hard drives to the hard drive drawer, observe the following general guidelines: When the drawer is opened, the cooling fans in the enclosure will run at full-speed. This is normal. Hard drives are sensitive to excessive vibration. Use care when opening and closing the drawer. Never leave the drawer open for any length of time. It should be opened only for maintenance and storage expansion. Verify that the drives are fully seated before closing the drawer. The drawer is fully closed when the fans slow down to their normal speed. The drawer should be closed with the handle in the released position. NOTE: Remember to close the handle after closing the drawer 8 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
Installing the drives Remember that you must install disks in both disk enclosures. 1. Use the StoreOnce System Graphical User Interface (GUI) to check what drives are already installed. There is a Storage Cluster entry in the Hardware tree for each couplet. Expand this entry to see the Disk Enclosures (2 per couplet). Remember to check the contents of both disk enclosures. To find out what disks are installed in drawer 1 of the first disk enclosure in couplet 1, expand the Hardware tree as follows: Hardware Storage Clusters Couplet 1 Storage Cluster 1 Drive Enclosures Sub Enclosure (Drawer 1) Drives A list of installed drives is displayed with their disk bay locations. In the following example only the base storage configuration for couplet 1 has been installed in Drawer 1. 2. Use the StoreOnce System GUI to check what drives are installed in drawer 2, expand the Hardware tree as follows: Hardware Storage Clusters Couplet 1 Storage Cluster 1 Drive Enclosures Sub Enclosure (Drawer 2) Drives A list of installed drives is displayed with their disk bay locations. In the following example only the base storage configuration has been installed in Drawer 2. Installing the drives 9
3. Having determined what disks are already installed, use the label on the disk enclosure to determine which drawer in the first disk enclosure should be populated with the first set of additional 11 disks. See Distributing the drives correctly (page 7). In our example, we have established that this is Expansion 1, so the additional disks will go into drawer 2. 4. Open the hard drive drawer for drawer 2. Pull the handle up (1) and out (2) to extend the drawer (3). Figure 3 Opening the disk drawer 10 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
5. Pinch the levers (1) and remove the hard drive blank (2). Figure 4 Removing the disk blank 6. Press the button (1) to release the carrier handle (2). Insert the hard drive (3) and close the carrier handle (4). Figure 5 Installing the drive Installing the drives 11
7. Repeat steps 5 and 6 until all eleven disks are installed. Close the hard drive drawer. You will hear it click into place when it is securely closed. The fans will return to normal speed when both drawers are properly closed. WARNING! Pinch hazard Keep hands out of front and rear of chassis when closing hard drive drawers. CAUTION: To prevent improper cooling and thermal damage, do not operate the disk enclosure for an extended period of time with the drawer open. CAUTION: To prevent improper cooling and thermal damage, do not operate the disk enclosure unless all bays are populated with either a component or a blank 8. Repeat steps 4 to 7 to install the second set of 11 disks in the second disk enclosure. This should be in the same sequence as you have just installed for the first disk enclosure. If required, you can check the disks as they are installed by using the StoreOnce User Interface: Hardware Storage Clusters Couplet 1 Storage Cluster 2 Drive Enclosures Sub Enclosure (Drawer 1) Drives and Hardware Storage Clusters Couplet 1 Storage Cluster 2 Drive Enclosures Sub Enclosure (Drawer 2) Drives 12 Installing the HPE StoreOnce 6500 (88TB) Capacity Expansion
3 Applying the license and completing the RAID expansion When all the disks from the Capacity Upgrade Kit have been installed in the StoreOnce disk enclosures, log on to the StoreOnce CLI as an Administrator to apply storage licenses and expand the storage configuration. For more information refer also to the HPE StoreOnce CLI Reference Guide. Applying the license 1. Access the StoreOnce CLI from an SSH terminal using an SSH client application (freely available on the internet) using any configured IP address for the appliance and provide an Administrator user name: ssh <username>@<ip address> At the next prompt, enter the Administrator's password. 2. If you have saved the license to use as a DAT file, check that it is stored within the licenses folder using the StoreOnce CLI command: system show licenses. Look for the <LTU>.dat file. 3. Apply the license using one of the following CLI commands: Use license load to add all licenses in the licenses directory. Or use license load <LTU>.dat to load a single license that has been saved as a file. The file must exist in the StoreOnce System's licenses directory. license add <string> to key in the license directly. If you used email or a temporary file, cut and paste the string as you obtained it from the HPE Licensing website. (Verify that the string contains only license keys and no descriptor text.) Entering the LTU manually is not advised. IMPORTANT: be transferred. The key is specific to the StoreOnce System to which it applies. It cannot 4. To ensure that the license has been applied successfully, run one of the following StoreOnce CLI commands: license show summary: to report the licensed capacity or license show all: Discovering and adding storage if you also wish to display full license keys Be sure to apply the licenses for all Capacity Upgrade Kits before running the expansion process. 1. Access the StoreOnce CLI from an SSH terminal using an SSH client application (freely available on the internet) using any configured IP address for the appliance and provide an Administrator user name: ssh <username>@<ip address> At the next prompt, enter the Administrator's password. 2. Check the status of the system and that the service set is running by sending the following command: system show status 3. To discover the newly attached storage and create a new Logical Unit (LUN) on this storage send the following command: hardware discover storage Applying the license 13
4. Monitor the status of the LUN creation process using the StoreOnce CLI command: hardware show storage status Look for the Formatted and Discovered information under Status. The following output is an example; the values shown may not match your appliance specific values. system show status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB Service Sets Status Notes ------------ ------ ----- Set 1 Running Set 2 Running hardware show storage status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB hardware discover storage This command takes several minutes to complete execution. storage discovery successfully completed hardware show storage status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB, Discovered 20,932.81GB to be added IMPORTANT: It is recommended that at this stage the user waits until Parity initialization is complete for all discovered enclosures before running the hardware add storage command. Doing so significantly reduces the overall time for parity initialization to complete. 5. Once the discovery process is complete, run the following command in order to format the storage LUN with file system segments: hardware add storage This command will expand the file system to use the storage. The process can take up to four hours to complete per file system on each couplet in the cluster and the new capacity will not be available until it is finished. IMPORTANT: If you run the hardware add storage command before the LUN creation process completes, the amount of time required to complete parity initialization cannot be predicted because it depends upon the workload of the system. It may take several days to complete and performance will be impaired. 6. Monitor the expansion using the following command: hardware show status and hardware show storage status The following output is an example; the values shown may not match your appliance specific values. hardware show status Name Dev id Status ---- ---- - -- ---- ---- ---- - ------ ---- -- 14 Applying the license and completing the RAID expansion
hp9d6719fb08 1 31343337 3338 5A43 3233 323330314D38 OK hp9d6719fb08 2 31343337 3338 5A43 3233 323330314D37 OK p1228 Storage System 041f40d4 0000 1000 b00c-533455303039 DEGRADED p1228 Storage System 0442094b 0000 1000 b00c-533455303032 DEGRADED HP 5920AF-24XG Switch switch1 OK HP 5920AF-24XG Switch switch2 OK hardware show storage status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB, Discovered 74,269.15GB to be added hardware add storage This command takes several hours to complete execution storage addition successfully started hardware show storage status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB, Adding 74,269.15GB... system show status Storage Set Status ---- ---- --- ---- Service Sets 1, 2 Formatted 69,753.98GB, Adding 74,269.15GB... Service Sets Status Notes ------------ ------ ----- Set 1 Running Set 2 Running 7. Once the storage is available, performance will return to normal as long as parity initialization was allowed to complete before the hardware add storage command was run. Discovering and adding storage 15
4 Troubleshooting Discover storage fails The hardware discover storage command will fail if: A previous discover storage command is already running. There is no storage to be added. There are insufficient expansion licenses applied to allow the entire expansion to complete (in this case, no expansion will take place until sufficient licenses are present for all added storage). The storage is installed in the wrong disk bay locations for this expansion set. There are any failed or predictive fail disks in either the existing or newly added storage. The SAS cabling to the disk enclosures is incorrect. There are foreign logical drives or volumes already present on the attached storage. These are identified as an unsupported or invalid storage configuration and the dev-id of the volume is provided in the error message. It is necessary to delete the storage, as shown in the following example: Add storage fails hardware discover storage This command takes several minutes to complete execution. Error - Couplet 1: Node 1: Unable to provision command. Unsupported/Invalid volume(s) found, Details: Volume vol003 62D48FB30D000010B026533657303552 is INVALID. hardware delete storage node1 62D48FB30D000010B026533657303552 Warning - Data may be destroyed. Are you sture you want to delete storage? [yes / no]: yes Warning - Are you sure you want to continue? [yes / no]: yes This command takes several minutes to complete execution. Command Successful The hardware add storage command will fail if: There is an outstanding discover or add command in progress. Any of the error conditions described above for the hardware discover storage command have not been rectified. 16 Troubleshooting
5 Support and other resources Accessing Hewlett Packard Enterprise Support For live assistance, go to the Contact Hewlett Packard Enterprise Worldwide website: www.hpe.com/assistance To access documentation and support services, go to the Hewlett Packard Enterprise Support Center website: www.hpe.com/support/hpesc Information to collect Technical support registration number (if applicable) Product name, model or version, and serial number Operating system name and version Firmware version Error messages Product-specific reports and logs Add-on products or components Third-party products or components Accessing updates Some software products provide a mechanism for accessing software updates through the product interface. Review your product documentation to identify the recommended software update method. To download product updates, go to either of the following: Hewlett Packard Enterprise Support Center Get connected with updates page: www.hpe.com/support/e-updates Software Depot website: www.hpe.com/support/softwaredepot To view and update your entitlements, and to link your contracts and warranties with your profile, go to the Hewlett Packard Enterprise Support Center More Information on Access to Support Materials page: Remote Support www.hpe.com/support/accesstosupportmaterials IMPORTANT: Access to some updates might require product entitlement when accessed through the Hewlett Packard Enterprise Support Center. You must have an HP Passport set up with relevant entitlements. Remote support is available with supported devices as part of your warranty or contractual support agreement. It provides intelligent event diagnosis, and automatic, secure submission of hardware event notifications to Hewlett Packard Enterprise, which will initiate a faster and more accurate resolution of any issues based on the service level for your product. Hewlett Packard Enterprise strongly recommends that you register your device for remote support. Accessing Hewlett Packard Enterprise Support 17
The preferred HPE Remote Support solution for StoreOnce products is Service Tools and Technical Support (STaTS), however Insight Remote Support is also available. Service Tools and Technical Support (STaTS): HPE Remote Support monitors StoreOnce appliances and allows the appliance to contact Hewlett Packard Enterprise proactively if issues arise on the system. Site-specific data is used both proactively and reactively with real-time monitoring and information extraction tools. For information on Remote Support via STaTS, go to the following website: http:// www.hpe.com/partners/storeonceremote StoreFrontRemote Manager: StoreFrontRemote Manager is a reporting tool, where customers are able to track their specific systems, showing additional reporting and analysis. Registration is simple and can allow customers to view parametric information collected about the configuration and performance of their products. Insight RS: For information and device support details for Insight RS, go to the following website: http://www.hpe.com/info/insightremotesupport/docs Product documentation For the most recent user documentation, see the Hewlett Packard Enterprise Information Library website: www.hpe.com/info/storeonce/docs Select StoreOnce System and then select your specific model. 18 Support and other resources