IBM System Storage EXN3000 Storage Expansion Unit Installation and Setup Instructions G52-1345-03
Notices Mail comments to: IBM orporation Attention epartment GZW 9000 South Rita Road Tucson, AZ 85744-0001 www.ibm.com/storage/sup/nseries/ References in this publication to IBM products or services do not imply that IBM intends to make them available in every country or region. IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines orporation in the United States, other countries, or both. A complete and current list of other IBM trademarks is available on the web at.www.ibm.com/legal/copytrade.shtml ata ONTAP, NetApp, and Network Appliance are trademarks and/or registered trademarks of NetApp, Inc in the United States and other countries. Other company, product, and service names may be trademarks or service marks of others. opyright IBM orporation 2009, 2012. US Government Users Restricted Rights Use, duplication or disclosure restricted by GSA AP Schedule ontract with IBM orp.
ontents Before you begin................................ v Overview of the EXN3000 storage expansion unit....................... vi Installation and setup instructions........................ 1 Unpacking the EXN3000............................... 1 Installing the rails in an IBM 19-inch rack......................... 1 Installing the EXN3000 in the rack............................ 4 onnecting power to the EXN3000............................ 5 F/SAS bridge for stretch or fabric-attached Metroluster systems................. 5 Setting the storage expansion unit Is......................... 6 abling the EXN3000................................ 6 Alternate ontrol Path (AP) capability......................... 7 abling a single-controller NAS or issi configuration.................... 7 abling a high availability NAS or issi configuration.................... 10 abling a fabric-attached Metroluster configuration.................... 12 Booting the system................................. 12 opyright IBM orp. 2009, 2012 iii
iv
Before you begin This document provides installation and setup instructions for the IBM System Storage EXN3000 storage expansion unit, sometimes referred to as a in this and other documents. Additional information about the EXN3000, including a comparison between the EXN3000 and other N series storage expansion units, can be found in the IBM System Storage EXN3000 Storage Expansion Unit Hardware and Service Guide. etailed SAS and Alternate ontrol Path (AP) cabling information can be found in the IBM System Storage N series Universal SAS and AP abling Guide. For additional information about the EXN3000 and related topics, refer to the following resources. v IBM System Storage N series Introduction and Planning Guide v IBM Environmental Notices and User Guide v IBM System Storage N series sup website at www.ibm.com/storage/sup/nseries/ Read the safety notices Before continuing, make sure that you have reviewed the safety notices in the documentation that came with this system. o not plug any cables into the system, adapters, or any electrical outlets until you have reviewed the safety information and followed the procedures in this document. Need help? If you encounter any difficulties while setting up your system, contact IBM service and sup for assistance. More information can also be found on the IBM System Storage N series sup website: www.ibm.com/storage/sup/nseries/ About the IBM N series sup website The IBM System Storage N series sup website requires users to register in order to obtain access to N series sup content on the web. To understand how the N series sup web content is organized and navigated, and to access the N series sup website, go to the following publicly accessible web page: www.ibm.com/storage/sup/nseries/ This web page also provides links to AutoSup information as well as other imant N series product resources. Software requirements Your storage system must meet the following software requirements: v ata ONTAP 7.x releases: ata ONTAP 7.3.6 or a later version of the 7.x release family N3400 and N3600 storage systems can use ata ONTAP 7.3.4 or a later version of the 7.x release family. v ata ONTAP 8.x releases: ata ONTAP 8.0.2P3 or a later version of the 8.x release family N3400 storage systems can use ata ONTAP 8.0.2 or a later version of the 8.x release family. opyright IBM orp. 2009, 2012 v
ustomer-supplied items for installation v #2 Phillips screwdriver v Flat-bladed screwdriver v Antistatic electrostatic discharge (ES) wrist strap and grounding leash Hot-adding EXN3000s You can hot-add an EXN3000 in the following cases: v irectly to a controller in any suped storage system with an existing SAS HBA or onboard SAS. v epending on your configuration, you can mix different storage expansion unit models in the same stack. Note: Mixing IOM3 and IOM6 in the same storage expansion unit is not suped. For more information about hot-adding EXN3000s, see the IBM System Storage N series EXN3000 Hardware and Service Guide. Overview of the EXN3000 storage expansion unit Refer to the following figures to familiarize yourself with the EXN3000 storage expansion unit. 1 2 3 4 exn300001 Figure 1. Front view with bezel 1 Shelf power LE 3 Shelf activity LE 2 Shelf fault LE 4 Two-digit I digital display vi
LNK LNK LNK LNK 1 2 3 4 rive Bays 0-3 4-7 8-11 12-15 16-19 20-23 exn300002 Figure 2. Front view without bezel 1 Operation panel 3 Tab for changing the I 2 Left mounting tab 4 Right mounting tab Note: isk drive bays are numbered horizontally starting from 0 at the upper left position to 23 at the lower right position. 1 2 3 4 5 6 7 8 IOM3 IOM3 IOM3 IOM3 exn300003 9 10 11 SLOT MAP PSU 1 PSU 3 SBB A Slot A SBB B Slot B PSU 2 PSU 4 Figure 3. Rear view 1 A fault LE 7 AP s Before you begin vii
2 Fan fault LE 8 SAS s 3 Power LE 9 I/O blanks 4 fault LE 10 I/O modules 5 Power supplies (each with two integrated fans) 11 Slot map label 6 IOM fault LE Notes: v isk shelves with two power supplies occupy the power supply unit (PSU1 and PSU4) locations as shown on the slot map label 11 in Figure 3 on page vii. v The AP and SAS s on the Input/Output Modules are designated as circle and square s (not In and Out s). viii
Installation and setup instructions Use these instructions to install and set up your EXN3000 storage expansion unit. Unpacking the EXN3000 Use these instructions to unpack the EXN3000. Imant: If your system was shipped already assembled and cabled in a rack, go directly to the Installation and Setup Instructions for your N series storage system. Note: The contents of the box might differ based on the model you purchased. 1. Verify that the EXN3000 (2857-003) shipping packages include the following items: v 1 EXN3000 storage expansion unit v 1 IBM rail kit v 1 electrostatic discharge (ES) wrist strap v 1 set of publications v 2 or 4 power cords (2 power cords ship with SATA H models; 4 power cords ship with SAS H models) v Miscellaneous data cables, as ordered AUTION: Use safe practices when lifting. AUTION 110 lbs (49.9 kg) LIFTING HAZAR To reduce the weight of the disk, remove the power supplies and IOMs before lifting. exn32006 AUTION: A fully populated EXN3000 weighs 49.9 kg (110 lbs). Use three people to lift an EXN3000 into a rack. To make the unit lighter and easier to move, remove the power supplies and Input/Output Modules (IOMs), noting the location of each component for reinstallation. o not remove the disk drives or drive blank covers to reduce the weight. After the unit is installed in the rack, reinsert the power supplies and IOMs. 2. Remove the EXN3000 from the carton using the integrated handles built into the sides of the unit. Place the unit on a table. Installing the rails in an IBM 19-inch rack Use these instructions to install the rails on which you will mount the EXN3000. Note: Read this document in its entirety before proceeding. opyright IBM orp. 2009, 2012 1
Rear of rack Front of rack Rail adjustment screws Left rail Locating pins Right rail n620007 Figure 4. Installing the rails into the rack 1. Loosen (but do not remove) the four rail adjustment screws on each rail. 2. Use Figure 5 on page 3 for reference. At the front of the rack, position the right-hand rail into the rack at the appropriate EIA location (make sure that the two locating pins seat properly). The bottom of the rail should line up with the bottom EIA boundary. 2
FRONT Left and Right Rails H1 Section of rack EIA rail REAR Left and Right Rails H1 H2 H2 1 EIA unit (1U) H3 H3 H4 H4 hassis attach screws H5 H5 Top rail screws Top rail screws H6 H6 H7 Locating pins H7 H8 H8 H9 Locating pins H9 Bottom rail screws H10 H10 hassis attach screws H11 H11 Bottom rail screws H12 H12 exn300016 Figure 5. Rail positioning guide Note: When installed, each EXN3000 unit will occupy a 4U space. Using two silver pan head M5 screws, attach the rail to the front of the rack using holes H6 and H10. Tighten these screws with a screwdriver. 3. At the rear of the rack, position the rail at the same EIA location used in step 2 (make sure that the locating pins seat properly). Using two silver pan head M5 screws, attach the rail to the rack using holes H5 and H11. Tighten these screws with a screwdriver. 4. Tighten the four rail adjustment screws on the installed rail. 5. Using a Phillips screwdriver, install a rear tie-down plate on the rail using two M5 Phillips flat-head screws 1, as shown in Figure 6 on page 4. Installation and setup instructions 3
1 exn300005 Figure 6. Installing the tie-down plate 6. Repeat steps 2 through 5 for the left-hand rail. 7. Repeat steps 1 through 6 for each additional EXN3000 that you are installing in the rack, making sure to allow 4U of space for each EXN3000. Installing the EXN3000 in the rack Use these instructions to install the EXN3000 in the rack. AUTION 110 lbs (49.9 kg) LIFTING HAZAR To reduce the weight of the disk, remove the power supplies and IOMs before lifting. exn32006 AUTION: A fully populated EXN3000 weighs 49.9 kg (110 lbs). Use three people to lift an EXN3000 into a rack. To make the unit lighter and easier to move, remove the power supplies and IOMs, noting the location of each component for reinstallation. o not remove the disk drives or drive blank covers to reduce the weight. After the unit is installed in the rack, reinsert the power supplies and IOMs. 1. Remove the EXN3000 front bezel. 2. From the front of the rack, place the EXN3000 onto the rails and slide it in until the front mounting bracket of the unit is flush with the frame rails of the rack. 3. At the front of the rack, using four silver pan head M5 screws in the H5 and H11 holes, secure the EXN3000 to the rack by threading the screws through the system unit bracket and the rack frame rail into the threaded rail nuts. Tighten the screws using a flat-bladed screwdriver. 4. From the rear of the rack, use a silver pan head M5 screw 1 to attach the rear of the chassis to the tie-down plate on each rail, as shown in Figure 7 on page 5. 4
1 exn300006 Figure 7. Attaching the chassis to the tie-down plate onnecting power to the EXN3000 Use these instructions to connect power to the EXN3000. 1. Make sure all power supply switches of the storage expansion unit (or units) are in the Off position. 2. onnect the power cords to each EXN3000 and secure the power cords in place with the power cord retainer. Make sure that the power supplies on the left side of the system are connected to a separate A source than the power supplies on the right side of the system. This ensures redundant power. Notes: v epending on the disk drive type, your EXN3000 might have two or four power supplies. EXN3000s with 15k SAS disk drives require the use of four power outlets. EXN3000s with 7.2k SATA disk drives require the use of two power outlets. v EXN3000 storage expansion units do not need additional grounding. 3. Turn on power to the storage expansion units and wait for the disk drives to spin up. F/SAS bridge for stretch or fabric-attached Metroluster systems See IBM System Storage N series Introduction and Planning Guide and ATTO FibreBridge 6500N Installation and Operations Manual for information about F/SAS bridge hardware. This document, as well as all N series documentation, is available on the IBM N series sup website, which is accessed and navigated as described in About the IBM N series sup website on page v. Installation and setup instructions 5
!! Setting the storage expansion unit Is A unique I is required for each SAS storage expansion unit within the entire storage system. A valid EXN3000 storage expansion unit I is 00-98. Note: N3400 and N3600 systems have an internal I preset to 00, so for N3400 and N3600 configurations, valid EXN3000 Is are 01-98. If your storage system has SAS and Fibre hannel (F) storage expansion units, the storage expansion unit Is do not need to be unique between the SAS and F expansion units. (F expansion unit Is continue to be unique within each F loop. SAS expansion unit Is continue to be unique to all other SAS expansion units in the storage system, including the N3400 or N3600 system's internal I.) Visually verify that the I for each storage expansion unit is unique. If not, set the I as follows. For additional details, see the IBM System Storage EXN3000 Storage Expansion Unit Hardware and Service Guide. 1. Remove the front bezel if you have not already removed it. 2. Press and hold the U-shaped tab 1 above the LEs until the first digit flashes.! Shelf I tab or button exn32007 Figure 8. Expansion unit I tab 3. Press the tab until the correct number is displayed. 4. Repeat steps 2 and 3 for the second digit. 5. Press and hold the tab until the second number stops flashing. Both numbers start flashing and the Fault LE on the operations panel illuminates after about five seconds. 6. Power-cycle the storage expansion unit to make the new expansion unit I take effect. 7. Replace the front bezel. abling the EXN3000 Use these instructions to cable the EXN3000. The AP and SAS s on the EXN3000 Input/Output modules are designated as circle and square s (not In and Out s). See the IBM System Storage EXN3000 Storage Expansion Unit Hardware and Service Guide for a comparison between SAS and Fibre hannel storage expansion units and for more information about the EXN3000. Attention: v If you are using HBAs, they must be installed in the storage system before you cable the system. v Always cable SAS connections first, and then cable AP connections. 1. able the N series controllers. 6
Refer to the Installation and Setup Instructions for the N series storage system to which you are connecting the EXN3000. 2. able the storage expansion units. The illustrations in abling a single-controller NAS or issi configuration and abling a high availability NAS or issi configuration on page 10 show the steps for cabling two common configurations. Note: In the descriptions of these configurations, references to the first and last disk shelves in a stack are to the first, or closest, in a SAS stack, which makes the first connections to the N series controller, and to the last, or ending, in a stack. For SAS and AP cabling rules, and for more cabling configurations, see the IBM System Storage N series Universal SAS and AP abling Guide. Alternate ontrol Path (AP) capability For maximum storage availability and stability, storage systems with EXN3000 storage expansion units have the option to use the AP capability. AP is a protocol that enables ata ONTAP to manage and control the EXN3000 storage subsystem. It uses a separate network from the data path so it can independently perform recovery whenever certain interruptions are detected in the data path. To use the AP capability, you must cable the AP s on the EXN3000s and connect the EXN3000s to the dedicated network interface on each N series storage system controller. At system setup, you enable the AP functionality by configuring AP parameters. If your storage system does not have a dedicated onboard network interface for AP, you dedicate one at system setup. Standard AP cabling rules apply to all N series storage systems and can be found in the IBM System Storage N series Universal SAS and AP abling Guide. Attention: AP cabling requires AT6 Ethernet LAN cables. AP functionality, configuration, and enabling information can be found in the ata ONTAP Storage Management Guide for 7-Mode. Note: If at initial storage system setup you choose not to use the AP capability, you can use it later by cabling the AP connections and enabling AP by running setup again. abling a single-controller NAS or issi configuration This task illustrates how to cable a single-controller NAS or issi configuration with two quad- SAS HBAs suping two stacks of expansion units with dual-path connectivity. 1. aisy-chain the SAS s, as shown in Figure 9 on page 8. Installation and setup instructions 7
ontroller 1 HBA 1 HBA 2 A A B B Ethernet Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300008 Figure 9. aisy-chain the SAS s 2. able the first connections as shown in Figure 10. ontroller 1 HBA 1 HBA 2 A A B B Ethernet Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300009 Figure 10. able the first connections 3. able the last connections as shown in Figure 11 on page 9. 8
HBA 1 HBA 2 A A B B ontroller 1 Ethernet Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300010 Figure 11. able the last connections 4. able the AP connections as shown in Figure 12. HBA 1 HBA 2 A A B B Ethernet ontroller 1 Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300011 Figure 12. able the AP connections Installation and setup instructions 9
abling a high availability NAS or issi configuration This task illustrates how to cable an active/active (or high availability) NAS or issi configuration with two quad- SAS HBAs suping two stacks of expansion units with multipath connectivity. 1. aisy-chain the SAS s, as shown in Figure 13. HBA 1 HBA 2 A B ontroller 1 A B Ethernet HBA 1 HBA 2 A A B B ontroller 2 Ethernet Stack 1 AP SAS AP SAS Stack 2 First IOM A IOM B Last exn300012 Figure 13. aisy-chain the SAS s 2. able the first connections, as shown in Figure 14. A B ontroller 1 HBA 1 HBA 2 A B Ethernet HBA 1 HBA 2 A A B B ontroller 2 Ethernet Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300013 Figure 14. able the first connections 3. able the last connections, as shown in Figure 15 on page 11. 10
HBA 1 HBA 2 A B ontroller 1 A B Ethernet HBA 1 HBA 2 A A B B ontroller 2 Ethernet Stack 1 Stack 2 AP SAS AP SAS IOM A IOM B First exn300014 Last Figure 15. able the last connections 4. able the AP connections, as shown in Figure 16. A B ontroller 1 HBA 1 HBA 2 A B Ethernet HBA 1 HBA 2 A A B B ontroller 2 Ethernet Stack 1 Stack 2 AP SAS AP SAS First IOM A IOM B Last exn300015 Figure 16. able the AP connections Installation and setup instructions 11
abling a fabric-attached Metroluster configuration See onfiguring a Metroluster with SAS disk shelves and FibreBridge 6500N and ATTO FibreBridge 6500N Installation and Operations Manual for information on installing, hot-adding, converting HA pairs to fabric-attached Metrolusters, and replacing F/SAS bridge. This document, as well as all N series documentation, is available on the IBM N series sup website, which is accessed and navigated as described in About the IBM N series sup website on page v. Booting the system See the Installation and Setup Instructions that came with your N series storage system for instructions on booting your storage system for the first time. If you are using the AP capability, at setup you will enable the AP capability. See the ata ONTAP Software Setup Guide for 7-Mode for the setup worksheet and other setup information. 12
Part Number: 35P2631 Printed in USA G52-1345-03 (1P) P/N: 35P2631