HP 3PAR OS Messages and Operators Guide

HP 3PAR OS 3.1.1 Messages and Operators Guide Abstract This guide is for system administrators and experienced users who are familiar with the storage systems, understand the operating system(s) they are using, and have a working knowledge of RAID. This guide provides information on the T-Class, F-Class and StoreServ 10000 Storage system LEDs, alerts, components, and procedures for powering the system on and off. HP Part Number: QL226-97030 Published: June 2013

Copyright 2008, 2013 Hewlett-Packard Development Company, L.P. Confidential computer software. Valid license from HP required for possession, use or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Acknowledgments Microsoft and Windows are U.S. registered trademarks of Microsoft Corporation. Adobe and Acrobat are trademarks of Adobe Systems Incorporated.

Contents Introduction...7 Related Documentation...7 1 Component Numbering for T-Class Storage System...8 Identifying Storage System Components...35 Service Processor Placement...36 Understanding Component Numbering...37 Cabinet Numbering...37 PDU Numbering...37 Battery Backup Unit Numbering...14 Magnetek Battery Backup Units...15 Controller Node Numbering...40 Drive Chassis Numbering...43 Drive Magazine Allocation...32 Power Supply Numbering...45 2 Component Numbering for F-Class Storage System...24 Identifying Storage System Components...35 Service Processor Placement...36 Understanding Component Numbering...37 Cabinet Numbering...37 PDU Numbering...37 Controller Node Numbering...40 Drive Chassis Numbering...43 Drive Magazine Allocation...32 Power Supply Numbering...33 3 Component Numbering for HP 3PAR StoreServ 10000 Storage...35 Identifying Storage System Components...35 Service Processor Placement...36 Understanding Component Numbering...37 Cabinet Numbering...37 Power Distribution Units Numbering...37 Battery Module Numbering...39 Controller Node Numbering...40 Drive Chassis Numbering...43 Power Supply Numbering...45 4 Understanding T-Class Storage System LED Status...47 Using the T-Class Component LEDs...58 Removing the Bezels and Unlocking the Door...47 Drive Cage LEDs...47 DC4 Drive Cage FC-AL Module LEDs...47 Drive Magazine LEDs...49 Controller Node LEDs...76 Fibre Channel Port LEDs...52 QLogic iscsi Port LEDs...67 Power Supply LEDs...53 Battery Backup Unit LEDs...55 Power Distribution Unit Lamps...85 Service Processor LEDs...55 Supermicro Service Processor LEDs...56 Supermicro II Service Processor...56 Contents 3

Securing the Storage System...71 5 Understanding F-Class Storage System LED Status...58 Using the F-Class Component LEDs...58 Bezel LEDs...58 Removing the Bezels and Unlocking the Door...59 Drive Chassis LEDs...59 OPs Panel LEDs...59 Interface Card LEDs...63 Power Supply/Cooling Module LEDs...63 Drive Magazine LEDs...64 Controller Node LEDs...76 Fibre Channel Port LEDs...67 QLogic iscsi Port LEDs...67 Emulex Fibre Channel Port LEDs...68 Controller Node Power Supply LEDs...69 Power Distribution Unit Lamps...85 Service Processor LEDs...70 Supermicro Service Processor...70 Supermicro II Service Processor...70 Securing the Storage System...71 6 Understanding HP 3PAR StoreServ 10000 Storage LED Status...72 Drive Cage LEDs...72 DC4 Drive Cage FC-AL Module LEDs...73 Drive Magazine LEDs...75 Controller Node LEDs...76 Controller Node Status Panel LEDs...77 Fan Module LEDs...78 Fibre Channel Adapter Port LEDs...79 CNA Port LEDs...80 Ethernet LEDs...81 Power Supply LEDs...82 Drive Chassis Power Supply LEDs...82 Controller Node Power Supply LEDs...83 Battery Module LEDs...84 Power Distribution Unit Lamps...85 Service Processor LEDs...86 7 Power Off/On Procedures...87 Powering Off the Storage System...87 Powering On the Storage System...87 Connecting to the Service Processor...88 Using a Serial Connection...88 Using an Ethernet Connection...88 Configuring the LAN Settings on the Maintenance PC...89 Using PuTTY...91 Logging into the SP Onsite Customer Care Interface (SPOCC)...92 8 Alerts...93 9 Troubleshooting...291 The checkhealth Command...291 Using the checkhealth Command...291 Troubleshooting Storage System Components...292 Alert...293 Format of Possible Alert Exception Messages...293 4 Contents

Alert Example...293 Alert Suggested Action...293 Cage...293 Format of Possible Cage Exception Messages...294 Cage Example 1...294 Cage Suggested Action 1...294 Cage Example 2...295 Cage Suggested Action 2...295 Cage Example 3...296 Cage Suggested Action 3...296 Cage Example 4...297 Cage Suggested Action 4...297 Cage Example 5...297 Cage Suggested Action 5...298 Note for DC3 Cages...299 Date...299 Format of Possible Date Exception Messages...299 Date Example...299 Date Suggested Action...300 LD...300 Format of Possible LD Exception Messages...300 LD Example 1...300 LD Suggested Action 1...300 LD Example 2...301 LD Suggested Action 2...301 LD Example 3...301 LD Suggested Action 3...302 LD Example 4...302 LD Suggested Action 4...302 License...303 Format of Possible License Exception Messages...303 License Example...303 License Suggested Action...303 Network...303 Format of Possible Network Exception Messages...303 Network Example 1...303 Network Suggested Action 1...303 Network Example 2...303 Network Suggested Action 2...303 Node...304 Format of Possible Node Exception Messages...304 Suggested Node Action, General...304 Node Example 1...304 Node Suggested Action 1...305 Node Example 2...305 Node Suggested Action 2...305 Node Example 3...306 Node Suggested Action 3...306 PD...306 Format of Possible PD Exception Messages...306 PD Example 1...307 PD Suggested Action 1...307 PD Example 2...308 PD Suggested Action 2...308 PD Example 3...309 Contents 5

PD Suggested Action 3...309 PD Example 4...309 PD Suggested Action 4...309 PD Example 5...310 PD Suggested Action 5...310 Port...310 Format of Possible Port Exception Messages...310 Port Suggested Actions, General...311 Port Example 1...311 Port Suggested Action 1...311 Port Example 2...312 Port Suggested Action 2...312 Port Example 3...312 Port Suggested Action 3...313 Port Example 4...313 Port Suggested Action 4...313 Port Example 5...313 Port Suggested Action 5...313 RC...314 Format of Possible RC Exception Messages...314 RC Example...314 RC Suggested Action...314 SNMP...314 Format of Possible SNMP Exception Messages...314 SNMP Example...314 SNMP Suggested Action...315 SP...315 Format of Possible SP Exception Messages...315 SP Example...315 SP Suggested Action...315 Task...315 Format of Possible Task Exception Messages...315 Task Example...315 Task Suggested Action...315 VLUN...316 Format of Possible VLUN Exception Messages...316 VLUN Example...316 VLUN Suggested Action...316 VV...317 Format of Possible VV Exception Messages...317 VV Suggested Action...317 10 Documentation feedback...318 6 Contents

Introduction This guide provides the information you need to familiarize yourself with the HP 3PAR Storage System alerts, components, LEDs, and procedures for powering on and powering off the storage system. Information provided in this document supports the HP 3PAR T-Class, F-Class, and StoreServ 10000 Storage Systems. NOTE: The InServ Storage Server has been rebranded as HP 3PAR Storage System. There are instances in this document where menu items and command output refer to the HP 3PAR Storage System as InServ or InServ Storage Server. Related Documentation Table 1 Related Documentation For information about... Planning and preparing for a storage system installation Checklist for installation tasks to be completed Upgrading HP 3PAR Storage Systems Understanding the basics of the HP 3PAR OS and storage systems Using the InForm Command Line Interface (CLI) to configure and manage the storage system Using the InForm Management Console s (IMC) user interface and manage the storage system Read the... HP 3PAR StoreServ 10000 Storage Physical Planning Manual HP 3PAR E/F-Class Storage System Physical Planning Manual HP 3PAR S/T-Class Storage System Physical Planning Manual HP 3PAR T-Class, F-Class and StoreServ 10000 Storage System Installation Checklist (for HP 3PAR Cabinets) HP T-Class, F-Class, and StoreServ 10000 Storage System Upgrades Guides HP 3PAR OS Concepts Guide HP 3PAR OS CLI Administrator s Manual HP 3PAR Management Console Online Help Related Documentation 7

1 Component Numbering for T-Class Storage System NOTE: Illustrations in this chapter show sample systems and might not match your configuration. Identifying Storage System Components Figure 1 (page 8) and Figure 2 (page 9) identify the major components of the T400 Storage System in a 2M (40U) HP 3PAR cabinet. Figure 1 T400 Front View 8 Component Numbering for T-Class Storage System

Figure 2 T400 Rear View Service Processor Placement The Service Processor (SP) is located at the bottom of the cabinet and is designed to support all actions required for maintenance of the storage system, providing real-time, automated monitoring. The SP also supports remote access to diagnose and resolve potential problems. The SP is usually installed directly above the PDUs and below the battery tray (Figure 3 (page 10)) and is powered internally by the storage system. The SP does not require an external power connection. Service Processor Placement 9

Figure 3 Placement of the Service Processor NOTE: In the T800, the SP is located above the backplane, below the lowest drive chassis but above the upper battery tray. Figure 5 (page 12) illustrates SP placement for the T800. When a cabinet does not include a SP, a filler panel covers the area of the cabinet that the SP normally occupies. Understanding Component Numbering Because of the large number of potential configurations, we have standardized component placement and internal cabling to simplify installation and maintenance. For this reason, system components are placed in the cabinet according to the principles outlined in this section and numbered according to their order and location in the cabinet. NOTE: For information about standardized cabling, see the HP 3PAR T-Class Storage System Installation and Deinstallation Guide. Cabinet Numbering The T-Class Storage System 2M (40U) cabinet is an EIA-standard rack that accepts storage system components. Numbers for chassis bays are assigned: beginning with 0. from top to bottom. Figure 4 (page 11) illustrates numbering of chassis bays in T-Class cabinet. 10 Component Numbering for T-Class Storage System

Figure 4 Numbering of Chassis Bays in the Cabinet A storage system can be housed in a single cabinet or multiple cabinets. When multiple cabinets are required, the first cabinet (the controller node cabinet ) holds the storage system backplane populated with controller nodes. Any additional cabinets, or drive chassis cabinets, hold the additional drive chassis that do not fit into the controller node cabinet. Table 2 (page 11) describes the pattern for cabinet numbering in multi-cabinet storage systems and for operating sites with multiple systems: Table 2 Cabinet Numbering Cabinet Controller node cabinet Drive chassis cabinets connecting to the first node cabinet Number C00 C01, C02, C03... C09 Figure 5 (page 12) shows the location of system components for the T400 and T800 controller node cabinets. Figure 6 (page 13) shows the location of system components for drive chassis cabinets. Understanding Component Numbering 11

Figure 5 Controller Node Cabinet Component Layout 12 Component Numbering for T-Class Storage System

Figure 6 Drive Chassis Cabinet Component Layout PDU Numbering For each cabinet, the four Power Distribution Units (PDUs) occupy the lowest chassis bay in the cabinet. Numbers for PDUs are assigned: beginning with 0. from top to bottom. Figure 7 (page 13) illustrates the four PDUs at the bottom of a T-Class cabinet. Figure 7 Numbering of PDUs Understanding Component Numbering 13

NOTE: In the T800, PDUs are positioned back-to-back so that they only take up 2U of space at the bottom of the cabinet rather than the standard 4U of space. PDUs are accessible from both the front and the rear of the storage system. Controller Node Cabinet Component Layout (page 12) illustrates PDU placement for the T800. Each PDU has two power banks, each with a separate circuit breaker, to be used exclusively for storage system components (Figure 8 (page 39)). Figure 8 Power Banks in the PDU WARNING! To avoid possible injury, damage to storage system equipment, and potential loss of data, do not use the surplus power outlets in the storage system PDUs. Never use outlets in the PDUs to power components that do not belong to the storage system or to power storage system components that reside in other cabinets. NOTE: For more information on PDUs and storage system configurations, see the T-Class Storage System Installation and Deinstallation Guide. Battery Backup Unit Numbering The controller node cabinet includes one or two battery trays that hold the battery backup units (BBU). The BBUs supply enough power to write the cache memory to the IDE drive inside the nodes in the event of a power failure. One battery per controller node is required for all storage system configurations. BBU placement and numbering schemes vary according to the type of components used in the system. There is always a battery tray located directly below the backplane. When a second battery tray is required, as is the case with storage systems that have six or eight controller nodes, a second battery tray rests immediately above the backplane. Storage systems use Magnetek BBUs. Each battery unit contains two independently-switched batteries, labeled battery a and battery b (Figure 9 (page 14)). Figure 9 Battery Backup Unit 14 Component Numbering for T-Class Storage System

A battery tray can hold a maximum of four BBUs. The number of BBUs and battery trays in a system depends on the number of controller nodes installed (Table 3 (page 15)). Table 3 Number of BBUs and Battery Tray Placement by Storage System Backplane and Number of Controller Nodes Backplane Nodes BBU Battery Trays Tray Placement T400 2 2 1 Below backplane 4 4 1 Below backplane T800 2 2 1 Below backplane 4 4 1 Below backplane 6 6 2 Below backplane (1) Above backplane (1) 8 8 2 Below backplane (1) Above backplane (1) Magnetek Battery Backup Units Magnetek BBUs have batteries that sit vertically, with battery A above battery B. (Figure 10 (page 15)). Figure 10 Magnetek BBUs When facing the rear of the storage system, Magnetek BBUs are numbered from right to left, 0 through 3. When two battery trays are present, the upper tray is numbered 0 and the lower tray is numbered 1 (Figure 11 (page 16)). Understanding Component Numbering 15

Figure 11 Magnetek BBU Numbering Scheme Controller Node Numbering The T-Class Storage System contain two, four, six, or eight controller nodes per system and only use T-Class controller nodes. Controller nodes are loaded into the backplane enclosure from bottom to top. Therefore, for the T800 with only two controller nodes installed, those controller nodes would occupy the lowest 4U of the backplane and would be numbered, node 6 and node 7. The other bays in the backplane enclosure would be protected with filler panels that block insertion of other components. A controller node takes on the number of the bay that it occupies in the backplane, as shown in Figure 12 (page 17). 16 Component Numbering for T-Class Storage System

Figure 12 Numbering of Controller Nodes As shown in Figure 13 (page 18), a controller node contains six PCI slots. These slots accept PCI adapters such as dual-port Fibre Channel adapters, iscsi adapters, and Ethernet adapters. The controller node also has a management Ethernet port (E0) and a maintenance port (C1). Understanding Component Numbering 17

Figure 13 Numbering for Dual-Port Fibre Channel Adapters in the Controller Node PCI Slots Each Fibre Channel adapter in a PCI slot has four ports. Each iscsi adapter in a PCI slot has two or four ports. PCI adapters assume the numbers of the PCI slots they occupy. In dual-port adapters, ports are labeled port 1 and 2, from top to bottom. In quad-port Fibre Channel adapters, the ports are numbered port 1 4, from top to bottom. Inside the controller node are control cache DIMMs and data cache DIMMs. Control cache DIMMs are located in control cache slots 0 and 1 (Figure 14 (page 19)). Data cache DIMMs are located on data cache riser cards (Figure 14 (page 19)). 18 Component Numbering for T-Class Storage System

Figure 14 Control Cache and Data Cache DIMMs in a T-Class Controller Node Numbers for controller nodes and their components are assigned in the order indicated in Table 4 (page 19). Table 4 Numbering System for Controller Nodes and their Components The Following Components... Controller nodes PCI adapters PCI ports dual-port adapters quad-port adapters Control Cache DIMMs control cache data cache Data Cache DIMMs Bank 0 Bank 1 Bank 2 1 When facing the storage system. Are Numbered... 0,1,2,3,4,5,6,7 0,1,2,3,4,5-1,2 1,2,3,4-0,1 0,1,2,3,4,5,6,7-0,1 0,1 0,1 Running from... left to right 1 and top to bottom left to right 1 top to bottom top to bottom left to right 1 top to bottom Drive Chassis Numbering Depending on the specific configuration, a storage system can include up to 64 drive chassis. A drive chassis houses two drive cages where each contains five drive bays. Each drive bay can accommodate a single drive magazine holding four disks for a total of 20 disks per drive cage and 40 disks per drive chassis. Numbers for drive chassis are assigned beginning with 0, from bottom to top, beginning with the drive chassis directly above the storage system backplane. Understanding Component Numbering 19

Drive chassis are always placed above the storage system backplane enclosure and numbered according to their position in relation to the backplane, as shown in Figure 15 (page 20). Figure 15 Numbering of Drive Chassis NOTE: For systems occupying multiple cabinets, drive chassis numbers continue at the bottom of the next cabinet and progress through the top of the cabinet. Figure 16 (page 21) and Figure 17 (page 21) illustrate individual drive chassis components and how they are numbered. Fibre Channel ports in the FC-AL adapters at the sides of the drive chassis enable connection to the controller nodes. 20 Component Numbering for T-Class Storage System

Figure 16 Numbering of Drive Chassis Components Figure 17 Numbering of Disks on a DC4 and DC4 Type-2 Drive Magazine Numbers for drive chassis components are assigned: from bottom to top. from rear to front (in the case of disks). in the order indicated by Table 5 (page 21). Table 5 Numbering System for Drive Chassis Components The Following Components... Drive cages FC-AL modules Are Numbered... 0,1,... 0,1 Running from... bottom to top left to right Understanding Component Numbering 21

Table 5 Numbering System for Drive Chassis Components (continued) The Following Components... Fibre Channel ports FC-AL 0 FC-AL 1 Drive magazines Disks on the drive magazine Are Numbered... A0,B0 A1,B1 0,1,2,3,4,5,6,7,8,9 0,1,2,3 Running from... top to bottom left to right rear to front Drive Magazine Allocation For highest availability and data protection, drive magazines are placed on different loops and internal power domains by loading them in the order illustrated by Figure 18 (page 22). NOTE: See the systems planning document or HP 3PAR Systems Assurance and Pre-Site Planning Guide for drive magazine allocation instructions specific to your system. Figure 18 Pattern for Loading Initial Drive Magazines into the Drive Chassis 22 Component Numbering for T-Class Storage System

NOTE: For further instructions on drive magazine allocation, see the HP 3PAR T-Class Storage System Installation and Deinstallation Guide. Power Supply Numbering Cabinets are divided into upper and lower power domains that contain drive cages or controller nodes and dedicated power supplies. Drive cages and controller nodes depend on these power supplies, located at the rear of the system, to supply power from the PDUs at the bottom of the cabinet. When viewing the cabinet from the rear, the power supplies in each power domain are numbered from 0 to 3, from left to right. Figure 19 (page 23) shows an expansion cabinet. Figure 19 Numbering of Power Supplies within the Power Domains Understanding Component Numbering 23

2 Component Numbering for F-Class Storage System NOTE: Illustrations in this chapter show sample systems and might not match your configuration. Identifying Storage System Components Figure 20 (page 24) and Figure 21 (page 25) identify the major components of an F-Class Storage System. Figure 20 F400 Front View 24 Component Numbering for F-Class Storage System

Figure 21 F400 Rear View Service Processor Placement The Service Processor (SP) is located at the bottom of the cabinet and is designed to support all actions required for maintenance of the storage system, providing real-time automated monitoring. The SP also supports remote access to diagnose and resolve potential problems. Because the SP is capable of supporting multiple storage systems at the same operating site, not all cabinets contain a SP. However, when present, the SP is usually installed directly above the PDUs and below the drive cage (see Figure 20 (page 24)). The SP is powered internally by the storage system and does not require an external power connection. When a cabinet does not include a SP, a filler panel covers the area of the cabinet that the SP normally occupies. Service Processor Placement 25

Understanding Component Numbering Because of the almost unlimited number of potential configurations, there is standardized component placement and internal cabling to simplify installation and maintenance. For this reason, system components are placed in the cabinet according to the principles outlined in this section and numbered according to their order and location in the cabinet. Cabinet Numbering The F-Class Storage System 2M (40U) cabinet is an EIA-standard rack that holds storage system components. Numbers for chassis bays are assigned beginning with 0, from top to bottom. Figure 22 (page 26) illustrates numbering of chassis bays in an HP 3PAR cabinet. Figure 22 Numbering of Chassis Bays in the Cabinet A storage system can be housed in a single cabinet or multiple cabinets. When multiple cabinets are required, the first cabinet (the controller node cabinet ) holds the backplane populated with controller nodes. Any additional cabinets, or drive chassis cabinets, hold the additional drive chassis that do not fit into the controller node cabinet. 26 Component Numbering for F-Class Storage System

Table 6 (page 27) describes the pattern for cabinet numbering in multi-cabinet storage systems and for operating sites with multiple systems: Table 6 Cabinet Numbering Cabinet Controller node cabinet Drive chassis cabinets connecting to the first node cabinet Number C00 C01, C02, C03...C09 Figure 23 (page 27) shows the location of controller node and drive chassis components for the storage system cabinet in the F200 and F400. Figure 23 Controller Node and Drive Chassis Component Layout PDU Numbering The four Power Distribution Units (PDUs) occupy the lowest chassis bay in the cabinet. Refer to Figure 22 (page 26) for bay numbering. Numbers for PDUs are assigned : beginning with 0. from top to bottom. Figure 24 (page 28) illustrates the four PDUs at the bottom of an HP 3PAR cabinet. Understanding Component Numbering 27

Figure 24 Numbering of PDUs Each PDU has two power banks, each with a separate circuit breaker, to be used exclusively for storage system components (Figure 25 (page 28)). Figure 25 PDU Power Banks WARNING! To avoid possible injury, damage to storage system equipment, and potential loss of data, do not use the surplus power outlets in the storage system PDUs. Never use outlets in the PDUs to power components that do not belong to the storage system or to power storage system components that reside in other cabinets. Controller Node Numbering The F-Class Storage System contains two or four nodes per system. Controller nodes are numbered from top to bottom node 0 and node 1 for a two node system, and node 0, node 1, node 2, node 3 for a four node system. 28 Component Numbering for F-Class Storage System

Figure 26 Numbering of Controller Nodes A controller node contains two controller slots and two on-board Ethernet ports. See Figure 27 (page 30) for specific port type assignments. Understanding Component Numbering 29

Figure 27 Numbering for Dual-Port Fibre Channel Adapters in the Controller Node PCI Slots Each Fibre Channel adapter in a PCI slot has two or four Fibre Channel ports. Fibre Channel adapters assume the numbers of the PCI slots they occupy. In dual-port adapters, ports are labeled port 1 and port 2, from top to bottom. In quad-port Fibre Channel adapters, the ports are numbered port 1, port 2, port 3, and port 4, horizontally. Inside the controller node are data cache DIMMs and control cache DIMMs. Data cache DIMMs are located in data cache slots 0 through 2. Control cache DIMMs are located on control cache slots 0 and 1 (Figure 28 (page 30)). Figure 28 Control Cache and Data Cache DIMMs in the Controller Node 30 Component Numbering for F-Class Storage System

Drive Chassis Numbering Depending on configuration, an F-Class Storage System can include up to 10 drive chassis. A drive chassis houses 16 drive magazines. Drive chassis are first placed sequentially below controller node 1 (controller node 3 in an F400) and then sequentially above controller node 0. Drive chassis are numbered as shown in Figure 29 (page 31). Figure 29 Numbering of Drive Chassis NOTE: For systems occupying multiple cabinets, drive chassis numbers continue at the bottom of the next cabinet and progress through the top of the cabinet. Figure 30 (page 32) and Figure 31 (page 32) illustrate individual drive chassis components and how they are numbered. Fibre Channel ports in the Fibre Channel Arbitrated Loop (FC-AL) at the sides of the drive chassis enable connection to the controller nodes. Understanding Component Numbering 31

Figure 30 Drive Chassis - Front View, Drive Magazine Bay Numbering Figure 31 Drive Chassis - Rear View, Port Numbering Drive Magazine Allocation For highest availability and data protection, drive magazines are placed on different loops and internal power domains by loading them in the order described in by Table 7 (page 33). The following figure shows the drive magazine numbering: NOTE: See the systems planning document or the HP 3PAR Systems Assurance and Pre-Site Planning Guide for drive magazine allocation instructions specific to your system. Figure 32 Drive Magazine Bay Numbering Drive magazines are loaded in the following ordered pairs: 32 Component Numbering for F-Class Storage System

Table 7 Drive Magazine Loading Pattern Group Number 1 2 3 4 Drive Magazine Pair Number 1 2 3 4 5 6 7 8 Drive Magazine Bay 0, 4 11, 15 8, 12 3, 7 1, 5 10, 14 9, 13 2, 6 NOTE: The loading sequence displayed in the table above indicates the loading order is in vertical columns. All drives in a vertical column must be of the same type and speed. Mixing drive types and speeds in the same column may cause unpredictable results. Power Supply Numbering F-Class Storage System cabinets share a single power domain that contains a drive cage or controller node and two dedicated power supplies. Drive cages and controller nodes depend on these two power supplies to supply power from the PDUs at the bottom of the cabinet. When viewing the cabinet from the rear, the power supplies are numbered as follows (Figure 33 (page 34)): Understanding Component Numbering 33

Figure 33 Numbering of Power Supplies 34 Component Numbering for F-Class Storage System

3 Component Numbering for HP 3PAR StoreServ 10000 Storage NOTE: Illustrations in this chapter show sample systems and might not match your configuration. Identifying Storage System Components Figure 34 (page 35) and Figure 35 (page 36) identifies the major components the 10400 and 10800 in an HP 3PAR cabinet. Figure 34 10400 and 10800 Front View Identifying Storage System Components 35

Figure 35 10400 and 10800 Rear View Service Processor Placement The Service Processor (SP) is supports all actions required for maintenance of the storage system, providing real-time, automated monitoring. The SP also supports remote access to diagnose and resolve potential problems. The SP resides in the lower section of the controller node cabinet and is typically installed directly below the node chassis power supply tray and directly above the DC4 drive chassis (Figure 36 (page 36)). The SP is powered internally by the storage system and does not require an external power connection. Figure 36 Service Processor Placement 36 Component Numbering for HP 3PAR StoreServ 10000 Storage

Understanding Component Numbering Because of the large number of potential configurations, we have standardized component placement and internal cabling to simplify installation and maintenance. System components are placed in the cabinet according to the principles outlined in this section and numbered according to their order and location in the cabinet. NOTE: For information about standardized cabling, see the HP 3PAR StoreServ 10000 Storage Installation and Deinstallation Guide. Cabinet Numbering The 2M cabinet is an EIA-standard rack and houses the storage system components. A storage system can be housed in a single or multiple cabinets. When multiple cabinets are required, the first cabinet (known as the controller node cabinet ) holds the node chassis populated with controller nodes. Any additional cabinets, or drive chassis cabinets, store the additional drive chassis that do not fit into the controller node cabinet. Table 8 (page 37) describes the pattern for cabinet numbering in multi-cabinet storage systems and for operating sites with multiple systems: Table 8 Cabinet Numbering Cabinet Controller node cabinet Drive chassis cabinets connecting to the first node cabinet Number C0 C0, C1, C2-C07 Power Distribution Units Numbering For each cabinet, four Power Distribution Units (PDUs) are mounted vertically on the left side of the rear of the cabinet. Numbers for PDUs are assigned beginning with 0, from bottom to top. Figure 37 (page 38) illustrates the four PDUs in an HP 3PAR cabinet. Understanding Component Numbering 37

Figure 37 PDU Numbering Each PDU is equipped with two power banks and separate circuit breakers, used exclusively for storage system components (Figure 8 (page 39)). 38 Component Numbering for HP 3PAR StoreServ 10000 Storage

Figure 38 Power Banks in the PDU NOTE: For more information on PDUs and storage system configurations, see the HP 3PAR StoreServ 10000 Storage Installation and Deinstallation Guide. Battery Module Numbering The HP 3PAR StoreServ 10000 Storage system include one or two battery compartments that hold up to four battery modules each. The battery compartment is part of the node chassis and adjacent to the node fan compartment. Battery module placement and numbering schemes may vary according to the type of configuration. When facing the front of the storage system, battery modules are numbered 0 through 3 from right to left and directly connected to the correlating controller node. When two battery compartments are present, the battery modules in the upper compartment are numbered 4 through 7 from right to left. Understanding Component Numbering 39

Figure 39 Battery Module Numbering Controller Node Numbering The HP 3PAR StoreServ 10000 Storage system may contain two, four, six, or eight controller nodes per system configuration. The controller node chassis slots are located at the rear of the cabinet. From the rear of the cabinet, component numbering starts with zero (0) at the bottom-left corner and advances right and upward, refer to Figure 40 (page 41). Use the following table as a guideline for loading controller nodes into the chassis: Table 9 Controller Node Loading Order System 10400 1010800 Controller Nodes 2 4 2 4 6 8 Loading Order 0, 1 0, 1, 2, 3 0, 1 0, 1, 4, 5 0, 1, 2, 3, 4, 5 0, 1, 2, 3, 4, 5, 6, 7 The following shows the numbering and positioning of the controller nodes in an HP 3PAR StoreServ 10000 chassis: 40 Component Numbering for HP 3PAR StoreServ 10000 Storage

Figure 40 Controller Nodes Numbering in the 10400 and 10800 As shown in Figure 41 (page 42), a controller node contains nine PCI slots. These slots contain PCI adapters, such as quad-port Fibre Channel and iscsi adapters. Each controller node has an administrative Ethernet port (E0), a dedicated Remote Copy over IP port (RCIP) (E1), and a console maintenance port (S0). Understanding Component Numbering 41

Figure 41 Controller Node PCI Slots and Port Numbering Each Fibre Channel adapter in a PCI slot has four ports. Each iscsi adapter in a PCI slot has two ports. PCI adapters assume the numbers of the PCI slots they occupy. In dual-port adapters, ports are labeled port 1 and port 2 in ascending order away from the adapter handle. In quad-port Fibre Channel adapters, the ports are numbered port 1, port 2, port 3, and port 4 in ascending order away from the adapter handle. Inside the controller node are control cache DIMMs and data cache DIMMs. Control cache DIMMs are located in control cache slots 0, 1, 2, and 3 (Figure 42 (page 43)). Data cache DIMMs are located on data cache slots (Figure 42 (page 43)). 42 Component Numbering for HP 3PAR StoreServ 10000 Storage

Figure 42 Control Cache and Data Cache DIMMs in a Controller Node Numbers for controller nodes and their components are assigned in the order indicated in Table 10 (page 43). Table 10 Controller Nodes and Components Numbering Components PCI adapters PCI ports dual-port adapters quad-port adapters Control Cache DIMMs Data Cache DIMMs Numbered 0, 1, 2, 3, 4, 5, 6, 7, 8 1, 2 1, 2, 3, 4 0, 1, 2, 3 CH1-0.1.0 0.1.1 CH0-0.0.0, 0.0.1 CH1-1.1.0, 1.1.1 CH0-1.0.0, 1.0.1 Drive Chassis Numbering Depending on the specific configuration, a storage system can include up to 64 drive chassis. A drive chassis houses a single drive cage containing 10 drive bays. Each drive bay can accommodate a single drive magazine holding four disks for a total of 40 hard drives per drive cage. For a 10400, six DC4s can be installed in the base cabinet. For a 10800, two DC4s can be installed in the base cabinet. Numbers for drive chassis are assigned beginning with 0, from bottom to top. Drive chassis are always placed above and below the node chassis and numbered according to their position in relation to the node chassis, as shown in Figure 43 (page 44). Understanding Component Numbering 43

Figure 43 Drive Chassis Numbering NOTE: For systems with multiple cabinets, drive chassis numbering may vary based on InForm OS configuration. Figure 44 (page 44) and Figure 45 (page 45) illustrate individual drive chassis components and their numbering scheme. Fibre Channel ports in the FC-AL adapters at the sides of the drive chassis enable connection to the controller nodes. Figure 44 Drive Chassis Components Numbering 44 Component Numbering for HP 3PAR StoreServ 10000 Storage

Figure 45 Numbering of Disks on a NL and FC Drive Magazine Numbers for drive chassis components are assigned from bottom to top, from rear to front (in the case of disks). Table 11 Drive Chassis Component Numbering Components Drive cages FC-AL modules Fibre Channel ports FC-AL 0 FC-AL 1 Drive magazines Disks on the drive magazine Numbered 0, 1,... 0, 1 - A0, B0 A1, B1 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 0,1, 2, 3 Running from bottom to top left to right top to bottom left to right rear to front Power Supply Numbering Cabinets are divided into upper and lower power domains that contain drive cages or controller nodes with dedicated power supplies located at the rear of the system. When viewing the cabinet from the rear, the power supplies connecting to the drive chassis of both the upper and lower power domains are numbered from 0 to 3, from left to right. Each node requires two power supplies. The power supplies in the lower node chassis are numbered 0 and 1, from left to right. The power supplies in the upper node chassis are numbered 0 and 1, from right to left. Understanding Component Numbering 45

Figure 46 Power Supplies Numbering within Power Domains 46 Component Numbering for HP 3PAR StoreServ 10000 Storage

4 Understanding T-Class Storage System LED Status Using the T-Class Component LEDs The T-Class Storage System components have LEDs to indicate whether or not the hardware is functioning properly and to help identify errors. These LEDs help diagnose basic hardware problems. You can quickly identify hardware problems by examining the LEDs on all the components and using the following tables and illustrations in this chapter. If you detect any problems during inspection of the LEDs, contact your Authorized Service Provider. Removing the Bezels and Unlocking the Door If your cabinet has locking fascias, you must first remove the fascias to access the system bezel. WARNING! Hazardous energy is located behind the rear access door of the storage system cabinet. Use caution when working with the door open. To view the node, drive chassis or service processor LEDs, remove the bezels. To view the power supply, battery or PDU LEDs, open the rear door by unlatching the three latches on the door. NOTE: Many LEDs are visible without removing the bezels. To view the power supply, battery or PDU LEDs, open the rear door of the cabinet. Drive Cage LEDs The DC4 drive chassis holds one DC4 drive cage housing with two drive cage FC-AL modules and a maximum of ten drive magazines. Figure 47 DC4 Drive Cage DC4 Drive Cage FC-AL Module LEDs DC4 drive cage FC-AL modules have the following LEDs (Figure 48 (page 48)): Using the T-Class Component LEDs 47

Figure 48 Connections and LEDs on the DC4 Drive Cage FC-AL Modules Table 12 Drive Cage DC4 FC-AL Module LED Displays LED RX TX FC-AL status Appearance Steady green light No light Steady green light No light Steady green light Flashing green light (1 blink per second) Steady amber light Indicates The presence of a small form-factor pluggable optical transceiver (SFP) and a valid signal from the node. No connection to the node or no SFP is installed. The presence of an SFP and the LED is on and transmitting. No SFP is present or the SFP transmitter failed. The drive cage is functioning properly, but is not communicating with other nodes. The drive cage is connected and communicating with the system manager of a node in the cluster. Normal, initial indication for two seconds upon power up. Otherwise, FC-AL module error or other cage error. If both FC-AL modules have a steady light, the temperature of a disk drive in the drive-cage has exceeded its 48 Understanding T-Class Storage System LED Status

Table 12 Drive Cage DC4 FC-AL Module LED Displays (continued) LED Hot plug Split mode 4GB/s Appearance Flashing amber light (1 blink per second) Rapid toggle between amber and green light Steady amber light No light Steady green light No light Steady green light No light Indicates high-level threshold, or a power supply has failed. The drive cage has some type of error, such as a failed or missing power supply, but is communicating with a node. A cage firmware upgrade initiated by the upgradecage CLI command is in progress. A firmware upgrade normally takes less than two minutes to complete. The FC-AL module is prepared for hot plug replacement. The FC-AL module is not prepared for the hot plug. The drive cage is split into two logical portions. The drive cage is not split. The transfer rate is operating at 4GB/s. The transfer rate is operating at 2GB/s. Drive Magazine LEDs NOTE: After powering on, allow approximately two minutes for the disks on the DC4 drive magazine to spin up before checking the drive magazine LEDs. Drive magazines contain the following LEDs (Figure 49 (page 50)): Using the T-Class Component LEDs 49

Figure 49 DC4 Drive Magazine LEDs Table 13 Drive Magazine LED Displays LED Drive magazine status Disk status Hot plug Appearance Steady green light Steady amber light Quick flashing, or 20 percent on, 80 percent off green light Steady green light Flashing green light No light Steady amber light Steady amber light Flashing amber light No light Indicates The drive magazine is functioning properly. A drive magazine error, or one or more drives are bypassed on at least one path. The disk is not spun up but has power. The disk is spun up and waiting for a command. The disk is executing commands. No disk is present. A disk error, or the disk is bypassed on both paths (loops). The drive magazine is prepared for hot plug replacement. That there is a connection failure between the drive magazine and the drive chassis. The drive magazine is not prepared for hot-plug. 50 Understanding T-Class Storage System LED Status

Controller Node LEDs Depending on configuration, a storage systsem contains between two and eight controller nodes, all located in the chassis. Controller nodes contain the following LEDs (Figure 50 (page 51)): Figure 50 Controller Node LEDs Table 14 Controller Node LED Displays LED Disk hot plug Node hot plug Node status Ethernet activity Appearance Steady amber light No light Steady amber light No light Flashing green light (1 blink per second) Flashing amber light (1 blink per second) Steady green light Rapidly flashing green (three times per second) Steady amber light Solid amber Steady green light Indicates Disk is prepared for hot plug. Disk is not prepared for hot plug. In combination with the status LED blinking green three times per second, indicates the node is prepared for removal. In combination with the status LED being solid, indicates a fatal failure. The node is not prepared for removal. The node is fully functional and part of the cluster. The node has a failed or missing power supply, fan, battery backup unit, or TOD battery but the node is still operational. The node is in the process of joining the cluster. In combination with the service LED being solid amber, the node is safe to remove. An error within the node. In combination with the service LED being amber, a fatal node failure. An Ethernet link. Using the T-Class Component LEDs 51

Table 14 Controller Node LED Displays (continued) LED Ethernet status Appearance Flashing green light No light Steady amber light Steady green light No light Indicates No Ethernet activity. No Ethernet connection. 1000 MB/s mode 100 MB/s mode 10 MB/s mode (or disconnected) Fibre Channel Port LEDs The Fibre Channel adapter in the controller node also contains Fibre Channel port LEDs (Figure 51 (page 52)). Figure 51 4-Port Fibre Channel LEDs Table 15 Fibre Channel Adapter LED Displays LED Port 1, 2, 3 Appearance No light Steady green light Flashing green light Indicates Wake up failure (dead device) Normal - link up at 2-4GBs/s Link down or not connected QLogic iscsi Port LEDs The QLogic iscsi adapter contains two ports with one LED for each port. 52 Understanding T-Class Storage System LED Status

Figure 52 iscsi Adapter Ports and LEDs Table 16 iscsi Adapter Port LED Displays LED Port 1, 2 Appearance No light Steady green light Flashing green light Indicates No connection or active link. Link is established. Receiving or transmitting activity. Power Supply LEDs Power supply units are located at the rear of all drive cages and controller nodes, and have the following LEDs (Figure 53 (page 54)): Using the T-Class Component LEDs 53

Figure 53 Power Supply LEDs NOTE: The appearance of the drive chassis and controller node power supplies can vary slightly according to manufacturer and location. Table 17 Power Supply LED Displays LED Power supply status AC Appearance Steady green light Steady amber light No light Steady green light No light Indicates Power is on. Power supply error. Broken connection. AC is entering from an external source. No AC is entering from an external source (for example, when power is off or when using battery power). 54 Understanding T-Class Storage System LED Status

Battery Backup Unit LEDs Depending on the configuration, storage systems with HP 3PAR cabinets include one or more battery trays that hold up to four BBUs each. BBUs supply power to write the cache memory to the drive inside the node in the event of a power failure. BBUs contain two batteries, labeled battery a and battery b, and include the following LEDs (Figure 54 (page 55)): Figure 54 BBU LEDs (Magnetek) Table 18 BBU LED Displays LED Battery A, B Appearance Solid green light Flashing green light Solid amber No light Indicates Battery is charged. Battery is undergoing a test. Battery error. BBUs or power supply is turned off. Power Distribution Unit Lamps T-Class storage systems include four PDUs that contain two power bank lamps (Figure 55 (page 55)): Figure 55 Power Distribution Unit Lamps A blue illuminated lamp indicates that power is being supplied to a power bank. When the blue lamp is not illuminated, the power bank is not receiving AC input. Service Processor LEDs The following describes the LEDs for the Supermicro and the Supermicro II Service Processor LEDs. Service Processor LEDs 55

Supermicro Service Processor LEDs Supermicro Service Processor LEDs are located at the top of the service processor (Figure 56 (page 56)). Figure 56 Supermicro Service Processor LEDs Table 19 Supermicro Service Processor LED Displays LED Power Hard disk drive NIC Port 1, 2 Overheat Appearance No light Steady green light No light Flashing amber light No light Steady green light Flashing green light No light Steady red light Indicates Service processor is off. Service processor is on. No hard drive activity. Hard drive activity. Port is not connected. Port is connected. Network activity. Service processor temperature is normal. Service processor temperature is overheating. Supermicro II Service Processor Supermicro II Service Processor LEDs are located at the top of the service processor (Figure 57 (page 57)). 56 Understanding T-Class Storage System LED Status

Figure 57 Supermicro II Service Processor LEDs Table 20 Supermicro II Service Processor LED Displays LED Power Hard disk drive NIC Port 1, 2 Overheat Appearance No light Steady green light No light Flashing amber light No light Steady green light Flashing green light No light Steady red light Flashing red light Indicates Service processor is off. Service processor is on. No hard drive activity. Hard drive activity. Port is not connected. Port is connected. Network activity. Service processor temperature is normal. Service processor temperature is overheating. Service processor has a failed fan. Securing the Storage System After verifying that the storage system is functioning properly, secure the system by closing the rear door and locking it with the keys provided. WARNING! Hazardous energy is located behind the rear access door of the storage system cabinet. Use caution when working with the door open. Securing the Storage System 57

5 Understanding F-Class Storage System LED Status Using the F-Class Component LEDs Bezel LEDs The F-Class Storage System components have LEDs to indicate whether or not the hardware is functioning properly and to help identify errors. These LEDs help diagnose basic hardware problems. You can quickly identify hardware problems by examining the LEDs on all the components and using the following tables and illustrations in this chapter. If you detect any problems during inspection of the LEDs, contact your Authorized Service Provider. LEDs are located at the front of the F-Class Storage System on the bezel for quick assessment of node health. Figure 58 Bezel LEDs Table 21 Bezel LED Displays LED Fan 0, 1, 2, 3 Node 0, 1, 2, 3 Appearance Solid green light Solid amber light Flashing green light (1 blink per second) Flashing amber light (1 blink per second) Steady green light Rapidly flashing green (three blinks per second) Indicates Fan is operating normally. Fan error. Node is fully functional and part of the cluster. Node has a failed or missing power supply, fan or battery, but still operational. Node is in the process of joining the cluster. In conjunction with the nodes hot-plug LED being solid amber (see Controller Node LEDs on page 5.13), node is safe to remove. 58 Understanding F-Class Storage System LED Status

Table 21 Bezel LED Displays (continued) LED Appearance Steady amber light Steady amber and hot-plug LED amber (see Controller Node LEDs on page 5.13) Indicates Error within the node. Fatal node failure. Removing the Bezels and Unlocking the Door If your HP 3PAR cabinet has locking fascias, you must first remove the fascias to access the system bezel. WARNING! Hazardous energy is located behind the rear access door of the storage system cabinet. Use caution when working with the door open. To view the power supply, battery or PDU LEDs, open the rear door by unlatching the three latches on the door. NOTE: Many LEDs are visible without removing the bezels. To view the power supply, battery or PDU LEDs, open the rear door of the cabinet. Drive Chassis LEDs The drive chassis LEDs are located at the front and rear of the chassis. The drive chassis houses the following components, each with their own LEDs: One OPs panel Two interface cards Two power supply/cooling modules Figure 59 Drive Chassis Components OPs Panel LEDs The drive chassis OPs panel has the following LEDs : Using the F-Class Component LEDs 59

Figure 60 Drive Chassis OPs Panel LEDs 60 Understanding F-Class Storage System LED Status

Table 22 Drive Chassis OPs Panel LED Displays LED Power On Power Supply/Cooling/Temperature Fault LED Appearance Steady green light Steady amber light Indicates Used in conjunction with Power Supply/Cooling/Temperature Fault LED, 2GB Link Speed LED, Invalid Address LED, and System Fault LED as described below. Test state (5 seconds), if: Power On LED is steady green. System Fault LED is steady amber. Invalid Address LED is steady amber. 2GB Link Speed LED is steady green. Power supply or fan fault, if: Power On LED is steady green. System Fault LED is off. Over or under temperature, if: Power On LED is steady green. System Fault LED is flashing amber. Flashing amber light One power supply is removed if: Power On LED is steady green. System Fault LED is flashing amber. OPs to ESI communications failed, if: Power On LED is steady green. System Fault LED is steady amber. 2GBLink Speed LED Steady green light Test state (5 seconds), if: Power On LED is steady green. Power Supply/Cooling/Temperature Fault LED is steady amber. System Fault LED is steady amber. Invalid Address LED is steady amber. 2GB drive loop is selected, if Power On LED is steady green. Flashing green light No green light One or more drives are bypassed on at least one loop. The 5V aux is present, overall power fail, if Power On LED is green and all other LEDs are off. Using the F-Class Component LEDs 61

Table 22 Drive Chassis OPs Panel LED Displays (continued) LED Invalid Address LED Appearance Steady amber light Indicates Indicates test state (5 seconds), if: Power On LED is steady green. Power Supply/Cooling/Temperature Fault LED is steady amber. System Fault LED is steady amber. 2GB Link Speed LED is steady amber. Flashing amber light Invalid address mode ID switch setting if Power On LED is steady green. System Fault LED Steady amber light Test state (5 seconds), if: Power On LED is steady green. Power Supply/Cooling/Temperature Fault LED is steady amber. Invalid Address LED is steady amber. 2GB Link Speed LED is steady amber. Processor module in FC-AL failure, if: Power ON LED is steady green. Power Supply/Cooling/Temperature Fault LED is off. Unknown FC-AL module type installed, I2C Bus failure, or backplane autostart watchdog failure, if: Power ON LED is steady green. Power Supply/Cooling/Temperature Fault LED is off. Ops to ESI communication failure, if: Power ON LED is steady green. Power Supply/Cooling/Temperature Fault LED is flashing. Flashing amber light Over or under temperature, if: Power On LED is steady green. Power Supply/Cooling/Temperature Fault LED is steady amber. Power supply is removed if: Power On LED is steady green. Power Supply/Cooling/Temperature Fault LED is flashing. No drives fitted, if: Power ON LED is steady green. Power Supply/Cooling/Temperature Fault LED is off. 62 Understanding F-Class Storage System LED Status

Interface Card LEDs The drive chassis contains two interface cards, FC-AL-A and FC-AL-B, with the following LEDs: Figure 61 Interface Card LEDs Table 23 Interface Card LED Displays LED Host Port 0, 1, 2, 3 Signal Good Loop Status Module Fault Appearance Steady green light Steady green light No light Flashing green light Steady amber light Indicates The incoming Fibre Channel signal is good. All device ports are good at 2GB. All device ports are good at 1GB. Drives are bypassed by module. FC-AL module is failed. Power Supply/Cooling Module LEDs Drive chassis power supplies/cooling modules have the following LEDs: Using the F-Class Component LEDs 63

Figure 62 Drive Chassis Power Supply/Cooling Module LEDs Table 24 Power Supply/Cooling Module LED Displays LED Power Supply Good AC Input Fail Fan Fault DC Output Fail Appearance Steady green light Steady amber light Steady green light Steady amber light Steady green light Steady amber light Steady green light Steady amber light Indicates The power supply is operating normally. The power supply is not operating correctly. Indicates the AC input is normal. Indicates AC input failure. Indicates the fan is operating normally. There is a fan fault. DC output is normal. DC output failure. Drive Magazine LEDs Drive magazine LEDs are located at the front of the storage system and contain the following LEDs: 64 Understanding F-Class Storage System LED Status

Figure 63 Drive Magazine LEDs Table 25 Drive Magazine LED Displays LED Activity Fault Appearance Steady green light Blinking green light Slowly blinking green light (once every 3 seconds) No light Steady amber light No light Slowly blinking amber light Indicates Drive power is present. There is drive activity. The drive has spun down. A drive is not present. There is a drive fault. No drive is present. Drive power is on. Drive activity. The drive is bypassed by the FC-AL module or ready for removal. Controller Node LEDs Depending on the configuration, storage systems contain two or four controller nodes, all located in the storage system chassis. Controller nodes contain the following LEDs (Figure 64 (page 66)): Using the F-Class Component LEDs 65

Figure 64 Controller Node LEDs Table 26 Controller Node LED Displays LED Disk hot plug Node hot plug Node status Ethernet activity Ethernet status Appearance Steady amber light No light Steady amber light No light Flashing green light (1 blink per second) Flashing amber light(1 blink per second) Steady green light Rapidly flashing green (three times per second) Steady amber light Solid amber Steady green light Flashing green light No light Steady amber light Indicates Disk is prepared for hot plug. Disk is not prepared for hot plug. In combination with the status LED blinking green three times per second, indicates the node is prepared for removal. In combination with the status LED being solid, indicates a fatal failure. The node is not prepared for removal. The node is fully functional and part of the cluster. The node has a failed or missing power supply, fan, battery backup unit, or TOD battery but the node is still operational. The node is in the process of joining the cluster. In combination with the service (hot plug) LED being solid amber, the node is safe to remove. An error within the node. In combination with the service (hot plug) LED being amber, a fatal node failure. An Ethernet link. No Ethernet activity. No Ethernet connection. 1000 MB/s mode 66 Understanding F-Class Storage System LED Status

Table 26 Controller Node LED Displays (continued) LED Appearance Steady green light No light Indicates 100 MB/s mode 10 MB/s mode (or disconnected) Fibre Channel Port LEDs The Fibre Channel adapter in the controller node also contains Fibre Channel port LEDs: Figure 65 4-Port Fibre Channel LEDs Table 27 Fibre Channel Adapter LED Displays LED Appearance No light Steady green light Flashing green light Indicates Wake up failure (dead device) Normal - link up at 2-4GBs/s Link down or not connected QLogic iscsi Port LEDs The QLogic iscsi adapter contains two ports with one LED for each port. Figure 66 iscsi Adapter Port LEDs Using the F-Class Component LEDs 67

Table 28 iscsi Adapter Port LED Displays LED Appearance No light Steady green light Flashing green light Indicates No connection or active link. Link is established. Receiving or transmitting activity. Emulex Fibre Channel Port LEDs The Emulex Fibre Channel adapter in the controller node also contain Fibre Channel port LEDs. Two port Emulex Fibre Channel adapters are only used in an F-Class Storage System (Figure 67 (page 68)). Figure 67 Emulex 2-Port Fibre Channel LEDs Table 29 Fibre Channel Port Status LED Displays (Emulex 2-Port Adapter) Yellow LED Internal Test Only Internal Test Only Internal Test Only Green LED Off On Slow Blink Port Status Wake-Up Failure (dead device) Normal - Link up at 1-4 GB/sec Normal - Link Down 68 Understanding F-Class Storage System LED Status

Controller Node Power Supply LEDs F-Class Storage System controller node power supply units are located on both sides of the controller nodes. The battery is integral to the controller node power supply. The LEDs are located on the rear of the power supply units: Figure 68 Controller Node Power Supply LEDs Table 30 Power Supply LED Displays LED Power supply status AC Battery status Appearance Steady green light Steady amber light No light Steady green light No light Steady green light Blinking green light Steady amber light Indicates Power is on. Power supply error. Broken connection to the power source. AC is entering from an external source. No AC is entering from an external source (for example, when power is off or when using battery power). The battery is charged. The battery is undergoing a test. There is a battery error. Power Distribution Unit Lamps The F-Class Storage Systems include four PDUs that contain two power bank lamps (Figure 69 (page 69)): Figure 69 Power Distribution Unit Lamps Using the F-Class Component LEDs 69

A blue illuminated lamp denotes that power is being supplied to a power bank. When the blue lamp is not illuminated, the power bank is not receiving AC input. Service Processor LEDs The following describes the LEDs for the Supermicro and the Supermicro II Service Processor LEDs. Supermicro Service Processor The Supermicro Service Processor LEDs are located at the top of the service processor (Figure 70 (page 70)). Figure 70 Supermicro Service Processor LEDs Table 31 Supermicro Service Processor LED Displays LED Power Hard disk drive NIC Port 1, 2 Overheat Appearance No light Steady green light No light Flashing amber light No light Steady green light Flashing green light No light Steady red light Indicates Service processor is off. Service processor is on. No hard drive activity. Hard drive activity. Port is not connected. Port is connected. Network activity. Service processor temperature is normal. Service processor temperature is overheating. Supermicro II Service Processor Supermicro II Service Processor LEDs are located at the top of the service processor (Figure 71 (page 71)). 70 Understanding F-Class Storage System LED Status

Figure 71 Supermicro II Service Processor LEDs Table 32 Supermicro II Service Processor LED Displays LED Power Hard disk drive NIC Port 1, 2 Overheat Appearance No light Steady green light No light Flashing amber light No light Steady green light Flashing green light No light Steady red light Flashing red light Indicates Service processor is off. Service processor is on. No hard drive activity. Hard drive activity. Port is not connected. Port is connected. Network activity. Service processor temperature is normal. Service processor temperature is overheating. Service processor has a failed fan. Securing the Storage System After verifying that the storage system is functioning properly, secure the system by closing the rear door and locking it with the keys provided. WARNING! Hazardous energy is located behind the rear access door of the cabinet. Use caution when working with the door open. Securing the Storage System 71

6 Understanding HP 3PAR StoreServ 10000 Storage LED Status The storage system components have LEDs to indicate whether or not the hardware is functioning properly and to help identify errors. The LEDs help diagnose basic hardware problems. You can quickly identify hardware problems by examining the LEDs on all of the components and using the tables and illustrations in this chapter. If you detect any problems during inspection of the LEDs, contact your Authorized Service Provider. Drive Cage LEDs The DC4 drive chassis holds one DC4 drive cage housing two drive cage FC-AL modules and a maximum of ten drive magazines. Figure 72 DC4 Drive Cage 72 Understanding HP 3PAR StoreServ 10000 Storage LED Status

DC4 Drive Cage FC-AL Module LEDs The DC4 drive cage FC-AL modules have the following LEDs: Figure 73 FC-AL LED and Port Locations Table 33 Drive Cage DC4 FC-AL Module LEDs LED RX TX FC-AL status Appearance Steady green light No light Steady green light No light Steady green light Flashing green light (1 blink per second) Steady amber light Indicates A presence of a small form-factor pluggable optical transceiver (SFP) and a valid signal from the node. No connection to the node or no SFP is installed. A presence of an SFP and that the LED is on and transmitting. No SFP is present or the SFP transmitter failed. The drive cage is functioning properly, but is not communicating with any nodes. The drive cage is connected and communicating with the system manager of a node in the cluster. Normal, initial indication for two seconds upon power up. Otherwise, Drive Cage LEDs 73

Table 33 Drive Cage DC4 FC-AL Module LEDs (continued) LED Hot plug 4GB/s Appearance Flashing amber light (1 blink per second) Rapid toggle between amber and green light Steady amber light No light Steady green light No light Indicates FC-AL module error or other cage error. If both FC-AL modules have a steady light, the temperature of a disk drive in the drive-cage has exceeded its high-level threshold, or a power supply has failed. The drive cage has some type of error, such as a failed or missing power supply, but is communicating with a node. A cage firmware upgrade initiated by the upgradecage CLI command is in progress. A firmware upgrade normally takes less than two minutes to complete. The FC-AL module is prepared for hot plug replacement. The FC-AL module is not prepared for hot plug. The transfer rate is operating at 4GB/s. The transfer rate is not operating at 4GB/s. 74 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Drive Magazine LEDs NOTE: After powering on, allow approximately two minutes for the disks on the drive magazine to spin up before checking the drive magazine LEDs. Drive magazines have the following LEDs: Figure 74 Drive Magazine LEDs Table 34 Drive Magazine LEDs LED Drive magazine status Disk status Hot plug Appearance Steady green light Steady amber light Quick flashing, or 20 percent on, 80 percent off green light Steady green light Flashing green light No light Steady amber light Steady amber light Flashing amber light No light Indicates The drive magazine is functioning properly. A drive magazine error, or one or more drives are bypassed on at least one path. The disk is not spun up but has power. The disk is spun up and waiting for a command. The disk is executing commands. No disk is present. A disk error, or the disk is bypassed on both paths (loops). The drive magazine is prepared for hot plug replacement. That there is a connection failure between the drive magazine and the drive chassis. The drive magazine is not prepared for hot plug. Drive Cage LEDs 75

Controller Node LEDs Depending on configuration, storage systems contain between two and eight controller nodes, all located in the chassis. Controller nodes have the following LEDs: NOTE: You can issue the locatenode command to flash all service LEDs associated to a controller node blue. This includes the power supplies, battery modules, and fan module LEDs. Table 35 Controller Node LEDs LED Node Disk Appearance No light Indicates Normal operation. Node Service Steady blue In combination with the status LED blinking green three times per second, indicates the controller node is prepared for removal. In combination with the status LED being solid, indicates a fatal node failure. In combination with the node status LED blinking green or amber one time per second, indicates the servicenode start command was issued to illuminate the node service LEDs. Node Status No light Flashing blue light Flashing green light Steady green light Normal operation. The locatenode command was issued to locate the node or the FRU is not fully seated. A quick flashing light means the node is booting. A slow flashing light means the node is part of the cluster. The node is booting but has not joined the cluster. 76 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Table 35 Controller Node LEDs (continued) LED HBA Service Appearance Rapidly flashing green light (three times per second) Flashing amber light Steady amber light Blue Indicates The node is booting, or, in combination with a blue service LED, the node is safe to remove. The node has joined the cluster but there is a degraded component associated with the node. A slow flashing light means the node is part of the cluster. An error within the node. The servicenode start command was issued to illuminate the service LED or the HBA has failed and needs to be replaced. If the LED is off, the HBA is normal. Controller Node Status Panel LEDs The controller node LED status panel is located at the front of the system. The 10400 includes four LEDs and the 10800 has eight LEDs. Each LED on the node-chassis panel should be identical to the individual controller node status LED, as shown in the Node Status LED section of the Controller Node LEDs table. Figure 75 LED Status Panel on a 10400 Controller Node LEDs 77

Fan Module LEDs The 10400 controller node chassis can hold up to eight fan modules that each hold two fans, and the 10800 can hold up to 16. Fan modules have the following LEDs: Table 36 Fan Module LEDs LED Status Service Appearance Green Amber Solid Blue Blue Blinking Off Indicates Normal operation, no faults. Fan speed is too low, failed, off or not working properly. With a blue service LED, the fan module failed and was not able to recover in 60 seconds. Replace the fan module. The servicenode start fan has been issued. With the amber status LED, the fan module is failed and needs servicing. The locatenode fan command has been issued. Node fan module no longer needs servicing. 78 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Fibre Channel Adapter Port LEDs The Fibre Channel adapter in the controller node also contains Fibre Channel port LEDs: Figure 76 Fibre Channel LEDs Table 37 Fibre Channel Adapter LEDs LED Port 1-4 (Port speed) (Link status) Appearance No light Amber light off Amber (3 fast blinks) Amber (4 fast blinks) Steady green light Flashing green light Indicates Wake up failure (dead device) or power is not applied. Not connected. Connected at 4GB/sec. Connected at 8GB/sec. Normal/Connected - link up. Link down or not connected. Fibre Channel Adapter Port LEDs 79

CNA Port LEDs The Converged Network Adapter (CNA) includes two ports with corresponding LEDs: Figure 77 CNA Port LEDs Table 38 CNA Port LEDs LED Link ACT (Activity) Appearance No light Steady green light No light Flashing green light Indicates Link down Link up No activity. Activity 80 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Ethernet LEDs The controller node has two built-in Ethernet ports and each port contains two LEDs: Figure 78 Ethernet LEDs Table 39 Ethernet LEDs LED ACT/LNK (top E0, E1) Speed (bottom E0, E1) Appearance Steady green light Flashing green light No light Steady yellow light Steady green light No light Indicates Valid link partner Data activity ACT/LNK is off 1000Mb/sec mode 100Mb/sec mode 10Mb/sec mode Ethernet LEDs 81

Power Supply LEDs Power supplies are located at the rear of the storage system. The drive chassis and controller node power supplies have the following LEDs: Drive Chassis Power Supply LEDs Drive chassis power supplies are located at the rear of the drive chassis. Figure 79 Drive Chassis Power Supply LEDs Table 40 Drive Chassis Power Supply LEDs LED Power Supply Status AC Appearance Steady green light Steady amber light No light Steady green light No light Indicates Power is on. Power supply error. Broken connection. AC is entering from an external source. Power supply output is off. 82 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Controller Node Power Supply LEDs The controller node power supplies are located behind the cable management tray in the node chassis. Figure 80 Controller Node Power Supply LEDs The power supply service LED is located on the dividers between the power supplies. Figure 81 Controller Node Power Supply Service LED Table 41 Controller Node Power Supply LEDs LED Power Status AC Status Fault Service Appearance Steady green light Steady amber light No light Steady green light No light Steady amber light Blue Indicates Power is on. Power supply error. Broken connection. AC is entering from an external source. Power supply output is off. Failed power supply. The servicenode start or locatenode command was issued to illuminate the service LED or the power supply has failed and needs to be replaced. Power Supply LEDs 83

Battery Module LEDs Depending on configuration, storage systems include one or two battery compartments that hold up to four battery modules each. Each node has one battery module. Each battery module has three LEDs: Figure 82 Battery Module LEDs Table 42 Battery Module LEDs LED Charging Discharging Service LED Appearance Green Amber Off Green Off Blue Off Indicates Battery modules is being charged. Battery module is at fault. Battery module is not in node or connected. Battery module output is on and supplying power to the node. Battery module is not providing power to the node. Battery module needs servicing or the servicenode start or locatenode command was issued. Battery module no longer needs servicing. 84 Understanding HP 3PAR StoreServ 10000 Storage LED Status

Power Distribution Unit Lamps Each storage system includes four PDUs that contain two power bank lamps: Figure 83 PDU Lamps Table 43 PDU Lamps LED Lamp Appearance Steady green light Off Indicates Power is being supplied to a power bank and the circuit breaker is turned ON. Power bank is not receiving AC input or the circuit breaker is turned OFF. Power Distribution Unit Lamps 85

Service Processor LEDs The LEDs are located at the top of the SP: Figure 84 Service Processor LEDs Table 44 SP LEDs LED Power Hard disk drive NIC Port 1/2 Overheat Appearance No light Steady green light No light Flashing amber light No light Steady green light Flashing green light No light Steady red light Flashing red light Indicates Service processor is off. Service processor is on. No hard drive activity. Hard drive activity. Port is not connected. Port is connected. Network activity. Service processor temperature is normal. Service processor temperature is overheating. Service processor has a failed fan. 86 Understanding HP 3PAR StoreServ 10000 Storage LED Status

7 Power Off/On Procedures Powering Off the Storage System When it is necessary to power off the storage system, use the following steps to safely remove power from the storage system and the service processor (SP). NOTE: PDUs in any expansion cabinets connected to the storage system may need to be shut off. Use the locatesys command to identify all connected cabinets. locatesys will blink all node and drive cage LEDs. Note this information now, as it is needed for the last step in this procedure. To power off the storage system: 1. Connect the maintenance PC using the serial connection or SSH to the SP. See Connecting to the Service Processor (page 88). 2. Start an spmaint session. NOTE: If using SPOCC, on the SPOCC homepage, click Support > SPMAINT on the Web > InServ Product Maintenance > Halt an InServ cluster/node and skip to step 7. 3. In the 3PAR Service Processor Menu, select option 4, InServ Product Maintenance. 4. Select option 6, Halt an InServ cluster/node. 5. Select the desired system and confirm all prompts to halt the system. 6. Press x to return to the 3PAR Service Processor Menu. CAUTION: Failure to wait until all controller nodes are in a halted state as defined in Step 7could cause the system to view the shutdown as uncontrolled and place the system in a checkld state upon power up. This can seriously impact host access to data. 7. Allow 2-3 minutes for the system to halt, then verify the node status LEDs are flashing green (at a rate of three blinks per second) and the node hot-plug LEDs are solid amber (for the HP 3PAR StoreServ 10000, the node service LED is blue) which indicate the nodes have halted. For more information see the LED chapters in this manual. 8. Select option 1, SP Control/Status. 9. Select option 3, Halt SP. 10. When prompted, press Y to confirm halting the SP. 11. Wait approximately 30 seconds and verify if the LED on the front of the SP is no longer illuminated. 12. Remove AC to the storage system by turning off all of the PDU circuit breakers in the cabinet. 13. If necessary, replace the bezel and close and lock the rear door. Powering On the Storage System To power on the storage system: NOTE: The system takes approximately 10-15 minutes to become fully operational providing it was gracefully shut down. If the system was powered off abruptly, powering on could take considerably longer. If the TOC is over a day old, it is considered invalid, and the setsysmgr tocgen command must be issued to select the appropriate TOC. Refer to the InForm OS CLI Reference for more information. Procedure 1 1. Turn on AC power to the cabinet(s) by turning on all of the PDU circuit breakers. Powering Off the Storage System 87

2. Verify that the blue LED on the front of the SP is illuminated. 3. Verify that all drive chassis LEDs are solid green and all controller node status LEDs are blinking green once per second. Connecting to the Service Processor Once you are connected to the SP, there are two SP user interfaces, SPOCC and SPMAINT, that you can use to perform various administrative and diagnostic tasks to support of both the storage system and the SP. Refer to Logging into the SP Onsite Customer Care Interface (SPOCC) (page 92). NOTE: Establishing a Secure Shell Session (SSH) is required when connecting the SP through LAN (Ethernet). Refer to Using PuTTY (page 91). Using a Serial Connection To connect the maintenance PC to the SP using a serial connection, refer to the appropriate HP 3PAR Storage System Maintenance Manual, Connecting the Maintenance PC chapter. Using an Ethernet Connection To connect the maintenance PC to the SP through the private Local Area Network (LAN) using an Ethernet cable, you must first configure the LAN settings on the maintenance PC. You can connect the maintenance to the SP using an Ethernet cable. When you use an Ethernet connection, you have to configure LAN settings on the maintenance PC (refer to Section (page 89)) and establish an SSH using PuTTY. Refer to Section (page 91). To connect using an Ethernet connection: 88 Power Off/On Procedures

1. Unlock and open the rear door of the storage system cabinet. If necessary, insert a red crossover Category 5 Ethernet cable (RJ45 to RJ45) into the proper Ethernet port of the SP (ETH1), refer to the following figures. Figure 85 Wintec Service Processor Ethernet Ports Figure 86 Supermicro Service Processor Ethernet Ports Figure 87 Supermicro II Service Processor Ethernet Ports NOTE: The Supermicro and Wintec Service Processor Ethernet port (ETH0) corresponds with the front NIC Port LED 1 and Ethernet port (ETH1) corresponds with the front NIC Port LED 2. 2. Connect the free end of the crossover Ethernet cable to the Ethernet port in the maintenance PC. 3. Power on the maintenance PC. 4. Configure the LAN settings on the maintenance PC. See Configuring the LAN Settings on the Maintenance PC (page 89). Configuring the LAN Settings on the Maintenance PC NOTE: For Windows Vista users, go to Control Panel > Network and Internet > Network Connections and right-click on the Local Area Connection icon and select Properties. Once on the Networking tab, skip to step 4. 1. Right-click the My Network Places desktop icon to open the shortcut menu and select Properties. 2. In the Network and Dial-up Connections window, right-click the Local Area Connection icon to open the Local Area Connections Properties menu. 3. Click Properties to open the Local Area Connection Properties dialog box ( Local Area Connection Properties Dialog Box (page 90)). Connecting to the Service Processor 89

Figure 88 Local Area Connection Properties Dialog Box 4. Double-click Internet Protocol (TCP/IP). The Internet Protocol (TCP/IP) Properties dialog box appears ( Internet Protocol (TCP/IP) Properties Box (page 90)). Figure 89 Internet Protocol (TCP/IP) Properties Box 5. In the Internet Protocol (TCP/IP) Properties dialog box, click the Use the following IP address button, then type the following IP addresses: Table 45 IP Addresses IP address Subnet mask Default gateway 10.255.155.49 255.255.255.248 None. 90 Power Off/On Procedures

Using PuTTY 6. Click OK. 7. Click OK in the Advanced TCP/IP Settings dialog box to finish configuring the LAN connection. 8. Initiate a SSH using PuTTy. Refer to Using PuTTY (page 91). After you have configured LAN settings and established an Ethernet connection, use PuTTY to initiate a SSH between the maintenance PC and the SP. 1. Go to the permanent location where you extracted putty.zip and double-click the putty.exe file. 2. In the PuTTY Configuration dialog box that appears, type the SP IP address in the Host Name (or IP address) box, click the SSH protocol button, then click Open ( PuTTY Configuration Dialog Box (page 91)). Figure 90 PuTTY Configuration Dialog Box 3. If you are connecting to the SP for the first time, the PuTTY Security Alert dialog box appears. Click Yes. 4. In the PuTTY main window, type your user ID and press ENTER then type your password and press ENTER. Connecting to the Service Processor 91