d Technical Report Introduction to NetApp E-Series E2700 with SANtricity 11.10 Todd Edwards, NetApp March 2014 TR-4275 1 Introduction to NetApp E-Series E2700 with SANtricity 11.10
TABLE OF CONTENTS 1 NetApp E-Series E2700 Architecture... 5 1.1 E2700 Hardware Using NetApp SANtricity 11.10...5 1.2 Expansion Drive Shelf Using E2700 Controllers... 25 2 Management of E-Series... 36 2.1 SANtricity 11.10 Out-of-Band Management... 36 2.2 Standard and Premium Features Using SANtricity 11.10... 40 2.3 E-Series Product Support... 43 3 Summary... 45 LIST OF TABLES Table 1) E2700 physical characteristics.... 10 Table 2) E2700 power specifications.... 10 Table 3) E2700 technical specifications.... 10 Table 4) SANtricity software boundaries for E2700-based storage systems.... 11 Table 5) E2700 controller-drive shelf LED definitions (front panel).... 14 Table 6) E2760 controller-drive shelf power supply and fan unit LED definitions (rear view).... 15 Table 7) E2724 and E2712 controller-drive shelf power supply LED definitions (rear view).... 16 Table 8) Ethernet management port LED definitions.... 17 Table 9) Host-side SAS ports LED definitions.... 18 Table 10) Controller base features LED definitions.... 18 Table 11) Drive-side SAS ports LED definitions.... 19 Table 12) 4-port and 2-port 12Gb SAS HIC LED definitions... 21 Table 13) 4-port and 2-port 16Gb FC HIC LED definitions (FC link rate).... 23 Table 14) 2-port 10Gb iscsi HIC LED definitions.... 24 Table 15) SAS drive expansion port LED definitions.... 26 Table 16) Ethernet management port LED definitions.... 26 Table 17) ESM and expansion drive shelf status LEDs.... 26 Table 18) DE6600 drive shelf LED definitions (front view).... 27 Table 19) DE6600 integrated fan unit and power supply LED definitions (rear view).... 28 Table 20) DE5600 drive shelf LED definitions (front view).... 29 Table 21) DE5600 power supply status LEDs (rear view).... 30 Table 22) Drive and shelf specifications per shelf type.... 31 Table 23) Drive shelf power specifications.... 31 2 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LIST OF FIGURES Figure 1) E2700 shelf options (simplex not shown)....6 Figure 2) E2700 with optional HICs....7 Figure 3) E2760 front view without bezel...8 Figure 4) E2760 rear view....8 Figure 5) E2724 front view....9 Figure 6) E2724 rear view....9 Figure 7) E2712 front view....9 Figure 8) E2712 rear view....9 Figure 9) LEDs on the front panel of the E2760 controller-drive shelf.... 13 Figure 10) LEDs on the front panel of the E2724 and E2712 controller-drive shelves.... 13 Figure 11) LEDs on the E2760 integrated power supply and fan unit (rear view).... 15 Figure 12) LEDs on the E2724 and E2712 power supply unit (rear view).... 16 Figure 13) LEDs on the left side of the E2700 controller module.... 17 Figure 14) LEDs for the drive expansion ports.... 19 Figure 15) LEDs for the 4-port 12Gb SAS HIC.... 20 Figure 16) LEDs for the 2-port 12Gb SAS HIC.... 21 Figure 17) LEDs for the 4-port 16Gb FC HIC.... 22 Figure 18) LEDs for the 2-port 16Gb FC HIC.... 23 Figure 19) LEDs for the 2-port 10Gb iscsi HIC.... 24 Figure 20) ESM ports and LEDs.... 25 Figure 21) LEDs on the DE6600 drive shelf (front view).... 27 Figure 22) DE6600 rear view with dual ESMs, power supplies, and fan modules.... 28 Figure 23) LEDs on the DE5600 drive shelf (front view).... 29 Figure 24) DE5600 rear view.... 30 Figure 25) DE1600 front view.... 30 Figure 26) Typical E2700 storage system configuration with one DE6600 drive shelf.... 32 Figure 27) Typical E2700 storage system configuration with either the DE1600 or the DE5600 drive shelf.... 32 Figure 28) Typical E2700 storage system dual stack configuration with either the DE1600 or the DE5600 drive shelf.33 Figure 29) Typical E2700 storage system simplex dual stack configuration with either the DE1600 or the DE5600 drive shelf.... 34 Figure 30) Typical E2700 storage system single stack simplex configuration with the DE6600 drive shelf.... 34 Figure 31) SANtricity management client EMW.... 37 Figure 32) SANtricity management client AMW.... 38 Figure 33) Out-of-band management topology.... 39 Figure 34) EMW Devices tab with ASUP icon selected.... 40 Figure 35) EMW ASUP settings and options.... 40 Figure 36) SANtricity 11.10 Premium Features and Feature Pack information dialog box.... 42 Figure 37) Serial number locations on the shelf.... 44 3 Introduction to NetApp E-Series E2700 with SANtricity 11.10
4 Introduction to NetApp E-Series E2700 with SANtricity 11.10
1 NetApp E-Series E2700 Architecture 1.1 E2700 Hardware Using NetApp SANtricity 11.10 Overview NetApp E2700 storage systems address wide-ranging requirements with balanced performance that is equally adept at handling throughput for sequential I/O applications and high IOPS requirements for transactional databases. The E2700 brings together the following advantages: Modular host interface flexibility (SAS, FC, and iscsi) Excellent storage density High reliability Intuitive management Together, these features create an entry to a midrange storage system that is perfectly suited for dataintensive solutions, high bandwidth intensive streaming applications, transaction-intensive workloads, and high-performance file system requirements without sacrificing simplicity and efficiency. In addition, its fully redundant I/O paths, advanced protection features, and extensive diagnostic capabilities deliver a high level of availability, integrity, and security. E2700 Controller Packaging Options The E2700 controller is available with three shelf options: E2760, E2724, and E2712. These packaging options support both spinning media and solid-state drives (although SSD is not supported in the E2712) to meet a wide range of customer performance and applications requirements. All three shelf types support dual controller packs, dual power supplies, and dual fan units for redundancy. It is also possible to have the three shelf types in a simplex configuration with only one controller. The shelves are sized to hold 60 drives, 24 drives, or 12 drives, respectively, as shown in Figure 1. This document uses the following terms interchangeably with the terms used in the NetApp SANtricity management software and E-Series technical publications: Shelf - shelf - enclosure Drive shelf - drive tray Drive - disk Module - canister The term drawer is used only to describe the five drawers in the DE6600 shelf and does not apply to other shelf models 5 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 1) E2700 shelf options (simplex not shown). The E2700 controller module supports multiple optional host interface cards (HICs), shown in Figure 2. The controller module must be removed from the storage system to install an optional HIC. The iscsi functionality labeled in Figure 2 refers to the combination FC-iSCSI optical HIC, which is not available with the SANtricity 11.10 release. However, the 2-port iscsi copper HIC does provide iscsi functionality in this release. Refer to Figure 19 and Table 14 for details on the 2- port 10Gb iscsi HIC. 6 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 2) E2700 with optional HICs. E2760 Controller-Drive Shelf The E2760 is a 4U shelf that holds up to 60 3.5" or 2.5" drives in 5 horizontal drawers (12 drives per drawer). It features dual RAID controllers, dual power modules, and dual fan modules with two fans in each module. An E2760-based storage system supports a maximum of 180 drives by using only 60-drive shelves, or 192 drives by using a mix of expansion drive shelf models. A minimum of 20 drives must be installed in the E2760 controller-drive shelf (and in each 60-drive expansion drive shelf that is added to the system). These drives must be installed in the four front drive slots in each drawer. 7 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Operating the storage system without populating all four front drive slots in each drawer can lead to overheating concerns. On the E2760 shelf, the bezel must be installed during normal operation. Refer to Table 3 for more details on the E2760 technical specifications. Figure 3 and Figure 4 show the front and rear views, respectively, of the E2760 controller-drive shelf. Figure 3) E2760 front view without bezel. Figure 4) E2760 rear view. E2724 Controller-Drive Shelf The E2724 is a 2U shelf that holds up to 24 2.5" drives. It features dual RAID controllers and dual integrated power and fan modules. An E2724-based storage system supports a maximum of 192 drives and a mix of expansion drive shelf models in a single system. Refer to Table 3 for more details on the E2724 technical specifications. The E2724 has a proven track record of reliability and scalability to satisfy requirements in remote dedicated environments or primary data centers. Figure 5 and Figure 6 show the front and rear views, respectively, of the E2724 controller-drive shelf. 8 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 5) E2724 front view. Figure 6) E2724 rear view. E2712 Controller-Drive Shelf The E2712 is a 2U shelf that holds up to 12 3.5" drives. It features dual RAID controllers and dual integrated power and fan modules. An E2712-based storage system supports a maximum of 192 drives and a mix of expansion drive shelf models. Refer to Table 3 for more details on the E2712 technical specifications. The E2712 has a proven track record of reliability in remote dedicated environments. Figure 7 and Figure 8 show the front and rear views, respectively, of the E2712 controller-drive shelf. Figure 7) E2712 front view. Figure 8) E2712 rear view. E2700 Hardware Specifications The E2700 controller has the following base hardware features: Dual Ethernet ports for management-related activities SAS, FC, or iscsi ports for host connection One of the host I/O port options must be ordered when the controller is purchased. SAS drive expansion ports to attach expansion drive shelves 9 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Table 1 lists the physical characteristics of the E2760, E2724, and E2712 controller-drive shelves. Table 1) E2700 physical characteristics. Dimensions and Weight E2760 Controller-Drive Shelf (DE6600 Drive Shelf) E2724 Controller-Drive Shelf (DE5600 Drive Shelf) E2712 Controller-Drive Shelf (DE1600 Drive Shelf) Height 7.0" (17.78cm) 3.47" (8.81cm) 3.4" (8.64cm) Width 19" (48.26cm) 19" (48.26cm) 19" (48.26cm) Depth 32.5" (82.55cm) 19.6" (49.78cm) 21.75" (55.25cm) Weight (maximum) 232lb. (105.2kg) 57.32lb. (26kg) 59.52lb. (27kg) Table 2 lists both the typical power specifications and the equipment-rated power specifications of the three E2700 controller-drive shelves. The table assumes that the shelves are in a dual controller configuration and fully loaded with drives. Table 2) E2700 power specifications. E2700 Controller-Drive Shelf Typical Operating Power Rated Power KVA Watts (AC) BTU/hr KVA Watts (AC) BTU/hr E2760 with HIC (4TB drives fully populated) E2724 with HIC (900GB 10K RPM drives fully populated) E2712 with HIC (4TB drives fully populated) 1.034 1,024 3,495 1.526 1,512 5,162 0.455 451 1,539 0.908 900 3,073 0.409 406 1,329 0.908 900 3,073 Table 3 lists the technical specifications of E2700-based storage systems. Table 3) E2700 technical specifications. Specification E2760 E2724 E2712 Maximum raw capacity 768TB 230TB 768TB Maximum number of drives 192 192 192 Form factor 4U 60 drives 2U 24 drives 2U 12 drives Drive types supported 800GB 2.5" SSD (25 per shelf max., 75 per storage system max.) 800GB 2.5" SSD (120 per storage system max.) N/A 1.2TB, 900GB, or 600GB 2.5" 10K RPM SAS 1.2TB, 900GB, or 600GB 2.5" 10K RPM SAS 600GB 3.5" 15K RPM SAS (restricted to add-on for existing system only EOL) 4TB, 3TB, or 2TB 3.5" 7.2K RPM SAS N/A 4TB, 3TB, or 2TB 3.5" 7.2K RPM SAS Memory Onboard I/O 4GB per controller module (upgradable to 8GB per controller) 2-port 12Gb SAS per controller module 10 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Specification E2760 E2724 E2712 Optional I/O 2-port or 4-port 12Gb SAS per controller module) 4 or 8 port 16Gb FC (2-port or 4-port 16Gb FC per controller module) 4 port 10Gb iscsi (2-port 10Gb iscsi per controller module) Drive shelves supported for expansion drive offerings DE6600 (4U 60 drives): 3 shelves max.; supports the same drive types as E2760 DE5600 (2U 24 drives): 8 shelves max.; supports the same drive types as E2724 DE1600 (2U 12 drives): 16 shelves max.; supports the same drive types as E2712 High-availability features Dual active controllers with automated I/O path failover Support for RAID levels 0, 1 (10 for four drives or more), 5, and 6 Redundant, hot-swappable storage controllers, disk drives, power supplies, and cooling fans SANtricity proactive drive health monitoring to identify problem drives before they create issues Automatic drive fault detection, failover, and rebuild by using global hot spare drives Mirrored data cache with battery backup and destage to flash SANtricity Persistent Monitor, for making periodic copies of the storage system configuration For additional information, refer to the NetApp E2700 Technical Specifications. SANtricity Software Specifications for E2700 Hardware Table 4 lists the SANtricity software specifications for E2700-based storage systems. Table 4) SANtricity software boundaries for E2700-based storage systems. Components Maximum Storage Hardware Components Shelves (system and expansion) 16 Drives 192 SSD cache capacity 5TB Logical Components Partitions 128 Volumes 512 Volumes per consistency group 32 Thin volumes per system 512 11 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Components Maximum Disk pools per system 20 NetApp Snapshot Copies Per Snapshot group 32 Per volume 128 Per storage system 512 Snapshot Volumes Per Snapshot copy 4 Per system 256 Snapshot Groups Per volume 4 Per system 256 Mirrors Legacy mirrors per system 16 (synchronous only) Mirrors per system 32 Mirrors per volume +1 Mirrors per asynchronous mirror group 32 Asynchronous mirror groups per system 4 E2700 Controller-Drive Shelf LEDs The E2700 controller-drive shelf has LED status indicators on the front of the shelf and on the power supply units and fan units installed at the rear of the shelf. The LEDs on the front panel indicate systemwide conditions, and the LEDs on the power supply units and fan units indicate the status of the individual units. Front Panel Status LEDs The status LEDs on the front panel of the E2760 controller-drive shelf are visible with or without the bezel installed. Figure 9 shows the LEDs on the front panel of the E2760 controller-drive shelf. 12 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 9) LEDs on the front panel of the E2760 controller-drive shelf. Figure 10 shows the LEDs on the front panel of the E2724 and E2712 controller-drive shelves. Figure 10) LEDs on the front panel of the E2724 and E2712 controller-drive shelves. 13 Introduction to NetApp E-Series E2700 with SANtricity 11.10
The LEDs on the front of the E2760 controller-drive shelf are ordered differently from those on the front of the E2724 and E2712 shelves. Table 5 defines the front panel LEDs on the E2760, E2724, and E2712 controller-drive shelves. The items in the table are listed in the order matching the layout on the E2760 controller-drive shelf. Table 5) E2700 controller-drive shelf LED definitions (front panel). LED Name Color LED On LED Off Power Green Power is present. Power is not present. Standby Green The controller-drive shelf is in standby mode. Shelf Locate White The LED lights up to make the controller-drive shelf easy to locate in the equipment rack. The controller-drive shelf is not in standby mode. Normal status. Shelf Over Temperature Amber The temperature of the controller-drive shelf has reached an unsafe level. Normal status. Service Action Required Amber A component in the controllerdrive shelf requires attention. Normal status. Power Supply and Fan Unit Status LEDs The E2760 controller-drive shelf supports dual power supplies and fan modules. Each power supply and fan module unit is equipped with status LEDs. Figure 11 shows the LEDs on the rear of the E2760 controller-drive shelf. 14 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 11) LEDs on the E2760 integrated power supply and fan unit (rear view). Table 6 defines the integrated power supply and fan unit LEDs on the rear of the E2760 controller-drive shelf. Table 6) E2760 controller-drive shelf power supply and fan unit LED definitions (rear view). LED Name Color LED On LED Off Standby Green The controller-drive shelf is in standby mode. The controller-drive shelf is not in standby mode. Output DC Power Green DC output power is present. DC output power is not present. Power Service Action Allowed Blue The controller-drive shelf is in service mode. The controller-drive shelf is not in service mode. Power Service Action Required Amber A power component in the controller-drive shelf requires attention. Normal status. Input AC Power Green AC power is present. AC power is not present. Fan Unit Service Action Allowed Blue The fan unit is in service mode. The fan unit is not in service mode. 15 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Fan Unit Service Action Required Amber The fan unit requires attention. Normal status. Fan Unit AC Power Green Fan AC power is present. Fan AC power is not present. The fan and power supply units for the E2724 and E2712 controller-drive shelves are identical. The power supply LEDs on the rear panel are shown in Figure 12 and are defined in Table 7. Figure 12) LEDs on the E2724 and E2712 power supply unit (rear view). Table 7) E2724 and E2712 controller-drive shelf power supply LED definitions (rear view). LED Name Color LED On LED Off Standby Green The controller-drive shelf is in standby mode. The controller-drive shelf is not in standby mode. Output DC Power Green DC output power is present. DC output power is not present. Power Service Action Allowed Blue The controller-drive shelf is in service mode. The controller-drive shelf is not in service mode. Power Service Action Required Amber A power component in the controller-drive shelf requires attention. Normal status. Input AC Power Green AC power is present. AC power is not present. E2700 Controller Module LEDs The E2700 controller module has several LED status indicators. The LEDs on the left side of the module refer to the onboard ports and to the base controller status. The LEDs on the right side of the module refer to the drive expansion ports and to the additional host connectivity interface options that are available with the E2700 controller: 4-port and 2-port 12Gb SAS HICs 4-port and 2-port 16Gb FC HICs 2-port 10Gb iscsi HIC 16 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Onboard Ports and Base Controller Status LEDs Figure 13 shows the onboard LED status indicators on the left rear side of the E2700 controller. Most of the LEDs are lit when a fault condition exists; however, the Battery Charging LED and the Cache Active LED are lit when the battery is fully charged and the cache is active, respectively. The Seven-Segment LEDs provide status codes for both normal operation and fault conditions; the dot in the first Seven- Segment LED is the controller heartbeat indicator, which comes on when an intercontroller communication link has been established. Figure 13) LEDs on the left side of the E2700 controller module. Table 8 defines the Ethernet management port LEDs on the controller (LEDs 1 through 4 in Figure 13). Table 8) Ethernet management port LED definitions. LED Name Color LED On LED Off Ethernet Management Port Link Rate (top left corner of management port RJ-45 connectors) Green There is a 100BASE-T rate. There is a 10BASE-T rate. 17 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Ethernet Management Port Link Active (top right corner of management port RJ- 45 connectors) Green Solid: The link is up without activity. Blinking: The link is up with activity. A link error has occurred. Table 9 defines the onboard host interface port LEDs (LEDs 5 through 8 in Figure 13). These LEDs indicate the connection status for each link between the storage system and host-side hardware. Table 9) Host-side SAS ports LED definitions. LED Name Color LED On LED Off Host Link 1 Fault Amber A link error has occurred. Normal status. Host Link 1 Active Green Solid: The link is up without activity. Blinking: The link is up with activity. A link error has occurred. Host Link 2 Fault Amber A link error has occurred. Normal status. Host Link 2 Active Green Solid: The link is up without activity. Blinking: The link is up with activity. A link error has occurred. Table 10 defines the controller or system status LEDs (LEDs 9 through 15 in Figure 13). Table 10) Controller base features LED definitions. LED Name Color LED On LED Off Battery Service Action Required Amber The battery in the controller module has failed. Normal status. Battery Charging Green Solid: The battery is fully charged. Blinking: The battery is charging. The controller module is operating without a battery, or the existing battery has failed. Controller Service Action Allowed Blue The controller module can be removed safely from the controller-drive shelf. The controller module cannot be removed safely from the controller-drive shelf. Controller Service Action Required Amber A fault exists within the controller module. Normal status. Cache Active Green Solid: The cache is active. Blinking: After an AC power failure, the cache offload is in process. The cache is inactive, or the controller module has been removed from the controllerdrive shelf. Dot in lower-right corner of first Seven-Segment LED Yellow (not amber) A flashing dot indicates that the controller heartbeat is active. If the dot is not lit, the controller heartbeat is not active (that is, the controller is not in service). 18 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Two Seven-Segment LEDs Yellow (not amber) If the controller status code equals 99, then the controller is in service. If the controller status code does not equal 99, then a fault condition exists. Contact Technical Support for further assistance. The controller is not powered on. The Battery Service Action Required LED indicates that the battery timer has expired or the battery has failed the automatic battery test. This condition can seriously affect the system write performance because the write cache feature is automatically disabled when the battery is not functioning normally. Drive-Side SAS Expansion Port LEDs The E2700 controller module is equipped with two SAS expansion ports that are used to connect expansion drive shelves to the E2700 controller-drive shelf. Figure 14 shows the SAS expansion port LEDs. Figure 14) LEDs for the drive expansion ports. Table 11 defines each drive-side LED. Table 11) Drive-side SAS ports LED definitions. LED Name Color LED On LED Off Drive Expansion Link Fault (Port 1 and Port 2) Amber At least one of the four PHYs in the output port is working, but another PHY cannot establish the same link to the expansion output connector. Normal status. 19 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Drive Expansion Link Active (Port 1 and Port 2) Green At least one of the four PHYs in the output port is working, and a link exists to the device connected to the expansion output connector. A link error has occurred. 4-Port and 2-Port 12Gb SAS Expansion HIC LEDs The E2700 supports several host interface expansion options, including SAS, FC, and iscsi. Figure 15 shows the LEDs for the 4-port 12Gb SAS HIC for the E2700 controller. Figure 15) LEDs for the 4-port 12Gb SAS HIC. In addition to the 4-port 12Gb SAS HIC, the E2700 controller also supports a 2-port 12Gb SAS HIC, shown in Figure 16. 20 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 16) LEDs for the 2-port 12Gb SAS HIC. Table 12 defines the LEDs for the 4-port and 2-port 12Gb SAS HICs. The drive expansion port LEDs (LEDs 9 through 12 in Figure 15 and LEDs 5 through 8 in Figure 16) are defined in Table 11. Table 12) 4-port and 2-port 12Gb SAS HIC LED definitions. LED Name Color LED On LED Off Host Link Fault Amber At least one of the four PHYs is working, but another PHY cannot establish the same link to the device connected to the host input port connector. Host Link Active Green At least one of the four PHYs in the host input port is working and a link exists to the device connected to the input port connector. Normal status. A link error has occurred. 4-Port and 2-Port 16Gb FC Expansion HIC LEDs In addition to supporting SAS host interfaces, the E2700 supports a 4-port 16Gb FC HIC on each controller, for a maximum of eight 16Gb FC ports per E2700 storage system (assuming dual controllers). Figure 17 shows the LEDs for the 4-port 16Gb FC HIC. 21 Introduction to NetApp E-Series E2700 with SANtricity 11.10
The iscsi functionality indicated on the label is not activated with SANtricity 11.10 on the E2700 controller. Figure 17) LEDs for the 4-port 16Gb FC HIC. The E2700 controller also supports a 2-port 16Gb FC HIC that is basically the same as the 4-port HIC but with 2 fewer ports to allow extended granularity in the configuration for scaling FC host interfaces. The 2- port 16Gb FC HIC is shown in Figure 18. 22 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 18) LEDs for the 2-port 16Gb FC HIC. Table 13 defines the LEDs for the 4-port and the 2-port 16Gb FC HICs. The drive expansion port LEDs (LEDs 9 through 12 in Figure 17 and LEDs 5 through 8 in Figure 18) are defined in Table 11. Table 13) 4-port and 2-port 16Gb FC HIC LED definitions (FC link rate). LED 0 LED 1 Link Rate Color Off Off Link down Green Off On Link operating at 4Gb/sec Green On Off Link operating at 8Gb/sec Green On On Link operating at 16Gb/sec Green 2-Port 10Gb iscsi Expansion HIC LEDs Another host connectivity interface supported by the E2700 controller is a 2-port 10Gb iscsi copper HIC. The HIC has two standard RJ-45 connectors, as shown in Figure 19. 23 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 19) LEDs for the 2-port 10Gb iscsi HIC. Table 14 defines the LEDs for the 2-port 10Gb iscsi HIC. The drive expansion port LEDs (LEDs 5 through 8 in Figure 19) are defined in Table 11. Table 14) 2-port 10Gb iscsi HIC LED definitions. LED 0 LED 1 Link Rate Color Off Off Link down Green On On 10Gb link up no activity Green On Off 1Gb link up no activity Green Blinking On 10Gb link up activity in progress Green Blinking Off 1Gb link up activity in progress Green For additional information about the E2700 controller and related hardware, refer to the E2700 Series product documentation located in the NetApp Documentation library. 24 Introduction to NetApp E-Series E2700 with SANtricity 11.10
1.2 Expansion Drive Shelf Using E2700 Controllers Overview NetApp E2700-based storage systems support storage capacity growth beyond the drive slots in the controller-drive shelf through the addition of expansion drive shelves. The DE6600 (60-drive), DE5600 (24-drive), or DE1600 (12-drive) drive shelves can be added to new or existing storage systems. ESM Expansion drive shelves differ from controller-drive shelves in one primary way: Expansion drive shelves have environmental services modules (ESMs) installed instead of controller modules. The ESM is equipped with dual serial attached SCSI (SAS) input ports, a single SAS output port, an Ethernet management port, and a serial port. The serial port is used only for advanced maintenance access at the direction of NetApp Technical Support. Like the serial port, the Ethernet port is for service use only; it is not connected for normal storage operations. Figure 20 shows the communication ports and status LEDs on the ESM. Figure 20) ESM ports and LEDs. Table 15 defines the drive expansion port LEDs (LEDs 1 through 4, and LEDs 8 and 9 in Figure 20). These LEDs indicate the connection status for each SAS link between the controller-drive shelf and all expansion drive shelves in the storage system. 25 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Table 15) SAS drive expansion port LED definitions. LED Name Color LED On LED Off Drive Expansion Link Fault (Input Ports 1 and 2, Output Port) Amber At least one of the four PHYs in the output port is working, but another PHY cannot establish the same link to the expansion output connector. Normal status. Drive Expansion Link Active (Input Ports 1 and 2, Output Port) Green At least one of the four PHYs in the output port is working, and a link exists to the device connected to the expansion output connector. A link error has occurred. Table 16 defines the Ethernet management port LEDs on the ESM (LEDs 6 and 7 in Figure 20). Table 16) Ethernet management port LED definitions. LED Name Color LED On LED Off Ethernet Management Port Link Rate (top left corner of management port RJ-45 connectors) Green There is a 100BASE-T rate. There is a 10BASE-T rate. Ethernet Management Port Link Active (top right corner of management port RJ- 45 connectors) Green Solid: The link is up without activity. Blinking: The link is up with activity. A link error has occurred. Table 17 defines the ESM and expansion drive shelf status LEDs (LEDs 10 through 14 in Figure 20). Table 17) ESM and expansion drive shelf status LEDs. LED Name Color LED On LED Off ESM Service Action Allowed Blue The ESM can be removed safely from the expansion drive shelf. The ESM cannot be removed safely from the expansion drive shelf. ESM Service Action Required Amber A fault exists in the ESM. Normal status. ESM Power Green The expansion drive shelf is powered on. The expansion drive shelf is not powered on. Dot in lower-right corner of first Seven-Segment LED Yellow (not amber) A flashing dot indicates that the controller heartbeat is active. If the dot is not lit, the controller heartbeat is not active (that is, the controller is not in service). Two Seven-Segment LEDs Yellow (not amber) The LED shows the drive shelf ID in the storage system. The expansion drive shelf is not powered on. Expansion Drive Shelf Multiple expansion drive shelves of different types (DE6600, DE5600, and DE1600) can be connected to a controller-drive shelf to add capacity to the storage system. 26 Introduction to NetApp E-Series E2700 with SANtricity 11.10
DE6600 Drive Shelf The DE6600 is a 4U shelf that holds up to 60 3.5" or 2.5" drives in 5 horizontal drawers (12 drives per drawer). It features dual power modules and dual fan modules with two fans in each module. Figure 21 shows the front view of the DE6600 drive shelf and its LEDs. Figure 21) LEDs on the DE6600 drive shelf (front view). Table 18 defines the LEDs on the front of the DE6600 drive shelf. Table 18) DE6600 drive shelf LED definitions (front view). LED Name Color LED On LED Off Power Green Power is present. Power is not present. Standby Green The drive shelf is in standby mode. Shelf Locate White The LED lights up to make the drive shelf easy to locate in the equipment rack. The drive shelf is not in standby mode. Normal status. Shelf Over Temperature Amber The temperature of the drive shelf has reached an unsafe level. Normal status. Service Action Required Amber A component within the drive shelf requires attention. Normal status. Figure 22 shows the rear view of the DE6600 drive shelf with dual ESMs, dual power supplies, and dual fan modules installed. 27 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 22) DE6600 rear view with dual ESMs, power supplies, and fan modules. Table 19 defines the DE6600 integrated fan unit and power supply LEDs on the rear panel. Table 19) DE6600 integrated fan unit and power supply LED definitions (rear view). LED Name Color LED On LED Off Standby Green The drive shelf is in standby mode. The drive shelf is not in standby mode. Output DC Power Green DC output power is present. DC output power is not present. Power Service Action Allowed Blue The drive shelf is in service mode. The drive shelf is not in service mode. Power Service Action Required Amber A power component in the drive shelf requires attention. Normal status. Input AC Power Green AC power is present. AC power is not present. Fan Unit Service Action Allowed Blue The fan unit is in service mode. The fan unit is not in service mode. 28 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Fan Unit Service Action Required Amber The fan unit requires attention. Normal status. Fan Unit AC Power Green Fan AC power is present. Fan AC power is not present. DE5600 Drive Shelf The DE5600 is a 2U shelf that holds up to 24 2.5" drives. It features dual RAID controllers and dual integrated power and fan modules. Figure 23 shows the front view of the DE5600 drive shelf and its LEDs. Figure 23) LEDs on the DE5600 drive shelf (front view). Table 20 defines the LEDs on the front of the DE5600 drive shelf. Table 20) DE5600 drive shelf LED definitions (front view). LED Name Color LED On LED Off Shelf Locate White The LED lights up to make the drive shelf easy to locate in the equipment rack. Normal status. Service Action Required Amber A component in the drive shelf requires attention. Normal status. Shelf Over Temperature Amber The temperature of the drive shelf has reached an unsafe level. Normal status. Power Green Power is present. Power is not present. 29 Introduction to NetApp E-Series E2700 with SANtricity 11.10
LED Name Color LED On LED Off Standby Green The drive shelf is in standby mode. The drive shelf is not in standby mode. Figure 24 shows the rear view of the DE5600 shelf with two ESMs installed. Figure 24) DE5600 rear view. Table 21 defines the DE5600 power supply LEDs on the rear panel. Table 21) DE5600 power supply status LEDs (rear view). LED Name Color LED On LED Off Standby Green The drive shelf is in standby mode. The drive shelf is not in standby mode. Output DC Power Green DC output power is present. DC output power is not present. Power Service Action Allowed Blue The drive shelf is in service mode. The drive shelf is not in service mode. Power Service Action Required Amber A power component in the drive shelf requires attention. Normal status. Input AC Power Green AC power is present. AC power is not present. DE1600 Drive Shelf The DE1600 is a 2U shelf that holds up to 12 3.5" drives. It features dual RAID controllers and dual integrated power and fan modules. Figure 25 shows the front view of the DE1600 drive shelf. Figure 25) DE1600 front view. 30 Introduction to NetApp E-Series E2700 with SANtricity 11.10
The LED layout for the DE1600 is identical to the layout for the DE5600 LEDs, defined in Table 20 and Table 21. The DE1600 rear view is the same as the DE5600 rear view shown in Figure 24. Expansion Drive Shelf Hardware Specifications Table 22 lists the drive types that are supported for each expansion drive shelf model. Table 22) Drive and shelf specifications per shelf type. Specification DE6600: 60 Drives 4U DE5600: 24 Drives 2U DE1600: 12 Drives 2U SSD 800GB 2.5" SSD (25 maximum per shelf) 800GB 2.5" SSD N/A SAS 1.2TB, 900GB, or 600GB 2.5" 10K RPM 1.2TB, 900GB, or 600GB 2.5" 10K RPM 600GB 3.5" 15K RPM (add-on to existing system only) NL-SAS 4TB, 3TB, or 2TB 3.5" 7.2K RPM N/A 4TB, 3TB, or 2TB 3.5" 7.2K RPM Maximum number of expansion shelves 2 15 15 Table 23 lists both the typical power specifications and the equipment-rated power specifications of the DE6600, DE5600, and DE1600 drive shelves. The table assumes that the shelves are in a dual ESM configuration and fully loaded with drives. Table 23) Drive shelf power specifications. Expansion Drive Shelf Typical Operating Power Equipment-Rated Power KVA Watts (AC) BTU/hr KVA Watts (AC) BTU/hr DE6600 (4TB drives fully populated) 0.855 847 2,890 1.526 1,512 5,162 DE5600 (900GB 10K RPM drives fully populated) 0.295 292 996 0.908 900 3,073 DE1600 (4TB drives fully populated) 0.249 247 841 0.908 900 3,073 Expansion Drive Shelf Cabling E-Series expansion drive shelves can be added to storage systems in combinations of 4U and 2U packages to achieve specific performance and capacity requirements. The typical dual controller configurations for each shelf type shown in Figure 26, Figure 27, and Figure 28 represent best-practice cabling topologies that maximize system resiliency against shelf hardware fault scenarios. The E2700 controller requires a new mini-sas HD to mini-sas cable to connect the controllerdrive shelf to an expansion drive shelf; two cables per controller are required. The ESM-to-ESM cables remain the same: mini-sas. The ESM has two SAS input ports and one output port for intershelf cabling. Unlike the E2600 and E5400 controllers, which have a single SAS output wide port with four channels (4 PHYs), the E2700 controller has two SAS output wide ports, each containing four channels, for a total of eight channels. These eight channels are combined in a way that allows any channel to be used for drive-side communications. 31 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 26) Typical E2700 storage system configuration with one DE6600 drive shelf. Figure 27) Typical E2700 storage system configuration with either the DE1600 or the DE5600 drive shelf. 32 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 28) Typical E2700 storage system dual stack configuration with either the DE1600 or the DE5600 drive shelf. For storage systems that contain a large number of expansion drive shelves, NetApp recommends using the dual stack configuration to improve performance. Figure 29 and Figure 30 represent the best-practice cabling topology in a single-controller (simplex) environment. In a single-controller configuration, the controller and ESMs should always be installed on the left side (A-side when viewed from the rear) of the configuration for an E2712 or E2724 controller. For an E2760 controller, the controller and the ESM should always be installed in the top position (A-side). 33 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 29) Typical E2700 storage system simplex dual stack configuration with either the DE1600 or the DE5600 drive shelf. The ESMs should not be connected together so that they form a loop. If there is only one additional drive shelf, both SAS output ports on the controller connect to both SAS input ports on the single ESM, as shown in Figure 30. Figure 30) Typical E2700 storage system single stack simplex configuration with the DE6600 drive shelf. 34 Introduction to NetApp E-Series E2700 with SANtricity 11.10
When mixing drive shelf models in the same storage system, verify that the drive types are supported by each shelf model in the configuration. For more information, refer to the following guides in the E2700 Series product documentation located in the NetApp Documentation library: For additional details about how to install E-Series storage system configurations, refer to the E- Series Storage Systems Site Preparation Guide. For instructions on how to install the DE6600 drive shelf specifically, refer to the Quick Install Guide for the DE6600 Drive Shelf. Best Practice The most common configuration for a storage system is to stack the expansion drive shelves in the same physical rack that contains the controller-drive shelf. Take the following precautions to stack the shelves safely: Make sure that floor loading limitations are not exceeded. Place the 60-drive shelf in the lower portions of the racks to avoid the possibility of tip-over. Use appropriate lifting equipment to mount the shelf, because a single shelf with the drives installed can exceed 200 pounds. The E-Series E2700-based storage system can support a maximum of 192 individual drives. However, depending on the shelf model and drive selection, additional boundaries to drive count must be considered. For more information about supported configurations, refer to the NetApp E2700 Storage System datasheet. When planning the total drive count for a single storage system, be aware that in any connected drive shelf, drive slots that are empty still count as drives. Best Practice When initially powering on an E-Series storage system that includes expansion drive shelves, power on the expansion drive shelves first and wait one to two minutes per drive shelf before powering on the controller-drive shelf. Hot-Adding a Drive Shelf E-Series storage systems support the addition of drive shelves and disk capacity to running storage systems. To prevent the loss of data availability to existing drive shelves when new drive shelves are added, the storage system must be cabled according to the cabling best practices recommended by NetApp. Two independent SAS channel paths must be available to the drive shelves so that one path can be interrupted to add a drive shelf to the storage system while the other path maintains data availability to existing shelves. The SANtricity cable audit report can be used to verify that the cabling is configured appropriately. After additional drive shelves have been successfully added to a storage system, SANtricity can be used to add capacity to existing volume groups and disk pools or to create new volume groups and disk pools. When adding an expansion drive shelf to an existing E-Series storage system, it is critical to follow the specific hot-add installation steps in the order specified in the deployment procedures. For more information and assistance with adding an expansion drive shelf to a production E- Series storage system, contact NetApp Global Services. 35 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Best Practice Plan carefully for any drive shelf hot-add activity on production storage systems. Verify that the following conditions are met: The existing power infrastructure can support the additional hardware. The cabling plan for the new shelf does not simultaneously interrupt the SAS expansion paths for controller A and controller B. Failure to make sure that one of the paths to the existing drive shelves remains active during the hot-add procedure can cause hosts to lose access to their LUNs. It is not possible to perform the hot-add procedure on a system that has a single controller. 2 Management of E-Series 2.1 SANtricity 11.10 Out-of-Band Management Overview SANtricity Storage Manager is an application used to manage E-Series storage systems. It is based on the Java framework and can be installed on a Microsoft Windows, Solaris, or Linux operating system (OS) platform. The NetApp best-practice configuration for managing storage systems is to use an out-ofband management host that does not participate in the data delivery workload. SANtricity Storage Manager is currently supported on HP-UX only when the in-band management method is used. The HP-UX host will not be supported in future releases of SANtricity. For information about running SANtricity on an in-band management host, refer to refer to the Initial Configuration and Software Installation Guide for SANtricity Storage Manager 11.10 from SANtricity Storage Manager 11.10 product documentation located in the NetApp Documentation library.. SANtricity Storage Manager 11.10 (sometimes referred to as the storage management software) is supported on 64-bit OS platforms and enables storage administrators to perform the following tasks: Set up network connections Commission new storage systems Configure NetApp AutoSupport (ASUP ) settings and preferences Provision volumes and map the storage to hosts Set up and manage storage features such as Snapshot copies, volume copy, synchronous mirroring, asynchronous mirroring, and SSD read cache Perform hardware and software maintenance activities to manage E-Series storage systems When the SANtricity management client is installed on a desktop OS, the following limitations apply: Simultaneous user sessions are limited to eight sessions. Desktop systems cannot run the host agent and send I/O traffic to the E-Series storage system. The SANtricity Storage Manager software has two windows that provide management functionality and offer a graphical representation of the storage system: Enterprise Management Window (EMW). When SANtricity Storage Manager is initiated, the EMW appears first. The EMW is used to add the storage systems that will be managed and monitored through SANtricity Storage Manager. 36 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Array Management Window (AMW). From the EMW, the AMW can be launched to access summary views and detailed information about individual storage systems. The AMW is used to configure, maintain, and manage a storage system and its components. Figure 31 and Figure 32 show the EMW and AMW, respectively. The storage system is referred to as a storage array in the SANtricity GUI. Figure 31) SANtricity management client EMW. 37 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 32) SANtricity management client AMW. Management Methods Depending on the system configuration, the out-of-band management method, the in-band management method, or both methods can be used to manage a storage system from a storage management station or host. NetApp recommends using the out-of-band management method for E-Series storage systems. Out-of-Band Management By using out-of-band management, an administrator can manage a storage system directly over the network from a storage management station that sends commands through an Ethernet connection to the Ethernet ports on the controllers. This management method can be used to manage all the functions in the storage system. Figure 33 shows the out-of-band management topology. 38 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 33) Out-of-band management topology. Storage management stations require TCP/IP to support the out-of-band management of storage systems. In-Band Management With the in-band management method, an administrator can manage a storage system controller through an I/O connection, by using a host that is running host-agent software and the SANtricity management software. NetApp AutoSupport NetApp ASUP is an integrated and efficient monitoring and reporting technology that constantly checks the health of NetApp storage systems in which this technology is enabled. It is one of the most important and effective troubleshooting tools for customers and for NetApp Customer Success Services. ASUP includes a scheduling mechanism for status and error reporting, and its messages contain configuration data, status data (such as available capacity and whether subsystems are up or down), system log files, and performance metrics. This data is used in a variety of critical ways to aid in troubleshooting and system trend-analysis activities. Figure 34 shows the EMW Devices tab with the ASUP icon selected. 39 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 34) EMW Devices tab with ASUP icon selected. Management Station ASUP is enabled by default on all E-Series storage systems from the factory; however, the support bundle delivery configuration must be completed before support data can be collected. This feature can be managed globally from the EMW, or individual storage systems can be managed from the AMW. Figure 35 shows the management options available from the EMW. Figure 35) EMW ASUP settings and options. ASUP can be enabled or disabled from the AMW for an individual storage system. All other ASUP settings are accessed from the EMW. For more information about the ASUP feature, refer to the Concepts Guide for SANtricity Storage Manager Version 11.10 in the SANtricity Storage Manager 11.10 product documentation located in the NetApp Documentation library. 40 Introduction to NetApp E-Series E2700 with SANtricity 11.10
2.2 Standard and Premium Features Using SANtricity 11.10 Overview A premium feature is a feature that is not available in the standard configuration of the E-Series storage management software. License key files are required to activate or update premium features and enable advanced functionality. With SANtricity 11.10, only the drive security feature requires a license key. All other product features are fully available out of the box. Standard Features The following standard features are automatically enabled in E-Series storage systems with the SANtricity 11.10 release: AutoSupport (ASUP) Volume copy Snapshot (point in time) Synchronous mirroring (FC only) Asynchronous mirroring (FC or iscsi) Mixed-type drives SSD read cache Automatically enabled features are not displayed in the Premium Features and Feature Pack information dialog box in the SANtricity AMW. Drive Security Feature Drive security is the only premium feature in SANtricity 11.10; it requires a license key file to activate the functionality. License keys for premium features are system specific and can be purchased by sending a request to a sales representative. The request must include the feature-enable identifier that is listed in the Premium Features and Feature Pack information dialog box (shown in Figure 36) and the storage system serial number (serial number of the E-Series controller-drive shelf). 41 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 36) SANtricity 11.10 Premium Features and Feature Pack information dialog box. Key Purchase and Delivery Process When the license key for the drive security feature has been purchased and the order has been processed in the NetApp order system, the key file can be generated by using the NetApp Storage Array Premium Feature Activation tool. The tool requires two types of information to generate license key files: the key activation code and the feature-enable identifier. The 11-digit key activation code is system generated for purchased licenses and is obtained by logging in to NetApp Support and viewing the system details under My Support > Software Licenses. The storage system controller-drive shelf serial number should be used to access the specific system details and key codes. The feature-enable identifier is a 32-digit code that is unique to a storage system. It can be located by using SANtricity to access the Premium Features and Feature Pack information dialog box for the storage system. Customers must have a valid Support site account login and password to access, generate, and download the license key file. For first-time users who apply for a new Support site account, access to their system details and to the license key site will be delayed for up to five business days while the registration information is validated and the user account is created. For this reason, NetApp recommends that customers create their Support site accounts as soon as their purchase order has been received by NetApp. 42 Introduction to NetApp E-Series E2700 with SANtricity 11.10
For issues with accessing license key files, open a support ticket with NetApp Support by using the serial number of the registered controller-drive shelf for the storage system that matches the feature-enable identifier. 2.3 E-Series Product Support Overview NetApp E-Series storage are identified by the serial number (SN) of the E-Series system shelf, not the SNs of the individual controllers within the E-Series system shelf. The correct SN must be registered for an E-Series system because only the SN of the E-Series system shelf can be used to log a support case with NetApp. E-Series Shelf Serial Number E-Series storage systems are shipped preconfigured from the factory (controllers have HICs and batteries installed and controllers are installed in the controller-drive shelf). The shelf SN is printed on a silver label affixed to the controller-drive shelf or expansion disk shelf, and its location can vary on the chassis. The shelf SN is identified by the text Serial or SN, which is shown in Figure 37 for different system types. 43 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Figure 37) Serial number locations on the shelf. The shelf SN is also included in the shelf UL sticker; however, this sticker is often not visible after the shelves are installed in a rack. On a running storage system, the serial number is also available using SANtricity Storage Manager by viewing the storage array profile. 44 Introduction to NetApp E-Series E2700 with SANtricity 11.10
Do not confuse a field-replaceable unit (FRU) SN with the shelf SN. FRU SNs are listed in the system, but they are not listed on the silver label that is affixed to the controller-drive shelf or to the expansion disk shelf. 3 Summary The NetApp E2700-based storage system allows customers to cut operational costs with ultra-dense drive shelves for capacity-hungry applications while improving storage utilization with the intuitive, easyto-learn SANtricity Storage Manager software. NetApp E2700 storage systems offer balanced performance for sequential workloads and demanding, high-iops database environments. The wide choice of drive speeds, capacities, and drive features combined with multiple host connectivity interface options make the E2700-based storage system the perfect choice for environments where simplicity, seamless integration with wide-ranging workloads, and a streamlined price/performance product focus are the key elements to customer success. 45 Introduction to NetApp E-Series E2700 with SANtricity 11.10