Dell PowerVault MD3200i and MD3220i Storage Arrays Owner s Manual Regulatory Model: E03J Series and E04J Series Regulatory Type: E03J001 and E04J001
Notes, Cautions, and Warnings NOTE: A NOTE indicates important information that helps you make better use of your computer. CAUTION: A CAUTION indicates potential damage to hardware or loss of data if instructions are not followed. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. Information in this publication is subject to change without notice. 2010 2011 Dell Inc. All rights reserved. Reproduction of these materials in any manner whatsoever without the written permission of Dell Inc. is strictly forbidden. Trademarks used in this text: Dell, the DELL logo, PowerEdge, PowerVault, and OpenManage are trademarks of Dell Inc. Intel is a registered trademarks of Intel Corporation in the U.S. and other countries. Microsoft, Windows, Windows Server, MS-DOS, and Internet Explorer are either trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Red Hat and Red Hat Enterprise Linux are registered trademarks of Red Hat, Inc. in the United States and other countries. SUSE is a registered trademark of Novell, Inc. in the United States and other countries. Other trademarks and trade names may be used in this publication to refer to either the entities claiming the marks and names or their products. Dell Inc. disclaims any proprietary interest in trademarks and trade names other than its own. Regulatory Model: E03J Series and E04J Series Regulatory Type: E03J001 and E04J001 2011-09 Rev. A01
Contents 1 Introduction....................... 19 About This Document.................. 19 Inside the box of the Dell PowerVault MD3200i Series Storage Array............. 19 MD3200i Series Storage Array........... 20 Dell PowerVault Modular Disk Storage Manager.................. 20 Dell PowerVault Modular Disk Configuration Utility................. 20 Other Information You May Need............ 20 2 Planning: About Your Storage Array.... 23 Overview......................... 23 Hardware Features................... 24 Front-Panel Features and Indicators....... 24 Back Panel Features and Indicators........ 27 Hard-Drive Indicator Patterns.............. 28 Power Supply and Cooling Fan Features........ 29 Power Indicator Codes and Features.......... 30 Contents 3
3 Planning: RAID Controller Modules.... 31 RAID Controller Modules................ 31 RAID Controller Module Connectors and Features....................... 32 RAID Controller Module Additional Features..... 34 Battery Backup Unit................ 34 Storage Array Thermal Shutdown......... 34 System Password Reset.............. 35 Cache Functions and Features.............. 35 Cache Mirroring................... 35 Write-Back Cache................. 35 Write-Through Cache................ 36 4 Planning: MD3200i Series Storage Array Terms and Concepts........... 37 Physical Disks, Virtual Disks, and Disk Groups..... 37 Physical Disks.................... 37 Physical Disk States................ 38 Self-Monitoring Analysis and Reporting Technology................ 39 Virtual Disks and Disk Groups........... 39 Virtual Disk States................. 40 RAID Levels........................ 40 RAID Level Usage.................. 41 Segment Size....................... 42 Virtual Disk Operations................. 43 Virtual Disk Initialization.............. 43 Background Initialization.............. 43 4 Contents
Foreground Initialization.............. 43 Consistency Check................. 44 Media Verification................. 44 Cycle Time..................... 44 Virtual Disk Operations Limit............ 45 Disk Group Operations.................. 45 RAID Level Migration................ 45 Segment Size Migration.............. 45 Virtual Disk Capacity Expansion.......... 46 Disk Group Expansion............... 46 Disk Group Defragmentation............ 46 Disk Group Operations Limit............ 47 RAID Background Operations Priority......... 47 Virtual Disk Migration and Disk Roaming........ 48 Disk Migration................... 48 Disk Roaming.................... 50 Advanced Features................... 50 Host Server-to-Virtual Disk Mapping........ 51 Host Types..................... 51 Snapshot Virtual Disks............... 51 Snapshot Repository Virtual Disk.......... 52 Virtual Disk Copy.................. 53 Virtual Disk Recovery................ 54 Using Snapshot and Disk Copy Together...... 54 Multi-Path Software................... 54 Preferred and Alternate Controllers and Paths................ 55 Virtual Disk Ownership............... 55 Load Balancing..................... 56 Contents 5
Monitoring MD3200i Series System Performance....................... 57 5 Configuration: Overview............ 61 User Interface...................... 61 Enterprise Management Window......... 62 Array Management Window............ 63 6 Configuration: About Your Storage Array..................... 65 Out-of-Band and In-Band Management......... 65 Storage Arrays...................... 66 Adding Storage Arrays............... 66 Setting Up Your Storage Array........... 68 Locating Storage Arrays.............. 69 Naming or Renaming Storage Arrays........ 70 Setting a Password................. 71 Viewing Storage Array Connections........ 72 Adding/Editing a Comment to an Existing Storage Array.................... 73 Removing Storage Arrays.............. 73 Enabling Premium Features............. 74 Failover Alert Display................ 74 Changing the Cache Settings on the Storage Array.................... 74 Changing Expansion Enclosure ID Numbers..................... 75 Changing the Enclosure Order in the Physical Pane.................... 75 Configuring Alert Notifications............. 76 6 Contents
Configuring E-mail Alerts.............. 76 Configuring SNMP Alerts.............. 79 Battery Settings..................... 80 Setting the Storage Array RAID Controller Module Clocks................... 81 7 Configuration: Using iscsi........... 83 Changing the iscsi Target Authentication....... 83 Entering Mutual Authentication Permissions...... 84 Creating CHAP Secrets................. 84 Initiator CHAP Secret................ 85 Target CHAP Secret................ 85 Valid Characters for CHAP Secrets........ 85 Changing the iscsi Target Identification........ 86 Changing the iscsi Target Discovery Settings..... 86 Configuring the iscsi Host Ports............ 87 Advanced iscsi Host Ports Settings.......... 89 Viewing or Ending an iscsi Session.......... 90 Viewing iscsi Statistics and Setting Baseline Statistics.................... 91 Edit, Remove, or Rename Host Topology........ 92 8 Configuration: Event Monitor......... 93 Enabling or Disabling the Event Monitor........ 93 Windows...................... 94 Contents 7
Linux......................... 94 9 Configuration: About Your Host....... 95 Configuring Host Access................. 95 Using the Mappings Tab................. 96 Defining a Host................... 96 Removing Host Access.................. 98 Managing Host Groups.................. 98 Creating a Host Group............... 98 Moving a Host to a Different Host Group...... 99 Removing a Host Group.............. 100 Host Topology................... 100 Starting or Stopping the Host Context Agent................... 101 I/O Data Path Protection................ 102 Managing Host Port Identifiers............ 103 10 Configuration: Disk Groups and Virtual Disks.................. 105 Creating Disk Groups and Virtual Disks........ 105 Creating Disk Groups............... 106 Locating a Disk Group.............. 108 Creating Virtual Disks............... 108 Changing the Virtual Disk Modification Priority............... 110 Changing the Virtual Disk Cache Settings.... 111 Changing the Segment Size of a Virtual Disk................... 113 8 Contents
Changing the I/O Type............... 114 Choosing an Appropriate Physical Disk Type...... 115 Physical Disk Security with Self Encrypting Disk..................... 115 Creating a Security Key............... 118 Changing a Security Key.............. 119 Saving a Security Key............... 121 Validate Security Key................ 122 Unlocking Secure Physical Disks.......... 122 Erasing Secure Physical Disks........... 122 Configuring Hot Spare Physical Disks......... 123 Hot Spares and Rebuild............... 125 Global Hot Spares................. 125 Hot Spare Operation................ 125 Hot Spare Drive Protection............. 126 Enclosure Loss Protection................ 126 Host-to-Virtual Disk Mapping.............. 128 Creating Host-to-Virtual Disk Mappings...... 129 Modifying and Removing Host-to-Virtual Disk Mapping............ 130 Changing Controller Ownership of the Virtual Disk.................. 131 Removing Host-to-Virtual Disk Mapping...... 132 Changing the RAID Controller Module Ownership of a Disk Group............. 132 Changing the RAID Level of a Disk Group..... 133 Removing a Host-to-Virtual Disk Mapping Using Linux DMMP................. 134 Restricted Mappings................... 136 Changing the RAID Controller Module Ownership of a Virtual Disk or a Disk Group.... 137 Contents 9
Changing the RAID Level of a Disk Group....... 139 Storage Partitioning.................. 140 Disk Group and Virtual Disk Expansion........ 141 Disk Group Expansion............... 141 Virtual Disk Expansion.............. 142 Using Free Capacity................ 142 Using Unconfigured Capacity........... 142 Disk Group Migration................. 143 Export Disk Group................. 143 Exporting a Disk Group.............. 143 Import Disk Group................... 144 Importing a Disk Group.............. 144 Storage Array Media Scan............... 145 Changing Media Scan Settings.......... 146 Suspending the Media Scan........... 147 11 Configuration: Premium Feature Snapshot Virtual Disks..... 149 Scheduling a Snapshot Virtual Disk.......... 150 Common Reasons for Scheduling a Snapshot Virtual Disk.............. 150 Guidelines for Creating Snapshot Schedules..................... 151 Enabling and Disabling Snapshot Schedules..................... 152 Creating a Snapshot Virtual Disk Using the Simple Path....................... 152 About the Simple Path.............. 153 10 Contents
Preparing Host Servers to Create the Snapshot Using the Simple Path.......... 153 Creating a Snapshot Virtual Disk Using the Advanced Path.................... 156 About the Advanced Path............. 156 Preparing Host Servers to Create the Snapshot Using the Advanced Path........ 157 Creating the Snapshot Using the Advanced Path................... 159 Specifying Snapshot Virtual Disk Names........ 161 Snapshot Repository Capacity.............. 162 Disabling a Snapshot Virtual Disk............ 165 Preparing Host Servers to Re-create a Snapshot Virtual Disk............... 166 Re-creating Snapshot Virtual Disks........... 167 Snapshot Rollback.................... 167 Rules and Guidelines for Performing a Snapshot Rollback................. 168 Protecting Against a Failed Snapshot Rollback................. 169 Previous Versions of the MD Storage Manager............... 169 Starting a Snapshot Rollback............ 169 Resuming a Snapshot Rollback.......... 170 Canceling a Snapshot Rollback.......... 171 12 Configuration: Premium Feature Virtual Disk Copy......... 173 Types of Virtual Disk Copies............... 174 Offline Copy..................... 174 Contents 11
Online Copy.................... 175 Creating a Virtual Disk Copy for an MSCS Shared Disk................... 176 Virtual Disk Read/Write Permissions......... 176 Virtual Disk Copy Restrictions............. 177 Creating a Virtual Disk Copy.............. 178 Before you Begin................. 178 Virtual Disk Copy and Modification Operations............. 179 Create Copy Wizard................ 179 Failed Virtual Disk Copy.............. 179 Preferred RAID Controller Module Ownership.... 180 Failed RAID Controller Module............ 180 Copy Manager..................... 180 Copying the Virtual Disk................ 180 Storage Array Performance During Virtual Disk Copy.................... 182 Setting Copy Priority.................. 182 Stopping a Virtual Disk Copy............. 183 Recopying a Virtual Disk................ 183 Preparing Host Servers to Recopy a Virtual Disk................... 184 Re-Copying a Virtual Disk............. 185 Removing Copy Pairs.................. 186 12 Contents
13 Configuration: Premium Feature Upgrading to High-Performance-Tier............. 187 14 Configuration: Device Mapper Multipath for Linux................ 189 Overview......................... 189 Using DM Multipathing Devices............ 190 Prerequisite Steps................. 190 Device Mapper Configuration Steps........ 191 Linux Host Server Reboot Best Practices..... 195 Important Information About Special Partitions.................. 196 Limitations and Known Issues.............. 197 Troubleshooting..................... 198 15 Management: Firmware Downloads... 201 Downloading RAID Controller and NVSRAM Packages................... 201 Downloading Both RAID Controller and NVSRAM Firmware................... 202 Downloading Only NVSRAM Firmware......... 204 Downloading Physical Disk Firmware......... 206 Downloading MD1200 Series Expansion Module EMM Firmware................. 208 Self-Monitoring Analysis and Reporting Technology (SMART).................. 210 Contents 13
Media Errors and Unreadable Sectors........ 210 16 Management: Installing Array Components...................... 211 Recommended Tools.................. 211 Front Bezel (Optional)................. 212 Removing the Front Bezel............. 212 Installing the Front Bezel............. 212 Hard Drives....................... 213 Removing a Hard-Drive Blank.......... 213 Installing a Hard-Drive Blank........... 214 Removing a Hard Drive.............. 214 Installing a Hard Drive.............. 216 Removing a Hard Drive From a Hard-Drive Carrier................ 216 Installing a Hard Drive Into a Hard-Drive Carrier................ 219 RAID Controller Module................ 219 Removing a RAID Controller Module Blank................... 219 Installing a RAID Controller Module Blank................... 220 Removing a RAID Controller Module....... 221 Installing a RAID Controller Module....... 222 Opening the RAID Controller Module....... 222 Closing the RAID Controller Module....... 223 RAID Controller Module Backup Battery Unit..... 224 Removing the RAID Controller Module Backup Battery Unit............... 224 Installing the RAID Controller Module Backup Battery Unit............... 225 14 Contents
Power Supply/Cooling Fan Module........... 225 Removing a Power Supply/Cooling Fan Module..................... 225 Installing a Power Supply/Cooling Fan Module..................... 228 Control Panel....................... 229 Removing the Control Panel............ 229 Installing the Control Panel............. 230 Backplane........................ 231 Removing the Backplane.............. 231 Installing the Backplane.............. 234 17 Management: Firmware Inventory.... 235 Viewing the Firmware Inventory............ 235 18 Management: System Interfaces..... 237 Microsoft Services.................... 237 Virtual Disk Service................. 237 Volume Shadow-Copy Service........... 237 19 Troubleshooting: Your Storage Array Software................... 239 Start-Up Routine..................... 239 Device Health Conditions................ 239 Storage Array Support Data............... 242 Automatically Collect the Support Bundle Data.... 243 Contents 15
Collecting the Physical Disk Data........... 244 Event Log........................ 244 Recovery Guru..................... 245 Storage Array Profile.................. 246 Viewing the Logical Associations........... 247 Viewing the Physical Associations.......... 248 Finding Nodes..................... 248 Using Go To....................... 250 Recovering From an Unresponsive Storage Array Condition................ 251 Locating a Physical Disk................ 253 Locating an Expansion Enclosure........... 255 Capturing the State Information............ 256 SMrepassist Utility................... 257 Unidentified Devices.................. 258 Recovering From an Unidentified Storage Array...................... 258 Starting or Restarting the Host Context Agent Software..................... 260 20 Troubleshooting: Your Array......... 263 Safety First For you and Your Array......... 263 Troubleshooting Storage Array Startup Failure..................... 263 16 Contents
Troubleshooting Loss of Communication........ 263 Troubleshooting External Connections......... 263 Troubleshooting Power Supply/Cooling Fan Module........................ 264 Troubleshooting Array Cooling Problems........ 265 Troubleshooting Expansion Enclosure Management Modules.................. 265 Troubleshooting RAID Controller Modules....... 267 Troubleshooting Hard Drives.............. 268 Troubleshooting Array and Expansion Enclosure Connections................. 269 Troubleshooting a Wet Storage Array.......... 269 Troubleshooting a Damaged Array........... 270 Troubleshooting RAID Controller Modules....... 271 Conditions...................... 271 Invalid Storage Array................ 271 ECC Errors..................... 271 PCI Errors...................... 272 Critical Conditions................. 272 Noncritical Conditions............... 272 21 Getting Help...................... 273 Contacting Dell..................... 273 Index.............................. 275 Contents 17
18 Contents
1 Introduction NOTE: Unless specified, MD3200i Series represents Dell PowerVault MD3200i and Dell PowerVault MD3220i storage arrays. WARNING: See the Safety, Environmental, and Regulatory Information document for important safety information before following any procedures listed in this document. About This Document This guide familiarizes you with the functions of the Dell PowerVault MD3200i Series storage array. The guide is organized according to the tasks that you must complete after receiving your MD3200i Series storage array. The tasks are: Planning Information about the storage array and its features. Configuration Tasks that must be completed to ensure that your storage array performs optimally. Management Tasks that may be performed to ensure that the storage array components are up to date and performing properly, including removal and installation of storage array components. Troubleshooting Tasks that you must complete to resolve problems that may occur with the storage array. Additional information on these and other topics can be found in the Dell PowerVault MD3200i and MD3220i Storage Array Deployment Guide at support.dell.com/manuals. Inside the box of the Dell PowerVault MD3200i Series Storage Array Your MD3200i Series product package includes: Dell PowerVault MD3200i Series storage array Power cables Front bezel (optional) Introduction 19
Mounting rails (2) (optional) MD3200i Series resource media Rack Installation Instructions. Getting Started With Your System (provides an overview of enclosure features, setting up your enclosure, and technical specifications). MD3200i Series Storage Array The Dell PowerVault MD3200i Series is a 2U rack-mounted external redundant array of independent disks (RAID) storage array capable of accommodating up to twelve 3.5" or twenty four 2.5" 6.0-Gbps Serial- Attached SCSI (SAS) disks. The MD3200i Series storage arrays can be daisychained with MD1200 Series expansion enclosures, providing access to a maximum of 120 disks (or 192 disks with Premium Feature activation) in the entire storage system. Connectivity between the storage array and the host server is provided by a standard Ethernet connection. Dell PowerVault Modular Disk Storage Manager Dell PowerVault Modular Disk Storage Manager (MDSM) is a graphical user interface (GUI) application, used to configure and manage one or more MD3200i Series Storage Arrays. The MDSM software is located on the MD3200i Series resource media. Dell PowerVault Modular Disk Configuration Utility Dell PowerVault Modular Disk Configuration Utility (MDCU) is an iscsi configuration wizard that can be used in conjunction with MDSM to simplify the configuration of iscsi connections. The MDCU software is located on the MD3200i Series resource media. Other Information You May Need WARNING: See the safety and regulatory information that shipped with your system. Warranty information may be included within this document or as a separate document. The Getting Started Guide provides an overview of setting up and cabling your storage array. 20 Introduction
The Deployment Guide provides installation and configuration instructions for both software and hardware. The Storage Manager CLI Guide provides information about using the command line interface (CLI). The Resource media contains all system management tools. The Systems Support Matrix provides information on supported software and hardware for MD systems. The document is available at support.dell.com/manuals. The Dell PowerEdge Cluster Documentation is available at support.dell.com/manuals. Release notes or readme files are included to provide last-minute updates to the enclosure or documentation or advanced technical reference material intended for experienced users or technicians. This document as well as Dell PowerVault MD 1200 Series Installation Guide is available at support.dell.com/manuals for users who incorporate MD1200 expansion enclosures. The Rack Installation Instructions included with your rack solution describes how to install your enclosure into a rack. NOTE: Always check for updates on support.dell.com/manuals and read the updates first because they often supersede information in other documents. Introduction 21
22 Introduction
2 Planning: About Your Storage Array Overview The MD3200i Series storage array is designed for high availability, offering redundant access to data storage. It features support for both single and dual RAID controller configuration. The Dell PowerVault MD3200i storage array provides 1.0-Gbps 1000 BaseT connectivity to the host server and enables access to 32 physical hosts. The MD3200i Series storage array includes: RAID controller module(s) PSU/Fan modules Disk drives (also called physical disk drives in this document) A front bezel (optional) A system enclosure, into which, the other components are plugged Planning: About Your Storage Array 23
Hardware Features Front-Panel Features and Indicators Figure 2-1. Front-Panel Features and Indicators Dell PowerVault MD3200i 1 2 3 4 5 6 Figure 2-2. Front-Panel Features and Indicators Dell PowerVault MD3220i 1 2 3 4 5 6 24 Planning: About Your Storage Array
Figure 2-3. Front-Bezel Features and Indicators 1 2 3 Item Indicator, Button, or Icon Description Connector 1 Enclosure status LED The enclosure status LED lights when the enclosure power is on. Lights blue during normal operation. Blinks blue when a host server is identifying the enclosure or when the system identification button is pressed. Lights amber as enclosure boots or is reset. Blinks amber when the enclosure is either in a fault state or the hosts are not using the preferred path to a virtual disk. 2 Power LED The power LED lights green when at least one power supply is supplying power to the enclosure. Planning: About Your Storage Array 25
Item Indicator, Button, or Connector 3 Split mode LED This LED must be unlit as the split mode function is not supported by the MD3200i Series Storage Arrays. 4 System identification button The system identification button on the front control panel can be used to locate a particular enclosure within a rack. When the button is pushed, the system status indicators on the control panel and the RAID controller module(s) blink blue until the button is pushed again. 5 Hard drives MD3200i Up to twelve 3.5" SAS hot-swappable hard drives. MD3220i Up to twenty four 2.5" SAS hotswappable hard drives. 6 Enclosure mode switch Icon Description The function of this switch is not applicable to your storage array. However, if MD1200 Series expansion enclosures are daisy chained to the storage array, the enclosure mode switches of the MD1200 Series expansion enclosures must be set to the Unified-Mode position. NOTE: This switch must be set before turning on the MD1200 series expansion enclosure. Changing the switch setting after the expansion enclosure is turned on has no effect on the enclosure configuration until the expansion enclosure goes through a complete power cycle. 26 Planning: About Your Storage Array
Back Panel Features and Indicators Figure 2-4. Back-Panel Features and Indicators Dell PowerVault MD3200i Series 1 2 3 4 1 600 W power supply/cooling fan 2 RAID Controller Module 0 module 3 RAID Controller Module 1 4 600 W power supply/cooling fan module Planning: About Your Storage Array 27
Hard-Drive Indicator Patterns Figure 2-5. Hard Drive Indicators 1 2 1 hard-drive activity indicator (green) 2 hard-drive status indicator (green and amber) 28 Planning: About Your Storage Array
Drive-Status Indicator Pattern Condition Off The physical disk is: not yet discovered by the host server is spun down for removal not supported for the RAID controller module or is not in the physical disk slot NOTE: The drive status indicator remains off until all hard drives are initialized after system power is turned on. Drives are not ready for insertion or removal during this time. Steady green Physical disk is online Green flashing (On 250 ms, Off 250 ms) Physical disk is being identified Green flashing (On 400 ms, Off 100 ms) Physical disk rebuilding Amber flashing (On 150 ms, Off 150 ms) Physical disk failed Flashing green, amber, and off (green On Physical disk failure predicted (SMART) 500 ms, amber On 500 ms, Off 1000 ms) Flashing green, amber, and Off (green 3 Physical disk rebuild aborted seconds, amber 3 seconds, and Off 3 seconds) Power Supply and Cooling Fan Features The MD3200i Series storage array includes two integrated, hot-swappable power supply/cooling fan modules. Both modules must be installed to ensure proper cooling. The system requires at least one of the cooling fans to function to avoid overheating. A power supply/cooling fan module can be replaced without powering down the system. For information on removing and installing the modules, see "Power Supply/Cooling Fan Module" on page 225. CAUTION: A power supply/cooling fan module can be removed from a poweredon system for a maximum period of 5 minutes. Beyond that time, the system may automatically shut down to prevent damage. Planning: About Your Storage Array 29
Power Indicator Codes and Features Figure 2-6. Power Indicator Codes and Features 1 2 3 4 5 Item LED Type Icon Description 1 DC power The LED lights green when the DC output voltage is within the limit. If this LED is off, it indicates that the DC output voltage are not within the limit. 2 Power supply/cooling fan fault The LED lights amber when the DC output voltage is not within the limit or a fault with the fan is detected. If this LED is off, it indicates that no fault condition is present. 3 AC power The LED lights green when the AC input voltage is within the limit. If this LED is off, it indicates either there is no power or the AC input voltage is not within the limit. 4 Power connector Connect the external power supply to this connector. 5 Power switches (2) The power switch controls the power supply output to the enclosure. 30 Planning: About Your Storage Array
3 Planning: RAID Controller Modules RAID Controller Modules The RAID controller modules provide high-performance, advanced virtual disk configuration, and fault-tolerant disk subsystem management. Each RAID controller module contains 2 GB of cache that is mirrored with the other controller's cache for high availability and is protected by a batterypowered cache offload mechanism. RAID controller modules provide the following data path and enclosure management functions: Monitoring and controlling enclosure environment elements (temperature, fans, power supplies, and enclosure LEDs) Controlling access to the physical disks Communicating enclosure attributes and states to the host server and management station Each RAID controller module has multiple iscsi IN-ports for host access. The ports provide redundant host connections and support a high availability storage environment. Various configurations can be utilized, in both single controller (simplex) and dual controller (duplex) modes, to connect the storage enclosure to hosts depending on specific redundancy needs. For information on cabling, see the MD3200i and MD3220i Series storage array s Deployment Guide at support.dell.com/manuals. Planning: RAID Controller Modules 31
RAID Controller Module Connectors and Features Figure 3-1. MD3200i Series iscsi RAID Controller Module 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 Item Component Function 1 SAS OUT port Provides SAS connection for cabling to an expansion enclosure. 2 iscsi IN port 0 Provides host-to-controller iscsi 1Gbps Ethernet connection. 3 iscsi IN port 1 Provides host-to-controller iscsi 1Gbps Ethernet connection. 4 iscsi IN port 2 Provides host-to-controller iscsi 1Gbps Ethernet connection. 5 iscsi IN port 3 Provides host-to-controller iscsi 1Gbps Ethernet connection. 6 Management port ethernet connector 7 Debug port Dell support only. Provides a 100/1000 Mbps Ethernet connection for out-of-band management of the enclosure. 32 Planning: RAID Controller Modules
Item Component Function 8 SAS OUT port link/fault LED 9 iscsi IN port link LED Lights green when all four links are connected. Lights amber when one to 3 links are disconnected. Off when all links in the port are disconnected or cable is disconnected. Lights green when ethernet connection at 1Gbps established. Off when there is no link. 10 Controller power LED Lights green when controller is turned on. Off when controller is not turned on. 11 iscsi IN port activity LED Lights green when there is no activity on 1Gbps connection. Blinks green when there is Activity on 1Gbps connection. Off when 1Gbps link is down. 12 Controller fault LED Lights amber when controller fault detected. Off when controller operating normally. 13 System identification LED 14 Cache active or cache offload LED Blinks blue when system identification switch pushbutton on enclosure front panel is pressed. Lights green when On-board controller memory contains data. If AC power fails, this LED changes to indicate Cache Offload status. If the password reset function has successfully changed the password, this LED flashes on and off briefly. 15 Battery fault Lights amber when battery backup unit or battery has failed. Off when battery backup unit is operating normally. 16 Password reset switch Activating this switch deletes the password. 17 MAC address label Provides MAC addresses of iscsi host ports and the management port. Planning: RAID Controller Modules 33
Item Component Function 18 Management port speed LED 19 Management port activity LED RAID Controller Module Additional Features Battery Backup Unit Each RAID controller contains a two-cell Lithium ion nanopolymer battery backup unit (BBU). It provides power to the RAID controller module in the event of a power outage. For information on removing and installing the BBU, see "RAID Controller Module Backup Battery Unit" on page 224. NOTE: For virtual disks, the RAID controller firmware changes the data cache setting based on the state of the battery. If the battery is missing or does not have sufficient charge, the controller flushes the cache and sets the write cache attribute to Write Through for all virtual disks. When the battery is replaced, Write Back is re-enabled. Storage Array Thermal Shutdown Lights green when ethernet connection is operating at 1000 Mbps. Lights amber when ethernet connection is operating at 100 Mbps. Off when ethernet connection is operating at 10 Mbps or is not active. Lights green when ethernet connection is active. Off when ethernet connection is not active. The system automatically shuts down when system temperature exceeds the safe threshold. The battery backup unit protects against data loss by providing power to offload to non-volatile memory in the event of power loss. It is not necessary to shut down any MD1200 Series expansion enclosures attached to the storage array when thermal shutdown occurs. Temperature threshold values determine the temperature at which shutdown occurs. These thresholds cannot be changed. 34 Planning: RAID Controller Modules
Table 3-1. Shutdown Threshold Type Threshold Temperature Exceeding Nominal failure threshold Maximum failure threshold Shutdown threshold Event Description A critical event is set Shutdown of the system power supplies occurs within 3 minutes Shutdown of the system power supplies occurs within 5 seconds System Password Reset The storage array system password can be reset if it is forgotten. To reset the password, push and hold down the password reset switch for at least 5 seconds. The password is deleted. See Figure 3-1 to locate the password reset switch. The RAID controller module allows you to change the password. For more information about setting your password, see "Setting a Password" on page 71. NOTE: The reset switch can be accessed by using a small object such as the tip of a pen. Cache Functions and Features Cache Mirroring Cache mirroring function copies accepted host-write data from the primary controller to the partner controller. This action ensures that host-write data is safely mirrored to the partner controller before successful completion status is returned to the host. If a controller fails, the surviving controller safely retains all mirrored data. Cache mirroring is enabled by default. Write-Back Cache In Write-back Cache, write operations result in a completion signal being sent to the host operating system as soon as the cache receives the data to be written. The target physical disk receives the data at a more appropriate time in order to increase controller performance. In dual-active controller configurations with Write-back Caching enabled, the write data is always Planning: RAID Controller Modules 35
mirrored to the cache of the second controller before completion status is issued to the host initiator. Write-Back Cache is enabled by default unless cache mirroring is disabled. Write-Through Cache In write-through cache, data is written to the physical disk before completion status is returned to the host operating system. Write-through cache is considered more robust than write-back cache, since a power failure is less likely to cause loss of data. The RAID controller automatically switches to write-through if cache mirroring is disabled or if the battery is missing or has a fault condition. 36 Planning: RAID Controller Modules
4 Planning: MD3200i Series Storage Array Terms and Concepts This chapter explains terms and concepts used for configuration and operation of MD3200i Series storage arrays. Physical Disks, Virtual Disks, and Disk Groups Physical disks in your storage array provide the physical storage capacity for your data. Before you can begin writing data to the storage array, you must configure the physical storage capacity into logical components, called disk groups and virtual disks. A disk group is a set of physical disks upon which multiple virtual disks are created. The maximum number of physical disks supported in a disk group is 120 disks (or 192 disks with Premium Feature activation) for RAID 0, RAID 1, and RAID 10, and 30 drives for RAID 5 and RAID 6. You can create disk groups from unconfigured capacity on your storage array. A virtual disk is a partition in a disk group that is made up of contiguous data segments of the physical disks in the disk group. A virtual disk consists of data segments from all physical disks in the disk group. Virtual disks and disk groups are set up according to how you plan to organize your data. For example, you may have one virtual disk for inventory, a second virtual disk for financial and tax information, and so on. All virtual disks in a disk group support the same RAID level. The storage array supports up to 255 virtual disks (minimum size of 10 MB each) that can be assigned to host servers. Each virtual disk is assigned a Logical Unit Number (LUN) that is recognized by the host operating system. Physical Disks Only Dell supported 6.0-Gbps SAS physical disks are supported in the storage array. If the storage array detects unsupported physical disks, it marks the disk as unsupported and the physical disk becomes unavailable for all operations. Planning: MD3200i Series Storage Array Terms and Concepts 37
NOTE: The MD3200i Series storage enclosure must contain at least two physical disks for proper operation. This is necessary because the physical disks are used to store configuration information. Physical Disk States Table 4-1 describes the various states of the physical disk, which are recognized by the storage array and reported in the MDSM application. Table 4-1. RAID Controller Physical Disk States Status Mode Description Physical Disk Status LED Optimal Assigned The physical disk in the indicated slot Steady Green is configured as part of a disk group. Optimal Unassigned The physical disk in the indicated slot Steady Green is unused and available to be configured. Optimal Optimal Failed Hot Spare standby Hot Spare in use Assigned, Unassigned, Hot Spare in use, or Hot Spare standby The physical disk in the indicated slot is configured as a hot spare. The physical disk in the indicated slot is in use as a hot spare within a disk group. The physical disk in the indicated slot has failed because of an unrecoverable error, an incorrect drive type or drive size, or by its operational state being set to failed. Replaced Assigned The physical disk in the indicated slot is replaced and is ready to be, or is actively being configured into a disk group. Pending Failure Assigned, Unassigned, Hot spare in use, or Hot Spare standby A Self-Monitoring Analysis and Reporting Technology (SMART) error is detected on the physical disk in the indicated slot. Steady Green Steady Green Amber flashing (150 ms) Green flashing (On 400 ms, Off 100 ms) Green flashing (500 ms), Amber (500 ms), and Off (1000 ms) 38 Planning: MD3200i Series Storage Array Terms and Concepts
Table 4-1. RAID Controller Physical Disk States (continued) Status Mode Description Physical Disk Status LED Offline Identify Not applicable The physical disk has either been spun down or had a rebuild aborted by user request. Assigned, Unassigned, Hot Spare in use, or Hot Spare standby If a disk drive rebuild fails because of a source drive failure or because the drive is too small, the MDSM reports a failure of the physical disk even though the LED state on the drive indicates the rebuild was aborted (green for 3 seconds, amber for 3 seconds, then off for 3 seconds). Self-Monitoring Analysis and Reporting Technology SMART monitors the internal performance of all physical disk components to detect faults indicating the potential for physical disk failure. SMART uses this information to report whether failure is imminent so that a physical disk can be replaced before failure occurs. The storage array monitors all attached drives and notifies you when a predicted failure is reported by a physical disk. Virtual Disks and Disk Groups The physical disk is being identified. N/A N/A The indicated slot is empty, or the array cannot detect the physical disk. Green flashing (3000 ms), Amber (3000 ms), and Off (3000 ms) Green flashing (250 ms) When configuring a storage array, you must: 1 Organize the physical disks into disk groups. 2 Create virtual disks within these disk groups. 3 Provide host server access. 4 Create mappings to associate the virtual disks with the host servers. NOTE: Host server access must be created before mapping virtual disks. Planning: MD3200i Series Storage Array Terms and Concepts 39
Disk groups are always created in the unconfigured capacity of a storage array. Unconfigured capacity is the available physical disk space not already assigned in the storage array. Virtual disks are created within the free capacity of a disk group. Free capacity is the space in a disk group that has not been assigned to a virtual disk. Virtual Disk States The storage array recognizes the following virtual disk states. Table 4-2. RAID Controller Virtual Disk States State Optimal Degraded Offline Force online Description The virtual disk contains physical disks that are all online. The virtual disk with a redundant RAID level contains an inaccessible physical disk. The system can still work properly, but performance may be affected and additional disk failures may result in data loss. A virtual disk with one or more member disks is in an inaccessible (failed, missing, or offline) state. Data on the virtual disk is no longer accessible. The storage array forces a virtual disk that is in an Offline state to an Optimal state. If all the member physical disks are not available, the storage array forces the virtual disk to a Degraded state. The storage array can force a virtual disk to an Online state only when a sufficient number of physical disks are available to support the virtual disk. RAID Levels RAID levels determine the way in which data is written to physical disks. Different RAID levels provide different levels of accessibility, redundancy, and capacity. Using multiple physical disks has the following advantages over using a single physical disk: Placing data on multiple physical disks (striping) allows input/output (I/O) operations to occur simultaneously and improve performance. Storing redundant data on multiple physical disks using mirroring or parity supports reconstruction of lost data if an error occurs, even if that error is the failure of a physical disk. 40 Planning: MD3200i Series Storage Array Terms and Concepts
Each RAID level provides different performance and protection. You must select a RAID level based on the type of application, access, fault tolerance, and data you are storing. The storage array supports RAID levels 0, 1, 5, 6, and 10. The maximum number of physical disks that can be used in a disk group depends on the RAID level: 192 for RAID levels 0, 1, and 10 30 for RAID levels 5 and 6. RAID Level Usage To ensure best performance, you must select an optimal RAID level when you create a system physical disk. The optimal RAID level for your disk array depends on: Number of physical disks in the disk array Capacity of the physical disks in the disk array Need for redundant access to the data (fault tolerance) Disk performance requirements RAID 0 RAID 0 uses disk striping to provide high data throughput, especially for large files in an environment that requires no data redundancy. RAID 0 breaks the data down into segments and writes each segment to a separate physical disk. I/O performance is greatly improved by spreading the I/O load across many physical disks. Although it offers the best performance of any RAID level, RAID 0 lacks data redundancy. Select this option only for non-critical data, because failure of one physical disk results in the loss of all data. Examples of RAID 0 applications include video editing, image editing, prepress applications, or any application requiring high bandwidth. RAID 1 RAID 1 uses disk mirroring so that data written to one physical disk is simultaneously written to another physical disk. This RAID level offers fast performance, the best data availability, and the highest disk overhead. RAID 1 Planning: MD3200i Series Storage Array Terms and Concepts 41
is recommended for small databases or other applications that do not require large capacity. RAID 1 provides full data redundancy. For example accounting, payroll, or financial applications. RAID 5 RAID 5 uses parity and striping data across all physical disks (distributed parity) to provide high data throughput and data redundancy, especially for small random access. This is a versatile RAID level and is suited for multi-user environments where typical I/O size is small and there is a high proportion of read activity such as file, application, database, web, e-mail, news, and intranet servers. RAID 6 RAID 6 is similar to RAID 5 but provides an additional parity disk for better redundancy. This is the most versatile RAID level and is suited for multi-user environments where typical I/O size is small and there is a high proportion of read activity. RAID 6 is recommended when large size physical disks are used or large number of physical disks are used in a disk group. RAID 10 RAID 10, a combination of RAID 1 and RAID 0, uses disk striping across mirrored disks. It provides high data throughput and complete data redundancy. Utilizing an even number of physical disks (four or more) creates a RAID level 10 disk group and/or virtual disk. Because RAID levels 1 and 10 use disk mirroring, half of the capacity of the physical disks is utilized for mirroring. This leaves the remaining half of the physical disk capacity for actual storage. RAID 10 is automatically used when a RAID level of 1 is chosen with four or more physical disks. RAID 10 works well for mediumsized databases or any environment that requires high performance and fault tolerance and moderate-to-medium capacity. Segment Size Disk striping enables data to be written across multiple physical disks. Disk striping enhances performance because striped disks are accessed simultaneously. 42 Planning: MD3200i Series Storage Array Terms and Concepts
The segment size or stripe element size specifies the size of data in a stripe written to a single disk. The storage array supports stripe element sizes of 8 KB, 16 KB, 32 KB, 64 KB, 128 KB, 256 KB, and 512 KB. The default stripe element size is 128 KB. Stripe width, or depth, refers to the number of disks involved in an array where striping is implemented. For example, a four-disk group with disk striping has a stripe width of four. NOTE: Although disk striping delivers excellent performance, striping alone does not provide data redundancy. Virtual Disk Operations Virtual Disk Initialization Every virtual disk must be initialized. Initialization can be done in the foreground or the background. A maximum of four virtual disks can be initialized concurrently on each RAID controller module. Background Initialization The storage array executes a background initialization when the virtual disk is created to establish parity, while allowing full host server access to the virtual disks. Background initialization does not run on RAID 0 virtual disks. The background initialization rate is controlled by MDSM. To change the rate of background initialization, you must stop any existing background initialization. The rate change is implemented when the background initialization restarts automatically. Foreground Initialization The storage array supports foreground initialization for virtual disks. All access to the virtual disk is blocked during foreground initialization. During foreground initialization, zeros (0x00) are written to every sector of the virtual disk. The virtual disk is available after foreground initialization is completed. Planning: MD3200i Series Storage Array Terms and Concepts 43
Consistency Check A consistency check verifies the correctness of data in a redundant array (RAID levels 1, 5, 6, and 10). For example, in a system with parity, checking consistency involves computing the data on one physical disk and comparing the results to the contents of the parity physical disk. A consistency check is similar to a background initialization. The difference is that background initialization cannot be started or stopped manually, while consistency check can. NOTE: Dell recommends that you run data consistency checks on a redundant array at least once a month. This allows detection and automatic replacement of unreadable sectors. Finding an unreadable sector during a rebuild of a failed physical disk is a serious problem, because the system does not have the redundancy to recover the data. Media Verification Another background task performed by the storage array is media verification of all configured physical disks in a disk group. The storage array uses the Read operation to perform verification on the space configured in virtual disks and the space reserved for the metadata. Cycle Time The media verification operation runs only on selected disk groups, independent of other disk groups. Cycle time is the time taken to complete verification of the metadata region of the disk group and all virtual disks in the disk group for which media verification is configured. The next cycle for a disk group starts automatically when the current cycle completes. You can set the cycle time for a media verification operation between 1 and 30 days. The storage controller throttles the media verification I/O accesses to disks based on the cycle time. The storage array tracks the cycle for each disk group independent of other disk groups on the controller and creates a checkpoint. If the media verification operation on a disk group is preempted or blocked by another operation on the disk group, the storage array resumes after the current cycle. If the media verification process on a disk group is stopped due to a RAID controller module restart, the storage array resumes the process from the last checkpoint. 44 Planning: MD3200i Series Storage Array Terms and Concepts
Virtual Disk Operations Limit The maximum number of active, concurrent virtual disk processes per RAID controller module installed in the storage array is four. This limit is applied to the following virtual disk processes: Background initialization Foreground initialization Consistency check Rebuild Copy back If a redundant RAID controller module fails with existing virtual disk processes, the processes on the failed controller are transferred to the peer controller. A transferred process is placed in a suspended state if there are four active processes on the peer controller. The suspended processes are resumed on the peer controller when the number of active processes falls below four. Disk Group Operations RAID Level Migration You can migrate from one RAID level to another depending on your requirements. For example, fault-tolerant characteristics can be added to a stripe set (RAID 0) by converting it to a RAID 5 set. MDSM provides information about RAID attributes to assist you in selecting the appropriate RAID level. You can perform a RAID level migration while the system is still running and without rebooting, which maintains data availability. Segment Size Migration Segment size refers to the amount of data (in KB) that the storage array writes on a single physical disk in a virtual disk before writing data on the next physical disk. Valid values for the segment size are 8 KB, 16 KB, 32 KB, 64 KB, 128 KB, 256 KB, and 512 KB. Dynamic segment size migration enables the segment size of a given virtual disk to be changed. A default segment size is set when the virtual disk is created, based on such factors as the RAID level and expected usage. You can change the default value if segment size usage does not match your needs. Planning: MD3200i Series Storage Array Terms and Concepts 45