10 Having Hot Spare disks available in the system is strongly recommended. There are two types of Hot Spare disks:

Transcription

1 0 This Web Based Training module provides support and maintenance related information for the ETERNUS DX S2 family. This module provides an introduction to a number of ETERNUS Web GUI functions, for a full description of the functions please refer to the ETERNUS Web GUI User's Guide. 1 This training module is divided in the following chapters. Chapter Maintenance Utilities introduces us to a number of ETERNUS Web GUI functionalities that are useful for the typical maintenance tasks. Maintenance Operations include tasks like replacing and adding of system components. Chapter Log and Dump Management explains the purpose of the different statistics and logs of the ETERNUS DX and show how they can be used for support and maintenance purposes. One of the default user accounts of the ETERNUS DX is called "root". This chapter explains the System Utilities that are available for the User "root". Another default user account is called f.ce; this chapter provides an introduction to the System Utilities that are available for the User "f.ce". 2 These are the ETERNUS Web GUI utilities that are useful for daily maintenance tasks. This chapter provides a brief functional description for each of these utilities. For more detailed descriptions you can refer to the ETERNUS Web GUI User's Guide. 3 After logging in to the ETERNUS DX S2 system the first screen is the Overview screen. The system name and model is shown at the top left hand corner, as well as the indicator of the general system status. All operations and maintenance tasks can be started from here by selecting a main topic from the menu bar. Furthermore, this opening screen provides a brief overview about the following: The section labeled "Hardware Components" shows an overview of modules and disks that have currently the status Normal, Warning or Error. Below from there is the "System Information" area that provides global system information like the current Firmware version, the Cache Mode and the Battery status, as well as identification of the CM that serves this current GUI session. The right half of the screen shows an overview of the used and available capacity of the RAID Groups, Thin Provisioning Pool and Snap Data Pool 4 This System Information screen provides more detailed system information than the respective area in the opening screen. There are two ways to access this screen; either select the blue underlined hyperlink with the model name from the previously seen screen or click on the main subject "Component" in the top menu bar and click on the ETERNUS host name in the Category column at the left hand side of the screen.

2 This screen gives a good overview of all relevant system information and also status information about the battery and each Enclosure. Further detailed view of the Enclosures and disks is available by selecting one of these sub-menu options. 5 After having selected a system component from the Category list, different administration and service actions are available in the Action field at the right hand side. These are the actions available; we will have a closer look at them on the following slides. If an action is grayed out that means in this particular case that the component is not in the state to carry out the particular task; here as an example the disk cannot be force enabled because it is already enabled. The other reason for Actions being grayed out is that the login that you're currently using doesn't have the necessary privileges to carry out the particular function. Third possibility is that a particular Action can only be executed when the system is in Maintenance mode. 6 Preventive Maintenance is an Action for detaching and replacing a component that is showing early signs of a failure. These components are marked with a yellow Warning symbol as a result of ETERNUS internal component diagnostics. Please note that this Action is only available for those components that can be diagnosed for early failures; for example a hard disk could have too many bad data blocks. The system must be in Maintenance mode for the Action to be executable. 7 Force Disable can be used to disable components that are fully functional and have thus a Normal status. This function can be used to remove components from the system for example for simulating errors or for troubleshooting intermittent errors. 8 Force Enable is the reverse of Force Disable Action, for example to enable a component that has been detached earlier with the Force Disable. Both Force Disable and Force Enable Actions are not available for all components; see the ETERNUS Web GUI User's Guide for further reference. 9 Especially if the customer has several ETERNUS DX systems, it is always a good idea to switch on the Locator LED for the Enclosure that requires maintenance work. This way you can be 100 per cent certain that you're not removing for example a hard disk from the wrong system. Turning the LED on makes it blink in green - make sure you switch the LED off after having finished the maintenance work. 10 Having Hot Spare disks available in the system is strongly recommended. There are two types of Hot Spare disks:

3 Global Hot Spares that any existing RAID Group can use as a Hot Spare and Dedicated Hot Spares that are designated for a particular RAID Group. Of each Hot Spare type there can be several disks configured in one system. Please note that for each disk type in the system - SAS, Nearline SAS or SSD - there should be at least one Hot Spare disk of the same type available. When a disk fails in a RAID Group, ETERNUS DX qualifies the available Hot Spare disks to find the best suite for the failed disk. If the same type of disk is not available, ETERNUS may for example have to take a slower Nearline SAS to replace a faster SAS disk. That degrades the performance of the whole RAID Group. 11 Now we move on to RAID Group Administration by choosing the main menu option "RAID Group". This menu can be used to create new RAID Groups and to execute Actions for existing RAID Groups, for example to expand a RAID Group or to verify its consistency. One can also create new Volumes; Open Volumes - meaning normal disk Volumes - or Thin Provisioning Volumes or Snapshot Volumes. 12 A RAID Group may be found defective for example because of a sector read failure; consequently the RAID Group is marked "Broken". To try and recover from the problem one can choose the Recover RAID Group Action. This Action tries to restore the RAID Group to full functionality and also to write any potentially existing Pinned Data from the cache to the disk. The RAID Group may also have status "Broken" because it has lost a further disk after having lost its redundancy - for example, due to a delayed replacement of a defective disk - in which case the defective disks need to be hot replaced. The data will of course be lost. If Pinned Data is left in the cache, you can use the respective ETERNUS Web GUI function to delete it. 13 Now we move on to the "Volume" menu, that can be accessed either by choosing Action "Create Volume" from RAID Group Administration or by choosing Volume from the top menu. Under "Category" column one can find the functions for volume performance statistics and the management of Pinned Data, Bad Sector and Balancing of Thin Provisioning Volumes. After choosing one or more of the existing Volumes the "Action" column shows the available functions. As a side remark; function "Forbid Advanced Copy" prevents Volumes from being accidently used as a destination of a reverse copy process. 14 This next chapter provides a brief introduction to a number of typical maintenance operations that are listed here. For complete descriptions please refer to the Installation and Operation User's Guide. 15

4 For some maintenance and service tasks it is necessary to change the global status of the ETERNUS DX system from Normal to Maintenance. To do this you must be logged in with a user account with maintainer privileges, for example f.ce. In Maintenance mode no error messages are sent out by the ETERNUS Maintenance status is shown in the upper right hand corner. The Maintenance mode can be toggled with the button in the lower right hand corner of the screen. 16 Adding a Drive Enclosure must always be done using the ETERNUS Web GUI "Add Drive Enclosure" wizard. The wizard guides through the necessary installation steps and eventually powers on the Enclosure and creates an inventory of all available disk drives. When adding multiple Enclosures the wizard must be run for each Enclosure separately. 17 The ETERNUS DX80 S2 and ETERNUS DX90 S2 have got one Memory DIMM socket per CM. Preventive Maintenance is only possible with a dual CM configuration because for the memory module replacement the CM must be physically removed from the system. In order not to lose host connection during the replacement the system must have a CM overlapping I/O Multipath configuration. Please note that the DX80 S2 uses a 2 Gigabyte DIMM and DX90 S2 uses a 4 Gigabyte DIMM. 18 With the DX410 S2, DX440 S2 and DX8700 S2 it is possible to upgrade and downgrade the CM cache capacity without stopping operation. A wizard session guides you through the process of adding memory. A CM overlapping I/O Multipath configuration is necessary to facilitate uninterrupted host access. The Cache Memory must be configured identically in all fitted CMs. Mixing different capacity DIMMs is supported. For more information refer to the respective ETERNUS DX Installation and Operation Guide. 19 The ETERNUS DX S2 systems provide flexible host connectivity by supporting different Channel Adapter topologies, like iscsi, SAS, Fibre Channel and Fibre Channel over Ethernet. Adding a Channel Adapter can be done without having to stop host access to the ETERNUS DX S2 if the system has a dual CM configuration with CM overlapping I/O Multipath. The CA configuration must be identical in both CM for the topology and CA slot number. There are no restrictions regarding mixing of the topologies within ETERNUS DX S2 system.

5 Also for this subject, for more information refer to the respective Installation and Operation Guide or to the Web Based Training module "ETERNUS DX S2 Common Features". 20 ETERNUS DX systems do not save any configuration information on the hard disks; instead the disk configuration is based on the hardware SAS address. This is why it is important always to use the ETERNUS Web GUI or CLI if a disk configuration needs to be changed. First step in the procedure is to remove the disk from any existing disk configuration. The Remove Disk Action can be used to release the selected disk from the system permanently after which it can be physically removed from its disk bay. Please note that after this the data on the disk is no longer available. When the same disk is fitted in another disk bay it will be automatically recognized and initialized as a new disk in the system. The Remove Disk Action can be executed only on one disk at a time. 21 Next chapter introduces us to the support and maintenance related functionalities regarding error statistics and event logs. 22 ETERNUS DX S2 systems maintain error statistics for the I/O Modules residing in the Drive Enclosures. These statistics serve as an information source for troubleshooting an intermittent error and as a diagnostics mechanism for preventive maintenance purposes. A similar functionality is provided for the CM and CA modules in a form of performance information. 23 Equally like with the I/O Modules, disk error statistics help finding components liable for preventive maintenance and may provide useful information for finding reasons for intermittent read or write errors. The statistics for a single disk, for a group of disks or for all disks can be deleted to help pinpointing a potential connection between irregular system behavior and disk errors. 24 ETERNUS DX keeps a track of all system events in a number of logs. These events include Event Notifications, Panic Dumps and Disk G-Lists that can be viewed and/or exported and deleted. We will have a closer look at these on the following slides. 25 The Event Log function displays the event history of the ETERNUS DX system. Up to 400 last log entries are stored. The leftmost column labeled "Level" uses three symbols to indicate the severity of the log entries. A blue "i" stands for "Information", a yellow triangle with a black exclamation mark indicates a "Warning" and a red circle with a white "x" refers to an "Error" event. Delete button can be used to clear the log.

6 26 ETERNUS holds an internal log for configuration information, detected errors, warnings, and traces. With the option "Include Expander Information" it is possible to create a log file without the information about the backend connection between the Enclosures. Log segment size can be chosen to suit the means by which the log will be forwarded to the back level support. And the selection "Delete of Customer Information" generates a log file without any customer related info, like IP address, administrator related information or details about the location of the ETERNUS. The binary file can be saved on the computer serving the Web GUI session. The log file can be read by back level support. And if necessary it is possible to delete the log by pressing the button available in the lower right hand corner. 27 The other useful piece of information for troubleshooting purposes for the back level support is the Panic Dumps. If any Panic Dumps are available they can be handled the same way as shown for the event logs on the previous slide. After a Panic Dump is exported it is good practice to delete it to make room for potential new Panic Dumps; if more than two Panics have taken place only the newest and oldest are held. 28 G-List stands for Growth-List which refers to a cumulative collection of errors that have occurred during the lifetime of the disk. Each hard disk holds this internal statistic list and ETERNUS DX provides the possibility to export this information to an ASCII file. The G-list contains for example information about sectors that have become unusable. Although such sectors are excluded from future data operations, such defects may reduce the disk access time if there are too many of them. The G-list may help to find hard disks that are candidates for a preventive replacement task. 29 ETERNUS DX provides a number of administration tasks that are generally referred to as System Utilities. Depending on the role of the login account different utilities are available. This next chapter provides an introduction to these Utility tasks that are available for the user account "root". 30 The System Utilities are available under the top menu option "System". Here is an overview of the available functions; the following slides explain them in more detail. 31 A shutdown of an ETERNUS DX S2 system is under normal circumstances rarely necessary because everything can be done online. However, a restart might be necessary to conclude a particular maintenance task.

7 By selecting this function the ETERNUS DX conducts a graceful shutdown and restart in about two minutes. This naturally also interrupts the current Web GUI session. 32 The function Export Configuration allows creating an external backup of the complete system configuration like RAID Groups, Volumes or Host Affinities. It is strongly recommended to save a configuration file on a regular basis. This configuration file is in binary format and can be saved on the PC that is serving the GUI session. The procedure is similar to that with the log files. The user account "root" has no permission to restore an ETERNUS DX configuration file; later on we will see that the default user f.ce has the necessary privileges to restore this configuration file. 33 Backup Configuration is a similar function with the Expert Configuration function but instead of exporting the configuration file it is saved on the system internal Boot-up and Utility Device, in short BUD. A maximal of four configuration files can be stored. After selecting the Backup Configuration in the Action column at the right hand side of the screen the next screen comes up with two sets of radio buttons. The upper "Select Configuration Definition" area can be used to choose a name for the configuration file; either by using the system default names or define an own name as an identification for the configuration. The lower "Select Backup Slot" area is used to choose one of the four placeholders for the configuration file. If the chosen placeholder already contains a configuration file the existing file will be overwritten. To execute the Action the Backup button in the bottom right-hand corner of this screen must be clicked. 34 There are further functions available for the default user account "f.ce"; this next chapter provides a brief introduction to those System Utilities that are additional to those for the user account "root". 35 The default user account f.ce has a role maintainer and therewith the required privileges to restore a system configuration. There are three alternative sources for the configuration file to be restored: one of the three automatically saved configurations or one of the four configuration files backed up on the BUD or from a locally stored, exported configuration file. It is very important to choose the correct restore mode; "Apply Mode Restore" or "Apply Mode Initialize". Function "Apply Mode Restore" restores the RAID configurations without initializing the Volumes, meaning existing data on the disks remain unchanged. With the function "Apply Mode Initialize" the RAID configurations are restored and the volumes are initialized, meaning existing data on the disks will be lost. The chosen selection can be applied by clicking on the Apply button in the bottom right hand corner of the screen.

8 36 "Initialize BUD" function deletes all firmware archives, internal logs and Panic Dumps from the BUD in each available CM. After the initialization is completed the active firmware should be re-registered so that at least one firmware version is available for a firmware recovery function. 37 This function is used to delete sense information that has not been reported to the host. Sense information may be generated and remain in the ETERNUS DX system during maintenance work. To avoid unnecessary errors being reported it is always recommended to delete the sense data after finishing maintenance work. 38 ETERNUS DX has special Recovery Utilities to recover from severe error situations. We will first have a look at the Reset Backup and Restore Fail function. If the ETERNUS DX starts up with a Not Ready Error status - meaning error code NRDY associated with a number - then it is possible to try and recover from the error using this utility. It is always recommended to refer to the Installation and Operating User's Guide for further information about the error code to understand better the root cause for the error. This utility resets the system after an error that has occurred either when the system was shutting down, during a power failure or when the system was starting up. After starting the process the ETERNUS tries to reset the error situation and after a re-start the system should have again green Normal status. 39 Data residing the Controller Module cache because it cannot be automatically written to the disks is called Pinned Data. If the ETERNUS DX reports that Pinned Data exists then you can use this utility to forcibly write the data to the disks. 40 This utility is designed for the rather uncommon situation when the system starts up after a power failure with Not Ready Error status. This is typically caused by a combination of errors so before executing this function it is recommended to try and correct the root cause of the error. After having done that, this utility can be used to save the user data that otherwise would have got lost. 41 When both CMs are faulty at the same time the ETERNUS DX system hangs and cached data cannot be written back to the data disks. The ETERNUS DX has status Machine Down. Reason for this could be for example when one CM is degraded or in Maintenance Mode and the other CM falls into Panic. With "Machine Down" status the ETERNUS DX cannot be turned off unless the internal recovery process completes successfully. This is to prevent loosing Pinned Data if the system was simply switched off.

9 "Reset Machine Down Recovery" can be executed to first save the Pinned Data and then restart the system. 42 This function is available for very rare error situations and should not be executed unless specifically instructed by the back level support. 43 With this utility it is possible to ensure that newly added disks are fully functional. The utility carries out a rather intensive diagnostics of the selected disk or disks and is therefore not recommended for disks that are in normal use as members of a RAID Group. Depending on the capacity of the disk the diagnostics can take a considerably long time. 44 That brings us to the end of this Web Based Training module. For further information regarding the ETERNUS DX storage systems from Fujitsu please check the other available training modules.