Implementing an NDMP backup solution using IBM Tivoli Storage Manager on IBM SONAS

Transcription

1 Implementing an NDMP backup solution using IBM Tivoli Storage Manager on IBM SONAS Technical report Mandar J. Vaidya IBM Systems and Technology Group ISV Enablement August 2011 Copyright IBM Corporation, 2011

2 Table of contents Abstract...1 IBM SONAS NDMP...1 Overview of IBM SONAS NDMP... 1 IBM SONAS NDMP supported physical configuration... 2 Two-way (or remote) SONAS NDMP configuration... 2 Three-way SONAS NDMP configuration... 3 Fundamentals of SONAS NDMP feature... 4 SONAS NDMP command-line configuration... 6 ISV LAB SONAS system configuration... 6 SONAS NDMP network group configuration... 6 SONAS NDMP node group configuration... 8 Configuring SONAS NDMP backup prefetch... 9 Concurrent SONAS NDMP backup and restore usage with other SONAS functions Considerations for Tivoli Storage Manager data management application for SONAS NDMP backup Monitoring NDMP session on the SONAS system Monitoring NDMP log information on SONAS system Tivoli Storage Manager NDMP configuration...14 IBM SONAS NDMP configuration on Tivoli Storage Manager SONAS two-way NDMP configuration with Tivoli Storage Manager Configuration of library path and adding drives to the library Performing IBM SONAS NDMP backup using Tivoli Storage Manager SONAS NDMP backup using Tivoli Storage Manager command line interface SONAS NDMP backup using Tivoli Storage Manager backup-archive web client SONAS directory-level backup using Tivoli Storage Manager Configuring virtual file space mapping Performing IBM SONAS NDMP restore using Tivoli Storage Manager SONAS NDMP restore using Tivoli Storage Manager server interface SONAS NDMP restore using Tivoli Storage Manager backup-archive web client interface Summary...31 Appendix A: Glossary...32 Appendix B: Materials used in the lab setup...33 Appendix C: Resources...34 About the author...35 Acknowledgements...35 Trademarks and special notices...36

3 Abstract Network Data Management Protocol (NDMP) is an open protocol for managing data stored on networked servers. This technical paper provides the best practices for implementing IBM SONAS NDMP backup solution using IBM Tivoli Storage Manager. The NDMP future development is under the direction of the Storage Networking Industry Association (SNIA), which has a work group for NDMP. IBM SONAS NDMP IBM Scale Out Network Attached Storage (SONAS) is designed to address the new storage challenges posed by the continuing explosion of data. Leveraging mature technology from IBM high-performance computing experience, and based upon IBM General Parallel File System (IBM GPFS ), SONAS is an easy-to-install, turnkey, modular, scale out network-attached storage (NAS) solution that provides the performance, clustered scalability, high availability, and functionality that are essential to meet strategic petabyte age and cloud-storage requirements. The high-density, high-performance SONAS can help organizations consolidate and manage data affordably, reduce crowded floor space, and reduce management expense associated with administering an excessive number of disparate storage systems. With its advanced architecture, SONAS virtualizes and consolidates multiple filers into a single, enterprise-wide file system, which can translate into reduced total cost of ownership (TCO), reduced capital expenditure, and enhanced operational efficiency. This paper is part of the SONAS NDMP information set and is intended for the System Administrator implementing a backup solution with IBM Tivoli Storage Manager. The System Administrator has to be familiar with backup and restore operations and with the administration of Tivoli Storage Manager. Overview of IBM SONAS NDMP NDMP is a network-based protocol used by data management applications, primarily for backing up and restoring the files contained within a NAS system, such as SONAS. The SONAS support NDMP version 4. The SONAS NDMP implementation provides the capability to backup and restore the file systems with the SONAS system using NDMP. The granularity of backup is at the directory level. NDMP supports the concept of a full backup and an incremental backup. A full backup backs up all files and directories specified to be backed by SONAS NDMP. An incremental backup backs up those files and directories that have changed since the last full backup, depending on whether the incremental backup is cumulative or differential. A cumulative incremental backup backs up the files that are specified in the backup selections list that have changed since the last full backup. All files are backed up if no previous backup has been done. Cumulative incremental backups occur automatically according to scheduled criteria. A complete restore requires the last full backup and the last cumulative incremental backup. 1

4 A differential incremental backup backs up the files that have changed since the last successful incremental (differential or cumulative) or full backup. All files are backed up if no previous backup has been done. Differential incremental backups occur automatically according to scheduled criteria. A complete restore requires the last full backup, the last cumulative incremental backup, and all differential incremental backups that have occurred since the last full backup. A differential backup with Tivoli Storage Manager backs up all the data that has changed since the last full backup. With Tivoli Storage Manager, full backups are referred as NDMP level 0 and differential backups are referred as NDMP level 1. IBM SONAS NDMP supported physical configuration There are two primary methods in which NDMP can be used as an interface with SONAS. Two-way (or remote) NDMP Three-way NDMP The following sections describe the two-way (or remote) and three-way NDMP configurations in detail. Two-way (or remote) SONAS NDMP configuration The two-way NDMP consists of an external data management application, such as Tivoli Storage Manager, running on a server external to the SONAS system. The data management application has some form of storage hierarchy, such as a tape library that it manages for the storage of backup data. In addition to the external data management application (Tivoli Storage Manager), an Ethernet network exists. This Ethernet network connects the data management application to the SONAS interface nodes on which the NDMP server is running. NDMP controls information and data traffic across the network between the external data management application and the SONAS interface nodes on which the NDMP server is running. The recommendation is that this network be a high speed 10 Gb Ethernet network to handle the volume of data being backed up or restored. However, nothing prevents this network from being a 1 Gb Ethernet network. Figure 1 shows an example of a two-way SONAS NDMP configuration. It includes an external data management application (Tivoli Storage Manager) running on a server external to the SONAS system. The data management application has an IBM System Storage TS7650G ProtecTIER Deduplication Gateway attached to it through an 8 Gbps Fibre Channel (FC) storage area network (SAN). The System Storage TS7650G ProtecTIER Deduplication Gateway has an IBM System Storage DS5000 storage controller attached to it through 8 Gbps FC links, which in turn has some number of IBM System Storage DS5020 disk storage expansion units attached to it through 8 Gbps FC links. The data management application is connected to a 10 Gbps Ethernet network to which the SONAS interface nodes are attached. In Figure 1, the lines are intended to show the type and speed on the connections between the various physical components and do not necessarily represent the actual number of physical links. 2

5 Figure 1: Two-way SONAS NDMP backup configuration with Tivoli Storage Manager Three-way SONAS NDMP configuration In a three-way SONAS NDMP implementation, an NDMP tape server is installed on a server external to the SONAS system and separate from the server on which the data management application is running. Some form of storage devices, such as a virtual tape library or real tape library and tape drives are attached to the server running the NDMP tape server. The NDMP control traffic flows between the data management application and the SONAS interface nodes and NDMP data traffic flows between the SONAS interface nodes and the NDMP tape server. In this scenario, as only NDMP control traffic is flowing between the data management application and the SONAS interface nodes, the data management application does not need to be on a high-speed network. The data management application can use a lower speed 1 Gbps Ethernet network to connect the SONAS interface nodes and the external server on which the NDMP tape server is running. However, NDMP data traffic (the actual data being backed up or restored) is flowing between the SONAS interface nodes and the external server on which the NDMP tape server is running. Therefore, it is recommended that the Ethernet network between the NDMP tape server and the SONAS interface nodes running the NDMP server be a high-speed 10 Gbps Ethernet network. 3

6 Figure 2Error! Reference source not found. shows an example of an NDMP three-way configuration. In this example, the SONAS interface nodes (used for file serving) and the data management applications are on a 1 Gbps Ethernet network. Other SONAS interface nodes, used for NDMP backup and restore, are on a 10 Gbps Ethernet network along with the NDMP tape server. The server on which the NDMP tape server is running is connected to an 8 Gbps FC SAN along with an IBM System Storage TS3500 tape library with some FC attached tape drives, such as IBM Linear Tape-Open data cartridges, Generation 3, Generation 4, or Generation 5 tape drives. Figure 2: Three-way SONAS NDMP backup configuration with DMA and NDMP tape server Fundamentals of SONAS NDMP feature The following points explain the fundamentals of SONAS NDMP features: An NDMP version 4 compliant data server is available on every interface node of the SONAS system. There is a provision to create a set of interface nodes that will be part of an NDMP_NODE_GROUP. This set of interface nodes is paired with network group IP addresses that can be assigned to a specific network port. This network port is associated with the NDMP service. 4

7 The NDMP server running on an interface node provides for both data and control connections to servers external to the SONAS system on which a data management appliance is running. The ability to configure the NDMP parameters for this set of interface nodes (the NDMP_NODE_GROUP) is provided through SONAS command-line interface (CLI) commands that are runing from the management node, storing the NDMP configuration parameters in the Samba Registry. In addition to the SONAS CLI commands available to store and retrieve NDMP configuration parameters, a set of CLI commands are provided allowing to view NDMP session information and NDMP log information, and to stop currently running NDMP sessions. An NDMP backup session provides backup of a specific directory in a GPFS file system and all files and subdirectories contained within it. Besides the basic data of the files and directories, all extended GPFS attributes are saved for every file and directory. In order to provide the provision to back up a directory structure at a given point in time, a snapshot is used and it is actually the snapshot of the directory structure that is backed up. This snapshot also accounts for files that might be open or in use during the backup, as a point-in-time representation of the file is backed up by NDMP. An NDMP restore session restores all the files and directories in the proper structure of subdirectories, and so on. In addition to the actual file contents, the GPFS extended attributes are also restored. 5

8 SONAS NDMP command-line configuration The following SONAS CLI commands (shown in Table 1) are available for configuring, monitoring, and managing the NDMP configuration parameters and NDMP sessions: # 1 cfgndmp Configure NDMP 2 cfgndmpprefetch Configuring NDMP backup prefetch 3 lsndmp List NDMP configuration 4 lsndmplog List the actual contents of the NDMP log on the given interface node 5 lsndmpsession List NDMP session information 6 rmndmpcfg Remove NDMP configuration information for a specified NDMP node group 7 stopndmpsession Stop NDMP session 8 lsndmpprefetch List NDMP prefetch configuration Table 1: SONAS CLI command description ISV LAB SONAS system configuration In the ISV lab: The SONAS appliance has one management node: mgmt001st001 The SONAS appliance has three interface nodes: int001st001, int002st001 and int003st001 The SONAS cluster is defined as: st001.vsofs1.com There is a 10 Gb Ethernet card on each interface node and configured ethx0 to access the bonded ports (Refer to Appendix B: Materials used in the lab setup for more information) SONAS NDMP network group configuration This section provides the guidelines to create and configure network group that includes all of the interface nodes that will service NDMP requests for the NDMP node group. Create a network group comprising three interface nodes using the mknwgroup SONAS CLI command on SONAS management node. mknwgroup ndmp_nw_group int001st001,int002st001 Validate the network group using the lsnwgroup SONAS CLI command on the SONAS management node. 6

9 Note: If you want to add an interface node to an existing network group, use the chnwgroup command. For example, you can add an interface node, named int003st001, to the network group ndmp_group as follows: chnwgroup ndmp_nw_group --add int003st001 Create a network with configurable IP addresses using the mknw SONAS CLI command on the SONAS management node. mknw / /0: add , , , Note: Visit the URL: to figure out the Classless Inter-Domain Routing (CIDR). In this case, the team used 23. mknw /24 Validate the newly created network using the lsnw SONAS CLI command on SONAS management node. Attach the newly-created network group, ndmp_nw_group, to the newly-created network using the attachnw SONAS CLI command on the SONAS management node. attachnw /24 ethx0 -g ndmp_nw_group 7

10 SONAS NDMP node group configuration This section provides appropriate guidelines to create and configure the SONAS NDMP node group. A SONAS NDMP configuration can be defined only for an NDMP node group. A SONAS NDMP node group need to be created before any other specific SONAS NDMP node group configuration parameters can be set. A SONAS NDMP node group is created, configured, and activated appropriately, before an NDMP backup or restore can be configured on the Tivoli Storage Manager data management application server. Note: The SONAS NDMP configuration parameters of a single interface node cannot be changed individually. Create an NDMP node group using the --create option of the cfgndmp command on SONAS management node. cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --create Attach the newly-configured network group, ndmp_nw_group; refer to the SONAS NDMP network group configuration section to the newly created SONAS NDMP node group using the cfgndmp SONAS CLI command with the --networkgroup option on the SONAS management node. cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --networkgroup ndmp_nw_group Set the data port range of the NDMP node group using the --datatransferportrange option of the cfgndmp command on SONAS management node. cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --datatransferportrange Add file system mount point paths to the NDMP node group configuration using the -addpaths option of the cfgndmp command on the SONAS management node. cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --addpaths /ibm/gpfs1,/ibm/gpfs2,/ibm/gpfs3 A default NDMP backup prefetch configuration is assigned to a newly-created NDMP node group, with the function deactivated. Optionally, use the cfgndmpprefetch CLI command to change the NDMP backup prefetch configuration and activate the function for improved NDMP backup performance. Refer to the Configuring SONAS NDMP backup prefetch section for more information. Activate the NDMP node group with the --activate option of the cfgndmp CLI command. cfgndmp -c st001.vsofs1.com ndmp_node_grp1 --activate Note: You can use the lsndmp CLI command with the -ndmpservicestatus option to verify that NDMP has started on all of the nodes in the NDMP node group, on the SONAS management node. lsndmp -c st001.vsofs1.com [-s] [--ndmpservicesatus] 8

11 Figure 3: An example of lsndmp Configuring SONAS NDMP backup prefetch The NDMP backup prefetch function navigates the directory that is being backed up, reading files in advance to the files actually coming due to be backed up. The prefetch function opens files in readonly mode and places the files in the interface node's cache for improved backup performance. NDMP backup prefetch function is designed to work on files that are less than or equal to 1 MB in size. Restriction: SONAS NDMP backup prefetch function will not work for a file system that has a block size greater than 1 MB. To activate the NDMP backup prefetch function, use the cfgndmpprefetch CLI command with the --activate option. Specify the NDMP node group to enable NDMP prefetch function with SONAS NDMP node group, as in the following example on the SONAS management node. cfgndmpprefetch -c st001.vsofs1.com ndmp_node_grp1 --activate Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that the prefetch function for NDMP will be activated when NDMP is activated. To set a limit for the number of applications that can simultaneously, use SONAS NDMP backup prefetch for a node, (including multiple instances of the same program such as multiple SONAS NDMP sessions) use the cfgndmpprefetch CLI command with the --applimit option, as in the following example on the SONAS management node. cfgndmpprefetch c st001.vsofs1.com ndmp_node_grp1 --applimit 4 Note: If NDMP is not active on the specified NDMP node group, a message is displayed indicating that the configuration for prefetch function for NDMP has been updated. To set a limit for the number of prefetching threads per interface node, use the cfgndmpprefetch CLI command with the --numthreads option, as in the following example on the SONAS management node. cfgndmpprefetch c st001.vsofs1.com ndmp_node_grp1 --numthreads 100 Note: The value for the --numthreads option must be a positive integer greater than 50 and less than or equal to 180. The default value is

12 To display NDMP backup prefetch status information, use the lsndmpprefetch CLI command using the -s or --status option, and optionally adding the -g option to limit display to the specified NDMP node group, as in the following example on the SONAS management node. This command shows the current and default settings for prefetch. lsndmpprefetch c st001.vsofs1.com g ndmp_node_grp1 s Concurrent SONAS NDMP backup and restore usage with other SONAS functions The information in Table 2 helps you identify the SONAS features and functions that might be currently used on the same SONAS system and on the same set of SONAS interface nodes. SONAS Features and Functions Anti-virus scanning Asynchronous replication HSM processing NDMP backup and restore Tivoli Storage Manager backup and restore Anti-virus scanning N/A system: Yes Interface Nodes: Yes system: Yes interface nodes: Yes Refer Note 3 system: Yes interface nodes: Yes system: Yes interface nodes: Yes Asynchronous replication system: Yes interface nodes: Yes N/A system: Yes interface Nodes: Yes Refer Note 2 system: Yes interface nodes: Yes system: Yes interface nodes: Yes Hierarchical support management (HSM) processing system: Yes interface nodes: Yes Refer Note 3 system: Yes interface nodes: Yes Refer Note 2 N/A system: No interface nodes: No system: Yes interface nodes: Yes NDMP backup and restore system: Yes interface nodes: Yes system: Yes interface nodes: Yes system: No interface nodes: No N/A system: No interface nodes: No Refer Note 1 Table 2: Concurrent SONAS NDMP backup and restore usage with other SONAS functions IBM Tivoli Storage Manager backup and restore system: Yes interface nodes: Yes system: Yes interface nodes: Yes system: Yes interface nodes: Yes system: No interface nodes: No Refer Note 1 N/A 10

13 Notes: 1. IBM Tivoli Storage Manager backup / restore and NDMP backup / restore provide the same basic functionality of backing up or restoring file systems and the directories and files within the file systems. It is not recommended and not supported to have both Tivoli Storage Manager backup restore processing and NDMP backup restore processing being used on the same SONAS system. 2. NDMP backup are normally scheduled operations, which can be scheduled at a time when other activity, such as general purpose file serving, is low. If possible, it is recommended performing NDMP backup during periods when other file serving activity is generally lower, perhaps late in the evening or early in the mornings. 3. In case, the NDMP backup or restore processing significantly interferes with other SONAS functions, such as network file serving (CIFS, NFS, FTP, and HTTP) then consider increasing the processing power and memory configuration of the SONAS interface nodes or consider isolating NDMP processing to dedicated SONAS interface nodes. Many SONAS functions invoke the GPFS policy engine to evaluate a GPFS policy to determine the list of files to operate on. These include: Tivoli Storage Manager backup processing Tivoli Storage Manager HSM processing NDMP incremental backup processing Asynchronous replication processing The runpolicy CLI command and others The GPFS policy engine scans the file system metadata to determine the files that match the criteria specified in the policy. This scan of the file system metadata can generate a significant amount of I/O to the storage systems to read all the file system metadata, especially for file systems containing very large number of files, such as 10s or 100s of millions of files. Therefore, it is recommended that all of these functions not be started at exactly the same time, but instead these SONAS functions be staggered over time. Considerations for Tivoli Storage Manager data management application for SONAS NDMP backup You need to take care of the following considerations for Tivoli Storage Manager data management application (DMA) for SONAS NDMP backup. Tivoli Storage Manager supports only two-way SONAS NDMP configuration with SONAS where Tivoli Storage Manager (DMA) has some form of storage hierarchy, such as a tape library that it manages for the storage of backup data. Refer to the Two-way (or remote) SONAS NDMP configuration for additional details. Obtain either the IP address or host name for the interface node to be used for this NDMP session. Host name: Configure a DNS server with a common hostname mapped to all of the IP addresses that are associated with the network group that in turn is associated with the 11

14 NDMP node group. If this hostname is used, any of the interface nodes that are associated with the NDMP node group can be assigned based on a round robin IP address assignment from the DNS server. IP address: Submit the lsnwinterface CLI command using the -x option on the management node of the SONAS system and choose an IP address or multiple IP addresses if multiple backup policies are to be run simultaneously. This method is useful when multiple NDMP backup policies are used and you want to distribute the NDMP workload across multiple interface nodes and ensure that the same interface node will not be used for all of the backup policies that will be run from the data management application server. Configure the Tivoli Storage Manager data management application server with the configuration parameters of the NDMP server for the interface nodes that are available to perform NDMP services, including the username and password associated with the NDMP node group. If a port other than was selected for the NDMP control port, then that control port's information needs to be configured on the data management application server. Monitoring NDMP session on the SONAS system Note: Read this information after configuring Tivoli Storage Manager NDMP configuration and staging appropriate SONAS NDMP backup or restore. Refer to the Tivoli Storage Manager NDMP configuration section for more information. The lsndmpsession CLI command enables to monitor NDMP sessions on SONAS system. Use -n or -nodes option to view NDMP sessions running on specified interface nodes or with the -g or --nodegroupname option to view NDMP sessions running on specified NDMP node groups. Only interface nodes can be specified when using the -n or --nodes option. Multiple nodes and multiple node groups in a list must be separated with commas. If no nodes or node groups are specified, the output displays information for all of the interface nodes in the cluster. To determine the interface nodes that are running NDMP sessions for an NDMP node group, submit the following command to display the interface nodes that have NDMP sessions running and the sessions that are running on the nodes: lsndmpsession c st001.vsofs1.com -n int003st001 Or lsndmpsession c st001.vsofs1.com g ndmp_node_grp1 Figure 4: An example of lsndmpsession Use the SONAS CLI lsndmpsession command with the -i or --sessionid option to view the verbose information of the NDMP session identified by the specified session ID running on the specified interface node. In the following example, the session ID is specified. Use the SONAS CLI lsndmpsession command with the -i or --sessionid option to view the verbose information of the NDMP session identified by the specified session ID running on the specified interface node. 12

15 lsndmpsession c st001.vsofs1.com -n int003st001 -i Figure 5: An example of lsndmpsession with session ID Monitoring NDMP log information on SONAS system You can view SONAS NDMP log using the lsndmplog CLI command. Use the SONAS CLI lsndmplog command with the -n or --nodes option to view all of the NDMP log information related to the specified interface node. In the following example, the node int003st001 is specified: lsndmplog -c st001.vsofs1.com -n int003st001 Use the SONAS CLI lsndmplog command with the -l or --lines option to view the most recent lines of the NDMP log information related to the specified interface node. In the following example, the node int003st001 and 25 lines are specified: lsndmplog -c st001.vsofs1.com -n int003st001 -l 25 Use the SONAS CLI lsndmplog command with the -o or --outputlogfilepath option to save the log file as a temporary file, as in the following example: lsndmplog -c st001.vsofs1.com -n int001st001 -o /ibm/gpfs0/ndmplog.out 13

16 Tivoli Storage Manager NDMP configuration The IBM Tivoli Storage Manager enables you to use NDMP to initiate and control backups and restores of NAS systems. Tivoli Storage Manager Extended Edition includes the support for the use of NDMP to back up and recover NAS file servers such as SONAS. Tivoli Storage Manager NDMP interface connects to hosts that have an active NDMP service or an NDMP data module installed. NDMP allows IBM SONAS to backup data to other NDMP-controlled devices in network. NDMP passes control of data and file metadata to and from the Tivoli Storage Manager program. IBM SONAS NDMP backup with Tivoli Storage Manager includes following features: Tivoli Storage Manager supports full image backup of SONAS file system images through NDMP. Full backups can be followed by subsequent differential backups. Tape resource sharing is available. Individual file restore is available. The table of contents (TOC) is available for viewing and browsing. Restore is possible through a web client or Tivoli Storage Manager command line. IBM SONAS NDMP configuration on Tivoli Storage Manager Tivoli Storage Manager uses both server administration center and server command line interface to manage networker operations. Before configuring Tivoli Storage Manager for NDMP operations, refer to the Tivoli Storage Manager Information Center and administration guide for the requirements and limitations of Tivoli Storage Manager data management application server. Tivoli Storage Manager supports only two-way SONAS NDMP configuration with SONAS where Tivoli Storage Manager (DMA) has some form of storage hierarchy, such as a tape library that it manages for the storage of backup data. Before the tape library can be configured on the Tivoli Storage Manager server for NDMP backup and recovery operations, ensure that you have registered the required license. SONAS two-way NDMP configuration with Tivoli Storage Manager 1. Login to the Tivoli Storage Manager server command line interface. 2. Define the tape library with a library type. Figure 6:An example of defining a tape library 3. Define a devclass for the tape drives. 14

17 Figure 7: An example of defining devclass 4. Define ndmp storage pool for SONAS backup media. Figure 8: An example of defining ndmp storage pool 5. Define storage pool for storing TOC. If you specify this option at the time of backup, you can later display the TOC of the backup image and it can be used to restore individual files directly from the backup images. Figure 9: An example of defining TOC 6. NAS servers performs backup in its own format. SONAS uses NDMPDUMP data format to store the data in Tivoli Storage Manager. In order to set up required policy for SONAS backups, define a separate policy domain. Figure 10: An example of defining domain 7. Create a policy set in the domain Figure 11: An example of creating a policy set 15

18 8. Define a management class, and then assign the management class as the default for the policy set. Figure 12: An example of defining management class 9. Define a backup copy group in the default management class. The destination must be the storage pool created for backup images for NDMP operations. Figure 13: An example of defining a backup copy group 10. Activate the policy set. After activating the policy, policy is ready to use. Nodes are associated with Tivoli Storage Manager policy when they are registered. Figure 14: An example of activating a policy 11. Register the SONAS as Tivoli Storage Manager node, specifying TYPE=NAS. This node name is used to track the image backups for the SONAS. Figure 15: An example of registering SONAS as a Tivoli Storage Manager node 12. Define a data mover for each SONAS. The data mover name must match the node name registered in the previous step. In this command: hladdress is an IP address of SONAS lladdress is IP port for NDMP sessions with the SONAS. userid is NDMP user ID authorized for NDMP sessions with SONAS. password is valid password with the authentication to an NDMP session with the SONAS. The data format is ndmpdump. This matches with that of the target storage pool. 16

19 Figure 16: An example of define data mover Tivoli Storage Manager is now configured for SONAS NDMP operation. Configuration of library path and adding drives to the library After defining the library, you need to define the library path to the Tivoli Storage Manager and add the drives to the library. This procedure can be performed through Tivoli Storage Manager server administration center. 1. On the Tivoli Storage Manager server administration center, click Storage Devices to display library properties. Figure 17: Library configuration wizard 2. Enter device special file name for the library path and source name to add the library path. Click OK to continue. 17

20 Figure 18: Defining library path 3. View the defined library path that is displayed. Figure 19: Library path status 4. Click Drives and then click Action Add a drive to start adding drives to the library. Enter a drive name and device special file name to the tape drive and click OK. Figure 20: Adding tape drives 18

21 5. View the configuration of the defined tape drive that is displayed Figure 21: Tape drive addition operation status 6. Similarly, add all the tape drives to the library. Summary displays all the tapes drives once configured. Figure 22: All tape drives summary 7. After configuring tape drives, click Volumes and add volumes to the inventory and label the volumes in the library. 19

22 Figure 23: Adding volumes 8. Search for the volumes and click Next. Figure 24: Searching the volumes 9. For labeling the volumes, select the appropriate options and click Next. Figure 25: Labeling volumes 20

23 10. After selecting advanced options, click Finish to start volume discover and label volume process. Figure 26: Start volume discover and label volume process 11. After the process is complete, labeled volumes are displayed and are ready to use for NDMP operations. Click OK to complete the wizard. Figure 27: List of labeled volumes Performing IBM SONAS NDMP backup using Tivoli Storage Manager You can perform SONAS NDMP backup using Tivoli Storage Manager command line interface or Tivoli Storage Manager backup-archive web client interface. Before performing NDMP backups, ensure that the following configuration has been performed. Enable the NDMP connection between Tivoli Storage Manager server and IBM SONAS. Load the tapes into the tape library and label them appropriately. 21

24 While performing NDMP backup, Tivoli Storage Manager can collect and store file-level information in a TOC. This will help in displaying TOC from the backup image and in restoring individual files or directories directly from the backup images generated through backup-archive web client interface. SONAS NDMP backup using Tivoli Storage Manager command line interface Perform the NDMP backup using backup node command. The following example performs a full backup of the SONAS file system, /ibm/gpfs1, and generates TOC for the backup image. Figure 28: An example of NDMP backup Verify the backup after completion using the query nasbackup command. Figure 29: An example of the query nasbackup command SONAS NDMP backup using Tivoli Storage Manager backup-archive web client Tivoli Storage Manager backup-archive web client can be used to start NDMP backup. 1. Launch backup-archive web client from the Tivoli Storage Manager client. Enter login credentials and click Backup to launch backup wizard. 22

25 Figure 30: Launching backup-archive client 2. Select the file system or directory to backup from SONAS and click Backup. Figure 31: Selecting file system/directory to backup 3. NDMP backup completion status will be displayed. Click OK to complete the backup wizard. 23

26 Figure 32: NDMP backup summary SONAS directory-level backup using Tivoli Storage Manager Tivoli Storage Manager allows directory-level NDMP backup. Initiating a directory-level backup reduces the duration of the backup and restore and provides more flexibility in configuring the NDMP backups. For directory-level backup, virtual file spaces needs to be defined which will partition SONAS file system into multiple backup operations. Different backup schedules can be used to backup different directories at different schedule. Virtual file space name must be unique. If a file system name and virtual file space name happens to be the same, conflict occurs while performing NDMP backup to Tivoli Storage Manager. Virtual files space can be specified as a destination for restore operations. This allows restore of backup images to a directory on any file system of SONAS. The backup-archive web client interface can be used to select files to restore from a directory-level backup image because Tivoli Storage Manager client treats the virtual file space names as NAS file spaces. Configuring virtual file space mapping Configure virtual file space mapping using the define virtualfsmapping Tivoli Storage Manager server administration command. Following example will configure virtual file space /backup_dir1 located at /ibm/gpfs1/tsm_ndmp/backup_dir1 path within /ibm/gpfs1 file system. 24

27 Figure 33: An example of defining virtual file space mapping Query existing virtual file space using query virtualfsmapping command. Figure 34: An example of querying a virtual file space mapping Backup the SONAS directory using NDMP by backing up virtual file space using the backup node command. Following command will backup virtual file space /backup_dir1 and will generate a TOC for the backup image. Figure 35: An example of SONAS directory-level backup Query the directory-level backup using the query nasbackup command. Figure 36: An example of querying SONAS directory-level backup 25

28 Performing IBM SONAS NDMP restore using Tivoli Storage Manager You can perform SONAS NDMP restores using Tivoli Storage Manager server command line interface or Microsoft Windows backup-archive web client interface. For NDMP file-by-file or directory restores, you can use server interface or backup-archive web client interface. Restores using Tivoli Storage Manager server interface: When backups are performed with the TOC option, query nasbackup command will display information about backup images generated by NDMP. Then, restore node command with filelist parameter can be used to restore files from the NDMP backups. When backups are not performed with the TOC option, contents of the backup images cannot be displayed. If the name and location of files and directories in which image files are present is known, then restore node command with the filelist parameter can be used to restore files from the NDMP backups. Restores using backup-archive web client interface: The backup-archive web client interface requires that a TOC exists in order to restore files and directories. The web client must be installed on a Windows system. The Tivoli Storage Manager server accesses the TOC from the storage pool and loads the TOC information into a temporary database table. Then, a backup-archive web client can be used to examine directories and files contained in one or more file system images, and select individual files or directories to restore directly from the backup images generated. SONAS NDMP restore using Tivoli Storage Manager server interface You can perform a full file system restore using the restore node command. The following example performs a full file system restore of /ibm/gpfs1 to its original location. Figure 37: An example of restoration of a file system File system restore can be performed to another file system or virtual file space. The following example performs a full file system restore of /ibm/gpfs2 to another file system /ibm/gpfs1. 26

29 Figure 38: An example of restoring a file system to another file system File- or directory-level restores can be performed to its original or another location. The following example performs directory-level restoration of the directory /10_2 from virtual file space (SONAS directory) /backup_dir1 to another virtual file space (SONAS directory) /restore_dir1. Note that the FILELIST path should start at the root of the backup image. Figure 39: An example of a directory-level restore Similarly, single-file restore can be performed to its original or another location. The following example shows file-level restore of a file rhel.iso from virtual file space(sonas directory) /backup_dir1 to another virtual file space (SONAS directory) /restore_dir1. Figure 40: An example of a single-file restore SONAS NDMP restore using Tivoli Storage Manager backup-archive web client interface Tivoli Storage Manager backup-archive web interface from a Windows system can be used to perform NDMP restores. To do so: 1. Launch the Tivoli Storage Manager backup-archive web client interface. 2. Click Restore to start restore wizard. 27

30 Figure 41: NDMP restore using Tivoli Storage Manager backup-archive web client interface 3. Browse NDMP backup image to locate the file or directory to restore. After selecting the file, click Restore. Figure 42: NDMP restore file selection 4. In the Restore Options window that is displayed, if required, specify the restore options and click OK. 28

31 Figure 43: NDMP restore selecting the restore options 5. Select the preferred location to restore objects and click Restore. Figure 44: NDMP restore selecting the location to restore 6. After completing the restore, a summary report is displayed. Click OK to complete restoration process. 29

32 Figure 45: NDMP restore - restore summary 30

33 Summary SONAS is designed to address the new storage challenges posed by the continuing explosion of data. Leveraging mature technology from IBM high performance computing experience and based upon IBM GPFS, SONAS is an easy-to-install, turnkey, modular, scale out NAS solution that provides performance, clustered scalability, high availability, and functionality that are essential to meet strategic petabyte age and cloud-storage requirements. The high-density, high-performance SONAS can help organizations consolidate and manage data affordably, reduce crowded floor space, and reduce management expense associated with administering an excessive number of disparate storage systems. With its advanced architecture, SONAS virtualizes and consolidates multiple filers into a single, enterprise-wide file system, which can translate into reduced TCO, reduced capital expenditure, and enhanced operational efficiency. SONAS has incorporated the NDMP technology and supports the NDMP protocol version 4. Leveraging Tivoli Storage Manager NDMP backup support, the SONAS data files can seamlessly back up to the Tivoli Storage Manager supported storage device and perform restore from it. This technical content is intended to be a reference guide for users who want to use Tivoli Storage Manager for backing up files using NDMP protocol that are created on SONAS. It is not meant to be an implementation or solution guide. For details on actual implementation or solution design, refer to the documentation provided in the Appendix C: Resources section of this technical paper. 31

34 Appendix A: Glossary IBM Scale Out Network Attached Storage (SONAS) Build on IBM high-performance computing experience, and based upon IBM General Parallel File System (GPFS), scale out network-attached storage (NAS) solution provides the performance, clustered scalability, high availability, and functionality that are essential to meet strategic petabyte age and cloud-storage requirements. Network Data Management Protocol (NDMP) An industry-standard protocol created to ease the process of integrating backup and restore for NAS with data protection software, such as Tivoli Storage Manager. The NDMP is the data transfer protocol and one piece of the overall data protection solution. For more information about the NDMP protocol and the NDMP standards group visit the URL: Two-way (or remote) SONAS NDMP An NDMP configuration supported by SONAS. The two-way NDMP consists of an external data management application, such as Tivoli Storage Manager, running on a server external to the SONAS system. The data management application has some form of storage hierarchy such as a tape library that it manages for the storage of backup data. Three-way SONAS NDMP An NDMP configuration supported by SONAS. In a three-way SONAS NDMP configuration, an NDMP tape server is installed on a server external to the SONAS system and separate from the system where data management application is running. Tivoli Storage Manager An NDMP data management application used to backup SONAS data, using SONAS NDMP technology. Direct access recovery (DAR) Tivoli Storage Manager uses DAR to restore a directory or individual files from a backup image. DAR can greatly reduce the time taken to restore files and directories. 32

35 Appendix B: Materials used in the lab setup Infrastructure component Vendor Quantity Details Data management application server IBM 1 IBM x3650 M3 Storage IBM IBM SONAS Management node 1 Interface nodes 3 Storage nodes 2 Nearline SAS and SAS drives Network adapter (interface nodes) Broadcom 2 Broadcom NetXtreme II BCM Base-T Network adapter (data management application server) Switch (data management application server back-end SAN) Host bus adapter (HBA) Broadcom 2 Broadcom NetXtreme II BCM Base-T IBM 1 IBM Switch Model 2498-B24 QLogic 2 QLogic QLA 2432 For more information, refer to IBM System Storage SAN24B-4 Express Switch at ibm.com/systems/storage/san/b-type/san24b- 4/express/specifications.html Tape library IBM 2 IBM TS3200 Tape Library Express Model For more information, visit: ibm.com/systems/storage/tape/ts3200/index.html IBM SONAS Software IBM SONAS NDMP version 4 IBM Tivoli Storage Manager Tivoli Storage Manager Extended Edition

36 Appendix C: Resources These websites provide useful references to supplement the information contained in this paper: IBM Systems on IBM PartnerWorld ibm.com/partnerworld/systems IBM Redbooks ibm.com/redbooks IBM Publications Center IBM SONAS on IBM PartnerWorld ibm.com/partnerworld/systems/sonas IBM SONAS documentation IBM Scale Out Network Attached Storage Concepts ibm.com/redbooks/redpieces/abstracts/sg html?open IBM SONAS Introduction and Planning Guide (GA ): IBM SONAS administration and user documentation: IBM Scale Out Network Attached Storage Administrator's Guide (GA ): guide.pdf IBM SONAS User's Guide (GA ): uide.pdf IBM SONAS Configuration Guide (GA ): guide.pdf IBM SONAS Troubleshooting Guide (GA ): de.pdf IBM Tivoli Storage Manager documentation Tivoli Storage Manager Information Center 34

37 About the author Mandar Vaidya is a Senior Staff Software Engineer in IBM SONAS ISV Enablement group. He has more than 12 years of experience working with various storage and systems technologies. Mandar holds a Bachelor of Engineering degree from the University of Pune, India. You can reach Mandar at mandvaid@in.ibm.com. Acknowledgements This paper could not have been completed without the valuable suggestions and validation efforts from John T. Olson from IBM SONAS team and Michael Segapeli from Tivoli Storage Manager team. Both of them have given their valuable suggestions at every stage in qualification. Author also likes to thank Pratap Banthia for supporting this effort. 35

38 Trademarks and special notices Copyright IBM Corporation All rights Reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country. IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol ( or ), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel Inside (logos), MMX, and Pentium are trademarks of Intel Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. SET and the SET Logo are trademarks owned by SET Secure Electronic Transaction LLC. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Information concerning non-ibm products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-ibm list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-ibm products. Questions on the capability of non-ibm products should be addressed to the supplier of those products. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Contact your local IBM office or IBM authorized reseller for the full text of the specific Statement of Direction. Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is 36