IBM Tivoli Storage Manager for Space Management Proposal for a Tivoli Storage Manager Client system migration from Solaris with VxFS to Linux with GPFS or AIX with GPFS or JFS2 Document version 1.0 Fabián Kuhl Thomas Schreiber Dominic Mueller-Wicke
Copyright International Business Machines Corporation 2015. US Government Users Restricted Rights Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.
REVISION HISTORY Date Version Revised By Comments April 2015 1.0 Fabián Kuhl Original version Copyright International Business Machines Corporation 2015 iii
Proposal for a Tivoli Storage Manager Client system migration from Solaris with VxFS to Linux with GPFS or AIX with GPFS or JFS2 This proposal describes a migration scenario for the following Tivoli Storage Manager clients (mentioned as source clients): - Tivoli Storage Manager API and Backup/Archive client 6.1.5.7 - Tivoli Storage Manager for Space Management (HSM) client 6.1.5.7 It describes the procedure to migrate the above mentioned clients from the following system (mentioned as source environment): - Solaris Sparc 10 with VxFS 5 (Veritas File Systems) The target systems in this procedure are the following (mentioned as target environments): - Linux x86 RH 6 with GPFS version 4.1 TL1 or higher or - AIX 7.1 with GPFS version 4.1 TL1 or higher or - AIX 7.1 with JFS2 The Tivoli Storage Manager clients on the target system (mentioned as target clients) are the following: - Tivoli Storage Manager API and Backup/Archive client 7.1.1 - Tivoli Storage Manager for Space Management (HSM) client 7.1.1 Prerequisites: This procedure is a proposal which does focus on the client side. The TSM Server migration procedure is not described here. Please see the TSM Server Information Center: http://www-01.ibm.com/support/knowledgecenter/ssgsg7_7.1.1/com.ibm.itsm.srv.common.doc/t_server_main.html For this migration procedure the TSM server has to be on the following level: 7.1.1 This system migration procedure is based on the assumption, that on client side the Tivoli Storage Manager API, Backup/Archive and the Tivoli Storage Manager for Space Management (HSM) is installed and running. The TSM Server stanza for those clients needs to be the same, so you can benefit from the Space Management client for this migration. The option NODENAME needs to be mentioned for the TSM Server stanza in the client dsm.sys file.
Before starting any migration, the above mentioned versions (on source systems) need to be installed and tested. A backup and restore aswell as a migration and recall of data has to be tested. The consistency of data has to be checked. To follow this procedure, we do recommend the have good skills on Tivoli Storage Manager and GPFS. For further information see: http://www-01.ibm.com/support/knowledgecenter/ssgsg7_7.1.1/com.ibm.itsm.ic.doc/welcome.html http://www-01.ibm.com/support/knowledgecenter/ssfkcn/gpfs_welcome.html http://www-01.ibm.com/support/docview.wss?uid=swg21599862 Note: The described procedure was successful sniff tested in the TSM Lab. The system migration procedure is not officially supported. The customer should perform internal testing before migrating any production system. Known Limitations: - File extended attributes (EA) data can't be recreated on the target system. The extended attribute format on VxFS and GPFS or JFS2 is incompatible. File extended ACL data can't be recreated on the target system. The extended ACL format on VxFS and GPFS or JFS2 is incompatible. - Premigrated or migrated files that held neither ACL nor EA data on the source system will be recreated to migrated file state on the target system if you specify restoremigstate=yes. For further information see: http://www-1.ibm.com/support/knowledgecenter/ssgsg7_7.1.1/com.ibm.itsm.client.doc/c_bac_aclsupt.html Source environment summary: - Solaris Sparc 10 with VxFS 5 or - Tivoli Storage Manager API and Backup/Archive client 6.1.5.7 - Tivoli Storage Manager for Space Management (HSM) client 6.1.5.7 - Tivoli Storage Manager Server version 7.1.1 Target environment summary: - Linux x86 RH 6 with GPFS version 4.1 TL1 or higher or - AIX 7.1 with GPFS version 4.1 TL1 or higher or - AIX 7.1 with JFS2 - Tivoli Storage Manager API and Backup/Archive client 7.1.1 - Tivoli Storage Manager for Space Management (HSM) client 7.1.1 Copyright International Business Machines Corporation 2015 5
- Tivoli Storage Manager Server version 7.1.1 Migration scenario overview: Final steps on source system and shutdown Environment setup on target system File Restore on target system Final TSM activities on target system Final steps on source system: 1. Make sure the source environment matches with the above described prerequisites. 2. Check backup and restore aswell as migration and recall of data. 3. Copy dsm.sys and dsm.opt to a safe space on other machine. 4. Save output of the used HSM file systems and mount points (mount, dsmdf). 5. HSM migrate all files to reduce the time required for restore on target system. 6. Run final incremental backup of all files. 7. Run final HSM reconciliation in the file system. 8. Run a database backup on TSM server. 9. Shutdown source system to prevent inconsistency between file systems and TSM server content. Setup target system: 1. Set up the operating system as mentioned in the target environment summary. 2. Set up AIX JFS2 or GPFS or on Linux x86 GPFS as mentioned in the target environment summary. On Linux we do recommend, not to set up SELINUX. This setup might lead to problems with restore and recalls. 3. For GPFS create GPFS cluster setup and start GPFS. 4. Create the file systems. The mount points of the file systems must be identically to the ones used on the source system. For GPFS the DMAPI must be enabled for all file systems which will be used with HSM.
5. Copy the stored dsm.opt and dsm.sys file to the target system. If you have set up a GPFS cluster with more than one node, copy the dsm.opt and dsm.sys to all cluster nodes. Please be sure you have option NODENAME set in dsm.sys. Optional you can use ASNODE option setup. 6. We recommend on AIX or Linux with GPFS to set export HSMINSTALLMODE=SCOUTFREE in a shell and the following options in the dsm.opt on all nodes HSMEXTOBJIDATTR YES HSMENABLEIMMEDIATEMIGRATE YES HSMGROUPEDMIGRATE YES HSMDISABLEAUTOMIGDAEMONS YES 7. Install the Tivoli Storage Manager clients 7.1.1 (API, Backup/Archive and Space Management HSM), in a GPFS cluster on all nodes. 8. The following HSM daemon should run now on all nodes: 1 x dsmwatchd, 3 x dsmrecalld, if SCOUTFREE not set, also 1 x dsmmonitord and 1 x dsmscoutd. 9. Mount all file systems, on GPFS use mmmount all -a. 10. Add space management (HSM) to the file systems which were managed by HSM on the source system (see saved output of dsmdf). 11. If SCOUTFREE set on GPFS, setup GPFS policies for threshold migration to prevent out of space conditions while the restore is ongoing (see Tivoli Field Guide "TSM - GPFS Integration: Threshold Migration"). 12. For test, create a file on the space managed file system. Manually test the backup and restore aswell the HSM migration and recall of the file. File restore on target system: Use the Tivoli Storage Manager Backup/Archive client and the Tivoli Storage Manager for Space Management to recreate the whole content of the file system. Run the following steps: 1. Restore of the empty directory structure. Use the restore options -dirsonly -replace=yes ifnewer Example: dsmc restore <filesystem name> -dirsonly -replace=yes ifnewer 2. Run the dsmmigundelete command to recreate all files as stub file, that were migrated by the Tivoli Storage Manager for Space Management (HSM) on the source system. Example: dsmmigundelete <filesystem name 3. Full file restore of all files that were not HSM migrated before on the source system. Use the following restore options: -subdir=yes -restoremigstate=yes -replace=yes -ifnewer Example: dsmc restore <filesystem name> -subdir=yes -restoremigstate=yes - replace=yes -ifnewer Copyright International Business Machines Corporation 2015 7
Final Tivoli Storage Manager client activities on target system: Run the following Tivoli Storage Manager activities on the target system: 1. Incremental backup of all files in the file systems On GPFS we do recommend to run mmbackup. See the IBM Knowledge Center http://www-01.ibm.com/support/knowledgecenter/ssfkcn/gpfs_welcome.html 2. Run HSM reconciliation in all HSM managed file systems. On GPFS we do recommend to use the GPFS policy based reconciliation method. (See TSM Information Center). Please note: Do only start the reconciliation, when all data is restored on the target system. 3. For test, access a stub file in a HSM managed file system. A recall will be initiated by the Tivoli Storage Manager for Space Management client. 4. Do run a restore of a file. Note: Files that were recreated in stub format on the target system by using the dsmmigundelete command, but held ACL on the source system will be recalled to the file system to state premigrated at the time of the next backup. After the backup has finished, the files can be migrated again to reduce the overall space required on the file system. Correction of issues indicated by error message ANS9616E Instead of the dsmmigundelete command the restore command can be used to recreate stub files in the target file system. As described above, this will work if the file has no ACL or EA data or has EA, but no ACL data. The usage of this procedure will lead to the following error, at the time of the next execution of the reconciliation on the target system after the system migration has finished: ANS9616E dsmreconcile: cannot get migration information for filename on filesystemname This error can be resolved by applying the dsmmigundelete command using the option -recover and retry execution of dsmreconcile. Recommendation for customer running pure Solaris environments and Solaris depending applications If the customer system environment exists of Solaris systems only and applications are used that aren't available on other operating systems, the absence of Tivoli Storage Manager for Space Management can be addressed as follows: Setup a target system with one of the supported operating- and file system types (AIX GPFS; AIX JFS2; Linux x86 GPFS). Perform a system migration to the target system. Use NFS mounts to connect the existing Solaris systems to the target system file system. Threshold migration has to be performed on the target system. The transparent recall
service works over NFS. If using GPFS it is recommended to use GPFS mmbackup for incremental file system backup and GPFS policy driven threshold migration for HSM activity. Both functions use the Tivoli Storage Manager functions inside. Notices This information was developed for products and services offered in the U.S.A. IBM may not offer the products, services, or features discussed in this document in other countries. Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead. However, it is the user's responsibility to evaluate and verify the operation of any non-ibm product, program, or service. IBM may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not grant you any license to these patents. You can send license inquiries, in writing, to: IBM Director of Licensing IBM Corporation North Castle Drive Armonk, NY 10504-1785 U.S.A. For license inquiries regarding double-byte character set (DBCS) information, contact the IBM Intellectual Property Department in your country or send inquiries, in writing, to: Intellectual Property Licensing Legal and Intellectual Property Law IBM Japan Ltd. 19-21, Nihonbashi-Hakozakicho, Chuo-ku Tokyo 103-8510, Japan The following paragraph does not apply to the United Kingdom or any other country where such provisions are inconsistent with local law: INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS PAPER AS IS WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you. This information could include technical inaccuracies or typographical errors. Changes may be made periodically to the information herein; these changes may be incorporated in subsequent versions of the paper. IBM may make improvements and/or changes in the product(s) and/or the program(s) described in this paper at any time without notice. Any references in this document to non-ibm Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this IBM product and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you. Licensees of this program who wish to have information about it for the purpose of enabling: (i) the exchange of information between independently created programs and other programs (including this one) and (ii) the mutual use of the information which has been exchanged, should contact: IBM Corporation 2Z4A/101 11400 Burnet Road Austin, TX 78758 U.S.A. Such information may be available, subject to appropriate terms and conditions, including in some cases, payment of a fee. Copyright International Business Machines Corporation 2015 9
The licensed program described in this document and all licensed material available for it are provided by IBM under terms of the IBM Customer Agreement, IBM International Program License Agreement or any equivalent agreement between us. Any performance data contained herein was determined in a controlled environment. Therefore, the results obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. All statements regarding IBM's future direction or intent are subject to change or withdrawal without notice, and represent goals and objectives only. This information is for planning purposes only. The information herein is subject to change before the products described become available. This information contains examples of data and reports used in daily business operations. To illustrate them as completely as possible, the examples include the names of individuals, companies, brands, and products. All of these names are fictitious and any similarity to the names and addresses used by an actual business enterprise is entirely coincidental. COPYRIGHT LICENSE: This information contains sample application programs in source language, which illustrate programming techniques on various operating platforms. You may copy, modify, and distribute these sample programs in any form without payment to IBM, for the purposes of developing, using, marketing or distributing application programs conforming to the application programming interface for the operating platform for which the sample programs are written. These examples have not been thoroughly tested under all conditions. IBM, therefore, cannot guarantee or imply reliability, serviceability, or function of these programs. The sample programs are provided "AS IS", without warranty of any kind. IBM shall not be liable for any damages arising out of your use of the sample programs. If you are viewing this information softcopy, the photographs and color illustrations may not appear. Trademarks IBM, the IBM logo, ibm.com, [insert IBM brand that materials relate to ONLY IF it appears on our trademark Web site], and [insert IBM product name that materials relate to ONLY IF it appears on our trademark Web site] are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at www.ibm.com/legal/copytrade.shtml. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries.