FDR/UPSTREAM C O N C E P T S & F A C I L I T I E S G U I D E

Transcription

1 FDR/UPSTREAM C O N C E P T S & F A C I L I T I E S G U I D E

2 FDR/UPSTREAM t a b l e o f c o n t e n t s Introduction...3 PART ONE. Executive Overview Introducing UPSTREAM FDR/UPSTREAM Platform Support Database Support High-Speed Backup Fast, Flexible Restores Simplify, Centralize, Automate The Director Exchanging Tapes with UPSTREAM Reservoir Ancillary Functions Summary Key Features Summary PART TWO. System Overview Introduction System Summary Diagram FDR/UPSTREAM For Linux for System z and IBM z/os UNIX PART THREE. The Backup/Restore Processes The FDR/UPSTREAM Backup Scheme Backup Profiles Backup File Management Backup Performance The Restore Process Disaster Recovery The Rescuer

3 FDR/UPSTREAM t a b l e o f c o n t e n t s PART FOUR. Database Support Introduction Database Support Pre-and Post-Backup Conditional Processing Oracle DB2 Universal Database IBM Notes Microsoft Exchange Microsoft SQL Server SAP PART FIVE. Additional Features Introduction Vaulting and Migrating Your Backups Reporting Host Reporting with the Director Notification Facility Registered Names ISPF Panels Summary

4 1 INTRODUCTION PRODUCT OVERVIEW For more than 40 years, Innovation Data Processing has been producing high-quality Storage Management Software. Over the years, its products have evolved into today s ultra high-speed, safe, reliable storage management solutions for z/os and non-z/os data. It all started with the FDR Storage Management Family, for which thousands of licenses have now been sold worldwide. The FDR Family is the complete Storage Management System for z/os. FDR has become the industry standard for fast, reliable backups of z/os data, while ABR adds a layer of automation to the standard functions of FDR, providing advanced backup facilities like Incremental Backup, Application Backup and Archiving. FDRINSTANT provides near 24x7 backup of offline volumes created by DASD Subsystem features like Oracle SnapShot Copy, EMC TimeFinder, Hitachi ShadowImage and IBM FlashCopy. FDRINSTANT also enhances the performance of other utilities in the FDR Family, such as FDRCOPY and FDRMOVE. FDRCRYPT offers encryption services for all FDR and ABR backups, as well as sequential output created by an IDCAMS REPRO. FDRCRYPT protects these backups against unauthorized access by anyone who does not possess the proper encryption keys. FDRDRP is an extension of ABR that can reduce full-volume recovery time by up to 80%. FDRPAS and FDRMOVE provide non-disruptive or minimally disruptive movement of data from one disk to another, either within the same disk subsystem or across different subsystems. Data can be moved non-disruptively at the volume level (with FDRPAS), or it can be moved non-disruptively or with minimal disruption at the data set level (with FDRMOVE). These products are particularly useful for migrating and/or consolidating data from smaller disks to larger disks (e.g s to /27/54s and EAVs). COMPAKTOR and FDRREORG offer intelligent and powerful reorganization processes for whole DASD volumes and for PDS, VSAM and IAM data sets. FDREPORT and FDRViEWS provide extensive, customized DASD Management Reporting to suit many needs and purposes. You can run your reporting as a z/os batch job or through TSO/ISPF panels with FDREPORT, or you can use a Windows-based user interface available through FDRViEWS. FDRERASE V5.4 L70 is an EAL2++ certified product that can be licensed as an option to FDRPAS (or separately). It can quickly and securely erase many z/os disk volumes in parallel, allowing you to erase your data in the minimum elapsed time. Multiple levels of erasure are available. 3

5 1 INTRODUCTION PRODUCT OVERVIEW IAM, FATS/FATAR and FATSCOPY complete Innovation s z/os product range: IAM is Innovation s alternative to VSAM KSDS, ESDS and (as a cost option) AIX and RRDS files. IAM consistently provides 50-80% reductions in EXCPs, Batch Elapsed Times and Online Response Times, as well as a 20-40% reduction in CPU usage compared to VSAM. Due to its advanced file structure, IAM typically requires 30-70% less DASD space than VSAM to hold the same amount of data. IAM/PLEX is a cost option to IAM that provides z/os SYSPLEX Record Level Sharing (RLS) for IAM data sets across multiple z/os systems and LPARs that are connected as a z/os SYSPLEX. FATS/FATAR is a set of multi-purpose tape subsystem Media Integrity tools that allow for online tape certification, verification, analysis and erasure of tapes. FATSCOPY provides automated tape stacking and conversion, including Tape-to-VTS, VTS-to-Tape and VTS-to-VTS conversions. The UPSTREAM family builds on the strengths of the FDR Storage Management system, and extends Innovation s range of products beyond the boundaries of z/os: FDR/UPSTREAM provides a fast, safe and reliable solution to backing up Open Systems data that resides on file servers and workstations. Backups are transmitted across a network connection to disk or tape on the z/os host. FDR/UPSTREAM Linux on System z offers a high performance solution for backing up your Linux on System z clients. FDR/UPSTREAM z/os UNIX supports file level data protection for z/os UNIX including HFS and zfs systems. FDRSOS and UPSTREAM/SOS provide additional performance enhancements to the backup and restore process, which can utilize high-performance System z FICON channels if the Open Systems data is resident on an IBM DS8700/DS8800 with zddb, or an EMC Symmetrix DMX or VMAX with z/sos (formerly Enterprise Storage Platform, ESP). UPSTREAM Reservoir is designed for those users who wish to take advantage of the many strengths provided by FDR/UPSTREAM, but would prefer to use an Open Systems storage server environment (e.g. Windows, AIX, Linux) for hosting the backup management engine. 4

6 INTRODUCTION Each of the Innovation products is described in a range of Concepts & Facilities Guides. In this particular guide, we take a look at FDR/UPSTREAM. PART ONE provides a brief, executive overview of FDR/UPSTREAM. PART TWO is a more detailed system overview, describing the main components of FDR/UPSTREAM. PART THREE details the main Backup and Restore processes in FDR/UPSTREAM. PART FOUR describes FDR/UPSTREAM s database support. PART FIVE outlines other subsidiary functions and points of interest in FDR/UPSTREAM. Any comments or suggestions regarding this guide can be directed to: support@fdrinnovation.com And don t forget to visit our website for additional and up-to-date information on all Innovation products: Copyright 2014 Innovation Data Processing 5

7 ONE Executive Overview This section provides a brief, general overview of FDR/UPSTREAM and the benefits it can provide. 6

8 1 PRODUCT EXECUTIVE OVERVIEW 1.0 Introducing UPSTREAM UPSTREAM is a powerful, reliable and high-performance suite of products for the data protection of Open Systems data. Your UPSTREAM system can be hosted on either: A z/os mainframe with FDR/UPSTREAM (described here in this Concepts Guide). An open systems server such as Windows, UNIX or Linux with UPSTREAM Reservoir (see inside back cover for details). Whether it is just a few servers that you wish to back up, or your entire Open Systems infrastructure, the UPSTREAM suite offers a reliable, flexible and scalable solution to meet your requirements. Regardless of where you locate your UPSTREAM storage servers, all backup and restore operations can be controlled and monitored through a common user interface, known as the Director. of the Open Systems Backups...? Windows UNIX z/os UNIX Linux for System z The Director z/os Linux for System z Windows Linux UNIX Novell Host Backup Servers Your UPSTREAM storage servers can be fully integrated with the systems and infrastructure in place on the hosting system, allowing UPSTREAM to interact with key management systems, such as security, scheduling and tape management. UPSTREAM s high-performance backups can be optionally compressed and/or encrypted, and they can be directed to be stored on either disk or tape. UPSTREAM is priced very competitively based on the number of TB being protected and currently includes extensive client and database support, plus many features that are often found as cost options in competing products, such as Archiving/Migration and File Transfer. Continue reading this Guide if you want to know more about FDR/UPSTREAM under z/os. Contact your local sales representative (see back page for details) if you would like to know more about UPSTREAM Reservoir and/or you would like to request a free copy of the UPSTREAM Reservoir Concepts & Facilities Guide. You can also find out more about the UPSTREAM suite of products by visiting our website: 7

9 1 EXECUTIVE OVERVIEW 1.1 FDR/UPSTREAM FDR/UPSTREAM s backup management engine, sometimes referred to as the Storage Server is located on a z/os mainframe. It uses your existing z/os infrastructure to provide a single, centralized point of control for all your Open Systems backups: It utilizes your z/os system s high-quality, robust disk/tape media for its backups, which can be stored in a compressed format for optimum efficiency. It makes full use of your existing, tried-and-tested z/os system services, such as the Tape Management System, Job Scheduling System and Security System. FDR/UPSTREAM provides a flexible and scalable solution for securing anything from large corporate data servers, to smaller file servers or end-user workstations. It offers extensive client platform support, as well as intelligent agents for most of today s most popular business applications. 1.2 Platform Support The data to be backed up by FDR/UPSTREAM can reside on any of the following server or workstation client platforms: Microsoft Windows IBM AIX RS/6000 VMware Novell NetWare OES2 HP-UX Sun x86 x86 Linux Sun Solaris IBM z/os UNIX Linux for System z 1.3 Database Support As well as backing up standard files and documents, FDR/UPSTREAM is also database aware and includes specially developed agents to provide online hot backup facilities for the following popular database, messaging and groupware systems: Oracle IBM DB2 UDB IBM Notes and Domino Microsoft Exchange Microsoft SQL Server SAP See PART FOUR for more detailed information on FDR/UPSTREAM s Database agents. 8

10 1 EXECUTIVE OVERVIEW 1.4 High-Speed Backup FDR/UPSTREAM offers several options for a high-speed and fl exible backup of your open systems data. These backups, which can be taken at either a Volume level or an Incremental File level, are directed to your z/os storage server for safe, reliable storage and retention. FDR/UPSTREAM has been designed to backup your open systems data as quickly and effi ciently as possible. It offers several choices for the transmission of backup data to the z/os host: It can use high-performance network connections, such as 10GB Ethernet, or FICON channel connections. For users looking to backup Linux for System z, FDR/UPSTREAM is also positioned to utilize Hipersocket connections (if available and confi gured on your z/os host). As well as using the fastest possible connections between the Open Systems client and the z/os host, FDR/UPSTREAM also reduces to a minimum the amount of data that has to be transmitted: Its incremental backup scheme ensures that only the changed fi les are transmitted to the z/os host drastically reducing the time and resources required to take daily backups. The synthetic merge backup facility reduces the time required to take full backups, by merging the backups of changed data with backups of unchanged data already stored on the z/os host. Duplicate file support avoids backing up fi les that are duplicated across multiple servers or workstations, saving on transmission time during the backups and also reducing host storage requirements. A single copy of each duplicated fi le can be stored in a central repository at the z/os host. Segmented backup support is a form of Block level de-duplication, allowing you to take advantage of the phenomenon that most changes to large fi les and databases are typically made to a very limited percentage of the data. The fact that so much data does not change, means that much of the data in a large fi le does not have to be transmitted to be available for restore. Employing the same virtualization technique as full merge backup, i.e. copying data forward from prior backups and recovering data from incrementals, you can signifi cantly reduce transmission time and backup storage requirements. Optional compression further reduces backup times. Multiple levels of compression are available, all performed on the client prior to the data being transmitted to the z/os host. A physical, byte-by-byte backup facility is also provided, which eliminates head or rotational delays when reading data from disk, and signifi cantly improves backup performance. Physical backups are of most use during disaster recovery. Users of EMC s Symmetrix/DMX with z/sos/vmax and IBM DS8700 and DS8800 with zddb DASD Subsystems can take advantage of FDRSOS and FDR/UPSTREAM/SOS, which are two separately priced products from Innovation. They work in conjunction with the EMC and IBM DASD array s to provide high speed operations for Open Systems volumes across FICON channel connections. For more information, see the FDRSOS and FDR/UPSTREAM/SOS Concepts & Facilities Guide. 9

11 1 EXECUTIVE OVERVIEW 1.5 Fast, Flexible Restores FDR/UPSTREAM offers great flexibility on restore operations. Individual files, groups of files, directories, drives and even whole disks or entire servers can be restored with just a few simple clicks. In addition, FDR/UPSTREAM also offers several useful features at restore time: Tape Vaulting. FDR/UPSTREAM allows you to create secondary vault copies of some/all of your backups, which can be placed offsite for safe storage. If the primary copy of your backup is unavailable (e.g. after a disaster), a simple process enables the vault copies to be used for subsequent restores. Stand-Alone Recovery (SAR). This is a powerful feature of FDR/UPSTREAM where you can use a Windows machine with a SCSI-attached tape drive to perform disaster recovery restores without requiring the z/os host. The Rescuer. A powerful addition to the FDR/UPSTREAM storage management system, which offers a complete backup and restore solution with disaster recovery for Linux for System z and UNIX. The FDR/UPSTREAM Rescuer is an enhancement to FDR/UPSTREAM that allows disaster recovery of select UNIX systems including System z Linux, Intel Linux, and Solaris.The Rescuer provides this essential system recovery supplement because it is completely integrated into FDR/UPSTREAM. 1.6 Simplify, Centralize, Automate... FDR/UPSTREAM enables the effective protection of your business-critical open systems data by providing reliable and verifiable operations and simplifying, centralizing and automating your backup and recovery operations. FDR/UPSTREAM is designed to: Lower the cost of protecting your corporate-critical Open Systems data. Provide superior levels of protection for that data. Make efficient use of your tape media. Improve backup and restore capabilities. 1.7 The Director FDR/UPSTREAM includes a management interface called the Director, which offers the Systems Administrator a single, centralized and system-wide point-of-control for all FDR/UPSTREAM operations. The Explorer like interface, that can also be run from a Web browser, has multiple uses including: System monitoring, performance and management control functions. Ad-hoc or scheduled initiation of FDR/UPSTREAM backup/restore tasks. Extensive reporting. Non-Upstream job/task initiation. Host reporting facility (see PART FIVE). 10

12 1 EXECUTIVE OVERVIEW 1.8 Exchanging Tapes with UPSTREAM Reservoir FDR/UPSTREAM is a member of the UPSTREAM family of products, which also includes UPSTREAM Reservoir, a backup/restore system similar to FDR/UPSTREAM, but hosted on an Open Systems server such as Windows, UNIX or Linux, rather than z/os. See the UPSTREAM Reservoir Concepts and Facilities Guide for more information. FDR/UPSTREAM and UPSTREAM Reservoir can both use a single, compatible tape format, which allows the interchange of backup data between the two systems. If required, backup tapes that are generated with FDR/UPSTREAM can be logically interchanged with UPSTREAM Reservoir and vice versa, assuming that the media is compatible. So, for example, if you have 3590 tape drives on your Open System and on your z/os system, UPSTREAM can read a tape-set created by either system, on either platform. 1.9 Additional Functions In addition to the primary functions of backup, restore, and disaster recovery, FDR/UPSTREAM includes several other ancillary services: File Transfer. FDR/UPSTREAM can be used to transfer files from the client to the z/os host, or vice versa. No additional software or communication connection is required. Text files may be translated between ASCII on the client and EBCDIC on the z/os host. The transfers can be requested by either the z/os host or by the client. File Migration. This is the process of taking a backup and then deleting files that are no longer required, or which have not been used for a period of time. With FDR/UPSTREAM, files may be migrated as part of the normal backup process, or the migration can be done separately. Data sharing/distribution. When backup copies of your data are stored in a location common to all users (i.e. the z/os host), other users can easily retrieve that data subject, of course, to security restrictions. FDR/UPSTREAM s fast, secure and unattended nature makes it ideal for software sharing and distribution. 11

13 1 EXECUTIVE OVERVIEW 1.10 Summary FDR/UPSTREAM is built upon the 40+ years of experience that Innovation Data Processing has gained working in the Storage Management industry. FDR/UPSTREAM has inherited the same high level of product reliability and ease-of-use that are the cornerstone of Innovation s world-renowned FDR product family, which is currently used in a wide variety of installations and organizations worldwide. FDR/UPSTREAM offers a full range of Storage Management facilities for Open Systems data, equivalent to the type of features that have been available for z/os systems for many years. Now, at last, Storage Administrators have the capability to manage their Open Systems storage with the same high level of control, performance and ease-of-use as their z/os data. 12

14 1 EXECUTIVE OVERVIEW 1.11 Key Features Summary Key features of FDR/UPSTREAM include: High Performance Backup & Restore Fast, reliable and verifiable operations (including backups and restores) Synthetic Full-Merge backup process Easy selection of files, folders drives etc Support for Windows Automated System Recovery (ASR) A stand-alone recovery tool of select UNIX and Linux Systems via The Rescuer Client/database support Extensive client operating system support Online backup agents for most of the popular database/messaging systems Control & Automation Single, consolidated Graphical User via The Director Automated Scheduling Event notification via Tape Handling Efficient usage/stacking of tape media. Copying, Vaulting, Consolidation and Migration utilities for backups Interchange of tapes with UPSTREAM Reservoir Other Storage Management Features Extensive reporting Data Migration service File Transfer Simple/automated software distribution 13

15 TWO System Overview This section provides an overview of the main system components of FDR/UPSTREAM. It also describes FDR/UPSTREAM s additional support for Linux for System z and IBM z/os UNIX (USS). 14

16 12 SYSTEM OVERVIEW 2.0 Introduction FDR/UPSTREAM consists of the following key components: The Storage Server The Client software The Director This section takes a closer look at each of these components. 1. The Storage Server The FDR/UPSTREAM Storage Server is located on a z/os mainframe and is the main engine of FDR/UPSTREAM. It runs as a standard z/os started task with multiple sub-tasks and is responsible for the storage, retention and management of all FDR/UPSTREAM backups. It is also where the main configuration control files reside, together with the FDR/UPSTREAM database, which tracks the location of all current backups. Various log and history files are also maintained here. The FDR/UPSTREAM host can be controlled by normal z/os operator commands and also includes a full set of ISPF panels, which provide status monitoring and batch initiation services. 2. The Client Software The data that you actually wish to backup with FDR/UPSTREAM can come from any server or workstation that can communicate with the Storage Server. The FDR/UPSTREAM client software is installed on the server or workstation to be backed up and is responsible for accessing the files and databases during the backup and restore process. Data is transferred between FDR/UPSTREAM s client and the z/os host across one or more connections. FDR/UPSTREAM uses TCP/IP as its internal communications protocol. No additional hardware or software is required for the two components to be able to communicate. 15

17 12 SYSTEM OVERVIEW 3. The Director In many organizations, often due to tactical and/or physical considerations, increasing amounts of corporate critical data are now being stored and maintained across a range of hardware platforms. As well as supporting these various platforms, FDR/UPSTREAM also offers the System Administrator(s) a single, system-wide point of control for monitoring all of its backup/restore activity. The Director is a Graphical User Interface that can be installed and accessed from PC or workstation on the network. In most implementations of FDR/UPSTREAM, the Director is used by administrators as a dash board to monitor and control all aspects of the system. As an example, here is a screen from the Director showing the status of a backup job running on a client elsewhere on the network. The backup is currently 31% complete. The Director has multiple uses, including: A single, system-wide interface for the control and operation of all FDR/UPSTREAM operations. Ad-hoc or scheduled initiation/control of FDR/UPSTREAM backup/restore tasks. System monitoring, performance and management control functions. System Status. The Director can also run in a web browser, such a Microsoft s Internet Explorer or Mozilla s Firefox, which essentially provides a ubiquitous web access to FDR/UPSTREAM. 16

18 12 SYSTEM OVERVIEW 2.1 System Summary Diagram The following diagram illustrates the 3 main components of FDR/UPSTREAM. Notice how the Director can be accessed from anywhere out on the network and how it can be used to control and/or monitor FDR/UPSTREAM operations (e.g. backups, restores, etc) that are running on other servers and workstations in the network. Even if the Director is used to initiate a backup or restore task, the client machine still carries out the main communication with the FDR/UPSTREAM z/os host in order to run the requested backup or restore task and to transfer the required data to/from tape. 1. Storage Server 2. Client Software 3. The Director The Director The FDR/UPSTREAM Data Storage Server is located on your z/os Mainframe. The FDR/UPSTREAM Client Software is installed on each of the Open System clients that you wish to backup with FDR/UPSTREAM. Control and monitor your backups from anywhere on the network with The Director. 17

19 12 SYSTEM OVERVIEW 2.2 FDR/UPSTREAM For Linux on System z and IBM z/os UNIX Corporations today are looking to leverage the strengths of the zenterprise mainframes, for uses such as e-business applications and Web serving. With this in mind, FDR/UPSTREAM s support for UNIX includes Linux on System z and IBM z/os UNIX. This support encompasses most of the facilities available for other UNIX platforms. For Linux on System z and IBM z/os UNIX, this includes a full-featured daemon, together with a choice of command line, client character mode and Director user interfaces. The full range of FDR/UPSTREAM s standard Storage Management features, as described in PART 1, is available under both platforms. The diagram below shows how FDR/UPSTREAM operates in conjunction with IBM z/os UNIX (which operates within a z/os LPAR) and Linux on System z (which operates as a separate LPAR on the z/os host). Because the Linux on System z and IBM z/os UNIX systems are resident on the z/os host, the data transfer between the Client software and the host data storage software differs from the standard (i.e. network-based) operations described a moment ago. As you can see, with the IBM z/os UNIX system running on the z/os Host #1, data can be transferred directly between the two FDR/UPSTREAM components (via TCP/IP) without going across a network connection. And in the case Linux on System z, running on z/os Host #2, the data is routed between LPARs across an Open Systems Adapter (OSA), so that the recipient (i.e. z/os) is in the same box and routes the data straight there. Data transfer between the two FDR/UPSTREAM components can also be achieved utilizing a feature called TCP/IP Hipersockets, that is available for the z/os operating system to add function for Linux on System z. With Hipersockets, the TCP/IP data can be routed directly between partitions in a z/os machine, without going to the OSA and bouncing off. The utilization of Hipersockets is transparent to applications like FDR/UPSTREAM, which just do their normal TCP/IP calls. However, because the data transfer does not involve the OSA, it is significantly faster. 18

20 THREE The Backup/Restore Processes This section describes FDR/UPSTREAM s primary functions of backup and restore, as well as Disaster Recovery issues. It looks in more detail at the various features within FDR/UPSTREAM to maximize backup and restore performance. 19

21 13 BACKUP/RESTORE PROCESSES 3.0 The FDR/UPSTREAM Backup Scheme FDR/UPSTREAM s flexible backup scheme can be used to secure everything from a whole server or application down to individual folders or files. In general, FDR/UPSTREAM backups are usually created to secure either a single or group of volumes in a server, or all the folders relating to one or more applications on the server. These backups are then run at either: A full volume level, where all files in the file specification get backed up. An incremental level, where only the changed or modified files are backed up. For Windows systems during the Incremental process, FDR/UPSTREAM checks the archive bit and backs up only the changed files drastically reducing the time required to take daily backups. In UNIX systems, where no archive bit is maintained, (and optionally for Windows), there is an option for FDR/UPSTREAM to use its own local incremental database to record the files it has backed up, and thus determine which files are to be included in the next incremental backup. Failed backups (i.e. due to communications failure, host unavailability, etc) can be restarted at the point of failure. Below you can see two example screens from The Director, which is being used to define an FDR/UPSTREAM backup task. On the left-hand screen we have selected various volumes to be backed up. (Note: If the whole server needed to be backed up, this could be done with a simple \\. selection without needing to specify each drive individually). As well as the full C:, F: and H: drives, we have also selected the Backups and Utility folders from the G: drive. Notice also that we have some excludes for various folders that we don t want to back up from the previously selected C, F and H drives. On the right-hand screen we are setting options to control various aspects of the backup, such as tape usage and backup retention settings. 20

22 13 BACKUP/RESTORE PROCESSES 3.1 Backup Profiles In order to associate a series of backups with a server, one or more unique backup profiles are defined within FDR/UPSTREAM for each server (or collection of files) that it will backup. These profiles provide the user with an easy way to name and identify individual server backups for recovery and reporting purposes. The information provided in each backup profile includes tape handling characteristics and backup retention requirements. 3.2 Backup File Management As described earlier, the z/os host component of FDR/UPSTREAM stores, records, maintains and expires the backups. FDR/UPSTREAM backups can go to either z/os disk; physical or virtual tape. All backups are cataloged in a standard ICF user catalog. The retention/expiration of these backups can be controlled by either RETPD/EXPDT, or by z/os GDG roll-off processing. Backup files on disk can be controlled by DFSMS and can be directed to the appropriate Storage Group, as selected by the ACS routines. Alternatively, they can be allocated to specific disks, as determined by parameters set in the FDR/UPSTREAM configuration. Backup files on tape can be controlled by the z/os Tape Management System (if present), which will direct them to an appropriate tape and record all of the required information. The Tape Management System can also control offsite vaulting of these tapes, if required. Authorization for the allocation and usage of all FDR/UPSTREAM backup files can be controlled by your z/os Security System. As well as interacting with various components of the z/os host operating system, FDR/UPSTREAM also has several of its own internal facilities that help with the management and control of your backups: Additional copies of backups can be created for off-site storage, or for long-term archival of data. Backup files can be migrated onto tape via the vaulting utility. The FDR/UPSTREAM database will be updated to reflect the new location of the backups. Backups from more than one server can be optionally consolidated (stacked) onto a single tape or tape set (see PART FIVE). 21

23 13 BACKUP/RESTORE PROCESSES 3.3 Backup Performance Aside from the elapsed time savings provided by features already described, such as the incremental backup process, FDR/UPSTREAM also offers several other data reduction and performance features. The following features aim to minimize the amount of data that is transmitted from the client component to the z/os host, while at the same time offering low resource usage and system utilization: Data availability Data compression Synthetic Full merge backups Deferred Merge Segmented Backup support Intelligent database agents (see PART FOUR) Let s take a closer look at each of these features. Data Availability FDR/UPSTREAM is well suited to take advantage of the features that Storage Array vendors provide for high-speed and flexibility of modern SAN environments. The list includes IBM FlashCopy, EMC TimeFinder, Hitachi ShadowImage, and SUN StorageTek SnapShot Copy. These disk shadowing or replication technologies enhance server availability by providing a fast, point-in-time copy of a standard source volume. After the replicated copy of a volume has been created, it can be backed up while the source volume is in use. While FDR/UPSTREAM supports these technologies and their usage can be automated, they do introduce a level of complexity to the backup process. FDR/UPSTREAM also supports the Volume Shadow Copy Service (VSS), available under the Microsoft Windows operating system. 22

24 13 BACKUP/RESTORE PROCESSES Data Compression The elapsed times of FDR/UPSTREAM s Full and Incremental backups can often be drastically reduced by using the optional data compression feature, whereby the backup data is compressed on the client machine prior to its transmission across to the z/os host. This means that client data is backed up and stored in a compressed format. Multiple levels of data compression are available to help balance the cost in terms of time and resources used to do the compression against the end result of the reduced transmission times. Full Merge Backups Many backup Administrators find it beneficial to intersperse daily incremental backups with a periodic full backup, where every file is backed up irrespective of whether it has changed or not. However, because of the potentially large volume of data, these full backups can consume client-side resources and impose uncomfortable loads on the network. FDR/UPSTREAM s efficient full merge backup mechanism allows administrators to obtain the benefits of the full backup, without these overheads, by combining backups on the host. To create a full backup, the Full Merge Backup mechanism backs up only the changed files from the server. What makes this backup different from a normal incremental backup is that it also sends a copy of the directory entries of the unchanged files to the host. Then, instead of using network and client-side resources to transmit these unchanged files to the host, FDR/UPSTREAM simply retrieves the most recent copy of each file from the prior backups. Using CPU resources only at the host end of the operation, FDR/UPSTREAM then combines all of the transmitted files, together with the retrieved copies of the unchanged files, to create a new merged Full Backup, which contains an up-to-date copy of every file. A full backup has thus been created using client-side resources that are only marginally greater than on a standard daily incremental backup. The following diagram summarizes this process: So, in summary, the FDR/UPSTREAM full merge process eliminates the need to do any regular (i.e. weekly) full backups. After your initial first-time full backup of your data, you only ever take Incremental and periodic full merge backups, saving both time and resources. An efficient and periodic full merge backup also helps to reduce the number of backup tapes that need to be loaded during a recovery process, which in turn can help to shorten the recovery time. 23

25 13 BACKUP/RESTORE PROCESSES Deferred Merge While the UPSTREAM Synthetic Full Merge backup is the most efficient and effective type of full backup that you can take, it does require that the client system is connected and remain communicating to the UPSTREAM Storage server transmitting data for the duration of the entire operation. For large amounts of data this can result in long wall clock time. The UPSTREAM Deferred Merge backup circumvents and overcomes this issue by completing the backup portion of the operation significantly quicker and delays the portion that does consolidation and collocation of prior backups to a later time. With this method the UPSTREAM Deferred Merge provide 2 types of Data De-Duplication: 1. A way to think about Data De-Duplication is by where it occurs. When the de-duplication occurs close to where data is created, it is often referred to as source de-duplication. 2. When the de-duplication occurs near where the data is stored, it is commonly called target de-duplication. The Deferred Merge uses Source side target de-duplication by not sending files that haven t changed already have a copy of the files. Therefore you are not using network bandwidth for unchanged files Backup wall clock time is shorter so you can make your backup window And you are not using unnecessary tape or disk resources or drive hours And your data is always fully protected The Deferred Merge when selectively storing only changed files is using target de-duplication. You are able to restore ANY file from anything that is retained With benefits of significant reduction of back end storage, network bandwidth, and CPU utilization And your data is always fully protected The UPSTREAM Deferred Merge is superior to products that do incrementals forever as large recoveries are significantly less resource intensive. 24

26 13 BACKUP/RESTORE PROCESSES 3.4 The Restore Process The restore capabilities of FDR/UPSTREAM are as powerful, flexible and reliable as the backup processes described earlier. When required, individual files and/or directories can be restored. In the event of a disaster, whole servers and workstations can be recreated. Using the Director or ISPF interface, FDR/UPSTREAM can display all files in a given directory for a single backup, or intelligently combine Incrementals and the Full backup into a single consolidated view. It is also possible to view all backup versions of a file that are currently being maintained by FDR/UPSTREAM. Having displayed the various backups for files, directories and subdirectories, the required versions can then be selected for restore, either to their original location, or a new location. Multiple selections can be made, and options are provided to prevent files from being restored if a copy already exists on the receiving disk. As FDR/UPSTREAM has recorded the details of where on the z/os the backup is located, the administrator or end-user doing the restore does not have to tell it which tape(s) to mount, or which disk(s) the backup was written to. Here is an example of The Director interface being used to restore several files from a folder called FDRCRYPT Results. 25

27 3 BACKUP/RESTORE PROCESSES 3.5 Disaster Recovery FDR/UPSTREAM provides comprehensive data protection for enterprise servers that includes file level data protection support and also Bare Metal system recovery. Disasters can come in many forms and can happen at any time. Hardware failure, server crashes, data corruption, electrical problems and even human error can all result in the same situation having to perform an Operating System installation and configuration and then restore your data. In the event of such a disaster, i.e. where complete servers/workstations need to be restored, FDR/UPSTREAM offers several facilities for the reconstruction and restoration of your data: It can use the powerful combination of the weekly Full-Merge backups, together with the daily Incrementals to provide a complete Back-to-Full recovery of drives, folders or even entire applications. The start point of the recovery process can be controlled so that the data can be restored back to the point of any given backup FDR/UPSTREAM also includes its own specially formulated procedures for the recovery of server and/or workstation operating systems, including Windows, NetWare, UNIX and Linux. These procedures often require just a basic pre-installation of the base Operating System, with FDR/UPSTREAM then restoring the site-specific configuration files etc. FDR/UPSTREAM now provides an enhanced Bare Metal Recovery for Windows Server bit systems and above. The process of the Bare Metal Recovery promotes automation, consistency, and reliable operations to the server recovery process. The enhanced recovery eliminates the need of reinstalling the operating systems or manually configuring hardware making server recovery simple and can be performed in a fraction of the time. If you are recovering an older Windows system, you can also use FDR/UPSTREAM s legacy existing System Recovery facility, that combines the recovery of the operating system with the recovery of application data. 3.6 The Rescuer FDR/UPSTREAM Rescuer allows disaster recovery of select UNIX systems including Linux on System z, Intel Linux, and Solaris. A recovery with the Rescuer requires an initial full FDR/UPSTREAM backup of the system, which may optionally then be followed by subsequent incremental backups. FDR/UPSTREAM backups include all of the information necessary for a full system recovery, including device files, FIFOs, hard and symbolic links and more. The Rescuer uses the single user or emergency boot facilities provided by the UNIX or Linux vendor. Then, with the operating system loaded and running, the disk to be recovered is created and mounted and the restore done, avoiding potentially fatal problems of overwriting the active operating system disk. The new Enhanced FDR/UPSTREAM Linux on System z Rescuer provides the ability to recover the Linux Virtual Machine in a single command. FDR/UPSTREAM does not backup partition or other disk definition information. However, on all Rescuer systems, a disaster recovery report is created which can be either backed up or sent via an notification (see Notification Facility in PART FIVE) to make the information available at disaster recovery time. Note: The methods and procedures for these recoveries differ across operating systems, so please see the FDR/UPSTREAM user documentation for full details. 26

28 1 PART FOUR Database Support This section describes the support provided in FDR/UPSTREAM for today s most popular databases, messaging systems and groupware applications. 27

29 4 DATABASE SUPPORT 4.0 Introduction Today s databases and messaging systems are generally regarded as business-critical, and the need for an effective backup and recovery solution for these systems has become apparent for most companies. Keeping these applications online, in production and aligned to 24x7 operations helps the organization s bottom line. Not having to shutdown a critical database or messaging system to perform backups is now a necessity rather than a luxury. FDR/UPSTREAM s range of database agents offers the ability to take non-disruptive, full and incremental hot backups of most of the popular database/messaging systems in use today. An option is also provided to execute scripts with pre- and post-backup conditional processing (see below), providing a totally automated solution for high-quality backups in a 24x7 environment. 4.1 Database Support FDR/UPSTREAM includes specially developed agents to provide online hot backup facilities for the following popular database, messaging and groupware systems: Oracle IBM DB2 UDB (Universal Database Server) IBM Notes and Domino Microsoft Exchange Microsoft SQL Server SAP 4.2 Pre- and Post-Backup Conditional Processing The Pre- and Post-Backup conditional processing facilities within FDR/UPSTREAM allow the administrator to prepare a database system for backup (or restore). As an example, this might involve running a SQL script or doing work with transaction logs. An FDR/UPSTREAM job would be started on the Storage Server, which then contacts the UPSTREAM client software running on the server or workstation to be backed up, telling it to execute the pre-process batch file, program, or script. Once that process has completed successfully, the actual backup of the database can take place. When the backup is completed, a post-processing facility could then also be automatically executed if required. Should the pre-process job fail for any reason, the UPSTREAM function itself would not be performed and would return a non-zero return code to the Storage Server. Any post-processing would also be suspended. This is just an example of the coordinated and cohesive support that FDR/UPSTREAM can provide for large database applications to reduce the workload of the DBA and Storage Administrator. The result is a totally automated method for safely and securely backing up your databases while providing useful feedback about the success or failure of the operation. This section now looks in more detail at the support offered by FDR/UPSTREAM for the most popular database and messaging systems in use today. 28

30 4 DATABASE SUPPORT 4.3 Oracle FDR/UPSTREAM offers several methods to backup Oracle databases, while at the same time reducing system downtime. A variety of backup techniques are available, including: File level backup Logical volume backup RMAN support As well as providing backup services for your Oracle databases, FDR/UPSTREAM can also be used to backup the Oracle system itself, allowing a complete protection of your overall Oracle environment. Innovation s membership in Oracle s Backup Solution Provider (BSP) program allows FDR/UPSTREAM to operate as an Oracle Media Manager Library product and to use the power of Oracle Recovery Manager (RMAN). RMAN is a full-featured backup facility that can be used with FDR/UPSTREAM to perform online and offline, full, incremental and tablespace backups of databases, tablespaces and data files. All of the powerful features of RMAN are available to FDR/UPSTREAM users under both local and host control. Multi-Channel Support FDR/UPSTREAM support for Oracle databases also includes multi-channel support for multiple simultaneous backups and restores. With this feature, FDR/UPSTREAM will transparently manage the parallel backups by internally splitting the backup process into separate backup streams. This powerful feature, which requires no administrator intervention, significantly reduces the runtime for backups and restores. See the Oracle section of the UPSTREAM Client User Guide for more details. 29

31 4 DATABASE SUPPORT 4.4 DB2 Universal Database FDR/UPSTREAM support for IBM s DB2 Universal Server (UDB) provides a backup agent that includes support for Windows, AIX, HP-UX, Solaris, Linux and Linux on System z systems. The agent features include: Full, partial and incremental backups as available in the DB2 BACKUP commands as a vendor DLL. Online and offline support, with full and incremental backup Tablespace level backups and restores Support for transaction log backups using the vendor DLL or user exit Point-in-time capable roll-forward restores Flexible scheduling from either the host or client scheduler Interaction with DB2 scripts for seamless operation and reduced training costs Support for DB2 load utility Automatic notification of agent failure Archive and auto-recall of transaction logs Database and transaction log aging controlled from within DB2 See the DB2 section of the UPSTREAM Client User Guide for more details. 4.5 IBM Notes and Domino Through the IBM Notes API (for Windows, AIX, Solaris, x86 Linux, Linux on System z and IBM z/os UNIX), FDR/UPSTREAM provides a robust, integrated solution for the protection of critical Notes and Domino information, enabling online backups of IBM Notes and Domino without disrupting user productivity. FDR/UPSTREAM can also be used to backup and recover the Notes application itself. FDR/UPSTREAM can perform online full backups of Notes databases (even if they are in-use) as well as incremental backups, by backing up Notes transaction logs which is essential if you are using transaction logging. FDR/UPSTREAM will recognize if a new database has been added, and it will back it up even if you are performing incremental backup. To add a further performance edge, FDR/UPSTREAM can also perform multiple simultaneous backup operations. The FDR/UPSTREAM support for IBM Notes is extensive and includes: Full backup of online databases (.nsf) and templates (.ntf) Automatic backup of important non-database data (e.g. Notes ID files and.ini files) Automatic expiration of database backups based on version limit and retention period. The restore capabilities are equally impressive: You can restore a database to a specific point-in-time, or to another IBM Notes server You can apply changes to a restored database (from transaction logs) You can restore individually active and archived transaction logs FDR/UPSTREAM can also be used to recover a Notes database in a disaster recovery situation. 30

32 4 DATABASE SUPPORT If required, all FDR/UPSTREAM operations can be scheduled using the Domino Scheduler in preference to the scheduling facilities provided by FDR/UPSTREAM or by the client operating system. FDR/UPSTREAM also provides a command line option, which allows you to migrate old Notes. This can be useful, for example, in generically migrating old messages to a separate Notes database, which can then in turn be migrated using FDR/UPSTREAM migration. 4.6 Microsoft Exchange UPSTREAM provides full support for Microsoft Exchange 2007, 2010 and The FDR/UPSTREAM agent provides full and incremental backups and transaction log backups. See the Exchange section of the UPSTREAM Client User Guide for more details. 31

33 4 DATABASE SUPPORT 4.7 Microsoft SQL Server Microsoft SQL Server provides a number of backup and restore options that provide DBAs with the flexibility they need to plan their database recovery strategy. Using a Microsoft API, FDR/UPSTREAM can take advantage of these options to aid in the automation of SQL backups and restores. FDR/UPSTREAM provides a backup agent which offers online, full and transaction log backups of SQL databases. See the SQL Server section of the UPSTREAM Client User Guide for more details. 4.8 SAP FDR/UPSTREAM includes an agent for backing up Oracle-based SAP R/3 databases. Platforms supported include Windows, AIX, Solaris and HP-UX. Backups and restores are requested and initiated using SAP utilities (sapdba, brbackup, brarchive, etc.) which drive the FDR/UPSTREAM backup agent to perform the requested function. See the SAP section of the UPSTREAM Client User Guide for more details. 32

34 FIVE ADDITIONAL FEATURES This section describes the additional features provided in FDR/UPSTREAM. 33

35 5 ADDITIONAL FEATURES 5.0 Introduction Aside from the primary functions of Backup and Restore, FDR/UPSTREAM also includes various utility functions and other useful features. This final section describes those features in more detail. 5.1 Vaulting and Migrating Your Backups FDR/UPSTREAM allows you to copy, vault, consolidate and move your backups. You might want to use these facilities when: With Vaulting you can make additional copies of one or more backups for extra security. These are a true copy of the original backup, but they are not recorded separately in the FDR/UPSTREAM database (although the database records can be updated to point to the copied backups, if required). You wish to make additional vaulted copies of your backups, usually for the purposes of offsite storage and disaster recovery. You wish to migrate onto a single tape a selection of backups that are currently spread over many tapes (or disk files). This would be done to optimize tape utilization. You wish to migrate one or more disk-based backups to tape. The following diagram illustrates these very useful FDR/UPSTREAM utility operations: Copy of original backups Copy of tape or disk backups vaulted to new tapes for offsite storage Multiple tape backups consolidated onto one tape Disk backups moved to tape 34

36 5 ADDITIONAL FEATURES 5.2 Reporting FDR/UPSTREAM includes various log files containing either detailed or summary information. These files can be browsed and reported on by FDR/UPSTREAM Systems Administrators for general reporting/feedback purposes, as well as being a vital source of information for problem determination. The USTRPORT BACKUP report can display information about servers being protected. Additionally, available as a z/os batch job, output can also be made to a CSV file. 35

37 5 ADDITIONAL FEATURES 5.3 Host Reporting with the Director Host Reports can also be produced from the Director interface. These reports can use a variety of different data sources and can be displayed either to a new window in the Director, or written to a flat file. In the sample screen below we are requesting a report of all backups with a backup profile of XPRES with a condition code of Failed. The resultant report from that report request would look something like this when displayed as a new window in the Director: 36

38 5 ADDITIONAL FEATURES 5.4 Notification Facility The Notification facility further assists the Storage Administrator with the automation and control of FDR/UPSTREAM operations. It allows backups and restores (and any other FDR/UPSTREAMinitiated task) to send an notification or SNMP traps to interested parties of a successful (or, if required, an unsuccessful) completion of the task. This feature adds yet another valuable layer of automation to your Storage Management operations and strategy. 5.5 Registered Names The registered name facility further eases the System Administration effort by allowing the assignment of a logical name to a client machine, rather than the actual IP address and TCP Port Number of the target machine to be backed up. This makes the FDR/UPSTREAM backup operation independent of the actual network address and also allows these values to dynamically change, which is very useful when roaming clients are connecting to the network using DHCP or a similar scheme. 5.6 ISPF Panels As an alternative to the client-side GUI panels and the Director Java Interface that were described in PART 1, FDR/UPSTREAM also includes a complete set of TSO ISPF panels which, among other things, can be used to create and manually initiate backups and restores. The backup/ restore specifications are saved as JCL, which can then be submitted as standard z/os batch jobs, optionally through the z/os job scheduler. Here is the Primary Option panel showing the menu of options that can be controlled through ISPF: 37

39 PART 5 ADDITIONAL FEATURES And here is an example of just one of the many panels that are useful to the UPSTREAM Administrator. This one shows the Registered Names facility. Rather than using the TCP/IP addresses to locate backup/restore targets, the UPSTREAM administrator has allocated meaningful names, such as ADMIN5 and BOBXP. Notice also that the screen shows the current version of the UPSTREAM client software being run on each machine. 5.7 Summary FDR/UPSTREAM is the ideal tool for taking reliable and high-performance backups of your Open Systems data. In summary, it provides: A choice of storage media options z/os disk or tape A wide range of clients are supported Windows, NetWare, Linux, Linux on System z, IBM AIX, HP-UX, Sun Solaris, Sun X86, VMware Intelligent database agents Oracle, IBM DB2 UDB, IBM Notes, Microsoft Exchange, Microsoft SQL Server, SAP Simple interfaces ISPF, The Director High-Performance backup features Incremental backup, Merge backup, Deferred merge backup, Compression Flexible/efficient use of tape media Block level segmented backup support/migrate/merge utilities Additional features Data migration, Software distribution, Data sharing In addition, FDR/UPSTREAM also includes important reporting/feedback facilities to ensure that you always know what backups you ve taken and where those backups are stored. And, most important of all, FDR/UPSTREAM provides flexible and reliable Restore and Disaster Recovery procedures to ensure that, in the event of any problems, you can get your data back...whenever and wherever you need it. 38

40 UPSTREAM RESERVOIR This Concepts & Facilities Guide has described the FDR/UPSTREAM component of the UPSTREAM suite of products, which is hosted on a z/os mainframe. If you would prefer to host UPSTREAM on an open systems server (e.g. Windows, Unix or LINUX) either as an alternative to, or as well as FDR/UPSTREAM under z/os, you should take a closer look at UPSTREAM Reservoir. UPSTREAM Reservoir shares the same basic functionality as FDR/UPSTREAM, and also includes many of the key features that have been described in this document, including the extensive client support, intelligent database agents and incremental/merge backup system. Like FDR/UPSTREAM, UPSTREAM Reservoir can also be controlled by the Director, and its operations can be scheduled and automated through the Dispatcher. UPSTREAM Reservoir also includes some of its own unique features, not described in this Guide. This includes support for VMware, and also the special SAN Express feature, which offers a high speed LAN-Free backup. If you would like to know more about UPSTREAM Reservoir, please contact your local representative (see back page) to request a brochure and a free copy of the UPSTREAM Reservoir Concepts & Facilities Guide. Product Brochure Concept & Facilities Guide UPSTREAM Reservoir For when you need more than just a High-Performance, Enterprise-Wide Backup and Recovery System. UPSTREAM Reservoir UPSTREAM Reservoir C O N C E P T S & F A C I L I T I E S G U I D E EXPERIENCE SUPPORT COMPETITIVE FREE TRIAL 39