HACMP Smart Assist for Oracle User s Guide

Transcription

1 High Availability Cluster Multi-Processing for AIX 5L HACMP Smart Assist for Oracle User s Guide Version 5.3 SC

2 Second Edition (August 2005) Before using the information in this book, read the general information in Notices for HACMP Smart Assist for Oracle User s Guide. This edition applies to HACMP for AIX 5L v.5.3 and to all subsequent releases of this product until otherwise indicated in new editions. Copyright International Business Machines Corporation 1998, All rights reserved. Note to U.S. Government Users Restricted Rights Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

3 Contents About This Guide 5 Chapter 1: Getting Started 11 Enhanced HACMP and Oracle Integration Keeping Oracle Highly Available Increasing Availability for an Oracle Server Two-Node Cluster with a Hot Standby Configuration Configuring HACMP using Oracle Assist Where You Go From Here Chapter 2: Planning Your Configuration 17 Hardware System Requirements Supported Software License and User Privilege Limitations Supported Cluster Configuration Planning the HACMP Cluster Step 1: Planning for an Oracle Application Step 2: Planning the Cluster Topology Step 3: Planning Access to Stored Data Step 4: Configuring Cluster Topology Step 5: Configuring Service IP Labels Where You Go From Here Chapter 3: Installing HACMP Smart Assist for Oracle 23 Software Installation Prerequisites Where to Install the Software Contents of the Installation Media Installation Choices Installing from an Installation Server Installing from a Hard Disk Installing HACMP Smart Assist for Oracle from the CD-ROM.. 25 Removing an HACMP Smart Assist for Oracle Installation Where You Go From Here HACMP Smart Assist for Oracle User s Guide 3

4 1 Chapter 4: Configuring Oracle in an HACMP Cluster 29 Configuration Overview Changing Default Configuration Values Creating the HACMP Two-Node Hot Standby Cluster Prerequisites Configuring the HACMP Two-Node Cluster Defining the Shared Volume Group Defining the Shared Filesystems Defining the HACMP Application Server Defining the Service IP Label Creating the Resource Group Adding the Resources to the Resource Group Defining the Private Network Verifying and Synchronizing the Cluster Running the Cluster Test Tool (Optional) Installing and Configuring Oracle Verifying Prerequisites Installing Oracle Software Starting the Oracle Infrastructure Tier Restarting the Oracle Installer Chapter 5: Troubleshooting the Installation 47 Using the Log Files Removing the Oracle Assist HACMP Two-Node Cluster Miscellaneous Problems Unable to Start the Oracle Interactive Installer Incorrect Dependency Error Messages Display with AIX 5L v Verification and Synchronization does not Complete Successfully 50 Appendix A: HACMP Configuration Summary 51 Glossary 57 Index 59 4 HACMP Smart Assist for Oracle User s Guide

5 About This Guide This guide describes the AIX 5L HACMP Smart Assist for Oracle tool, used to install an Oracle Application Server 10g (9.0.4) (AS10g) Cold Failover Cluster solution the HACMP two-node cluster with a hot standby on two machines with the IBM AIX 5L (5200) operating system. The following table provides version and manual part numbers for this guide: HACMP Version Book Name Book Number 5.3 Last updated 8/2005 HACMP Smart Assist for Oracle User s Guide SC HACMP Smart Assist for Oracle User s Guide SC Who Should Use This Guide This guide is intended for system administrators and customer engineers, responsible for planning and configuring an HACMP environment for Oracle components. Before continuing with HACMP Smart Assist for Oracle, familiarize yourself with Oracle Application Server 10g (9.0.4) from a conceptual and functional standpoint, and IBM AIX 5L and HACMP. For more information, see the sections Reference Documents and HACMP Publications. Reference Documents For information about Highly Available Cluster Multi-Processing for AIX 5L, see the section HACMP Publications. The following lists documentation, references, standards, and other publications or URLs that provide information specific to Oracle: Experiences Installing Oracle Application Server 10g (9.0.4) Cold Failover Cluster on AIX 5L Version 1.2, July, Search the High Availability Cluster Multi-Processing (HACMP) for AIX 5L Library to access this white paper. Oracle Application Server 10g Quick Installation and Upgrade Guide10g (9.0.4) for AIX-Based Systems, Part No. B : pdf Oracle Application Server 10g Installation Guide 10g (9.0.4) for AIX-Based Systems, HP-UX PA-RISC (64-bit), Tru64 UNIX, and Linux x86 Part No. B Oracle Application Server 10g High Availability Guide 10g (9.0.4) Part No. B HACMP Smart Assist for Oracle User s Guide 5

6 Oracle Application Server Documentation Library 10g for AIX-Based Systems: Oracle Application Server 10g Release Notes 10g(9.0.4) for AIX-Based Systems, Part No. B : Oracle Application Server 10g (9.0.4) Documentation: Highlighting This guide uses the following highlighting conventions: Italic Bold Identifies new terms or concepts, or indicates emphasis. Identifies routines, commands, keywords, files, directories, menu items, and other items whose actual names are predefined by the system. Monospace Identifies examples of specific data values, examples of text similar to what you might see displayed, examples of program code similar to what you might write as a programmer, messages from the system, or information that you should actually type. ISO 9000 ISO 9000 registered quality systems were used in the development and manufacturing of this product. HACMP Publications The HACMP software comes with the following publications: Release Notes in /usr/es/sbin/cluster/doc/release_notes describe hardware and software requirements and last-minute information about installation, product usage, and known issues. HACMP for AIX 5L: Concepts and Facilities Guide, SC HACMP for AIX 5L: Master Glossary, SC HACMP for AIX 5L: Planning and Installation Guide, SC HACMP for AIX 5L: Administration Guide, SC HACMP for AIX 5L: Troubleshooting Guide, SC HACMP for AIX 5L: Programming Client Applications SC IBM International Program License Agreement. 6 HACMP Smart Assist for Oracle User s Guide

7 HACMP/XD Publications The HACMP Extended Distance (HACMP/XD) software solutions for disaster recovery, added to the base HACMP software, enable a cluster to operate over extended distances at two sites. HACMP/XD publications include the following: HACMP/XD for PPRC: Planning and Administration Guide, SC HACMP/XD for Geographic LVM (GLVM): Planning and Administration Guide, SA HACMP/XD for HAGEO Technology: Concepts and Facilities Guide, SC HACMP/XD for HAGEO Technology: Planning and Administration Guide, SC HACMP Smart Assist Publications The HACMP Smart Assist software helps you quickly add an instance of certain applications to your HACMP configuration so that HACMP can manage their availability. The HACMP Smart Assist publications include the following: HACMP Smart Assist for DB2 User s Guide, SC HACMP Smart Assist for Oracle User s Guide, SC HACMP Smart Assist for WebSphere User s Guide, SC HACMP Smart Assist Release Notes. IBM AIX 5L Publications The following publications offer more information about IBM technology related to or used by HACMP: RS/6000 SP High Availability Infrastructure, SG IBM AIX 5L v.5.3 Security Guide, SC IBM Reliable Scalable Cluster Technology for AIX 5L and Linux: Group Services Programming Guide and Reference, SA IBM Reliable Scalable Cluster Technology for AIX 5L and Linux: Administration Guide, SA IBM Reliable Scalable Cluster Technology for AIX 5L: Technical Reference, SA IBM Reliable Scalable Cluster Technology for AIX 5L: Messages, GA Accessing Publications Use the following Internet URLs to access online libraries of documentation: AIX 5L, IBM eserver pseries, and related products: AIX 5L v.5.3 publications: nfocenter/base/aix53.htm HACMP Smart Assist for Oracle User s Guide 7

8 WebSphere Application Server publications: Search the IBM website to access the WebSphere Application Server Library DB2 Universal Database Enterprise Server Edition publications: /en_main#v8pdf Tivoli Directory Server publications: IBM Welcomes Your Comments You can send any comments via to Make sure to include the following in your comment or note: Title and order number of this book Page number or topic related to your comment. When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. Trademarks The following terms are trademarks of International Business Machines Corporation in the United States or other countries: AFS AIX AIX 5L DFS eserver Cluster 1600 Enterprise Storage Server HACMP IBM NetView pseries RS/6000 Scalable POWERParallel Systems Shark SP xseries WebSphere. 8 HACMP Smart Assist for Oracle User s Guide

9 UNIX is a registered trademark in the United States and other countries and is licensed exclusively through The Open Group. Other company, product, and service names may be trademarks or service marks of others. HACMP Smart Assist for Oracle User s Guide 9

10 10 HACMP Smart Assist for Oracle User s Guide

11 Chapter 1: Getting Started HACMP Smart Assist for Oracle facilitates the installation of Oracle Application Server 10g (9.0.4) (AS10g) Cold Failover Cluster (CFC) solution on two machines with the IBM AIX 5L (5200) operating system. A Cold Failover Cluster is equivalent to the HACMP two-node cluster with a hot standby configuration, where one node performs the work while the other node waits as a fallover location. By including the Oracle application in your two-node cluster with hot standby configuration, HACMP ensures high availability for the Identity Management (IM) and Metadata Repository (MR) components of an Oracle AS10g deployment. Note: In HACMP, the term fallover refers to the process of an active node acquiring resources previously owned by another node in order to maintain availability of those resources. This term is also known in the industry as failover. HACMP Smart Assist for Oracle configures the shared physical disks that support the Oracle application on the standby cluster node and helps you to create a simple two-node cluster. It simplifies the installation and configuration of the database, application server, and the Oracle CFC solution. Oracle Assist does not configure anything outside of the Oracle Application Server Infrastructure tier. This chapter contains the following sections: Enhanced HACMP and Oracle Integration Keeping Oracle Highly Available Two-Node Cluster with a Hot Standby Configuration Configuring HACMP using Oracle Assist Where You Go From Here. The Oracle Assist automates the tasks described the white paper Experiences Installing Oracle Application Server 10g (9.0.4) Cold Failover Cluster on AIX 5L. For more information about the Oracle components, see the section High Availability Configurations for Infrastructure in the Oracle Application Server 10g High Availability Guide 10g (9.0.4) Part No. B For the link to these documents, see the section Reference Documents in About This Guide. HACMP Smart Assist for Oracle supplements the Oracle Application Server 10g Installation Guide, Part No. B 's, Chapter 9: Installing in High availability Environments. Use this document in conjunction with the Oracle installation guide during your CFC installation. Also, review the Reference Documents in the About This Guide section for a list of sources on the topics covered in this text. To make use of HACMP Smart Assist for Oracle, install the software listed in the section Software Installation Prerequisites in Chapter 3: Installing HACMP Smart Assist for Oracle on all nodes that are going to be part of the cluster. This guide uses Oracle Assist when referring to the HACMP Smart Assist for Oracle tool HACMP Smart Assist for Oracle User s Guide 11

12 1 Getting Started Enhanced HACMP and Oracle Integration Enhanced HACMP and Oracle Integration HACMP Smart Assist for Oracle is an extension of the HACMP software that enables you to easily make your Oracle configuration highly available using the features provided by HACMP. HACMP Smart Assist for Oracle lets you: Automate the HACMP cluster configuration process, minimizing the time and effort required to integrate Oracle into an HACMP cluster. Make the resources specific to the Oracle infrastructure highly available, such as a shared volume group, filesystems, and the service IP label associated with the Oracle application. Create a two-node cluster configuration, where the Oracle instance is recovered on the standby node by the means of automatic fallover. Start and stop the Oracle application on the nodes automatically, by the means of an HACMP application server (a collection of start and stop scripts in HACMP) created for the Oracle instance in the HACMP cluster. Verify the existing configuration of the Oracle components to ensure that the Oracle and HACMP configuration is valid. Keeping Oracle Highly Available The HACMP two-node cluster with a hot standby configuration protects the Oracle instance from a system or server failure. To ensure availability in case of a component failure, HACMP restarts the Oracle instance on a spare server in the cluster. HACMP automatically moves the network labels and filesystems to the backup server. Clients on the network may experience a lockout period during fallover until the database instance starts on the standby node. The following figure shows the operation of a HACMP two-node cluster with a hot standby configuration: 12 HACMP Smart Assist for Oracle User s Guide

13 Getting Started Keeping Oracle Highly Available 1 Two-Node Cluster with a Hot Standby Configuration for the Oracle Application This guide and the HACMP SMIT user interface use the following terminology to define the node on which the Oracle instance may run in the cluster: A primary node for the Oracle instance. The primary cluster node is where the application runs unless a condition forces a fallover to another cluster node. It is also a primary node for the HACMP resource group hosting the Oracle instance. A standby node for the Oracle instance. The standby cluster node is where the application runs after a fallover from the primary node. The configuration created by HACMP Smart Assist for Oracle a two-node hot standby configuration consists of one primary node and one standby cluster node. The standby node acts as a standby for only one Oracle instance. For more information on the cluster configuration, see the section Two-Node Cluster with a Hot Standby Configuration in this chapter. Increasing Availability for an Oracle Server HACMP views the application server as the Oracle Infrastructure Tier. If an application becomes unavailable, HACMP migrates the Oracle database instance from the primary cluster node to the standby cluster node. When the primary cluster node becomes available again, HACMP migrates the Oracle server and the Oracle database instance to the primary cluster node. HACMP Smart Assist for Oracle User s Guide 13

14 1 Getting Started Two-Node Cluster with a Hot Standby Configuration Two-Node Cluster with a Hot Standby Configuration The primary components required to deploy an HACMP two-node cluster with a hot standby configuration for the Oracle Application are: Middle Tier Application Server. The Middle Tier Application Server is not part of the cluster, but it communicates with it through the service IP Virtual IP address (VIP). Infrastructure Tier. This tier contains two nodes running HACMP, and provides certain key services such as Identity Management and storage, and access to commonly used metadata. Shared Storage device. The shared storage is accessible by both Infrastructure Tier nodes. The HACMP and Oracle two-node cluster with a hot standby configuration support AS10g's Infrastructure Tier components. The HACMP nodes and a shared storage device are the primary components of the cluster. In normal operation mode, the Middle Tier application server establishes connection with the Infrastructure Tier using a Virtual IP address/hostname (VIP). The HACMP Smart Assist for Oracle requires that you select the service IP label/address to be the Virtual IP (VIP) that the application server uses to access the cluster. The application servers will alias their IP label on the public network to an address with the same subnet as the VIP, providing access to the VIP. The service IP label/address will be the Virtual IP (VIP) address that the Middle Tier application servers will use to access the cluster. This VIP is assigned to the active Infrastructure Tier node. In the event of a failure on the active primary node, the HACMP cluster detects the service interruption, mounts the shared storage device on the standby node (which starts the AS10g processes), assumes the VIP address, and resumes processing requests from the Middle Tier. The following diagram provides an overview of the primary components required to deploy an Oracle CFC solution: Primary Components of the HACMP Two-Node Cluster with a Hot Standby Configuration for the Oracle Application 14 HACMP Smart Assist for Oracle User s Guide

15 Getting Started Configuring HACMP using Oracle Assist 1 The HACMP two-node cluster with a hot standby configuration includes: HACMP two-node cluster with a non-concurrent shared disk supporting node failure detection and IP address takeover. In this configuration, n1 the primary node owns the Oracle instance, or is the node that owns the resource group containing the application server for Oracle. Middle Tier Application Server. The Middle Tier application server is not part of the cluster, but it communicates with it through the service IP label. Public network for client access and private network for Oracle inter-node communications. These networks must be on separate subnets. One resource group containing one shared volume group, two logical volume and journaled filesystem pairs, and one or more physical volume(s). The resource group has a non-concurrent site policy as follows: Startup: Online On primary node Only. Fallover: Fallover to Next Priority Node in the List Fallback: Fallback to Higher Priority Node in the List Note: In HACMP, the term fallover refers to the process of an active node acquiring resources previously owned by another node, in order to maintain availability of those resources, also known in the industry as failover. Start and stop scripts (shipped with the fileset) are added to the resource group as the HACMP application server. The HACMP application server is used to gracefully stop or start the application in the event of a takeover by the standby node. See the HACMP Components Created for Oracle section in Appendix A: HACMP Configuration Summary, for a description and location of the start and stop scripts. Configuring HACMP using Oracle Assist HACMP Smart Assist for Oracle sets up your HACMP resource configuration for you. It uses information it gathers from the application configuration, the system configuration, and information you enter to create an HACMP resource group. HACMP uses the resource group information to protect the Oracle application and keep it highly available. An HACMP resource group contains a set of resources, such as cluster nodes, volume groups, and IP labels (used by server applications to communicate with clients) that HACMP manages as a unit. In addition to creating a resource group for the Oracle application to be made highly available, HACMP Smart Assist for Oracle performs the following tasks: Provides start and stop scripts for the application. Helps you to create an HACMP application server for the application. Note: An HACMP application server identifies the application start and stop scripts that are used in conjunction with HACMP. Stores the generated HACMP configuration in the HACMP Configuration Database. HACMP Smart Assist for Oracle User s Guide 15

16 1 Getting Started Where You Go From Here When HACMP Smart Assist for Oracle creates the HACMP resource configuration, it updates the HACMP configuration but does not change any of the supported application configurations. Where You Go From Here You are now ready to plan your Oracle environment. For information on planning, see Chapter 2: Planning Your Configuration. 16 HACMP Smart Assist for Oracle User s Guide

17 Chapter 2: Planning Your Configuration This chapter describes how to plan the hardware infrastructure for the HACMP and Oracle AS10g Cold Failover Cluster (CFC) deployment. The chapter contains the following sections: Hardware System Requirements Supported Software Limitations Supported Cluster Configuration Planning the HACMP Cluster Where You Go From Here. Hardware System Requirements Make sure that your system meets the following requirements for a successful installation: Two IBM pseries 650 servers (minimum). You need at least two nodes in the Infrastructure Tier for a highly available environment if one node fails, the second node takes over for the node that fails. Memory: 1536 MB Swap space (paging space) 400 MB /tmp space 25 MB /var space for cluster verification Disk Storage: 4.3 GB Shared Disk Storage. Supported Software The following list shows the versions of the software supported by HACMP Smart Assist for Oracle. These programs must be installed and configured on a system running AIX 5L v.5.2 Maintenance Level (ML) 1 ( ) or higher: HACMP 5.3 Oracle Database 10g Universal Installer (OUI). Note: With AIX 5L v.5.2, you must install the following prerequisite RSCT filesets: prereq bos.rte prereq rsct.compat.basic.hacmp HACMP Smart Assist for Oracle User s Guide 17

18 2 Planning Your Configuration Limitations License and User Privilege prereq rsct.core.sec prereq rsct.compat.clients.hacmp prereq rsct.core.rmc An HACMP installation requires: Each cluster node have its own HACMP software license A user with root privileges to perform the installation. Limitations HACMP Smart Assist for Oracle has the following limitations: Changes to the HACMP configuration that affect the Oracle configuration require that you update the Oracle configuration. Oracle configuration changes that can affect the HACMP configuration require you to update the HACMP configuration. The cluster cannot be configured using HACMP Smart Assist for Oracle while the cluster services are running. If you attempt to configure HACMP using the Oracle Assist while the cluster is operational, HACMP issues an error message indicating that the cluster cannot be configured using this tool while the cluster services are running. Supported Cluster Configuration Oracle Assist supports the Oracle Cold Failover Cluster (CFC), which is the HACMP two-node with a hot standby configuration, where one node performs the work while the other node waits as a fallover location. By including the Oracle application in your two-node cluster with hot standby, HACMP ensures high availability for the Identity Management (IM) and Metadata Repository (MR) components of an Oracle AS10g deployment. Planning the HACMP Cluster You should have a good working knowledge of the Oracle application and of HACMP before planning your HACMP implementation for the Oracle CFC solution. HACMP Smart Assist for Oracle performs many of the HACMP cluster configuration activities for you. However, you need to plan your basic environment before you run HACMP Smart Assist for Oracle. As you plan your environment, record planning information as noted. For more information about the Oracle components, see the section High Availability Configurations for Infrastructure in the Oracle Application Server 10g High Availability Guide 10g (9.0.4) Part No. B For the link to this document, see the section Reference Documents in About This Guide. 18 HACMP Smart Assist for Oracle User s Guide

19 Planning Your Configuration Planning the HACMP Cluster 2 Step 1: Planning for an Oracle Application For the Oracle instance that you plan to keep highly available, identify: The primary cluster node the node on which the Oracle instance usually runs The standby cluster node the node on which the Oracle instance runs after a fallover The service IP label the Oracle instance will use to communicate with clients. To plan a two-node cluster with a hot standby configuration, list the primary cluster node, the standby cluster node, and the service IP label for the Oracle instance you want HACMP to protect in the following table: Application Name of Primary Node Service IP Label Name of Standby Node Step 2: Planning the Cluster Topology Planning Cluster Nodes Complete the planning activities as described in chapter on Planning Cluster Network Connectivity in the Planning and Installation Guide. The nodes involved in your deployment may be standalone servers or logical equivalents. The storage subsystem is directly attached to the two participating cluster nodes and hosts a filesystem for the Oracle software. For information about the system requirements, see the section Hardware System Requirements. When you add a resource group with the Oracle instance, HACMP automatically adds the Oracle instance to the HACMP configuration including any supporting topology configuration, such as nodes, networks, and IP interfaces. Planning Cluster Networks Oracle Instance Before proceeding with installing HACMP Smart Assist for Oracle, plan the following cluster networks: A public network for client access and a private network for Oracle inter-node communications. The public and private networks must be on separate subnets. Add the HACMP service IP label and the standby node hostname to /etc/hosts on all nodes. The cluster event scripts use the /etc/hosts file for name resolution. All cluster node IP interfaces (boot and service) must be added to this file on each node. Note that if you do not add the service IP labels to the /etc/hosts file on any cluster node, then HACMP automatically adds them to this file as part of the automatic corrective action of the cluster verification process. In general, HACMP uses the communication path for IP network discovery and automatic configuration of the cluster network topology. For this purpose, during the cluster configuration, you will need to specify one of the following for the cluster network: IP address Fully-qualified domain name HACMP Smart Assist for Oracle User s Guide 19

20 2 Planning Your Configuration Planning the HACMP Cluster Existing HACMP node name. For more information, see Step 4: Configuring Cluster Topology and Step 5: Configuring Service IP Labels. Step 3: Planning Access to Stored Data The HACMP cluster incorporates a shared storage device and a shared filesystem, used to house the Identity Management and Oracle Metadata Repository for Oracle AS10g. Data resides in this filesystem on shared disks, in order to be made highly available. The shared filesystem is used by Oracle on the non-concurrent shared disk. Only one Oracle server accesses data at a time. The primary server accesses data when the server is running on the primary cluster node. At fallover, only the standby cluster node (which became the primary cluster node at fallover) accesses data. During installation and configuration for Oracle, an Oracle database instance is created on the shared disk. To plan for storage in a two-node simple takeover cluster configuration (the HACMP hot standby configuration), ensure that the Oracle application primary and standby cluster nodes have access to the same volume group and filesystem that stores the application data. This way, if the Oracle application falls over from the primary cluster node to the standby cluster node, the application continues to access its data from the shared volume group. In order for Oracle Assist to collect configuration information for an Oracle instance, the primary node the node from where you run the assist must have the volume group varied on. For the Oracle server, plan the volume group used to store data files. Oracle Assist will help you to select required predefined resources, or if resources have not been defined, Oracle Assist will help you to define the resources required to make the Oracle instance highly available. In an HACMP cluster, a shared volume group is a volume group that resides on the external disks shared by cluster nodes. A shared physical volume is a disk that resides in a shared volume group. A shared logical volume is a logical volume that resides in a shared volume group. A shared filesystem is a filesystem that resides in a shared logical volume. To be kept highly available by HACMP, every cluster resource must be part of a resource group. The HACMP two-node cluster with a hot standby configuration for the Oracle instance will include: One shared volume group Two logical volume and journaled filesystem pairs One HACMP resource group One or more physical volume(s). Oracle Assist automatically creates two logical volumes and prompts you to define the journaled filesystem type jfs or jfs2. Oracle Assist pairs each volume group with a journaled filesystem one for the database, and one for commands and the primary directory. The two logical volume/filesystems pairs can reside on one shared disk (for LUN implementations), or on two shared disks: one disk for the database (to protect the integrity of filesystem metadata that resides in the shared logical volume) and one disk for commands and the primary directory. Oracle uses these shared filesystems on the non-concurrent shared disk. A default name is used for the filesystems. 20 HACMP Smart Assist for Oracle User s Guide

21 Planning Your Configuration Planning the HACMP Cluster 2 An Enhanced Journaled Filesystem (JFS2) provides the capability to store much larger files than the Journaled Filesystem (JFS). JFS2 is the default filesystem for the 64-bit kernel. You can select to implement either JFS, which is the recommended filesystem for 32-bit environments or JFS2, which offers 64-bit functionality. For more information on the Journaled Filesystem, see the Administration Guide. For more information on JFS2, see the following: AIX 5L v.5.2 Differences Guide: and the AIX 5L v.5.3 Differences Guide: For more information about planning shared disks for an HACMP cluster, see the Planning Shared Disk and Tape Devices chapter in the Planning and Installation Guide. Volume Group Added to the HACMP Resource Group Containing Oracle Instances The HACMP Smart Assist for Oracle helps you to create a new volume group or you can use an existing shared volume group. The volume group can have one or more physical disks allocated. List the name of the volume group that you plan to use with the Oracle instance. Note that this volume group is only for your planning. HACMP Smart Assist for Oracle discovers information about the available volume group and will add the volume group you select to the resource group. Application Shared Volume Group Oracle Instance At verification, HACMP Smart Assist for Oracle checks the following state of your storage configuration: The Oracle instance primary directory resides on shared storage. The shared volume group is accessible on all nodes where a particular Oracle instance may reside in the cluster. This requires that all physical disks (hdisks) be defined on all participating cluster nodes. Step 4: Configuring Cluster Topology HACMP Smart Assist for Oracle will automatically configure the cluster topology for HACMP to include: Cluster nodes that you planned in the section Step 1: Planning for an Oracle Application Network connectivity for the cluster Information about network interfaces The HACMP default setting to use for IP address takeover IP Address Takeover via IP Aliases. For more information about configuring the network connectivity in HACMP, see the chapter Configuring HACMP Cluster Topology and Resources (Extended) in the Administration Guide. HACMP Smart Assist for Oracle User s Guide 21

22 2 Planning Your Configuration Where You Go From Here Step 5: Configuring Service IP Labels Clients communicate with the server application through the network interface service IP label. Oracle Assist requires a service IP label for the Oracle instance. For the list of service IP labels planned for your cluster, see the section Step 1: Planning for an Oracle Application. Oracle Assist configures the labels from the primary cluster node and synchronizes the configuration to the standby cluster node. For more information about service IP labels, see the chapter on Planning Cluster Network Connectivity in the Planning and Installation Guide and the chapter on Configuring HACMP Cluster Topology and Resources (Extended) in the Administration Guide. Where You Go From Here After you plan your Oracle environment, and the resources that you want to make highly available, install HACMP Smart Assist for Oracle. For instructions, see Chapter 3: Installing HACMP Smart Assist for Oracle. 22 HACMP Smart Assist for Oracle User s Guide

23 Chapter 3: Installing HACMP Smart Assist for Oracle This chapter describes how to install HACMP Smart Assist for Oracle; it contains the following sections: Software Installation Prerequisites Installation Choices Removing an HACMP Smart Assist for Oracle Installation Where You Go From Here. Software Installation Prerequisites The following list shows the software versions required by HACMP Smart Assist for Oracle. Install the following on both nodes: HACMP 5.3 and greater for AIX 5L Subsystems 5765-F62. AIX 5L v.5.2 Maintenance Level (ML) 1 or higher - OS level Java Cryptography Extension (JCE) jce-1_2_2.zip file downloaded to the primary node. You can download the file from Have the Oracle Database 10g Universal Installer (OUI) available. The OUI will copy the files it needs to the shared disk during the Oracle installation. HACMP Smart Assist for Oracle requires 2.5 MB of space in the /usr directory. We recommend that you review the Hardware System Requirements section in Chapter 2: Planning Your Configuration, make any necessary installations, and then apply the most current AIX 5L maintenance level (ML) available for download. Where to Install the Software Install the HACMP Smart Assist for Oracle software on both cluster nodes. HACMP Smart Assist for Oracle User s Guide 23

24 3 Installing HACMP Smart Assist for Oracle Installation Choices Contents of the Installation Media The media for HACMP Smart Assist for Oracle contains the following filesets: cluster.doc.en_us.assist.oracle.pdf cluster.doc.en_us.assist.oracle.html cluster.es.assist.oracle cluster.msg.en_us.assist cluster.assist.license The user documentation in PDF and HTML formats Program files for HACMP Smart Assist for Oracle Message files HACMP Smart Assist Feature License Agreement Files Installation Choices The following sections describe how to install the software in several ways: Installing from an Installation Server Installing from a Hard Disk Installing HACMP Smart Assist for Oracle from the CD-ROM. Installing from an Installation Server To install the HACMP Smart Assist for Oracle software in a cluster environment, you can create an HACMP Smart Assist for Oracle installation server (containing the HACMP Smart Assist for Oracle software installable images) on one node and then load the images onto the remaining cluster nodes. This is the fastest way to install HACMP Smart Assist for Oracle. HACMP Smart Assist for Oracle supports the Network Installation Management program and Alternate Disk Migration. For instructions on creating an installation server, see the AIX 5L Installation Guide or the AIX 5L Network Installation Management Guide and Reference. Installing from a Hard Disk To install HACMP Smart Assist for Oracle software from your hard disk, copy the software from the installation medium to the hard disk prior to installation. To copy the HACMP Smart Assist for Oracle software to your hard disk: 1. Place the HACMP Smart Assist for Oracle CD into the CD-ROM drive. 2. Enter smit bffcreate The Copy Software to Hard Disk for Future Installation panel displays. 3. Enter the name of the CD-ROM drive in the INPUT device/directory for software field and press Enter. If you are unsure of the input device name, select it from the picklist. Select the proper drive and press Enter. That value is entered into the INPUT device/directory field as the valid input device. 24 HACMP Smart Assist for Oracle User s Guide

25 Installing HACMP Smart Assist for Oracle Installation Choices 3 4. Press Enter to display the Copy Software to Hard Disk for Future Installation panel. 5. Enter field values as follows: SOFTWARE name DIRECTORY for storing software Press F4 for a software listing. Install the images for HACMP Smart Assist for Oracle. For a list of the HACMP Smart Assist for Oracle images, see the section Contents of the Installation Media. Change the value to the storage directory accessed by all nodes using HACMP Smart Assist for Oracle. 6. Enter values for the other fields as appropriate for your site. 7. When you are satisfied with the entries, press Enter. SMIT responds: Are you sure? 8. Press Enter again to copy the software. 9. After the HACMP Smart Assist for Oracle software has been copied to your system, install the software by following the instructions in the section Installing HACMP Smart Assist for Oracle from the CD-ROM. Note: For information on installing HACMP software see the Planning and Installation Guide. Installing HACMP Smart Assist for Oracle from the CD-ROM If you install the HACMP Smart Assist for Oracle software from the CD-ROM, install the software directly onto each cluster node. To install the HACMP Smart Assist for Oracle software on a cluster node: 1. Insert the CD into the CD-ROM drive. 2. Enter smit install_all SMIT displays the first Install and Update from ALL Available Software panel. 3. Enter the device name of the installation medium or install directory in the INPUT device/directory for software field and press Enter. If you are unsure about the input device name or about the install directory, press F4 to list available devices. Then select the proper device or directory and press Enter. The correct value is entered into the INPUT device/directory field as the valid input device. 4. You can accept the default settings for the following fields. Use the context-sensitive (F1) Help to get more information about the field. INPUT device/directory for software This field shows the device or directory you specified earlier. HACMP Smart Assist for Oracle User s Guide 25

26 3 Installing HACMP Smart Assist for Oracle Installation Choices SOFTWARE to install PREVIEW only? COMMIT software updates? SAVE replaced files? AUTOMATICALLY install requisite software EXTEND filesystems if space needed? OVERWRITE same or newer versions? VERIFY install and check file sizes? DETAILED output? Press F4 for a software listing, use the arrow keys to locate all software filesets associated with an image. For a list of filesets, see the section Contents of the Installation Media located in this chapter. Press F7 to select either an image or a fileset. Then press Enter after making all selections. Your selections appear in this field. If set to yes, the preview option checks and verifies that installation prerequisites are met, for instance that required software is installed and sufficient disk space is available. Press F1 for details. When you are ready to perform the actual installation, set this field to no. This field applies only when installing software updates (PTFs). This field applies only when installing software updates (PTFs). If you select no to commit software updates? select yes for this field. Set this field to no, if the prerequisite software is already installed or if the OVERWRITE same or newer versions? field is set to yes; otherwise, set this field to yes to install required software. Select yes if the system has adequate hard disk space. Select no if the system has limited disk space. For normal new installations, leave this field set to no. Set it to yes if you are reinstalling the software. If you set this field to yes, set the Automatically install requisite software field to no. Select yes if you want the system to perform some checks on the software you installed. Select yes if you want a detailed log of all installation messages. Process multiple volumes? Select this option if you want to enable the processing of multiple-volume CDs. 5. Accept the license agreement and preview the license. Enter field values as follows: ACCEPT new license agreements? Select yes to proceed with installation. If you select no, installation may stop with a warning that one or more filesets require software license agreements. You accept the license agreement only once for each cluster node. 26 HACMP Smart Assist for Oracle User s Guide

27 Installing HACMP Smart Assist for Oracle Removing an HACMP Smart Assist for Oracle Installation 3 Preview new license agreements? Select yes to view the text of the license agreements. The text displays in the current window in the language defined on your system. 6. When you are satisfied with the entries, press Enter. SMIT responds Are you sure? 7. Press Enter again to install the software. Read the HACMP Smart Assist for Oracle 5.3 Release Notes in the /usr/es/sbin/cluster/release_notes_assist directory for additional information that may not appear in the product documentation. Removing an HACMP Smart Assist for Oracle Installation If you remove an installation of HACMP Smart Assist for Oracle, removing the software does not remove the files generated by running the commands and scripts within HACMP Smart Assist for Oracle, and does not affect the HACMP configuration. If you want to remove the files generated by HACMP Smart Assist for Oracle, delete the files from AIX 5L. To remove HACMP Smart Assist for Oracle: 1. Stop cluster services: a. Enter the fastpath smit cl_admin b. Select Manage HACMP Services > Stop Cluster Services and press Enter. c. Select Stop now and press Enter. For information about stopping cluster services, see the chapter Starting and Stopping Cluster Services in the Administration Guide. 2. Enter smit install_remove The Install/Remove panel appears. 3. Enter field values as follows: SOFTWARE name REMOVE dependent software? EXTEND filesystems if space needed? DETAILED output? Use the arrow keys to locate all software you want to remove; then press F7 to select it. Remove the filesets listed in the section Contents of the Installation Media. Press Enter after making all selections. Your selections appear in this field. Select no. Select yes. Select no. HACMP Smart Assist for Oracle User s Guide 27

28 3 Installing HACMP Smart Assist for Oracle Where You Go From Here Where You Go From Here After you successfully install the HACMP Smart Assist for Oracle software on all of the HACMP cluster nodes as planned, you will use HACMP Smart Assist for Oracle to set up HACMP on the nodes. See Chapter 4: Configuring Oracle in an HACMP Cluster 28 HACMP Smart Assist for Oracle User s Guide

29 Chapter 4: Configuring Oracle in an HACMP Cluster This chapter describes how to use HACMP Smart Assist for Oracle to set up the HACMP two-node cluster with a hot standby configuration for your Oracle solution. It contains the following sections: Configuration Overview Creating the HACMP Two-Node Hot Standby Cluster Installing and Configuring Oracle. Configuration Overview HACMP Smart Assist for Oracle has two parts: the first part, Creating the HACMP Two-Node Hot Standby Cluster, helps you to configure a two-node cluster with a non-concurrent shared disk suitable for the Oracle Infrastructure Tier and performs relevant validation tests for your installation. The second part, Installing and Configuring Oracle, starts the Oracle installation software and helps you to install and configure Oracle. HACMP Smart Assist for Oracle: Checks the HACMP and AIX 5L install levels, Java Cryptography Extension (JCE) jce-1_2_2.zip on the primary node, and storage requirements. Ensures the machine is running in 64-bit mode. Checks the basic cluster topology; if the two-node cluster is not configured, Oracle Assist prompts you to configure HACMP nodes, networks and communication paths before installing Oracle. Helps you to create the HACMP application server (a collection of the Oracle instance start and stop scripts), shared volume group and resource group, and configures the two-node cluster with shared disk(s). Creates two shared logical volume and filesystem pairs. Synchronizes and verifies the configuration, optionally tests the cluster, and starts HACMP cluster services. Creates an initial Oracle instance group and user, displays values, checks port availability, and runs an Oracle script (rootpre.sh) on the cluster nodes. Installs and configures an Oracle instance by calling the Oracle Database 10g Universal Installer (OUI). HACMP Smart Assist for Oracle User s Guide 29

30 4 Configuring Oracle in an HACMP Cluster Creating the HACMP Two-Node Hot Standby Cluster Changing Default Configuration Values The /usr/es/sbin/cluster/sa/oracle/sbin/options file contains default configuration values. Oracle Assist takes these default values from the options file and records in this file, the information you enter while running the Oracle Assist. To customize subsequent two-node cluster with a hot standby configurations for an Oracle application, you can change defaults, or increase (not reduce) the size of these values in the options file. For example, by default the Oracle Assist creates and mounts two 5 GB filesystems. Before running the Assist, you can change the filesystem default in the options file so that the Oracle Assist creates and mounts two 10 GB filesystems. Creating the HACMP Two-Node Hot Standby Cluster Prerequisites To configure a two-node hot standby cluster configuration, the Oracle Assist helps you to add all the necessary cluster components, such as a resource group and its associated resources. With the hot standby cluster configuration, the Oracle instance is hosted on one node, with the other node serving as a standby node. In case of a cluster failure, the resource group managing the Oracle instance falls over to the standby node. The following sections describe how to create the HACMP two-node hot standby cluster using the HACMP Smart Assist for Oracle. Configuring the HACMP Two-Node Cluster Defining the Shared Volume Group Defining the Shared Filesystems Defining the HACMP Application Server Defining the Service IP Label Creating the Resource Group Adding the Resources to the Resource Group Defining the Private Network Verifying and Synchronizing the Cluster Running the Cluster Test Tool (Optional) Starting Cluster Services. Before reading this chapter, follow the instructions in the previous chapters: Chapter 2: Planning Your Configuration Chapter 3: Installing HACMP Smart Assist for Oracle. Before configuring the HACMP two-node cluster using the Oracle Assist: 1. Ensure your system meets the Hardware System Requirements as listed in Chapter 2: Planning Your Configuration. 30 HACMP Smart Assist for Oracle User s Guide

31 Configuring Oracle in an HACMP Cluster Creating the HACMP Two-Node Hot Standby Cluster 4 2. Add the HACMP service IP label and the standby node hostname to /etc/hosts on all nodes. The cluster event scripts use the /etc/hosts file for name resolution. All cluster node IP interfaces (boot and service) must be added to this file on each node. Note that if you do not add the service IP labels to the /etc/hosts file on any cluster node, then HACMP automatically adds them to this file as part of the automatic corrective action of the cluster verification process. 3. Ensure the service labels are resolvable on the local node. 4. Install AIX 5L, HACMP and the HACMP Smart Assist for Oracle filesets on both cluster nodes. 5. Have the Oracle Database 10g Universal Installer (OUI) available. The OUI will copy the files it needs to the shared disk during the Oracle installation. 6. If HACMP cluster services are running, stop them before proceeding: a. Enter the fastpath smit cl_admin b. Select Manage HACMP Services > Stop Cluster Services and press Enter. c. Select Stop now and press Enter. For information about stopping cluster services, see the chapter Starting and Stopping Cluster Services in the Administration Guide. Configuring the HACMP Two-Node Cluster The Oracle Assist offers two options when creating and configuring the cluster: Automatically and Using SMIT. Using the Automatically option is recommended. The Automatically option is less prone to errors, as the Oracle Assist configures the cluster for you and prompts you to define only required fields. While creating the two-node cluster either automatically or using SMIT Oracle Assist prompts you to enter or define configuration information and then displays the next task. Oracle Assist also provides configuration status at each step as each command runs. To create the basic HACMP two-node cluster with a hot standby configuration: 1. On the primary node, run /usr/es/sbin/cluster/sa/oracle/sbin/oracle_sa 2. Enter the hostname of the standby (secondary) node when prompted by HACMP Smart Assist for Oracle, for example: NodeC.ibm.com. 3. Enter location of the jce-1_2_2.zip file, when prompted by HACMP Smart Assist for Oracle (required the first time that the assist runs). Oracle Assist displays a list of numbered options: configure the HACMP two-node cluster, unconfigure the cluster, and to view the README information. 4. Enter the option to Configure the HACMP two-node cluster. HACMP Smart Assist for Oracle checks the HACMP and AIX 5L install levels and storage requirements, verifies the Java Cryptography Extension (JCE) jce-1_2_2.zip is located on the primary node, and ensures the machine is running in 64-bit mode. The Oracle Assist checks that the HACMP cluster is configured, required before installing Oracle. If there is no cluster defined, the Oracle Assist creates a two-node cluster using the node you are currently running on as the primary node one of the two cluster nodes. HACMP Smart Assist for Oracle User s Guide 31