High Availability Solutions with Oracle on HP-UX

Transcription

1 High Availability Solutions with Oracle on HP-UX Rebecca Schlecht (HP) EMEA HP/Oracle Cooperative Technology Centre (CTC) DECUS IT - Symposium 2007, CCN CongressCenter Nürnberg, 2006 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice HP/Oracle Cooperative Technology Center Located at HP in Germany, France & Oracle UK 10 HP & Oracle employees in one team Delivering services to HP, Oracle & Partners Founded in spring 1994 Technical pre-sales assistance/consulting for partners & customers customer workshops/demos, proof of concept projects, benchmarks, RFx contributions, architecture consulting, complex sizing and configuration assistance, customer presentations,.) Know-How Transfer & Country Enablement Evaluation and tests of new products/features Technology transfer to and from US labs Slide 2 1

2 Agenda HA Offering with Oracle & HP-UX Serviceguard Oracle RAC on HP-UX RAW, CFS, ASM Disaster Tolerant Solutions with Oracle RAC Data Guard 10gR2 Slide 3 High Availability Slide 4 2

3 HP & Oracle handle all causes of downtime Unplanned Downtime System Failure Data Failure & Disaster Human Error HP Serviceguard, Oracle RAC Storage Replication (BC/CA), Data Guard, RMAN + Data Protector integration... Flashback, LogMiner Data Guard, Storage Snapshots Planned Downtime System Maintenance Oracle Software Dynamic reconfiguration (Patches/Drivers) + Rolling maintenance (with SG) Rollable Patches, Data Guard (Logical Standby), Streams Database Maintenance Slide 5 Online Redefinition, Partitioning, Parallel SQL Cold Failover with HP Serviceguard Non-Shared Database Provides 16 node failover solution Applications/Users connect to Floating Virtual IP address Scalability of cluster is limited to scalability of one server Cold failover is slow, as many time consuming tasks must be performed as part of failover moving and mounting logical volumes starting the oracle instance opening the data files After failover: Start of Oracle instance All sessions must re-establish connections to the database Clients Application 1 Application 2 Virtual IP Ora Pkg FC Switch SAN Virtual IP Ora Pkg Slide 6 3

4 Workload Management with HP Serviceguard Node 1 Pkg A Pkg B Pkg A Node 2 Pkg D Pkg E Balance workload after a node failure Minimize impact on remaining nodes Pkg B Node 3 Pkg F Pkg C Node 4 Pkg G If Node 1 fails... Pkg C Pkg H Pkg I Slide 7 Oracle Real Application Clusters Application Cluster Database All systems are active and access the same database Increase scalability beyond one system Much faster failover and switchover Can pre-connect users to the secondary instance for fast restart without logon Load can be distributed Caches are warm on the secondary instance better performance after failure Requires raw devices, CFS or ASM Concurrent access from every node = scale out More nodes = higher availability Slide 8 4

5 Oracle RAC10g Architecture Server 1 Server 2 Oracle RAC instance 1 Oracle Clusterware Oracle Cache Fusion Oracle RAC instance 2 Oracle Clusterware opt: Vendor Clusterware cluster interconnect opt: Vendor Clusterware S3 S4 Sn opt: CVM / CFS Operating System shared storage opt: CVM / CFS Operating System more nodes = higher availability concurrent access from every node = scale out voting ocr Optional: quorum Slide 9 redo log instance 1 redo log instance 3 control files database files Oracle Clusterware Architecture SGA Pool SGA Pool Buffer Cache Buffer Cache Large Pool Large Pool SQL Cache SQL Cache Java Pool Java Pool virtual IP addresses database instances processes Oracle Cluster Ready Services (CRS) HA Framework Oracle Cluster Synchronization Services (CSS) Node Monitoring & Membership Hardware / OS Kernel Slide

6 Oracle RAC10g on HP-UX RAC 10g SG/SGeRAC & Oracle Clusterware Oracle Clusterware Only SLVM CVM ASM RAW ASM RAW CFS Slide 11 Why HP SG / SGeRAC together with Oracle Clusterware HP Serviceguard as proven cluster layer with 150,000+ licenses HP Serviceguard is integrated with the HP Virtual Server Environment Continue to use HP Serviceguard to make your complete cluster high available including 3rd party applications HPs Enterprise Cluster Master Toolkits (ECMT) to rapidly implement and deploy applications under the control of HP Serviceguard Increase network reliability for all components including the critical private interconnect. Integration with HP Extended Cluster (aka Campus Cluster) and HP ContinentalClusters. Make use of a Cluster File System Make use of HP's shared logical volumes Co-existence of Oracle9i RAC and RAC10g on the same cluster Slide

7 Integration SGeRAC & Oracle Clusterware In a combined SGeRAC & Oracle Clusterware environment SGeRAC is responsible for Cluster membership info provided to Oracle Clusterware CSS (Cluster Synchronization Service) daemon Management of SGeRAC provided storage options (SLVM, CVM, CFS) Startup of Oracle Clusterware within an HP Serviceguard package (required ). Oracle Clusterware CRS (Cluster Ready Services) is responsible for Management of database and associated resources (instances, services, VIPs, listeners,..) Management of Oracle ASM Slide 13 HP Serviceguard Extension for RAC (SGeRAC) Support for 9i RAC & RAC10g Cluster management is provided with SG Shared Logical Volume Manager features are enabled with SGeRAC Support for 16 nodes with SLVM SGeRAC runs on top of SG starting with Support for SG Extension for Fast Failover Support for Rolling Upgrade starting with SGeRAC does not support mixed clusters yet. All nodes must either be Itanium2 or PA-RISC, but not both in the same cluster. Online Node Reconfiguration Support (SNOR) Online Node Addition Support Slide

8 Oracle RAC10g with HP CFS for RAC One of HP s new Serviceguard Storage Management Suite Bundles Includes the newest version of VRTS software 4.1 and SG/SGeRAC Provides consistent support for both Oracle 9i and 10gR2 environments, for both singleinstance Oracle and RAC Applications and the database are managed the same way Provides support for 8-node clusters with SG CFS for RAC Ability to manage the various db files with normal UNIX commands Slide 15 CFS can be used for Oracle data files and for Oracle binaries, config files, and logs Ability to use all normal backup utilities with db files on a CFS Support for local cluster and Extended Cluster RAC 10g SG/SGeRAC & Oracle Clusterware CVM CFS HP Serviceguard Storage Management Suite T2771BA T2772BA T2773BA T2774BA Serviceguard Storage Management Serviceguard Storage Management Premium Serviceguard Storage Management for Oracle Serviceguard Storage Management for Oracle Premium T2775BA T2776BA T2777BA Serviceguard Cluster File System Serviceguard Cluster File System for Oracle Serviceguard Cluster File System for RAC Slide

9 HP Serviceguard Storage Management Suite Features Volume Management and File System Cluster File System Oracle Disk Manager (ODM) Flashsnap Quicklog Benefits Online storage reconfiguration, online volume and file system creation and resizing, and database tablespace growth Hot relocation of failed redundant storage A CFS provides excellent I/O performance and simplifies the installation and ongoing management of a RAC database Allows near raw performance within a file system Let DBAs easily establish database clone, a duplicate database on a secondary host for off-host processing Enhances file system performance by placing the file system log on a separate device Dynamic Storage Tiers (formerly QoSS) Portable Data Containers (PDCs) Dynamic Multi-Pathing (DMP) Storage Mapping Allows single FS to span two tiers of disk (FC & ATA) Online archiving solution Use the most cost effective storage for needs Common on-disk data format across OSes Allows for easier OS migration (i.e. Solaris HP-UX) Allows for redundant paths to storage to be utilized, protecting against network outages Quickly diagnose performance bottlenecks from table space down to disk Slide 17 Oracle RAC10g on HP-UX with Oracle Clusterware only and ASM RAC 10g Oracle Clusterware Only ASM The Oracle Clusterware to provide RAC cluster membership Oracle ASM for storage management High availability for other applications running on same cluster can be implemented with RAC10gR2 Cluster API CRS monitors the virtual IP address (VIP) and not other network interfaces. Therefore, additional software necessary to provide HA features for private interconnect (e.g. HP APA) No shared logical volume manager supported for Oracle files (OCR, Voting, data files, ) Supported with Oracle RAC 10gR1+ Slide

10 The ASM Operational Stack Without ASM ASM Tables Tables Tablespace Files File System Logical Vol Tablespace File Names File System Logical Vol Automatic Storage Management Disks Disk Group Networked Storage (SAN, NAS, DAS) Slide 19 ASM How it Works Automatic Storage Management Partitions total disk space into uniform sized megabyte units Units assigned to a file are managed and tracked by ASM Automatic online rebalance whenever storage configuration changes Only Oracle data such as data file, redo logs, dump sets, control files, spfile, archive logs, flashback logs Stripe And Mirror Everything (SAME) Striping across all disks in the disk group Integrated mirroring (no, double or triple mirroring) Slide

11 Oracle ASM on top of RAW Disk Slide 21 Oracle RAC10g on HP-UX with SG/SGeRAC & ASM over SLVM RAC 10g SG/SGeRAC & Oracle Clusterware SLVM ASM Prior to SGeRAC 11.17, ASM is NOT supported in SG/SGeRAC configurations Only support for RAC 10g R2: no support for RAC10g R1 no support for single instance no support for Extended SG Cluster Solutions Each ASM disk group member must be a SLVM raw logical volume Up to 16 nodes in cluster SLVM provides active/standby multi-pathing support for RAC and single instance ( pvlinks ) ASM-over-SLVM enables the HP-UX devices used for disk group members to have the same names on all nodes, easing ASM configuration. Slide

12 Oracle ASM on top of Shared LVM Use of Alternate Paths, or pvlinks Alternate links, or pvlinks, are multiple paths to the same physical disk. # vgcreate <name> <primary path> <secondary path> Used for redundancy, in case of channel failure, alternate links will automatically change paths to a disk in the event of a card failure, increasing availability. No load balancing across the two paths. Therefore you typically configure the primary path of one disk over controller1 and the second disk with controller2. # vgcreate /dev/vg1 /dev/dsk/c4t0d0 /dev/dsk/c5t0d0 # vgextend /dev/vg1 /dev/dsk/c5t0d0 /dev/dsk/c4t0d0 Slide 23 Configuring SLVM Volume Groups for ASM Disk Groups DB Instances DG1 Logical Volumes Physical Volumes (PVs) ASM Instance ASM Disk Groups DG2 Volume Group Organize the disks to be used by ASM into LVM volume groups (VGs) Ensure that there are multiple paths to each disk, by configuring PV Links or disk level multipathing For each physical volume (PV), configure a logical volume (LV) using up all available space on that PV On each LV, set an I/O timeout equal to pvtimeout*# of PV Links Export the VG across the cluster and mark it shared Do not use mirroring, striping, concatenation or splitting of PVs at LVM level ASM manages these functions Slide

13 Oracle RAC10g on HP-UX with SG/SGeRAC & RAW Oracle Clusterware running integrated on top of SG/SGeRAC Cluster Membership is derived from SG/SGeRAC SG Package Manager to provide high availability of other applications Provides high availability for all networks Integration with HP Extended Cluster solutions Support for shared logical volume manager (OCR, Voting, data files, ) Optimal performance Lacks file system capabilities Slightly more complex to handle RAC 10g SG/SGeRAC & Oracle Clusterware SLVM CVM Slide 25 RAW RAW RAC10g on HP-UX: What to choose? RAC10g with HP SG/SGeRAC... RAC10g with HP SG/SGeRAC and CFS Pro s + SG/SGeRAC provides mature and proven cluster layer + SG Package Manager to provide HA for other applications + provides high availability for all networks + integration with HP Extended Cluster + best management option for all kind of files + ability to use all normal file system utilities + optimal performance with ODM driver + includes many desirable file system + volume management features such as Flashsnap, Dynamic multipathing, supported with 9i and Slide 2610g Con s additional software licenses for SG/SGeRAC no support for heterogeneous environments (HP-UX only) additional software licenses for SG CFS bundle support from multiple vendor 13

14 RAC10g on HP-UX: What to choose? RAC10g with HP SG/SGeRAC... and RAW RAC10g with HP SG/SGeRAC... and ASM over SLVM Pro s + optimal performance + no additional software licenses for volume manager / file systems + supported for 9i + 10g + no additional licenses for volume manager / file systems + easy management with ASM + optimal performance + SLVM provides active/standby multi-pathing support for RAC and single instance ( pvlinks ) Con s no file system capabilities likely more complex to handle no support before 10gR2 no support for single instance no support for Extended Cluster RAC10g with Oracle Clusterware Only and ASM + no additional licenses for - Volume manager - File systems - Cluster Manager + easy support model (all from Oracle) Slide 27 no HA for networks - ASM lacks multi-pathing capabilities only supported with 10g RAC Interconnect Support Platform 1GbB (IP) 10GbB (IP) IP over Infiniband RDS over Infiniband Hyperfabric (HMP & IP) 10g RAC HP-UX Yes Yes Yes Planned for mid this year No 10g RAC Linux Yes Yes Yes Yes ( with Silverstorm) No 9i RAC HP-UX Yes Yes No No Yes 9i RAC Linux Yes Yes No No No!! Crossover Cables are not supported by Oracle as an interconnect with 9iRAC/10gRAC on any platform! Slide

15 Slide 29 Disaster Tolerant Solutions with Oracle RAC Slide

16 Extended Distance SGeRAC Cluster Single Cluster over two data centers - Active/Active Disaster tolerance as servers and storage reside in two separate data centers Automatic failover to second data center Software mirroring 2 nodes supported with RAW/SLVM and MirrorDisk/UX 8 nodes supported with CFS/CVM and RAW/CVM up to 10km; 2 nodes up to 100km Support for Oracle9i & 10g Slide 31 RAC Node A Node B SLVM/CVM SLVM/CVM Storage Storage Data Center 1 Data Center 2 Support for single-instance & RAC MetroCluster / Cluster Extension XP with Oracle Node A XP/EMC Node C Arbitrator CA / SRDF Data Center 1 Data Center 2 Node B XP/EMC Only supported with Oracle single instance MC/SG Single Cluster over two data centers; Active/Passive Disaster tolerance as servers and storage reside in two separate data centers Rapid, automatic site recovery without human intervention Storage Hardware Mirroring with XP CA, EVA CA or EMC SRDF Separate arbitrator for split brain situations system connected to mirror has read only access Slide

17 C abin et Num be r HK P 48 V GS P R em ote A ten tion h p S to r a g ew or k s x p d i sk ar r ay REA ALA DY RM ME SA GE PU SH h p S to r a g ew or k s x p d i sk ar r ay h p S to r a g ew or k s x p d i sk ar r ay C ab ine tn um be r H KP 4 8V G SP Re mo te At enti on C abin et Num be r HK P 48 V GS P R em ote A ten tion h p S to r a g ew or k s x p d i sk ar r ay REA DY ALA RM ME SA GE PUSH h p S to r a g ew or k s x p d i sk ar r ay h p S to r a g ew or k s x p d i sk ar r ay C abin et Num be r HK P 48 V GS P R em ote A ten tion IT-Symposium 2007 HP Continentalclusters & Oracle RAC Single Clusters in separate data centers Active/Passive Support up to 32 nodes per Continentalclusters Supported with Oracle single instance and Oracle RAC Push-Button Failover Support for RAC 10g introduced in December 2005 with SG/SGeRAC Supported with RAW/SLVM, CFS/CVM Before Failure: Primary Cluster Instanc e1 After Failure: Active DB Instanc e2 Primary Cluster Instanc e1 Instanc e2 XP CA Recovery Cluster Recovery Cluster Instanc e1 Instanc e2 Slide 33 XP CA Active DB HP Continentalclusters & Oracle RAC German Customer Example ContinentalClusters local SGeRAC cluster local SGeRAC cluster Apps Server RAC11 Apps Server RAC12 Intercluster Monitoring Apps Server RAC21 Apps Server RAC22 RAC11 & RAC12 access DB1 RAC21 & RAC22 access DB2 DB1 DB2 bi-directional HP CA XP/EVA synch. or async. Slide 34 DB1 DB2 17

18 Slide 35 Slide

19 Oracle Data Guard Slide 37 What is a Standby Database? Primary Site Standby Site Log Data Primary Database Standby Database Replica of Primary database As primary database is modified, changes are propagated to standby databases Primary database is open and active. Standby database is either in recovery or open read-only If something goes wrong with primary, standby can be activated Slide

20 DIGITAL DATA STORAGE DIGITAL DATA STORAGE IT-Symposium 2007 Oracle Data Guard physical vs. logical standby Physical Standby Database Production Database Sync/Async Optional Delay Apply Physical Redo Backup Network Broker Sync/Async Logical Standby Database SQL Apply Continuously Open for Reports Transform Redo to SQL with optional delay Additional Indexes & MVs Data Guard Protection Modes Maximum Protection Highest Level of data protection with zero data loss Synchronous LGWR If standby is unavailable, processing stops at primary Maximum Availability Zero data loss Synchronous LGWR If standby is unavailable, processing continues at primary. When fault corrected, standby db gets automatically resynchronized with primary db. Maximum Performance Async redo data shipment to the standby database Little effect on primary database performance Slide

21 Enhanced Disaster Recovery with Flashback Database Primary Database Redo Shipment Real Time Apply Standby Database Real Time Reporting No Delay! Flashback Log Flashback Log Primary: No reinstantiation after failover! Flashback DB removes the need to delay application of logs Flashback DB removes the need to reinstantiate primary after failover Real-time apply enables real-time reporting on standby Slide 41 Oracle Data Guard Fast-Start Failover Primary Database Observer Standby Database Fast-Start Failover is an Oracle Data Guard 10gR2 feature that automatically fails over to a synchronized standby db in event of loss of production db without requiring any manual steps to invoke the failover. Requires Maximum Availability protection mode (LGWR SYNC Redo Transmission). Flashback Database and Flash Recovery Area must be enabled on both primary and standby db. After failover completes, the Broker automatically reinstates the old primary database as a new standby database. Configuration with Data Guard Broker that provides centralized management. Slide

22 Don t miss Slide 43 Slide

23 Slide