Oracle RAC 10g on HP-UX

Transcription

1 Oracle RAC 10g on HP-UX now featuring HP SG CFS Rebecca Schlecht EMEA HP/Oracle CTC 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 1 Agenda HP/Oracle Alliance RAC10g with HP CFS for RAC Supported Configurations with RAC10g on HP-UX What option to choose? Further Links Q & A 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 2 1

2 HP/Oracle Alliance = 25 years of collaborative partnership 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 3 Oracle and HP a Strong Alliance 25 years of collaborative partnership 100,000+ combined customers $6B business Market leading 41% of Oracle database customers use HP systems 70% mid-range HP-UX servers and 90% of Superdomes run Oracle Hundreds of dedicated resources to Oracle. 13 worldwide technology & competency centers 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 4 2

3 See Oracle committed to HP Integrity Prompt Oracle releases on Integrity E-Business Suite split-tier on Integrity now, pure Integrity by early /17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 5 Oracle s Development Platforms Linux IA32 + Windows IA32 are Base Development Platforms for Oracle HP-UX Integrity, SUN Solaris, IBM AIX,... are Strategic Development Platforms for Oracle. New Oracle versions are first available on Base Development platforms and within 30 days on all Strategic Development Platforms. Up to now, HP-UX PA-RISC was Strategic Development Platform, with the next Oracle Releases this is HP-UX Integrity. 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 6 3

4 Current TPMC Status 4 Core and 8 Core Vendor System Proc/Core Tpmc Database OS Price/Perf IBM P / 4 (1.9GHz) Oralce 10g EE AIX 5L US $ HP DL585 4/8 (2.4GHz) IBM DB2 8.2 MS 2003 EE 2.02 US $ HP DL585 4/8 (2.4GHz) 206,181 SQL 2005 MS 2003 EE 2.30 US $ HP NEW Integrity rx4640 2/4 (1,6GHz) Montecito 200,829 Oralce 10g EE HP UX 11.iv US $ Integrity Benchmark = zx1 Chipset; DDR1 Memory; only 2 CPU sockets filled. Even more PERFORMANCE with 8 Cores in rx4640 Even more PERFORMANCE with zx2 Price / Performance already now below P5!! Source: 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 7 Recent Oracle Licensing Change (1) Virtualization All Virtualization Software tools of HP will be treated as a hard partition nppar vpar Secure Resource Partitions Virtual Machine Refer to 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 8 4

5 Recent Oracle Licensing Change (2) Dual Core Oracle s recent dual core pricing announcements will level the playing Multicore RISC processors 0.75 e.g. IBM Power5, Sun UltraSPARC IV, and HP PA-8800 Multicore Intel &AMD processors 0.5 e.g. Montecito Multicore Sun T1 processors 0.25 Single core CPU 1 Example: # of Oracle licenses required for 32 core server IBM = 32 x 0.75 x $40k = $960k HP Montecito = 32 x 0.5 x $40K = $640k Standard Edition based on sockets (not cores) 8 Dual Core Refer to 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 9 Oracle RAC10g on HP 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 10 5

6 Oracle RAC10g Architecture Server 1 Server 2 Oracle RAC instance 1 Oracle Clusterware Oracle Cache Fusion Oracle RAC instance 2 Oracle Clusterware opt: Vendor Clusterware cluster interconnect opt: Vendor Clusterware S3 S4 Sn opt: CVM / CFS Operating System shared storage opt: CVM / CFS Operating System more nodes = higher availability concurrent access from every node = scale out voting ocr Optional: quorum redo log instance 1 redo log instance 3 control files database files 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 11 Oracle Clusterware Architecture SGA Pool SGA Pool Buffer Cache Buffer Cache Large Pool Large Pool SQL Cache SQL Cache Java Pool Java Pool virtual IP addresses database instances processes Oracle Cluster Ready Services (CRS) HA Framework Oracle Cluster Synchronization Services (CSS) de Monitoring & Membership Hardware / OS Kernel 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 12 6

7 Oracle RAC10g Architecture Oracle Clusterware -CRS -EVM -CSS Oracle Clusterware -CRS - EVM -CSS SG / SGeRAC - Resource Monitoring - Resource Management - Cluster Control/ Failover APIs - Cluster Membership CFS; SLVM; SLVM/ASM; CVM Oracle ASM Hardware- / OS-Kernel 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 13 Oracle RAC10g runs on Server HP Integrity Family Server Processor Itanium2 OS HP-UX 11i v2 HP ProLiant Server Intel Xeon & AMD Opteron Linux 32/64 HP 9000 Server PA-RISC HP-UX 11i v2 HP Alpha Server Alpha Tru64 Linux 64 Windows 32/64 HP-UX 11iv1 OpenVMS Windows 64 OpenVMS * 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. * planned for H2CY

8 Oracle RAC10g on HP RAC10g with HP CFS for RAC 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 15 Commitment: HP and symantec partner to provide integrated clustering solutions HP introduces HP Serviceguard integrated with symantec VERITAS cluster file system on HP-UX 11i v2 scheduled for end of September VERITAS reaffirms HP-UX 11i as a strategic platform, including HP Integrity Servers and HP 9000 HP and VERITAS product integration BETTER integrated management for ease of use and strengthening the foundation for leading high availability and disaster tolerant solutions 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 16 8

9 Oracle RAC10g with HP CFS for RAC One of HP s new Serviceguard Storage Management Suite Bundles Includes the newest version of VRTS software 4.1 and SG/SGeRAC Provides consistent support for both Oracle 9i and 10g environments, for both single-instance Oracle and RAC (9iRAC and RAC10g R2) Applications and the database are managed the same way Provides initial support for 4-node clusters with SG CFS for RAC, 8 nodes will follow Ability to see the various db files (and associated sizes) with normal UNIX commands CFS can be used for Oracle data files and for Oracle binaries, config files, and logs Ability to use all normal backup utilities with db files on a CFS Currently only local cluster supported. Please contact us if you have customers who want Extended Cluster with CFS! RAC 10g SG/SGeRAC & Oracle Clusterware CVM CFS 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 17 HP Serviceguard Storage Management Suite T2771BA T2772BA T2773BA T2774BA Serviceguard Storage Management Serviceguard Storage Management Premium Serviceguard Storage Management for Oracle Serviceguard Storage Management for Oracle Premium T2775BA Serviceguard Cluster File System T2776BA Serviceguard Cluster File System for Oracle T2777BA Serviceguard Cluster File System for RAC 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 18 9

10 Management of RAC databases Advantages using CFS Best management option for all kind of files addition/deletion of files possibility to grow Oracle data files possibility for file system backup Support for installation of binaries into CFS Oracle is full cluster file system aware configuration file names are node/instance specific: CRS log files: [nodename].log CSS log files: ocssd[denumber].log 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 19 Backup & Recovery with RAC Advantages using CFS de 1 de 2 Instance A SGA ARCH LGWR Redo Redo Thread1 interconnect shared Oracle Data files Arch Files, Configuration & Logfiles Instance B SGA LGWR Redo Redo Thread2 ARCH Having archive logs on a CFS simplifies the backup significantly. need of crossinstance archiving NFS cross mounts manual intervention in case a node/instance goes down 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

11 HP Serviceguard Cluster File System for RAC Common to all bundles Serviceguard A VxVM Enterprise Cluster Master Toolkit 2TB File System 2-32 File System >32 File System VERITAS Enterprise Administrator (GUI) New with 4.1: Dynamic Multi-pathing (enhanced with 4.1) Intelligent Storage Provisioning Configuration Backup Storage Expert History log (new with 4.1) Online Intent Log Resize Named Data Streams Online LUN Resize Portable Data Containers Hardware Assisted E-Copy Multi-Volume File System From 3.5: Online Administration Specific to this bundle SGeRAC Cluster File System Clustered Volume Manager Quality of Storage Instant Volume Snapshots Checkpoint Restore Oracle Disk Manager for Oracle 9i & 10g (known as Quick I/O for pre-9i) Storage Mapping to LUN Level Storage rollback Storage Checkpoints Disk Group Split and Join Fast Mirror Resync Product Number: T2777BA 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 21 What is ODM? API defined by Oracle to enhance File Management and Disk I/O throughput this API is available to vendors. ODM API co-developed by Oracle and VERITAS Designed for Oracle9i or later Replaces Quick I/O which is up to Oracle8i The ODM interface provides unified I/O and file management for Oracle servers and reduces the number of system calls that Oracle servers generate. All Oracle processes use a single I/O library. Available in all Serviceguard Storage Management Suite for Oracle Bundles 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

12 Architecture and Design - SGeRAC i RAC instance or 10g RAC CRS startup package* RAC using CFS RAC using CVM Per CFS mount point (may need multiple CFS mount per RAC instance) Per CVM Disk Group (may need multiple CFS DG per RAC instance) CVM/CFS subsystem CFS Mount MNP Simple dependency (SG-CFS-MP-#id) Disk group MNP (SG-CFS-DG-#id) STORAGE_GROUP CVM/CFS 4.x SMNP (SG-CFS-pkg) * Requires Oracle or later patch 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 23 Oracle RAC10g on HP Other Supported Configurations besides SG CFS for RAC 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

13 Oracle RAC10g on HP-UX RAC 10g SG/SGeRAC & Oracle Clusterware Oracle Clusterware Only SLVM CVM ASM RAW ASM RAW CFS 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 25 Why HP SG / SGeRAC together with Oracle Clusterware HP Serviceguard as proven cluster layer with 150,000+ licenses HP Serviceguard is integrated with the HP Virtual Server Environment Continue to use HP Serviceguard to make your complete cluster high available including 3rd party applications HPs Enterprise Cluster Master Toolkits (ECMT) to rapidly implement and deploy applications under the control of HP Serviceguard Increase network reliability: Oracle Clusterware does not provide any protection for the critical private interconnect. Integration with HP Extended Cluster (aka Campus Cluster) and HP ContinentalClusters. Make use of a Cluster File System Make use of HP's shared logical volumes Co-existence of Oracle9i RAC and RAC10g on the same cluster 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

14 HP Serviceguard Extension for RAC (SGeRAC) Support for 9i RAC & RAC10g Cluster management is provided with SG Shared Logical Volume Manager features are enabled with SGeRAC Support for 16 nodes with SLVM SGeRAC runs on top of SG starting with Support for SG Extension for Fast Failover Support for Rolling Upgrade starting with SGeRAC does not support mixed clusters. All nodes must either be Itanium2 or PA-RISC, but not both in the same cluster. Online de Reconfiguration Support (SNOR) Being able to reconfigure SLVM while VG is activated in only one administrative node in the cluster Online de Addition Support This feature requires changes in SG and Kernel LVM 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 27 Integration SGeRAC & Oracle Clusterware In a combined SGeRAC & Oracle Clusterware environment SGeRAC is responsible for Cluster membership info provided to Oracle Clusterware CSS (Cluster Synchronization Service) daemon Management of SGeRAC provided storage options (SLVM, CVM, CFS) Startup of Oracle Clusterware within an HP Serviceguard package (required ). Oracle Clusterware CRS (Cluster Ready Services) is responsible for Management of database and associated resources (instances, services, VIPs, listeners,..) Management of Oracle ASM 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

15 SGeRAC and Oracle Clusterware - best practices Disable automatic start-up of Oracle Clusterware /sbin/init.d/init.crs disable Ensure that Oracle does not activate/deactivate any volumes no /var/opt/oracle/oravg.conf Configure SG package to activate/deactivate shared VGs and to start/stop Let Oracle Clusterware start/stop all registered resources such as db instances, listener, VIPs,... Configure same heartbeat interfaces for SGeRAC & Oracle Oracle VIP must be configured for a public network that is not used by any other SG application SG/SGeRAC will provide high availability for all networks 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 29 Oracle RAC10g on HP-UX with SG/SGeRAC & RAW Oracle Clusterware running integrated on top of SG/SGeRAC Cluster Membership is derived from SG/SGeRAC: mature and proven cluster layer SG Package Manager to provide high availability of other applications Provides high availability for all networks Integration with HP Extended Cluster (aka Campus Cluster) and Continental Clusters. Support for shared logical volume manager (OCR, VOTING, data files, ) Optimal performance Lacks file system capabilities Slightly more complex to handle RAC 10g SG/SGeRAC & Oracle Clusterware SLVM RAW CVM RAW 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

16 Oracle RAC10g on HP-UX with SG/SGeRAC & SLVM/ASM RAC 10g SG/SGeRAC & Oracle Clusterware SLVM ASM Prior to SGeRAC 11.17, ASM is NOT supported in SG/SGeRAC configurations Only support for RAC 10g R2: no support for RAC10g R1 no support for single instance no support for Extended Cluster (irrespective of whether the inter-site mirroring is via ASM or HP-provided volume manager) Each ASM disk group member must be a SLVM raw logical volume Max # of nodes in cluster: without MNP/Simple Dependency Framework - 16, with Framework 4 SLVM provides active/standby multipathing support for RAC and single instance ( pvlinks ) Leverage cluster-wide device name feature of SLVM 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 31 Oracle RAC10g on HP-UX with Oracle Clusterware only and ASM RAC 10g Oracle Clusterware Only ASM The Oracle Clusterware to provide RAC cluster membership Oracle ASM for storage management High availability for other applications running on same cluster can be implemented with HP SG (no SGeRAC) or with RAC10gR2 Cluster API CRS monitors the virtual IP address (VIP) and not other network interfaces. Therefore, additional software necessary to provide HA features for private interconnect (e.g. HP APA) shared logical volume manager supported for Oracle files (OCR, VOTING, data files, ) Supported with Oracle RAC 10gR1+ 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

17 RAC10g on HP-UX: What to choose? Pro s Con s RAC10g with HP SG/SGeRAC... RAC10g with HP SG/SGeRAC and CFS + SG/SGeRAC provides mature and proven cluster layer + SG Package Manager to provide HA for other applications + provides high availability for all networks + integration with HP Extended Cluster + best management option for all kind of files + ability to use all normal file system utilities + optimal performance with ODM driver + includes many desirable file system + volume management features such as Flashsnap, Dynamic multipathing, supported with 9i and 10g additional software licenses for SG/SGeRAC no support for heterogeneous environments (HP-UX only) additional software licenses for SG CFS bundle 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 33 RAC10g on HP-UX: What to choose? RAC10g with HP SG/SGeRAC... and RAW RAC10g with HP SG/SGeRAC... and ASM over SLVM RAC10g with Oracle Clusterware Only and ASM Pro s + optimal performance + no additional software licenses for volume manager / file systems + supported for 9i + 10g + no additional licenses for volume manager / file systems + easy management with ASM + SLVM provides active/standby multi-pathing support for RAC and single instance ( pvlinks ) + easy support model (all from Oracle) Con s no file system capabilities more complex to handle no support before 10gR2 no support for single instance no support for Extended Cluster performance impact of extra layer of volume management no HA for networks - ASM lacks multi-pathing capabilities you must use ASM, no SLVM only supported with 10g 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

18 Further Links 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 35 to get a copy of this paper please send an to rebecca.schlecht@hp.com / rainer.marekwia@oracle.com 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

19 Further Links HP & Oracle Alliance Web Site Optimze for Agility che/ html Oracle Metalink: Oracle Technology Network: Product Availability: /metalink Oracle Grid Computing optimized in HP BladeSystems: wnloads/15391%20oracle%20blade%20 BR%204b.pdf HP High availability technology Serviceguard HA and DTS solutions for HP-UX 11i and Linux se/cache/ html HP Parallel Database Clusters s/enterprise/highavailability/oracle Automatic Storage Management with HP Storage Arrays on HP-UX se/downloads/oracle_10g_asm_w_ HP_StorageWorks_Arrays_on_HP- UX.pdf HP Offers Oracle Patch Parity: se/downloads/hp%20oracle%20pat ch%20parity.pdf 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 37 Q & A 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

20 Oracle RAC10g on HP Interconnect 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 39 Interconnect for RAC on HP-UX Crossover Cables are not supported by Oracle as an interconnect with 9iRAC/10gRAC on any platform. Important criteria for interconnect: Throughput of interconnect: 1GB Ethernet / 10GB Ethernet / InfiniBand (today 10GB/s) / Hyperfabric2 (4 GB/s) Latency of protocol UDP: available for all network adapters; ~ 50 microseconds Low latency implementations: RDS planned RDMA out of scope HMP over Hyperfabric: not any longer strategic... Distance InfiniBand: max 10m copper cable Hyperfabric2: max 200m cable High Availability For most customer implementations UDP over Ethernet is sufficient. Goal : Replace HMP/HyperFabric with Infiniband or 10Gigabit Ethernet. 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

21 Oracle RAC Interconnect for HP-UX Integrity HF2/HMP HF2/UDP IPoIB IB/RDS 1Gb 10Gb gR1 SG 10gR1 CRS only 10gR2 SG 10gR2 CRS only, (SLVM only, no CFS yet) Currently Planned 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 41 Oracle RAC Interconnect for HP-UX PA-RISC HF2/HMP HF2/UDP IPoIB IB/RDS 1Gb 10Gb gR1 SG 10gR1 CRS only 10gR2 SG 10gR2 CRS only, under discussio n Currently Planned 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

22 Oracle RAC10g on HP Disaster Tolerant Configurations 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 43 Extended Distance SGeRAC Cluster Single Cluster over two data centers - Active/Active Disaster tolerance as servers and storage reside in two separate data centers Automatic failover to second data center Software mirroring 2 nodes supported with SLVM and MirrorDisk/UX 8 nodes supported with Veritas VxVM/CVM up to 10km; 2 nodes up to 100km Support for single-instance & RAC Support for Oracle9i & 10g RAC de A de B SLVM SLVM Storage Storage Data Center 1 Data Center 2 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

23 Extended Distance SGeRAC Cluster: German Logistic Customer 6x HP rx4640 HP-UX 11iv2 HP SG & SGeRAC Raw Devices -- Veritas CVM with mirroring across two HP EVA8000 Servers and storage placed in two data centers with a distance < 150m Migration project from Oracle8i OPS Need to make additional applications high available Possibility to upgrade to SG CFS later SAN < 150m in production since October /17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 45 HP Continentalclusters & Oracle RAC Single Clusters in separate data centers Active/Passive Support up to 32 HP 9000 and Integrity servers per Continentalclusters Supported with Oracle single instance and Oracle RAC Push-Button Failover Support for RAC 10g introduced in December 2005 with SG/SGeRAC Before Failure: Instan ce1 Primary Cluster Active DB After Failure: Instan ce1 Instan ce2 Primary Cluster Instan ce2 XP CA XP CA Recovery Cluster Recovery Cluster Instan ce1 Active DB Instan ce2 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved

24 CabinetNu mb er HKP 48V GSP Re mote Atention hp S t o r a g e W o r k s x p d is k a r r a y RE AD Y AL ARM M ESS AG E PU SH hp Stora geworks xp12000 disk array hp S to r a g e W o r k s x p d i s k a r r a y CabinetNu mb er HKP 48V GSP Re mote Atention Cab in e tnu mb er HKP 48V GSP Re mote Atention hp S t o r a g e W o r k s x p d is k a r r a y RE AD Y AL ARM MESS AGE PU SH hp Stora geworks xp12000 disk array hp S to r a g e W o r k s x p d i s k a r r a y CabinetNu mb er HKP 48V GSP Re mote Atention HP IT-Symposium 2006 HP Continentalclusters & Oracle RAC German Customer Example ContinentalClusters local SGeRAC cluster local SGeRAC cluster Apps Server RAC11 Apps Server RAC12 Intercluster Monitoring Apps Server RAC21 Apps Server RAC22 RAC11 & RAC12 access DB1 RAC21 & RAC22 access DB2 DB1 DB2 bi-directional HP CA XP/EVA synch. or async. DB1 DB2 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved. 47 Oracle Clusterware: Oracle Mirroring across Data Centers SAN EVA1 OCR Vote EVA2 OCR Vote Failure Group 1 Failure Group 2 ASM Disk Group with normal redundancy Vote 3rd data center 5/17/2006 Copyright 2003 HP corporate presentation. All rights reserved