Virtualization and Automation in an Oracle Grid Environment. Sanjay Umarji Solution Architect HP-Oracle Competency Center

Transcription

1 Virtualization and Automation in an Oracle Grid Environment Sanjay Umarji Solution Architect HP-Oracle Competency Center

2 Agenda Virtualization Why does HP care? Why does Oracle care? Why should IT care? Oracle and HP s visions for our customers HP s Reference Architectures for Virtualization Scale-out virtualization Scale-up-and-out virtualization VSE Reference Architecture components Management & automation

3 Virtualization E pluribus unum E unum pluribus Resource virtualization and provisioning is [sic] the key to improving resource utilization and enabling the realignment of resources as business needs change. - Oracle Database New Features Guide for 10g Release 1 (10.1)

4 Quote Unquote Use of virtualization technologies.. will dramatically improve server utilization rates, increase server flexibility and reduce the overall spending required for servers. Source: T. Bittman, Gartner, November % of customers use server virtualization today or plan to evaluate it in the next 3 years. Source: Summit, August 2004

5 History of HP virtualization firsts Element virtualization Optimize utilization of server, storage or networking resources Integrated virtualization Optimize multiple environments to automatically meet service-level agreements Complete IT utility Optimize all heterogeneous resources so supply meets demand in real time Servers Storage Network Software Printers & Clients HP AutoRaid (1994) HP-UX Virtual Partitions (2001) HP ProLiant Essentials Virtual Machine Management Pack (2004) HP ProLiant Sizer for VMware (2005) HP-UX Workload Manager (2000) HP Virtual Server Environment for HP-UX 11i (2003) HP StorageWorks RISS, SFS & EFS Clustered Gateway (2004, 2005) HP NonStop Application Virtualization (2005) Pioneering projects within HP and with customers such as DreamWorks and Amadeus Pioneering packaged complete IT utility solution: HP Utility Data Center (2001)

6 Challenge enterprises have unused server capacity yet still can t meet demand 100 Utilization at an actual HP customer Server Average Utilization Tremendous amount of unutilized capacity Servers Average Utilization Yet these systems are unable to handle the load Most reports put average utilization at approximately 30%

7 Virtualization: Reduce costs, increase agility Virtualization: An approach to IT that pools and shares resources so utilization is optimized and supply automatically meets demand ERP IT current state CRM Silos Web IT future state ERP CRM Web IT Server Storage Network Software Silos Silo IT Costly and rigid Fixed capacity and cost Under-utilized + over-provisioned Complex and difficult to change Pooled + Shared Virtual IT Efficient and agile Dynamic capacity pay-per-use Optimized resources Simplified, secure and flexible

8 HP s Adaptive Infrastructure Delivering on the next-generation data center vision Current state High-cost IT islands Low-cost pooled IT assets Future state Automated 24x7 lights-out computing Key enablers IT Systems & Services Power & Cooling Management Security Virtualization Automation Scalability based on standards IT services and solutions Energy efficient computing Unified Infrastructure Management Proactive best practices and built-in protection Pooling and sharing of IT resources to optimize utilization Dynamic IT re-deployment to meet changing business demand

9 Oracle Grid Computing Model Grid Control Application Servers Databases Storage Oracle s grid computing model employs virtualization to permit sharing of resources among different workloads.

10 Grid fundamentals Using virtualization to solve the silo problem Low-cost standard building blocks Assumption: Entire solution is therefore lowcost Any resource can be deployed easily to any application Virtualization facilitates resource deployment/sharing Assumption: Application peaks not synchronized Resources can be shared among apps Assumption: can accommodate demand by adding building blocks True for loosely coupled clusters (e.g. webservers, appservers) Not necessarily true for tightly coupled clusters (e.g. databases)

11 Scaling in today s data center Scale-up Scale-out Business Critical Servers (Database & Core Business Workloads) Department Application Servers (Workgroups, Applications) Infrastructure Servers (File & print, Web Servers) Edge of Web (Firewalls, Cache, Proxy, VPN) Clients (Rich, Thick, Hybrid, Thin)

12 HP: Scale-out champion! Low-cost, high quality/performance ProLiant servers Blade servers ideally suited for scale-out HP understands RAC Workload suitability consulting Data/workload partitioning to facilitate scaling HA consulting IT staff training Total-cost-of-ownership analysis HP+Oracle grid: HP Reference Architecture for Oracle on HP BladeSystem

13 HP-Oracle Virtualization for Linux HP Reference Architecture for Oracle HP BladeSystem Integrated management console Oracle Application Server Cluster Integrated Ethernet Integrated FC SAN Oracle Real Application Cluster Shared database files

14 HP-Oracle Virtualization for Linux HP Reference Architecture for Oracle HP BladeSystem Integrated management console Oracle Application Server Cluster HP RDP automates installation & configures OS, drivers, & agents on target server(s) Integrated Ethernet Integrated FC SAN Oracle Real Application Cluster Shared database files

15 HP-Oracle Virtualization for Linux HP Reference Architecture for Oracle HP BladeSystem Integrated management console Oracle Application Server Cluster RDP invokes Oracle Grid Control to clone Oracle home(s) to target(s) Integrated Ethernet Integrated FC SAN Oracle Real Application Cluster Shared database files

16 HP-Oracle Virtualization for Linux HP Reference Architecture for Oracle HP BladeSystem Integrated management console Oracle Application Server Cluster Manual or auto process to join new server to cluster and start; Oracle rebalances load automatically. Integrated Ethernet Integrated FC SAN Oracle Real Application Cluster Shared database files

17 HP-Oracle Virtualization for Linux HP Reference Architecture for Oracle HP BladeSystem Integrated management console Oracle Application Server Cluster RDP can allocate more space on shared storage for RAC database, too. Integrated Ethernet Integrated FC SAN Oracle Real Application Cluster Shared database files

18 Sometimes your horse needs more horsepower.

19 HP: Scale-up champion! Integrity servers HP-UX 11i Serviceguard for HA RAC on HP-UX: SGeRAC CFS

20 Oracle & HP??? Scale-up Scale-out Business Critical Servers (Database & Core Business Workloads) Department Application Servers (Workgroups, Applications) Infrastructure Servers (File & print, Web Servers) Edge of Web (Firewalls, Cache, Proxy, VPN) Clients (Rich, Thick, Hybrid, Thin)

21 Scale Up. Scale Out. Scale Right. RAC plays a role across all HP servers Scale Out RAC provides Scaling workload across multiple servers Database Availability Server virtualization for Database Grids HP Integrity rx8640 HP Integrity Superdome HP Integrity rx4640 HP c-class BladeSystem HP Integrity rx2620 Scale Up & Out RAC provides Database Availability Database and server consolidation CPU and memory optimization

22 Virtualization for Databases Can we combine the best of both approaches? Challenge: Avoid Scale-Out Complications Reduce complexity inherent to scale-out growth Avoid scaling issues & eliminate fixes to permit scaling for databases with good data locality Challenge: Incorporate Grid Advantages Sharing resources among various applications Tools to facilitate (re)deployment, (re)provisioning HA features of Oracle clustering Challenge: Incorporate Scale-Up Advantages Excellent scaling for databases with good data locality no fixes! Larger-CPU servers better suited for many applications HA features of HP clustering Solution: Scale up AND out!

23 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle Integrity servers are partitioned into several logical servers, each with its own set of resources Test Environment Inventory Application Real Application Cluster Order Management Service Financial Service

24 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle Test Environment Inventory Application Each workload can only use resources within its own partition Real Application Cluster Order Management Service Financial Service

25 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle Test Environment Inventory Application If a peak in demand leads to overutilization of one or more partitions Order Management Service Financial Service

26 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle HP gwlm automatically flexes partitions to accommodate peak usage needs shrink grow Test Environment Order Management Service Inventory Application Financial Service

27 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle Test Environment Inventory Application If continued heavy usage consumes the maximum partition allowed Order Management Service Financial Service

28 Dynamic Resource Flexing HP VSE Reference Architecture for Oracle Oracle Clusterware starts the service on the standby server and directs new requests to that service Test Environment Order Management Service Inventory Application Order Management Service (2) Financial Service

29 Oracle 10g RAC VSE Reference Architecture VSE Partitioning: npars, vpars, PRM, Control: gwlm, SIM Utility Pricing: TiCAP Availability: Serviceguard, SGeRAC, and SG CFS Platform HP-UX: HP-UX 11i v2 Servers: rx8620, rx5670 Data Connection VSE/gWLM Management Managed Node vpar vpar rx8620 rx5670 Cluster Interconnect Cluster Interconnect Managed Node vpar vpar rx8620 Applications Oracle 10g R2 RAC Test applications: Orabm Database Database XP128 Shared Storage

30 HP VSE Reference Architectures for HP-UX 11i Integrated and pre-tested configurations VSE Partitioning: npars, vpars, PRM Control: WLM, gwlm, SIM Utility Pricing: icap, TiCAP Availability: Serviceguard, SGeRAC, SGeSAP Platform HP-UX: HP-UX 11i v1 and v2 Servers: rp7400, Superdome, rx5670, rx8620 Applications Current: BEA, WebSphere, SAP, SAS, Oracle Testing Interoperation between VSE, platform and applications under realistic load conditions to validate: Consolidation of workloads on single server under various partitioning schemes vpars, npars, PRM, Integrity VM (upcoming) Dynamic allocation of CPUs between workloads during failures and varying loads Automated invocation of utility pricing through activation of CPUs during peak loads

31 VSERA components VSE Virtual Server Environment vpars virtual partitions RAC/Serviceguard stack gwlm Global Workload Manager

32 Operating System support for elements of the HP Virtual Server Environment for HP Integrity and HP 9000 servers HP Virtual Server Environment Intelligent control HP Systems Insight Manager (U,W,L,O) HP Integrity Essentials Capacity Advisor (U) Partitioning npars (U,W,L,O) vpars (U) HP Integrity Virtual Machines (U, W&L 2006, O planned) HP Secure Resource Partitions (U) HP Integrity Essentials Virtualization Manager (U) Virtual servers Availability HP Serviceguard (U,L) HP Serviceguard Storage Management Suite (U) HP Metrocluster (U) HP Continentalclusters (U) HP OpenVMS clusters (O) HP Integrity Essentials Global Workload Manager (U,L,O) HP-UX Workload Manager (U) Utility Pricing HP Instant Capacity (U,W**,L**,O***) HP Temporary Instant Capacity (U,O***) HP Pay Per Use (U,W,O***) HP Global Instant Capacity (U) Legend U HP-UX 11i L Linux W Windows O OpenVMS ** with Integrity Virtual Machines 2006 *** planned with OpenVMS 8.3

33 HP-UX Virtual Partitions (vpars) Flexibility: Multiple independent OSs Dynamic CPU migration 1 CPU granularity Integrates with npartitions and Instant Capacity CPUs Allows app-specific OS tuning Dept. A App 1 HP-UX Revision A.1 Dept. A App 1 HP-UX Revision A.2 Dept. B App 2 HP-UX Revision B.3 Dept. B App 3 HP-UX Revision B.3 Resources not tied to physical configurations vpar Monitor Isolation: Of OS, applications, resources Individual reconfiguration & reboot Easy deployment: Ignite-UX is vpar-aware Easy management: Automatic, SLO-based workload management ACROSS vpars (WLM cross-vpar integration)

34 Virtual Partition and Oracle Service Configuration rx8620 vpar 0 ( 1A ) rx8620 vpar 0 ( 2A ) HR B D D D vpar1 ( 1B ) FA HRDB FGDB HR B D D D vpar1 ( 2B ) GL Each server is partitioned into 2 vpars Each vpar has 4 cores and 16GB RAM SGeRAC cluster #1: 1A and 2A running HRDB (Human Resource) SGeRAC cluster #2: 1B and 2B running FGDB (Financial Analysis & General Ledger) B D D D B D D D B D Boot Processor Dynamic CPU host/ Service HR FA GL 1A preferred N/A N/A 2A preferred N/A N/A 1B N/A preferred available 2B N/A available preferred

35 HP Integrity Essentials Global Workload Manager (gwlm) Manage and automate large, multi-system VSEs Goal-based policy engine For managing workloads across multiple systems simultaneously Easy to use management Integrated with HP Systems Insight Manager and other VSE management tools Enables central IT to deliver an IT utility Supporting multiple LOB Resources can be assigned to LOB based on: Own/borrow/lend model Fixed entitlement model CPU utilization model Service Level Objectives App A App B App C App D Policies New functionality with gwlm 2.0 Support for HP Integrity Virtual Machines and Temporary Instant Capacity Support for OpenVMS Support for HP-UX 11i, Linux, and OpenVMS on HP Integrity, and HP-UX 11i on HP 9000 Monitoring and Reporting App E App F App G App H

36 Global Workload Manager Configuration System (vpar) Policy Name Policy Type PolicyMIN (CPU) Owned (CPU) PolicyMax (CPU) 1A 2A 1B cutst144 cutst171 cutst149 HR1 HR2 FG1 OwnBorrow OwnBorrow OwnBorrow B cutst172 FG2 OwnBorrow 1 2 8

37 Dynamic Flexing CPU Resource Across vpars vpar 0 ( 1A) HR vpar 1 ( 1B ) FA vpar 0 ( 2A ) HR vpar 1 ( 2B ) GL gwlm policy: FA has higher priority than HR HR is guaranteed 2 CPUs HR, and GL have steady load FA workload increases, gwlm moves 2 CPUs from HR (1A) to FA (1B) Host Oracle instance vpar 0 ( 1A) vpar 0 ( 2A ) 1A hrdb1 HR HR 2A 1B hrdb2 fgdb1 vpar 1 ( 1B ) vpar 1 ( 2B ) 2B fgdb2 FA GL

38 Dynamic Flexing CPU Resource Across vpars 1B 1A

39 Dynamic Scale-out with HP VSE and Oracle RAC vpar 0 ( 1A) HR vpar 1 ( 1B ) FA vpar 0 ( 1A) HR vpar 1 ( 1B ) vpar 0 ( 2A ) HR vpar 1 ( 2B ) GL vpar 0 ( 2A ) HR vpar 1 ( 2B ) FA load continues to increase, the complex has no more CPU available to meet the SLO of FA A script monitoring gwlm event invokes Oracle Cluster Service using the srvctl utility to change the state of FA on 2B from available to preferred Any new connections to FA are now load balanced by Oracle service between the FA service instances on 1B and 2B gwlm moves 1 CPU from HR (2A) to FA (2B) to meet the SLO of FA FA FA GL

40 Dynamic Scale-out with HP VSE and Oracle RAC vpar 0 (cutst144) HR vpar 1 (cutst149) FA vpar 0 (cutst144) HR vpar 1 (cutst149) vpar 0 (cutst171) HR vpar 1 (cutst172) GL vpar 0 (cutst171) HR vpar 1 (cutst172) FA load continues to increase, the complex has no more CPU available to meet the SLO of FA A script monitoring gwlm event invokes Oracle Cluster Service using the srvctl utility to change the state of FA on cutst172 from available to preferred Any new connections to FA are now load balanced by Oracle service between the FA service instances on cutst149 and cutst172 gwlm moves 1 CPU from HR (cutst171) to FA (cutst172) to meet the SLO of FA FA FA GL

41 Dynamic Scale-out with HP VSE and Oracle RAC 1B 2B

42 Dynamic Scale-back with HP VSE and Oracle RAC vpar 0 ( 1A) HR vpar 1 ( 1B ) FA vpar 0 ( 2A ) HR vpar 1 ( 2B ) FA GL When the FA workload decreases, gwlm returns those borrowed CPUs back to HR The monitoring script invokes srvctl to change the state of FA service on 2B from preferred back to available At this point, any new connection for FA will connect to 1B only vpar 0 ( 1A) HR vpar 0 ( 2A ) HR vpar 1 ( 1B ) HR vpar 1 ( 2B ) GL

43 Dynamic Scale-back with HP VSE and Oracle RAC 1B 2B

44 HP Integrity Essentials Capacity Advisor Experiment with different scenarios Fully integrated with VSE technologies to simulate major configuration changes before implementation Easier to use and more accurate Designed for on-going use by general server administrators Uses historic data of actual usage Determines ideal amount of resources needed for: Existing workloads Planned migrations New workloads Recommends placement of workloads such that Each workload has sufficient resources Over-capacity is minimized Support for HP-UX 11i, Windows, and Linux on HP Integrity, and HP-UX 11i on HP 9000

45 HP Integrity Essentials Capacity Advisor The new math: 8+8 = 12 8 CPU Peak Peaks for different workloads do not all happen at the same time. 12 CPU Peak + = 8 CPU Peak Two workloads each have an 8 CPU peak demand but the peak of their sum is 12 CPUs.

46 HP VSE resources Websites: HP VSE HP VSERA Resources for HP Integrity VM and Serviceguard Using Serviceguard to Manage Integrity Virtual Machines white paper Designing High availability Solutions with Serviceguard & Integrity VM white paper On software.hp.com HP SG for Integrity VM Toolkit, for free download; "part number = SGHPVMTOOL (also available on Integrity VM 2.0 DVD fall 2006) Solution Demo Portal - many VSE demos (recorded demos, live demo scheduler and some VSERA demos) on the site. (After choosing your language, navigate to IT Solutions and choose Infrastructure Solutions, Virtualization, then Virtual Server Environment.)

47 Conclusions Virtualization & automation are important to both HP & Oracle HP, Oracle closely aligned virtualization strategies HP provides added-value solutions for Oracle by automation technologies to enable Virtualization

48 Hp logo black on white