Managing Database Performance Within Virtual Environments. Walter Guerrero, Sr. Software Engineer

Managing Database Performance Within Virtual Environments Walter Guerrero, Sr. Software Engineer

Terms of This Presentation This presentation was based on current information and resource allocations as of October 2009 and is subject to change or withdrawal by CA at any time without notice. Notwithstanding anything in this presentation to the contrary, this presentation shall not serve to (i) affect the rights and/or obligations of CA or its licensees under any existing or future written license agreement or services agreement relating to any CA software product; or (ii) amend any product documentation or specifications for any CA software product. The development, release and timing of any features or functionality described in this presentation remain at CA s sole discretion. Notwithstanding anything in this presentation to the contrary, upon the general availability of any future CA product release referenced in this presentation, CA will make such release available (i) for sale to new licensees of such product; and (ii) to existing licensees of such product on a when and if-available basis as part of CA maintenance and support, and in the form of a regularly scheduled major product release. Such releases may be made available to current licensees of such product who are current subscribers to CA maintenance and support on a when and if-available basis. In the event of a conflict between the terms of this paragraph and any other information contained in this presentation, the terms of this paragraph shall govern. 2 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

For Informational Purposes Only Certain information in this presentation may outline CA s general product direction. All information in this presentation is for your informational purposes only and may not be incorporated into any contract. CA assumes no responsibility for the accuracy or completeness of the information. To the extent permitted by applicable law, CA provides this document as is without warranty of any kind, including without limitation, any implied warranties or merchantability, fitness for a particular purpose, or noninfringement. In no event will CA be liable for any loss or damage, direct or indirect, from the use of this document, including, without limitation, lost profits, lost investment, business interruption, goodwill, or lost data, even if CA is expressly advised of the possibility of such damages. 3 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Abstract Managing database performance in virtual environments can be challenging when different database performance products are being used for Oracle, SQL Server, DB2 for LUW, and Sybase. CA can help. CA Insight DPM will allow you to proactively manage the performance of your virtualized databases as well as the VMware virtual center repository. This presentation discusses CA s current solutions and practices for managing virtualized databases as well as our vision and roadmap for virtualized environments. 4 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

The Database Performance Challenge > Before virtualization What is happening to my database and why??? > After virtualization What is happening to my database and why??? > Managing database performance Virtual vs Physical Same concerns, different world Need visibility to key performance metrics Need end-to-end visibility of DB health Need alerting with visibility across silos Need to detect dynamic changes Need flexibility 5 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

CA Database Performance Management > Manage physical, virtual and cloud environments View performance metrics of VM, physical server and database metrics in a single display Support for VMware, Sun Solaris Zones, IBM LPARs, Citrix Xen and Hyper-V environments Manage VMware vcenter repository > Improve service availability and performance with faster time to resolution > Integrate event & performance management across technology domains to indentify the root cause of problems 6 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

VMware vcenter Repository Vital Component To Be Managed > Holds inventory Host and virtual machine details > Holds alarms and Events Data stored for event and each alarm triggered in the system > Holds performance statistics Makes up the majority of the vcenter database size and processing: up to 90% of VMware Performance statistics inserted (every five minutes) Performance statistics rollup stored procedures > Ad-doc queries against can present problems Unexpected workload Blocking / locking Increased database reads and writes in active systems 7 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter Repository Workload and Maintenance > VPXD roll up opportunity to monitor and notify when realtime five minute performance statistics are not able to be archived to historical in the database > Stored procedures opportunity to monitor and notify when scheduled jobs in SQL Server every thirty minutes, two hours and twenty-four hours do not complete Increased CPU utilization at these time intervals is normal > Fragmentation in the vcenter database occurs mostly as a result of statistics updates and rollup Four database tables for storing historical performance data vpx_hist_stat1, vpx_hist_stat2, vpx_hist_stat3, vpx_hist_stat4 Each of these tables has its own clustered index Opportunity to defragmentation and reindex 8 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter Repository Storage Growth Expectations > Size of database dependent on number of hosts & VMs managed, frequency of data collection and type of database SQL Server - each stat collected 60 bytes, event stored 1600 bytes, Oracle - each stat collected 100 bytes event stored 600 bytes Using default settings, data for 2 hosts running 8-16 VMs per host approx 60 to 140 MB year. Each month, average number of events generated will also consume about 190 MB in SQL Server, and 70 MB in Oracle Total database size after a year ~2.20 GB SQL Server, 1.0 GB Oracle Using default settings, data for 75 hosts running 8-16 VMs per host approx 150 to 330 MB year. Each month, average number of events generated will also consume about 190 MB in SQL Server, and 70 MB in Oracle Total database size after a year ~2.40 GB SQL Server, 1.2 GB Oracle 9 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter Repository SQL Server Key Performance Indicators > Memory Buffer cache hit ratio: Should be high 90s or database is spending too much time waiting to retrieve data from the disk drives. Opportunity to monitor and notify when database does not have enough memory to cache working data set Increase the amount of memory allocated to SQL Server > Page Reads/sec Page Writes/sec Page Requests/sec. > Page lookups/sec Number of database pages requested by SQL Server. > Processor High numbers can sometimes signify that data is not properly indexed or that the query optimizer is not using the most efficient index. %Processor Time Percentage of time that the CPU is busy. If consistently over 80 percent, you might be bottlenecked by CPU. > PhysicalDisk Current Disk Queue Length The number of outstanding disk I/Os at the time the time the data is collected. If this number is consistently greater than two, your database might be bottlenecked by disk I/O. Disk Writes/sec Number of disk writes per second. Important counter for transaction log disk monitoring to ensure that transaction log writes are not bottlenecking your system. > Disk I/O monitor and notify when disk device bandwidth for log devices bottlenecks on disk I/O and impacts/prevents transactions 10 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter Repository Key Performance Indicators > Locks Lock Waits/sec Number of times a lock request cannot be granted immediately. Monitor this along with the Lock Wait Time counter. Lock Wait Time (ms) Number of milliseconds in the last second that a SQL Server process is blocked waiting for a lock. SQL Server uses > Latches Latch Waits/sec Number of times a latch request cannot be granted immediately. Monitor this along with the Latch Wait Time counter. Latch Wait Time (ms) Number of milliseconds in the last second that a SQL Server process is blocked waiting for a latch. Latches are lighter weight than locks and should have much shorter, if any, wait times. 11 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Managing Databases in VMware & vcenter Server Database Health Sent to CA ehealth PM CA ehealth PM Server DBMS VM VM VM VM ESX Insight Knowledge Agents CA ehealth PM View Insight Knowledge Agent DBM S DBMS VM VM VM VM ESX Insight Knowledge Agents vcenter Server w/repository CA Spectrum IM View CA Spectrum IM Server DBMS VM VM VM VM ESX Insight Knowledge Agents Database Health Sent to CA Spectrum IM 12 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

End-to-End Service Assurance Performance Metrics VM Level Performance metrics can be displayed at either the database level or the VM level 13 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

End-to-End Service Assurance vcenter Server - Manage and Alert Monitor and alert on the VC database performance 14 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

End-to-End Service Assurance Integration with CA ehealth PM gives visibility without asking a DBA Robust metrics and alerting for managing database performance 15 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Architecture CA Insight DPM Benefits > Flexible Manage performance for both physical & virtual environments Local agent based or remote monitoring Same agent integrates across CA ehealth PM, CA Spectrum IM, CA Wily Introscope, and CA Spectrum SA (when GA) > Dynamic Automatically detects and monitors New processes Changes to virtual CPUs New storage (SAN, NAS) Changes to memory Multi-threshold alarms on same condition > Customizable and extensible User defined functions for custom scanning 16 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Architecture CA Insight DPM Robust > Excellent visibility on performance 1500 different metrics CPU Database Physical and Logical IO Storage level physical and logical Memory Locks Database Objects Space, Fragmentation, Usage SQL Services 17 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Potential CA Defined SQL For vcenter Environment > Opportunity to monitor/notify when host exceeds 20 or VM exceeds 200 to use separate disks To ensure performance in 20+ host or 200+ virtual machine environments, VMware recommends SQL Server and vcenter Server be installed on separate physical disk drives > Opportunity to notify on failed authentication attempts into Virtual Center select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT where EVENT_TYPE = vim.event.badusernamesessionevent > Opportunity to notify on successful authentication attempts into Virtual Center select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT where EVENT_TYPE = vim.event.userloginsessionevent 18 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Potential CA Defined SQL For vcenter Environment Cont'd > Opportunity to monitor/notify when host exceeds 20 or VM exceeds 200 to use separate disks To ensure performance in 20+ host or 200+ virtual machine environments, VMware recommends SQL Server and vcenter Server be installed on separate physical disk drives > Opportunity to notify on failed authentication attempts into Virtual Center select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT where EVENT_TYPE = vim.event.badusernamesessionevent > Opportunity to notify on successful authentication attempts into Virtual Center select EVENT_TYPE, USERNAME, CREATE_TIME, HOST_NAME from VPX_EVENT where EVENT_TYPE = vim.event.userloginsessionevent > Opportunity to monitor for databases that have been vmotioned (moved) Rogue or to just be notified > Opportunity to monitor and track databases for licensing compliance Oracle is the primary one as they charge for the full environment versus what is actually used 19 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter Repository Database Views Reference > vpxv_farmgroups > vpxv_vmgroups > vpxv_entity > vpxv_hosts > vpxv_vm > vpxv_templates > vpxv_tasks > vpxv_alarms > vpxv_host_datastore > vpxv_vm_datastore > vpxv_host_network > vpxv_vm_network > vpxv_compute_resource_network > vpxv_fields > vpxv_host_fields > vpxv_vm_fields > vpxv_perf_intervals > vpxv_perf_host_counters 20 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

vcenter SQL Server Plugin Key Performance Indicators > Default Instance Buffer Cache Hit Ratio > Default Free Pages > Default Instance Free Pages > Named Instance Working Set > Named Instance Buffer Cache Hit Ratio > Named Instance Free Pages > Named Instance Total Server Memory 21 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

VMware Repository Metrics to Hardware Recommendation Sample Size CPU Cores SQL Server Memory Log Device I/Os per second 40K 1 1GB < 130 40K 80K 2 2GB 120-200 80K 120K 4 4GB 200-300 120K 160K 4 6GB 400-500 160K 200K 5 8GB 500-600 > 200K 8 12GB 650 22 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

DB Performance Prior to VM Migration Using vmotion View of the CA Insight DPM workspace prior to vmotion View of MS SQL Server 2005 workspace prior to vmotion 23 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

CA ehealth PM At-a-Glance Report Prior to VM Migration Using vmotion CA ehealth PM At A Glance report of MS SQL Server 2005 prior VM migration using vmotion 24 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

VMware Migration using vmotion VM migration utilizing vmotion technology VM migration complete utilizing vmotion 25 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

CA Insight DPM After VM Migration using vmotion CA Insight DPM workspace after the VM migration event utilizing vmotion CA Insight DPM SQL Server 2005 workspace after VM migration event utilizing vmotion 29 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

CA ehealth PM At-a-Glance Report After VM Migration Using vmotion CA ehealth PM At A Glance report of MS SQL Server 2005 after VM migration using vmotion 30 October 12, 2009 Managing Database Performance Within Virtual Environments Copyright 2009 CA

Demonstration

Thank You!