Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitme

Transcription

1 VIRT1052BE Extreme Performance Series: Monster VM Database Performance Todd Muirhead, VMware David Morse, VMware #VMworld #VIRT1052BE

2 Disclaimer This presentation may contain product features that are currently under development. This overview of new technology represents no commitment from VMware to deliver these features in any generally available product. Features are subject to change, and must not be included in contracts, purchase orders, or sales agreements of any kind. Technical feasibility and market demand will affect final delivery. Pricing and packaging for any new technologies or features discussed or presented have not been determined. #VIRT1052BE CONFIDENTIAL 2

3 Extreme Performance Series: Monster VM Database Performance Todd Muirhead, VMware David Morse, VMware

4 Outline Monster Database VMs Capability / Scalability / Performance Oracle and SQL Server Generational Performance (Westmere-EX to Skylake-SP) Performance Impact of Hyper-Threading, NUMA, VMFS vs RAW Best Practices Compute Memory Storage Network Key Takeaways #VIRT1052BE CONFIDENTIAL 4

5 Monster Database VM Testing Overview

6 Sockets, Cores, Logical Processors Processor counts continue to increase with each generation Hyper-Threading doubles the number of Logical Processors, but doesn't double performance When sizing your VMs, CPU Cores is the most relevant value Hyper-Threading typically provides 15-20% more performance #VIRT1052BE CONFIDENTIAL 6

7 Know Your NUMA Right-Size VMs to your Host Architecture NUMA = Non-Uniform Memory Access Physical hosts are divided into NUMA nodes = 1 CPU and its local memory NUMA layout for a typical 4-socket Intel server: NUMA allows CPUs to access local memory faster than non-local (remote) memory If possible, right-size VMs (vcpu and vmem) to fit your underlying host architecture Example: for a host with 4 CPUs, 1 TB of RAM, each NUMA node = 1 CPU and 256 GB RAM or distribution For Monster VMs, ESXi automatically creates virtual NUMA nodes for the VM and spans physical NUMA nodes #VIRT1052BE CONFIDENTIAL 7

8 Monster VM Host Servers Intel 4-P Codename/Date Westmere-EX (2011) Ivy-Bridge-EX (2014) Haswell-EX (2015) Broadwell-EX (2016) Skylake-SP (2017) 8 #VIRT1052BE CONFIDENTIAL

9 High Speed Storage IBM FlashSystem A9000 Highly Parallel Architecture Easy to Integrate with VMware vsphere Based on high performance IBM MicroLatency modules Inline deduplication and compression Easy to configure storage while still getting best performance possible Easily handled all Monster DB testing maintaining low latency for all IO of ~ 1 ms VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 9

10 Testing Configuration Storage Array IBM FlashSystem A9000 Fibre Channel Ethernet or Driver Server 2 socket VMware vsphere 6.5 distribution Westmere-EX Server Xeon E VMware vsphere 6.0 IvyBridge-EX Server Xeon E v2 VMware vsphere 6.5 Haswell/Broadwell-EX Servers Xeon E v3, v4 VMware vsphere 6.5 Skylake-SP Server Xeon Platinum 8180 VMware vsphere 6.5 #VIRT1052BE CONFIDENTIAL 10

11 DVD Store 3 Test workload was open source DVD Store 3 (github.com/dvdstore/ds3) OLTP workload simulating online store selling DVDs Utilizes many database features including stored procedures, transactions, triggers, foreign keys, and full-text indexes New version 3 includes customer reviews with intelligent review rankings Measured in terms of Orders Per Minute Each order is made up of a series of steps login, browse for products, browse reviews, purchase products VMworld 2017 Supports Oracle, SQL Server, and MySQL Workload was run at increasing levels of load to find the highest performing test configuration New and more complex queries make results not comparable with previous DVD Store versions Content: Not for publication #VIRT1052BE CONFIDENTIAL 11

12 Oracle Performance

13 Oracle Testing Overview Virtual Machine Configuration Oracle 12c Redhat Enterprise Linux GB RAM pvscsi Vmxnet3 Virtual CPU / VM counts Lots of different configurations based on hardware (Total Physical Processors / Cores / Threads) #VIRT1052BE CONFIDENTIAL 13

14 Cool esxtop Screenshot #VIRT1052BE CONFIDENTIAL 14

15 Relative Orders Per Minute (OPM) Virtual Performance Grows with Hardware Performance Increases Generational Monster Oracle DB VM Performance 0 Westmere 40 vcpu VM Ivy-Bridge 60 vcpu VM Haswell 72 vcpu VM Broadwell 96 vcpu VM Skylake 112 vcpu VM #VIRT1052BU CONFIDENTIAL 15

16 Hyper-Threading Performance gain of 11% Relative Orders Per Minute (OPM) Relative Orders Per Minute (OPM) Performance Gain Using Hyper-Threads on 4- Performance Gain Using Hyper-Threads on Socket Intel Broadwell Server 4-Socket Intel Broadwell Server x 96 vcpu VM 2 x 96 vcpu VMs 1 x 96 vcpu VM 2 x 96 vcpu VMs #VIRT1052BU CONFIDENTIAL 16

17 40 vcpu VM on Broadwell-EX performs 50% better than on Westmere-EX* Orders Per Minute (OPM) *with room left over for another 40vCPU VM 40vCPU VM Monster DB VM Performance 98% Host CPU Util Increase in Capacity 42% Host CPU Util ESXi Host %CPU Util Westmere-EX 40vCPUs Broadwell-EX 40vCPUs 0 #VIRT1052BU CONFIDENTIAL 17

18 SQL Server Performance

19 SQL Server Testing Overview Virtual Machine Configuration SQL Server 2014, 2016 Windows Server 2012 R2 256GB RAM pvscsi Vmxnet3 Lots of different configurations based on hardware (Total Physical Processors / Cores / Threads) VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 19

20 Orders Per Minute (OPM) Generational Monster VM SQL Server Performance Skylake-SP achieved over 4X performance (OPM) vs. Westmere-EX based system 180, , , , ,000 80,000 60,000 40,000 20,000 38,482 70,869 95, , ,287 0 Westmere-EX 4 x E Physical Cores/vCPUs IvyBridge-EX 4 x E v2 60 Physical Cores/vCPUs Haswell-EX 4 x E v3 72 Physical Cores/vCPUs Broadwell-EX 4 x E v4 96 Physical Cores/vCPUs Skylake SP 4 x Xeon Platinum Physical Cores/vCPUs #VIRT1052BE CONFIDENTIAL 20

21 Performance Per Watt Performance is also more efficient with newer servers with higher OPM/watt #VIRT1052BE CONFIDENTIAL 21

22 VMFS vs RDM on SQL Server 2016 Performance of VMFS and RDM were only about 1% different #VIRT1052BE CONFIDENTIAL 22

23 SQL Server on Linux

24 SQL Server on Linux Microsoft is brining SQL Server to the Linux platform. Currently in technical preview. Worked with Microsoft on some tests to validate the performance on vsphere 6.5 Test Workload Cloud Database Benchmark was provided by Microsoft Transactional workload, output measured in terms of Transactions Per Second (TPS) Test database size was 1.5TB Test system was Broadwell-EX based server with 96 cores (24 cores per socket). Virtual Machine was configured for the test: 512 GB of RAM RHEL 7.2 Current build of SQL Server for Linux as of July 2017 #VIRT1052BE CONFIDENTIAL 24

25 Cool CDB / Matrix Screenshot #VIRT1052BE CONFIDENTIAL 25

26 SQL Server for Linux Monster VM Test Results Transactions Per Sceond (TPS) SQL Server for Linux Monster VM Scaling on vsphere 6.5 with CDB Workload or distribution 0 24 vcpus 48 vcpus 72 vcpus 96 vcpus Gain from 24 vcpu VM to a 96 vcpu VM was good with 3.2x scaling #VIRT1052BE CONFIDENTIAL 26

27 Monster Database VM Best Practices

28 CPU Best Practices First, size the CPU resources a VM needs then look at NUMA node sizes Monster DB VMs that need to span NUMA nodes (aka wide VMs) perform great, so if you need more vcpus than what one socket provides, increase it! If you don t need that much CPU, then it can be more efficient to keep things within a NUMA node Run monster DB VMs on newest servers for best performance Do not pin VMs (CPU affinity) Enable Hyper-Threading (usually BIOS default) Leave Latency Sensitivity at default value of Normal VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 28

29 Memory Best Practices Use large memory pages Virtual databases benefit from large pages more than most applications due to memory usage patterns Set memory reservation Equal to Oracle SGA / SQL Server active memory Size VM memory based on NUMA node memory size #VIRT1052BE CONFIDENTIAL 29

30 Storage Best Practices Configure storage carefully and properly Monster database VM is going to need dedicated storage LUNs Check to make sure the number of disks, type of disks, and RAID type are right Work with the storage administrator closely on storage configuration Use flash or SSDs if possible - IBM FlashSystem in our tests Virtual SCSI adapters should always be paravirtual SCSI (pvscsi) If using iscsi or NFS based storage, enable jumbo frames VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 30

31 Oracle Monster VM Best Practices Use Oracle Best Practices within the VM Use Oracle installer RPM to prep the VM with their best practices Evaluate the use of NUMA before enabling (Default is off) Use Linux Hugepages (sometimes called large pages) Enable at the OS level Oracle memory management parameters Enable virtual NUMA for the VM if it is wide Even though Oracle is not using NUMA, performance was still better with vnuma than without Refer to Oracle Databases on VMware Best Practices Guide for more information #VIRT1052BE CONFIDENTIAL 31

32 SQL Server Monster VM Best Practices SQL Server is largely auto-tuning; newer releases better utilize NUMA It Just Runs Faster Apply SQL Server 2016 and SQL Server internally leverages SOFT NUMA partitioning to achieve double digit performance gains. Source: However, some tuning is still advisable; here are a couple of bookmark-worthy resources: 5 SQL Server Settings to Change: Microsoft SQL Server on VMware vsphere Best Practices Guide: VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 32

33 SQL Server Monster VM Best Practices Ensure your SQL Server license allows for the scale you need Web/Express/Standard have limitations vs. Developer/Enterprise Editions: Source: #VIRT1052BE CONFIDENTIAL 33

34 SQL Server Monster VM Best Practices Right-sizing your monster SQL VMs is critical ESXi multi-cpu VMs are single-core by default (1 core/socket) Windows Server 2012 supports up to 64 sockets and 640 logical processors Therefore, you must increase cores per socket to go above 64 vcpu Example: For a 96-core physical host (4 sockets, 24 cores/socket), size the VM appropriately #VIRT1052BE CONFIDENTIAL 34

35 Key Takeaways Upgrading to the latest hardware can provide big performance gains Low Latency of IBM FlashSystem enabled great performance Monster Database VMs are capable for all workloads Using best practices will ensure best performance Understanding how to monitor and troubleshoot performance #VIRT1052BE CONFIDENTIAL 35

36 Extreme Performance Series Barcelona SER2724BE Performance Best Practices SER2343BE vsphere Compute & Memory Schedulers SER1504BE vcenter Performance Deep Dive SER2849BE Predictive DRS Performance & Best Practices VIRT1445BE Fast Virtualized Hadoop and Spark on All-Flash Disks VMworld 2017 VIRT1397BE Optimize & Increase Performance Using VMware NSX VIRT1052BE Monster VM Database Performance FUT2020BE Wringing Max Perf from vsphere for Extremely Demanding Workloads Content: Not for publication #VIRT1052BE CONFIDENTIAL 37

37 Extreme Performance Series Hand on Labs Don t miss these popular Extreme Performance labs: HOL SDC: vsphere 6.5 Performance Diagnostics & Benchmarking Each module dives deep into vsphere performance best practices, diagnostics, and optimizations using various interfaces and benchmarking tools HOL CHG: vsphere Challenge Lab Each module places you in a different fictional scenario to fix common vsphere operational and performance problems #VIRT1052BE CONFIDENTIAL 38

38 Performance Survey The VMware Performance Engineering team is always looking for feedback about your experience with the performance of our products, our various tools, interfaces and where we can improve. Scan this QR code to access a short survey and provide us direct feedback. Alternatively: Thank you! VMworld 2017 Content: Not for publication #VIRT1052BE CONFIDENTIAL 39

39 Q & A

40

41