Performance comparison of Cloud vendors Tobias Deml Consultant @TobiasDemlDBA DOAG2017
About Consultant, Trivadis GmbH, Munich Since more than 9 years working in Oracle environment Focus areas Cloud Computing Performance Tuning High Availability Delegate at DOAG 2 14.11.17
Our company. Trivadis is a market leader in IT consulting, system integration, solution engineering and the provision of IT services focusing on and technologies in Switzerland, Germany, Austria and Denmark. We offer our services in the following strategic business fields: O P E R A T I O N Trivadis Services takes over the interacting operation of your IT systems. 3 14.11.17 Trivadis DOAG17: presentation title
With over 600 specialists and IT experts in your region. COPENHAGEN HAMBURG 14 Trivadis branches and more than 600 employees 200 Service Level Agreements Over 4,000 training participants DÜSSELDORF Research and development budget: CHF 5.0 million FRANKFURT Financially self-supporting and sustainably profitable BASEL FREIBURG STUTTGART BRUGG ZURICH MUNICH VIENNA Experience from more than 1,900 projects per year at over 800 customers GENEVA BERN LAUSANNE 4 14.11.17 Trivadis DOAG17: presentation title
Agenda 1. Introduction 2. Test environments and measuring methods 3. Results 4. Conclusion 5 14.11.17
Introduction IaaS vendors 6 14.11.17
Test environments and measuring methods 7 14.11.17
Defining the test environments Choosing a comparable shape which could be reproduced at every vendor is able to deliver a respectable performance Oracle Database for performance measuring Resulting shape 4 CPU Threads 15 GB Memory 3 Mount points (DATA, REDO, FRA) 8 14.11.17
Microsoft Azure Shape D4s_v3 4 vcpus Intel XEON E5-2673 v3 16 GB RAM 32 GB SSD Standard Storage (HDD) Shape DS3_v2 4 vcpus Intel XEON E5-2673 v4 14 GB RAM 28 GB SSD Premium Storage (SSD) 9 14.11.17
Amazon Web Services Shape m3.xlarge 4 vcpus Intel Xeon E5-2670 v2 16 GB RAM 30 GB SSD 2.500 IOPS (Provisioned SSDs) Shape m4.xlarge 4 vcpus Intel Xeon E5-2676 v3 16 GB RAM 30 GB SSD 2.500 IOPS (Provisioned SSDs) 10 14.11.17
Oracle IaaS Cloud Shape OC4 2 OCPUs 15 GB RAM 50GB SSD Storage (Standard) 70.000 IOPS 11 14.11.17
Oracle Database setup Oracle Database Enterprise Edition 12.2.0.1 SGA_TARGET = 9GB, PGA_AGGREGATE_TARGET = 1GB FILESYSTEMIO_OPTIONS = SETALL 30 GB SMALLFILE Tablespace 12 14.11.17
Trivadis CPU benchmark Measuring the compute capability of database environments Dissected in different workload types PL/SQL computing SUM operations SQL-Joins Results a abstract and comparable CPU speed factor 13 14.11.17
CALIBRATE_IO Standardized package for IO calibration Performs synthetic workload Results are abstract and not applicable to real workload Ideal for comparing different environments 14 14.11.17
Storage performance testing with SLOB Command line based load testing tool simulating near-real workload Developed and maintained by Kevin Closson Default setting Different test runs with raising parallelism (1 à 8) 15 14.11.17
Results 16 14.11.17
CPU performance benchmark price/performance 3,00 better CPU factor 2,50 2,00 1,50 worse Azure D4_v3 Azure DS4_v2 AWS m3.xl AWS m4.xl Oracle 1,00 0,000 0,050 0,100 0,150 0,200 0,250 Price per hour ($) 17 14.11.17
CALIBRATE_IO Latency 9 8 7 Latency in ms 6 4 5 2 0 Azure Standard Azure Premium AWS Oracle 0 18 14.11.17
CALIBRATE_IO Throughput 1500 1250 1153 Throughput in MB/s 1000 750 500 448 324 250 124 0 Azure Standard Azure Premium AWS Oracle 19 14.11.17
SLOB Latency of db file sequential read 60 50 Latency in ms 40 30 20 10 0 1 2 4 8 Degree of Parallelism Azure Standard Azure Premium AWS Oracle 20 14.11.17
20 SLOB Latency of db file sequential read 15 13,1 Latency in ms 10 6,8 5,8 8,2 5 0 3,1 2,2 1,6 1,2 0,3 0,3 0,4 1 2 4 8 Degree of Parallelism Azure Standard Azure Premium AWS Oracle 21 14.11.17
Oracle Bare Metal Cloud Service 22 14.11.17
Oracle Bare Metal Cloud Service Services will be provisioned on dedicated hardware Avoiding the Noisy neighbors problem Dedicated and local NVMe-based SSD storage NVMe = Non-Volatile Memory Express new standard for PCI Express based flash drives Theoretical Throughput of 16 GB/s Splitting the workload 23 14.11.17
AHCI <> NVMe - Command Queueing AHCI NVMe 1 Queue 32 Commands Maximum of 32 command entries 65,535 Queues 65,535 Commands/Q Maximum of 4.3 Billion command entries 24 14.11.17
Evolution of IO performance Solid State Disks - IOPS: 40,000 - Latency: 1-3 ms NVMe SSDs - IOPS: 400,000 - Latency: 2 40 us Hard Disk Drives - IOPS: 500 - Latency: 3-8ms 25 14.11.17
Conclusion 26 14.11.17
Conclusion There is a wide variety of different performance shapes Regarding CPU the capabilities are similar but there are noticeable differences which can chance very frequent IO capabilities are key for achieving needed performance goal Huge differences in delivered IOPS Pain point is the latency (!) Validation and Testing are the keys to success 27 14.11.17
Cloud is not the target, Cloud could be the means to achieve a goal or solve a problem. 28 14.11.17
Additional information https://cloud.oracle.com https://azure.microsoft.com https://aws.amazon.com Oracle Cloud Microsoft Azure Amazon Web Services 29 14.11.17
Any Question? Tobias Deml Consultant Tel. +49 89 992 759 324 Tobias.Deml@trivadis.com @TobiasDemlDBA 30 14.11.17
Trivadis @ DOAG 2017 #opencompany Booth: 3rd Floor next to the escalator We share our Know how! Just come across, Live-Presentations and documents archive T-Shirts, Contest and much more We look forward to your visit 31 14.11.17 Trivadis DOAG17: presentation title