Design and Architecture of Dell Acceleration Appliances for Database (DAAD): A Practical Approach with High Availability Guaranteed Kai Yu, Yuxiang Gao Dell Global Solutions Engineering Group Peng Zhang, Stony Brook University Meikang Qiu, Pace University
Agenda Database as a Service (DBaaS) Cloud Model Existing Solutions High Performance HA Storage Solutions Dell Accelerations Appliances for Database (DAAD) Experimental Evaluation: Performance Benchmarks Conclusions and Next Version of DAAD
About Authors Kai Yu, Senior Principal Engineer, Dell Enterprise Solutions Engineering 20 years Database and Infrastructure Solutions Engineering, Oracle ACE Director. Over 140 conference presentations and whitepapers, 2 US Patents 2012 Oracle Excellence Award: Technologist of the Year: Cloud Architect by Oracle Magazine, OAUG Innovator of Year; Co-author Apress Book Expert Oracle RAC 12c My Oracle Blog: http://kyuoracleblog.wordpress.com/ Yuxiang Gao, Senior HPC Consultant, Dell Enterprise Solutions Engineering (until 2014) PhD degree in Applied Mathematics from Stony Brook University Focuses on accelerator-based cluster design and performance analysis
About Authors Peng Zhang, senior research associate, Stony Brook University PhD degree in Applied Mathematics from Stony Brook University Working on the multidisciplinary programs for simulating complex biological systems on modern high performance computing (HPC) Focuses on optimizing large-scale parallel applications on modern HPC systems, for offering computationally affordable solutions. Meikang Qiu, Associate Professor of Computer Science at Pace University PhD degree of computer science from University of Texas at Dallas ACM Senior member, Senior Member of the IEEE. Research interests include cyber security, embedded systems, cloud computing, smart grid, microprocessor, data analytics Published 3 books, 170þ peer-reviewed journal and conference papers (including 70 journal articles, 100 conference papers), and 3 patents Won Naval Summer Faculty Award in 2012 and Air Force Summer Faculty Award in 2009; ACM Transactions on Design Automation of Electrical Systems (TODAES) 2011 Best Paper Award; won another 4 Conference Best Paper Awards (IEEE/ACM ICESS 12, IEEE GreenCom 10, IEEE EUC 10, IEEE CSE 09)
Database as a Service Cloud Model Database as a Service cloud model Consolidate multiples databases : multitenant architecture Provide Database as a Service (DBaaS)/ Platform as a Service (PaaS) Great benefits: Reduce cost by maximizing the utilization of system resources Allow to provisioning on demand: dynamically provisioning to meet the workload needs
Database as a Service Cloud Model Infrastructure Challenges on DBaaS High Availability Requirement Great business impact caused by infrastructure downtime Different service level(sla) for different business Highly scalable architecture to meet the performance requirements Handle the workloads from multiple databases Bottlenecks from processor, memory, network, storage Storage frequently presents critical database performance bottlenecks Processor, memory and network performance improved significantly Storage performance bottlenecks Database workloads usually requires very high IO requirements throughputs( IOPs, MB/s), IO latency. Hard disk performance limited by mechanical speed. As results, Processor, memory and network resources underutilized Software license also underutilized (usually linked to # of processors)
Existing Solutions Oracle Real Application Clusters: active-active cluster database Based on share everything clustering architecture Protect database availability against up to N-1 server failure Reduce planned downtime for hardware, OS, software upgrade Add node or remove node based on demand of capacity Application load balancing Provide high availability and scalability architecture Require shared storage to store database files. Require high speed interconnect network across database nodes User connections Node1 Node2 Node3 RAC Instance1 RAC Instance2 RAC Instance3 Cluster Interconnect RAC Database
Existing Solutions HA Storage Solutions Redundancy Array of Inexpensive Disks (RAID) to ensure storage HA Network-Attached Storage (NAS) and Storage Area Network (SAN) Multiple IO paths Redundant Network Switches Redundant storage Controllers R Re Redundant Backend cables D Disk Array RAID configuration Perform Performance bottlenecks
High Performance HA Storage Solutions Flash based SSD for low latency and high IOPs Store data in flash base PCIe SSDs that are plugged into PCI backplane Dell Express Flash PCIe SSD SanDisk iomemory Card Non Volatile Memory Express (NVM Express) Dell Acceleration Appliances for Database (DAAD) based on iomemory
Dell Acceleration Appliances for Database (DAAD) High Availability enabled DAAD A HA cluster with Two DAAD nodes: 40 Gb point-to-point network between two DAAD nodes Volume configuration for storage high availability
Dell Acceleration Appliances for Database (DAAD) High Availability Database Solution Architecture Architecture of Oracle Database on DAAD IO Multipath to the storage volumes
Experimental Evaluation: Performance Benchmarks Iometer to measure the pure IO performance Test Name DAAD vs 96-disk Baseline IOPS MB/s speed up 4k Random Read 1,010,13/ 3,946 / 144 27x 36,771 8K Random 346,120/ 2,704 / 295 9.2x 70/30 R/W 37,723 1MB Seq Read 7,453/ 7,453 / 2,907 2.6x 2,907 1MB Seq Write 4,132 / 940 4,132 / 940 4.4x Test Name 4KB Random Read 8KB Random 70/30 R/W DAAD vs 96-disk Baseline Latency(ms) Reduction 0.51 / 13.92 96% 1.48 / 13.57 89% Calibrate_IO to simulate Oracle Database IO: Compare with baseline MB/s scalability IOPs scalability
Experimental Evaluation: Performance Benchmarks TPCC-Like benchmark by HammerDB Simulating application workloads, using 10ms response time limit Measuring :Transaction Per Minute (TPM): New Order Per Minute (NOPM) Average Response time (ART); Scalability by # of DB nodes 3,000,000 Performance Scaling for DAAD 60.00 2,500,000 50.00 Transactions per Minute 2,000,000 1,500,000 1,000,000 500,000 0 1 2 3 4 TPM 970,107 1,714,048 2,257,219 2,542,395 NOPM 326,839 582,967 796,161 959,274 ART 5.97 6.75 7.52 7.98 Number of Database Nodes 40.00 30.00 20.00 10.00 0.00 Response Time (ms)
Conclusion and Next Version of DAAD Dell Acceleration Appliances for Database (DAAD) High Performance storage solutions for Oracle Database Highly Available Architecture: Storage, Network and Database Nodes. Next Version of DAAD Introducing InfiniBand Network for Storage and DB node Interconnenct Highly Available Architecture: Storage, Network and Database Nodes