Oracle Exadata X7 Uwe Kirchhoff Oracle ACS - Delivery Senior Principal Service Delivery Engineer 05.12.2017
Oracle Engineered Systems ZFS Backup Appliance Zero Data Loss Recovery Appliance Exadata Database Machine Big Data Appliance Exalogic Elastic Cloud Private Cloud Appliance Exalytics Data Protection Database Big Data Big Data SQL Middleware / Apps Analytics Oracle Confidential Internal Oracle Database Appliance Dept 2
Exadata Database Machine Performance, Availability and Security Enabled by: Single-vendor accountability Exclusive focus on databases Deep h/w and s/w integration Revolutionary approach to storage 3
Exadata Database Machine X7-2 State-of-the-Art Hardware Scale-Out Database Servers 2 socket Xeon processors 48 cores per server 384 GB - 1.5 TB DRAM Fastest Internal Fabric Scale-Out Intelligent Storage High-Capacity Storage Server Extreme Flash Storage Server 40 Gb/s InfiniBand internal network 25/10/1 GigE external network 120 TB disk capacity (10 TB helium disks) 25.6 TB PCI NVMe Flash 20 cores for SQL offload 51.2 TB PCI NVMe Flash 20 cores for SQL offload 4
X7-2 Hardware Compared to X6-2 Twice the Flash, 25% More Disk, Faster Ethernet, Faster Processors, More Memory Compute X7-2 X6-2 Improvement Cores per CPU/server 24 / 48 22 / 44 20% - 40% faster CPUs DRAM per server 384 GB 256 GB 50% more memory Max DRAM per server 1.5 TB 1.5 TB Network X7-2 X6-2 Improvement Internal (InfiniBand) 40 Gb/s 40 Gb/s External (Ethernet) 25 GigE 10 GigE 150% faster Ethernet Storage X7-2 X6-2 Improvement All-Flash per server 51.2 TB 25.6 100% more all-flash capacity Flash Cache per server 25.6 12.8 100% more Flash Cache Disk capacity per server 120 TB 96 TB 25% more disk capacity SQL offload cores per svr 20 20 5
Exadata Database Machine X7-2 Smart, Database-Aware Software Scale-Out Database Servers Compute Software Oracle Linux 6 Oracle Database Enterprise Edition Oracle VM (optional) Oracle Database options Fastest Internal Fabric Scale-Out Intelligent Storage High-Capacity Storage Server Extreme Flash Storage Server Storage Server Software Smart Scan (SQL offload) Smart Flash Cache Hybrid Columnar Compression IO Resource Management 6
Exadata Hardware Generational Advances * V1 V2 X2 X3 X4 X5 X6 X7 Sept 2008 Xeon E5430 Harpertown Sept 2009 Xeon E5540 Nehalem Sept 2010 Xeon X5670 Westmere Sept 2012 Xeon E5-2690 Sandy Bridge Nov 2013 Xeon E5-2697v2 Ivy Bridge Dec 2014 Xeon E5-2699 v3 Haswell Apr 2016 Xeon E5-2699 v4 Broadwell Oct 2017 Xeon 8160 Skylake V1 X7 Growth 10 X 64 X 6 X 48 X 100 X * Assumes full rack configuration of 8 database servers and 14 storage servers 7
Exadata Unique Smart Database Software Highlights Smart Analytics Move queries to storage, not storage to queries Automatically offload and parallelize queries across all storage servers Extend In-Memory DB with flash Run In-Memory DB on standby 10x 100x faster analytics Smart OLTP Special InfiniBand protocol enables 3x faster OLTP messaging Ultra-fast DB-optimized flash logging Instant detection of node failure and I/ O issues Smart Storage Hybrid Columnar Compression reduces space usage by 10x Database-aware Flash Caching gives speed of flash with capacity of disk Storage Indexes eliminate unnecessary I/O Smart Consolidation Critical DB messages jump to head of queue for ultra-fast latency CPU, I/O, network resources prioritized for end-to-end quality of service 4x more databases vs same hardware without Exadata software 8
Latest Exadata Smart Software Enhancements In-Memory Analytics in Storage In-Memory OLTP in Storage In-Memory Columnar Scans Up to 1.5 TB DRAM per Server Automatically converts data to In-Memory Columnar format and up to 4x better performance in Exadata Flash Cache In-Flash Columnar Scans Compute Server DRAM Cache in storage serves OLTP blocks 2.5x faster than Flash Cache DB Blocks DRAM Cache (HOT) Up to 25.6 TB Flash per Server Storage Server Flash Cache Disks 9
Exadata 12.2.1.1.0 and 18.1.0.0.0 Highlights Over 40 unique software features and enhancements in a year Better analytics, better transaction processing, better consolidation, more secure, faster and more robust upgrades, and easier to manage Complete investment protection All new software features work on all supported Exadata hardware generations Full storage offload functionality for Database 12.2 Database 11.2, 12.1, and 10.2 can coexist along side 12.2 on the same system Updated Oracle Linux kernel and Oracle VM improve robustness and scalability Oracle Linux 6.9 with UEK4, Oracle Virtual Machine 3.4.4 Bloom filter (in Storage index) for low cardinality 10
Analytics: In-Memory Columnar Formats in Flash Cache 3-4x Overall Analytics Performance Improvement In-Memory Columnar scans Database Server SGA IMC Up to 1.5 TB DRAM In-Flash Columnar scans 25.6 TB Flash x 3 = 76.8 TB (or more) 12.8 TB Flash IMC (In-Memory Columnar) data Storage Server Row formatted or HCC Data 11
Exadata Automates and Simplifies Administration Spend Less by Administering and Managing Less All layers in Exadata are pre-configured, pre-tuned, pre-debugged DB, OS, drivers, firmware, network, servers, storage Automatic database installation and configuration Input sizing parameters and Exadata will deploy and configure the database Automatic periodic full-stack health checks Validates compliance with best practices, software versions, parameter settings, etc One Support team expert in and accountable for full stack Oracle performs free full-stack updates and 24/7 monitoring One management tool for the entire stack Drill down from DB to storage, and up from storage to DB Oracle Confidential Highly Restricted 12
Best Performance 13
Breakthrough Database Performance Exadata X7 Full Rack * OLTP SCAN Read 5.97 million IO/sec 350 GB/sec Write 5.4 million IO/sec n/a IO Latency 250 microseconds n/a *Exadata Rack with 10 DB servers and 12 Extreme Flash storage servers 14
Exadata X7-2 and X7-8 Performance Improvements 350 GB/sec I/O Throughput 17% more (vs Exadata X6) 5.97 Million OLTP Read IOPS 50% more IOPS (vs Exadata X6) under 250 µsec = 3.5M 40% CPU improvement for Analytics 20% CPU improvement for OLTP 40% on X7-8 (vs Exadata X6-8) Dramatically faster than leading all-flash arrays in every metric Each rack has up to: 1.7 PB Disk 720 TB NVMe Flash 15
Best Availability 16
Exadata Maximum Availability Architecture (MAA) Blueprint for HA: Designed and Tested to Handle All Failure Scenarios Within Exadata Within a Site Across Sites Redundant Hardware Local standby for HA Failover Remote standby for Disaster Recovery Servers, Disks, Flash, Network, Power Redundant Software Active clusters, Disk/ flash mirroring DATABASE IN-MEMORY Redo-based change replication with data consistency checking LAN DATABASE IN-MEMORY Redundant Systems Redundant Databases WAN DATABASE IN-MEMORY Redundant Systems Redundant Databases Online patching, reconfiguration, expansion Fastest RAC Instance and Node Failure Recovery Fastest Backup - RMAN Offload to Storage Deep ASM Mirroring Integration Fastest Data Guard Redo Apply Complete Failure Testing with Lowest Brownouts 17
Unique Fault-Tolerant In-Memory Databases Only Available on Engineered Systems In-Memory databases can reduce availability Server crash makes memory inaccessible until after data is reloaded Oracle Database In-Memory uniquely duplicates in-memory columns on another server Similar to storage mirroring Downtime eliminated by automatically switching to duplicate after failure 18
Best Security 19
Exadata Full-Stack Security Oracle owns all component and cross component security Identical configurations for all customers Validated by numerous audits at security sensitive organizations Banks, Governments, Telcos, Retailers, etc. FIPS 140-2 certification PCI-DSS compliant Encryption via hardware Linux minimal distribution Secure erase System lockdown Live kernel patching 20
Miscellaneous Slides 22
Exadata Database Servers 2008 2009 2010 2012 2013 2014 2016 V1 V2 X2 X3 X4 X5 X6 2017 X7 Harpertown 8 cores per server Nahelam 8 cores per server Westmere 12 cores per server Sandy Bridge 16 cores per server Ivy Bridge 24 cores per server Haswell 36 cores per server Broadwell 44 cores per server Skylake 48 cores per server Full Rack (8 servers) 192 cores 288 cores 352 cores 384 cores Qtr Rack (2 servers) 48 cores 72 cores 88 cores 96 cores Eighth Rack (2 servers x.5) 24 cores 36 cores 44 cores 48 cores 23
Exadata Disk Storage 2008 2009 2010 2012 2013 2014 2016 V1 V2 X2 X3 X4 X5 X6 2017 X7 1 TB 2 TB 3 TB 4 TB 8 TB 10 TB Helium Helium Full Rack (14 storage) Qtr Rack (3 storage) 200 TB 400 TB 400 TB 500 TB 43 TB 85 TB 85 TB 107 TB Usable Capacity with HIGH Redundancy before Compression 24
Exadata Flash Storage 2008 2009 2010 2012 2013 2014 2016 2017 V1 V2 X2 X3 X4 X5 X6 X7 96 GB per Card 96 GB per Card 384 GB per Card 768 GB per Card 1.6 TB per Card 3.2 TB per Card Full Rack HC Flash Cache/% of Disk 45 TB/.23 90 TB/.23 180 TB/.45 360 TB/.72 Qtr Rack HC Flash Cache/% of Disk 18 TB/.21 37 TB/.44 74 TB/.69 Full Rack EF ( All Flash ) 50 TB 102 TB 204 TB Qtr Rack EF ( All Flash ) 10 TB 22 TB 44 TB Usable Capacity with HIGH Redundancy before Compression 9 TB/.21 6.4 TB per Card 25
Exadata Flash Performance 2008 2009 2010 2012 2013 2014 2016 2017 V1 V2 X2 X3 X4 X5 X6 X7 1.8 GB/ sec 2.5 GB/ sec 5.4 GB/ sec 5.5 GB/ sec Full Rack Scan Throughput 100 GB/sec 180 GB/sec 301 GB/sec 350 GB/sec Qtr Rack Scan Throughput 22 TB/sec 30 GB/sec 64 GB/sec 75 GB/sec Full Rack OLTP Read IOPS 2.8 M 4.1 M 5.6 M 5.97 M Qtr Rack OLTP Read IOPS 570 K 1M 1.1 M 1.2 M 26