Hewlett Packard Enterprise HPE GEN10 PERSISTENT MEMORY PERFORMANCE THROUGH PERSISTENCE
Digital transformation is taking place in businesses of all sizes Big Data and Analytics Mobility Internet of Things Cloud-Native Technologies 2
IT is responding through the deployment of new technologies Internet of Things Cloud On Premise Data Center Multi-purpose & Secure Mission Critical Workload specialized Software defined Composable Infrastructure Hyper Converged Edge computing Campus Infrastructure Future
Convergence of memory and storage Persistent Memory = The speed of memory with the persistence of storage Load-Store Data Low Latency CPU Cache Memory Speed Volatile DRAM Persistent Memory Block-Store Data Flash SDD Storage Long Latency Non-Volatile Magnetic HDD Persistence 4
Evolving the software ecosystem for persistent memory Application Objects Interpreters Libraries Operating System Bottleneck? Application Objects Interpreters Libraries SSD/HDD File system I/O Buffers Drivers Controller Cache Media ~25k instructions 3+ data copies Bottleneck 3 instructions 0 data copies Persistent Memory Media 5
HPE Gen10 Persistent Memory Portfolio Performance of Memory Persistence of Storage HPE Scalable Persistent Memory Up to 1TB capacity at DRAM speeds HPE NVDIMMs HPE 16GB NVDIMM HPE 8GB NVDIMMs (Gen9) Slide best viewed in presentation mode Large in-memory compute Checkpoints and Restores HTAP- Real Time Analytics Large Databases Software-Defined Storage Big Data, Service Providers, Performance Tier, and Virtualization Database Storage Bottlenecks Software Licensing Reduction Caching Small (100s of GB) Large (Terabytes) Database Workloads
HPE Gen10 Persistent Memory Executive Summary HPE Scalable Persistent Memory Fall 2017 HPE 16GB NVDIMM Late Fall 2017 Ideal For Fastest Persistent Memory at terabyte scale Right-sized Persistent Memory Proof Points Performance Up to 20x reduction in database restart time Up to 27x faster checkpoint operations Latency: 30ns BW: 250 GB/s Up to 50% reduction in database licensing costs Up to 4x faster database transactions Latency: 30ns BW: 20 GB/s Capacity Up to 1TB NVDIMM: 16GB Max: 192GB (2s) and 384GB (4s) Workloads Large in-memory compute Faster Checkpoints and Restores Database storage bottlenecks HTAP- Real Time Analytics Software-Defined Storage Database Storage Bottlenecks Software Licensing Reduction Caching
HPE Scalable Persistent Memory Fastest performing persistent memory at terabyte scale HPE Scalable Persistent Memory is an integrated storage solution that runs at memory speeds with terabyte capacity unlocking new levels of performance for your business workloads. Ideal for: Enabling in-memory compute with persistence, faster checkpoints and restores, HTAP, software-defined storage caching tiers and any workload that could benefit from low-latency DRAM-level performance Key Features: DRAM-level performance for fastest performing persistent memory Flexible capacity points with capacity up to 1TB Complete solution using DRAM for application performance, flash tier for persistence and backup power for moving data to persistent store Up to 20x reduction in database restart time preserving maximum uptime 1 Up to 27x faster checkpoint operations enabling significantly faster business operations 2 1 HPE Internal Labs test. HPE Scalable Persistent Memory, restarting 1000GB HekatonDatabase is as fast as restarting 200GB database or 20x, March 31, 2017 2 TPC-C Benchmark Throughput with Checkpoint (trans/sec). Calculated Time to Checkpoint and Restore a Docker Container running MySQL, compare Persistent memory vs. SSD, March 31, 2017 Learn more: https://www.hpe.com/info/persistentmemory
HPE Scalable Persistent Memory Use Cases Performance of Memory Persistence of Storage In-memory compute with persistence Faster HTAP Transactions + Real Time Analytics Faster Checkpoints and Restores OLTP + OLAP = HTAP Reducing database storage bottlenecks Software-defined storage acceleration And much much more Big Data Service Providers Performance Tier Virtualization 9
HPE 16GB NVDIMM Fastest performing persistent memory for smaller storage bottlenecks HPE 16GB NVDIMMs are flash-backed DIMMs designed to eliminate smaller storage bottlenecks while delivering the performance of memory with the persistence of storage. Ideal for: Smaller database storage bottlenecks, write caching tiers and any workload constrained by storage bottlenecks Key Features: DRAM-level performance for fastest performing persistent memory Up to 384GB total capacity in a single server HPE Smart Storage Battery for backup power 2x the capacity of 1 st generation HPE NVDIMMs 4 Up to 50% reduction in database licensing costs using the fastest tier of storage on HPE servers 3 3 HPE Internal lab testing. Data gathered on pre-release hardware and software, final results may differ, Nov. 2016. 4 Comparing 8GB NVDIMM to 16GB NVDIMM equals 2X capacity increase, September 2017. Learn more: https://www.hpe.com/info/persistentmemory 10
HPE Persistent Memory NVDIMM Use Cases Performance of Memory Persistence of Storage Reducing Database Storage Bottlenecks Up to 4x faster and better CPU Utilization with byte addressable storage. Software Licensing Reduction Up to 50% reduction in core-based software licensing with NVDIMMs Write Caching Up to 2x faster with NVDIMMs than with NVMeSSDs Storage Spaces 11
HPE Persistent Memory Market Leadership Fall 2016 Summer/Fall 2017 ProLiant Gen9 Time-to-Market and Leadership! ProLiant Gen10 Industry s Highest Perfomance HPE 8GB NVDIMM-N *First To Market* HPE 16GB NVDIMM HPE Scalable Persistent Memory HPE Gen10 Persistent Memory Market Plans HPE Gen10 Persistent Memory Software Ecosystem VMworld 2017: Demos, PMEM Session (VMware), announce support MSFT Ignite 2017: 8-node cluster demo with Storage Spaces Direct HPE Discover Madrid 2017: Demos, session, social media promotion Gen10 PMEM Demos: Youtube and web with social media promotion UPS-backed Scalable PMEM: Expanded platform support (2018) Channel enablement: Collateral, demo videos, training VMware: vsphere support announcement at VMworld 2017 Microsoft: Hyper-V and S2D announcements at Microsoft Ignite 2017 Application Enablement: Microsoft (SQL, Storage Spaces, HTAP and Exchange) Oracle DB EnterpriseDB Redis.www.hpe.com/info/persistentmemory for latest announcements OS Enablement: Microsoft: WS2012 R2 and WS2016 Linux: RHEL 7.3/7.4 and SLES 12 SP2/SP3 Announcements soon on VMware vsphere and Microsoft Hyper-V
SECRET SAUCE HPE Scalable Persistent Memory Recipe APPLICATION S SERVERS 2. BIOS controls HPE Scalable Persistent Memory functionality 6. Business Workloads running at memory speeds unlocking new levels of performance on HPE Servers! 1. It starts with the best servers in the industry.hpe ProLiant! DRAM Flash Backup Power 3. HPE SmartMemory DRAM for application acceleration 4. HPE 2.5 NVMe SSDs as a dedicated flash tier 5. PSU with battery backup capability to hold power up to move data from DRAM to flash
HPE Gen10 Persistent Memory solutions: Use Cases and Demos Reducing database storage bottlenecks OLTP Reducing Licensing Cost Tail Of Log Virtualization ESXi Linux Guest Windows Guest SQL Server Guest Faster HTAP Transactions + Real Time Analytics OLTP + OLAP = HTAP OLTP Performance Software-defined storage acceleration HTAP 3D Graphics and Data Processing Replication Storage Spaces Direct In-memory compute with persistence Faster Checkpoints and Restores OpendTect Mail Server and Calendaring Rapid Restart Performance Exchange Performance
SQL Server 2016 Tail of Log Server configuration: 1x HPE ProLiant DL380 (both sockets populated) 1x NVDIMM-N (8 GB) for the tail of the log 2x SATA SSD (400 GB) as the store for database files 1x NVMe SSD (400 GB) as the store for both logs 128 GB memory Software: Windows Server 2016 SQL Server 2016 SQL tables are stored on 2x SATA SSDs that are striped (Simple Space) SQL Tail of the Log enabled Table size configured to match data and log storage capacities Threads: 1 per Windows logical processor SQL queries: Create, Insert, Update SQL PerfCollectors: None Batch size: 1 Row size: 32B Higher is better 71 147 K transactions/sec Write-intensive NVMe SSD 2x SQL2016 performance 14 2x 7 latency per update (us) Lower is better Tail of the Log using the single HPE NVDIMM Executed tests and results : 05/19/2016: 2x with a HPE write-intensive NVMe SSD 05/06/2016: 3x with a mixed (vs. write-intensive) type NVMe SSD June 2016: 4xwith a SAS SSD
SQL2016 Tail of Log HP Confidential 16
Faster Restores with HPE Scalable Persistent Memory Restarting a 200GB In-Memory DB 25 20 20 15 500K Transactions Per Second 10 5 0 SSDs 20x 1 Minutes HPE Scalable Persistent Memory HPE Scalable Persistent Memory: Up to 20x reduction in database restart time! 17
Reduce Oracle licensing cost while achieving higher throughput with NVDIMM as compared to HDD Relative throughput 600 500 400 300 200 100 0 Oracle DB throughput SAS with 32 cores vs NVDIMM with 16 cores 25 50 75 100 125 Number of Oracle connections SAS 32C NVDIMM 16C SAS CPU util NVDIMM CPU util 100 80 60 40 20 0 CPU utilization NVDIMM with 16 cores performed better than SAS drives with 32 cores, reducing Oracle licenses by 50% * https://www.hpe.com/h20195/v2/getpdf.aspx/4aa6-6008enw.pdf
SQL Server Fast Restart and HPE Persistent Memory HPE Scalable Persistent Memory to improve SQL Server restart time Using MSFT SQL HekatonPersistent Memory optimized prototype Focus restart at the same TPS rate before the crash DL380 with HPE Scalable Persistent Memory and 1TB Hekaton DB prototype restart: 500 000 tps o 10 minutes with NVMe SSD 45 seconds*with HPE Scalable Persistent Memory Bonus: HPE Scalable Persistent Memory: restarting 1TB Hekaton DB is as fast as restarting the 200GB DB. 800 600 400 200 0 time to restart to 500 000 tps NVMe SSD 600 13x seconds 45 HPE Scalable Persistent Memory
Storage Spaces Direct with SCM using HPE Persistent Memory Cluster configuration: 8 node cluster, per node: HP DL380 Gen9 2x E5-2699 v4 (22c44t 2.2Ghz/ea) 16x 16GB DDR4 2400Mhz DRAM 16x 8GB HPE NVDIMM-N 4x U.2 NVME 1x Mellanox CX4 100Gb RNIC Mellanox Spectrum SN2700 switch 300000 3x 200000 100000 0 64K 100% Read IOPS NVME 15000 3x 10000 5000 0 64K 100% Read MB/s 2x 8K 80% Read 20% Write SCM 2x 8K 80% Read 20% Write NVME SCM
Checkpoint-Restore Performance Time to Checkpoint and Restore a Docker Container Running MySQL Time (seconds) 50 45 40 35 30 25 20 15 10 5 0 3X 27X Checkpoint pmem ssd 5X Restore 13X Significant speedup of checkpointing with persistent memory!
MySQL Performance with Checkpoint 600 500 400 300 200 100 0 TPC-C Benchmark Throughput with Checkpoint (trans/sec) 10 40 70 100 130 160 190 220 250 280 310 340 370 400 430 460 490 520 550 580 Time (seconds) pmem Significant reduction of performance impact with persistent memory!
Problem SSD not Available? Try HDD+NVDIMM! The Solid State Drives (SSD) market has experienced significant supply constraints, creating unprecedented delays in fulfillment of server orders. Solution HPE developed an innovative alternative solution to SSDs, which configures HPE NVDIMMs with Hard Disk Drives delivering comparable performance and potential cost savings. White Paper: Cost and performance benefits of deploying Microsoft SQL Server on HPE Persistent Memory and Microsoft Storage Spaces Click here to download
Persistent Memory Resources Website Persistent Memory web page Persistent Memory software Videos and Blogs Persistent Memory 3D Product Demo Persistent Memory Overview Video NVDIMM-N as Byte-Addressable Storage in Windows Server 2016 NVDIMM-N as Block Storage in Windows Server 2016 Persistent Memory blogs Accelerating SQL Server 2016 performance in Windows Server 2016 Technical Papers Persistent Memory technical white paper Persistent Memory on SQL Server 2016 Persistent Memory on Windows Server 2012 R2 Reducing Oracle licensing and improving performance Accelerate EDB Postgres Advanced Server 24
Questions?
Thank You!