Long Live DAS! Ryan Jancaitis Product Management - Symantec Frank Ober Data Center Solutions Architect - Intel

Transcription

1 Long Live DAS! Ryan Jancaitis Product Management - Symantec Frank Ober Data Center Solutions Architect - Intel

2 Long Live DAS! SYMANTEC VISION

3 The Storage Conundrum 1.2ZB THE WORLD S DATA IN ZB THE WORLD S DATA BY 2015 THE WORLD S DATA BY ZB 61.8% UNSTRUCTURED DATA GROWTH RATE TO IDC, Digital Universe study, December IDC, Worldwide Disk-Based Data Protection and Recovery Forecast, December 2012 Long Live DAS! SYMANTEC VISION

4 Data Center Challenge: A Tier-1 Bottleneck Tier-1 App Faster/More CPU Faster/More RAM Faster Internals Tier-1 Storage Tier-1!= $/IOP Tier-1 = $/GB VMAX is a Capacity Tier - John Roese, CTO, EMC 10/40/100 GbE InfiniBand RDMA IOPs Maxed Wide Stripe Over-Allocation Long Live DAS! SYMANTEC VISION

5 SSDs are Fundamentally Changing the Data Center HDD revenue will stay flat in 2014, with estimates at $32 billion HIS Worldwide SSD shipments across all market segments are projected to increase by 46% in 2013 and grow at a 31% CAGR. Nov 13 IDC SSDs will continue to complement (slower) hard disk drives while replacing the fastest 15,000-RPM drives. - Gartner All Flash Array Forecast $1.5 Billion by 2015 IDC Worldwide SSD revenue is now expected to grow at a CAGR of 20% for Nov 13 IDC Long Live DAS! SYMANTEC VISION

6 Any form Factor flash optimization Right $/IOPS with Flash/SSD SSD in SAN All-Flash in SAN In-server SSD Eliminate the SAN Less Disruptive Marginal Benefit High Performance Expensive SAN Lower latency SAN for efficiency SSD closest to CPU Avoid SAN Optimize SSD Eliminate Host Bottleneck Optimize R+W Performance Enable True DAS App aware Storage Tiering Optimize Storage with Compression & Dedup Migration to ANY storage Reduce Host protocol overhead Enable Scale-out architecture on host Migrate to All Flash with ease Remove logjams in SAN Rely on commodity SAN storage Optimize Read & Writes Mix of SATA & Flash for SLA Benefits of SAN in DAS Linearly scale as need grows Long Live DAS! SYMANTEC VISION

7 Long Live DAS! SYMANTEC VISION

8 PCI Express* SSD vs Multi SATA* SSDs SATA SSDs advantages Matured hardware RAID/Adapter for management of SSDs Matured technology/eco system for SSDs Cost & performance balance Quick Performance Comparison Random WRITE IOPS: 6 x S3700 = one PCIe SSD 1.6T (4 lanes, Gen3) Random READ IOPS: ~8 x S3700 = 1 x PCIe SSD IOPS 6x800GB Intel S3700 1x NVMe 1600GB Mix-Use PCIe and SATA SSDs hot-pluggable 2.5 PCIe SSD has same maintenance advantage as SATA SSD TCO, balance on performance and cost % read 50% read 0% read 4K random workloads (IOPS) Performance of 6~8 Intel S3700 SSDs is close to 1x PCIe SSD Measurements made on Hanlan Creek (Intel S5520HC) system with two Intel Xeon X5560@ 2.93GHz and 12GB (per CPU) Mem running RHEL6.4 O/S, Intel S3700 SATA Gen3 SSDs are connected to LSI* HBA 9211, NVMe SSD is under development, data collected by FIO* tool Long Live DAS! SYMANTEC VISION 2014

9 Intel Data Center Family of SSDs Why They Matter Feature Benefits Full Data Path Protection Data + Non Data Path Protects against unexpected data corruption throughout the drive Power Loss Data Protection PLI + PLI check Protects data against unexpected power loss Intel Developed Controller Intel Quality & Reliability Consistent Performance Tighter IOPS and lower max latencies for consistent and predictable performance AES 256b encryption 256b Enhanced data protection for data at rest Max Capacities 800GB 1.6TB Q TB Q4 14 Increased capacities for growing storage needs NAND Technology 20nm & 25nm w/ & w/o HET* Leading edge NAND technology provides a better cost structure OEM Validation Major server OEM qualified, warranted, and serviced NVMe Protocol PCIe Connection & NVMe Protocol Lowest latency storage driver 6µs *Other names and brands may be claimed as the property of others. 9 Long Live DAS! SYMANTEC VISION 2014

10 Intel Data Center Family of SSDs Protect against possible corruption of in-transit and stored data through every element of the SSD Including SRAM, DRAM, and NAND memory Starting when the data enters the drive until the point it leaves Interface CRC Internal CRC LBA Tag Check S/DRAM ECC Internal CRC LBA Tag Check NAND ECC Host SATA3 SATA Frontend Transfer Buffer NAND *Other names and brands may be claimed as the property of others. 10 Long Live DAS! SYMANTEC VISION 2014

11 Intel Data Center Family of SSDs Power Loss Data Protection Features Power Failure Detection Circuit Power Loss Tolerant Charge Storage Enhanced Firmware Data Safe Mode Hot Plug Inrush Current Mitigation *Other names and brands may be claimed as the property of others. 11 Long Live DAS! SYMANTEC VISION 2014

12 IOPS IOPS Intel Data Center Family of SSDs QoS spec is unique to Intel Data Center SSDs Specified maximum latency Better RAID system performance Consistently high IOPS and low latency Competitor SSD: 4K Random Write Workload DC S3500: 4K Random Write Workload Time seconds Loose Unpredictable IOPS *Other names and brands may be claimed as the property of others Time seconds Tight Predictable IOPS 12 Long Live DAS! SYMANTEC VISION 2014

13 Intel SSD Labs (Folsom, CA) Hadoop, Splunk, Big Data VMWare Hyper-V Openstack Big Data and HPC Virtualization And Internal Cloud Databases and Applications Direct Attached Storage Oracle SQL Server NoSQL ISV-OEM enablement 13 Long Live DAS! SYMANTEC VISION 2014

14 SSD in Databases Top DB SSD use cases: Log Writer Traditional & In Memory Caches - b-cache, Intel CAS or TempDB MS SQL Buffer Pool Extension (2014*), Oracle Smart Flash Cache (2010) Pure SSD is always the best approach for DB s #1 Industry Trend = movement to In Memory DB s (IMDB) Case Studies Opportunity for Case Study? Symantec White Paper on HA / FSS - Intel SSD DC S3700 for Oracle* Log Writer Oracle* TimesTen + Intel SSD DC S Aerospike* Acceleration w/intel SSD *Other names and brands may be claimed as the property of others. 14 Long Live DAS! SYMANTEC VISION 2014

15 SSD + Software Solid-state proliferation requires data management efficiency software. Gartner, 2012 Gartner: Understanding Application Workloads is Understanding SSDs 2012 Long Live DAS! SYMANTEC VISION

16 Long Live DAS! SYMANTEC VISION

17 Any form Factor flash optimization Right $/IOPS with Flash/SSD SSD in SAN All-Flash in SAN In-server SSD Eliminate the SAN Less Disruptive Marginal Benefit High Performance Expensive SAN Lower latency SAN for efficiency SSD closest to CPU Avoid SAN Optimize SSD Eliminate Host Bottleneck SmartIO Optimize R+W Performance FSS Enable True DAS App aware Storage Tiering Optimize Storage with Compression & Dedup Migration to ANY storage Reduce Host protocol overhead Enable Scale-out architecture on host Migrate to All Flash with ease Remove logjams in SAN Rely on commodity SAN storage Optimize Read & Writes Mix of SATA & Flash for SLA Benefits of SAN in DAS Linearly scale as need grows Long Live DAS! SYMANTEC VISION

18 Introducing SmartIO Volume Manager Read Cache File System Read Cache File System Write-Back Cache Linux Only in 6.1 New CLI: sfcache Granular, Online Control Highlights I/O Optimization Application Integration HCL Independence Boot Persistence Long Live DAS! SYMANTEC VISION

19 SmartIO Write-Back Write-Back Standalone Server Application SF Cache Layer Write-Back Cluster File System Application CFS Distributed Cache Layer 1 Write 1 2 ACK 1 WRITE 2 ACK Cache Reflection 3 3 Lazy Flush SAN Storage Lazy Flush SAN Storage Long Live DAS! SYMANTEC VISION

20 SmartIO Benefits Increased Application Performance Reduced Storage Costs Bring Data Closer to Application De-Couple IOPs and Capacity Improved Storage Utilization Cascaded Performance Benefits Increase Application Density Maximize Back-end Resources Long Live DAS! SYMANTEC VISION

21 SmartIO: Increased Application Performance Server Storage Results 2.5x Configuration Dell Cores GB RAM IBM DS GB Cache 64 Spindles Overview More than 2x OLTP transactions per minute Application Insight Oracle Sybase Adjust heuristics based on workload type No Application downtime No Application re-architecting SSD Workload 1 TB PCIe OLTP 150 Users 5000 Warehouses 7 GB SGA Long Live DAS! SYMANTEC VISION

22 SmartIO: Reduced Storage Costs Results Overview Combine Tier-2 Storage with SmartIO Over 2x performance than Tier-1 array 60% Cost Savings Server Configuration Dell Cores GB RAM De-couple IOPs from Capacity Reduce infrastructure required to maximize HDD performance Tier-1 Storage EMC VMAX 16 GB Cache 128x15k RPM Disks $13.54/TPM Server Dell Cores 128 GB RAM Tier-2 Storage EMC Cx4 16 GB Cache 80x15k RPM disks $5.78/TPM SSSD 1 TB PCIe Long Live DAS! SYMANTEC VISION

23 SmartIO: Improved Storage Utilization Servers Storage Results Configuration Dell Cores GB RAM IBM DS GB Cache 64 Spindles Overview More than 2x OLTP transactions per minute SmartIO frees up backend: Spindles Cache 2x the workload density on same array No performance degradation SSD Workload 1 TB PCIe OLTP 150 Users 5000 Warehouses 7 GB SGA Long Live DAS! SYMANTEC VISION

24 SmartIO: Cascaded Performance Benefits Servers Results Configuration Node 1 Dell Cores GB RAM Node 2 Dell Cores 96 GB RAM Overview Node 1 running SmartIO 4x performance improvement Node 2 No SSD No SmartIO 60% performance improvement Reduced workload from Node 1 benefits Node 2 Storage SSD Workload IBM DS GB Cache 1TB PCIe OLTP 150 Users 5000 Users 7 GB SGA Long Live DAS! SYMANTEC VISION

25 Introducing: Flexible Storage Sharing Features Build true DAS cluster HDD SSD Hybrid Ease of administration Virtualization support RDMA Interconnect InfiniBand Ethernet Built on existing technologies Flexible Storage Sharing Highly Available Applications 10GE/IB Highly Available File Systems Benefits Reduced Infrastructure Improved Flexibility All CFS/SFRAC use cases Long Live DAS! SYMANTEC VISION

26 CFS+Intel: Managed Performance 512GB 80 Cores 3700 Series 800 GB Oracle 11gR2 1.4 TB Data Files 2000 Warehouses 100 Users Storage Foundation Redo Logs: 4k 2-way Stripe Data Volumes: 8k 3-way Stripe But 4.5x SAN performance 20% SAN Cost* What about redundancy? What about high availability? What happens if hardware fails? * Pro-rated cost for EMC VMAX 20K using 1/5 th of Available Capacity Long Live DAS! SYMANTEC VISION

27 CFS+Intel: Managed Performance IB Cluster File System Oracle 11gR2 1.4 TB Data Files 2000 Warehouses 100 Users Redo Logs: 4k 2-Way Stripe/Mirror Data Volume: 8k 3-Way Stripe/Mirror With 4x SAN performance 22% SAN Cost* Full Data Redundancy Fast-failover capabilities Disaster Recovery App/Server Administrator Control * Pro-rated cost for EMC VMAX 20K using 1/5 th of Available Capacity Long Live DAS! SYMANTEC VISION

28 CFS+Intel: Managed Performance Do not put redo logs on Solid State Disk (SSD) 1 Although generally, Solid State Disks write performance is good on average, they may endure write peaks which will highly increase waits on 'log file sync' 1 Document Troubleshooting: "Log File Sync" Waits Long Live DAS! SYMANTEC VISION

29 CFS+Intel: Flexible Performance Performance Configuration Warehouse Configuration IB IB Cluster File System Redo Logs: 4k Striped Cluster File System Redo Logs: 4k 2-way Stripe/Mirror 577, 000 TPmC Data Volume: 8k 4-Way Stripe 700% Improvement over SAN 1.5 hr Load time 2x vs SAN 17k QPH 4x vs SAN Data Volume: 8k 2-Way Stripe/Mirror Long Live DAS! SYMANTEC VISION

30 Next Steps Community and Blogs Symantec/Intel Whitepaper Symantec Connect Symantec.com 6.1 Trialware Community and Blogs Steve Shaw: (Oracle/Linux) Chris Black: Frank Ober: Long Live DAS! SYMANTEC VISION

31 Long Live DAS! SYMANTEC VISION

32 Thank you! Copyright 2014 Symantec Corporation. All rights reserved. Symantec and the Symantec Logo are trademarks or registered trademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice. Long Live DAS!