The Impact of SSDs on Software Defined Storage

Transcription

1 open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the The Impact of SSDs on Software Defined Storage Barbara Murphy VP of Marketing, Weka.IO barbara@weka.io Santa Clara, CA 1

2 Company Overview Founded in 2013, R&D in Israel DNA in Storage - XIV lead architects US HQ in San Jose, CA DNA in Flash - Michael Raam, SandForce, $32.25M raised to date Hyper-converged file storage Targeting Web 2.0, Rendering, Life Sciences, EDA and HPC

3 All Storage is Software Defined Software Defined Vs. Software Designed open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still The cannot be displayed. Your computer may not have enough memory to open the The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, Santa Clara, CA 3

4 Built to Last or Built to Fail? Software Defined Homogenous High durability components Dedicated networks Failures are exceptional Tight bill-of-materials Design to slowest component Software Designed Heterogeneous Cheapest components Poor networks Failures are normal Latest off the truck Design to the average of all Santa Clara, CA 4

5 What Modern Design Needs Designed for tomorrow s IT environments High speed networks Flash first Hot and cold tiers Commodity unreliable servers Virtualized agile deployment Cost containment Santa Clara, CA 5

6 Designed for Disk or Flash? Everything changed with SSDs Data Structures Power failure Endurance Reliability Latency Santa Clara, CA 6

7 ZFS Designed for Disk ZFS is designed with a focus on data integrity by protecting the user s data on Disk Wikipedia B Tree Write Amplification Disk Caching Disk Scrubbing RAM Copy-on-write The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the and The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then The cannot be displayed. Your computer may not have enough memory to open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the Santa Clara, CA 7

8 SDS Designed for Scale Triple Replication Costs 3x cost, 1/3 life Impacts power, network traffic, footprint, failures, Dedupe and Compression A compensation - not a solution Erasure coding reduces overhead by over 80% Properly designed to minimize write amplification Santa Clara, CA 8

9 Latency the New Bottleneck IOPS - Solved Bottleneck moved to software, controllers and network Legacy stacks designed for disk latencies Requires I/O path efficiencies Is NVMe the answer? Requires non-standard network settings May be relegated to rack level deployment Santa Clara, CA 9

10 SSD for the Cloud Virtualized storage Expand or contract your infrastructure, add performance on demand The larger the scale, the more you will fail Triple replication or N+2 is not sufficient File intelligence, block speed POSIX, REST, HDFS Tight coupling to leverage cloud Upstream into orchestration environments (Openstack) Downstream to data lake (Disk/archive) Santa Clara, CA 10

11 Summary SSD has a foundational impact on SDS Data structures, I/O path, resiliency, endurance, cost Legacy file systems will not solve the SSD challenge Next generation file systems:- Flash centric Virtualized, tiered, scalable, modern interfaces Santa Clara, CA 11

12 Performance, Scalability and Value! The The The Weka.IO File System cannot be cannot displaye be d. Your displaye compute d. Your r may comput not have er may enough not open the memory, or the may have been corrupted. Restart your computer, and then open the have file again. If the red x still appears, you may have to delete the to open enough open the, the or the may have been memory corrupted. Restart your computer, and then open the file again. If the red x still appears, you may, have to delete the and then to open insert it again. or the the, may or the have been may corrupte have d. been The Restart corrupt your ed. cannot compute Restart The be r, and your displaye then comput cannot er, and be Object then displaye open d. Your the file compute again. If r may the red not have x still enough appears memory, you to The open The may the have to, cannot cannot delete or be the be the displaye NAS The cannot be displaye SAN The cannot be displaye AFA 100% SSD Designed Performance of Flash Intelligence of File Latency of SAN Cloud scale and economics Santa Clara, CA

13 Peta Exa Zetta Yotta Thank you Xona Weka (10 30 ) open the, or the may have been corrupted. Restart your computer, and then open the file again. If the red x still appears, you may have to delete the