The Intersection of Cloud & Solid State Storage Val Bercovici Cloud Czar, NetApp Office of the CTO SNIA Cloud Storage Initiative SNIA Solid State Storage Initiative
Cloud Backdrop Worldwide IT spending on cloud services will grow almost threefold, reaching US$42 billion, by 2012 - IDC 75% of the SaaS market could be considered a cloud service, number could increase to 90% by 2013 - Gartner What s different: Cultural Trends mandate instant gratification Technology maturity is making solutions affordable Economic pressure accelerating new IT biz models Scalable Pay-as-you-go 2
Journey to a Service Oriented Infrastructure Cost Reduction & Flexibility Centralize IT Standardize Offering Virtualize & Consolidate Automate IT IT as as a Service Self-service w/ Charge-Back Where Does Your Journey Begin? 3
Evolution Not Revolution Economic realities trump legacy thinking Focus on core competencies Focus away from undifferentiated IT services Application Based Silos Horizontal Shared Infrastructure Cloud Services Marketplace Apps Servers Network Storage 4
Data Management Turf Wars Servers Virtual Servers Apps Virtual Storage Storage Application Centric Resource Centric Predictions: 1. Competition between application-centric and resource-centric data management 2. Resource-centric wins internal battles thru better efficiency 3. App-centric wins ultimate war thru open Cloud Resource Marketplace 5
New Paradigms Compute Computer Computer Computer Computer Compute Compute Serial SMP computing (Unix, Linux, Windows) One operating system, One data set IO bottleneck, File locking problems Grid MPI, PVM, Condor, SUNgrid Grid: Many operating systems, One data set Sharing is tricky, requires bandwidth Parallel Hadoop (Cloudera), Google MapReduce Many operating systems, many data sets Budding ecosystem 6
Cloud Storage Interface Preferences Cloud IT as a Service IaaS Infrastructure as a Service IT Services: Servers Network Storage Management Reporting PaaS Platform as a Service Application building blocks and standards Traditional Block or File (Posix Compliant) Storage Interface SaaS Software as a Service Applications STaaS Storage as a Service Storage Services: Backup Archive DR Examples: Amazon EC2 BT Telstra T-Systems Examples: MS Azure Force.com Google Apps Oracle OnDmnd Examples: Yahoo! Email SalesForce.com Google Docs Twitter Examples: Amazon S3 Nirvanix 7
Enter Solid State 8
Relative Sizes of Flash and Data NAND Flash covers most hot data Solid State media stores / caches metadata as well as large quantities of active data Flash v1 16GB Metadata 1 Flash v2 256GB Flash v3 (MLC) 512GB Active Data 1110101000011 0101101001010 1001010010101 0011101010001 1010101011010 0101101001110 Entire Dataset 10101001010100111010100011010101011010000110101010110 10010100111010100011010101011010110100101101011010010 11010110100101010010100101010010101001110101010110101 10100101010100111010100011010100011010101011010010111 00011010101011010010101001010100111010100011010101011 01001011010011101010001101010101101011010010110101101 00101101011010010101001010101101011010010110100101010 01010100111010100011010110100101010010101001110101010 11010110100101010010101001110101000101001011010110100 00111010100011010101011010010110101101001010100101010 01110101000110101010110100101101001110101000110101010 11010010110101101001011010010101001010100111010100011 01011010010101001010100111010101011010110100101010010 10100111010100011010101011010010110101101001010100101 01001110101000110101010110100101101001110101000110101 00011010101011010010111000110101010110100101101001110 10100011010101011010010110101101001011010010101001010 10011101010010101101001010101010110100101011010010110 10110100101010010100101010010101001110101010110101101 00101010100111010100001101011010010101001010010101001 11010100011010101011010010110100111010100011010101011 01011010010110101101001011010110100101010010100101010 01010100111010101011010110100101010100111010100011010 10001101010101101001011100011010101011010010110100111 01010001101010101100111010100011010101011010010110101 10100101010010101001110101000110101010110100101101001 11010100011010101011010010110101101001011010010101001 01010011101010001101011010010101001010100111010101011 01011010010101010110101101001010101010110100101011010 01011010110100101010010100101010010101001110101010110 10110100101010100111010100001110101000110101010110101 10100101101011010010110101101001010100101001010100101 01001110101010110101101101011010010101010101101001010 11010010110101101001010100101001010100101010011101010 10110101101001010101001110101000001010101001110101000 11010100011010101011010010111000110100110101000110101 01011010010111000110101010110100101101001110101000110 10110101001010100111010100010100101101011010010110100 10101001010100111010100011010110100101010010100101010 01110010101011010010100011010101011010010110100111010 11000001010011101010101101011010010101001010100111010 10001101010101101001011010110101011010010101001010101 01001010100111010100011010101011010001000110101010110 9
Multiple Flash Points Emerge Flash in application host Flash-based cache in storage controller Acceleration appliance Solid State Disk drives & shelves Predictions: 1. Flash drives new ways of thinking 2. Sweet spot for flash is caching
Caching: Achieving HDD & SSD Harmony More Ways to Achieve Your Goals for Performance and Cost + SSD + Flash Cache Configure with SSD Only Predictable Performance Expensive Configure with HDD and SDD Disks provide capacity/iops Flash delivers more IOPs and speeds response times Manual Tuning Configure with SATA Disks and Flash Cache Most cost-effective capacity Flash soaks up IOPs, frees up SATA drives for capacity Achieve cost savings for storage, power, and space 11
New Rules You ll need a new mindset: Physical Virtual Procure Provision Architecture Composition Operations Orchestration Scalable Pay-as-you-go 12
Dynamic Scalability Scale Separately in each Dimension More Performance Supports both scale up and scale out architectures More Capacity Add capacity, performance, or clients based on the business requirements, independently across controller, disk drivers, or clients Add more modules later, pay as you grow to maximize Capex 13
Tiered Data Centers, Peak workloads Flash Cache Volume Caching System Blade Servers Cloud Challenges Follow the Moon Balance load between DC Dynamic client load Move compute easily WAN WAN Origin Volume Origin System Caching System Flash Cache Volume Flash in Fabric Benefits Caches data near client Reduced latency Avoids replication overheads Master copy in data bunker Scale performance globally Seamless migration Migrate to cheapest data center 14
Thank You. Let s Discuss! 15