The Intersection of Cloud & Solid State Storage

Transcription

1 The Intersection of Cloud & Solid State Storage Val Bercovici Cloud Czar, NetApp Office of the CTO SNIA Cloud Storage Initiative SNIA Solid State Storage Initiative

2 Cloud Backdrop Worldwide IT spending on cloud services will grow almost threefold, reaching US$42 billion, by IDC 75% of the SaaS market could be considered a cloud service, number could increase to 90% by Gartner What s different: Cultural Trends mandate instant gratification Technology maturity is making solutions affordable Economic pressure accelerating new IT biz models Scalable Pay-as-you-go 2

3 Journey to a Service Oriented Infrastructure Cost Reduction & Flexibility Centralize IT Standardize Offering Virtualize & Consolidate Automate IT IT as as a Service Self-service w/ Charge-Back Where Does Your Journey Begin? 3

4 Evolution Not Revolution Economic realities trump legacy thinking Focus on core competencies Focus away from undifferentiated IT services Application Based Silos Horizontal Shared Infrastructure Cloud Services Marketplace Apps Servers Network Storage 4

5 Data Management Turf Wars Servers Virtual Servers Apps Virtual Storage Storage Application Centric Resource Centric Predictions: 1. Competition between application-centric and resource-centric data management 2. Resource-centric wins internal battles thru better efficiency 3. App-centric wins ultimate war thru open Cloud Resource Marketplace 5

6 New Paradigms Compute Computer Computer Computer Computer Compute Compute Serial SMP computing (Unix, Linux, Windows) One operating system, One data set IO bottleneck, File locking problems Grid MPI, PVM, Condor, SUNgrid Grid: Many operating systems, One data set Sharing is tricky, requires bandwidth Parallel Hadoop (Cloudera), Google MapReduce Many operating systems, many data sets Budding ecosystem 6

7 Cloud Storage Interface Preferences Cloud IT as a Service IaaS Infrastructure as a Service IT Services: Servers Network Storage Management Reporting PaaS Platform as a Service Application building blocks and standards Traditional Block or File (Posix Compliant) Storage Interface SaaS Software as a Service Applications STaaS Storage as a Service Storage Services: Backup Archive DR Examples: Amazon EC2 BT Telstra T-Systems Examples: MS Azure Force.com Google Apps Oracle OnDmnd Examples: Yahoo! SalesForce.com Google Docs Twitter Examples: Amazon S3 Nirvanix 7

8 Enter Solid State 8

9 Relative Sizes of Flash and Data NAND Flash covers most hot data Solid State media stores / caches metadata as well as large quantities of active data Flash v1 16GB Metadata 1 Flash v2 256GB Flash v3 (MLC) 512GB Active Data Entire Dataset

10 Multiple Flash Points Emerge Flash in application host Flash-based cache in storage controller Acceleration appliance Solid State Disk drives & shelves Predictions: 1. Flash drives new ways of thinking 2. Sweet spot for flash is caching

11 Caching: Achieving HDD & SSD Harmony More Ways to Achieve Your Goals for Performance and Cost + SSD + Flash Cache Configure with SSD Only Predictable Performance Expensive Configure with HDD and SDD Disks provide capacity/iops Flash delivers more IOPs and speeds response times Manual Tuning Configure with SATA Disks and Flash Cache Most cost-effective capacity Flash soaks up IOPs, frees up SATA drives for capacity Achieve cost savings for storage, power, and space 11

12 New Rules You ll need a new mindset: Physical Virtual Procure Provision Architecture Composition Operations Orchestration Scalable Pay-as-you-go 12

13 Dynamic Scalability Scale Separately in each Dimension More Performance Supports both scale up and scale out architectures More Capacity Add capacity, performance, or clients based on the business requirements, independently across controller, disk drivers, or clients Add more modules later, pay as you grow to maximize Capex 13

14 Tiered Data Centers, Peak workloads Flash Cache Volume Caching System Blade Servers Cloud Challenges Follow the Moon Balance load between DC Dynamic client load Move compute easily WAN WAN Origin Volume Origin System Caching System Flash Cache Volume Flash in Fabric Benefits Caches data near client Reduced latency Avoids replication overheads Master copy in data bunker Scale performance globally Seamless migration Migrate to cheapest data center 14

15 Thank You. Let s Discuss! 15