DISRUPTION IN THE $35B STORAGE MARKET

Transcription

1 DISRUPTION IN THE $35B STORAGE MARKET and the rise of Ceph Brent Compton Director Storage Solution Architectures Red Hat

2 2 INSERT DESIGNATOR, IF NEEDED

3 DRIVING BIG SHIFT IN MARKET $PEND Storage deployed in servers is projected to grow from 48% to 66% of total deployed storage capacity between 2010 and % WW DEPLOYED STORAGE CAPACITY (TB) 80% By 2016, server-based storage solutions will lower storage hardware costs by 50% or more. Gartner: IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry Server-based storage is nearly 49% of capacity shipped and we project that it will account for over 60% of shipments long term. Credit Suisse Storage Update, September 3, % 40% 20% 0% By 2019, 70% of existing storage array products will also be available as software only versions Innovation Insight: Separating Hype From Hope for Software-Defined Storage (est) 2016 (est) Source: IDC SAN/NAS server-based

4 CHANGING HOW BUSINESSES BUY STORAGE public cloud storage hyper-converged compute + storage storage appliances sohware defined storage commodity servers beaer faster more lock-in silos* less experbse less control narrow opbons Cost efficiency worse Speed of provisioning slower Vendor lock-in Storage scaling Admin Governance IOPS per GB beaer faster less lock-in elasbc pool more experbse more control broad opbons

5 CHANGING HOW BUSINESSES BUY STORAGE SMB Remote Office Branch Office Big Enterprise Web-scale, Service Providers public cloud storage hyper-converged compute + storage storage appliances sohware defined storage commodity servers beaer faster Cost efficiency worse Speed of provisioning Slower beaer faster

6 WHAT IS SOFTWARE-DEFINED STORAGE? STORAGE VIRTUALIZATION STORAGE ORCHESTRATION

7 CEPH VS. THE APPLIANCE flexibility + elasticity = business agility

8 STORAGE VIRTUALIZATION Storage virtualization is the use of software and commodity hardware to provide services traditionally provided by single-purpose storage appliances (similar to server virtualization, which uses software to emulate servers), providing increased agility and efficiency. USER USER USER USER USER USER MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA MEDIA APPLIANCE APPLIANCE APPLIANCE DISTRIBUTED CLUSTER OF SERVERS

9 VIRTUALIZED STORAGE SCALES BETTER COMPUTE NODE STORAGE APPLIANCE + COMPUTE NODE STORAGE NODE

10 WHAT IS SOFTWARE-DEFINED STORAGE? STORAGE VIRTUALIZATION STORAGE ORCHESTRATION

11 STORAGE ORCHESTRATION Storage orchestration is the ability to provision, grow, shrink, and decommission storage resources on-demand and programmatically, providing increased control and integration of storage into a software-defined data center. WEB CONSOLE A browser interface designed for managing distributed storage API A full API for automation and integration with outside systems COMMAND LINE A robust, scriptable commandline interface for expert operators PROVISION INSTALL CONFIGURE TUNE MONITOR Full lifecycle management for distributed, software-defined data services

12 SCALING CEPH CLUSTERS FOR IOPS OR TB Rigid Appliance Silos Less TB More IOPS.. Balanced TB Balanced IOPS More TB fixed IOPS More TB Less IOPS

13 WHERE CEPH IS USED Workload IO Profiles Workload Examples Searchable Examples Workload IO Characteristics Hardware Characteristics IOPS MySQL MariaDB PostgreSQL Medallia High IOPS/GB Low latency IO Small random IO 70/30 read/write mix Compute servers High core:drive ratio 10GbE NVMe SSD Throughput Digital media serving Server virtualization (OpenStack Cinder) Bloomberg Target, Walmart yahoo! High MB/Sec/GB Latency consistency Large sequential IO Balanced read/write Storage servers Balanced core:drive ratio 10GbE -> 40GbE HDD -> SSD Capacity-Archive Digital media archive Object archive yahoo! CERN Low cost/gb High write volume/hr Sequential IO 90/10 write/read mix Dense storage servers Low core:drive ratio 40GbE HDD

14 OVERWHELMINGLY PREFERRED FOR PRIVATE CLOUDS SOURCE: OpenStack User Survey, October 2015)

15 OPEN SOURCE COMMUNITY FOR DEVELOPMENT 78 AUTHORS/mo λ λ Contributions from Intel, SanDisk, CERN, and Yahoo. Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events COMMITS/mo 258 POSTERS/mo

16 RED HAT SUBSCRIPTIONS FOR PRODUCTION BENEFITS OF A RED HAT SUBSCRIPTION COMMUNITYS SUPPORT Recognized industry leadership in support services and online support Use at own risk PRODUCT FEATURES Only stable, production-ready code Bleeding-edge, often not widely-tested PRODUCT ACCESS RELEASE LIFECYCLE UPGRADES SECURITY / ACCOUNTABILITY Consistent quality; packaging available through Red Hat Satellite Well-defined, infrequent, hardened, curated, committed 3-year lifespan with strict policies Timely, tested patches with clearly-defined, documented, and supported migration path Backed by Red Hat Product Security, Red Hat Certification & Quality Assurance Programs Packages available from ceph.com, gluster.org, and Linux distributions Rapid releases, experimental, loosely tested, with an indefinite lifespan Not coordinated, roll your own, unsupported No official certification or single source of accountability ADDITIONAL RESOURCES/ SUBSCRIPTION BENEFITS Red Hat Knowledgebase (articles, tech briefs, videos, documentation), Automated Services INTERNAL USE ONLY

17 TEST DRIVE Test-drive: bit.ly/cephtestdrive

18 THANK YOU