Next Generation Storage for The Software-Defned World

Size: px

Start display at page:

Download "Next Generation Storage for The Software-Defned World"

Barry Crawford
5 years ago
Views:

1 ` Next Generation Storage for The Software-Defned World John Hofer Solution Architect Red Hat, Inc.

2 BUSINESS PAINS DEMAND NEW MODELS CLOUD ARCHITECTURES PROPRIETARY/TRADITIONAL ARCHITECTURES High up-front costs, amortized ROI Enterprise agreements, inflexible terms Proprietary stacks with lock-in Single-vendor commitment High utilization of existing resources DOC r4 Based on open source, low up front costs Pay-as-you-go, metering and chargeback Heterogeneous architecture Multiple vendors, best of breed Grow and shrink resources according to demand, SLA, cost RED HAT 2013

3 TRADITIONAL ARCHITECTURE IS NOT THE ANSWER Source: IBM

STORAGE DESIGN GOALS Scale out Elimination of metadata Effective distribution of data to achieve scalability and flexibility Linear Scaling Capacity scale up vertically Performance scale out

4 STORAGE DESIGN GOALS Scale out Elimination of metadata Effective distribution of data to achieve scalability and flexibility Linear Scaling Capacity scale up vertically Performance scale out horizontally Elasticity Flexibly adapt to the growth or reduction of data in the enterprise Add or remove resources to/from storage pool with zero application disruption Deployment Agnostic Deploy on-premise, in the public cloud or a hybrid setup. Must run on commodity hardware Industry standard servers. No-purpose built hardware.

5 Upstream is Active!

6 RED HAT STORAGE 2.1 USE CASES Content Cloud Tier 2 or 3 Backup target General purpose file storage VM Store (RHEV) HPC throughput not IOPs

7 OPENSTACK SOFTWARE DEFINED INFRASTRUCTURE FOR CLOUD-ENABLED WORKLOADS Modular architecture Designed to easily scale out Based on (growing) set of core services DOC r4 RED HAT 2013

DEFINED STORAGE ENTERPRISE MOBILITY CLOUD

storage architecture Standard x86 systems

8 OPEN HYBRID SCALE-OUT SOFTWARE-DEFINED STORAGE PLATFORM DATA SERVICES ENTERPRISE APPLICATIONS BIG DATA WORKLOADS OPEN OBJECT APIs FILE SERVICES SOFTWARE DEFINED STORAGE ENTERPRISE MOBILITY CLOUD APPLICATIONS CONVERGED COMPUTE AND STORAGE OPEN, SOFTWARE-DEFINED STORAGE PLATFORM PHYSICAL VIRTUAL CLOUD Scale-out storage architecture Standard x86 systems Scale-out NAS solutions Include idle or legacy resources EBS EBS

9 Red Hat Storage technology stack CIFS HADOOP ENABLEMENT SAMBA USER APP FUSE SWIFT CLIENT/ PRESENTATION QEMU NFS REPLICATION TRANSLATORS BACKEND/ PERSIST TRANSLATORS MANAGE MULTI-SITE DR GLUSTERFS FRAMEWORK PLATFORM MANAGEABILITY GLUSTERFS XFS NETWORK STACK OTHER MULTI-TENANT: NAMESPACE AND ENCRYPT MULTI-TENANT: QoS (CGROUPS) LOCAL FILESYSTEM LOGICAL VOLUME MANAGEMENT NETWORK DEVICE PLATFORM HARDWARE ENABLEMENT RED HAT ENTERPRISE LINUX BLOCK DEVICE VOLUME SNAPSHOT

10 REDconcepts HAT STORAGE CONCEPTS Red Hat Storage VOLUME SERVER/NODES A namespace presented as a POSIX mount point and is comprised of bricks. The basic unit of storage, represented by an export directory on a server Contain the bricks

11 Red Hat Storage user perspective (distributed volumes) DISTRIBUTED VOLUME DISTRIBUTED VOLUME server2:/exp1 server1:/exp1 MOUNT POINT server1:/exp1 server2:/exp1 FILE 1 FILE 2 FILE 3

12 Red Hat Storage user perspective (replicated volumes) REPLICATED VOLUME server2:/exp1 server1:/exp1 MOUNT POINT FILE 1 FILE 2

13 Red Hat Storage user perspective (distributed replicated volumes) DISTRIBUTED VOLUME MOUNT POINT Replicated Volume 0 server1 (exp1) FILE 1 Replicated Volume 1 server2 (exp2) server3 (exp3) FILE 2 server4 (exp4)

14 Red Hat Storage Server for On-premise Scale out performance, capacity, and availability Global namespace Scale up capacity RED HAT STORAGE RED HAT STORAGE FOR ON-PREMISE FOR ON-PREMISE Aggregates CPU, memory, network capacity. SERVER (CPU/MEM) SERVER Deploys on Red Hat-supported servers and underlying storage: DAS, JBOD. (CPU/MEM) 1TB 1TB Scale out linearly. Scale out performance and capacity as needed. Replicate synchronously and asynchronously. SINGLE GLOBAL NAMESPACE

15 HAT STORAGE SERVER FOR PUBLIC CLOUD Red HatRED Storage Server for Public Cloud Scale out performance, capacity, and availability GlusterFS Amazon Machine Images (AMIs) Scale up capacity RED HAT STORAGE FOR PUBLIC CLOUD The only way to achieve high availability of Elastic Block Storage (EBS) Multiple EBS devices pooled EC2 POSIX compatible (no application to rewrite required to run on Amazon EC2) EBS SINGLE GLOBAL NAMESPACE Scale out capacity and performance as needed

16 What is productized in Red Hat Storage? Red Hat Enterprise Linux XFS GlusterFS Red Hat Storage console management station A pre-integrated, pre-verified and ready to run software platform Physical Server: 2 socket x86 with disks or Virtual Server: Amazon, AWS, Red Hat Virtualization, or VMware Sourced by customer

UNSTRUCTURED DATAGROWTH GROWTH AND ACCELERATION UNSTRUCTURED DATA AND ACCELERATION CLOUD/VIRT DRIVING Cloud use of scale-out storage Scale-out storage shipments will exceed 63,000 PB by 2015 (74%

17 UNSTRUCTURED DATAGROWTH GROWTH AND ACCELERATION UNSTRUCTURED DATA AND ACCELERATION CLOUD/VIRT DRIVING Cloud use of scale-out storage Scale-out storage shipments will exceed 63,000 PB by 2015 (74% CAGR)* Big Data/ No SQL MODERN STORAGE INFRASTRUCTURE 40% OF CORE CLOUD SPEND is storage related Unstructured data volumes EXPECTED TO GROW44X BY 2020* Scale-out NAS software VIRT $7B BY 2015 *Source: Gartner, IDC, 451 Group

Red Hat Storage Server for AWS

Red Hat Storage Server for AWS Craig Carl Solution Architect, Amazon Web Services Tushar Katarki Principal Product Manager, Red Hat Veda Shankar Principal Technical Marketing Manager, Red Hat GlusterFS