Why software defined storage matters? Sergey Goncharov Solution Architect, Red Hat

Transcription

1 Why software defined storage matters? Sergey Goncharov Solution Architect, Red Hat

2 AGENDA Storage and Datacenter evolution Red Hat Storage portfolio Red Hat Gluster Storage Red Hat Ceph Storage Red Hat Storage roadmap and future Q/A

3 WHAT IS SOFTWARE-DEFINED STORAGE? SERVER-BASED 3 CENTRALIZED CONTROL OPEN ECOSYSTEM

4 THE DATACENTER IS EVOLVING 4 DEVELOPMENT MODEL APPLICATION ARCHITECTURE DEPLOYMENT AND PACKAGING APPLICATION INFRASTRUCTURE STORAGE Waterfall Monolithic Bare Metal Data Center Scale Up Agile N-Tier Virtual Services Hosted Scale Out DEVOPS MICROSERVICES CONTAINERS HYBRID CLOUD SOFTWARE-DEFINED STORAGE

5 SERVER-BASED STORAGE Server-based storage is the use of software and standard hardware to provide services traditionally provided by single-purpose storage appliances (similar to server virtualization, which uses software to emulate servers), providing increased agility and efficiency. 5 Appliance Appliance Appliance Distributed Cluster of Services

6 STORAGE ORCHESTRATION Storage orchestration is the ability to provision, grow, shrink, and decommission storage resources on-demand and programmatically, providing increased control and integration of storage into a software-defined data center. Web Console API Command Line A browser interface designed for managing distributed storage A full API for automation and integration with outside systems A robust, scriptable command-line interface for expert operators PROVISION INSTALL CONFIGURE TUNE Full life cycle management for distributed, software-defined data services 6 MONITOR

7 GROWING INNOVATION COMMUNITIES 97 AUTHORS/MO Contributions from Intel, SanDisk, CERN, and Yahoo 2,453 COMMITS/MO Presenting Ceph Days in cities around the world and quarterly virtual Ceph Developer Summit events 260 POSTERS/MO 33 AUTHORS/MO 7 Over 11M downloads in the last 12 months 97 COMMITS/MO Increased development velocity, authorship, and discussion has resulted in rapid feature expansion 138 POSTERS/MO

8 THE FUTURE OF STORAGE TRADITIONAL STORAGE Complex proprietary silos 8 ADMIN ADMIN Custom GUI Custom GUI Custom GUI Proprietary Hardware Proprietary Hardware Proprietary Hardware Proprietary Software Proprietary Software Proprietary Software ADMIN Open Source Software ADMIN Standard Hardware OPEN, SOFTWARE-DEFINED STORAGE Standardized, unified, open platforms Control Plane (API, GUI) Ceph Gluster Standard Computers and Disks +++

9 STANDARD HARDWARE OPEN SOURCE SOFTWARE THE RED HAT STORAGE PORTFOLIO 9 Share-nothing, scale-out architecture provides durability and adapts to changing demands Ceph management Ceph data service Gluster management Gluster data service Self-managing and self-healing features reduce operational overhead Standards-based interfaces and full APIs ease integration with applications and systems Supported by the experts at Red Hat

10 HOW STORAGE FITS RED HAT STORAGE PHYSICAL 10 VIRTUALIZATION PRIVATE CLOUD CONTAINERS PUBLIC CLOUD

11 RED HAT GLUSTER STORAGE Open source, software-defined storage for unstructured file data at petabyte scale Media, video Machine, Log Data GeoSpatial Persistent Storage Documents

12 RED HAT GLUSTER STORAGE ADVANTAGES OPEN Open, software-defined distributed file and object store SCALABLE No Metadata Server ACCESSIBLE Multi-Protocol the Same Data MODULAR No Kernel Dependencies ALWAYS-ON High-Availability across data, systems and applications Based on GlusterFS open source community project Uses proven local file system (XFS) Data is stored in native format Uses an elastic hashing algorithm for data placement Uses local filesystem s xattrs to store metadata Nothing shared scale-out architecture Global name space NFS, SMB, object, HDFS, Gluster native protocol Posix compliant GlusterFS is based on filesystem in userspace (FUSE) Modular stackable arch allows easy addition of features...without being tied to any kernel versioniant Synchronous replication with self-healing for server failure Asynchronous geo-replication for site failure

13 GLUSTER ARCHITECTURE Distributed scale out storage using industry standard hardware NFS CIFS FUSE SERVERS WITH LOCAL DISKS Aggregates systems to one cohesive unit and presents using common protocols

14 WHY RED HAT CEPH STORAGE FOR OBJECTS? Proven at Web-Scale for Object Storage Flexible Storage for Your Applications Data Protection, Reliability & Availability Enterprises Demand Open, Community Based Software Defined Storage for Object Storage Cost Effective Object Storage to Help You Maximize Your Storage Budget

15 CEPH ARCHITECTURE APPLICATION HOST / VM CLIENT RGW RBD CEPHFS* A web services gateway for object storage, compatible with S3 & Swift A reliable, fully-distributed block device with cloud platform integration A distributed file system with POSIX semantics & scale-out metadata LIBRADOS A library allowing apps to directly access RADOS (C, C++, Java, Python, Ruby, PHP) RADOS A software-based, reliable, autonomous, distributed object store comprised of self-healing, self-managing, intelligent storage nodes and lightweight monitors * TECH PREVIEW 15

16 NEW INTEGRATED MANAGEMENT WITH RED HAT STORAGE CONSOLE 2 ADMINS Easy to use graphical interface to manage storage cluster life cycle Ansible-based deployment tools for installation, importation, and granular configuration from CLI or GUI Monitoring and troubleshooting with statistical and graphical information about cluster components CLIENTS RED HAT STORAGE CONSOLE 2 RADOS. RGW, RBD, CALAMARI CLUSTER OF STANDARD SERVERS AND MEDIA

17 ROAD MAP: RED HAT GLUSTER STORAGE SELINUX DEVICE MANAGEMENT SSL ENCRYPTION ( IN-FLIGHT) GEO-REPLICATION, SNAPSHOTS DASHBOARD Gluster 3.7, RHEL 6, 7 SMB 3 (ADVANCED FEATURES) MULTI-CHANNEL CORE FILE CONTROLLED REBALANCE AT-REST ENCRYPTION SEC SEC SMB 3 (BASIC SUBSET) FASTER SELF-HEAL DYNAMIC PROVISIONING OF RESOURCES MGMT ACTIVE/ACTIVE NFSV4 CORE SNAP SCHEDULE FILE TIERING INODE QUOTAS FUTURE (v4.0 and beyond) SEC BIT ROT DETECTION V3.2 (H1-2016) MGMT ERASURE CODING MGMT FILE CORE TODAY (v3.1) Gluster 3.8, RHEL 6, 7 COMPRESSION DEDUPLICATION HIGHLY SCALABLE CTRL PLANE NEXT-GEN REPLICATION DISTRIBUTION pnfs QOS CLIENT SIDE CACHING NEW UI GLUSTER REST API Gluster 4, RHEL 7

18 RED HAT CEPH STORAGE 2 (today) OBJECT Support for global clusters AD, LDAP, Keystone v3 Expanded API compatibility NFS gateway (tech preview) BLOCK Mirroring CORE Bluestore (tech preview) Performance optimizations MANAGEMENT Red Hat Storage Console 2 Lifecycle management Ansible support CORE Bluestore general availability Data checksums End-to-end SSL Improved multi-threading FILE Active/active metadata servers Snapshots Hypervisor integration RED HAT CEPH STORAGE 2.1 (Q4 2016) OBJECT AWS Secure Token Service (STS) BLOCK iscsi UPSTREAM ACTIVITY (in the future) OBJECT Metadata search Tiering to public cloud Object-level encryption Compression BLOCK Distributed client-side cache Improved iscsi support

19