OPEN HYBRID CLOUD. ALEXANDRE BLIN CLOUD BUSINESS DEVELOPMENT Red Hat France

Transcription

1 OPEN HYBRID CLOUD ALEXANDRE BLIN CLOUD BUSINESS DEVELOPMENT Red Hat France

2 OPEN SOURCE : LA VOIE VERS L INNOVATION ovirt CLOUD Ceph RDO BIG DATA Hadoop OpenStack JBoss Community ManageIQ KVM 100,000+ PROJECTS Ansible Fedora I.T. MÉTIERS Gluster OpenShift Origin FuseSource Linux Kernel Apache MOBILE IoT CLOUD APPS

3 DES APPLICATIONS A L INFRASTRUCTURE

4 SOFTWARE-DEFINED STORAGE Frédéric MARSAUD EMEA Senior Solutions Architect fmarsaud@redhat.com Tel : Yoann LEGRAND Sales Specialist Storage ylegrand@redhat.com Tel :

5 TODAY S CHALLENGES Costs Complexities Growth Downtime VM sprawl consumes expensive space on SAN infrastructures Managing complex storage infrastructures in virtual environments RAID for GB : too much time for rebuild Concerned about availability of virtual layer along with physical layer Staff training costs for specialized expertise Low storage utilization and less optimal performance Over or under storage provisioning : adding SAN costs. Long-term migration costs High Availability Costs

6

7 RED HAT'S UNIQUE APPROACH Harness Open Source innovation & deliver mission-critical IT solutions

8 THE RED HAT STORAGE PORTFOLIO OPEN SOURCE SOFTWARE Ceph management Ceph data service Gluster management Gluster data service Share-nothing, scale-out architecture provides durability and adapts to changing demands Self-managing and self-healing features reduce operational overhead STANDARD HARDWARE Standards-based interfaces and full APIs ease integration with applications and systems Supported by the experts at Red Hat Standard x86 servers

9 HOW STORAGE FITS PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD

10 RED HAT STORAGE Linux of Storage Red Hat Confidential - NDA Required

11 BUILT-IN RE-BALANCING FREES UP IT BUDGET RED HAT STORAGE Forklift upgrades Moves data to new node Upgrade without disruption Easily de-commission systems Migration costs

12 ENSURE DATA PROTECTION AND AVAILABILITY Geo-replication capability protects your data Remote site / disaster recovery Site A Site B

13 SET OF USE CASES ANALYTICS Big Data analytics with Hadoop Machine data analytics with Splunk CLOUD INFRASTRUCTURE RICH MEDIA AND ARCHIVAL Virtual machine storage with OpenStack Object storage for tenant applications Cost-effective storage for rich media streaming Active archives SYNC AND SHARE File sync and share with owncloud ENTERPRISE VIRTUALIZATION Storage for conventional virtualization with RHEV

14 RED HAT CEPH STORAGE Red Hat Confidential - NDA Required

15 THE CEPH PHILOSOPHY Failure is normal Scale out on commodity hardware Everything runs on software Solution must be 100% open source

16 REDHAT CEPH STORAGE OBJECT STORAGE S3 & Swift Multi-tenant Keystone Geo-Replication Native API BLOCK STORAGE Snapshots Clones OpenStack Linux Kernel iscsi

17 REDHAT CEPH HIGH LEVEL ARCHITECTURE APP HOST/VM 17

18 ARCHITECTURE COMPONENTS S3/SWIFT HOST/HYPERVISOR iscsi SDK INTERFACES STORAGE CLUSTERS OBJECT STORAGE MONITORS BLOCK STORAGE OBJECT STORAGE DAEMONS (OSD) 18

19 CEPH DATA ACCESS CRUSH OBJECT Pseudo-random placement algorithm Fast calculation, no lookup Repeatable, deterministic Statistically uniform distribution Stable mapping Limited data migration on change Rule-based configuration Infrastructure topology aware Adjustable replication Weighting RADOS CLUSTER

20 ERASURE CODING

21 CEPH DATA ACCESS

22 CEPH OPENSTACK INTEGRATION RED HAT ENTREPRISE LINUX OPENSTACK KEYSTONE RADOSGW LIBRADOS SWIFT CINDER LIBRBD GLANC E LIBRBD NOVA HYPER- VISOR LIBRBD Volumes Ephemeral Copy-on-Write RADOS CLUSTER Snapshots

23 CLOUD STORAGE S3/Swift S3/Swift S3/Swift S3/Swift 23

24 MULTI-SITE OBJECT STORAGE

25 RHCS Multi-site Use Case Public Sector Customer Business Needs: Unsecure data storage(local, external) Consolidate various needs from different entities(shares, private and public data) Built services offering: - Object like owncloud - Bloc for virtual machine Solution: One RHCS Cluster for 3 sites 750 TB Usable Scalability with capacity and performance Security Rely on the built-in data protection features Avoid downtime

26 COMCAST NEEDED WEB-SCALE STORAGE Object storage that is scalable, flexible, nimble, and cost-effective Comcast s XFINITY X1 Entertainment Operating System powers set-top boxes for their nationwide cable network. Comcast is the world s largest broadcasting and cable company, and the largest internet service provider in the US. Seasonal application surges create fluctuation in storage needs that traditional hardware-based solutions cannot meet. Red Hat Ceph Storage provides an object store that allows Comcast to deliver apps and content to millions of subscribers.

27 WORKLOAD DESIGN CRITERIAS OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED Object Storage Suite Spot

28 SERVICE TYPE DESIGN CHOICES OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED 2-4x PCIe/NVMe slot servers (PCIe) 12x 2.5 SSD bay servers (SAS/SATA) THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED 12-16x 3.5 bay servers 24-36x 3.5 bay servers 24-36x 3.5 bay servers 60-72x 3.5 bay servers

29 CONFIGURATION DESIGN CHOICES OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED Ceph RBD (block) OSDs on all flash media (SATA SSD or PCIe) High-bin, dual-socket CPU 2x replication w/ backup or 3x replication Multiple OSDs per drive (if PCIe) Ceph RBD (block) or RGW (object) OSDs on HDD media with dedicated SSD write journals (4:1 ratio) Mid-bin, dual-socket CPU (single-socket adequate, servers <=12 OSDs) 3x replication (RBD/RGW read intensive) or erasure-coded (RGW write-intensive) High-bandwidth networking, >10Gb (for servers with >12 OSDs) Ceph RGW (object) OSDs on HDD media (write journals co-located on HDDs) Mid-bin, single-socket CPU (dual-socket, servers >12 OSDs) Erasure-coded data protection (v. replication)

30 WHAT S NEW IN 2016 Red Hat Confidential - NDA Required

31 RED HAT STORAGE November March SELinux Satellite 5 support Container Ready (Preview) Tiering, SMB Perf., Writable Snapshots Container Ready 8 (April) Hyper Converged Support (NFV) 64TB Batteries Included Dedicated Tier Storage Native Kubernetes driver Support for RHGS 3.1 Support for RHCS 1.3

32 RED HAT CEPH STORAGE v1.3 (June 2015) v1.3.z (Q3/Q4 2015) v2.0 and Beyond (2016) MGMT OBJECT BLOCK CORE OSD w/ssd optimization More robust rebalancing Improved repair process Local and pyramid erasure codes Improved read IOPS Faster booting from clones S3 object versioning Bucket sharing Foreman/puppet installer CLI :: Calamari API parity Multi-user and multi-cluster MGMT OBJECT BLOCK CORE SELinux LTTNG Tracepoints Swift Storage Policies SELinux Puppet Modules (Tech Preview) MGMT OBJECT BLOCK CORE Performance Consistency Guided Repair New Backing Store (Tech Preview) iscsi Mirroring NFS Active/Active multi-site New UI Alerts Ceph Hammer Ceph Hammer Ceph Jewel

33 REDHAT STORAGE CONTROLLER WEB CONSOLE A browser interface designed for managing distributed storage API A full API for automation and integration with outside systems COMMAND LINE A robust, scriptable commandline interface for expert operators PROVISION INSTALL CONFIGURE TUNE MONITOR Full lifecycle management for distributed, software-defined data services OBJECT STORE VIRTUAL BLOCK DEVICE DISTRIBUTED FILE SYSTEM Storage Cluster on commodity hardware

34 REDHAT STORAGE CONTROLLER

35 The Red Hat Stack From PaaS to Storage DevOps Tools and User Experience Language Runtimes and Middleware Databases and Other Services Container Orchestration and Management Container API Container Host Storage

36 MORE INFORMATION Red Hat General Red Hat Gluster Storage - Red Hat Gluster Storage Compatibility Red Hat Ceph Storage hat ceph storage/ Red Hat Ceph Storage Cluster Recommended Practices - Where to find more information: openstack/ Sales Tools Case studies - Datasheets and brochures - Online tools - Reference architectures - Webinars - Whitepapers -

37 Thank You