OPEN HYBRID CLOUD ALEXANDRE BLIN CLOUD BUSINESS DEVELOPMENT Red Hat France
OPEN SOURCE : LA VOIE VERS L INNOVATION ovirt CLOUD Ceph RDO BIG DATA Hadoop OpenStack JBoss Community ManageIQ KVM 100,000+ PROJECTS Ansible Fedora I.T. MÉTIERS Gluster OpenShift Origin FuseSource Linux Kernel Apache MOBILE IoT CLOUD APPS
DES APPLICATIONS A L INFRASTRUCTURE
SOFTWARE-DEFINED STORAGE Frédéric MARSAUD EMEA Senior Solutions Architect Email : fmarsaud@redhat.com Tel : +33631536829 Yoann LEGRAND Sales Specialist Storage Email : ylegrand@redhat.com Tel : +33785943968
TODAY S CHALLENGES Costs Complexities Growth Downtime VM sprawl consumes expensive space on SAN infrastructures Managing complex storage infrastructures in virtual environments RAID for GB : too much time for rebuild Concerned about availability of virtual layer along with physical layer Staff training costs for specialized expertise Low storage utilization and less optimal performance Over or under storage provisioning : adding SAN costs. Long-term migration costs High Availability Costs
RED HAT'S UNIQUE APPROACH Harness Open Source innovation & deliver mission-critical IT solutions
THE RED HAT STORAGE PORTFOLIO OPEN SOURCE SOFTWARE Ceph management Ceph data service Gluster management Gluster data service Share-nothing, scale-out architecture provides durability and adapts to changing demands Self-managing and self-healing features reduce operational overhead STANDARD HARDWARE Standards-based interfaces and full APIs ease integration with applications and systems Supported by the experts at Red Hat Standard x86 servers
HOW STORAGE FITS PHYSICAL VIRTUAL PRIVATE CLOUD CONTAINERS PUBLIC CLOUD
RED HAT STORAGE Linux of Storage Red Hat Confidential - NDA Required
BUILT-IN RE-BALANCING FREES UP IT BUDGET RED HAT STORAGE Forklift upgrades Moves data to new node Upgrade without disruption Easily de-commission systems Migration costs
ENSURE DATA PROTECTION AND AVAILABILITY Geo-replication capability protects your data Remote site / disaster recovery Site A Site B
SET OF USE CASES ANALYTICS Big Data analytics with Hadoop Machine data analytics with Splunk CLOUD INFRASTRUCTURE RICH MEDIA AND ARCHIVAL Virtual machine storage with OpenStack Object storage for tenant applications Cost-effective storage for rich media streaming Active archives SYNC AND SHARE File sync and share with owncloud ENTERPRISE VIRTUALIZATION Storage for conventional virtualization with RHEV
RED HAT CEPH STORAGE Red Hat Confidential - NDA Required
THE CEPH PHILOSOPHY Failure is normal Scale out on commodity hardware Everything runs on software Solution must be 100% open source
REDHAT CEPH STORAGE OBJECT STORAGE S3 & Swift Multi-tenant Keystone Geo-Replication Native API BLOCK STORAGE Snapshots Clones OpenStack Linux Kernel iscsi
REDHAT CEPH HIGH LEVEL ARCHITECTURE APP HOST/VM 17
ARCHITECTURE COMPONENTS S3/SWIFT HOST/HYPERVISOR iscsi SDK INTERFACES STORAGE CLUSTERS OBJECT STORAGE MONITORS BLOCK STORAGE OBJECT STORAGE DAEMONS (OSD) 18
CEPH DATA ACCESS CRUSH OBJECT 10 01 01 11 Pseudo-random placement algorithm Fast calculation, no lookup Repeatable, deterministic Statistically uniform distribution Stable mapping Limited data migration on change Rule-based configuration Infrastructure topology aware Adjustable replication Weighting 01 01 01 11 10 10 RADOS CLUSTER 01 10 10 10 01 01
ERASURE CODING
CEPH DATA ACCESS
CEPH OPENSTACK INTEGRATION RED HAT ENTREPRISE LINUX OPENSTACK KEYSTONE RADOSGW LIBRADOS SWIFT CINDER LIBRBD GLANC E LIBRBD NOVA HYPER- VISOR LIBRBD Volumes Ephemeral Copy-on-Write RADOS CLUSTER Snapshots
CLOUD STORAGE S3/Swift S3/Swift S3/Swift S3/Swift 23
MULTI-SITE OBJECT STORAGE
RHCS Multi-site Use Case Public Sector Customer Business Needs: Unsecure data storage(local, external) Consolidate various needs from different entities(shares, private and public data) Built services offering: - Object like owncloud - Bloc for virtual machine Solution: One RHCS Cluster for 3 sites 750 TB Usable Scalability with capacity and performance Security Rely on the built-in data protection features Avoid downtime
COMCAST NEEDED WEB-SCALE STORAGE Object storage that is scalable, flexible, nimble, and cost-effective Comcast s XFINITY X1 Entertainment Operating System powers set-top boxes for their nationwide cable network. Comcast is the world s largest broadcasting and cable company, and the largest internet service provider in the US. Seasonal application surges create fluctuation in storage needs that traditional hardware-based solutions cannot meet. Red Hat Ceph Storage provides an object store that allows Comcast to deliver apps and content to millions of subscribers.
WORKLOAD DESIGN CRITERIAS OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED Object Storage Suite Spot
SERVICE TYPE DESIGN CHOICES OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED 2-4x PCIe/NVMe slot servers (PCIe) 12x 2.5 SSD bay servers (SAS/SATA) THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED 12-16x 3.5 bay servers 24-36x 3.5 bay servers 24-36x 3.5 bay servers 60-72x 3.5 bay servers
CONFIGURATION DESIGN CHOICES OpenStack Starter 100TB S 500TB M 1PB L 2PB IOPS OPTIMIZED THROUGHPUT OPTIMIZED COST- CAPACITY OPTIMIZED Ceph RBD (block) OSDs on all flash media (SATA SSD or PCIe) High-bin, dual-socket CPU 2x replication w/ backup or 3x replication Multiple OSDs per drive (if PCIe) Ceph RBD (block) or RGW (object) OSDs on HDD media with dedicated SSD write journals (4:1 ratio) Mid-bin, dual-socket CPU (single-socket adequate, servers <=12 OSDs) 3x replication (RBD/RGW read intensive) or erasure-coded (RGW write-intensive) High-bandwidth networking, >10Gb (for servers with >12 OSDs) Ceph RGW (object) OSDs on HDD media (write journals co-located on HDDs) Mid-bin, single-socket CPU (dual-socket, servers >12 OSDs) Erasure-coded data protection (v. replication)
WHAT S NEW IN 2016 Red Hat Confidential - NDA Required
RED HAT STORAGE November March 1.3.2 SELinux Satellite 5 support Container Ready (Preview) 3.1.2 Tiering, SMB Perf., Writable Snapshots Container Ready 8 (April) Hyper Converged Support (NFV) 64TB Batteries Included 3.1.2 Dedicated Tier Storage Native Kubernetes driver Support for RHGS 3.1 Support for RHCS 1.3
RED HAT CEPH STORAGE v1.3 (June 2015) v1.3.z (Q3/Q4 2015) v2.0 and Beyond (2016) MGMT OBJECT BLOCK CORE OSD w/ssd optimization More robust rebalancing Improved repair process Local and pyramid erasure codes Improved read IOPS Faster booting from clones S3 object versioning Bucket sharing Foreman/puppet installer CLI :: Calamari API parity Multi-user and multi-cluster MGMT OBJECT BLOCK CORE SELinux LTTNG Tracepoints Swift Storage Policies SELinux Puppet Modules (Tech Preview) MGMT OBJECT BLOCK CORE Performance Consistency Guided Repair New Backing Store (Tech Preview) iscsi Mirroring NFS Active/Active multi-site New UI Alerts Ceph Hammer Ceph Hammer Ceph Jewel
REDHAT STORAGE CONTROLLER WEB CONSOLE A browser interface designed for managing distributed storage API A full API for automation and integration with outside systems COMMAND LINE A robust, scriptable commandline interface for expert operators PROVISION INSTALL CONFIGURE TUNE MONITOR Full lifecycle management for distributed, software-defined data services OBJECT STORE VIRTUAL BLOCK DEVICE DISTRIBUTED FILE SYSTEM Storage Cluster on commodity hardware https://www.youtube.com/watch?v=lvyqllnuyny
REDHAT STORAGE CONTROLLER
The Red Hat Stack From PaaS to Storage DevOps Tools and User Experience Language Runtimes and Middleware Databases and Other Services Container Orchestration and Management Container API Container Host Storage
MORE INFORMATION Red Hat General Red Hat Gluster Storage - https://access.redhat.com/documentation/en-us/red_hat_storage/ Red Hat Gluster Storage Compatibility https://access.redhat.com/articles/66206#red_hat_gluster_storage_compatibility Red Hat Ceph Storage https://access.redhat.com/documentation/en/red hat ceph storage/ Red Hat Ceph Storage Cluster Recommended Practices - https://access.redhat.com/articles/1273193 Where to find more information: http://redhatstorage.redhat.com http://www.youtube.com/user/redhatstorage http://docs.ceph.com/docs/master/rbd/rbd openstack/ Sales Tools Case studies - www.redhat.com/resourcelibrary/case-studies/ Datasheets and brochures - www.redhat.com/resourcelibrary/datasheets/ Online tools - www.redhat.com/resourcelibrary/onlinetools/ Reference architectures - www.redhat.com/resourcelibrary/reference-architectures/ Webinars - www.redhat.com/resourcelibrary/webinars/ Whitepapers - www.redhat.com/resourcelibrary/whitepapers/
Thank You