Provisioning with SUSE Enterprise Storage Nyers Gábor Trainer & Consultant @Trebut gnyers@trebut.com
Managing storage growth and costs of the software-defined datacenter PRESENT Easily scale and manage data storage $ Control storage growth and manage costs FUTURE $ Support today s investment and adapt to the future 2
Enterprise Storage Capacity Utilization Q: How much of your data is stored where? 30-100 $/GB 10-20 $/GB 1-3 % 15-20% Tier 0: Ultra High Performance Storage Solid State disks Tier 1: Primary Storage High performance disk 1-10 $/GB 20-25% Tier 2: Secondary Storage Logs, On-line Backup, Reference- and Bulk Data High density disk 0.2-2 $/GB 50-60% of Enterprise Data Tier 3: Long Term Storage Compliance Archive, Typically Tape (40-60 c/gb) Long access time Source: article (click on link) 3
Enterprise Storage Capacity Utilization SUSE Storage sweet spot 1-3 % 15-20% 20-25% 50-60% of Enterprise Data Tier 0: Ultra High Performance Solid State disks (20-50 $/GB) Tier 1: High-value, OLTP High performance disk (7-12 $/GB) Tier 2 with Ceph Logs, Big Data, Analytics, On-line Backup, Reference- and Bulk Data 60-120 c/gb on-line access Tier 3: Compliance Archive, Long-term Retention Typically Tape (40-60 c/gb) Long access time Source: article (click on link) 4
A volume optimized example setup Server infrastructure consuming Ceph storage capacity Specifications Fill. rate : 80% (~363TB) Netto Storage : 450 TB Brutto Storage : 1360 TB Redundancy : 3x (1.4 with Erasure Codes) Nr. of nodes : 10x Annual Storage costs: ~70 ct/gb/year Data center infrastructure 5 Teamed network link 10Gbit Access Network 10x Ceph nodes 10Gbit Ceph Cluster Interconnect
Traditional Storage Ceph Hardware & Software Maintenance Contract ~33%, 5,2 G$ Revenue (EMC 2012) (Optional) Enterprise Support Contract Proprietary Management Software ~33%, 1,1 G$ R&D (EMC 2012) Open Source Management Software Proprietary Software Open Source Software Proprietary Hardware Commodity Hardware Disk Disk Disk Disk Disk Disk Disk Disk 6
Why Ceph? Scalability Upper Limit: ExaBytes, Incremental expansion No Single Point of Failure Typically 3 independent copies of everything 100% Software Defined Storage Completely hardware independent; Vendor Mixing Self managing, Self healing Designed for commodity hardware 7
Unified Storage Object Storage Foto's, Media files, Archives, Backups Block Storage (Currently Linux only) Virtualization, SAN File system Storage (Currently Linux only) Home directories, NAS Ceph Array 8
Unified Storage Object Storage Block Storage File system Storage Amazon S3, OpenStack Swift Multi-tenant Replication Erasure coding Clones Snapshots Native Linux kernel driver Thin provisioning POSIX compatibility CIFS / NFS Native Linux kernel driver Dynamic Subtree Partitioning 9
Object Store Comparison with traditional NAS/Files NAS / Files Object Contain data? Yes Yes Have metadata? Yes Yes Address space server:/path/to/files https://server/uuid Access features Read, Write, Seek, Lock Get, Put, Delete Access API Local filesystem, open() Remote, HTTP/REST API Scalability Vertical scalability Horizontal scalability Address space Platform dependent Platform independent 10
Support object, block or file system storage in the same cluster Management Node Object Storage Block Storage File System 001110111010110101101011010110110111010 001011010101010111011011101110001011010 001110111101110100101101011101111011011 111010110101101101110100111010110101010 Remote Cluster Data Encrypted at Rest Automated management Data compression Heterogeneous OS Access Monitor Nodes 11
Scale storage from terabytes to hundreds of petabytes without downtime BUSINESS OPERATIONS SOCIAL MEDIA % UPTIME 100 MOBILE DATA CUSTOMER DATA 12
Optimize performance with minimal monitoring and storage administration Management Node Object Storage Block Storage File System Monitor Nodes 13
Build enterprise class storage with commodity servers and disk drives $ Add capacity as needed Broaden choice of vendors Reduce capital expense 14
Heterogeneous operating system support with iscsi storage protocol PRESENT FUTURE $ Cluster Network OSD1 OSD2 OSD3 OSD4 RBD image Public Network RBD Module RBD Module iscsi Initiator iscsi Gateway iscsi Gateway 15
Connect block storage to virtual machines with SUSE OpenStack Cloud PRESENT FUTURE $ Resource Orchestration Virtual Systems Servers Storage Network
Demo Win7 Linux ISCSI initiator ISCSI target ISCSI target ses1 OSD storage node ses2 OSD storage node ses3 OSD storage node mon1 Monitor node mon2 Monitor node calamari Management node
Reduce storage costs and management with SUSE Enterprise Storage Adapt Quickly Control Costs Manage Less 18
Corporate Headquarters Maxfeldstrasse 5 90409 Nuremberg Germany +49 911 740 53 0 (Worldwide) www.suse.com Join us on: www.opensuse.org 20
Unpublished Work of SUSE LLC. All Rights Reserved. This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability. General Disclaimer This document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.