Provisioning with SUSE Enterprise Storage. Nyers Gábor Trainer &

Transcription

1 Provisioning with SUSE Enterprise Storage Nyers Gábor Trainer &

2 Managing storage growth and costs of the software-defined datacenter PRESENT Easily scale and manage data storage $ Control storage growth and manage costs FUTURE $ Support today s investment and adapt to the future 2

3 Enterprise Storage Capacity Utilization Q: How much of your data is stored where? $/GB $/GB 1-3 % 15-20% Tier 0: Ultra High Performance Storage Solid State disks Tier 1: Primary Storage High performance disk 1-10 $/GB 20-25% Tier 2: Secondary Storage Logs, On-line Backup, Reference- and Bulk Data High density disk $/GB 50-60% of Enterprise Data Tier 3: Long Term Storage Compliance Archive, Typically Tape (40-60 c/gb) Long access time Source: article (click on link) 3

4 Enterprise Storage Capacity Utilization SUSE Storage sweet spot 1-3 % 15-20% 20-25% 50-60% of Enterprise Data Tier 0: Ultra High Performance Solid State disks (20-50 $/GB) Tier 1: High-value, OLTP High performance disk (7-12 $/GB) Tier 2 with Ceph Logs, Big Data, Analytics, On-line Backup, Reference- and Bulk Data c/gb on-line access Tier 3: Compliance Archive, Long-term Retention Typically Tape (40-60 c/gb) Long access time Source: article (click on link) 4

5 A volume optimized example setup Server infrastructure consuming Ceph storage capacity Specifications Fill. rate : 80% (~363TB) Netto Storage : 450 TB Brutto Storage : 1360 TB Redundancy : 3x (1.4 with Erasure Codes) Nr. of nodes : 10x Annual Storage costs: ~70 ct/gb/year Data center infrastructure 5 Teamed network link 10Gbit Access Network 10x Ceph nodes 10Gbit Ceph Cluster Interconnect

6 Traditional Storage Ceph Hardware & Software Maintenance Contract ~33%, 5,2 G$ Revenue (EMC 2012) (Optional) Enterprise Support Contract Proprietary Management Software ~33%, 1,1 G$ R&D (EMC 2012) Open Source Management Software Proprietary Software Open Source Software Proprietary Hardware Commodity Hardware Disk Disk Disk Disk Disk Disk Disk Disk 6

7 Why Ceph? Scalability Upper Limit: ExaBytes, Incremental expansion No Single Point of Failure Typically 3 independent copies of everything 100% Software Defined Storage Completely hardware independent; Vendor Mixing Self managing, Self healing Designed for commodity hardware 7

8 Unified Storage Object Storage Foto's, Media files, Archives, Backups Block Storage (Currently Linux only) Virtualization, SAN File system Storage (Currently Linux only) Home directories, NAS Ceph Array 8

9 Unified Storage Object Storage Block Storage File system Storage Amazon S3, OpenStack Swift Multi-tenant Replication Erasure coding Clones Snapshots Native Linux kernel driver Thin provisioning POSIX compatibility CIFS / NFS Native Linux kernel driver Dynamic Subtree Partitioning 9

10 Object Store Comparison with traditional NAS/Files NAS / Files Object Contain data? Yes Yes Have metadata? Yes Yes Address space server:/path/to/files Access features Read, Write, Seek, Lock Get, Put, Delete Access API Local filesystem, open() Remote, HTTP/REST API Scalability Vertical scalability Horizontal scalability Address space Platform dependent Platform independent 10

11 Support object, block or file system storage in the same cluster Management Node Object Storage Block Storage File System Remote Cluster Data Encrypted at Rest Automated management Data compression Heterogeneous OS Access Monitor Nodes 11

12 Scale storage from terabytes to hundreds of petabytes without downtime BUSINESS OPERATIONS SOCIAL MEDIA % UPTIME 100 MOBILE DATA CUSTOMER DATA 12

13 Optimize performance with minimal monitoring and storage administration Management Node Object Storage Block Storage File System Monitor Nodes 13

14 Build enterprise class storage with commodity servers and disk drives $ Add capacity as needed Broaden choice of vendors Reduce capital expense 14

15 Heterogeneous operating system support with iscsi storage protocol PRESENT FUTURE $ Cluster Network OSD1 OSD2 OSD3 OSD4 RBD image Public Network RBD Module RBD Module iscsi Initiator iscsi Gateway iscsi Gateway 15

16 Connect block storage to virtual machines with SUSE OpenStack Cloud PRESENT FUTURE $ Resource Orchestration Virtual Systems Servers Storage Network

17 Demo Win7 Linux ISCSI initiator ISCSI target ISCSI target ses1 OSD storage node ses2 OSD storage node ses3 OSD storage node mon1 Monitor node mon2 Monitor node calamari Management node

18 Reduce storage costs and management with SUSE Enterprise Storage Adapt Quickly Control Costs Manage Less 18

19

20 Corporate Headquarters Maxfeldstrasse Nuremberg Germany (Worldwide) Join us on: 20

21 Unpublished Work of SUSE LLC. All Rights Reserved. This work is an unpublished work and contains confidential, proprietary and trade secret information of SUSE LLC. Access to this work is restricted to SUSE employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of SUSE. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability. General Disclaimer This document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. SUSE makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for SUSE products remains at the sole discretion of SUSE. Further, SUSE reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All SUSE marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.