Overview of Data Reduction in IBM FlashSystem A9000

Transcription

1 Overview of Data Reduction in IBM FlashSystem A9000 Guy Meir Real Time Compression Technical Team Leader STG Storage Europe 2011 IBM Corporation

2 The Primary Storage Growth Challenge Primary storage continues to grow 35% to 65% for most companies This cost to much! Growth is a factor of: Natural growth Snapshots - Mirrors - Clones Replicas All of this data is being backed up Of the backup data, a good deal of it is being replicated for DR purposes Everyone wants data to be live, fast, and accessible. No one is willing to compromise on secondary tiers Users say My data can not reside on slower tiers Disk Mirrors Snapshots Clones Servers How will I manage Disk that Replicas? Virtual Servers Disk Backup Disk Backup Tape Archive Archive Mirrors Snapshots Clones Off-Site Data Storage 2 Storwize 2010 Storwize Confidential and Proprietary 2

3 The Primary Storage Speed Challenge Primary storage users demands keeps growing CPUs are getting faster and faster Application are demanding more performance I want less latency!!! Users are LESS patient I need more IOPS!!! 3 Storwize 2010 Storwize Confidential and Proprietary

4 Introducing IBM FlashSystem A9000 & IBM FlashSystem A9000R With Built in Data Reduction Capabilities Dynamic Performance for data intensive workloads FlashSystem A9000R Dynamic Performance for data at scale FlashSystem A9000R

5 IBM Real-time Compression Give Your Storage More Space Market Requirements Technology Value Data Reduction Real-time Random Access Compression Engine (RACE) Random Access Store more - Pay less No Performance Impact Performance Lowers Costs Real-time Compression Availability Better storage utilization Increased Energy Efficiency Transparency High Performance Lossless Flash Speed Disk Price Industry Standard Foundation 5

6 RACE Delivers Extraordinaire Efficiency One component responsible to all data reduction capabilities Compression Deduplication Pattern matching Always on Data Reduction All Data Reduction is done Inline Compression \ Decompression is done in HW Optimized integration into XIV stack 7

7 Flash-Optimized Data Efficiency Suite Optimizes Economics Designed together for comprehensive & complementary reduction PATTERN REMOVAL + DEDUPLICATION COMPRESSION THIN PROVISIONING SNAPSHOTS A B C D A B C D A B C D A B C D A B C D A B C D D C A B A C B D Supports scalable workloads Global, inline 8K block size w/4k alignment Hardware accelerated No performance-degrading background scrubs Inline Allocate capacity effectively Redirect-on-write Space-efficient High-performance 8

8 Deduplication and Pattern Detection 2011 IBM Corporation 9

9 Data Reduction Methods Data reduction methods: 8KB pattern detection Deduplication Compression 64KB user write Pattern removal Dedupe Compression

10 IBM Deduplication Systems Storage Basics Deduplication (Dedupe) is the capability of storing data that was written many times only once Basic operation : A fingerprint/hash is calculated for each block The fingerprints are stored in a repository Future writes query the repository for existing fingerprints If fingerprint is found a reference to the existing chunk is created A B C D D C A B A C B D A B C D A9000 dedupe is Global (System Wide)

11 Deduplication in Action Example Each color represents unique data Written by user: Actually written without deduplication : Actually written with deduplication: 25% (4:1):

12 Compression 2011 IBM Corporation 13

13 Real Time Compression Basics Compresses the data using standard industry LZ algorithm Utilize same code (RACE) as RTC on Storwize and the RTCA 10 years of experience Proven track record Stable and reliable Always on Utilize HW compression cards for compression \ decompression workloads Multiple engines in parallel Inline \ Real Time works on data as it is written \ read Temporal Locality advantages 14

14 Temporal Locality - Advantages RACE location in the data path allows for Time based compression Temporal Locality The relation between how data is written and how it is read application I/O written around the same time are likely related - and thereby likely to be read together in the future Allows for minimizing disk access and maximizing read cache effectiveness **Synthetic benchmarking tools disregards temporal locality completely (and some even compression ratio)

15 Integration into A IBM Corporation 17

16 FlashSystem A9000 Flash Optimized Data Path Three Controllers For Redundancy & Sustained Performance Host Write IO Interface Node Controller Front Distribution Interface Node Controller Front Distribution Interface Node Controller Front Distribution Once all three caches are written, the host is sent an acknowledgement Cache DRN Backend Distribution Cache DRN Backend Distribution Cache DRN Backend Distribution The system is free to receive the next data transfer while it deals with the final execution of the previous transfer IBM 18

17 Data Reduction Value 2011 IBM Corporation 19

18 Project Manager VS. Storage Manager Project manager request 10TB of storage space Only going to use 4TB this year and 4TB next year Thin-provisioning save 2TB Second layer of efficiency Compression & Deduplication Only uses the physical space (Thin Provisioning) Compressed the 8TB to 4TB All in all 4TB consumed space rest - 6TB are free 2 TB Thin Provisioning savings 10 TB 8 TB User data 8TB 4 TB Compression Savings 4 TB Used Space 20

19 Introducing IBM FlashSystem A9000 Simply efficient, simply consistent, simply reliable 8U modular offering Composed of 3 grid controllers & 1 flash enclosure Scales via IBM Hyper-Scale Manager Flash Enclosure-60 Flash Enclosure-150 Flash Enclosure-300 Effective Capacity 1 60 TB 150 TB 300 TB IBM MicroLatency modules 12 x 1.2 TB 12 x 2.9 TB 12 x 5.7 TB IOPS 2 Up to 500,000 Minimum latency 250 µs Host interface 8 or 16 Gb Fibre Channel + 10 Gb iscsi, or 10 Gb iscsi 1 Based on a 5.26 to 1 data reduction ratio; 2 70/30 read write

20 IBM FlashSystem A9000R Simply efficient, simply consistent, simply reliable FLASH ENCLOSURE Minimum Latency PERFORMANCE AT SCALE µs IOPS Up to 2M EFFECTIVE CAPACITY 1 GRID CONTROLLERS Number of grid elements 900 TB configuration 1.8 PB configuration TB 600 TB IB SWITCHES PDUS TB 900 TB TB 1,200 TB TB 1,500 TB GRID ELEMENT TB 1,800 TB IBM MicroLatency modules per flash enclosure 12 x 2.9 TB 12 x 5.7 TB 1 Based on a 5.26 to 1 data reduction ratio; 2 70/30 read/write

21 IBM Corporation IBM Corporation

22 Notices and Disclaimers Copyright 2016 by International Business Machines Corporation (IBM). No part of this document may be reproduced or transmitted in any form without written permission from IBM. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM. Information in these presentations (including information relating to products that have not yet been announced by IBM) has been reviewed for accuracy as of the date of initial publication and could include unintentional technical or typographical errors. IBM shall have no responsibility to update this information. THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IN NO EVENT SHALL IBM BE LIABLE FOR ANY DAMAGE ARISING FROM THE USE OF THIS INFORMATION, INCLUDING BUT NOT LIMITED TO, LOSS OF DATA, BUSINESS INTERRUPTION, LOSS OF PROFIT OR LOSS OF OPPORTUNITY. IBM products and services are warranted according to the terms and conditions of the agreements under which they are provided. IBM products are manufactured from new parts or new and used parts. In some cases, a product may not be new and may have been previously installed. Regardless, our warranty terms apply. Any statements regarding IBM's future direction, intent or product plans are subject to change or withdrawal without notice. Performance data contained herein was generally obtained in a controlled, isolated environments. Customer examples are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual performance, cost, savings or other results in other operating environments may vary. References in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Workshops, sessions and associated materials may have been prepared by independent session speakers, and do not necessarily reflect the views of IBM. All materials and discussions are provided for informational purposes only, and are neither intended to, nor shall constitute legal or other guidance or advice to any individual participant or their specific situation. It is the customer s responsibility to insure its own compliance with legal requirements and to obtain advice of competent legal counsel as to the identification and interpretation of any relevant laws and regulatory requirements that may affect the customer s business and any actions the customer may need to take to comply with such laws. IBM does not provide legal advice or represent or warrant that its services or products will ensure that the customer is in compliance with any law

23 Notices and Disclaimers Con t. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or the ability of any such third-party products to interoperate with IBM s products. IBM EXPRESSLY DISCLAIMS ALL WARRANTIES, EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM patents, copyrights, trademarks or other intellectual property right. IBM, the IBM logo, ibm.com, Aspera, Bluemix, Blueworks Live, CICS, Clearcase, Cognos, DOORS, Emptoris, Enterprise Document Management System, FASP, FileNet, Global Business Services, Global Technology Services, IBM ExperienceOne, IBM SmartCloud, IBM Social Business, Information on Demand, ILOG, Maximo, MQIntegrator, MQSeries, Netcool, OMEGAMON, OpenPower, PureAnalytics, PureApplication, purecluster, PureCoverage, PureData, PureExperience, PureFlex, purequery, purescale, PureSystems, QRadar, Rational, Rhapsody, Smarter Commerce, SoDA, SPSS, Sterling Commerce, StoredIQ, Tealeaf, Tivoli, Trusteer, Unica, urban{code}, Watson, WebSphere, Worklight, X-Force and System z Z/OS, are trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the Web at "Copyright and trademark information" at:

24 IBM Corporation IBM Corporation