Open Systems Virtualization and Enterprise-Class De-duplication for Your Information Infrastructure

Transcription

1 Open Systems Virtualization and Enterprise-Class De-duplication for Your Information Infrastructure Technology Day IBM Paris 10 mars 2009 Marc-Audic Landreau

2 Four Client Pain Points Addressed A better way to manage information and mitigate business risks Information Availability Deliver continuous and reliable access to information Heterogeneous storage virtualization Unified management console Future-proof data migration services Information Security Protect and enable secure sharing of information Data and media encryption Secure Access control Continuous data protection Information Retention Support your information retention policies Optimized, efficient tiered storage Data de-duplication, compression Integrated archiving solutions Information Compliance Reduce reputation risks and audit deficiencies Data discovery, classification Tunable service levels Information lifecycle management 2 10-Mar-09

3 De-duplication - A form of compression Refers to the elimination of redundant data elements. (aka. chunks, blocks, extents or patterns ). Only one instance is stored for each common element. Data Store Data Store Data Store C B A C B A C b a A A B A C B A A B A C B A a B a c b 1. Data elements are evaluated to determine a unique signature for each. 2. Signature values are compared to identify all duplicates. 3. Duplicate data elements are replaced with pointers to a single stored element Mar-09

4 Deduplication is HOT! Organizations are deploying deduplication to address the backup issues they are facing 61% Need to reduce backup times 61% Cost of backup and recovery infrastructure 56% Keeping pace with capacity of data growth Deduplication is Number 1 on Heat Index 150 of Fortune 1000 firms prioritized their nearterm spending plans 24% using deduplication now 16% plan to implement in near term 28% plan to implement in long term Deduplication is becoming mainstream Total terabytes anticipated to increase at a 29.2% CAGR 65% of the total amount of terabytes being used for backup will be using data deduplication by 2012 Estimate the current data reduction rate of 15:1 in 2008 will increase to 20:1 by the close of Mar-09

5 Storage Networking Technology Ranking of User Needs and Planned Spending for Each Technology Rank 1 2 Technology Deduplication Virtual Tape Library (VTL) for Open Systems Score Source: TheInfoPro, Inc. Wave 10 Survey, Jan Mar-09

6 Storage Professionals Pain Points What are your two biggest Storage related pain points? Managing Storage Growth Proper Capacity Forecasting & Storage Reporting Backup Administration & Management Managing Costs Managing Complexity Storage Provisioning Archiving and Archive Management Dealing with Performance Problems Data Mobility Lack of Integrated Tools Regulatory Compliance Power Management Vendor Management 0% 10% 20% 30% 40% 50% TheInfoPro Storage Study Wave 9 (4/5/07): F1000 Sample. n=149. Other n=14. *Multiple responses recorded 6 10-Mar-09

7 ProtecTIER s Growing Market Presence Only Enterprise Data-Center inline de-duplication platform Launched in Q (over 24 months in production) 3 of the Top 10 Global Telecommunications Companies 3 of the Top 10 Global Media & Entertainment Companies 3 of the Top 10 Global Consumer Electronics Companies 2 of the Top 10 Government Agencies Top 10 Global Commercial Banking Firm, Global Investment Firm, Global Cellular Company, Global Healthcare Service Provider, Global Car Manufacturer Vital Stats Global reach via IBM channel Over 200 Customers worldwide; 500 systems in production Over 20 PB of disk capacity under management 7 10-Mar-09

8 Changing the Data Protection Game Protect More Store Less ProtecTIER reduces the required backup disk capacity by up to 25X s or more 8 10-Mar-09

9 TS7650G ProtecTIER Overview Virtual Tape Library FC Backup Server TS7650G Disk Array Software solution that resides on standard Linux server Emulates a tape library unit, including drives, cartridges and robotics Uses FC-attached disk array as the backup medium 9 10-Mar-09

10 New Data Stream Repository Memory Resident Index FC Switch TS7650G Disk Arrays Backup Servers Ratio of Repository to Index: 250,000 : 1 Filtered data Mar-09

11 ProtecTIER Functional Layers User data is written to ProtecTIER VT as tape Data goes through HyperFactor and only new data is written Existing version data is referenced When an overwrite occurs references are removed Space is possibly reclaimed A B C D E F G H I J Mar-09

12 TS7650G ProtecTIER De-Duplication Gateway, Clustered FC Switch TS7650G x 2 2 Node Cluster Backup Servers Backup Arrays Active-active true clustered nodes High performance (900MB/s sustainable) Highly available Mar-09 High capacity, highly scalable Easily manageable two nodes working together one repository

13 The Impact of HyperFactor Master Server Represented capacity Backup Server ProtecTIER Server Physical capacity Up to 25X the physical capacity Mar-09

14 IBM TS7650 ProtecTIER Deduplication Appliance Pre-configured for rapid deployment into existing backup environments Extremely powerful solutions, featuring: IBM ProtecTIER software with patented HyperFactor deduplication technology IBM System x Server multi-core server for enterprise-level performance IBM Storage Controller with Fibre Channel drives - Proven reliability and performance IBM TS3000 System Console for Call Home and Remote Support Complete solution that includes rack, cables, switches, and everything that is needed Mar-09

15 IBM TS7650 ProtecTIER Deduplication Appliance Highest Performance Largest Capacity High Availability Good Performance Highly Scalable Low cost Up to 100 MB/sec 7 TB useable Better Performance Larger Capacity Scalable Up to 250 MB/sec 18 TB useable Highest Performance Largest Capacity Scalable Capacity and Performance Up to 500 MB/sec 36 TB useable Active-Active Cluster Up to 500 MB/sec 36 TB useable Announce Feb 9, 2009 Planned GA Mar Mar-09

16 Replication with ProtecTIER Primary Site Backup Server ProtecTIER Gateway Represented capacity Physical capacity Backup Server Significant bandwidth reduction Secondary Site PT-server based replication Represented capacity Backup Server ProtecTIER Gateway Physical capacity Mar-09

17 Sample Enterprise Deployment: Top 10 Healthcare Service Provider ProtecTIER deployed in 3 Datacenters Total of 32 ProtecTIER nodes in production Total physical capacity is more than 3 PB Average repository size is 80 TB physical FC storage capacity Measured throughput performance of >450 MB/s Mar-09

18 Delivering ProtecTIER Value Performance Data is growing, backup windows are shrinking. Solutions must allow customers to process more data faster 1 GB/s inline dedupe per system Capacity Business needs and regulation are driving the need for long term on-site disk-based data retention. 1 PB of physical disk behind each ProtecTIER System Data Integrity Information is the company s lifeblood. Data integrity is essential 100% Data Integrity of dedupe process (no risk of hash-collision) Non-Disruption The solution must fit with existing practices, policies and SLA s End-user can complete all tasks inclusive of dedupe with no deviation from current processes Mar-09

19 There is only one right choice when choosing a ProtecTIER data deduplication solution... IBM! ProtecTIER is the solution that can provide: High speed inline deduplication Scalability Enterprise-class data integrity And, only IBM can provide: A complete one vendor solution World wide support Access to all future enhancements Mar-09

20 Customer Deduplication Proof Points Industry and Analyst Recognition Mar-09 IBM Confidential

21 IBM is delivering deduplication across its entire storage portfolio Addressing the full spectrum of customer requirements for data reduction 10+TB/night, >100MB/s performance Complementary Solutions Today! TS7650G ProtecTIER Gateway Easy management (via an appliance model) Minimal overall operational impact (via no post processing) Dedup data from multiple backup vendors including TSM Deduplication is only done once For customers who need to Lower operational costs and energy usage Simplify and accelerate information protection Reduce amount of disk and improve manageability But can be done at multiple enterprise locations No impact during backups/ingest Fully integrated into TSM No specific hardware dependencies Tivoli Storage Manager Mar-09 Dedup TSM legacy data With additional Information Infrastructure deduplication solutions planned

22 Two Basic Implementations #1 Inline As data is received by the target device it is de-duplicated in real time not temporarily stored on disk Data written to the disk storage is de-duplicated #2 Post Processing As data is received by the target device it is temporarily stored on disk storage Data is subsequently read back in to be processed by a de-duplication engine Mar-09

23 Case Study: Impact of Different Post-Process De-dupe Speeds Profile Receive at 300 MB/s Post 100 MB/sec Backup 6 TB Takes approximately 6 hours Post process then consumes the next 18 hours! So, it takes 24 hours to process 6 TB But What about resources in support of vaulting/off-site? When de-dupe is a post-process it competes for disk resources as any other process? Actual performance: 6 TB / 24 Hrs = 69.4 MBPS Mar-09

24 Inline Processing Backup Server ProtecTIER VT Tape Library Truck De-Dupe SLA is Met 8:00 PM 2:00 AM 8:00 AM 8:00 PM Post Processing De-Dupe Overlap Backup Server VTL Tape Library Truck De-Dupe De-Dupe 8:00 PM 2:00 AM 8:00 AM 8:00 PM Mar-09

25 Questions to Consider How fast is the de-dupe process in an operational environment? If de-dupe is done in parallel to ingest, what is the impact on ingest speed? Does capacity scale without impacting performance? How does the solution scale in performance? Does the system need quiet times for space management? Will de-dupe impact operational/production activities? How long has their system been in production? How many customers do they have who backup more than 10 TB per night? When looking into de-dupe based solutions make sure you ask the critical questions Mar-09

26 Summary Enterprise-Class Data De-duplication

27 Addressing the Data Center Data Protection Problem Performance 500 MB/s sustainable in-line de-duplication, 1000 MB/s per two node cluster Scalability - up to 1 PB per system LTO Tape Emulation Ease of Management Integrates well with existing B/U environment & infrastructure Support current user s B/U policies A new breakthrough in data protection is here Mar-09

28 Find Out More - External IBM storage NewsCenter ibm.com/systems/storage/news/center/data Deduplication IBM storage offerings ibm.com/systems/storage/tape Mar-09

29 Hindi Hebrew Russian Arabic Grazie Italian Thank You English Korean Simplified Chinese Gracias Spanish Obrigado Danke German Brazilian Portuguese Merci French Tamil Japanese Traditional Chinese Thai Mar-09

30 Trademarks and Disclaimers 8 IBM Corporation All rights reserved. References in this document to IBM products or services do not imply that IBM intends to make them available in every country. Trademarks of International Business Machines Corporation in the United States, other countries, or both can be found on the World Wide Web at Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. Information is provided "AS IS" without warranty of any kind. The customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Information concerning non-ibm products was obtained from a supplier of these products, published announcement material, or other publicly available sources and does not constitute an endorsement of such products by IBM. Sources for non-ibm list prices and performance numbers are taken from publicly available information, including vendor announcements and vendor worldwide homepages. IBM has not tested these products and cannot confirm the accuracy of performance, capability, or any other claims related to non-ibm products. Questions on the capability of non-ibm products should be addressed to the supplier of those products. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Some information addresses anticipated future capabilities. Such information is not intended as a definitive statement of a commitment to specific levels of performance, function or delivery schedules with respect to any future products. Such commitments are only made in IBM product announcements. The information is presented here to communicate IBM's current investment and development activities as a good faith effort to help with our customers' future planning. Performance is based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput or performance that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput or performance improvements equivalent to the ratios stated here. Photographs shown may be engineering prototypes. Changes may be incorporated in production models Mar-09