Virtualisation, tiered storage, space management How does it all fit together? Dr Axel Koester Senior Consultant, Enterprise Storage Luxembourg Storage Seminar, 09.05.2007
50 Years of Disk Storage: 1956 First Disk System RAMAC: Random Access Method for Accounting and Control IBM System 350 + RAMAC 305 Disk Storage 5 MB, 50.000 US$ 2
RAMAC Storage: For Accounting and Control only! Capacity Number of Disks Diameter Tracks/disk-surface Recording density Access time RAMAC capacity compared 5MB = 5MB = 5MB = 5MB = 5MB ("Mega-Characters") 50 61cm 100, with 500 8bit-characters Max. 100 bits/inch, min. 55 bits/inch Average 500ms, max. 750ms 60K 80-column punched cards 2000 ft. tape (200 char/ ) 940 pages single-spaced Magnetic Drum 13 diam,42 ft. 3
33 Years of tiered Storage: Speed versus Capacity IBM 3420 Tape IBM 3850 Mass Storage System (1974) 1970 IBM 3420 472 Billion Characters IBM 3850 Cartridges (19,5m) with Staging-Disk IBM 3336 4
Information Management Software since ~20 years Data Facility Systems Managed Storage (DFSMS) since 1988 Tivoli Storage Manager (TSM / ADSM) since 1993 Content management & discovery software ContentMgr, Commonstore, Filenet, Productivity Center, 5
The Landscape Today Virtualisation Server Virtualisation SAN Virtualisation - SVC File Virtualisation - GPFS Tape Virtualisation Space Management Tivoli Storage Manager HSM Space Manager Productivity Center DFSMS FC / SATA / Tape Tivoli Storage Manager Policy-based Migration Tiered Storage 6
Goals of Virtualization Server Virtualization: Efficient usage of resources Less hardware / floorspace Still: Administrative effort per partition/os System Z9 ~95% System P5 Storage Virtualization: Efficient usage of resources (Somewhat) less hardware Reduce admin effort: Manage pools, not racks 7
Goals of Tiered Storage 1. Provide storage at the appropriate cost level per application 2. Provide recovery capabilities as required per application Enablers for tiered storage: Online application migration capabilities (SVC) Pool management Resource usage monitoring (TPC) 8
Goals of Space Management 1. Minimize highest storage tier costs 2. Automate placement of application data, reduce admin effort 3. Optimize application restore capabilities Enablers for space management: Policy-based automation (HSM, FS) Transparent resource usage (TPC) 9
Space Management 10
Space Management with Tivoli HSM For Windows, Unix, or Linux Inactive data is transparently migrated by process rules, while remaining accessible 11
Tivoli Hierarchical Storage Management 85% fill grade: Delete 50% fill grade: Pre-migrate Migration rule(s) for inactive data Recall rules & quotas TSM Repository» Disk cache Tape 12
Fast Application Restore with Tivoli HSM Logical disk size unchanged but physical disk size reduced to size of one disk cluster After a disaster, only 4kB have to be restored to make this application startable 13
Elements required with Tivoli HSM TSM server (the one used for standard backup/restore/archive) TSM client software ( " ) Enable client-side HSM Migrate TSM Client HSM Recall TSM Server 14
Resource Management 15
Administrator's Swiss Army Knife One application for: Data and storage management (cross-vendor) Performance statistics Analysis, reporting, quota violations Prediction Avoiding out-of-space conditions (e.g. trigger provisioning) Error detection & correlation Topology browsing Chargeback/billing 16
TotalStorage Productivity Center TPC Storage Resource Management Tool Relates the application view with the system view on data Applikation? User? Share? LUN? WWN? Path? Container? Correlation Engine Storage Esperanto: SMI-S / GS3 17
TotalStorage Productivity Center TPC IBM TotalStorage Productivity Center Standard Edition Productivity Center For Data Productivity Center For Fabric Productivity Center For Disk Productivity Center For Replication Limited Edition (limit = 2TB) Limited Edition ships for free with every IBM storage Elements can be ordered separately 18
19
20
Resource Virtualisation 21
Block-based Storage Virtualisation Benefits: Homogeneous administration Migrate while online Increased storage fill grade Balanced performance Isolate non-interoperable systems Less specialized staff required Heterogeneous distant replication Substantial software licenses economies SAN SAN Volume Controller 22
Why did we chose in-band Storage Virtualisation? In-band Appliance Array Based Intelligent Switch Host Zone Host Zone Host Zone Storage Zone Storage Zone Storage Zone Fast Path Intelligent Blades Control Path MetaData SAN Volume Controller HDS TagmaStore EMC Invista 23
Why did we chose in-band Storage Virtualisation? In-band Appliance Array Based Intelligent Switch Host Zone Storage Zone No storage pool concept. No striping Host Zone Image-mode mode pass through access only. Storage Zone Virtualisation as migration tool No caching concept. Relies on subsystem functions for Replication etc Expensive switch hardware Storage Zone Host Zone Fast Path Intelligent Blades Performance? SPC benchmark? Control Path MetaData SAN Volume Controller HDS TagmaStore EMC Invista 24
SAN Volume Controller: #1 in official SPC benchmarks SPC = official benchmark for storage, compare to "TPC" for servers SPC-1 measures random access performance in database environments whereas SPC-2 measures sequential throughput SPC-2 focuses on file serving in a real-word environment Not the ideal 100%-cache-hit peak number Benefits of read prefetch mechanism Benefits of sequential IO detection http://www.storageperformance.org All numbers circa +20% for current SVC 4.1 To-be-announced SVC 4.2 is expected to exceed 6000 MB/s in SPC-2 benchmark. 25
File Virtualisation 26
IBM Storage Tank Technology Goal: Let the system assign resources (DFSMS-like) 1. Define classes of IT projects with policies & rules 2. Associate new projects with a class of policies 3. See how everything finds its most-suitable place by itself, over time, without human interaction 27
IBM Storage Tank Technology Examples of policy-driven data placement: Storage Tank Policies Storage Pool Storage Pool Storage Pool ❶ Place new files on fast reliable storage, migrate as they age ❷ Place temp files on nonmirrored non-backed storage ❸ Keep related files together 28
IBM Storage Tank Technology now in GPFS 3.1 1. Policy driven data movement between all storage classes including full box migration. 2. Single point management across all storage classes including snapshot. 3. Isolation of storage configuration and effective application used storage. 4. Scalability from ThinkPad to BlueGene. 5. SAP certified with DB2 and Oracle Databases. GPFS 3.1 + Policies GPFS 2.x: thousands of satisfied customers worldwide 29
How they fit together: Virtualisation Server Virtualisation SAN Virtualisation - SVC File Virtualisation - GPFS Tape Virtualisation Space Management Tivoli Storage Manager HSM Space Manager Productivity Center DFSMS FC / SATA / Tape Tivoli Storage Manager Policy-based Migration Tiered Storage 30
Disclaimers No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation. Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or program(s) at any time without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The performance data contained herein was obtained in a controlled, isolated environment. Actual results that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Customer experiences described herein are based upon information and opinions provided by the customer. The same results may not be obtained by every user. Reference in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBM's intellectual property rights, may be used instead. It is the user's responsibility to evaluate and verify the operation on any non-ibm product, program or service. THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR INFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-ibm products discussed herein. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. The providing of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inquiries regarding patent or copyright licenses should be made, in writing, to: IBM Director of Licensing IBM Corporation North Castle Drive Armonk, NY 10504-1785 USA 31
Trademarks The following terms are trademarks or registered trademarks of the IBM Corporation in either the United States, other countries or both. AIX AIX 5L BladeCenter Chipkill DB2 DB2 Universal Database DFSMSdss DFSMShsm DFSMSrmm Domino e-business logo Enterprise Storage Server ESCON eserver FICON FlashCopy GDPS Geographically Dispersed Parallel Sysplex HiperSockets i5/os IBM IBM eserver IBM logo iseries Lotus Linear Tape-Open, LTO, LTO Logo, Ultrium logo, Ultrium 2 Logo and Ultrium 3 logo are trademarks in the United States and other countries of Certance, Hewlett- Packard, and IBM. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States and/or other countries. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States and/or other countries. Intel, Intel Inside (logos), MMX and Pentium are trademarks of Intel Corporation in the United States and/or other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States and other countries. Other company, product, or service names may be trademarks or service marks of others. ON (button device) On demand business OnForever OpenPower OS/390 OS/400 Parallel Sysplex POWER POWER5 Predictive Failure Analysis pseries S/390 Seascape ServerProven System z9 System p5 System Storage Tivoli TotalStorage TotalStorage Proven TPF Virtualization Engine X-Architecture xseries z/os z/vm zseries 32
33