ProtecTIER on IBM i. May,2011. Bob French Dynamix Group, Inc IBM Corporation

Transcription

1 ProtecTIER on IBM i May,2011 Bob French Dynamix Group, Inc. bobfrench@dynamixgroup.com

2 Agenda ProtecTIER on IBM i Product Overview What does it do? Deduplication Algorithms Product Family ProtecTIER on IBM i where it fits ProtecTIER on IBM i how it attaches ProtecTIER on IBM i - sizing Next Steps 2

3 ProtecTIER Product Overview 3

4 ProtecTIER Vision and Design Criteria 1. Data-agnostic factoring of up to 25 times or more 2. Unmatched performance up to 1000 MB/s or more 3. Unequaled scalability: up to 1 PB physical data 4. Enterprise-class data-integrity: Not hash-based 5. Simple, non-disruptive deployment 6. Supported in most hardware and software environments No other dedupe technology meets all these criteria! 4

5 What does ProtecTIER do? IP Replication Minimized bandwidth since data is de-dup d before sending Ohio ProtecTIER IBM i Optional duplication to physical tape (at local or remote site) TS3500 New York IBM i Virtual Tapes ProtecTIER Disk What is DeDuplication? A C A B B A A C B Local Saves to Virtual Tape with De-dup A C A B B A A C B A C A B B A A C B 5

6 Hyperfactor Deduplication in Action New Data Stream HyperFactor Repository Memory Resident Index Disk Arrays SAN Switch TS7650G Existing Data IBM i Servers Filtered data 6

7 Deduplication Algorithms - Types Content Aware Hash Based ProtecTIER HyperFactor Hash Value Pointer Assumes the best candidate to de-dup Text against is an object with similar attributes (eg file name, file type) De-dup ratios are lower since even a tiny difference within the boundary causes the match to fail Sepaton Hash table grows as more backup data is stored As the repository fills, backup speeds decrease since it takes longer to check the bigger table Eventually the Hash Table can t fit in memory and backup speeds decrease seriously Hence this algorithm is only suited to smaller devices: it doesn t scale well Data Domain, FalconStor Very fast algorithm since it processes backup stream to find possible matches then offloads work to disk to confirm the match Algorithm can index 1 PB of physical disk using a 4 GB index that fits in memory, hence no performance degradation as the repository grows Hence scalable for large repositories 7

8 Production Customers Deployment Results 8

9 Deduplication Algorithms Post vs Inline Post Processing Deduplication Inline De-Duplication (eg HyperFactor) Backups run first without de-dup Separate de-dup algorithm runs thereafter Requires extra disk space to hold the interim full-sized copy of the backup Used when the de-dup algorithm is not fast enough to run inline De-dup runs as part of backup process Uses less disk Once save is done, the entire process is done Only possible with a fast de-dup algorithm like ProtecTIER HyperFactor 9

10 Combined Disk Index I/O Activity for 10 TB Approach Index Read I/O TB to process datastream HyperFactor 0 10 Hash Inline > 1 Billion * 0 Hash Post > 1 Billion 20 Content Aware ~10 Million 30 * This can be hosted in memory if the mapped area is small. When dealing with a 10 TB payload this is not likely

11 IBM TS7600 ProtecTIER Deduplication Family New in July 2010 Good Performance Entry Capacity Very Low cost Single Node Single Node Up to 85 MB/sec Up to 85 MB/sec 5.9 TB (5.5 TiB) useable 4.4 TB (4.0 TiB) useable Good Performance Highly Scalable Low cost Single Node Up to 100 MB/sec 7 TB (6.3 TiB) useable Better Performance Larger Capacity Scalable Single Node Up to 250 MB/sec 18 TB (15.8 TiB) useable Highest Performance Largest Capacity Single Node Up to 500 MB/sec 36 TB (31.5 TiB) useable Highest Performance Largest Capacity High Availability Active-Active Cluster Up to 500 MB/sec 36 TB (31.5 TiB) useable High Performance High Capacity Flexible Storage Single Node Up to 900 MB/sec 1 PB useable Highest Performance Largest Capacity High Availability Active-Active Cluster Up to 1500 MB/sec 1 PB useable Nominal Space Available = useable space * HyperFactor Ratio 1 TB = decimal TB = 1,000,000,000,000 bytes or 1,000 GB (i.e. 10^12 bytes) 1 TiB = binary TB = 1,099,511,627,776 bytes or 1,024 GiB (i.e. 2^40 bytes) 11

12 ProtecTIER Details LTO-2 & LTO-3 Emulation Notes: (1) IBM i has a max of 32 drives in a virtual library attached to a given server, and 92 drives total in a virtual library TS7610 Appliance TS7650 Appliance TS7650 Gateway (2) IBM i has a max of 4096 cartridge locations in each library (slots + drives + IO slots + grippers) TS7610 Appliance TS7650 Appliance TS7650 Gateway # nodes Max Throughput 80 MB/sec 100, 250, 500 MB/sec Up to 1500 MB/sec with 2 nodes Repository (Physical) 4.4 or 5.9 TB 7, 18, 36 TB Up to 1 PB Max # Virtual Libraries Max # Virtual Drives (1) Max # Virtual Cartridges (2) 8, , ,000 Replication Max Spokes per Hub 4 if TS7610 is the hub 12 if TS7650 is the hub

13 Customer Profile for each Appliance Configuration Ideal Customer for 7TB ProtecTIER Appliance 1 TB or less incremental backups per day 1-3 TBs full backups each week Experiencing average data growth Needs a cost effective solution Ideal Customer for 18TB ProtecTIER Appliance 3 TBs or less incremental backups per day 3-6 TBs full backups each week Experiencing rapid data growth Needs good performance to meet backup window Ideal Customer for 36TB ProtecTIER Appliance 5 TBs or less incremental backups per day 5-12 TBs full backups each week Additional growth expected Meeting the Backup window is an issue - higher performance needed * Note: These general guidelines are based on the backup workload that best fits each appliance configuration Please use Capacity Planning Tool to accurately size a solution to meet customer s specific requirements 13

14 IBM s LTO Technology Roadmap 14

15 ProtecTIER For IBM i 15

16 ProtecTIER on IBM i Where does it fit? Our Niche ProtecTIER IP Replication For customers who are moving their tapes offsite via truck today and would like a safer, more automated solution Our Niche Tired of Handling Tapes? IBM i ProtecTIER ProtecTIER IBM i Note: If the customer already has an HA/DR solution that replicates his data to his remote site, then that will likely provide a more economical solution for remote tape: IBM i Software-based Replication (eg icluster, MIMIX, Visions, itera, etc) External Disk Copy Services IBM i Geographic Mirroring (formerly Cross Site Mirorring or XSM) Our Niche Tiny LPARs For customers where a tape cartridge is much bigger than needed ProtecTIER... VIOS / NPIV 16

17 Virtual Tape on IBM i Questions to Ask Your Vendor Overall Speed and Single Stream Speed Backup Scheduling Virtual Tape Devices shine when they can run a large number of mediumspeed backup streams. IBM i customers often need a small number of very fast streams. Be sure to understand the single stream performance provided to make sure your Virtual Tape Device will meet your needs LPAR 11 pm IBM i 01 11:30 pm Midnite 12:30 am 1 am IBM i Single Stream performance depends on the VTL disk type/amount MB/sec per stream ProtecTIER IBM i 02 IBM i 03 IBM i MB/sec per stream MB/sec per stream MB/sec per stream Total MB/Sec Draw a Backup Gantt Chart to check the MB/sec and # streams at your peak TS7650 ProtecTIER Full box Save capacity is 1500 MB/sec with 2 nodes Non-Infinite Resources Current Technology Physical Drives run at MB/sec per stream (umix / largefile) Although virtual tape if flexible, remember the resources aren t infinite 17

18 ProtecTIER on IBM i Support and Testing Supported with: IBM i V5R4 onwards Any IBM i fibre card supported on your server BRMS is strongly recommended Tested with the same COMPREHENSIVE Test Buckets used for regular tape drives IBM ProtecTIER is the ONLY External Virtual Tape product that is tested and supported by IBM Rochester 18

19 ProtecTIER Attachment to IBM i - Details Fibre cards that use an IOP (fc 2765, 5704, 5761) IBM i V5R4M0 onwards TS7650 ProtecTIER Code Levels Min for Local Backups: V Min for IP Replication: V2.3.0 Fibre cards that don t use an IOP (fc 5749, 5774/5276, 5735/5273, 5708 FCoE + Blades fibre cards) IBM i V6R1M1 onwards with the following PTFs IBM i 6.1.1: MF pre-reqs IBM i 7.1.0: MF pre-reqs POWER6 or POWER7 system TS7650 ProtecTIER Code Level V Server Code V PT Manager Code (GUI) BRMS is recommended since TS7650 presents as a tape library 19

20 IBM i IOPless Support for ProtecTIER, TS7650/G - Notes Support of TS7650G/TS7650 system attachment to IBM i IOP-less Fibre Channel was added on June 30 th, ProtecTIER has been supported on IBM i since June 2009, but only using the IOP-based Fibre Channel adapters. Prerequisites for IBM i IOP-less configurations with TS7650G/TS7650: 1. POWER6 or POWER7 system 2. IBM i 6.1 with LIC or later 3. IBM i PTFs (Program Temporary Fix): 1. IBM i 6.1.1: MF pre-reqs 2. IBM i 7.1.0: MF pre-reqs 4. IBM i Fibre Channel card options: (all available today) 1. fc # Gb PCI-X 2. fc # Gb PCIe, fc #5276 (low profile version of this card) 3. fc # Gb PCIe (NPIV capable), fc 5273 (low profile version of this card) 4. fc #5708 FCoE Blades fibre cards #8242, #8271, #8240, # ProtecTIER Server / Manager Code Versions: 1. June 30, A special release of ProtecTIER Server 2.4 available by request from ProtecTIER support (v ) with PT Manager (GUI) code *or* 2. July 15, The GA version of the code is v with PT Manager (GUI) code Considerations/restrictions for IOP-less usage: 1. If a ProtecTIER drive is going to be used for an alternate IPL device (D-mode), there can only be one drive visible on the adapter as the alternate restart device. ProtecTIER LUN masking may be used to satisfy this requirement. 2. If any VIOS partition is connected to the ProtecTIER on the SAN, the ProtecTIER must be removed from the zone prior to initiating a reboot of the ProtecTIER. Failure to follow this restriction will cause errors to occur on other devices attached to the same NPIV port that may be disruptive. 20

21 IBM i IOPless Support for ProtecTIER - Restrictions Restriction #1: IBM i alt-ipl (reload) (this only applies to IOPless fibre cards, not the older IOP d cards) Restriction #2: TS7650 IPL with VIOS IBM i VIOS IBM i TS7650 Node 0 Node 1 SAN Switch Virt Drive 0 Virt Drive 2 Virt Drive 3 SAVSYS Tape Virtual Library TS7650 Other Tape in VIOS Zone To D-IPL your IBM i, use TS7650 LUN masking so the adapter card can only see a single virtual drive (the one with the SAVSYS in it) If TS7650 is attached to VIOS, remove TS7650 port(s) from the VIOS SAN Zone before IPLing the TS7650, otherwise it may disrupt other devices 21

22 BRMS DUPMEDBRM Compaction PTF TS7650 Virtual Tape Saves are not compacted so take 3x as much virtual media (gained back with dedup) Exposes the COMPACT parameter so you can compact the physical volumes when you dup from ProtecTIER Part of June 2010 BRMS PTF IBM i V5R4: SI38733 IBM i 6.1: SI38739 IBM i 7.1: SI38740 Before the PTF, dups used the same compaction parameter as the source volume, so more physical media was needed TS3500 With the PTF, DUPMEDBRM can request compaction so uses less media With PTF Before PTF Behavior: V5R4: control via Data Area Q1ADUPCOMP in QTEMP can be set to *FROMFILE, *YES, *NO IBM i 6.1 / 7.1 COMPACT(*YES) is available help text via web For new IBM i 6.1 auto-dup feature, need to change command default on DUPMEDBRM to *DEV Future releases: COMPACT(*YES) will be available with regular help text 22

23 Sizing ProtecTIER For IBM i 23

24 ProtecTIER on IBM i Designing / Sizing Get the ProtecTIER on IBM i Introduction and Questionnaire IBMers: Partners: Simple Environment: 1-2 hours of work Complex Environment: Several days of work Build a Repository Sizing Spreadsheet LPAR GB in Save Iterations Kept IBM i GB GB in repository IBM i GB IBM i GB IBM i GB Total Build a Backup Schedule Gantt Chart (to figure out the peak MB/sec) LPAR 11 pm IBM i 01 IBM i 02 IBM i 03 IBM i 04 Total MB/Sec 11:3 0 pm mid nite 12: 30 am 1 am Then ask the ProtecTIER FTSS to tell you how many disk arms you need 24

25 Next Steps 25

26 If you would like to consider ProtecTIER for your shop Detailed ProtecTIER Presentation Backup Environment Review Attend the ProtecTIER Hands-on Workshop Text Invite your local IBM ProtecTIER Sales Team to give you a moredetailed presentation Ask your ProtecTIER team to engage an IBM i / ProtecTIER specialist to review your backup environment with you Two-Day Hands-on Workshop in Gaithersburg, Maryland. Runs 1-2 times per month No charge to attend 26

27 Questions? 27

28 Deduplication Market at a Glance DEDUP TECHNOLOGY DD880 DXi7500 VTL 700 S2100-ES2 ProtecTIER with HyperFactor RockSoft Hash-based SIR Hash-based DeltaStor Byte-level diff comparison Inline! Potential Hash collision RockSoft Hash-based Inline! Potential Hash collision! Post process! Potential Hash collision See Note (1) Byte-level diff comparison Deduplication! Post process! Post process See Note (2) See Note (3) Block Level Deduplication PERFORMANCE Block Level Block Level Block Level Ø File Level See Note (4) Single node performance 500 MB/s Dual node Cluster performance 1000MB/s RESOURCE UTILIZATION! 300 MB/s!Clustering not available! 130 MB/s! 188 MB/s! 160 MB/s!Clustering not available!clustering with Global Dedupe not available!clustering with Global Dedupe not available See Notes (5-6) See Notes (7-8) No disk staging area required Only 4GB RAM needed for a 1PB repository No disk staging area required!over 300GBs of RAM!! Staging area > than the size of largest full backup!over 300GBs of RAM!! Staging area > than the size of largest full backup!over 300GBs of RAM! Ø Staging area > twice the size of largest full backup 24GB of RAM Not hash based See Notes (9-10) See Note (11) 28

29 Deduplication Market at a Glance ProtecTIER with HyperFactor PRODUCT STABILITY IBM in business for nearly 100 years DD880 RockSoft Hash-based DXi7500 RockSoft Hash-based VTL 700 SIR Hash-based S2100-ES2 DeltaStor Acquired by EMC! Over $400 million in debt! Small struggling company ProtecTIER in In production production since 2006 since 2006! Post process! GA October 2008 Ø Acquisition or failure imminent! GA May 2008 See Note (12-13) Over 25PBs of in production CAPACITY-SCALABILTY Many small systems in production! Very few small customers! Very few small customers Ø Almost no deduplication in production See Note (14-15) Single system can scale to 1PB capacity Up to 16 virtual tape libraries Up to 512 virtual tape drives Up to 512,000 virtual tape cartridges! 58TB Maximum useable capacity!limits not published!limits not published!limits not published MEETS ENTERPRISE REQUIREMENTS?!Limited by rapid hash table growth Up to 64 virtual tape libraries Up to160 virtual tape drives Up to130,000 virtual cartridges!limited by rapid hash table growth Up to 128 virtual tape libraries Up to 1024 virtual drives Up to 64,000 virtual cartridges!limited by huge storage requirements Up to 192 virtual tape libraries Up to 192 virtual tape drives Up to 5.3 million virtual cartridges! NO YES! NO! NO! NO 29

30 Notes Binary and Decimal TB Binary TB are most common in the industry and are shown on the ProtecTIER Manager GUI screens. The ProtecTIER overhead has been removed from these figures Decimal TB are used in the marketing literature. The ProtecTIER overhead has not yet been removed from these figures 30