WSC Accelerate with IBM Storage: Introduction to Open Systems Tape 101

Transcription

1 WSC Accelerate with IBM Storage: Introduction to Open Systems Tape 101 Carl Reasoner Reena Patel Copyright IBM Corporation 2016.

2 Accelerate with IBM Storage Webinars The Free IBM Storage Technical Webinar Series Continues in Washington Systems Center Storage experts cover a variety of technical topics. Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome. To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an request to acceleratejoin@hursley.ibm.com. Located in the Accelerate with IBM Storage Blog: Also, check out the WSC YouTube Channel here: Webinars: January 9 DS8880 Easy Tier January 17 Start 2018 Fast! What's New for Spectrum Scale V5 and ESS February 8 - VersaStack - Solutions For Fast Deployments February 16 - TS7700 R4.1 Phase 2 GUI with Live Demo February 22 - DS8880 Transparent Cloud Tiering Live Demo March 7 - Spectrum Storage Management, Control, Insights, Foundation March 15 - IBM FlashSystem A9000/R and SVC Configuration Best Practices March 27 - IBM FlashSystem A9000/R Technical Update April 12 - Introducing Spectrum NAS - The Newest Member in the Spectrum Storage Family April 26 - TS7700 Grid Configuration Changes -- Joins, Merges and Removals May 8 - DS8880 Technical Update June 7 Economic Value of Response Time June 21 Deep Dive into Spectrum Scale AFM June 28 - Open System Tape, What s New July 19 - Copy Services Manager Version Technical Update August 2 - Back to Basics - TS7700 Concepts and Operations August 7 - IBM/Broadcom: Why NVMe-Over Fiber should be on your radar! August 30 - Transforming Traditional IT to a Multi-Cloud strategy leveraging IBM Storage September 13 - DS8880 Technical Update September 20 - IBM/Broadcom SAN Extension September 27 Introduction to Open Systems Tape 101 October 2 - Copy Services Manager / Safeguarded Copy Update Register Here: 4b6ad1d220 October 11 Storage Insights & Storage Insights PRO Use Cases at the WSC Register Here: c6352e850 October 18 TS7700 usability enhancements in release Register Here: e44

3 2

4 General description of Tape Tape is still alive!! It will be alive for many years to come!! Why? Lowest cost tier of storage, how can I prove it? What are the costs? TCO TCA Longevity Future of tape Roadmap Other advantages of tape Why do some people not like tape? How to overcome the Who is using tape? What is available today?

5 Is tape still fashionable? If you care about cost, the answer is YES!

6 TCO comparison Tape vs Disk

7 TCO comparison Tape vs Cloud

8 Cost metrics TCA is the total acquisition price $ per GB ($0.02 / GB = 2 cents/gb) (TCA) TCO Total cost of ownerhip - is total over time Total Cost for 10 years $ per GB/month ($ / GB/Month = 1/20 th of a cent/gb/month) ( TCO vs managed or Cloud) Incremental Cost ($ /GB) Street price media cost purchase price

9 Cost TCO Acquisition price (day 1) TCA Capacity Drive and Media type TS1155 JD Media 15 TB native Library slots Performance Number of drives TS MB/sec native Time how long is your TCO Capacity increase over time (data growth rate) Performance increase requirements over time Improvements in new drive and media over TCO time Retention Policy (effects media costs and library growth) Power costs over time (KWh) Upgrade Costs Other costs can be considered Floor space Operational costs

10 Longevity Tape library Life IBM Media warranty is for 10 years Generally tapes can be read for the following 2 generations of tape drives. Long service time for Tape drives & media Example: TS1120 General Availability 2005 TS1120 End of Service will be June 30, years of service for the TS1120 Cartridges written by the TS1120 can still be read by the TS1140 drive ( no EOS has been announced)

11 Over 65 years of tape innovations 1952 IBM st magnetic tape drive In tape drive technology and software 1964 IBM st read/back drive IBM 3590 LTO Gen LTO Gen LTO Gen LTO LTO LTFS SDE 2011 LTFS LE LTO LTFS Gen6 SM 2013 LTFS EE 2015 LTO LTO IBM st read/write drive 1984 IBM st cartridge drive 1999 IBM 3590E Gen TS1120 (3592 G2) 2008 TS1130 (3592 G3) 2011 TS1140 (3592 G4) 2014 TS1150 (3592 G5) 2017 TS1155 ( F) In tape automation and virtualization 1962 IBM Tractor System 1992 IBM IBM TS TS3200 TS TS TS2900 TS3500 High Density 2011 TS3500 Connector & shuttle 2011 LTFS LE 2016 TS TS MSS VTS G1 VTS G VTS G TS7740 (VTS Gen 4) 2005 TS7510 VTL 2007 TS TS TS TS7650G 2009 TS7650 Appliance 2010 TS7610 TS TS7740 TS TS Gen 4

12 IBM has Demonstrated a Tape Technology Pipeline 11

13 IBM Storage & SDI IBM-FujiFilm demonstration of 201 Gb/in2 on Sputtered Media 2015: IBM-FujiFilm demonstration of 123 Gb/in 2 on BaFe tape 2017: IBM-Sony demonstration of 201 Gb/in 2 on Sputtered Tape Product Technology Demonstration 330 TB per cartridge 201 Gbit/in 2 sputtered tape Areal density/capacity scaling achieved by shrinking the same basic technology to write smaller and smaller bits on disk

14 Data Growth and the GAP with HDD Technology Bridge the GAP with Tape Until 2014 disk capacity growth out performed data growth. Now data growth is higher than disk capacity growth. Close the GAP with TAPE

15 textthe Digital Universe Zettabytes Created by Year 163Z B Data Classification by business value Mission Critical 15% Business Critical/Vital 20% Sensitive 25% Archive, Long-term 40% About 60% of all data optimally suited for tape Only 26% will be delivered by public cloud DCs 16.1ZB 44ZB The 163ZB projected in 2025 is only the beginning! Taken from LTO Storage Outlook. LTO Consortium Austin TX Source: Storage Newsletter 04/2017

16 LTO Roadmap

17 IBM 3592 Tape Drive History TS1100 Generations TS1140 TS1150 TS1155 Max Format Capacity (Native) 4 TB (JC) 1.6 TB (JB 10 TB (JD) 7 TB (JC) 15 TB (JD) 7TB (JC) Other Format Capacities (Native) 1 TB (JB) 700 GB (JB) (All JA R/O) 4 TB (JC) 10 TB (JD) 4 TB (JC, R/O) Native Data Rate 250 MB/s 360 MB/s 360 MB/s Attachment FC-8 FC-8 FC-8, 10 GigE (RoCE, iscsi) Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.

18 More Advantages of tape Low Cost Length of useful life Drives Media Power Consumption - Each Tape drive consumes about the same as a 50W light bulb cartridge in slot 0W Portability Reliability tape is 275 x more reliable than disk Streaming speed TS1150 and TS /MB/sec native streaming speed Inline compression Inline encryption Air Gap

19 Tape compression and encryption Built-in AES 256-bit data encryption engine Look-aside decryption & decompression help assure data integrity. <1% performance and capacity impact Authentication: SKLM queries drive certificate and uses public key to authenticate exchanges Clear Clear Clear FC Port 0 FC Port 0 Host Interface DMA Compression AES Decompression AES Decryption Application Specific Integrated Circuit Buffer ECC and Format Encoding Read/Write Electronics Read/Write Head #*4msW Clear Clear w*q03!k3ikm4aw^1* ear Drive Firmware Processor Code Memory Drive Certificate with Drive s Public Key Tape Drive with Private Key Tape Media Page 18

20 The Compelling Event: Many Faces of Cybercrime Whether you have the best backup solution, the latest anti-virus protection, or multiple versions of back up repositories, this next generation of cybercrime is evolving so quickly that those concepts seldom matter anymore. *

21 Reasons for not liking tape overcome the challenges Tape Handling Reduce handling New generations of media require fewer tapes Automate tape library Remote tape remote library Reliability Tape fails and you don t know - Media Verification Multiple copies of backups or archives Move writing to tape outside backup window (D-D-T) Backup takes too long Move write to tape outside backup window (D-D-T) Reduce primary storage move inactive files to archive

22 Reasons for not liking tape overcome the challenges Performance Time to first data - TS Seconds ( scaled capacity with x35 setting(20%) 12 s. Sequential Access (streaming) Tape Streaming Performance of drive TS MB/sec (compressed sustained rate 750 MB/s) Cartridge / Format Blocksize Compression Ratio Disk Performance / File Size Stop / Start Shoe Shinning Larger tape buffers (virtual backhitch) HBA to drive fan out Path

23 22 Washington Systems Center - Storage Constraining Variable Disk SAN HBA PCI BUS CPU Memory LAN Server HBA SAN Tape Constraining variable

24 Reasons for not liking tape overcome the challenges Having to upgrade to new drive technology and media Migrate Keep older drives in the library Tape is not cool! Low Cost trumps cool

25 TAPE $AVES YOU...COSTS ENERGY DATA COMPANY JOB Future for Tape Traditional Use for Tape: backup, disaster recovery, compliance, archive AREAL DENSITY (Gbit/in²) HDD Products NAND Products TAPE Products TAPE Demos HDD 40%/yr HDD 100%/yr HDD 20%/yr HDD 40%/yr HDD 20%/yr?? NAND 40%/yr 2 bit/cell Value TAPE 40%/yr NAND 1 bit/cell Capacity YEAR Reliability Ease of Use 1/5 th the cost of disk Tape = 40% CAGR Disk = 15% CAGR 275K time more reliable than disk* LTFS SNIA standard It is just not reasonable to think, that future capacity requirements can be handled with HDD and Flash alone. Tape has significant higher economics, better reliability and durability and is faster than HDD. Today/Future: active file archive, low cost NAS storage for easy access to big data, cloud, HPC and other IT operations and still for backup (Last line of defense) Tape solutions for cloud are a fraction of the cost Cloud Tape Advantages include lowest cost, superior reliability, high speed, ease of use and highly scalable capacity * Henry Newman, Instrumental Inc., April 19, 2014 * Decad, Fontana, Hetzler IBM Journal

26 Beyond text Backup and Recovery - Tape Use ARCHIVING Archive large volumes of data Retain data for long periods of time. BACKUP Simple backup solution Easy data access and restore LONG TERM RETENTION Simple, policy based data migration Easy data access Leverage simplicity and tape TCO and standardized format TIERED STORAGE Simple policy based data migration Easy data access CUTTING COSTS FOR CLOUD Long term data retention Easy data access 25

27 Gartner Study 2017 The use of tape in backup remains far greater than what many perceive; with even higher usage in Europe, compared with North America Disk-to-tape remains the predominant methodology: % of the respondents use D2T or D2D2T The most-frequent deployment with tape is D2D2T, and Gartner expects this backup methodology to remain highly deployed in the foreseeable future, as organizations try to obtain maximum life out of their installed tape technology. 26

28 IBM Tape: Reliable and cost-effective solutions for new workloads Cloud Media and Entertainment Genomics Big data and analytics Digital Video Surveillance (DVS) Internet of Things (IoT) 27

29 What data should be on tape!!! Cold data Static data Long term retention data Data that needs to be isolated (Air Gap) Data must not be changed (WORM)

30 Your Data High speed Random Access Minimal response time required Frequent access I/O intensive Rarely, if ever accessed Minimal response time required

31 Sample Case Study Customer Analysis Your data

32 LTFS Tape Evolution New Use Case with Liner Tape File System File System Designed for Tape Not traditional use of Tape by TAR command nor Tape Backup Software Allows the user to access to the data on tape using the file manager (Windows Explorer), just like USB memory stick and CD/DVD Application program can access to the files directly without tape backup/restore program or database Directory Structure CD/DVD disc HDD 15TB File List View 128GB USB Memory LTFS-format cartridge

33 LTFS Advantages File System designed for Long-Term Retention and Media Portability Award-winning technology, invented and maintained by IBM File System implementation available as open source since 2010 Open Standard ISO/IEC 20919:2016 Data structure on tape Two Partitions Index Partition and Data Partition Industry Collaboration - SNIA Technical Working Group Version 2.4 approved in 2017 Logo Program (Compatibility Testing) by LTO Consortium Self-Describing Information Exchange by Tape No Vendor Lock-in No separate DB server for managing tape contents Available as IBM Spectrum Archive 3 Editions; Single Drive Edition (SDE), Library Edition (LE), and Enterprise Edition (EE)

34 IBM Tape Portfolio IBM Storage & SDI What is available today?

35 Software Disk Based Virtualization Washington Systems Center - Storage IBM Storage & SDI Industry s Broadest Portfolio of Data Protection & Retention Products Entry Midrange Enterprise Spectrum Protect Deduplication / Linear Tape File System Tivoli Key Lifecycle Manager / ISKLM Spectrum Protect (TSM), Tape Sys Lib Manager DFSMS

36 IBM Tape Drive Introduction IBM LTO8 tape drive IBM TS1155 tape drive

37 LTO Ultrium 8 Tape Drives IBM Storage & SDI Offered in Full High FC, Half High FC and SAS Highlights: Delivers increased capacity: - 12 TB native and 30 TB with 2.5:1 compression - Full High Maximum data rate = 360 MB/s - Half High Maximum data rate = 300 MB/s Read/write support of LTO-7 media (BaFe) Support to write-once-read-many (WORM) cartridges Tunnel Magnetoresistive head (TMR) - Improved tape interface, extended life and corrosion resistance Available for IBM branded solutions: - TS4500, TS4300, TS2900, TS2280, TS3500*,TS3100/3200*, TS3310* Features: Encryption AME and AES-256 standard support IBM Spectrum Archive support - Linear Tape File System format I am ready * Available only as drive upgrade

38 TS1155 Tape Drive IBM Storage & SDI Improves capacity of TS1150 drive by 50% Reuses existing JD Barium Ferrite media types to provide up to 15 TB native capacity Re-Writable and Write Once Read Many (WORM) cartridge at 15 TB Economy cartridge at 3 TB 360 MBps native drive data rate Supports data partitioning, data encryption and key management Supporting both Fibre and Ethernet interface capabilities Dual 10Gb optical attachment on new 55E model (for support in TS4500 only) RoCE v2 protocols support Dual FC-8 interfaces supported on 55F model Upgrade options* 3592-E G (convert existing TS1150 to TS1155) G F (purchase new TS1155 for TS3500 and migrate to TS4500 in future) x Reducing the cost of storing data by increasing capacity in the same physical footprint, reducing overall TCO for Linear Tape data retention

39 Choosing the Right Tape Drive Why Enterprise? Customer Requirements LTO Gen 8 TS1150 Feature Mainframe batch Mainframe support via processing TS7700 Archive retrieval High resolution directory Fast access to data High resolution directory Large data buffer Scaled media Start, stop and seek Virtual backhitch Lowest TCO cost across Media re-use, easier tech. gens upgrades Lowest Initial cost Open standards TS1155 currently offers over 25% more capacity than LTO 8 Job times for some applications improve by a factor of 20x or greater Enterprise average access to a file is 26% faster than LTO, and rewinds are 30% faster New access options and first to market interfaces Loader life 3 times higher than LTO

40 IBM LTO Tape Portfolio TS2280 TS2900 TS4300 TS4500 Max capacity* Max # drives Max # cartridges 12 TB 108 TB 3.2 PB 278 PB ,170 *All capacities are based on LTO 8 native format

41 IBM TS2280 Tape Drive Support for LTO Ultrium 8 half-high tape drives - Native data transfer of up to 300 MBps and up to 750 MBps with 2.5:1 compression LTO generation 8 media specification tape cartridge compressed capacity of up to 30 TB (up to 12 TB native) 6 Gbps SAS attachment support 1 GB internal buffer Application-managed encryption support for half-high LTO 8 SAS tape drive 16 KB cartridge memory with Ultrium 8 media Half-high drive form factor Two SAS ports per drive for improved availability and attachability IBM Spectrum Archive support - Incorporates Linear Tape File System format

42 IBM TS2900 Tape Autoloader Support for LTO Ultrium 6, 7 and 8 half-high tape drives - Native data transfer of up to 300 MBps LTO generation 8 media specification tape cartridge compressed capacity of up to 30 TB* (up to 12 TB native) Increased capacity - LTO 8: up to 9 cartridges = up to 270 TB* per library (108 TB native) 6 Gbps SAS attachment support Support for encryption IBM Spectrum Archive support - Incorporates Linear Tape File System format Save space with a slim-profile, 1U system designed for rack system environments for automated, high-capacity tape storage * With 2.5:1 compression

43 IBM TS4300 Tape Library Up to 3.2 PB native capacity (with LTO 8 cartridges) 1 base unit + 6 expansion units 32 to 272 LTO storage slots* Up to 5 I/O slots per module Up to 21 LTO 6, 7 and 8 hot-swappable tape drives Combination of HH & FH drives Two drive interfaces: 8 Gbps Fibre Channel (LTO 6, 7 and 8) HH- single ported FH- dual ported 6 Gbps dual-ported SAS (LTO 6, 7 and 8 ) Up to 300 MB/sec native performance Supports Direct attach and SAN attach IBM Spectrum Archive support - Incorporates Linear Tape File System format Data security and regulatory compliance through support for Library Managed Encryption (LME) and WORM media on LTO Ultrium 8, 7, and 6 tape drives * 40 slots per module (20 per magazine) includes 5 optional I/O. 8 lowest slots of module 1 (lowest module) not accessible

44 TS4300 Tape Library Features IBM Storage & SDI Standard Features Management GUI Web Interface Operator Panel Library Partitioning Prevents unwanted access to slots/drives among different use cases Up to 21 logical libraries (up to number of drives installed) Persistent Binding WWNN does not change after a drive is replaced Encryption Application Managed Encryption is a standard feature of the library Notifications Supports SNMP, SMTP ( notification), LDAP (remote authentication), Active Directory (Kerberos) SNTP (Simple Network Time protocol) Optional Features Rack mount for Base module Path Failover (Data and Control) Library Managed Encryption (KMIP) First Power Supply (for E3A) Redundant power supply IBM / Business Partner Use Only 43

45 IBM TS4500 Tape Library Increased capacity - Up to 278 PB per library (up to 695 PB with 2.5 to 1 compression) with LTO8 drives or up to 263 PB per library ( PB with 3:1 compression) with TS1155 drives - Up to 128 tape drives - LTO 5, 6, 7 8 tape drive - TS1140, TS1150 or TS1155 tape drives - Up to 17, cartridges or 23,170 LTO cartridges - Optional dual accessor - Up to 18 frames IBM Spectrum Archive support - Incorporates Linear Tape File System format Data security and regulatory compliance through support for Encryption and WORM media on LTO Ultrium 8, 7, and 6 tape drives Increase capacity by storing up to 278 PB of uncompressed data per library with the new Linear Tape-Open (LTO) Ultrium 8 drives or up to PB per library using 3592 cartridges.

46 TS4500 HD2 base frame TS4500 Tape Library Model Lx5 Up to 12 Drives 36 I/O - LTO 32 I/O Licensed Slot Capacity Entry Interm Base HD LTO Up to 3.3X the slot density of TS3500 with more standard features including: Advanced Library Management System (ALMS) Dynamic partitioning Transparent Capacity on Demand Virtual I/O (VIO) Cartridge cache Two I/O Stations System console capabilities e.g. broadband call home (formerly TSSC)

47 TS4500 HD2 drive expansion frames New HD Capacity on Demand option 2 I/O Stations optional No capacity reduction for tape drives TS4500 Expansion Base Model Dx5 Up to 16 Drives Licensed Slot Capacity HD w/ I/O HD w/o I/O LTO

48 Mainframe-ready Integrate TS7700 backend switches New 16 Gb switches Attach to TS7700 TSSC for centralized service IMC maintains role of local operator GUI GUI support for preset TS7700 logical library

49 SKLM Background KMIP / IPP IBM Security Key Lifecycle Manager (SKLM) Self-Encrypting Devices SKLM is a Key Distribution and Management software solution Uses standard protocols (i.e. KMIP: Key Management Interoperability Protocol) SKLM Disk Storage Arrays e.g. DS8000, DS5xxx, IBM Spectrum Accelerate (XIV), Enterprise Tape Libraries e.g. TS11xx, TS2xxx, TS3xxx, Databases (e.g. DB2) Provides centralized key mgmt for self-encrypting drives (tape, disk) Network storage servers (NetApp) Light-weight and highly-scalable Smart Meter Infrastructures SKLM helps customers keep data private, compliant, and encryption keys well-managed Cloud file systems, Elastic Storage, Big Data / Data Warehouse (IBM Spectrum Scale Netezza, etc.) Expanding support for flash storage, cloud storage, network devices, etc. IBM Flash Storage Software: VMware vsphere Multi-Cloud Data Encryption

50 Spectrum Archive EE Tape Tier for Scalable File Storage Automated File-System Data Management Seamlessly incorporates tape storage under the single namespace Keep data in active archive at much lower costs ($0.01/GB/Year) Policy-based data placement Persistent view of the data - data still listed in directories Once data is accessed it is moved to disk recall on demand Client Applications Multiple Protocol Support Single name space CIO Finance Engineering Spectrum Scale Spectrum Archive EE Tape as the external pool of Spectrum Scale Tapes in LTFS format Exporting tapes to other site and accessible with other LTFS software Supports entire IBM tape product portfolio Enterprise Tape LTO Tape Flash Gold Pool Tier 1 Disk Silver Pool Tier 2 Tape LTFS Pool 2 Tape Libraries Up to 500 PB (with TS1155 Tape Drives) Tier 3 CLI, REST API, Grafana-based dashboard screen

51 Tape: Key Attributes that Reduce Cost of Ownership 1) Enterprise Tape Media Reuse: Multi-Generational re-formatting of cartridges allowing major savings by upgrading to higher capacities for next generation of Enterprise Drives 2) Intelligent Management & Automation features of TS4500 minimize human intervention during operations 3) Adding capacity to an existing library frames requires no additional power or disruption to IT operations - IT administrator loads a magazine of cartridges through specially designed I/O port - Virtual I/O feature reduces operator intervention - Newer and Higher capacity cartridges further reduces amount of operating handling 4) Automatic Media Verification: Background operation to validate readability of infrequently accessed cartridges 5) Manage library, with easy to use GUI, from anywhere via the web, no additional software required 6) Eliminate costly SAN: Ethernet host interface on drive reduces cost and admin savings 7) Create Multiple copies of data on separate cartridges to increase data protection and for development ops 8) Built-in encryption: Native hardware level compresses then encrypts insuring maximum compressability 9) Air Gap: Mitigates Ransomware Risks 10) Green technology. Each Tape drive consumes about the same as a 50W light bulb

52 References IBM Knowledge Center - TS4500 TS4300 TS1100 Spectrum Archive Enterprise Edition Spectrum Archive Library Edition Spectrum Archive Stand Alone Edition IBM Independent Software Vendor (ISV) Matrix tachment=ivl12347usen.pdf IBM Tape Redbooks - ESG Economic Validation Summary Report, Quantifying the Economic Benefits of LTO-8 Technology, August