Storage Technology Outlook & and how the Internet fits into 1TB of IBM Watson. Dr Axel Köster Enterprise Storage Technologist ESCC Mainz

Transcription

1 Storage Technology Outlook & and how the Internet fits into 1TB of IBM Watson Dr Axel Köster Enterprise Storage Technologist ESCC Mainz

2 100 Years IBM 1911

3 100 Years IBM Storage

4 Evolution: RAMAC 350 Disk Storage with 5MB (1956)

5 Data Access Challenge

6 Since then, storage media have gained capacity... but no significant performance 64 MB 9 GB 300 GB 3 TB Performance 50 only 1 RW head Capacity

7 Will Flash Memory replace disks? $ per GB prediction SLC Flash MLC Flash 15k RPM Nearline

8 Will Flash Memory replace disks? Tapes EasyTier

9 What's happening recently: Flash SSD accelerators Tapes Using these media only for backup Redundant database nodes 3 copies of the data

10 Every application should not reinvent this! Tapes Redundancy Protection Snapshots Cached copies Consistency : Distributed Data Management ex. GPFS Panache

11

12 There is no RAID controller in a disk cluster JBOD JBOD JBOD JBOD 9+3 software RAID cluster (GPFS Perseus) JBOD JBOD 1TB disk drives JBOD JBOD JBOD JBOD JBOD JBOD

13 RAID will not work in Exascale Capacity Classic RAID 1TB = 4 hours 2TB = 8 hours 3TB = full day : Rebuilding full drives takes a lot of time. This will not scale - true today for RAID5, will eventually become true for RAID6 / DP / etc. Declustered RAID parallel recovery of redundancy 30 min

14 Declustered RAID in-a-box: XIV Storage System 1 node Its redundancy data is distributed across all other disks not in the same node Rebuilding redundancy is a parallel activity of all others Solving complex storage problems mathematically, not mechanically.

15

16 Grid communication latency, not bandwidth, is most important SLOW Gb-Ethernet, high latency Data FAST InfiniBand, no visible latency Data CPU CPU CPU RAM CPU RAM

17 Can I get "Grid", "InfiniBand" and Flash SSD today? YES * SSD availability (field upgrade) 1Q 2012

18 Caching the whole Internet, and fast!

19 A new generation of computers "Artificial Intelligence Reinvented"

20

21 ... how does it "know"? This scrambled state capital is HAIR GEL Push one of these paper products and you stretch established limits What is RALEIGH? What is the ENVELOPE? 98% C 61% C You just need a little more sun! You don't have this hereditary lack of pigment. What is ALBINISM? 98% C

22 accesses all its data in parallel "information aggregator" core IBM Power 750 / 16 TB RAM, 1TB disk content / 200 mio book pages Parallel access to 100% of the data, no Internet access during games 1TB data out of 4 TB GPFS disk space, with 16TB = 15 TiB RAM

23 What is IBM Watson doing with these massive resources? matching everything that comes to mind (brainstorming ) The correct answer could be somewhere here

24 A precursor of "new informatics" much less deterministic

25 HAL 9000 in Space Odyssey 2001

26 We will need a lot of storage

27 The Record Player molecule : New horizons for hard disks? porphyrin dye Write using light / read magnetically Source: University Kiel, Prof. Rainer Herges, Copyright CAU

28 Magnetic Memory Liquid Source: University Kiel, CAU

29 100 TB tape cartridge experiment (IBM Rueschlikon labs) 100Gb/in2 requires < 200nm bit width, < 40nm bit length 100nm reader width, allowed runout ~ 7nm 14 nm)

30 Single-atom DRAM demonstrated... holds data for 250 ns Cu 2 N 1 Bit à Fe Andreas Heinrich Scanning tunneling microscope topogram of an iron atom (yellow) on a nitride-covered substrate (blue). Next to the iron are two more atoms and a missing atom defect in the nitride. Today's DRAM cells must have their bits refreshed every 50 ms or so. By using a new pulsed-stm technique, IBM Almaden research teams could observe that single iron atoms will need to be refreshed about every 250 nanoseconds about 200,000 times faster.

31 Exciting next 100 years!

32

33 Disclaimer No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation. Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or program(s) at any time without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The performance data contained herein was obtained in a controlled, isolated environment. Actual results that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Customer experiences described herein are based upon information and opinions provided by the customer. The same results may not be obtained by every user. Reference in this document to IBM products, programs, or services does not imply that IBM intends to make such products, programs or services available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBM's intellectual property rights, may be used instead. It is the user's responsibility to evaluate and verify the operation on any non-ibm product, program or service. THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR INFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements (e.g. IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-ibm products discussed herein. Information concerning non-ibm products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products.