Virtualize and simplify traditional storage to improve performance and efficiency

Transcription

1 Virtualize and simplify traditional storage to improve performance and efficiency Nick Harris Steve Ward 1

2 Today s traditional storage environment is siloed, complex, sprawling and costly Disparate storage devices without consistency or uniformity are difficult to manage Isolated, large complex storage infrastructures Mul=ple sets of tools and processes required Data migra=on is a con=nual challenge Manual processes that are prone to error and delay 30% Used Users 25% Used The result is that tradi=onal storage sprawls across the IT landscape Storage is significantly under-u=lized, and available storage becomes isolated and hard to find Most disks are provisioned as full volumes Sprawl is increased by short-stroking for performance Source: IBM BuHerfly Studies, and IBM CPO internal storage op=miza=on analysis 40% Used 35% Used 39% Used 40% Used 2

3 Storage virtualization is the key to reducing complexity, increasing utilization and reducing costs Virtualiza=on, supplemented with centralized control and management and state-of-the-art Flash technology, is the answer to storage simplifica=on Virtualiza=on is a tried-and-true IT technique what's been holding back widespread adop=on of this technology for storage? Lack of understanding Lack of interoperability Lack of standards The ini=al lack of virtualiza=on support from major storage vendors also hampered adop=on Business drive for virtualiza=on Infrastructure commodi=za=on: Physical devices masked from hosts makes replacement for whatever reason easy Liquidity of capital assets: Faster and easier to move storage hardware in and out as needed 3

4 Virtualization with IBM Spectrum Virtualize addresses the challenges of today s traditional storage landscape Consolidate More efficient use of physical storage reduces waste, drives up u=liza=on and lowers costs 4 Simplify & Reinvigorate Centralized management of storage hardware allows new advanced features to be easily inserted across all hardware Open & Flexible Enables mix of IBM and third party storage hardware

5 New Storwize V7000 Gen2+ delivers more performance without disruption More powerful hardware plaxorm with new ten-core 2.2 GHz Broadwell processor and RAM technology DDR4 20% be.er performance¹ of previous models New Control enclosure model : Drive op=ons: NL SAS and SAS HDD, new 1.92TB and 3.84TB² flash drives Storwize V7000 Model 624 can be clustered with Storwize V7000 Gen1 and Storwize V Model 524 systems All systems in the cluster must be using the same version of Spectrum Virtualize Non disrupbve model conversion from Model 524 to Model 624³ Drives and data preserved. Software licenses remain, same enclosure serial number Warranty is balance remaining with original Model 524. ¹ With HDD ² Preview of 7TB and 15TB flash drives, planned availability by 4Q16 ³Planned availability by 4Q16 IBM / Business Partner Use Only

6 Completing the SDS design with IBM Spectrum Virtualize Software Available for x86 servers Ini=ally supports Lenovo x3650 M5 servers Statement of direc=on for Cisco, Supermicro, HP Statement of direc=on for hypervisor or container support Statement of direc=on for complete iscsi networking Great choice for service providers and others requiring more flexibility in hybrid cloud deployment IBM's statements regarding its plans, directions, and intent are subject to change or withdrawal without notice at IBM's sole discretion. Information regarding potential future products is intended to outline our general product direction and it should not be relied on in making a purchasing decision. The information mentioned regarding potential future products is not a commitment, promise, or legal obligation to deliver any material, code, or functionality. Information about potential future products may not be incorporated into any contract. The development, release, and timing of any future features or functionality described for our products remain at our sole discretion. 6

7 IBM Spectrum Virtualize Software Capability All SVC/Storwize family external storage func=on supported Virtualiza=on, local and remote replica=on, compression, encryp=on, Easy Tier, All SVC/Storwize interoperability supported * Almost 400 storage systems Server, and ISV support (VMware, Microsok, data protec=on sokware, ) Integrated support for VMware including SRM at no addi=onal charge Clustering only with other servers running IBM Spectrum Virtualize sokware No clustering with IBM SVC, Storwize family, FlashSystem V9000 Remote replica=on between IBM Spectrum Virtualize sokware and other family systems Enables different systems and storage at each site Call home enabled for sokware events Will not call home for hardware events Client provides server with specified HBAs Client or IBM Business Partner downloads sokware image from Passport Advantage and installs sokware 7 * For details, see ibm.biz/interoperation

8 Storage virtualization software abstracts the physical devices from the host servers Storage volumes appear to the host servers as local disks A virtualiza=on layer maps logical volumes to physical blocks of storage The virtualiza=on layer maintains the map The backend storage can be locally ahached or external devices Data can be spread across different blocks on the physical storage Tradi=onally, small amounts of unused storage would be skipped over With virtualiza=on, these can be combined into a single storage volume 8 A Map B Host 1 Logical Volume 1 1 A C Physical Device 2 2 B 3 3 C D 4 5 Virtualization Layer 4 D E 5 E Virtualize Storage external storage Pool devices J Host 2 Logical Volume 6 6 F 7 7 G 8 8 H K 9 9 J F K G H

9 Reinvigorate storage infrastructure to reduce costs and increase performance Spectrum Virtualize Technology Iden=fy unused TBs Virtual Storage Pool 160TB External virtualiza=on 40 TB 120 TB 24 TB 100 TB 30 TB Medium performance workloads Easy Tier Data Mobility Encryp=on Flash Storage Silos Shared storage Separate sokware Replica=on No migra=on capability No compression use Non-encrypted drives 80 TB 460 TB 9 40 TB High performance workloads 134 TB Real-=me Compression

10 Encryption for External Virtualized Storage Adds encryption to existing storage systems Helps to improve data security Eliminates capital expense for new storage systems or drives to enable encryption Reduces operating expense with single point of administration for encryption across multiple heterogeneous storage systems Minimal impact on performance Takes advantage of Intel AES-NI processor instructions to perform encryption IBM Spectrum Virtualize encryption addresses all these use cases Typical encryption use cases Protection against disclosure of data when drives removed Malicious removal of drives Drives returned to vendor as part of maintenance actions Secure erasure of storage Drives or arrays being reused for different data System being sold or otherwise disposed of IBM IBM Corporation Systems 10

11 Data breaches occur despite increased security The breaches you hear about Hacking into accounts that are authorized to view sensi=ve data Inadvertent/accidental disclosure Malware An insider who inten=onally breaches informa=on Thek of portable devices (laptops, USB drives, portable hard drives, etc.) The breaches in the data center you don t hear about Data lek on storage, and returned at end of lease Drives replaced under maintenance Used drives on the shelf 11 Healthcare company Hard drive containing pa/ent data (names, dates of birth, a7ending doctor, etc.) stolen from locked server room hhps:// Airline Hard drive stolen from corporate headquarters Contained names, dates of birth, social security numbers, etc. of 79,000 employees

12 The cost of data breaches continue to rise Cost of Data Breach Study: Global Analysis, Ponemon Ins=tute, June 2016

13 Breaking down the cost of Spectrum Virtualize Encryption of existing storage vs. Rip and Replace Externally virtualized Cost of VSC Sokware and SVC $42,000 per node HW $564,289 SW for 173TB Cost of retaining exis=ng OEM Storage Base hardware maintenance $69,533 con=nues Base sokware maintenance $8,640 con=nues Op=onal Sokware maintenance $86,330 removed from annual costs func=ons now provided by Spectrum Virtualize 13 Rip and replace Cost of new OEM Storage storage device $606,289 $439,676 for 174TB system $608,300 $168,624 per annum post warranty SW maintenance Lease early return penalty $$$ Cost of client retaining unencrypted drives $186,415 $164,503 Or $186,415 Example cost of scrubbing drives before return $14,000 to scrub a clients storage before lease return Needs available host par==on to drive scrub IBM RealBme Compression increases capacity and reduces $/TB cost further AND you get access to all the other Spectrum Virtualize advanced funcbons for FREE! Note: List prices from TCONow! And Gartner CPStorage

14 IBM Spectrum Virtualize Real-time Compression Shrinks ac=ve data up to 80% without degrading applica=on performance Supports ac=ve data, unlike other storage compression solu=ons More data = more benefit Cuts storage cost in half or more 14

15 Drilling down further - a simple storage deployment can experience significant storage sprawl Storage Consumed New workloads being deployed One 600GB database The associated development copy of the database Volumes are fully allocated with the tradi=onal deployment model Primary Storage STRANDED STORAGE Data 600GB RAID 5 600GB Growth 1000GB Space 200GB This creates storage that remains unused for years => stranded storage Storage Consumed 4800 Stranded Storage 2400 Dev Copy STRANDED STORAGE Data 600GB RAID 5 600GB Growth 1000GB Space 200GB 15

16 Consolidation with IBM Spectrum Virtualize releases stranded storage Use thin provisioning to remove stranded storage This frees storage and allows two workloads to share the same drives One disk array of storage is released for other users Stranded storage becomes zero Storage Consumed Storage Consumed Primary Storage Dev Copy Dev Copy Stranded Storage Zero 1x 4 drive x 600GB RAID 5 Arrays Stranded storage released Stranded storage released Data 600GB RAID 5 600GB Data 600GB Growth 1000GB 2000GB Space -1400GB Data 600GB RAID 5 600GB Growth 1000GB 16

17 IBM s Real-time Compression reduces the data footprint and consumption by more than 50% When compression is applied to remove stranded space in data Data size on disk oken be reduce by as much as +80% Storage Consumed Primary Storage Dev Copy 1x 4 drive x 600GB RAID 5 Arrays Data 180GB 600GB RAID 5 600GB Data 180GB 600GB Growth 2000GB 600GB Space -1400GB 0GB Compression es=mate 70% Storage Consumed Stranded Storage Zero Storage stranded in Data Zero 17

18 IBM s Real-time Compression technology beats the competition Object type IBM Real-=me Compression Other vendor inline compression DB2 and Oracle databases Up to 80% Up to 65% Virtual Servers (VMware) Linux virtual OS Up to 75% 55% Windows virtual OS Up to 55% 55% Office 2003/2007 Up to 60% 35% 2010 Up to 20% 35% Engineering Data Up to 70% 55% Text and Log files +80% 55% Other vendor source: NetApp Data Compression and Deduplica=on Deployment and Implementa=on Guide, hhp:// 18

19 Pelephone Communications shrinks data-center footprint with IBM Spectrum Virtualize Real-time Compression Business Outcomes: Cut power consump=on and overall storage footprint by 84 percent Accelerated storage provisioning and backups by 90 percent Saving USD1.5 million in a three-year period 19

20 Unifying the infrastructure view with Spectrum Virtualize and Spectrum Control reduces complexity Each vendor has a separate GUI per device at the Data Access level Each requires a separate skill set to manage Vendors offer Control Plane level management, Points of management = 1 IBM Spectrum Virtualize provides a single pane GUI for all storage devices at the Data Access level IBM Spectrum Control provides single pane of management at the Control Plane level but these do not manage all devices 20 MulBple points of management

21 IBM Spectrum Control provides centralized management to improve administrator productivity Storage administrator has complete view and control of all virtualized storage resources Integrates with and supports OpenStack, VMware, and public/private storage clouds Includes Standardized storage services from a catalog Storage volume mobility Self-service storage Policy-based analy=cs and op=miza=on of storage resources 21 Virtualized SANs Hyperscale Block Global File & Object Other cloud

22 IBM Spectrum Control cuts provisioning time by 33% over traditional methods Task List Tradi=onal Storage System Admin IBM Spectrum Control Admin 1. Receive request* Review and approve* Capacity planning and placement decisions* Create LUN Zone SAN 300** 6. Map host 5 7. Execute mount Close user request* Total * From large educa=on ins=tute ** Es=mate 1,335 seconds or minutes seconds or 15 minutes Automa=on of these 4 tasks saved over 7 minutes 22

23 IBM Spectrum Control with Storage Insights provides a dashboard that delivers answers quickly Storage Insights is a convergence of analy=cs, cloud and data management Capacity dashboards provide insights from mul=ple perspec=ves Historical data, plus future trends, help plan storagerelated investments Breakdowns of storageby-=er and thin provisioning show where savings can occur 23

24 IBM Spectrum Control extends storage economic benefits to operations Manage disk, flash, file, and object data from a single console Integrate with virtual and cloud environments Improve produc=vity through analy=cs and automa=on European education institution VMware admins manage 12PB of storage for 70k VMs Cut storage provisioning =me from 2 weeks to 5 minutes Saving 15 hours a week in performance troubleshoo=ng based on improved storage environment visibility From days to minutes on turnaround for client provisioning requests Automated expira=on to reclaim wasted space 24

25 Similar storage management software from competitors lacks features and completeness EMC's ViPR suite of products is EMC's solu=on to address having acquired storage products and companies with dissimilar management interfaces and architectures. The ViPR v2.4 controller provides a single control plane to abstract and pool heterogeneous storage systems. the adop=on of ViPR controller remains modest due to low market awareness, lack of standards and feature gaps IBM is the clear market leader in sokware-defined storage controller sokware (IDC): 60.0% 40.0% 20.0% 0.0% Market Share IBM EMC NetAppOthers 25

26 IBM Spectrum Virtualize transforms the economics of traditional SAN Complement virtualized servers Enhance the value of exis=ng storage suppor=ng 250+ IBM & non-ibm systems Improve flexibility and responsiveness Stuttgarter Straßenbahnen AG 50% reduc=on in total cost Push buhon data mobility University of Pittsburgh Medical Center 67% reduc=on in storage and facili=es cost Con=nuous migra=ons with zero disrup=ons SicoobCredicitrus 30% reduc=on in space Reuse exis=ng systems Middle Eastern Regional Telco 70%+ reduc=on in space Storage provisioned in minutes vs hours 26

27 Once the storage is virtualized, it can take advantage of the faster Flash storage easily. Cost of Flash is now low enough to make it especially ahracive for large-scale storage systems. 27

28 Drive up performance with IBM FlashSystem storage IBM FlashSystem 900 Extreme Performance with IBM MicroLatency : Delivers 100 microsecond response =mes Macro Efficiency: Lowest latency offering with >40% greater capacity Enterprise Reliability: IBM enhanced Micron flash technology which contains MLC offering with Flash Wear Guarantee IBM FlashSystem V9000 Scalable Performance: Grow capacity and performance with up to 2.2 PB scaling capability Enduring Economics: Next genera=on flash media for less than the cost of HDD Agile Integra=on: Fully integrated system management to simplify management and improve workforce produc=vity under a single name space Powered by IBM FlashCore Technology 28

29 IBM All-Flash Solutions Built with IBM Spectrum Virtualize: Keeps getting better! All-flash and hybrid solutions built on IBM Spectrum Virtualize software virtualize external storage under single management, extending rich data services to externalized capacity to reduce both cap-ex and op-ex. Announced 23 rd August New model New model New model ENTRY MIDRANGE ENTERPRISE IBM IBM Corporation Systems

30 IBM Systems Flash storage offerings poroolio designed for your business needs Storwize V5030F Storwize V7000F FlashSystem V9000 FlashSystem A9000 FlashSystem A9000R DeepFlash 150 DS8888 Entry / Mid-Range Mid-Range Virtualizing the DC Cloud service providers Large deployments Big Data High End Server Simplified management Flexible consump=on model Virtualized, enterprise-class, flash-op=mized, modular storage Enterprise class heterogeneous data services and selectable data reduc=on Full time data reduction Workloads: Cloud, VDI, VMware Full time data reduction Workloads: Mixed and cloud High capacity High density z/os Power HA Power i HA 30 SVC Enhanced data storage functions, economics and flexibility with sophisticated virtualization FlashSystem 900 Applica=on accelera=on Extreme performance Targeting database acceleration & Spectrum Storage booster IBM FlashCore Technology Optimized 30

31 The Right Storage for the Workload Environments Virtual Storage Infrastructure Grid Scale Cloud Storage Big Data Storage Business Cri=cal Storage Typical Workloads IBM Systems Performance Capacity Distributed block workloads SQL Server MySQL Tradi=onal IT applica=ons FlashSystem V9000 Storwize V7000F Storwize V5030F Large-scale distributed block workloads VDI Hybrid cloud deployment CSPs (Mixed workloads, Mul=-tenancy) SAP VMware Exchange FlashSystem FlashSystem A9000R A9000 XIV Gen III Distributed file or object workloads Scale: Hadoop, Media Streaming, SAS, Spark, HPC, Content Collabora=on, Highperformance backup target Cleversafe: Content Repositories, Ac=ve Archive DeepFlash 150 w/ IBM Spectrum Scale Cleversafe High-availability / Low RTO applica=ons High-performance OLTP Real =me analy=cs High-performance data warehouse DS8888 DS8886 DS8884 Built with Cleversafe Key Attributes Heterogeneous Enterpriseclass Data Services Dynamic Data Migra=on Mul=-Vendor Management Data Reduc=on Mul=-site ac=ve-ac=ve Cloud-op=mized (QOS, Mul=-Tenancy) Predictable High Performance w/ Data Reduc=on (including deduplica=on) Ease-of-management Scale: Mul=-protocol support Policy-driven =ering Single namespace data ocean High-performance file storage Cleversafe: Global data repository w/ mul=-site load-balancing Simple administra=on z/os Support High Performance Highest Availability z/os (GDPS) Power HA Power i HA Three-site/Four-site Six 9 s Reliability Enterprise Scalability 31

32 IBM FlashSystem storage drops significantly drops the transaction response time Application Processing Time CPU Utilization & App. Efficiency 4% Total Application Processing Time 5,200us (5.2ms) Save time and money! CPU Utilization & App. Efficiency 50% Total Application Processing Time 400us (.4ms) 12X Application benefit by only changing storage latency! 5,000us (5ms) 200us (.2ms) I/O Serviced by Disk Time Waiting for I/0 (Waiting for Array) Time Processing Data (Server CPU) I/O Serviced by IBM Flash 200us (.2ms) 200us (.2ms) 32

33 Migrating data to IBM FlashSystem storage is easy using IBM Spectrum Virtualize With IBM Spectrum Virtualize, administrators can migrate running workloads without down=me Example: Database applica=on running on older DS5000 storage Migrate database to newer, faster IBM FlashSystem storage SVC performs migra=on without interrup=on Database con=nues to process transac=ons Faster IBM FlashSystem performance evident in increased transac=on rates Allows older systems to be easily decommissioned Allows administrators to move data to new storage that meets current business needs Virtually eliminates storage migra=on labor 33 Only 16 minutes to migrate AND performance increases by 13x Many disk arms POWER System running DB2 SVC with IBM Spectrum Virtualize DS5000 FlashSystem TPS 660GB Brokerage Workload 3227 TPS 660GB Brokerage Workload

34 DEMO: Replacing spinning disk with IBM FlashSystems provides instant performance 34

35 IBM Real-time Compression reduces storage and cost; IBM FlashSystem storage maintains performance Power System running DB2 with Brokerage Database TPS % be.er performance SVC with IBM Spectrum Virtualize FlashSystem 900 Uncompressed Compressed Uncompressed Compressed Storage Consumed 1335 GB 651 GB Uncompressed Compressed 51% less storage consumed 49% lower cost 35

36 Agenda for the day Rethinking storage Architec=ng solu=ons for digital and cogni=ve era Virtualize and simplify tradi=onal storage to improve performance and efficiency Architect storage with flexibility and scale for cloud environments Extend storage for analy=cs and big data Protect data from disaster and thek Summary: Why IBM Spectrum Storage Suite and IBM Flash Systems make sense IBM leads the compe==on Complete solu=on for sokware-defined storage (SDS) Full breadth of Flash storage Complete SDS virtualiza=on, with faster real-=me compression Market-leading control sokware Highly advanced Flash technology 36