FlashSystem A9000 / A9000R R12.2 Technical Update

Transcription

1 FlashSystem A9000 / A9000R R12.2 Technical Update Craig Gordon, Lisa Martinez, Brian Sherman IBM Storage ATS - Washington Systems Center Steve Solewin IBM Corporate Solutions Architect

2 Accelerate with IBM Storage Webinars The Free IBM Storage Technical Webinar Series Continues... Washington Systems Center Storage experts cover a variety of technical topics Audience: Clients who have or are considering acquiring IBM Storage solutions. Business Partners and IBMers are also welcome How to sign up? To automatically receive announcements of upcoming Accelerate with IBM Storage webinars, Clients, Business Partners and IBMers are welcome to send an request to accelerate-join@hursley.ibm.com. Information, schedules, and archives: Located in the Accelerate with IBM Storage Blog: Upcoming Webinars: Dec 5 th FlashSystem A9000 and A9000R Update Dec 12 th IBM DS8000 R8.3 DSGUI Live Demo Jan 9 th IBM DS8880 Easy Tier Recent Webinars: Nov 30 th LTO8 Drive and related updates to IBM tape products Nov 16 th VersaStack - IBM s On Premise Cloud Solution Nov1 st Spectrum Control Capacity Planning Oct10 th z14 IO and Infrastructure Modernization Oct 3 rd GDPS Update Sept 14 th DS8000 R8.3 Update Sept 7 th Utilizing the BVIR VEHSTATS Reports to Monitor Your 2 TS7700 Environment

3 Agenda Overview of what s new with R12.2 Container support and scalability enhancements FlashSystem Hardware enhancements Cross generation replication update HyperScale Mobility update HyperSwap Update HyperScale Manager R5.3 enhancements Additional functions 3

4 FlashSystem A9000 / A9000R R12.2 Overview of what s new 4

5 IBM Systems Flash Storage Offerings Portfolio Storwize V5030F Storwize V7000F FlashSystem V9000 FlashSystem A9000 FlashSystem A9000R Elastic Storage Server DS888xF Entry Storage Virtualization Midrange Storage Virtualization Highest Performance Line of Business & MSP Consolidate at scale Big Data Business Critical Simplified management Flexible consumption model Virtualized, enterprise-class, flash-optimized, modular storage Enterprise class heterogeneous data services and selectable data reduction Enhanced data storage functions, economics and flexibility with sophisticated virtualization SVC FlashSystem 900 Application acceleration Radically simple & autonomous design for Cloud Economics & Operations Capacity & performance optimized configurations All-flash with full inline data reduction Enterprise features & reliability Extreme performance Targeting database acceleration & Spectrum Storage booster IBM FlashCore Technology Optimized Consolidates file & object workloads Faster data analysis Global sharing VersaStack Flexible Converged Infrastructure with power of Storwize V5030F and Spectrum Scale z/os AIX Power HA Power i HA Business critical, deepest integration with IBM Z / Power Superior performance & reliability Three-site / Foursite replication DS8884F DS8886F DS8888F 5

6 A9000 / A9000R What s New in R12.2 New FlashSystem A9000 and A9000R model 425 New 3D TLC NAND MicroLatency modules Dates: 10/24/2017 Announcement 11/24/2017 General Availability Cross generation Asynchronous mirroring between XIV Gen3, A9000 and A9000R HyperScale Mobility new configurations Migrate amongst any A9000 and A9000R systems, over fibre-channel IBM Storage Enabler for Containers Increased A9000 and A9000R scalability limits 24K volumes and snapshots 1024 consistency groups for snapshots and mirrors 512 volumes in a consistency group HyperScale Manager Improvements Snapshot scheduler by pool Filter using wildcards Save Preferences by user 6

7 FlashSystem A9000 / A9000R R12.2 Container and scalability enhancements 7

8 IBM Storage Enabler for Containers Unified solution across IBM storage portfolio Allows IBM Storage to provide persistent storage for Docker container environments Communication with IBM block storage systems through IBM Spectrum Control Base Edition (SCBE) SCBE creates a storage profile (for example, gold, silver or bronze) and makes it available for Docker or Kubernetes plugins Orchestration using IBM Cloud Private and Kubernetes Following IBM block storage systems are available: IBM Spectrum Accelerate Family: IBM FlashSystem A9000 and A9000R IBM XIV IBM Spectrum Virtualize Family: IBM FlashSystem V9000 IBM SAN Volume Controller IBM Storwize Family VersaStack 8

9 R12.2 A9000 / A9000R Scalability improvements Scaled-up FlashSystem A9000 and A9000R limits Increase in the number of volumes / snapshots Increased from 16K to 24K volumes and snapshots Increase in the number of volumes per consistency group and number of consistency groups supported Number of volumes in a consistency group increased from 128 to 512 Number of consistency groups increased from 512 to 1024 for snapshots and mirrors 9

10 IBM Spectrum Control Storage Insights Foundation Holistic management, optimization and support experience Anonymous collection of metadata to create a data ocean for AI technologies to exploit Empowers both storage admins and IBM support to deliver better storage outcomes Dates: 10/24/2017 Preview Announcement Beta Available IBM Spectrum Control Storage Insights Foundation Beta Program: ibm.biz/foundationpilot 10

11 Storage Insights Foundation Vision Near real-time view to IBM Support of the client storage environment, including performance, capacity and health IBM Flash Systems IBM Storwize IBM DS8000 Call Home + Storage Insights Meta Data collector IBM Spectrum Control Storage Insights Deep log packages are self-serve for support Select Switches Select Hypervisors IBM predictive analytics mine historical and live telemetry data for insights Future 11

12 FlashSystem A9000 / A9000R R12.2 Hardware update 12

13 Custom Designed Flash Media With Field Proven Architecture The Right Systems for the Right Environments All IBM FlashSystem products share a Consistent Core Architecture IBM MicroLatency Flash Modules delivering industry leading performance IBM FlashCore Technology with IBM Enhanced 3DTLC Flash Consistent low latency performance with Compression always on Non-blocking Crossbar Switch Hardware Only Data Path Concurrent Code Load and Concurrent Maintenance High Availability Flash Enclosure with dual canister design Integrated Data Integrity Checking Two-Dimensional RAID 13

14 FS900 System Block Diagram NVMe over Fabric (NVME-oF) ready 2-Dimensional RAID5 (10+P+S) V S R Maximize Business Uptime Engineered for Flash Low latency NVM data bus Hardware RAID Fully redundant with no single point of failure Data path is entirely independent of the control path Full Active-Active design Fine Grain Grid architecture 14

15 Introducing the new IBM FlashSystem 900 3x higher density with IBM enhanced 3D TLC MicroLatency modules First array in the industry with custom 3D TLC flash modules Traditional 2D NAND has reached the physical limits of scalability Shrinking flash cells and more bits per cell cause lower endurance, heavy error correction, and degraded latency 3D NAND flash enables greater scalability Increases density without compromising latency or endurance Stacks NAND cells vertically instead of shrinking size of each cell Allows increased lithography size 3D TLC Flash Endurance Gain = 3.8X Next generation FlashCore technology improves on native flash chip endurance over 3.8x 15

16 IBM FlashSystem 900 Flash without compromise 3X capacity with new IBM enhanced 3D TLC in 2U Inline hardware compression with no performance penalty Up to 220TB effective capacity for compressible workloads Next generation FlashCore technology Consistent response time; latency as low as 95 microseconds Enhanced user interface with new dashboard view Centralized encryption key management; SKLM 7-year flash wear guarantee 3.6TB 8.5TB 18TB Qty Usable Maximum Effective

17 FlashSystem 900 Technical Foundation FlashSystem 900 R2 FlashSystem 900 R3 Flash media MLC 3D TLC Capacity points Minimum Usable Capacity (TB) (3D TLC) Maximum Effective Capacity (TB) Native compression No Yes RAID RAID 5 + Hot spare RAID 5 + Hot Spare Latency: write 90µs 95µs Latency: read 155µs 155µs IOPS: read (100%, random) 1,100,000 1,100,000 IOPS: read/write (70%/30%, random) 800, ,000 IOPS: write (100%, random) 600, ,000 Bandwidth: read (100%, sequential) 10 GB/s 10 GB/s Bandwidth: write (100%, sequential) 4.5 GB/s 4.5 GB/s Encryption Local key management Local key management, SKLM Interfaces 18 x 16Gb FC 6 x 8Gb FC 8 x 40Gb QDR InfiniBand 18 x 16Gb FC 6 x 8Gb FC 8 x 40Gb QDR InfiniBand Remote support No Yes Warranty 1 year or 3 year 1 year or 3 year 17 17

18 IBM FlashCore Technology The DNA of the FS900/V9000/A9000 family Industry Standard Interface Technology Powered by IBM FlashCore Technology Hardware Accelerated I/O IBM MicroLatency Module Advanced Flash Management Industry Standard Chip Technology IBM Enhanced Micron Technology Engineered for Flash Hardware RAID Hardware inline compression Non-blocking Crossbar Switch Hardware Only Data Path Single Box Highly Available Architecture Concurrent Code Load & Maintenance IBM Engineered Massively Parallel Design FPGAs in the Data Path Distributed RAM High Speed Interface Line Speed Data at Rest Encryption IBM Variable Stripe RAID IBM Engineered ECC IBM Optimized Overprovisioning Health Binning and Heat Segregation Write Buffer and Hardware Offload IBM Optimized Garbage Collection Forget about it Endurance Consistent predictable performance for life 18

19 IBM MicroLatency Module Key Differentiators Built in, always on hardware based compression No added latency Innovative ECC algorithm corrects very high bit error rates (does not require additional reads) Latency does not degrade as parts age Health binning and heat segregation FlashCore technology continually assesses health by monitoring several key parameters Hotter data placed in healthier blocks Up to 57% improvement in endurance! Write Amplification reduced by up to 45% by grouping like heat levels The IBM and Micron collaboration provides special access to the Flash Extensive characterization determined optimal read offsets to set as block ages Powerful checks on entire data path, including inside the flash modules Variable Stripe RAID delivers two dimensions of data protection Results: Large endurance gains w/o latency penalty Asymmetrical wear leveling results in higher endurance in real life workloads! As the part ages and we determine the health of each block, the ideal voltage levels are set in order to minimize errors! Outstanding data reliability and improved endurance Consistent low latency performance! 19

20 FlashSystem A9000 and FlashSystem A9000R FlashSystem A9000 8U, complete offering IBM Installation, service and support Ideal building blocks for service providers 110TB 900TB effective capacity* Up to 900K IOPs 250µs minimum latency FlashSystem A9000R Pre-integrated 42U rack offering IBM Installation, service and support Scale-out grid architecture Ideal for larger enterprise environments 360TB 3.6PB effective capacity* Up to 2.4M IOPs 250μs minimum latency *Note: Effective Capacity assumes 5:1 Data Reduction ratio 20

21 A9000 and FS900 R3 Truly Capacity and Cost Optimized IBM FlashSystem A9000 and IBM FlashSystem A9000R 8U with cable bundle and fully self contained All Grid controllers and the single flash drawer interconnected with InfiniBand (IB) A9000/R exploits FS900 hardware compression for metadata A9000 Grid Controller exactly the same as the A9000R grid controller 384GB DRAM Same Processor complex as A9000R Next Generation X86 processors to further improve performance IBM FlashSystem A9000 The FS900 drawer adds 3D TLC! Usable capacities increase to 22TB, 36TB, 85TB and 180TB 21

22 FlashSystem A9000 Model 425 Configurations Accelerate line-of-business workloads Accommodate fast-growth of data-intensive applications Support real-time data-driven business decisions 3X Capacity increase 66% Power and space reduction Cost-competitive with Hybrid Arrays Balanced Capacity Optimized 900K IOPS Performance Optimized 900K IOPS 900TB* IOPS results represent random IO, 80/20% read/write * Capacity information is Effective, assuming 5:1 data reduction 900K IOPS 110TB* 900K IOPS 180TB* 425TB* MicroLatency Module usable capacity 3.6TB (X8) 3.6TB 8.5TB 18TB 22

23 A9000R integrated with FS900 R3! IBM FlashSystem A9000 and IBM FlashSystem A9000R A9000R interconnect to FS900 is unchanged RDMA over InfiniBand A9000/R exploits FS900 hardware compression for metadata Next Generation X86 processors to further improve performance A9000 and A9000R have same high performance grid controllers The FS900 drawer adds 3D TLC! Usable capacities increase to 36TB, 85TB and 180TB A9000R scales from 2 to 4 grid elements Grid element consists of 2 grid controllers and one FS900 storage enclosure IBM FlashSystem A9000R 23

24 FlashSystem A9000R Model 425 Configurations Consolidate with Confidence Leverage declining cost of flash media Dramatically reduce footprint vs HDD storage Dramatically reduce power consumption Dramatically improve data center utilization Balanced Capacity Optimized 2.4M IOPS 1.8M IOPS 3.6PB* Number of Grid-Elements Performance Optimized 1.8M IOPS 2.4M IOPS 1.7PB* 1.2M IOPS 2.7PB* IOPS results represent random IO, 80/20% read/write * Capacity information is Effective, assuming 5:1 data reduction 1.2M IOPS 360TB* 1.8M IOPS 540TB* 2.4M IOPS 720TB* 1.2M IOPS 850TB* 1.28PB* 1.8PB* MicroLatency Module usable capacity 3.6TB 8.5TB 18TB 24

25 A9000 / A9000R Building blocks: Server Lenovo M5 Server Same Server for A9000 / A9000R Dual socket Xeon Processor E v4 12C 2.2GHz 30MB 2400MHz (Broadwell) 384GB RAM - 8 x 32GB 8 x 16GB DDR4 Memory 2400MHz LP RDIMM 2 x HDD (600GB), 2 x SSD (400GB) Internal battery solution BBU Kit 25

26 . Server PCIe slots configuration Two configurations (Host connection) iscsi over 10GE - Based on MLX ConnectX-3 Pro FC Based on Qlogic QLE2662 InfiniBand (IB) Interconnect Based on MLX Connect-IB Server to Server and Server to Flash Compression card Coleto Creek A9000 A9000R Fiber channel 1 PCI 2 PCI 3 PCI IB Compression Card FC IB 6 PCI 7 PCI 8 PCI Compression Card 10GE FC 2 1 ATTENTION Power supply filler is required for system cooling Remove only when installing 2 nd power supply 750w AC 750w AC AC DC AC DC 1 PC I 2 PC I 3 PC I IB Compression Card FC 6 PC I 7 PC I 8 PC I Compression Card 10GE FC 2 1 AC 750w AC ATTENTION Power supply filer is required for system cooling Remove only when instaling 2 nd power supply AC DC AC DC iscsi over 10GE configuration A9000 A9000R 1 PCI 2 PCI 3 PCI IB Compression Card IB 6 PCI 7 PCI 8 PCI Compression Card 10GE 10GE 2 1 ATTENTION Power supply filler is required for system cooling Remove only when installing 2 nd power supply 750w AC 750w AC AC DC AC DC 1 PC I 2 PC I 3 PC I IB Compression Card 6 PC I 7 PC I 8 PC I Compression Card 10GE 10GE 2 1 AC 750w AC ATTENTION Power supply filer is required for system cooling Remove only when instaling 2 nd power supply AC DC AC DC 26

27 FlashSystem A9000/A9000R model 425 Host Port Connections Host Port Connections * Option 1 Host Port Connections * Option 2 A x16Gb FC + 6x10Gb iscsi 12 x 10Gb iscsi A9000R with 2 Grid Elements 16x16Gb FC + 8x10Gb iscsi 16 x 10Gb iscsi A9000R with 3 Grid Elements 24x16Gb FC + 12x10Gb iscsi 24 x 10Gb iscsi A9000R with 4 Grid Elements 32x16Gb FC + 16x10Gb iscsi 32 x 10Gb iscsi * Host port connections must be identically configured (100% Option 1 or 100% Option 2) in each of the grid controllers 27

28 FlashSystem A9000 and A9000R Choice of financial and licensing models Own: Perpetual license Reuse: Transferable Consume: Storage Utility Offering* Available as VersaStack integrated offering Baseline subscription * Storage Utility Offering for A9000/A9000R model 425 available initially via RPQ with standard support planned for 1Q/18 28

29 Performance Updates (by version software update only!) Read Bandwidth Per Module GB/s 1.25 GB/s 2.3 GB/s 3 GB/s 3.25 GB/s Maximum IOPS Per Module - Read Hit 4K 0.27 MIOPS 0.33 MIOPS 0.37 MIOPS 0.50 MIOPS

30 A9000R TPC-C Oracle OLTP (70/30/80 8K) 1.10 Response Time (ms) / Throughput (IOPS) Curve A9000R ms 0.7 ms ms 0.3 ms 0.3 ms 0.3 ms 0.2 ms 0.2 ms 307, , ,000 1,230,000 1,538,000 1,846,363 2,154,000

31 FlashSystem A9000 / A9000R R12.2 Cross gen Replication 31

32 Cross-generation Asynchronous mirroring Asynchronous mirror between A9000/A9000R and XIV Gen3 Supported versions: XIV Gen3: a only A9000/R: and above Bi-directional mirror is supported FC or iscsi XIV Gen3 - only uncompressed volumes can be mirrored with A9000 All Async mirror functionality is supported: change role, switch role, mirrored snapshots, etc. No change in XCLI Asynchronous mirror 32

33 Cross-gen Async mirror relevant limitations Limitations always according to the more strict limit (Gen3) Volume sizes: Max volume size that can be mirrored cross-gen: 161TiB (Gen3 limit) The volume size in blocks must be identical. Rounding up rules may be different and result in different volume size in GB, but that does not matter Max CG size: 512 volumes Cross-generation limited to 128 volumes per CG due to XIV limit Max mirrors: 512 (XIV limit) Max targets 10 Min interval 1 minute with HSM, 30 seconds with xcli Min RPO 2 minutes with HSM, 60s with xcli Interval must be less than the RPO 33

34 FlashSystem A9000 / A9000R R12.2 HyperScale Mobility 34

35 Simplify management with non-disruptive data mobility Agile integration IBM Hyper-Scale Mobility enables seamless data migration across FlashSystem A9000 / A9000R systems: Maximize utilization across systems Simplify data movement with an automated, non-disruptive process HOST Automatically redirects to the new location Eliminate interruptions to host applications Balance workloads without downtime for better performance

36 FlashSystem A9000 / A9000R R12.2 HyperSwap 36

37 HyperSwap Continuous Availability solution for A9000 & A9000R IBM has long understood the critical requirement to always have access to data and first introduced HyperSwap technology on IBM Storage for IBM Z in 2002 Data is replicated between two systems using sync mirror technology Host A Volume exists on both systems simultaneously The hosts connect to a HyperSwap volume through both systems in an active-active configuration Asymmetric Logical Unit Access (ALUA) utilized to optimize paths between host and storage Hosts I/O is maintained through failures by high-availability logic using a third site Quorum Witness (QW) Existing sync relationships can be converted to HyperSwap and vice versa If the host experiences a planned or unplanned failover, there is a change in the state of its paths with no impact to applications and no manual intervention Primary Data center A Quorum Witness Secondary Data center B Site C 37

38 IBM Hyper-Scale Manager FlashSystem A9000 / A9000R R12.2 HyperScale Manager 38

39 Hyper-Scale Manager 5.3 What s New Summary Support for the 425 model Snapshot Scheduler (defined at a pool boundary) Flexible Layout Saving user preferences Improved Host Awareness Filtering with wildcards: * and, Management server updates Latency Restart Perform actions on a mass of volumes i.e. Activate mirror Create a host cluster on multiple systems 39

40 40

41 HSM R5.3 - Snapshot Scheduler 41

42 HSM R5.3 Flexible Layout Save user preferences 42

43 HSM R5.3 Filter using Wildcards Smart Filtering: Search anything in your environment in seconds by any parameter or condition Use smart filtering for policy control to find non-valid objects by searching Additional wildcard filtering using * or OR/, 43

44 HSM R5.3 - Improved Host Awareness Experience 44

45 HSM R5.3 - Improved Host Awareness Experience 45

46 FlashSystem A9000 / A9000R Additional functionality 46

47 A9000/A9000R Data Reduction Processing (Host Write) 8KB pattern detection Deduplication Compression Pattern Matching 64KB Host Write 8KB 8KB 8KB 8KB 8KB 8KB 8KB 8KB Known patterns Match found Removal 8KB 8KB 8KB 8KB 8KB 8KB Duplicate found Dedupe 8KB 8KB 8KB 8KB Compression 47

48 Cloud Storage Management with IBM A9000/A9000R - orchestration made easy REST API CLI VMware, Microsoft and Container integration IBM Spectrum Control Base Python Library OpenStack Cinder 48

49 End-to-End A9000/R solutions for Monitor A9000/R health with Easily automate A9000/R operations with Provide A9000/R Visibility & Self service provisioning to vcenter administrators with Enable A9000/R Storage Policy Based Management (SPBM) & Virtual Volumes (VVOL s) with Orchestrate A9000/R & ESXi hosts Disaster Recovery with Leverage A9000/R performance efficiencies to increase ESXi VMFS scalability, with Backup vsphere virtual machines on A9000/R with vrealize Operations vrealize Orchestrator & vrealize Automation vsphere vcenter Web Client Plugin vsphere VASA vsphere Site Recovery Manager vsphere VAAI IBM Spectrum Protect Plus 49

50 A9000/R solutions for Monitor A9000/R health with Enable A9000/R self-service provisioning for System Center Virtual Machine Manager administrators Orchestrate A9000/R & Hyper-V hosts Disaster Recovery Azure Site Recovery Backup Hyper-V virtual machines on A9000/R with Azure Site Recovery IBM Spectrum Protect Plus 50

51 FlashSystem A9000/R Data-at-rest Encryption MicroLatency : Hardware-based data at rest encryption A9000 and A9000R Industry standard AES-XTS 256 Encryption Hot encryption activation and re-keying Key management External key management IBM Security Key Lifecycle Manager (SKLM) Safenet KeySecure Thales Other KMIP compliant solutions via RPQ Internal key management 51

52 Protecting data in the cloud with Multi-Tenancy Multi-tenancy restricts the objects the user can access Provide the ability to serve multiple clients/organizations (tenants) in a single system Each tenant s storage admin can manage their allocated storage without knowing (or caring) about others A Domain is a subset of the system s resources Users, pools, hosts and clusters Restricts the resources a user can manage No visibility between domains Two storage administrator types Global Admin (access to the entire box and creates domains) Domain Admin (associated with one or more domains, access to resources only within the domain(s)) Use in conjunction with Quality of Service as required 52

53 Performance Management with Quality of Service (QoS) Optional to ensure performance for critical applications by limiting performance of lower priority hosts or applications (e.g. Test/Dev) accessing the same A9000/A9000R/XIV system Performance class limiting IOPs, MBs or both is created Type of classes: Hosts Pools/Domains Volumes Maximum IOPs/BW for class can be independent or shared Objects outside performance classes are not limited by QoS Immediate, dynamic changes Movement into/out of a performance class Maximum IOPs and/or BW specifications for performance class An I/O is limited by the maximum limit 53

54 CVD available for A9000 in a VersaStack Converged Infrastructure Software Defined method of deploying a Storage Infrastructure Field proven enterprise storage software Repurpose x86 infrastructure at will Co-locate compute and storage for a converged solution Scale-out private Cloud with full enterprise storage capability All-Flash Converged Infrastructure: VersaStack Storwize V5030F Storwize V7000F SVC FlashSystem V9000 FlashSystem A9000 Entry Midrange Virtualizing the DC Enterprise Cloud service providers

55 Tier 1 Guarantee IBM FlashSystem A9000 and IBM FlashSystem A9000R Performance: IBM MicroLatency performance with fulltime data reduction Data Reduction: Effective capacity guaranteed 3 different ways: sight unseen, measured estimates & a competitive match Deduplication, Compression, & Pattern removal High Availability Exceed the built in % uptime with active-active data access enabled by HyperSwap & High-Availability Guarantee 7 year 24x7 Support: Up to 7 years support available with optional price protection and flash media retention offerings Enterprise Class Support Endurance: FlashCore ensures that Flash memory will be covered for read/write endurance while you are under warranty or maintenance Peace of Mind: No charge IBM services, incl. training, configuration, & consultation, for all tier 1 offerings Perpetual Licensing with IBM Spectrum Accelerate / IBM Spectrum Storage Suite 55

56 Questions 56