Accelerate with IBM Storage: Exploiting DS8000 with IBM i

Transcription

1 Accelerate with IBM Storage: Exploiting DS8000 with IBM i Alison Pate Executive IT Specialist patea@us.ibm.com Copyright IBM Corporation 2017.

2 Agenda IBM i Storage Options DS8000 Architecture DS8000 with IBM i Synergy Performance Considerations Power HA Summary Backup material Implementation Best Practices 1

3 IBM i Storage Architecture Built on DB2 with heavy exploitation of Data in Memory Built on disk block size of 520 bytes Data is spread across all disks in disk pool Designed for ease of use and self-management Why does this matter when choosing a storage system? Little skew Random access patterns Cache unfriendly All-or-nothing copies (full system copy) 2

4 Single level storage Auxiliary Storage Pool structure Auxiliary Storage Pools (ASPs): ASPs are created from one or more disk units to isolate data / workload to the same storage area The system ASP (ASP 1) contains the load source disk unit and exists on every IBM i system Optionally user ASPs 2-32 or/and independent user ASPs (IASPs) can be created Independent Auxiliary Storage Pools (IASPs): A primary disk pool and zero or more secondary disk pools which are grouped together and share the same database IASPs can be varied on/off (mount/unmount) Singly or as groups together IASPs can be made switchable between IBM i cluster nodes Single Level Storage System ASP User 2-32 iasp# UDFS The system database is referred to as SYSBAS Primary Pool groups for multiple databases Primary Secondary Primary Secondary Important: IBM i single-level storage architecture requires that storagebased replication for IBM i must either be implemented on full-system or IASP level. Secondary 3

5 Storage Options Power System DS8880 NPIV IBM i Native VIOS IBM FlashSystem NPIV vscsi NPIV Spectrum Virtualize V9000, V7000 and SVC Native VIOS (virtual) XIV Any supported storage 4

6 DS8880 Family Highlights Performance Built on Power 8 High-Performance Flash Enclosure Five generations of Easy Tier and automated QoS management Storage synergy Integration with IBM i for an infrastructure optimized for critical workloads and high performance Reliability and availability Designed for % availability to keep critical applications online all the time The gold standard in business continuity solutions with deep integration with high-end server HA/clustering Economic Impact Self-optimization and QoS management Efficient architecture keeps hardware resources balanced and capacity utilization high Data Protection and Security Flexible replication services to address backup and business-continuity needs. Government-grade security with stronger encryption, advanced access control, and self-encrypting drives Ease of Use Self optimization features to redirect IT staff to more important initiatives Advanced GUI keeps administrators productive and happy 5

7 IBM POWER and System Storage DS8000 DS8000 is IBM s Flagship Disk System and is built on over 50 years of enterprise class innovation & tens of thousands of systems sold IBM DS8000 Leads in IBM i attached external disk IBM Power servers and storage are designed together to work together IBM is best positioned to deliver support for IBM Power Systems innovation first and often does long before competition can Integration at every phase Design Development Testing Customer Support Tight collaboration yields many benefits in performance, availability, resiliency, lower cost, etc 6

8 Seven Generations of the DS8000 Family POWER5 POWER5+ POWER6 POWER6+ POWER7 POWER7+ POWER8 DS8100 DS8300 DS8300 Turbo DS8700 DS8800 DS8870 DS8870 DS8880 Replication and Microcode Compatibility 7

9 IBM i and DS8000 Synergy Full System HyperSwap Live Partition Mobility and HyperSwap Variable LUN sizes PowerHA - ACS integration with CSM Increased integration of IBM i performance tools with DS8000 IBM i OS based hot data ASP Balancer and DB2 media preference support for DS8000 Solid State Drives (SSD) and EasyTier PowerHA NPIV Virtual I/O Server with DS8000 Full support of Virtual I/O Server (VIOS) and PowerHA PowerHA + DS8000 copy services end-toend integration Common Smart-IOA fiber for disk and tape Smart fiber I/O Adapter (IOPless) 6.1 (++ performance) Tagged Command Queuing and Header Strip Merge (+++ performance) Common one-stop POWER/DS8000 support 16Gb fiber Advanced DS8000 on IBM i education series Storage on IBM i Redbooks BRMS native support for FlashCopy environment Boot from San DSCLI - DS Command Line Interface provides IBM i control Additional LUN sizes for increased flexibility Copy Services for IBM DS8000 (a.k.a. Toolkit) Disk Magic and IBM i Performance Tools coordination Enhances cache algorithms for iseries benefits all OS s 8

10 DS8000 Just Keeps Getting Better Note: not all enhancements are included 2004 DS8100/DS Easy Tier Thin Provisioning Quick Init 2TB nearline SATA Multiple GM sessions Easy Tier2 IO Priority Manager (open) Resource Groups New GUI 16TB LUN New Business Class option Encryption for SSD and NL-SAS on DS8800 Easy Tier4 400GB SSD Thin Provisioning for all copy services Easy Tier V Server, App, Heat Map Transfer VMware VAAI, vsphere, SRM zsynergy Global Mirror Pause with Consistency High Perf Flash Enclosure Easy Tier VI 200GB & 800GB SSD OpenStack Enhancement s Multi-target Mirroring Gb FCP/FICON Fabric Priority Forward Error Correction Dynamic Routing zhpf distance performance T10 Diff for AIX 16Gb HBA OpenStack Kilo support GUI Performance Monitoring RESTful API DS8888 all Flash RAID 10 for HPFE KIMP support LDAP support for CSM SuperPAV DB2 Castout Accelerator ESE for CKD Small extents ESE space release for GM Remote access and package offload OpenStack Mitaka GUI Updates HPFE Gen 2 Models 984/84E, 986/86E,985/85E 400GB, 800GB, 1.6 TB and 3.2 TB Flash capacity options RAID 6 default for all drives User supplied Digital Certificates for Authentication Extent level Space Release with DFSMSdss Support configurable HMC firewall DSCLI support for z/os Improved IU pacing for FICON Read from MM secondary Space Release with Copy Services PPRC Standard to ESE New RESTful APIs DS8870 include all functional enhancements up to R DS8100 / DS8300 includes all functional enhancements up to R4.3 HyperPAV Storage Pool Striping Space Efficient FlashCopy Dynamic Volume Expansion Extended Address Volumes Intelligent Write Cache Full Disk Encryption (FDE) Remote pair FlashCopy Thin Provisioning Quick init zhpf Multi-track support DS8700 with Power6 controller PCI-E internal fabric Increased Cache/NVS DS8700 / DS8800 include all functional enhancements up to R DS8800 Power6+ All 2.5 SAS-2 drives 8GB HA and DA TB nearline SAS Add l expansion frame and 1,536 drives Easy Tier3 I/O Priority Manager (CKD) zhpf QSAM BSAM BPAM 1 TB EAV DB2 list pre-fetch optimizer Global Mirror Collision Avoidance DS8870 with Power 7 controller Increased Cache / NVS All FDE drives RoHS 2013 Energy savings Support of the American National Standards Institute's (ANSI) T10 Data Integrity Field (DIF) standard DS8870 with Power 7+ controller 1.2TB and 4TB FDE drives OpenStack VMware VWC Easy Tier Server Cluster HPFE in Expansion Frame Flash Performance Accelerator Multi-target PPRC Easy Tier VII zhyperwrite 600GB 15K and 1.2TB SSD New GUI Multiple Incremental FlashCopy Relationships Global Copy Collision Avoidance POWER8 Improved rack power system New I/O bay interconnect Improved I/O enclosure bays Standard industrial rack packaging Small form factor Hardware Management Console (HMC) New advanced function license packaging DS HPFE support 800 GB Flash cards DS8870 Model Conversion to 3 phase DS8886 Full support for Small Extents and Thin Provisioning Display Copy Services Pokeables and Product Switches via CSM 9

11 Performance Performance Copyright IBM Corporation Accelerate with IBM Storage. 10

12 Performance Objectives Provide predictable and consistent performance at the most cost effective point Easy performance management/minimize tuning Easy performance reporting 11

13 IBM Disk Magic - Performance planning Integration IBM/BP delivered custom performance and capacity sizing for your workloads IBM i Performance Tools Report Data POWER Workload Estimator Manual Input Modeled Workload Output 12

14 Memory and IO hierarchy Nano seconds Speed DRAM Micro seconds Flash Cost Milli seconds Enterprise Disk Nearline Disk 13

15 Future view of the All-flash and Hybrid-flash market All Hard Disk Drive 42.11% 41.70% 42.64% 43.85% 44.66% 45.63% 45.25% 5.64% 11.20% 16.28% 20.38% 24.05% 27.38% 29.28% Source: Worldwide External Enterprise Storage Systems Forecast, , Publication Date: IDC Jul, 2016 Hybrid Flash All Flash 14

16 DS8880F all-flash family Efficiently designed to meet a wide range of business needs, from small to large enterprises DS8884F Business class DS8886F Enterprise class DS8888F Analytics class Lowest entry cost for midrange enterprises Built with IBM Power Systems S822 6-core POWER8 processor per S822 Up to 256 GB Cache (DRAM) Up to 32 Fibre channel/ficon ports From 6.4TB to 154 TB of flash capacity High performance for large enterprises Built with IBM Power Systems S824 From 8 to 24-core POWER8 processor per S824 Up to 2 TB Cache (DRAM) Up to 128 Fibre channel/ficon ports From 6.4TB to TB of flash capacity Highest performance for faster insights Built with IBM Power Systems E850 From 24 to 48-core POWER8 processor per E850 Up to 2 TB Cache (DRAM) Up to 128 Fibre channel/ficon ports From 6.4TB to 1.22 PB of flash capacity 16

17 KIOPs DS8880F All-Flash Database Open Performance Summary Values based on OLTP database simulation benchmarks: 70% read, 30% write, 4KB IOs and 50% read cache hit DS8884F DS8886F DS8888F 0.3 ms Peak DS8884F DS8886F 0.3 ms Peak IOPs 17

18 IBM System Storage Easy Tier New generation of smart storage that intelligently adapts to application workloads Places data on the correct hardware tier Optimize your hardware investment Maximize application performance Automated and granular: Automated movement of data based on actual workload performance Virtually no administrative effort: Easy Tier optimizes storage tiering without laborious manual tuning Supported on DS8000, Spectrum Virtualize, and Storwize family Slightly different implementations 18

19 Easy Tier - Workload Learning Easy Tier learning of application IO patterns Heat Map Migration plan 24 hour cycle for inter-tier migration 6 hour cycle for intratier migrations Extent migration background task IO pattern Migration Plan Solid-state Enterprise - FC / SAS Heatmap and I/O Density Report Nearline - SAS / SATA 19

20 Easy Tier Performance with IBM i DS GB 10K rpm disks plus SSD managed by Easy Tier 20

21 IBM i Exploitation of SSD with DS8000 IBM i can recognize SSD-backed LUNs on DS8000 Manually ASP placement DB2 Media Preference ASP Balancer BRMS Migration Easy Tier Transparent to server Minimal implementation effort 21

22 DB2 Media Preference Tag objects to be placed on SSD Great option if you know which files are hot for the application Performance Explorer data can be used to find hot files Data available via PEX read latency by job 22

23 DS8886 Performance IBM i Client Data 600GB 15K rpm disks plus HPFE and SSD Managed by Easy Tier with Media Preference 24

24 Performance Monitoring Integration Performance monitoring integration and ease of use Other POWER IBM i Cache DS8000 CPU Ranks Mem Links LUN IBM i Collection Services SAN Infrastructure Performance Statistics Focus on end-to-end performance monitoring and investigation for an IBM i and DS8000 environment IBM i 7.1 adds a new category to IBM i Collection Services *EXTSTG new collection performance metrics from DS8000 Requires DS8000 R4 or later firmware Data can be presented in graphs using idoctor today 25

25 Average DS to IBMi latency Copyright IBM Corporation Accelerate with IBM Storage. 29

26 Disk Performance on IBM i Understand your workload Use the sizing tools (Work with IBM or Business Partner) Disk Magic Sue Baker s IOA sizing spreadsheet Plan logical configuration as well as hardware configuration No measureable difference in performance between native, NPIV, and VIOS attachments Isolation or sharing? Balance IO activity across all resources Stripe and share everything Isolate IBM i workloads for performance protection Easy Tier can work well with IBM i Use minimum 20% Flash capacity guideline 30

27 High Availability and Disaster Recovery High Availability Disaster Recovery Copyright IBM Corporation Accelerate with IBM Storage. 31

28 High Availability and Disaster Recovery Increase system up-time Reduce backup times Reduce planned outages Maintenance windows, Backup windows, Software upgrades Reduce time to recover in the event of a Disaster (RTO) Reduce RPO in the event of a disaster Increase backup frequency Automate Recovery Reduce overheads of Disaster Recovery provision Combined HA/DR, Reduce costs, Reduce manpower 32

29 Copy Services Point in Time copy within the same storage system FlashCopy Snapshot Remote Replication between storage systems Synchronous (Metro Mirror/PPRC) Asyncronous (Global Mirror) Multiple site replication Metro/Global Mirror Cascading Multi-target PPRC (3 and 4 site) 33

30 Copy Services Architectures for IBM i iasp based replication PowerHA and copy services PowerHA LUN Level Switching Clustering and E2E automation IASPs eliminate need for IPL HA, DR and Backups PROD (source) LPAR-1 IASP PowerHA Network HA/DR (target) LPAR-2 IASP Ext. Storage Ext. Storage Full Copy resiliency Full system copy Required IPL crash consistency Manual operation or toolkit management PROD (source) LPAR-1 HA/DR (target) LPAR-2 Network Ext. Storage Ext. Storage 34

31 Flash Copy Automation available from IBM lab services for DS8000, Spectrum Virtualize, and XIV Production System/LPAR Backup System/LPAR Tape System Prod LUNs BRMS Flash Copy Full system copy requires an IPL of the Backup LPAR BRMS support for Flash Copy 35

32 Flashcopy for backup timeline Traditional Backup Production processing Quiesce system Backup to tape IPL resume Production processing Backup with FlashCopy Flashcopy Production processing Quiesce system IPL resume Production processing IPL Backup system Backup to tape 36

33 Full System Copy Metro Mirror (or Global Mirror) Automation available from IBM lab services Production Site Backup Site Full System Remote Copy Full System Target Full System Flash BRMS Tape System Local site Backup System i will require an abnormal IPL for unplanned outages. Planned outages require an IPL of the Backup LPAR 37

34 End-to-End Solution Washington Systems Center - Storage PowerHA SystemMirror for i An IBM delivered, end-to-end solution for HA, DR and on-line backups PowerHA SystemMirror for i Switched IASPs IBM i Clusters and Cluster Resource Services HA Switchable Resources - XSM DSCLI DS Command Line Interface Geographic Mirroring Metro Mirror Global Mirror Flash Copy DS8000 and Storwize Lab Services ACS LUN Level Switching OS Resiliency Technology Storage Resiliency Technology 38

35 Power HA with Storage Replication Admin domain Production LPAR HA/DR LPAR Sysbase IASP Replication IASP Sysbase Only the IASP is replicated/switchable Replication target is offline until failover when it is varied online to the HA/DR system Each IBM i LPAR is running it s own version of the System (SYSBAS) 39

36 PowerHA for IBM i Comprehensive HA/DR solutions for multi-site or data center Shared storage clustering technology Provides automation for ease of use Implemented in IBM i, SLIC, and storage management Data replication is provided by IBM storage FlashCopy enables off line tape backup Designed for regular role swap operations and automated failovers Developed and supported by IBM 40

37 PowerHA Enterprise Edition HyperSwap solution for High Availability Two-site DS8K HyperSwap PowerHA Enterprise Edition cluster configuration Combine with Live Partition Mobility for Server and Storage HA Server outage management via a PowerHA cluster operation Storage outage management via a HyperSwap switch Full System or IASP implementation Application Metro Mirror HyperSwap Site one Site two 42

38 PowerHA Tools for IBM i Complement and extend PowerHA and IBM Storage capabilities for HA/DR Helps reduce business risk and improve resiliency for critical applications Simplifies set up and automation of HA/DR and backup solutions Reduces cost of maintaining and regular testing of an HA/DR environment Facilitates flexible deployment options for single or multi-site protection Assures consistent deployment using best practices and experienced consultants PowerHA Tools for IBM i is a service offering from IBM Systems Lab Services

39 PowerHA Tools for IBM i PowerHA Tools for IBM i Capability Benefit DS8000 Storwize Internal Smart Assist for PowerHA on IBM i Provides operator commands and scripts to supplement PowerHA installation and ongoing operations for IASP enabled applications. IASP Manager (Automated recovery with faster IASP-level vary on, no system IPL) Flashcopy Automates Flashcopy of IASP for daily off-line backup with seamless BRMS integration. Simplifies deployment and ongoing management of high availability for critical IBM i applications. Increases application availability by reducing or eliminating backup window for routine daily backups. Yes Yes Yes Yes Yes LUN-level Switching Simplifies deployment and automates switching of an IASP between IBM i cluster nodes in one data center. Enables a business continuity manager to provide a simple, single site HA solution. Yes* Remote Copy Simplifies initial deployment and automates ongoing server and storage management of two-site Metro Mirror or Global Mirror HA or DR solutions. Requires IASP enabled applications.. Enables a business continuity manager to provide seamless operation of integrated server and storage operations for two-site high availability or disaster recovery. Yes Metro Global Mirror (MGM) Extends PowerHA functionality to provide three-site server/storage replication solution combining Metro Mirror for HA with cascading Global Mirror for DR. Requires IASP enabled applications and IBM Tivoli Productivity Center for Replication (TPC-R). Enables a business continuity manager to further lower business risk and maximize business resilience for highly critical business applications that require three-site HA/DR protection. Yes Multi-Target Copy (MTC) Extends PowerHA functionality to provide three-site server/storage replication solution for HA/DR broadcast topologies including two Metro Mirror relationships or a Metro Mirror and Global Mirror relationship. Requires IASP enabled applications and IBM Copy Services Manager (CSM). Full System Manager (Automated recovery, requires full system IPL on target LPAR) Flashcopy Automates full system Flashcopy for daily off-line backup with integrated support for BRMS without IASP-enabled applications. Enables a business continuity manager to further lower business risk and maximize business resilience for highly critical business applications that require three-site HA/DR protection. Increases application availability by reducing or eliminating backup window for routine daily backups. Enables an entry solution while planning IASP enablement. Yes XIV Yes Yes Yes Remote Copy Simplifies initial deployment and automates ongoing server and Enables a business continuity manager to provide storage management of two-site Metro Mirror or Global Mirror seamless operation of integrated server and storage HA or DR solutions. without IASP-enabled applications. operations for HA or DR. Enables an entry solution while planning IASP enablement. Copyright IBM Corporation Accelerate with IBM Storage. *DS8000 support available with PowerHA Tools for IBM i 6.1 or earlier, included in PowerHA SystemMirror 7.1 Yes Yes

40 IBM Lab Services Offerings for PowerHA for IBM i PowerHA Service Offering IBM i High Availability Architecture and Design Workshop PowerHA for IBM i Bandwidth Analysis IBM i Independent Auxiliary Storage Pool (IASP) Workshop PowerHA for IBM i Implementation Services Description An experienced IBM i consultant will conduct a planning and design workshop to review solutions and alternatives to meet HA/DR and backup/recovery requirements. The consultant will provide an architecture and implementation plan to meet these requirements. An experienced IBM i consultant will review network bandwidth requirements for implementing storage data replication. IBM will review I/O data patterns and provide a bandwidth estimate to build into the business and project plan for clients deploying PowerHA for IBM i. An experienced IBM i consultant will provide jumpstart services for migrating applications into an IASP. Training includes enabling applications for IASPs, clustering techniques, plus managing PowerHA and HA/DR solution options with IASPs. An experienced IBM consultant will provide services to implement an HA/DR solution for IBM Power Systems servers with IBM Storage. Depending on specific business requirements, the end-to-end solution implementation may include a combination of PowerHA for IBM i and/or PowerHA Tools for IBM i, plus appropriate storage software such as Metro Mirror, Global Mirror and/or Flashcopy. For more information on PowerHA Tools for IBM i offerings and services, contact: Mike Gordon mgorgo@us.ibm.com stgls@us.ibm.com

41 Implementation Implementation Copyright IBM Corporation Accelerate with IBM Storage. 46

42 Implementation planning Understand the workload and the environment Isolation or sharing? Balance IO activity across all resources Stripe and share everything Use as few pools as possible to preserve required level of isolation Isolate Critical workloads Performance and Availability Exploit IOPM to protect disk resources for critical workloads Isolate IBM i workloads? Apply common sense 47

43 Logical Configuration as important as the hardware LUN size Number and size of LUNS GB is optimal Use Disk Magic Size appropriate number of LUNS per fiber channel port IOA configuration on Power Server Driven by addressing, performance, and availability Use Sue Baker s Spreadsheet to determine IOA ports required Isolation or Sharing? Apply Common Sense DS8000 HA ports not impacted by addressing Use Disk Magic 48

44 Replication considerations Account for replication requirements in sizing Remote Copy ports Replication overhead (Disk Magic) Target Configuration Global Mirror journals Dedicate DS8000 HBA cards for replication (minimum of 2 cards) Use of Extent Space Efficient LUNs for Global Mirror Small extents recommended 30-50% provisioned 49

45 Benefits of NPIV without NPIV POWER Server 2 port IOA 2 port IOA 2 port IOA 2 port IOA 2 port IOA Switch LPAR A LUNs LPAR B LUNs 4 port HA 4 port HA LPAR C - 64 LUNs DS

46 Benefits of NPIV with NPIV POWER Server 2 port IOA 2 port IOA Switch Virtualized connections 4 port HA 4 port HA DS

47 NPIV Guidelines and Limits Virtual IOA limits NPIV 64 LUNs/virtual path Multiple virtual paths from different LPARS can share the physical path Recommend up to 3 virtual paths/physical path Use Sue Baker s Fiber Channel planning guide Consider adding HA ports and HBA cards for ease of management Aka Apply Common Sense Sharing optimizes hardware use: balance against requirements for isolation 53

48 Why external disk? High Availability Disaster Recovery Performance Consolidation And flexibility Virtualization Encryption Centralized Storage Management 54

49 Further References for DS8000 External disk on IBM i redbook DS8000 Copy Services for IBM i redbook DS8000 Copy Services for IBM i with VIOS redbook DS8000 and IBM i Hints and Tips PowerHA and DS8000 Integration PowerHA options for IBM I 55