Experiences with VIOS support for IBM i

Transcription

1 Experiences with VIOS support for IBM i Pete Stephen, Power Systems / AIX Architect Sirius Computer Solutions Pete.Stephen@siriuscom.com

2 Agenda VIO overview Virtualization Trends. PowerVM and how do I use it with IBM i. Supported functions and IBM i versions VIOS Changes with HMC V8.R8.2 Changes Virtualized Network overview (SEA) Virtualized Storage and Fiber overview NPIV Considerations for Configuring VIO for IBM i Dynamic LPAR and RMC connections Setting up the Storage vscsi or/and NPIV LUNs vs. Disk Arms in the IBM i world 60 LUN per adapter limit. New PMR, but we still cover how to work around this. Identifying the Load Source Disk Storage Pools for Disk and DVD Tape Library Attachment Options Monitoring the VIO and the SEA and the storage Using VIO Adviosr to size the VIO (the part command) NMON to monitor and NMON Analyzer to view Using the HMCScanner to document the configuration 2

3 VIO Overview Virtualization Trends CPU / Memory Technology support and accelerate virtualization trends The problem is to minimizing complexity while maximizing utilization through virtualization IBM has been and continues to be a virtualization technology leader IBM i has used virtualization. But now it is taking advantage of Virtual I/O PowerVM is evolving to support these trends on multiple OS platforms. As an AIX and VIO guy, I need to support PowerVM as it evolves 3

4 IBM i and PowerVM IBM i The i stands for Integrated (not virtualized) IBM i has always treated its disk in a unique way. IBM i does benefit from virtualization DPARs LPM. So how does VIO best support IBM i??? 4

5 Feature Support for 8GB FC adapter and NPIV IBM i and PowerVM Supported Versions Version/Release IBM i level 6.1 with machine code Live Partition Mobility IBM i level 7.1 TR4 PTF group SF99707 level 4 PowerVM Enterprise with VIOS Various SAN Storage Systems support Check the IBM i Storage Support Matrix 5

6 IBM i POWER External Storage Support Matrix Summary Definition of IBM i attach methods Direct attach switch or fabric device is not required between the adapter and the storage device Fabric attach switch or fabric device is required between the adapter and the storage device VIOS VSCSI A virtual I/O server (VIOS or IBM i) provides a virtual SCSI adapter and virtual SCSI storage devices to a client operating system (IBM i, AIX, or Linux for VIOS; IBM i, AIX, Linux, or Windows for IBM i) VIOS NPIV N_Port ID Virtualization (NPIV) aka virtual fibre channel A virtual I/O server (VIOS) provides a virtual fibre channel adapter to the client operating system (IBM i, AIX, or Linux) 6

7 VIOS Release Strategy VIOS Release Strategy Changes with In June 2015, VIOS introduces the minipack as a new service stream delivery vehicle as well as a change to the VIOS fix level numbering scheme. The VIOS "fix level" (the 4th number) has changed to a double digit. VIOS is changed to VIOS Please refer to the VIOS Maintenance Strategy here for more details regarding the change to the VIOS release numbering scheme.. VIOS level is NIM Master level must be equal to or higher than Update Release AIX or AIX To take full advantage of all the function available in the VIOS, it may be necessary to be at the latest system firmware level. Upgrade the Firmware before you update the VIOS The latest level of HMC V8R8.2 SP1 (MH01521) will support VIO functionality 7

8 Considerations for Configuring VIO for IBM i Dynamic LPAR operations and RMC connections Shared Ethernet Adapter Configuration Setting up the Storage vscsi or/and NPIV - IASP or not LUNs vs. Disk Arms in the IBM i world The 60 LUN per adapter limit. New PMR, but we still cover how to work around this. Identifying the Load Source Disk Storage Pools for Disk and DVD Tape Library Attachment Options 8

9 IBM i and Dynamic LPAR operations and RMC connections IBM i does not use the rsct demons to enable DLPAR operations. IBM i uses the HMC Service Processor connection to enablre DLPAR. # lssrc -a grep rsct ctrmc rsct active IBM.HostRM rsct_rm active IBM.ServiceRM rsct_rm active IBM.MgmtDomainRM rsct_rm active IBM.DRM rsct_rm active 9

10 VIO Implementation with SEA SEA Configuration Common to AIX LPARs. Unusual and complex for IBM i LPARs Do we need to support multiple VLANs or just one? 10GB adapters or 1 GB? EtherChannel the ports? S824 Server

11 Jumbo Frames has a large impact on network performance I Recommend building out the SEA (physical and logical devices) with Jumbo Frames. Then use mtu_bypass=yes or mtu_bypass=no to enable on a per LPAR basis

12 VIO Implementation with SR-IOV Expected to be popular with IBM I LPARs

13 VIO Virtualized Storage vscsi or NPIV for IBM i 13

14 VIO NPIV Implementation for IBM i Each IBM i LPAR has 4 vfc adapters supporting up to 64 LUNs. (IBM i OS limit per FC) ( Best to stay below 64 ) virtual adapter device Controller Slot number Last 4 digits of WWPN Virtual Adapters fsc0 C GB fsc1 C alp206 Can support up to 128 LUNs fsc6 C SAN s fsc7 C fsc2 C SAN s fsc3 C fsc4 C fsc5 C alp210 Can Support up to 64 LUNs fsc0 C51 0A60 80GB fsc1 C52 0A62 SAN s fsc2 C53 0A64 fsc3 C54 0A68 Each VIO Server is connected to both Fabrics Fabric A -> T1 ports Fabric B -> T2 ports vfcmaps Physical port number Physical adapter device Last 4 digits of WWPN vfchost0 C43 T1 fcs0 99D4 vfchost1 C45 vfchost2 C47 T2 fcs1 99D5 U2C4E.001.DBJF263-P2-C2 vfchost3 C49 VIOS01 T1 fcs2 A1FC vfchost4 C51 vfchost5 C53 T2 fcs3 A1FD U2C4E.001.DBJF263-P2-C5 VIO Servers Physical Dual Port FC Adapters vfchost0 C44 T1 fcs0 A260 vfchost1 C46 vfchost2 C48 T2 fcs1 A261 U2C4E.001.DBJF262-P2-C2 vfchost3 C50 VIOS02 T1 fcs2 A160 vfchost4 C52 vfchost5 C54 T2 fcs3 A161 U2C4E.001.DBJF262-P2-C5 vfcmap vadapter vfchostx fcp fcsx Command to map Virtual to Physical Fiber Channel SWITCH Fabric A SWITCH Fabric B Load Source Disks Data Disks (size as needed) 80GB 80GB 14

15 V7000 LUNs and Disk Arms for ios LUN compared to Disk arm The V7000 LUN connected to IBM i reports in IBM i as a disk unit. IBM i storage management employs the management and performance functions as if the LUN was a disk arm. The number of LUNs drives the requirement for more FC adapters on the IBM i due to the addressing restrictions of IBM i if you are using native attachment. Remember that each path to a LUN will count towards the maximum addressable LUNs on each IBM i IOA.

16 IBM i OS limits the number of Disks per Fiber HBA to 60 Note the Limit of Disks per Adapter on ios!!!. alp206 Can support up to 128 LUNs alp210 Can Support up to 64 LUNs All the Data LUNs should be the same size. If the total storage / size of the LUNs exceeds 60 you MUST map to multiple virtual hosts. Match the Client and Server Slot Numbers fsc0 C vfchost0 C43 T1 fcs0 99D4 80GB fsc1 C vfchost1 C45 fsc6 C vfchost2 C47 T2 fcs1 99D5 U2C4E.001.DBJF263-P2-C2 SAN s fsc7 C vfchost3 C49 VIOS01 T1 fcs2 A1FC fsc2 C vfchost4 C51 T2 fcs3 A1FD U2C4E.001.DBJF263-P2-C5 SAN s fsc3 C vfchost5 C53 fsc4 C fsc5 C VIO Servers Physical Dual Port FC Adapters fsc0 C51 0A60 T1 fcs0 A260 80GB fsc1 C52 0A62 T2 fcs1 A261 U2C4E.001.DBJF262-P2-C2 s fsc2 C53 0A64 vfchost0 vfchost1 vfchost2 C44 C46 C48 VIOS02 fsc3 C54 0A68 vfchost3 C50 T1 fcs2 A160 vfchost4 vfchost5 C52 C54 T2 fcs3 A161 U2C4E.001.DBJF262-P2-C Virtual Host Mapping #1 SWITCH Fabric A SWITCH Fabric B Virtual Host Mapping #2 Load Source Disks Data Disks (size as needed) 80GB 80GB 16

17 Identify which LUN is which disk unit in IBM i to find the Load Source All connection options: Native, VIOS_NPIV, and VIOS Virtual SCSI support Boot from SAN. LoadSource resides on a V7000 LUN which is connected the same way as the other LUNs; there aren't any special requirements for LoadSource connection. In IBM i Dedicated Service Tools (DST) or System Service Tools (SST) look for the Serial number of a disk unit. In the picture Disk units in native or NPIV connection we see Serial numbers Y11C490001DC, Y11C490001DA, etc. The last 6 characters of the Serial number are the last 6 characters of the LUN IDs in V7000. Example: Y11C490001DA. 17

18 Virtual Storage Management of the DVD Drive DVDs are important to IBM i maintenance. If the DVD is not on its own adapter (traditional IBM i configuration) then create a Virtual Storage Pool for the DVD device. 18

19 Virtual Storage Management of the Tape Library One Drive or a Library? BMRS or Native backup NPIV attached or dedicated adapter? 19

20 Cool Tools VIOS Advisor and HMC Scanner Analyze and document your IBM i virtualized environment HMC Scanner Systems/page/HMC Scanner VIOS Advisor (the part command) 20

21 References and Links The VIO cheat sheet IBM PowerVM Virtualization Introduction and Configuration IBM PowerVM Best Practices Virtual I/O Server and Integrated Virtualization Manager commands Get to know the VIOS CLI Virtualization best practices - Wiki HMC Commands Syntax Hints and Tips for implementing Storwize V7000 in an IBM i environment What are the maximum storage devices IBM i LPAR? IBM i Virtualization and Open Storage 21

22 Thank You 22 This document is for IBM and IBM Business Partner use only. It is not intended for client distribution or use with clients