Virtual I/O Server Beyond the Basics

Transcription

1 Virtual I/O Server Beyond the Basics MITEC 2011 W 210 C-4 James Nash Advanced Technical Skills jjnash@us.ibm.com

2 Trademarks The following are trademarks of the International Business Machines Corporation in the United States, other countries, or both. Not all common law marks used by IBM are listed on this page. Failure of a mark to appear does not mean that IBM does not use the mark nor does it mean that the product is not actively marketed or is not significant within its relevant market. Those trademarks followed by are registered trademarks of IBM in the United States; all others are trademarks or common law marks of IBM in the United States. For a complete list of IBM Trademarks, see *, AS/400, e business(logo), DBE, ESCO, eserver, FICON, IBM, IBM (logo), iseries, MVS, OS/390, pseries, RS/6000, S/30, VM/ESA, VSE/ESA, WebSphere, xseries, z/os, zseries, z/vm, System i, System i5, System p, System p5, System x, System z, System z9, BladeCenter The following are trademarks or registered trademarks of other companies. Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Cell Broadband Engine is a trademark of Sony Computer Entertainment, Inc. in the United States, other countries, or both and is used under license therefrom. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. Microsoft, Windows, Windows NT, and the Windows logo are trademarks of Microsoft Corporation in the United States, other countries, or both. Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. ITIL is a registered trademark, and a registered community trademark of the Office of Government Commerce, and is registered in the U.S. Patent and Trademark Office. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency, which is now part of the Office of Government Commerce. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-ibm products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-ibm products. Questions on the capabilities of non-ibm products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. 2

3 3

4 4 Agenda Virtual I/O Server Topics Networking Shared Ethernet Adapters Integrated Virtual Ethernet MAC Addresses Virtual Storage N_Port Id Virtualization Live Partition Mobility Boot from SAN? Infrequently used alternatives Virtual Media Library backupios vs viosbr Dynamic VLAN Quality of Service WWN Management

5 Virtual Networking - Overview Shared Ethernet Adapters Options SEA Failover Network Interface Backup Link Aggregation Integrated Virtual Ethernet Changes Advanced Virtual Ethernet Adapters Dynamic VLAN User-defined MAC Address Quality of Service 5

6 Virtual Networking Shared Ethernet Adapters

7 Virtual Networking Integrated Virtual Ethernet FC 5636, 2 x 1Gb POWER6 Options Up to 16 Logical Ports per Port Group Up to 2 Port Groups per HEA FC 5637, 4 x 1Gb FC 5639, 2 x 10Gb 7

8 IVE Options with POWER7 POWER7 770 (9117-MMB) FC 1803 Integrated, 4-port- 1Gb Virtual Ethernet, I/O ports FC 1804 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Optical ports) FC 1813 Integrated, 4-port (2x1Gb and 2x10Gb SFP+ Copper twinax ports) Each of these cards contains 4 port groups because it combines two P5IOC2 chips 4 port groups allows for up to 64 logical ports per controller (assuming the MCS value for each port group is set to 1) POWER 750 (8233-E8B) FC 5613 Integrated, Dual-port- 10Gb Virtual Ethernet Daughter Card FC port 1Gb Integrated Virtual Ethernet Daughter Card Same rules that apply to POWER6 systems 2 port groups with up to a total of 32 logical ports per controller (also assuming the MCS value is set to 1) IBM

9 Virtual Networking Integrated Virtual Ethernet FC 1803 Integrated, 4-port 1Gb Virtual Ethernet, I/O ports FC 1804 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Optical ports) FC 1813 Integrated, 4-port (2 x 1Gb and 2 x 10Gb SFP+ Copper ports) FC 1824 Integrated, 4-port 1Gb Virtual Ethernet, I/O ports FC 1825 Integrated, 2-port 2 x 10Gb (Fiber) FC 1826 Integrated, 4-port 2 x 10Gb (Copper) FC 1832 Integrated, 4-port - 1Gb Virtual Ethernet, I/O ports FC 1833 Integrated, 2-port 2 x 10Gb (Fiber) FC 1837 Integrated, 4-port 2 x 10Gb (Copper) FC 5613 Integrated, 2-port 10Gb (SR Fiber) FC 5623 Integrated, 2-port 2 x 1Gb FC 1826 Integrated, 4-port 2 x 1Gb 9

10 Virtual Networking Integrated Virtual Ethernet Machine FC FC FC Note U U U U Port Groups Port Groups Port Groups Port Groups 795 N/A 10

11 Virtual Networking Dynamic VLANs 11

12 Other Dynamic Options 12

13 Virtual Networking Specify a MAC Address 13

14 Virtual Networking Specify a MAC Address octet: 1st 2nd 3rd 4th 5th 6th Most Significant A B Least Significant bit 8 bit 7 bit 6 bit 5 bit 4 bit 3 bit 2 bit 1 0: globally unique (OUI enforced) 1: locally administered 14

15 Virtual Networking Specify a MAC Address 15

16 Virtual Networking Quality of Service 16

17 Double Check Yourself You can select one of the following values for the priority level: 0 - best effort; lowest priority 1 - background 2 - spare 3 - excellent effort 4 - controlled load 5 - video (less than 100 ms latency and jitter) 6 - voice (less than 10 ms latency and jitter) 7 - network control; highest priority 17

18 Virtual Storage - Overview The vscsi Conundrum Virtual Storage with Live Partition Mobility Hub-and-spoke N_Port Id Virtualization WWN Management 18

19 Virtual Storage - vscsi VIO Server POWER Hypervisor (PHYP) vscsi0 vscsi1 VIO Server 1 vhost0 vhost0 VIO Server 2 fcs0 fcs1 fcs0 fcs1 SAN Switch #1 SAN Switch #2 SAN Storage 19

20 Where did that disk go? VIO Server Keep a spreadsheet Check all the VIO servers Consider NPIV VIO Server At one point the disks had to be configured with a reserve_policy = no_reserve PR_shared supported at VIO v

21 Consider a Hub and Spoke Design VIO Server VIO Server VIO Server VIO Server VIO Server 21

22 NPIV - Virtual FC Server/ Overview Physical 8Gb NPIV Adapter Virtual FC Server Adapter VIO Server Virtual FC Adapter POWER Hypervisor (PHYP) 22

23 Virtual Storage NPIV Configuration lssyscfg r prof m FieldSystem1 \ F lpar_name,virtual_fc_adapters fs5,"""20/client/1/fs6vio2/20/c ,c /0"", "21/client/2/fs6vio3/21/c ,c /0"" fs6,"""22/client/1/fs6vio2/22/c ,c /0"", ""23/client/2/fs6vio3/23/c ,c /0"" fsios71,none fsios61,none fs6vio3,"21/server/7/fs5/21//0,23/server/6/fs6/23//0 fs6vio2,"20/server/7/fs5/20//0,22/server/6/fs6/22//0" 23

24 Virtual Storage WWN Management # lscfg -vpl fcs0 fcs0 U8203.E4A.06EB1C4-V8-C26-T1 Virtual Fibre Channel Adapter Network Address...C C ROS # Level fcstat and ID... fcs0 Device Specific.(Z0)... FIBRE CHANNEL STATISTICS REPORT: fcs0 Device Specific.(Z1)... Device Specific.(Z2)... Device Device Specific.(Z3)... Type: FC Adapter (adapter/vdevice/ibm,vfc-client) Device Serial Specific.(Z4)... Number: UNKNOWN Device Option Specific.(Z5)... ROM Version: UNKNOWN Device Firmware Specific.(Z6)... Version: UNKNOWN Device World Specific.(Z7)... Wide Node Name: 0xC D Device World Specific.(Z8)...C C Wide Port Name: 0xC D Device Specific.(Z9)... Hardware Location Code...U8203.E4A.06EB1C4-V8-C26-T1 FC-4 TYPES: Supported: 0x PLATFORM SPECIFIC Active: 0x Name: vfc-client Class of Service: 3 Node: vfc-client@ a Port Speed (supported): UNKNOWN Device Type: fcp Port Speed (running): 2 GBIT Physical Location: U8203.E4A.06EB1C4-V8-C26-T1 Port FC ID: 0x6D071D Port Type: Fabric 24

25 Virtual Storage WWN Management 25

26 Activate the Activate and select Boot Mode to be Open Firmware OK prompt

27 ioinfo Menus Enter the command ioinfo at the OK prompt Select option 6 for FCINFO

28 ioinfo Menus Select your vfcs adapter This verifies your WWPN and logs the adapter into the switch

29 Manual Step? 29

30 Anywhere to Anywhere VIO Server VIO Server VIO Server VIO Server 30

31 Virtual Storage NPIV simplify management? VIO Admin I. Fewer Devices on VIO Server II. III. IV. Minimize Risk for disk theft Less setup needed for LPM Easier to replace failed FC adapter V. Could make DR easier VI. Advanced Multi-Path Options SAN Admin I. Many more WWNs to manage II. III. IV. Creating Zoneset more complicated Once configured, fewer changes needed for LPM Nothing needed when FC adapter is replaced Single Admin? 31

32 Live Partition Mobility - Overview Moving from POWER6 to POWER7 Requirements In the Zone Port ID Binding Boot from SAN? Port Security Disaster Recovery 32

33 33

34 Set processor compatibility mode Moving to POWER7 P7 features are not available while running in P6 mode Active Memory Expansion Virtual Ethernet QoS Default sets the current mode to the most fully featured mode supported by the operating 34 environment.

35 Live Partition Mobility - Zoning Physical 8Gb NPIV Adapter Virtual FC Server Adapter VIO Server Virtual FC Adapter POWER Hypervisor (PHYP) 35

36 Live Partition Mobility Boot from SAN? Do you want SDDPCM or PowerPath managing rootvg? What does your storage vendor recommend What are the requirements to update the MP software What are the required steps for partition recovery 36 Can you split MP software by drive? SDD # excludesddcfg l hdisk0 (querysn older versions) HDLM # vi /usr/dynamiclinkmanager/drv/dlmfdrv.unconf PowerPath # pprootdev on

37 Live Partition Mobility Security 37

38 Some advantages of Virtual Optical Media Library With read-only virtual media the same virtual optical device can be presented to multiple client partitions simultaneously You could easily boot from and install partitions remotely without having the need to swap out physical CD/DVDs or setup Network Installation Manager (NIM) server Easier to boot a partition into maintenance mode to repair problems Easier to maintain a complete library of all the software needed for the managed system. Various software packages as well as all the necessary software levels to support each partition partitions could use blank file-backed virtual optical media for backup purposes (read/write devices) These file-backed optical devices could then be backed up from on the VIO server to other types of media (tape, physical CD/DVD, TSM server, etc.)

39 Add Media within IVM

40 Virtual Optical Media on HMC Managed Systems Managing the Virtual Media Repository VIO Command Description $ mkrep Create a Virtual media repository $ lsrep Display information on a Virtual Media Repository Managing Virtual Optical Media $ chrep Change characteristics of a Virtual Media Repository $ rmrep Remove a Virtual Media Repository VIO Description Command $ mkvopt Creates a new virtual optical disk in the Virtual Media Repository $ lsvopt Displays information about file backed virtual optical devices $ chvopt Change the characteristics of a virtual optical media disk within the Virtual Media Repository $ loadopt Load a virtual optical media disk from the Virtual Media

41 Virtual Optical Media Create an ISO file from CDROM $ mkvopt -name dvd.aix_6.1.iso -dev cd0 -ro You choose the name for this file, so make it meaningful Creates an ISO image from the media in /dev/cd0 After the.iso file is in your /var/vio/vmlibrary directory, run: $ mkvdev -fbo -vadapter vhost4 vtopt0 Available Replace vhost4 with your Virtual SCSI server adapter name. This mkvdev command creates your virtual optical target device. $ loadopt -vtd vtopt0 disk

42 New command viosbr (with VIO 2.1.2) $ viosbr Too few parameters. Usage: viosbr -backup -file FileName [-frequency daily weekly monthly [-numfiles filecount]] viosbr -nobackup viosbr -view -file FileName [-type devtype] [-detail] viosbr -view -file FileName -mapping viosbr -view -list [UserDir] viosbr -restore -file FileName [-validate] [-type devtype] [-inter] viosbr -restore -file FileName [-type devtype] [-force] $ viosbr -backup -file nash-backup 42

43 New command - viosbr $ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz Controllers: ============ Name Phys Loc iscsi0 sissas0 U H1395-P1-C1-T1 sissas1 U H1395-P1-C2-T1 sissas2 U78C0.001.DBJ0426-P2-T3 sissas3 U78C0.001.DBJ0426-P2-C9-T1 pager0 U9117.MMB P-V1-C32769-L0-L0 pager1 U9117.MMB P-V1-C32773-L0-L0 vasi0 U9117.MMB P-V1-C

44 New command - viosbr Physical Volumes: ================= Name Phys Loc hdisk20 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0- L hdisk21 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0- L1B hdisk22 U78C0.001.DBJ0426-P2-C9-D1 hdisk23 U78C0.001.DBJ0426-P2-C9-D4 hdisk0 U H1395-P3-D1 hdisk1 U H1395-P3-D2 hdisk2 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L0 hdisk3 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0- L

45 New command - viosbr Ethernet Interfaces: ==================== en0 en1 en2 en3 en4 Shared Ethernet Adapters: ========================= Name Physical Adapter Default Adapter Virtual Adapters ent4 ent0 ent1 ent1 45

46 New command - viosbr Virtual Server Adapters: ======================== SVSA Phys Loc VTD vhost0 U9117.MMB P-V1-C5 rg103_gambs vhost1 U9117.MMB P-V1-C6 rg104_gambs vhost2 U9117.MMB P-V1-C7 rg105_gambs vhost3 U9117.MMB P-V1-C8 rg106_gambs vhost4 U9117.MMB P-V1-C2 mob29_target vhost5 U9117.MMB P-V1-C4 vtscsi1 vtscsi0 46

47 New command - viosbr Virtual Server Adapters: ======================== SVSA Phys Loc VTD vhost0 U9117.MMB P-V1-C5 rg103_gambs vhost1 U9117.MMB P-V1-C6 rg104_gambs vhost2 U9117.MMB P-V1-C7 rg105_gambs vhost3 U9117.MMB P-V1-C8 rg106_gambs vhost4 U9117.MMB P-V1-C2 mob29_target vhost5 U9117.MMB P-V1-C4 vtscsi1 vtscsi0 This is NOT even the detailed view 47

48 New command - viosbr $ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \ -detail... hdisk21 Attribute Name device_mode 10 queue_depth 32 message_no 105 hcheck_interval 60 U78C0.001.DBJ0426-P2-C2-T1-W201800A0B81132D0-L1B Attribute Value hcheck_cmd inquiry unique_id 3E213600A0B D00000F2F94B7E72800F1815 FAStT03IBMfcp scsi_id 0x lun_id 0x1b ww_name 0x201800a0b81132d0 node_name 0x200800a0b81132d0 ses_attach yes pvid 00c23c9f212cf reserve_policy no_reserve 48

49 New command - viosbr $ viosbr -view -file /home/padmin/cfgbackups/nash-backup.tar.gz \ mapping... Name Physloc ClntID ClntName ClntOS vfchost0 U9117.MMB P-V1-C16 29 mob29_lpm AIX ClntOS AIX Status LOGGED_IN FC name fcs0 Ports logged in 3 Flags a VFC client name fcs0 FC loc code U78C0.001.DBJ0426-P2-C2-T1 VFC client DRC U9117.MMA.1023C9F-V29-C3-T1 49

50 viosbr or backupios

51 Questions? James Nash