z/vm Development z/vm Advanced Technical Support December 01,2009 Sue Farrell Angelo Macchiano Bruce McClellan Steve Gracin . 1

Transcription

1 Chapter 1. z/vm Highly Available Network December 01,2009 z/vm Development Sue Farrell Angelo Macchiano Bruce McClellan z/vm Advanced Technical Support Steve Gracin. 1

2 1.1 Highly Available Network Overview A highly available network provides a z/vm guest virtual machine continuous connectivity via a VSwitch irrespective of OSA port availability or OEM switch status. The network being proposed in this paper inherits this attribute based on z/vm Virtual Switch Link Aggregation support (based on IEEE 802.3AD) connected to a Cisco Catalyst 6500 Virtual Switching System 1440 (VSS1440). Even though this testing was performed specifically with a Cisco VSS 1440 system the team believes that similar results could be achieved with vendor switches that support "Virtual Chassis" configurations. This configuration eliminates all single points of failure in the physical network coupled with workload balancing across the active resources within the network. z/vm guest virtual machines connected to this type of VSwitch network configuration enjoy transparent error recovery or OSA port service as demonstrated in this white paper. The Cisco Catalyst 6500 Virtual Switching System 1440 (VSS1440), combined with the z/vm Virtual Switch Link Aggregation Support are the primary components of our Highly Available Network. A virtual to physical network topology deployed with these technologies will maintain a network connection for z/vm guest machines, in all but a catastrophic failure. The failure of a complete Ethenet switch, OSA port, cable, or a combination of equipment failures depending upon configuration will not result in a communication outage Test Configuration The test configuration consisted of a z10 processor with OSA-Express3 Ports. These Ports were 1000BASE-T. However; combinations of copper and fibre QDIO mode OSA-Express3 ports can be combined in the Link Aggregation Group (Link Agg Group), as long as they are the same speed. The four OSA-Express3 ports attached to z/vm6.1, were joined to two Link Agg groups, each group using two of the available ports. The two groups assigned to two type ETHERNET Vswitches with Link Aggregation Control Protocol (LACP). LACP is required for insuring synchronization between the VSWITCH and the CISCO switches. Link Agg - Highly Avilable... 2

3 Two CISCO 65xx switches equipped with G Supervisor Engines were interconnected via a Virtual Switch Link (VSL). This arrangement allows the two 65xx switches to be pooled together to form a single Virtual Switching System All Vswitch and Port Group definitions for testing were placed in the PROFILE EXEC of user AUTOLOG1 for these tests rather than in SYSTEM CONFIG, eliminating the need to IPL in order to pick up changes Link Aggregation (Link Agg) Considerations To join a Link Aggregation Group an OSA-Express3 port can not be in use by another Vswitch or IP stack. Attempting to assign an OSA-Express3 port that is already active with a Vswitch or IP stack; will result in a configuration failure with an accompanying error message. Conversely trying to start a Vswitch or an IP stack using subchannel addresses of a OSA-Express3 port that is already part of a Vswitch Link Aggregation Group will result in a configuration failure with an accompanying error message. This is known as Exclusive Use. Once the port becomes part of a Link Aggregation Group it is marked for exclusive use by the Link Aggregation Group. The port becomes exclusive use when a JOIN to a GROUP is successfully issued. The port will remain in exclusive use until a LEAVE is issued VSS1440 The CISCO VSS1440 is formed by pooling two CISCO Catalyst series 6500 Ethernet Switches into one Virtual Switch, in our case it was named 6509-R12. Chapter 1. z/vm Highly Available Network... 3

4 1.1.5 Test Network The Test Network consisted of Linux for System Z guests running on a z10, being accessed by various x86 clients. The network was all within the IBM internal network in Endicott. z/vm Link Aggregation with Cisco VSS configuration External Network OSA Exp3 1GE-1000BaseT Layer 3 Etherchannel Gi1/1/37 Pchid 1D0/p0 Pchid 1D0/p1 Pchid 1D1/p0 1D00.P00 VSW10 Port group CISCO10 LACP Trunk z/linux SLES10 Curl web clients BMM Cisco 6509 Switch VSS 1/x/x side Active Gi1/1/38 Pchid 1D1/p1 1D03.P01 VSL 10GE x 2 Cisco 6506 Switch VSS 2/x/x side Hot Standby Gi2/1/13 1D80.P00 VSW11 Port group CISCO11 LACP Trunk z/linux SLES10 Apache web servers BM pchid/port chpid 1D0/P1 D0 1D1/P0 D1 1D1/P1 D1 1D0/P0 D0 1F0/P0 F0 1F0/P1 F0 1F1/P0 F1 1F1/P1 F1 Gi2/1/14 OSA Exp3 1GE-1000BaseT Pchid 1F0/p0 Pchid 1F0/p1 Pchid 1F1/p0 Pchid 1F1/p1 1D83.P01 = LACP port group CISCO10 member = LACP port group CISCO11 member To generate network traffic from the external network to the Linux guests, test scripts were executed at hosts on the internal and external network that caused various types of traffic, http, ftp for example. To flow between the hosts and the Linux guests BMM00001 through BMM00004, and BM00001 through BM Link Agg - Highly Avilable... 4

5 1.2 VSS1440 Definitions The two Cisco 6509 switches were defined to act as a single virtual switch, the Port-channels were defined. User Access Verification Password: 6509-R12>enable Password:6509-R12(config)#interface gigabitethernet 1/1/ R12(config-if)#channel-protocol lacp 6509-R12(config-if)#channel-group 10 mode active Creating a port-channel interface Port-channel R12(config-if)#exit 6509-R12(config)#interface gigabitethernet 2/1/ R12(config-if)#channel-protocol lacp 6509-R12(config-if)#channel-group 10 mode active 6509-R12(config-if)#exit 6509-R12(config)#interface port-channel R12(config-if)#switchport trunk encapsulation dot1q 6509-R12(config-if)#switchport mode trunk 6509-R12(config-if)#no shutdown 6509-R12(config-if)# Password:6509-R12(config)#interface gigabitethernet 1/1/ R12(config-if)#channel-protocol lacp 6509-R12(config-if)#channel-group 11 mode active Creating a port-channel interface Port-channel R12(config-if)#exit 6509-R12(config)#interface gigabitethernet 2/1/ R12(config-if)#channel-protocol lacp 6509-R12(config-if)#channel-group 11 mode active 6509-R12(config-if)#exit 6509-R12(config)#interface port-channel R12(config-if)#switchport trunk encapsulation dot1q 6509-R12(config-if)#switchport mode trunk 6509-R12(config-if)#no shutdown 6509-R12(config-if)# Chapter 1. z/vm Highly Available Network... 5

6 1.2.1 Show Etherchannel summary 6509-R12#show etherchannel summary Flags: D - down P - bundled in port-channel I - stand-alone s - suspended H - Hot-standby (LACP only) R - Layer3 S - Layer2 U - in use N - not in use, no aggregation f - failed to allocate aggregator M - not in use, no aggregation due to minimum links not met m - not in use, port not aggregated due to minimum links not met u - unsuitable for bundling d - default port w - waiting to be aggregated Number of channel-groups in use: 5 Number of aggregators: 5 Group Port-channel Protocol Ports Po1(RU) - Te1/5/4(P) Te1/5/5(P) 2 Po2(RU) - Te2/5/4(P) Te2/5/5(P) 3 Po3(SU) LACP Gi1/1/1(P) Gi2/1/1(P) 10 Po10(SD) LACP Gi1/1/37(I) Gi2/1/13(I) 11 Po11(SD) LACP Gi1/1/38(I) Gi2/1/14(I) Link Agg - Highly Avilable... 6

7 1.3 z/vm Definitions The definition of the ETHERNET (Layer2) Vswitch and associated Port Groups was performed by issuing the individual commands at a user with the proper Privclass. This was done for demonstration purposes. In a production environment these commands would be in the PROFILE EXEC of User AUTOLOG1. The Vswitch does not have to be defined before its Port Group, either order is acceptable Define The PORT GROUPs Two Port Groups were defined, CISCO10 and CISCO11. These are arbitrary names that can be any name of up to eight characters. Two OSA ports each have been joined to the groups. The Vswitch groups and the physical switch are defined with LACP ( Link Aggregation Control Protocol ). This protocol provides for the detection and removal of a failed link from the group, it will also detect when the repaired link has been restored to the group, then restart it. Chapter 1. z/vm Highly Available Network... 7

8 1.3.2 Vswitch Definition For testing the Vswitches were defined by issuing two DEFINE VSWITCH commands. What is different for our configuration than a typical Vswitch definition is RDEV NONE, no backup Port is specified. Since the physical switches and Z10 in this highly available configuration can be kilometers away from each other, and in essence back each other up, it would take a catastrophic incident to lose total network connectivity, so a separate backup Port is of no benefit. In a production environment these DEFINE VSWITCH commands would be issued from the PROFILE EXEC of user AUTOLOG1. define vswitch vsw10 rdev none controller * ethernet group cisco10 vlan 300 porttype access define vswitch vsw11 rdev none controller * ethernet group cisco11 vlan 300 porttype access With the Port Groups previously defined, when Vswitch VSW10 and VSW11 are defined a controller will be assigned to the Vswitch and the OSA Ports in the associated Port Groups will be enabled. Link Agg - Highly Avilable... 8

9 Chapter 1. z/vm Highly Available Network... 9

10 1.3.3 Test Case The VSS1440 configuration that combined our two physical switches to form the one Virtual Switch System was established. The Port Groups CISCO10 and CISCO11 and the Vswitches VSW10 and VSW11 were defined. Once the network was shown to be operational and traffic was flowing between the clients in the external network to the Linux Guests, the ACTIVE switch would be powered off. The ACTIVE switch is the 6509 that is currently controlling the VSS1440 operations. The other frame is Hot Standby, to become ACTIVE in the event of a failure. Before powering off the ACTIVE 6509 the current state of the VSS1440 was displayed. show switch virtual/role 6509-R12#show switch virtual Switch mode : Virtual Switch Virtual switch domain number : 100 Local switch number : 1 Local switch operational role: Virtual Switch Active Peer switch number : 2 Peer switch operational role : Virtual Switch Standby 6509-R12#show switch virtual role Switch Switch Status Preempt Priority Role Session ID Number Oper(Conf) Oper(Conf) Local Remote LOCAL 1 UP FALSE(N ) 100(100) ACTIVE 0 0 REMOTE 2 UP FALSE(N ) 100(100) STANDBY In dual-active recovery mode: No Link Agg - Highly Avilable... 10

11 show switch virtual link 6509-R12#show switch virtual link VSL Status : UP VSL Uptime : 18 hours, 0 minutes VSL SCP Ping : Pass VSL ICC Ping : Pass VSL Control Link : Te1/5/ R12#show switch virtual red 6509-R12#show switch virtual redundancy My Switch Id = 1 Peer Switch Id = 2 Last switchover reason = active unit removed Configured Redundancy Mode = sso Operating Redundancy Mode = sso Switch 1 Slot 5 Processor Information : Current Software state = ACTIVE Uptime in current state = 18 hours, 7 minutes Image Version = Cisco IOS Software, s72033_rp Software (s72033_rp-advipservicesk9_wan-m), Version 12.2(33)SXH3, RELEASE SOFTWARE (fc1) Technical Support: Copyright (c) by Cisco Systems, Inc. Compiled Thu 24-Jul-08 19:18 by prod_rel_team BOOT = sup-bootflash:,1; CONFIG_FILE = BOOTLDR = Configuration register = 0x2102 Fabric State = ACTIVE Control Plane State = ACTIVE Switch 2 Slot 5 Processor Information : Current Software state = STANDBY HOT (switchover target) Uptime in current state = 18 hours, 2 minutes Image Version = Cisco IOS Software, s72033_rp Software (s72033_rp-advipservicesk9_wan-m), Version 12.2(33)SXH3, RELEASE SOFTWARE (fc1) Technical Support: Copyright (c) by Cisco Systems, Inc. Compiled Thu 24-Jul-08 19:18 by prod_rel_team BOOT = sup-bootflash:,1; CONFIG_FILE = BOOTLDR = Configuration register = 0x2102 Fabric State = ACTIVE Control Plane State = STANDBY 6509-R12# The commands show that the 6509 considered the LOCAL switch is the ACTIVE switch; and the REMOTE switch is STANDBY. The ACTIVE switch is the frame that will be powered off. Chapter 1. z/vm Highly Available Network... 11

12 Query Vswitch/Port Group details The Vswitches and Port Groups were Queried. Due to the volume of information provided with the DETAILS option specified, the complete command output is not shown in the following displays. q vswitch vswt10 det q vswitch vsw10 details VSWITCH SYSTEM VSW10 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Enabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E State: Ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO10 Active LACP Mode: Active RDEV: 1D00.P00 VDEV: 1D00 Controller: DTCVSW1 VSWITCH Connection: MAC address: E RX Packets: Discarded: Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D00 Unit: 000 Role: DATA vport: 0001 Index: 0001 Unicast IP Addresses: MAC: A9-BF Remote RDEV: 1D80.P00 VDEV: 1D80 Controller: DTCVSW2 VSWITCH Connection: MAC address: E A RX Packets: Discarded: 8 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D80 Unit: 000 Role: DATA vport: 0002 Index: 0002 Adapter Connections: Adapter Owner: BMM00001 NIC: 0600.P00 Name: UNASSIGNED Porttype: Access Link Agg - Highly Avilable... 12

13 q vswitch vswt11 det q vswitch vsw11 det VSWITCH SYSTEM VSW11 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Enabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E B State: Ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO11 Active LACP Mode: Active RDEV: 1D03.P01 VDEV: 1D03 Controller: DTCVSW1 VSWITCH Connection: MAC address: E C RX Packets: Discarded: Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D03 Unit: 000 Role: DATA vport: 0001 Index: 0001 Unicast IP Addresses: MAC: A9-BF Remote RDEV: 1D83.P01 VDEV: 1D83 Controller: DTCVSW2 VSWITCH Connection: MAC address: E D RX Packets: Discarded: 8 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D83 Unit: 000 Role: DATA vport: 0002 Index: 0002 Adapter Connections: Adapter Owner: BM00001 NIC: 0600.P00 Name: UNASSIGNED Porttype: Access Chapter 1. z/vm Highly Available Network... 13

14 query port group det q port group cisco10 det Group: CISCO10 Active LACP Mode: Active VSWITCH SYSTEM VSW10 Interval: 300 ifindex: 64 GROUP Information: PORT Information - Total Frames per Interval: Device Status Previous Current 1D00 Active D80 Active ROUTING Information - Frame Distribution per Interval: MAC Device Previous Current 0 1D D D D D D D D RDEV: 1D00.P00 VDEV: 1D00 Controller: DTCVSW1... q port group cisco11 det Group: CISCO11 Active LACP Mode: Active VSWITCH SYSTEM VSW11 Interval: 300 ifindex: 64 GROUP Information: PORT Information - Total Frames per Interval: Device Status Previous Current 1D03 Active D83 Active ROUTING Information - Frame Distribution per Interval: MAC Device Previous Current 0 1D D D D D D D D RDEV: 1D03.P01 VDEV: 1D03 Controller: DTCVSW1 Link Agg - Highly Avilable... 14

15 The show commands at the Cisco 6509 s and the z/vm Queries show that the network setup is complete and operational, the queries show transmit and receive data counts between the client machines in the external network and the Linux guest machines Power Off the ACTIVE switch, switch 1. At this point the ACTIVE 6509 switch1 was powered off. To an end user at the client machines in the external network, there was no noticeable change to their operations. Network operations continued as usual. Chapter 1. z/vm Highly Available Network... 15

16 1.4 After Power off of switch show switch virtual/link/role The show commands show that the Local switch number is now 2, the 6506 which was previously STANDBY. The VSL Status is DOWN as there is only one 65xx; switch number 2; which is now ACTIVE with no further backup R12#show switch virtual Switch mode : Virtual Switch Virtual switch domain number : 100 Local switch number : 2 Local switch operational role: Virtual Switch Active 6509-R12# 6509-R12#show switch virtual link VSL Status : DOWN VSL Uptime : - VSL SCP Ping : - VSL ICC Ping : - VSL Control Link : R12# 6509-R12#show switch virtual role Switch Switch Status Preempt Priority Role Session ID Number Oper(Conf) Oper(Conf) Local Remote LOCAL 2 UP FALSE(N ) 100(100) ACTIVE 0 0 In dual-active recovery mode: No Link Agg - Highly Avilable... 16

17 1.4.2 show switch virtual redundancy This show command shows that the current switch; My Switch Id is currently 2. which previously was the STANDBY switch. The Last switchover reason was that the active unit removed, this was the result of the power off. Now switch Id 2 has the Current Software state of ACTIVE and has been the ACTIVE switch for 4 minutes when this command was issued R12#show switch virtual redundancy My Switch Id = 2 Peer Switch Id = 1 Last switchover reason = active unit removed Configured Redundancy Mode = sso Operating Redundancy Mode = sso Switch 2 Slot 5 Processor Information : Current Software state = ACTIVE Uptime in current state = 4 minutes Image Version = Cisco IOS Software, s72033_rp Software (s72033_rp-advipservicesk9_wan-m), Version 12.2(33)SXH3, RELEASE SOFTWARE (fc1) Technical Support: Copyright (c) by Cisco Systems, Inc. Compiled Thu 24-Jul-08 19:18 by prod_rel_team BOOT = sup-bootflash:,1; CONFIG_FILE = BOOTLDR = Configuration register = 0x2102 Fabric State = ACTIVE Control Plane State = ACTIVE Peer information is not available because it is in 'DISABLED' state 6509-R12# Chapter 1. z/vm Highly Available Network... 17

18 1.4.3 query vswitch vsw10 det The link to the 6509 switch number 1, the powered off switch, shows that data transfer is suspended due to Port Inoperable. The second link 1D80.P00 continues without errors, and all of the guest machines continue to operate uninterrupted. q vswitch vsw10 det VSWITCH SYSTEM VSW10 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Disabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E State: Device not ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO10 Active LACP Mode: Active RDEV: 1D00.P00 VDEV: 1D00 Controller: DTCVSW1 Status: Suspended Reason: Port inoperable RDEV: 1D80.P00 VDEV: 1D80 Controller: DTCVSW2 VSWITCH Connection: MAC address: E A RX Packets: Discarded: 9 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D80 Unit: 000 Role: DATA vport: 0002 Index: 0002 Unicast IP Addresses: MAC: A9-BF Remote MAC: A9-BF Remote Adapter Connections: Adapter Owner: BMM00001 NIC: 0600.P00 Name: UNASSIGNED Porttype: Access RX Packets: Discarded: 0 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 0602 Unit: 002 Role: DATA vport: 0077 Index: 0077 Link Agg - Highly Avilable... 18

19 1.4.4 query vswitch vsw11 det VSW11 also shows a port Inoperable for the link that connects to the powered off switch 1. Its second link 1D83.P01 and the adapter owner BM00001 continue without error. q vswitch vsw11 det VSWITCH SYSTEM VSW11 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Disabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E B State: Device not ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO11 Active LACP Mode: Active RDEV: 1D03.P01 VDEV: 1D03 Controller: DTCVSW1 Status: Suspended Reason: Port inoperable RDEV: 1D83.P01 VDEV: 1D83 Controller: DTCVSW2 VSWITCH Connection: MAC address: E D RX Packets: Discarded: 9 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D83 Unit: 000 Role: DATA vport: 0002 Index: 0002 Unicast IP Addresses: MAC: A9-BF Remote MAC: A9-BF Remote Adapter Connections: Adapter Owner: BM00001 NIC: 0600.P00 Name: UNASSIGNED Porttype: Access RX Packets: Discarded: 0 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 0602 Unit: 002 Role: DATA vport: 0078 Index: 0078 Chapter 1. z/vm Highly Available Network... 19

20 1.4.5 query port group det q port group cisco10 det Group: CISCO10 Active LACP Mode: Active VSWITCH SYSTEM VSW10 Interval: 300 ifindex: 64 GROUP Information: PORT Information - Total Frames per Interval: Device Status Previous Current 1D00 Suspended D80 Active ROUTING Information - Frame Distribution per Interval: MAC Device Previous Current 0 1D D D D D D D D RDEV: 1D00.P00 VDEV: 1D00 Controller: DTCVSW1 Status: Suspended Reason: Port inoperable RDEV: 1D80.P00 VDEV: 1D80 Controller: DTCVSW2 q port group cisco11 det Group: CISCO11 Active LACP Mode: Active VSWITCH SYSTEM VSW11 Interval: 300 ifindex: 64 GROUP Information: PORT Information - Total Frames per Interval: Device Status Previous Current 1D03 Suspended 0 0 1D83 Active ROUTING Information - Frame Distribution per Interval: MAC Device Previous Current 0 1D D D D D D D D RDEV: 1D03.P01 VDEV: 1D03 Controller: DTCVSW1 Status: Suspended Reason: Port inoperable RDEV: 1D83.P01 VDEV: 1D83 Controller: DTCVSW2 Link Agg - Highly Avilable... 20

21 1.5 Power switch 1 back on At this point our network is operational entirely through 6509 switch 2 which started as the STANDBY switch in the VSS1440 configuration. The original ACTIVE switch switch 1 is powered back on. Switch 1 to come back into the Virtual Switching System configuration, in our case typically took about four minutes R12#show switch virtual role Switch Switch Status Preempt Priority Role Session ID Number Oper(Conf) Oper(Conf) Local Remote LOCAL 2 UP FALSE(N ) 100(100) ACTIVE 0 0 REMOTE 1 UP FALSE(N ) 100(100) STANDBY In dual-active recovery mode: No 6509-R12#show switch virtual link VSL Status : UP VSL Uptime : 9 minutes VSL SCP Ping : Pass VSL ICC Ping : Pass VSL Control Link : Te2/5/ R12#show switch virtual Switch mode : Virtual Switch Virtual switch domain number : 100 Local switch number : 2 Local switch operational role: Virtual Switch Active Peer switch number : 1 Peer switch operational role : Virtual Switch Standby 6509-R12# Switch 1 is back as Peer or BACKUP switch. Chapter 1. z/vm Highly Available Network... 21

22 1.5.1 query vswitch details q vswitch vsw10 det VSWITCH SYSTEM VSW10 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Enabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E State: Ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO10 Active LACP Mode: Active RDEV: 1D00.P00 VDEV: 1D00 Controller: DTCVSW1 VSWITCH Connection: MAC address: E RX Packets: Discarded: Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D00 Unit: 000 Role: DATA vport: 0001 Index: 0001 RDEV: 1D80.P00 VDEV: 1D80 Controller: DTCVSW2 VSWITCH Connection: MAC address: E A RX Packets: Discarded: 16 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D80 Unit: 000 Role: DATA vport: 0002 Index: q vswitch vsw11 det VSWITCH SYSTEM VSW11 Type: VSWITCH Connected: 4 Maxconn: INFINITE PERSISTENT RESTRICTED ETHERNET Accounting: ON VLAN Aware Default VLAN: 0300 Default Porttype: Access GVRP: Enabled Native VLAN: 0001 VLAN Counters: OFF MAC address: E B State: Ready IPTimeout: 5 QueueStorage: 8 Isolation Status: OFF Group: CISCO11 Active LACP Mode: Active RDEV: 1D03.P01 VDEV: 1D03 Controller: DTCVSW1 VSWITCH Connection: MAC address: E C RX Packets: Discarded: Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D03 Unit: 000 Role: DATA vport: 0001 Index: 0001 RDEV: 1D83.P01 VDEV: 1D83 Controller: DTCVSW2 VSWITCH Connection: MAC address: E D RX Packets: Discarded: 21 Errors: 0 TX Packets: Discarded: 0 Errors: 0 RX Bytes: TX Bytes: Device: 1D83 Unit: 000 Role: DATA vport: 0002 Index: 0002 The query of the vswitches shows that both links are active with assigned controllers. The came active when the Cisco 6509, switch 1 became part of the Virtual Switching System again. Link Agg - Highly Avilable... 22

23 1.5.2 Summary As demonstrated the CISCO VSS1440 technology combined with z/vm Vswitch Link Aggregation support can provide an extremely robust virtual/physical network. Up to eight OSA-Express3 ports can be combined into a Link Agg Group spread across multiple physical switches that can be geographically dispersed. This makes for outstanding network reliability, availability, and seviceability as individual ports can be removed from the Link Agg Group for maintenance, then returned. It could be possible to replace entire OSA-Express3 cards without a network outage. End Of Document Chapter 1. z/vm Highly Available Network... 23

24 Link Agg - Highly Avilable... 24