HPE Synergy 40Gb F8 Switch Module

Transcription

1 HPE Synergy 40Gb F8 Switch Module LA Configuration Abstract This document is intended for the person who configures HPE Synergy 40Gb F8 Switch Modules a March 2017 Edition: 1

2 Copyright 2016, 2017 Hewlett Packard Enterprise Development LP The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein. Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard Enterprise has no control over and is not responsible for information outside the Hewlett Packard Enterprise website. Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use or copying. Consistent with FAR and , Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor s standard commercial license.

3 Contents CHAPTER 1: LA CONFIGURATION 1 Abstract CHAPTER 2: INTRODUCTION 7 PURPOSE AND SCOPE... 7 ACRONYMS... 7 REFERENCES... 7 DOCUMENT CONVENTIONS... 7 GENERAL CONFIGURATIONS... 8 CHAPTER 3: PROTOCOL DESCRIPTION 9 CHAPTER 4: CONFIGURING LINK AGGREGATION 10 CONFIGURATION GUIDELINES DEFAULT CONFIGURATIONS ENABLING LINK AGGREGATION ENABLING INDEPENDENT MODE CONFIGURING PORT-CHANNEL INTERFACES CONFIGURING LACP PORT-PRIORITY CONFIGURING LACP SYSTEM PRIORITY CONFIGURING PORT-CHANNEL LOAD BALANCE CONFIGURING LACP SYSTEM IDENTIFIER CONFIGURING LACP PORT IDENTIFIER MTU CONFIGURATIONS CONFIGURING LACP WAIT TIME CONFIGURING LACP TIME-OUT DISPLAYING LACP STATUS Interaction between LA and VLAN Configuration of ICM with Multiple Instance DYNAMIC AGGREGATOR CONFIGURATION Configurations D-LAG CONFIGURATIONS Configuring Active-Active D-LAG parameters Configuring Active-Active D-LAG Status Active-Active D-LAG Configuration Example Configuring D-LAG parameters Configuring D-LAG Status Configuring D-LAG redundancy Displaying D-LAG parameters D-LAG Configuration Example MC-LAG CONFIGURATIONS ICCL startup file Configuring ICCL parameters Configuring MC-LAG parameters Configuring MC-LAG Status MC-LAG Configuration Example Displaying MC-LAG parameters Configuring Heartbeat parameters FDB sync-up ACCESSING HEWLETT PACKARD ENTERPRISE SUPPORT Information to collect ACCESSING UPDATES WEBSITES REMOTE SUPPORT

4

5 Figures Figure 1: Link Aggregation - Example Figure 2: Link Aggregation - Topology Figure 3: Setup for configuring ICM with MI Figure 4: Initial Scenario Figure 5: Port Reallocation across Aggregator at end of Selection Logic Figure 6: Primary Port is down Figure 7: DLAG Node Topology Figure 8: DLAG Node Topology Figure 9: MC-LAG with two nodes Figure 10: MC-LAG Node Topology Figure 11: FDB Sync up

6 Tables Table 1: Acronyms used in this document... 7 Table 2: Document Conventions... 7 Table 3: General Configurations... 8 Table 4: Default Configurations... 11

7 Introduction Purpose and Scope Acronyms The HPE LA product allows one or more links to be aggregated together to form a Link Aggregation Group as if it were a single link, that is, it supports the establishment of logical links which consist of n number of parallel, fullduplex, point-to-point links operating at the same data rate. This document explains the configurations for HPE LA running as a part of HPE ICM. The reader is expected to have a basic knowledge of the protocol as a prerequisite. Table 1: Acronyms used in this document Acronym CLI ICM LA LACP MAC MI PDU SNMP MTU ICCL HB MC MC-LAG Expansion Command Line Interface Interconnect Module Link Aggregation Link Aggregation Control Protocol Media Access Control Multiple Instance Protocol Data Unit Simple Network Management Protocol Maximum Transmission Unit Inter Chassis Communication Link Heart Beat Multi chassis Distributed Link aggregation Group. References HPE Synergy 40Gb F8 Switch Module Command Line Interface (CLI) Guide Document Conventions Table 2: Document Conventions Convention Usage

8 Bold Italics Courier New 10 Regular, blue color CLI commands User inputs for CLI commands CLI command outputs Notes / Guidelines / Pre-requisites Output areas specific to the configuration General Configurations The following table provides the access and exit methods to various general configuration modes. Table 3: General Configurations Command Mode Access Method Prompt Exit method User EXEC This is the initial mode to start a session. switch> The logout method is used. Privileged EXEC The User EXEC mode command enable, is used to enter the Privileged EXEC mode. switch# To return from the Privileged EXEC mode to User EXEC mode the disable command is used. Global Configuration The Privileged EXEC mode command configure terminal, is used to enter the Global Configuration mode switch(config )# To exit to the Global Configuration mode the exit command is used and to exit to the Privileged EXEC mode the end command is used. Interface Configuration The Global Configuration mode command interface <interfacetype><interface-id> is used to enter the Interface Configuration mode. switch(config -if)# To exit to the Global Configuration mode the exit command is used and to exit to the Privileged EXEC mode the end command is used.

9 Protocol Description Link Aggregation allows aggregation of point-to-point links operating at the same data rate. Link Aggregation is supported only on point-to-point links with MAC clients operating in full duplex mode. A MAC client communicates with a set of ports through an Aggregator, which presents a standard IEEE service interface to the MAC client. The Aggregator binds to one or more ports within a system. LACP (Link Aggregation Control Protocol) is used for automatic communication of aggregation capabilities and automatic configuration of Link Aggregation between systems. The list of ports that are aggregated to a particular aggregator is transparent to the higher modules (such as Spanning Tree). Few of the salient features of Link Aggregation are as follows: Load sharing Increased availability Increased bandwidth Linear incremental bandwidth Low risk of duplication or mis-ordering Upon Link Aggregation, individual point-to-point ports/interfaces are aggregated into a group that is regarded as a single port/interface by the higher layers such as Spanning-tree. The total capacity of such an aggregated group is the sum of the capacities of the individual links composing the aggregate, thus providing higher bandwidth to the MAC client (such as Spanning Tree). As shown in Figure 1 multiple links on the server side of the switch are aggregated together to form a single link. HPE LA is responsible for taking frames from the aggregator and submitting them for transmission on the appropriate port. The physical port for transmission is chosen based on the selection policy in the chipset. Similarly, HPE LA is responsible for collecting the frames received on various ports of the aggregator. The user can configure a specific distribution policy for the traffic flow based on the deployment scenario. This allows the switches to get the advantage of increased bandwidth for the traffic between the hosts and the server. Also, if one of the links in the aggregation group is made down, say, for maintenance purpose, and then it will not affect the traffic between the hosts and the server.

10 Host B Host C SWITCH A SWITCH B Host D 1 Gbps Host A 400 Mbps 32 Mbps SERVER SERVER 128 Mbps 200 Mbps SERVER SERVER - Aggregated Links: Switch - to - Server Link Aggregation Figure 1: Link Aggregation - Example Configuring Link Aggregation The following sections describe the configuration of HPE LA running as a part of HPE ICM. Port 1 Port 1 Port 2 Port 2 Switch A Port 3 Port 3 Switch B Configuration Guidelines Figure 2: Link Aggregation - Topology 1 1 The guidelines for the configuration of LA are as follows: Port-channel must be enabled in the system for Link aggregation configuration to take effect. If 802.1x is enabled on a port, then Link Aggregation can be enabled on that port only when the port is in the authorized state. Link Aggregation cannot be enabled on unauthorized ports. 1 By default HPE ICM supports a maximum of 8 ports per aggregation. Assume maximum number of ports per aggregation is 2.

11 Default Configurations Table 4: Default Configurations Feature Port-channel Channel-groups Default Setting Disabled None LACP System Priority 0x8000 or Load balancing LACP Port Priority Source and Destination MAC address based 128 on all interfaces LACP Wait time 2 LACP timeout long: The long timeout value means that LACP PDU is expected every 30 seconds (LACP packets to be received every 30 seconds) and LACP timeout value (no packet is received from peer) is 90 seconds MAC-selection dynamic: Port-channel MAC address is address of an active port Enabling Link Aggregation Refer to Figure 2 for setup. Link Aggregation is disabled by default. 1. Execute the following commands in both the switches to enable Link Aggregation. Enter the Global Configuration mode. switch# configure terminal Enable port channel. switch(config)# set port-channel enable Exit from the Global configuration mode. switch(config)# end 2. View the etherchannel information using the following command. switch# show etherchannel summary The output in Switch A and Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Flags: D - down P - in port-channel I - stand-alone H - Hot-standby (LACP only) U - in-use d - default port

12 R - Layer3 AD - Admin Down AU - Admin Up OD - Operative Down OU - Operative Up Number of channel-groups in use: 1 Number of aggregators: 1 Group Port-channel Protocol Ports Po1(D)[AU,OD] LACP TwentyGigE0/1/1(D) The following command is used to shutdown the entire LA module switch(config)# shutdown port-channel This will shutdown LA module. Do you want to continue (y/n)?: Enabling Independent Mode Refer to Figure 2 for setup. Independent mode is disabled by default. 1. Execute the following commands in both the switches to enable Independent mode. Enter the Global Configuration mode. switch# configure terminal Enable port channel. switch(config)# set port-channel independent enable Exit from the Global configuration mode. switch(config)# end 2. View the etherchannel information using the following command. switch# show etherchannel summary The output in Switch A and Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is enabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is enabled

13 Port-channel System Identifier is 00:01:02:03:04:05 LACP System Priority: switch# show etherchannel detail The output in Switch A and Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is enabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: The command used to disable independent feature in the switch, switch(config)# set port-channel independentmode disable Independent mode feature can be verified by enabling this feature on both Actor and Partner sides. If it is enabled on either of the sides, this will end up in inconsistent behavior. This mis-configuration should be avoided. Configuring Port-channel Interfaces Refer to Figure 2 for setup. Port 3 of both the switches are configured to be a part of the link aggregation. 1. Execute the following commands in both the switches. Enter the Global configuration mode. switch# configure terminal Enable port channel. switch(config)# set port-channel enable Create port channel. switch(config)# interface port-channel 1 switch(config-if)# no shutdown switch(config-if)# exit Enter the Interface configuration mode. Up to eight interfaces of the same type and speed can be configured for the same group. switch(config)# interface TwentyGigE 0/1/3 switch(config-if)# no shutdown Configure the physical port in a port channel and specify the mode by which the port becomes part of the port-channel. The channelgroup-number ranges from 1 to 64. Each port-channel can have up to eight compatibly configured Ethernet interfaces. switch(config-if)# channel-group 1 mode active Mode can be active: LACP negotiation is started un-conditionally.

14 passive: LACP negotiation is started only when an LACP packet is received from the peer. on: Force the interface to be a part of the port channel without communicating through the LACP protocol. This is equivalent to manual aggregation. Exit from the Interface configuration mode. switch(config-if)# end 2. View the etherchannel information using the following command. switch# show etherchannel 1 detail The output in Switch A is Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active

15 LACP Timeout : Long Aggregation State : Aggregation, Defaulted LACP Port Admin Oper Port Port Port State Priority Key Key Number State TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 1 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps If the port-channel interface is not present, then it must be created using the following commands: switch# configure terminal switch(config)# interface port-channel 1 switch(config-if)# no shut switch(config-if)# end LACP feature can be verified by enabling LACP (can be either Active/Passive) on both Actor and Partner sides. If LACP is enabled on Actor side and manual on partner side or vice versa, it will end up in inconsistent behavior, hence this mis-configuration should be avoided.

16 Configuring LACP Port-Priority Refer to Figure 2 for setup. Ports 1, 2 and 3 are part of link aggregation. All ports in both the switches are configured to belong to port-channel Execute the following commands in both the switches. switch# configure terminal switch(config) # set port-channel enable switch(config)# interface port-channel 1 switch(config-if)# no shutdown switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/1 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/2 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/3 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# exit switch(config-if)# end 2. View the etherchannel information using the following command. switch# show etherchannel 1 detail The output in Switch A is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Group: Protocol :LACP Channel Group Listing

17 Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/3

18 Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted LACP Port Admin Oper Port Port Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8

19 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:01:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: Group: Protocol :LACP Channel Group Listing Ports in the Group Port: Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Up in Bundle

20 Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Bundle x2 0xbc Gi0/3 Standby x3 0xa0 Port-channel : Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic

21 Maximum number of Ports = 2 The output in Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:02:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: Channel Group Listing Group: Protocol :LACP Ports in the Group Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active

22 LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Bundle x2 0xbc Gi0/3 Standby x3 0xa0 Port-channel: Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic Maximum number of Ports = 2 Observation before configuring the LACP port priority: Port TwentyGigE 0/1/3 is the Standby port in Switches A and B. (as max ports in the port channel is 2 ports) 3. Execute the following commands in Switch A. Enter the Global configuration mode. switch# configure terminal Enter the Interface Configuration mode. switch(config)# interface TwentyGigE 0/1/3

23 Execute the following command to configure the LACP Port Priority. The range of values is from The lower the value, the more likely that the interface will be used for LACP transmission. switch(config-if)# lacp port-priority 20 To return to the default port-priority configuration for the interface use the command switch(config-if)# no lacp port-priority. Exit from the Interface Configuration mode. switch(config-if)# end 4. View the Etherchannel information using the following command. switch# show etherchannel 1 detail The output in Switch A is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Channel Group Listing Group: Protocol :LACP Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs

24 LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long

25 Aggregation State : Aggregation, Defaulted LACP Port Admin Oper Port Port Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:01:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: Channel Group Listing

26 Group: Protocol :LACP Ports in the Group Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active

27 Pseudo port-channel = Po1 LACP port-priority = 20 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Standby x2 0xbc Gi0/3 Bundle x3 0xa0 Port-channel : Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic Maximum number of Ports = 2 The output in Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:02:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: Channel Group Listing Group: Protocol :LACP Ports in the Group Port : Gi0/1

28 Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State: Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long

29 Aggregation State : Aggregation, Sync, Collecting, Distributing, LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Standby x2 0xbc Gi0/3 Bundle x3 0xa0 Port-channel : Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic Maximum number of Ports = 2 Observation after configuring the LACP port priority: Port 2 is the Standby port in Switches A and B. Configuring LACP System Priority Refer to Figure 2 for setup. Ports 1, 2 and 3 are part of link aggregation. All ports in both the switches are configured to belong to port-channel Execute the following commands in both the switches. switch# configure terminal switch(config) # set port-channel enable switch(config)# interface port-channel 1 switch(config-if)# no shutdown switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/1 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/2 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# exit switch(config)# interface TwentyGigE 0/1/3

30 switch(config-if)# no shutdown switch(config-if)# channel-group 1 mode active switch(config-if)# end 2. View the etherchannel information using the following command. switch# show etherchannel 1 detail The output in Switch A is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted

31 Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Admin Oper Port Port LACP Port

32 Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps The output in Switch B is, switch# show etherchannel 1 detail Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:02:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: Group: Protocol :LACP Channel Group Listing

33 Ports in the Group Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs

34 LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Bundle x2 0xbc Gi0/3 Standby x3 0xa0 Port-channel : Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic Maximum number of Ports = 2 Observation before configuring the LACP system priority: Port TwentyGigE 0/1/3 in switch A and B are standby ports. 3. Execute the following commands in Switch B. Enter the Global configuration mode. switch# configure terminal Set the LACP System priority. The priority value ranges from 0 to The lower the value, the higher the system priority. The switch with the lower system priority value determines the links between the LACP partner switches that are in active and standby states for each LACP port-channel. switch(config)# lacp system-priority 20 Execute the following command to configure the LACP Port Priority, for Port 3 in Switch A. switch(config)# interface TwentyGigE 0/1/3 switch(config-if)# lacp port-priority 20 Exit from the configuration mode. switch(config-if)# end 4. View the etherchannel information using the following command. switch# show etherchannel 1 detail The output in Switch A is,

35 Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 5c:b9:01:47:bc:9e LACP System Priority: 20 Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1

36 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 20 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted LACP Port Admin Oper Port Port Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2

37 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps The output in Switch B is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel System Identifier is 00:02:02:03:04:01 Port-channel Independent mode is disabled LACP System Priority: 20 Channel Group Listing Group: Protocol :LACP Ports in the Group Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128

38 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Up in Bundle Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 2 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Sync, Collecting, Distributing, Port : Gi0/ Port State = Hot standby Channel Group : 1 Mode : Active Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, LACP Port Admin Oper Port Port Port State Priority Key Key Number State Gi0/1 Bundle x1 0xbc Gi0/2 Bundle x2 0xbc Gi0/3 Standby x3 0xa0

39 Port-channel : Po Number of Ports = 3 HotStandBy port = 1 Port state = Port-channel Ag-Inuse Protocol = LACP MAC selection = Dynamic Maximum number of Ports = 2 Observation after configuring the LACP system priority: Port TwentyGigE 0/1/3 in Switch A and B will continue to be standby ports. The port priority configured for the Port 3 in Switch A is not effective, as the System priority of Switch A is less when compared to B. Configuring Port-channel Load Balance Traffic in a port-channel is distributed across the individual bundled links in a deterministic fashion. However, the load is not necessarily balanced equally across all the links. Instead, frames are forwarded on a specific link using any of the following criteria - source IP address, destination IP address, or a combination of source and destination IP addresses, source and destination MAC addresses. 1. Execute the following commands in the Switch A. Enter the Global Configuration mode. switch# configure terminal Configure the load-balance policy. switch(config)# port-channel load-balance dest-mac 1 The load-balance policy can be configured as: src-mac: Load distribution is based on the source MAC address in the frame. Packets from different hosts use different ports in the channel, but packets from the same host use the same port. dest-mac: Load distribution is based on the destination MAC address in the frame. Packets to the same destination are sent on the same port, but packets to different destinations are sent on different ports in the channel. src-dest-mac: Load distribution is based on the source and destination MAC addresses. src-ip: Load distribution is based on the source IP address. dest-ip: Load distribution is based on the destination IP address. src-dest-ip: Load distribution is based on the source and destination IP addresses. vlan-id: Load distribution is based on VLAN Identifier. Exit from the Global configuration mode. switch(config)# end

40 2. View the Etherchannel load-balance information using the following command. switch# show etherchannel load-balance The output in the Switch is, Channel Group Listing Group : Destination MAC Address Group : Source and Destination MAC Address If the port-channel index is not included in this command, then the load-balancing applies for all port-channels configured in the system Configuring LACP System Identifier Refer to Figure 2 for setup. Ports 1, 2 and 3 are part of Link Aggregation. 1. Execute the following commands in both the switches to configure the global LACP System ID. Enter the Global configuration mode. switch# configure terminal Enable port channel. switch(config)# set port-channel enable Create port channel. switch(config)# interface port-channel 1 switch(config-if)# no shutdown Configure the LACP System Identifier. switch(config)# lacp system-identifier 00:55:44:33:22:11 Exit from the Global configuration mode. switch(config)# end 2. View the Etherchannel information using the following command. switch# show etherchannel detail CONFIGURE commands : port-channel load-balance { src-mac dest-mac src-dest-mac src-ip dest-ip src-dest-ip } [ <port-c hannel-index( )>]

41 Switch(config)# port-channel load- CONFIGURE commands : port-channel load-balance { src-mac dest-mac src-dest-mac src-ip dest-ip src-dest-ip } [ <port-c hannel-index( )>] Switch(config)# port-channel load-balance dest- CONFIGURE commands : port-channel load-balance { src-mac dest-mac src-dest-mac src-ip dest-ip src-dest-ip } [ <port-c hannel-index( )>] Switch(config)# port-channel load-balance dest-mac 1 Switch(config)# end Switch# show ether EXEC commands : show etherchannel show etherchannel <channel-group-number( )> { detail load-balance port port-channel summary protocol redundancy} show etherchannel { detail load-balance port port-channel summary protocol redundancy} Switch# show etherchannel loa EXEC commands : show etherchannel { detail load-balance port port-channel summary protocol redundancy} Switch# show etherchannel load-balance Channel Group Listing

42 Group : Destination MAC Address Group : Source and Destination MAC Address Switch# con t Switch(config)# set port CONFIGURE commands : } set port-channel independentmode { enable disable set port-channel { enable disable } Switch(config)# set port-channel en CONFIGURE commands : set port-channel { enable disable } Switch(config)# set port-channel enable Switch(config)# interface por CONFIGURE commands : interface {cpu0 vlan <vlan-id/vfi-id> [switch <switch-name>] port-channel <port-channel-id ( )> t unnel <tunnel-id (0-128)> <interface-type> <interface-id> loopback <interface-id (0-100)> sisp <interfaceid ( )> s-channel <ifnum>} Switch(config)# interface port-channel 1 Switch(config-if)# no shut PO commands : no shutdown Switch(config-if)# no shutdown Switch(config-if)# end

43 Switch# lacp system-identifier 00:55:44:33:22:11 % Invalid Command Switch# con t Switch(config)# end Switch# con t Switch(config)# lacp system-identifier 00:55:44:33:22:11 Switch(config)# end Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# show ether EXEC commands : show etherchannel show etherchannel <channel-group-number( )> { detail load-balance port port-channel summary protocol redundancy} show etherchannel { detail load-balance port port-channel summary protocol redundancy} Switch# show etherchannel det EXEC commands : show etherchannel { detail load-balance port port-channel summary protocol redundancy}

44 Switch# show etherchannel detail Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 00:55:44:33:22:11 LACP System Priority: 20 Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Switch# q % Invalid Command Switch# end Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch# Switch#

45 Switch# Switch# Switch# Switch# Switch# Switch# show etherchannel detail Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 00:55:44:33:22:11 LACP System Priority: 20 Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted

46 Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 20 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Admin Oper Port Port LACP Port

47 Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Group: Protocol :Disabled Port-channels in the group: Port-channel : Po Number of Ports = 0

48 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Down Protocol = - Aggregator-MAC 00:01:02:03:05:1a Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Configuring LACP Port Identifier Refer to Figure 2 for setup. Ports 1, 2 and 3 are part of Link Aggregation. 1. Observe the Port State behavior with default port identifier. switch# show etherchannel 1 detail The output in Switch A is, Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 00:55:44:33:22:11 LACP System Priority: 20 Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle

49 Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null

50 Pseudo port-channel = Po1 LACP port-priority = 20 LACP Wait-time = 2 secs LACP Port Identifier = 5 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted LACP Port Admin Oper Port Port Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Observation before configuring the LACP port identifier: Port TwentyGigE 0/1/3 in switch A and B are Standby ports.

51 2. Now, configure the port identifier of Port 3 in Switch A as 1. switch(config)# interface TwentyGigE 0/1/3 switch(config-if)# lacp port-identifier 1 The range for configuring the LACP port identifier varies from 1 to MAX_PORTS in the system. If a value higher than the max ports is configured, an error value is returned. 3. View the configuration use the following command. switch# show etherchannel detail Port-channel Module Admin Status is enabled Port-channel Module Oper Status is enabled Port-channel Independent mode is disabled Port-channel System Identifier is 00:55:44:33:22:11 LACP System Priority: 20 Group: Protocol :LACP Channel Group Listing Ports in the Group Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long

52 Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 128 LACP Wait-time = 2 secs LACP Port Identifier = 3 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Port : TwentyGigE0/1/ Port State = Down, Not in Bundle Reason for port-down : Oper status of the port is down Channel Group : 1 Mode : Active Port-channel = Null Pseudo port-channel = Po1 LACP port-priority = 20 LACP Wait-time = 2 secs LACP Port Identifier = 1 LACP Activity : Active LACP Timeout : Long Aggregation State : Aggregation, Defaulted Admin Oper Port Port LACP Port

53 Port State Priority Key Key Number State TwentyGigE0/1/1 Down x1 0xa2 TwentyGigE0/1/2 Down x3 0xa2 TwentyGigE0/1/3 Down x5 0xa2 Port-channel : Po Number of Ports = 3 HotStandBy port = null Port state = Port-channel Ag-Not-Inuse Protocol = LACP Aggregator-MAC 00:01:02:03:05:19 Maximum number of Ports = 8 Port-Channel Mtu = 9394 Port-Channel Speed = 0 Mbps Port-Channel High Speed = 0 Mbps Port-Channel Member Ports Speed = 0 Mbps Port-Channel Member Ports High Speed = 0 Mbps Group: Protocol :Disabled Port-channels in the group: Port-channel : Po Number of Ports = 0