February Connectrix VDX-6740B IP Storage Switch Deployment Guide for VxRail Appliance

21 February 2016 Connectrix VDX-6740B IP Storage Switch Deployment Guide for VxRail Appliance

2016, Brocade Communications Systems, Inc. All Rights Reserved. ADX, Brocade, Brocade Assurance, the B-wing symbol, DCX, Fabric OS, HyperEdge, ICX, MLX, MyBrocade, OpenScript, The Effortless Network, VCS, VDX, Vplane, and Vyatta are registered trademarks, and Fabric Vision and vadx are trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries. Other brands, products, or service names mentioned may be trademarks of others. tice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning any equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to this document at any time, without notice, and assumes no responsibility for its use. This informational document describes features that may not be currently available. Contact a Brocade sales office for information on feature and product availability. Export of technical data contained in this document may require an export license from the United States government. The authors and Brocade Communications Systems, Inc. assume no liability or responsibility to any person or entity with respect to the accuracy of this document or any loss, cost, liability, or damages arising from the information contained herein or the computer programs that accompany it. The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements. To find out which open source software is included in Brocade products, view the licensing terms applicable to the open source software, and obtain a copy of the programming source code, please visit http://www.brocade.com/support/oscd. EMC2, EMC, the EMC logo, Connectrix, and Redefine are registered trademarks or trademarks of EMC Corporation in the United States and other countries. VMware is a registered trademark or trademark of VMware, Inc., in the United States and other jurisdictions. Copyright 2016 EMC Corporation. All rights reserved. Published in the USA. 01/15 Specification Sheet H13919.2 EMC believes the information in this document is accurate as of its publication date. The information is subject to change without notice.

Contents... 4 Overview... 4 Configuration... 6 Example Configuration... 18 Basic Configuration Worksheet... 23 VLAN Worksheet...24 Creating A Serial Connection...25 3

Overview... 4 Configuration...6 Overview The goal of this document is to guide an installer through the process of connecting VxRail Appliances to Connectrix VDX-6740B top-of-rack switches and configuring the switches to connect to an end customer's IP network. VxRail solution combines VMware compute, networking, and storage resources into a hyperconverged infrastructure appliance to create a simple, easy to deploy, all-in-one solution. The VxRail hyper-converged infrastructure appliance enables power-on to VM creation in minutes, radically easy VM deployment, easy non-disruptive patch and upgrades and simplified scale-out. In VMware's current release, up to sixteen VxRail Appliances can be grouped together as a single VxRail cluster serviced by a single Virtual SAN Datastore. Each VxRail Appliance contains four server nodes and each server node has two 10GbE ports which connect to the Connectrix VDX-6740B switches as shown in Figure 1 below. This guide walks you through the steps to add a single cluster of VxRail Appliances to either one or two Connectrix VDX-6740B top-of-rack switches. Additional clusters may be connected to the Connectrix VDX-6740B switches.if you are adding more than one cluster, print out multiple copies of Table 4 on page 24 and fill them out separately for each cluster. For the second and additional clusters, refer to the VDX port assignments shown in Table 1 on page 13 and Table 2 on page 14 and use the next available port groupings for each additional cluster. For example, if you used VDX ports 1-4 and 33-36 for the first cluster and the second cluster is the same number of VxRail Appliance, you can use VDX ports 5-8 and 39-42. 4

FIGURE 1 VxRail Appliance with Connectrix VDX-6740B Top-of-Rack switch solution The VxRail Appliance s must be connected to the IP network before they can be configured and this requires both physical connectivity to the customer's network as well as some basic knowledge of the customer's network. Basic requirements include knowledge of The customer's default IP gateway address and subnet mask. Whether Connectrix VDX-6740B switch management will be in-band or out-of-band, and the IP address for switch management. The number and type of Ethernet ports required for VxRail Appliance connectivity. The number and type of Ethernet ports for the VDX inter-switch links (ISLs) which are used to interconnect the switches to each other. The number and type of Ethernet ports for the VDX network uplinks used to connect the switches to the customer s existing network. 5

Configuration The Connectrix VDX-6740B switch comes with 24 10GbE ports enabled. If more than 24 10GbE ports are needed, or if 40GbE ports are needed, one or more license keys need to be installed on the VDX. It is assumed the installer has the required license keys. There are references to "Rbridge" and "Rbridge id" in the document. An Rbridge refers to a single Connectrix VDX-6740B, and rbridge-id refers to the unique switch identifier. There are references to in-band and out-of-band management in the document. This refers to whether switch management traffic is routed to an "out-of-band" management port on the switch (#5 in Figure 2 on page 7) or whether management traffic is routed "in-band" to one of the other Ethernet ports. In this document, the serial console management port is used to configure the switch via a serial cable attached to the laptop. After this initial configuration, the VDX switch will be configured for either inband or out-of-band management. This guide requires no working knowledge of the Connectrix VDX-6740B, it walks the installer through all of the required steps. Some of the configuration commands or terms may be unfamiliar to the installer, but the guide is designed to walk the installer through the configuration step-by-step without requiring any further knowledge of the commands or terms used. Simply following step-by-step instructions and if you're not sure about a given value, use the recommended value. Configuration 1. This guide assumes that the installer has a basic familiarity with the VxRail Appliance requirements, including how many appliances will be installed, and whether the VxRail deployment will use VLANs or will be flat. The installer should also know how many ports are available on the upstream switches that the Connectrix VDX-6740B will connect to and whether they are 10GbE or 40GbE ports. 2. Installer laptop a. Serial console port: The laptop needs to connect to the console port of the Connectrix VDX- 6740B (port #4 in Figure 2 ). A serial cable with an RJ-45 connector is provided with the Connectrix VDX-6740B for the purpose of connecting to the console port of the VDX. An appropriate adaptor may be required for the laptop. b. Serial console software: The installer will be required to perform the configuration via the serial port. A terminal emulator program, for example "PuTTY" or "Screen," is required for console access. c. For more detail on configuring the serial connection to the serial console port, refer to Creating A Serial Connection on page 25 below. 6

FIGURE 2 Connectrix VDX-6740B front side 3. Installer laptop rights a. Must be able to set up and use the serial console port, using a terminal emulator program on the laptop such as PuTTY or Screen. 4. Connectrix VDX-6740B a. NOS 5.0.1a or later must be installed. b. The VDX is expected to be in the "factory default" configuration. If it is not in the factory default state, reset the VDX as follows. First, login to the switch, the defaults are: Username = admin Password = password You can either do a complete reset to factory default, which erases all configuration and installed license keys, or you can use an optional configuration parameter to reset all user configurations except the management IP address and any installed licenses (such as additional 10GbE or 40GbE port licenses). Do one of the following two steps: i. Perform a simple reset to factory default erasing all configuration and installed license keys. Enter the global command: write erase ii. Reset all user configurations except the management IP address and optional licenses. Enter the global command: write erase rbridgeid <n> Where <n> is the configured RbridgeID number. If you are not sure of the RbridgeID number, you can display it using the show rbridge-id command. Required VDX Switch Configuration Information 5. Check if optional 10GbE or 40GbE licenses have been installed on the switch. a. If a 10GbE or 40GbE license needs to be installed, apply the licenses to the Connectrix VDX- 6740B using the instructions in this step. Otherwise skip to the next step. To install a license key, enter the license add licstr command followed by the license key. The license key is printed between the XML start <lickey> and end </lickey> tags in the license file. 7

Be sure to copy the entire string, including spaces and non-alphanumeric characters. If the license key includes spaces, you must enclose the entire string in double quotation marks. Repeat this command for each software license key found in the license file. See the example below. FIGURE 3 Adding a license key to a switch NOTE For steps 6-11, use the worksheets in Table 3 on page 23 and Table 4 on page 24 to record the answers. 6. How many VxRail Appliances will be deployed? (default = 1, range = 1-16) 7. Will the network be flat or will it use VLANs? If flat, go to Step 8. If using VLANs, you may need to ask the customer what their VLAN addressing scheme is. If they are not sure, then use the defaults below including a single shared VM Network VLAN. a. Management VLAN ID (default =1, the Native VLAN.) Assign the name "Management" for this VLAN. The VDX Management VLAN must be VLAN ID 1 because VxRail Appliance management traffic is untagged by default and needs to be forwarded on the VDX's Native VLAN, which is VLAN ID 1. Traffic forwarded on VDX VLAN ID 1 is also untagged by default. b. vsphere vmotion VLAN ID (default = 20) Assign the name vmotion for this VLAN. c. Virtual SAN VLAN ID (default = 30) Assign the name VSAN for this VLAN. d. VM Network VLAN How many VM networks are required? (Optional, default = 1, range = 1-4K) VM network VLAN naming and numbering can be defined by the customer, or if they do not have a preference you can use the names suggested in this step. As a best practice, VLAN names can be VM Network A, VM Network B, and continue alphabetically. The VLAN ID's can start with 110, then increment in 10's. So the second is 120, third is 130, etc. If a conflict exists with Management, vmotion or Virtual SAN VLANs, then skip to next VLAN ID number. 8. How many VDX switches are going to be provisioned? (range = 1-2). Each switch needs uplink ports to connect to upstream switches in the network. If you have two switches, you will also need to interconnect them using inter-switch link ports (ISLs). a. If one switch, there is no need for any ISL connections. Go to step 9. b. If two switches will be provisioned, are the ISLs 10GbE or 40GbE? Both switches will have the same ISL configuration. i. If the ISL is 10GbE, how many ports are in the trunk group (default = 2, range = 1-8)? ii. If the ISL is 40GbE, how many ports are in the trunk group (default = 2, range = 1-2)? 8

9. How many uplink ports are needed to connect to the upstream network? If two switches are being deployed, both switches will have the same port configuration. a. 10GbE or 40GbE ports? b. Number of network ports? i. 10GbE (default = 2, range = 1-8) ii. 40GbE (default = 2, range - 1-4 minus any 40GbE ports selected for ISL trunks) 10. Will the out-of-band VDX Ethernet Management port be configured, or will in-band management be used instead? The out-of-band VDX Ethernet Management port is port #5 in Figure 2 above. You will need to ask the customer for the management IP address, subnet mask, and gateway. The out-ofband management port is used when the customer deploys a separate out-of-band management network. a. You will need the VDX Management IP Address - this is required for either in-band or out-of-band management b. You will also need the IP default gateway and subnet mask in CIDR notation for management network. For example, 10.1.1.1/24. VDX Configuration Actions 11. You will now configure the switch or switches using the parameters and values chosen and recorded in Table 3 on page 23 and Table 4 on page 24 worksheets as explained in the steps below. Power on the switch, connect the laptop's serial cable to the VDX console port, and log in. When you first log in to the switch, the defaults are as follows: Username = admin Password = password It is highly recommended that you change the password. Enter the command configure terminal and then enter the global command: username admin password <new-password> 12. Configure an Rbridge ID for each switch. It is a mandatory switch identifier. Each switch needs a unique number. If you have two switches, you can simply use 1 and 2. Enter the value(s) you used into the worksheet in Table 3 on page 23 below. rbridge-id <number> Where <number> is a unique number from 1-239. 13. Optionally, enter a name for the switch using the command switch-attributes host-name <your chosen name> 14. In-band VDX management setup (from Step 10 above). If out-of-band VDX switch management is to be used instead, skip to the next step. Enter the IP default gateway address. From the rbridge-id 1 context, enter the management virtual routing and forwarding context (VRF) by typing the command: vrf mgmt-vrf Next enter the IPv4 context by typing the command: address-family ipv4 unicast Enter the command: ip route 0.0.0.0/0 <w.x.y.z> 9

Where <w.x.y.z> is the IP default gateway address you chose in Table 3 on page 23 below. Enter the command: exit, then press Enter. Then again type exit and press Enter. Next create the virtual interface (VE) that is to be used for in-band management and bind it to management VLAN-ID 1: interface ve 1 Add this interface to the management VRF created earlier: vrf forwarding mgmt-vrf Set the IP address and subnet mask for in-band management: ip address <a.b.c.d>/<subnet mask> Where <a.b.c.d>/<mask> is the IP address and subnet mask you chose in Table 3 on page 23. Enable the virtual interface: The following is an example of the configuration above: rbridge-id 1 switch-attributes host-name foo vrf mgmt-vrf address-family ipv4 unicast ip route 0.0.0.0/0 10.5.1.1 interface Ve 1 vrf forwarding mgmt-vrf ip proxy-arp ip address 10.5.1.2/24 15. Out-of-band VDX Management port setup (From Step 10 above) If you have set up in-band VDX switch management, skip to the next step. For setting up the out-ofband VDX Management port, follow the steps below. Enter the command configure terminalthen enter the global command: rbridge-id <number you configured in step 12> Next enter the management virtual routing and forwarding context (VRF) by typing the command: vrf mgmt-vrf Enter the IPv4 context by typing the command: address-family ipv4 unicast Enter the command: ip route 0.0.0.0/0 <w.x.y.z> Where <w.x.y.z> is the IP default gateway address you chose in Table 3 on page 23 below. Enter the command: end To return to the command prompt. Enter the command configure terminal then enter the global command: interface Management <rbridge-id number you configured in step 12>/0 Enter the command: 10

ip address <a.b.c.d>/<subnet mask> Where <a.b.c.d>/<mask> is the IP address and subnet mask you chose in Table 3 on page 23 below. Enter the command: end To return to the command prompt. The following is an example of the out-of-band VDX management port setup. rbridge-id 1 switch-attributes host-name foo vrf mgmt-vrf address-family ipv4 unicast ip route 0.0.0.0/0 10.5.1.1 interface Management 1/0 ip address 10.5.1.70/16 16. Configure VxRail Appliance -facing Ethernet ports and optional VLAN interfaces based on the number of appliances and switches selected. If the network is flat, you do not need to configure additional VLANs. If the network uses VLANs, you must create each VLAN interface, then enable the Ethernet ports and specify which VLANs are allowed to be included in each Ethernet port s trunk, per Table 3 on page 23 and Table 4 on page 24 below. The Management VLAN must be IPv4 IGMP snooping and IPv6 MLD snooping enabled, and VSAN VLANs must be IPv4 IGMP snooping enabled. The snooping querier function will also be enabled. Generally speaking, any Ethernet port can be used to connect to any host, appliance or upstream switch. However for optimal performance, it is best to balance the use of the ports across the two "Packet Buffer Banks", one from ports 1-32, the other from ports 33-52. Each packet buffer bank has its own dedicated memory, so by balancing the use of ports across the two packet buffer banks you take full advantage of the buffering capabilities of the switch. See Figure 4 below. Use Table 1 and Table 2 to determine which VDX switch ports to enable based on the values chosen in Table 3 on page 23 worksheet. These port selections make optimal use of the switches buffering capabilities. FIGURE 4 Connectrix VDX-6740B: port configuration and buffer banks 11

FIGURE 5 Connectrix VDX-6740B Inter-Switch Link (ISL) trunk groups You may deploy one or two switches for VxRail Appliance. A single switch provides the lowest cost option though it is a single point of failure. A single switch topology is not recommended if you plan to deploy more than 4 VxRail Appliances. Two switches provide redundancy for high availability and is the recommended approach. Figure 6 is an example of a single switch topology and Figure 7 is an example of dual-switch topology. In the single switch topology, each node connects to a single VDX switch. The VDX may connect to one or two upstream switches. FIGURE 6 Example of a single switch topology In the dual-switch topology, each node will connect to both switches. When two switches are deployed, inter-switch links (ISLs) are needed. ISLs are used to interconnect the switches, you can combine multiple Ethernet links to create trunks. These trunks are a bundle of Ethernet interfaces and are automatically configured when they are connected. When creating a trunk, all of the Ethernet ports used in the trunk must belong to ports in the same trunk group. See Figure 5 above. 12

The steps that follow guide you which ports to use based on the answers given in the worksheet shown in Table 4 on page 24 below. FIGURE 7 Example of a dual-switch topology In the current version of VxRail solution, you can have up to sixteen VxRail Appliance represented as one cluster and serviced by one Virtual SAN datastore. Each VxRail Appliance is comprised of four ESX hosts configured into a single cluster under the management of vcenter Server, and serviced by a single Virtual SAN datastore. The following are key rules and assumptions for deployment: Each VxRail Appliance has exactly eight 10GbE connections to the Connectrix VDX-6740B topof-rack switch. All VxRail Appliance are grouped into a single VxRail cluster. Up to 16 VxRail Appliance can be deployed for a total of 64 server nodes. Table 1 below defines the optimal VDX port selection for a single-switch toplogy. Table 2 below defines the optimal VDX port selection for a dual-switch toplogy. TABLE 1 Single-switch topology: appliance-facing network port assignments Number of VxRail Appliance VDX Port Assignments 1 Ports 1-4, 33-36 2 Ports 1-8, 33-40 3 Ports 1-12, 33-44 4 Ports 1-16, 33-48 13

TABLE 2 Dual-switch topology: appliance-facing network port assignments Number of VxRail Appliance VDX Port Assignments 1 Ports 1-2, 33-34 2 Ports 1-4, 33-36 3 Ports 1-6, 33-38 4 Ports 1-8, 33-40 5 Ports 1-10, 33-42 6 Ports 1-12, 33-44 7 Ports 1-14, 33-36 8 Ports 1-16, 33-48 For the following steps, refer to the worksheets in Table 3 on page 23 and Table 4 on page 24 for the VLAN IDs and names you've chosen, and to Table 1 above for the port assignments. 17. Configure the Management VLAN interface, which will be using the switches default Native VLAN ID, using the command: interface vlan 1 Then enter the VLAN name using the command: name <VLAN name> For the Management VLAN, you also need to enable IPv4 IGMP snooping, IPv6 MLD snooping, and the snooping queriers. Enter the following commands: ip igmp snooping enable ip igmp snooping querier enable ipv6 mld snooping enable ipv6 mld snooping querier enable Enter the command: exit You are now returned to the top level configuration mode. 18. Disable tagging of untagged traffic on the Native VLAN (Management VLAN). Enter the global command: no vlan dot1q tag native 19. If the network is flat (no VLANs), skip to the step 20. If using VLANs, begin configuring VLAN interfaces using the command: 14

interface vlan <x> Where <x> is the name of the VLAN ID. Then enter the VLAN name using the command: name <VLAN name> For the VSAN VLANs, you need to enable IPv4 IGMP snooping and the snooping querier. Enter the following commands for those VLANs: ip igmp snooping enable ip igmp snooping querier enable Enter the command: exit To return to the top level configuration mode. Repeat the above steps for all VLAN interfaces. The following is an example of this portion of the configuration. no vlan dot1q tag native interface Vlan 1 name Management ip igmp snooping enable ip igmp snooping querier enable ipv6 mld snooping enable ipv6 mld snooping querier enable interface Vlan 30 name VSAN ip igmp snooping enable ip igmp snooping querier enable 20. Configure the server-facing network interfaces a. Recall that each switch has a unique Rbridge number, refer to the worksheet in Table 3 on page 23 for the values you chose. For Connectrix VDX-6740B switches, the slot number is always 0. Configure the ports on the switch which connect to the VxRail nodes based on the values in Table 1 for a single switch topology and Table 2 for a dual-switch topology. Enter the command: interface tengig <rbridge-id/slot/port> te that to make port configuration quicker, you can configure a range of ports with one command. For example to configure ports 1 4 enter the command: interface tengig 1/0/1-4 Next put the port into trunk mode by entering the following two commands: 21. If the network is flat (no VLANs), skip to step 22. If using VLANs, refer to Table 4 on page 24 for the VLAN IDs and names you have chosen. These are then added to the trunk with the following command. Management VLAN 1 is forwarded by default and should not be included. Use a comma to separate multiple VLAN IDs. trunk allowed vlan add <vlan ID,vlan ID,vlan ID > 22. Enabling Inter-Switch Links (ISL trunks). 15

You can use any of these ports of ISL connectivity, these are the ports that connect the switches together. Port Type Use Ports in Range 10GbE 17-24 40GbE 49-52 For ISLs, there is no configuration required. Just plug in the correct optics and cables and it will automatically form the ISL. 23. Configure the network-facing uplink ports as LAGs as shown in the example below. This example is shown for both 10GbE and 40GbE interfaces. You will need to configure only the interfaces you are using for the uplink connections. Port Type Use Ports in Range 10GbE 25-32 40GbE 49-52 Network-facing ports (uplinks) are configured as LAGs or as trunk ports. Typically, if you have an L2 network (no routing) with VLANs, you bundle the uplink ports into a LAG. Link aggregation allows you to bundle multiple physical Ethernet links to form a single logical trunk providing enhanced performance and redundancy. The aggregated trunk is referred to as a Link Aggregation Group (LAG). The LAG is viewed as a single link by connected devices, the Spanning Tree Protocol, IEEE 802.1Q VLANs, and so on. When one physical link in the LAG fails, the other links stay up and there is no disruption to traffic. To configure links to form a LAG, the physical links must be the same speed and all links must go to the same upstream switch unless the upstream switches support a multi-chassis LAG capability, such as Cisco vpc, MLAG or Brocade VLAG. Once you are in the config mode (config t), enter the following: interface Port-channel <n> Where <n> is the port-channel interface number. It can be any number from 1-6144. Next, put the port-channel in trunk mode and bring it up by typing the following commands. w, pick the interfaces from each switch (Rbridge1 and Rbridge2) which are connected to the upstream switches (Switch A and Switch B) and configure them to belong to port-channel <n>. Refer to Figure 7 above. If you are using 10G interfaces for uplinks, you can configure them as shown below interface tengig 1/0/31-32 channel-group <n> mode active Where <n> is the port channel interface number. If you are using 40G interfaces for uplinks, you can configure 40G ports 49-50 as shown below. interface fortygig 1/0/49-50 channel-group <n> mode active Where <n> is the port channel interface number. Management VLAN 1 is forwarded by default. other VLANs need to be forwarded on the network-facing ports. 16

Here is an example of this section of the configuration where the port-channel number is 10. interface TenGigabitEthernet 1/0/31 channel-group 10 mode active type standard interface TenGigabitEthernet 1/0/32 channel-group 10 mode active type standard interface Port-channel 10 24. For best performance in an VxRail environment it is a good idea to set the interface MTU to the largest value, also known as enabled "jumbo frames". However it is important that the upstream switches and hosts connected to the VDX are also configured to the same interface MTU size. The VDX supports a maximum MTU of 9216. Make sure to check the host and upstream network interface settings. t all hosts or switches can support full 9216 byte jumbo frames. If you are not sure, skip this step and check later. As an example, assume that your server's interface and upstream network switch ports are set to an MTU of 9000. Then enter the command: Enter the command end to return to the command prompt. As a simple example, the following is an MTU configuration for an appliance facing trunk port and network-facing uplink port. interface TenGigabitEthernet 1/0/1 trunk allowed vlan add 20,30,110,120 interface Port-channel 10 25. Performance Optimization To optimize the switches forwarding performance for an VxRail environment, you should allocate a little more buffering for bursty traffic. Enter the command configure terminal. Then enter the global command: rbridge-id <number> Use the rbridge number you chose in Table 3 on page 23 below. Enter the following two commands: qos rcv-queue limit 2000 qos tx-queue limit 2000 Enter the end command to finish the configuration. 26. Save the configuration. This is the most important step copy running-config startup-config 17

Example Configuration Example Configuration Consider the following appliance/switch combination. The VLAN configuration method was chosen and each switch has two VM networks. Number of VxRail Appliances Number of Switches VDX Port Assignments 2 2 Ports 1-4, 33-36 In addition, we configure two 10GbE uplink ports and connect two 10GbE ISLs. te that no configuration is needed for the ISLs, you just plug them into the correct ports. You can verify the VLAN configurations by issuing the show vlan brief command. The command show fabric isl shows you ISL connectivity (for example below, Ten 1/0/23 and 1/0/24 are ISLs). Two samples of the required VDX configuration commands on Rbridge1 are shown below, one for outof-band and one for in-band management. You can verify the configuration by issuing the show running config command. te this is the partial output of the show running config command. It includes some default commands that were not entered in the steps above, for example the command is a default command shown on all interfaces regardless of whether or not they are used as ISL ports. Rbridge1 (with Out-of-band VDX management): no vlan dot1q tag native interface Vlan 1 name Management ip igmp snooping enable ip igmp snooping querier enable ipv6 mld snooping enable ipv6 mld snooping querier enable interface Vlan 20 name VMOTION interface Vlan 30 name VSAN ip igmp snooping enable ip igmp snooping querier enable interface Vlan 110 name VM NETWORK_A interface Vlan 120 name VM NETWORK_B rbridge-id 1 switch-attributes chassis-name VDX6740 switch-attributes host-name VDX-TOR-1 vrf mgmt-vrf address-family ipv4 unicast ip route 0.0.0.0/0 10.5.1.1 address-family ipv6 unicast qos tx-queue limit 2000 qos rcv-queue limit 2000 interface Management 1/0 vrf forwarding mgmt-vrf no tcp burstrate ip icmp unreachable ip icmp echo-reply no ip address dhcp ip address 10.5.1.70/24 18

Example Configuration ipv6 icmpv6 unreachable interface TenGigabitEthernet 1/0/1 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/2 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/3 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/4 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/23 interface TenGigabitEthernet 1/0/24 interface TenGigabitEthernet 1/0/31 channel-group 10 mode active type standard lacp timeout long interface TenGigabitEthernet 1/0/32 channel-group 10 mode active type standard lacp timeout long interface TenGigabitEthernet 1/0/33 trunk allowed vlan add 20,30,110,120 19

Example Configuration trunk tag native-vlan interface TenGigabitEthernet 1/0/34 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/35 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/36 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface Port-channel 10 vlag ignore-split trunk tag native-vlan Rbridge1 (with In-band VDX management): no vlan dot1q tag native interface Vlan 1 name Management ip igmp snooping enable ip igmp snooping querier enable ipv6 mld snooping enable ipv6 mld snooping querier enable interface Vlan 20 name VMOTION interface Vlan 30 name VSAN ip igmp snooping enable ip igmp snooping querier enable interface Vlan 110 name VM NETWORK_A interface Vlan 120 name VM NETWORK_B rbridge-id 1 switch-attributes chassis-name VDX6740 switch-attributes host-name VDX-TOR-1 vrf mgmt-vrf address-family ipv4 unicast 20

Example Configuration ip route 0.0.0.0/0 10.5.1.1 address-family ipv6 unicast qos tx-queue limit 2000 qos rcv-queue limit 2000 interface ve 1 vrf forwarding mgmt-vrf ip proxy-arp ip address 10.5.1.2/24 interface TenGigabitEthernet 1/0/1 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/2 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/3 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/4 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/23 interface TenGigabitEthernet 1/0/24 interface TenGigabitEthernet 1/0/31 channel-group 10 mode active type standard lacp timeout long interface TenGigabitEthernet 1/0/32 21

Example Configuration channel-group 10 mode active type standard lacp timeout long interface TenGigabitEthernet 1/0/33 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/34 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/35 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface TenGigabitEthernet 1/0/36 trunk allowed vlan add 20,30,110,120 trunk tag native-vlan interface Port-channel 10 vlag ignore-split trunk tag native-vlan 22

Basic Configuration Worksheet TABLE 3 Basic Configuration Worksheet Worksheet Setting Required Worksheet Value Number of VxRail Appliances Number of VDX switches Number of 10 GbE network-facing ports (uplinks) Number of 40 GbE network-facing ports (uplinks) Yes (At least one) Yes (At least one) At least one uplink to the upstream network Number of 10 GbE inter-switch links (ISLs) Number of 40 GbE inter-switch links (ISLs) Management port IP address and mask for Rbridge 1 (if using VDX Management port) At least one 10 GbE or 40 GbE ISL if using dual-switch topology Management port IP address and mask for Rbridge 2 (if using VDX Management port) Management port default gateway In-band Management IP address for VDX 1 (if using any of the 10GbE or 40GbE for management purposes) In-band Management IP address for VDX 2 (if using any of the 10GbE or 40GbE for management purposes) In-band Management port default gateway VDX Switch 1 Rbridge ID (a unique number between 1-200 which identifies the switch) Yes VDX Switch 2 Rbridge ID (a unique number between 1-200 which identifies the switch) Yes 23

VLAN Worksheet VLAN Worksheet NOTE In the VLAN Worksheet enter a VLAN ID value 2-4094, except reserved VLANs 1, 1002, 3964-4090. TABLE 4 VLAN Worksheet Worksheet Setting Required VLAN ID VLAN Name ESXi Management VLAN vsphere vmotion VLAN Virtual SAN VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN VM Network VLAN The table above shows entries for up to ten VM Network VLANs. If needed, more VM Network VLANs can be added. 24

Creating A Serial Connection You perform all configuration tasks using a serial connection from a workstation or terminal to the switch. Complete the following steps to create a serial connection to the switch: 1. Connect the serial cable to the serial port on the switch and to an RS-232 serial port on the workstation or terminal device. If the serial port on the workstation or terminal device is RJ45 instead of RS-232, remove the adapter on the end of the serial cable and insert the exposed RJ45 connector into the RJ45 serial port on the workstation. 2. Open a terminal emulator application (such as HyperTerminal on a PC, or TERM, TIP, or Kermit in a UNIX environment), and configure the application as follows: In a Windows environment, enter the following values: 9600 bits per second, 8 databits, no parity, 1 stop bit, and no flow control. In a UNIX environment using TIP, enter the following string at the prompt: tip /dev/ttyb -9600 If ttyb is already in use, use ttya instead. The serial port is located on the port side of the Connectrix VDX-6740B switches. The Connectrix VDX-6740B uses an RJ-45 connector for the serial port. An RJ-45 to DB9 adapter is also provided with the switch. The cable supplied is a rollover cable. NOTE To protect the serial port from damage, keep the cover on the port when not in use. The serial port can be used to connect to a workstation to configure the IP address for the Connectrix VDX-6740B switch before connecting the switch to a fabric or IP network. The serial port's parameters are fixed at 9600 baud, 8 data bits, and no parity, with flow control set to ne. TABLE 5 Serial cable pinouts PIN Signal Description 1 t supported NA 2 t supported NA 3 TXD Transmit data 4 GND Logic ground 5 t supported NA 6 RXD Receive data 7 t supported NA 8 t supported NA 25