Brocade FCIP/FCR. MAJOR TELCOM COMPANY Joe Holbrook BCFP, BCSD, BCSM. September 04, 2007

Transcription

1 Brocade FCIP/FCR Implementation MAJOR TELCOM COMPANY Joe Holbrook BCFP, BCSD, BCSM September 04, 2007

2 Legal Disclaimer All or some of the products detailed in this presentation may still be under development and certain specifications, including but not limited to, release dates, prices, and product features, may change. The products may not function as intended and a production version of the products may never be released. Even if a production version is released, it may be materially different from the pre-release version discussed in this presentation. NOTHING IN THIS PRESENTATION SHALL BE DEEMED TO CREATE A WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, STATUTORY OR OTHERWISE, INCLUDING BUT NOT LIMITED TO, ANY IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NONINFRINGEMENT OF THIRD PARTY RIGHTS WITH RESPECT TO ANY PRODUCTS AND SERVICES REFERENCED HEREIN. Brocade, the Brocade B-weave logo, McDATA, Fabric OS, File Lifecycle Manager, MyView, Secure Fabric OS, SilkWorm, and StorageX are registered trademarks and the Brocade B-wing symbol and Tapestry are trademarks of Brocade Communications Systems, Inc. or its subsidiaries, in the United States and/or in other countries. FICON is a registered trademark of IBM Corporation in the U.S. and other countries. All other brands, products, or service names are or may be trademarks or service marks of, and are used to identify, products or services of their respective owners. 2

3 7500 NOTES

4 7500 Overview 4

5 7500 Front 5

6 7500 Back 6

7 FCIP/FCR NOTES

8 Example Configuration Overview 8

9 FCIP/FCR Once the switch (SW7500) is configured, the switchshow command displays 32 Fibre Channel ports (port numbers 0 through 31) and 2 GbE ports. The first 16 Fibre Channel ports are physical ports on the SilkWorm 7500, Ports are virtual ports associated with the GE0 physical GbE link and ports are virtual ports associated with GE1 physical GbE link. The GbE ports are displayed as ge0 and ge1 and are not assigned port numbers or area numbers. 9

10 FCIP/FCR NOTE: Fabrics connected through FCIP merge if the ports are configured as VE_Ports, and do not merge if they are configured as VEX_Ports. If VE_Ports are used in a Fibre Channel Routing Services backbone fabric configuration, then the backbone fabric merges but the EX_Port attached to edge fabrics do not merge. 10

11 FCIP/FCR NOTE: The port types for FCIP tunneling are either VE_Port or VEX_Port. An FCIP tunnel using VE_Ports will merge the two fabrics. An FCIP tunnel using a VEX_Port will not merge the fabrics. A VEX_Port can connect only to a VE_Port. The IP encapsulation of the Fibre Channel frame on one port and the reconstruction of Fibre Channel frames on the other port is transparent to the initiator and target. 11

12 FCIP/FCR NOTE: If using FCIP in your FC-FC Routing configuration, you must first configure FCIP tunnels. Once a tunnel is created, it defaults to a disabled state. Then configure the VE_Port or VEX_Port. After the appropriate ports are configured, enable the tunnel. 12

13 BROCADE FCR/FCIP Secure Fabric OS, Management Server Platform services, and interopmode are not supported in the backbone fabric. FOS 5.2 and above support FC-FC connections to McDATA Fabrics. Fabric OS v5.2.0 furnishes the FC router with the ability to connect to McDATA fabrics in both McDATA Open or McDATA Fabric mode. 13

14 BROCADE FCR/FCIP Ensure fabric OS is at v5.1 or later. Fabric OS 5.2 or later is required if connecting to McDATA Fabrics 14

15 Information Needed Customer Supplied

16 Pre Implementation Information Gathering Lets Document the following Switchname IP Addresses Subnet Netmask MTU size (Jumbo Packets?) FCR LSAN Zoning 16

17 Configure Switch

18 Configure Term Configure the Port Settings parameters as follows: Bits per second 9600 Data bits - 8 Parity - None Stop bits - 1 Flow control None 18

19 Configure Management LAN a. View Current Management Interface Settings i. ipaddrshow to view current configuration 1. Ethernet IP Address: 2. Ethernet Subnetmask: 3. Fibre Channel IP Address: 4. Fibre Channel Subnetmask: 5. Gateway Address: b. Set IP for Management Interface i. ipaddrset and follow prompts 1. IP Address 2. Subnetmask 3. Fibre Channel IP Address 4. Fibre Channel Subnetmask 5. Gateway IP Address c. Reboot Switch 19

20 Set Switchname When naming your routers it is important to name them in a consistent and easy to replicate manner. switchname name 20

21 Verify Firmware Firmware needs to be v5.1 and above a. version to display current firmware version running on switch b. firmwareshow Display firmware in both memory partitions c. check OEM recommended level & TSB s to determine if upgrade is necessary 21

22 Configure Domain ID and Fabric Params a. switchdisable to disable switch in order to make fabric parameter changes b. configure i Note: Ctrl-D at any time to accept remaining settings without completing all prompts. c. Yes or Y to configure fabric parameters d. Domain ID e. WAN_TOV ii. Accept Default of 1000ms iii. If timeouts/errors occur on tunnel this can be modified/updated f. Insistent Domain ID (OPTIONAL) g. switchenable 22

23 Optional Settings Time Server a. tsclockserver xxx.xxx.xxx.xxx b. verify settings using tsclockserver Time Zone a. tstimezone [houroffset [, minuteoffset]] i. For Pacific Standard Time, enter tstimezone -8,0 ii. For Mountain Standard Time, enter tstimezone -7,0 iii. For Central Standard Time, enter tstimezone -6,0 iv. For Mountain Standard Time, enter tstimezone -5,0 23

24 Optional Settings Syslog Server a. syslogdipadd xxx.xxx.xxx.xxx to add a new syslog server b. syslogdipshow to view configured syslog servers 24

25 Optional Settings Syslog Server a. syslogdipadd xxx.xxx.xxx.xxx to add a new syslog server b. syslogdipshow to view configured syslog servers 25

26 Install FCIP License a. licenseshow (record info) b. validate licenses active with packet of licenses purchased i. If licenses are missing we need 1. transaction key (from paper packet) 2. WWN (from switchshow) ii. If we have a license key proceed to activate license c. licenseadd key d. licenseremove key 26

27 Configupload a. configupload (Follow Prompts for the following information) i. Protocol (ftp or scp) ii. Server Name or IP Address iii. User Name iv. File Name v. Password b. Verify File was uploaded to FTP server 27

28 Verify Switch Status a. switchstatusshow i. Verifies overall switch status b. portshow port number i. Verifies port status on per port basis c. fanshow i. Verifies overall Fan status d. psshow i. Verifies overall Power Supply Status e. tempshow i. Verifies Temperature Sensor Status 28

29 Configure FCIP Ports

30 Configure FCIP Ports VERIFY SETTINGS SW7500:admin> portcfg ge0 or portcfg ge1 Usage: portcfg <action> [Slot/]Port[-Range] <Args> Range: Specify a range of port in the same slot to apply Action: rscnsupr -- RSCN suppression ipif -- IP Interface iproute -- IP Routes fciptunnel -- FCIP Tunnel arp -- ARP Entry Args: Action specific arguments 30

31 Configure FCIP Ports a. Portcfgshow ge0 (To view current configuration of GbE 0) b. Portcfgshow ge1 (To view current configuration of GbE 1) 31

32 Configure FCIP Ports Licenseshow Verify Persistently disabled a. Switchshow to validate that ports are disabled (These are FCIP Tunnel Virtual Ports) b. Verify ge0 & ge1 are Disabled 32

33 Configure FCIP Ports c. The Tunnel Ports associated to each GbE interface are shown below Port GbE Interface Tunnel Number ============================== 16 GbE 0 TUNNEL 0 17 GbE 0 TUNNEL 1 18 GbE 0 TUNNEL 2 19 GbE 0 TUNNEL 3 20 GbE 0 TUNNEL 4 21 GbE 0 TUNNEL 5 22 GbE 0 TUNNEL 6 23 GbE 0 TUNNEL 7 24 GbE 1 TUNNEL 0 25 GbE 1 TUNNEL 1 26 GbE 1 TUNNEL 2 27 GbE 1 TUNNEL 3 28 GbE 1 TUNNEL 4 29 GbE 1 TUNNEL 5 30 GbE 1 TUNNEL 6 31 GbE 1 TUNNEL 7 ge0 id 1G No_Sync Disabled ge1 id 1G No_Sync Disabled 33

34 Configure FCIP Ports Define Switch_A a. Portshow ipif ge0 / ge1 To View Current IP, Netmask & MTU settings b. To Add IP Tunnels to ge0 i. portcfg ipif ge0 create (UP TO 8 PER EACH GE PORT CAN BE CREATED) 1. IP = NetMask = MTU = 1500 ii. portcfg ipif ge0 create IP = NetMask = MTU =

35 Configure FCIP Ports c. To Add IP Tunnels to ge1 i. portcfg ipif ge1 create (UP TO 8 PER EACH GE PORT CAN BE CREATED) 1. IP = NetMask = MTU = 1500 ii. portcfg ipif ge1 create IP = NetMask = MTU =

36 Configure FCIP Ports d. portshow ipif ge0 / ge1 to view / ensure settings are correct Port: ge0 Interface IP Address NetMask MTU Port: ge1 Interface IP Address NetMask MTU e. To Delete a defined IP i. portcfg ipif ge0 / ge1 delete xxx.xxx.xxx.xxx where x s = IP address 36

37 Configure FCIP Ports Configure Remote Switch_B a. portshow ipif ge0 / ge1 To View Current IP, Netmask & MTU settings b. To Define IP Tunnel Configuration to ge0 i. portcfg ipif ge0 create (UP TO 8 PER EACH GE PORT CAN BE CONFIGURED) 1. IP = NetMask = MTU =

38 Configure FCIP Ports ii. portcfg ipif ge0 create IP = NetMask = MTU =

39 Configure FCIP Ports c. To Define IP Tunnel Configuration to ge1 i. portcfg ipif ge1 create (UP TO 8 PER EACH GE PORT CAN BE CONFIGURED) 1. IP = NetMask = MTU = 1500 ii. portcfg ipif ge1 create IP = NetMask = MTU =

40 Configure FCIP Ports d. portshow ipif ge0 / ge1 to view / ensure settings are correct Port: ge0 Interface IP Address NetMask MTU Port: ge1 Interface IP Address NetMask MTU

41 ENABLE FCIP Ports Add Routes (optional) Enable GE Ports!! a. Switchshow to view all ports b. portenable ge0 on both local & remote routers c. portenable ge1 on both local & remote routers d. switchshow to verity ports are enabled 41

42 Verify FCIP Ports Verify Connectivity (We will need to this both ways) This verification is used to ping the destination IP address from one of the source IP interfaces on the GbE ports to ensure Ethernet IP-IP connectivity. This verification also ensures that data packets can be sent to the remote interfaces a. portcmd ping ge0 s d s Source -d Destination 42

43 Verify FCIP Ports COMMAND EXAMPLE OUTPUT SW7500_D11:admin> portcmd ping ge0 -s d Pinging from ip interface on 0/0 with 40 bytes of data Reply from : bytes=40 rtt=0ms Reply from : bytes=40 rtt=0ms Reply from : bytes=40 rtt=0ms Reply from : bytes=40 rtt=0ms Ping Statistics for : Packets: Sent = 4, Received = 4, Loss = 0 ( 0 percent loss) Min RTT = 0ms, Max RTT = 0ms Average = 0ms 43

44 Configure FCIP Tunnels After you have verified licensing and connectivity between your source and destination IP interfaces, you can configure FCIP tunnels. As you your tunnel configurations, be aware that uncommitted rate tunnels use a minimum of 1000 Kbps, up to a maximum of available uncommitted bandwidth on the GbE port. The total bandwidth available on a GbE port is 1 Gbps. You can configure tunnels as bidirectional entities with different commit rates in both directions. 44

45 Configure FCIP Tunnels a. portcfg fciptunnel ge0 create i. if only half of the tunnel is ours or we need to throttle the tunnel we can modify the settings here using a different value than ii. NOTE This example (We are using ½ of the full 1G tunnel for this tunnel and the other ½ for the 2nd one being created in b below) b. portcfg fciptunnel ge0 create i. if only half of the tunnel is ours or we need to throttle the tunnel we can modify thesettings here using a different value than ii. NOTE (We are using ½ of the full 1G tunnel for this tunnel and the other ½ for the2nd one being created in b below) 45

46 Configure FCIP Tunnels c. portshow fciptunnel ge0 all (To View Created Tunnels, Output Below) i. Notice that the tunnel is Inactive until the Remote side is configured. SW7500_D11:admin> portshow fciptunnel ge0 all Port: ge Tunnel ID 1 Remote IP Addr Local IP Addr Remote WWN Not Configured Local WWN 10:00:00:05:1e:37:8c:35 Compression off Committed Rate Kbps ( Gbps) SACK on Min Retransmit Time 100 Keepalive Timeout 10 Command Truncated!!! 46

47 Configure FCIP Tunnels CONFIGURE LOCAL FCIP TUNNELS (GE1 Optional) a. portcfg fciptunnel ge1 create b. portcfg fciptunnel ge1 create c. portshow fciptunnel ge1 all (To View Created Tunnels, Output Below) i. Notice that the tunnel is Inactive. SW7500_D11:admin> portshow fciptunnel ge1 all Port: ge1 47

48 Configure FCIP Tunnels Configure Remote FCIP Tunnel GE0 a. portcfg fciptunnel ge0 create b. portcfg fciptunnel ge0 create c. portshow fciptunnel ge0 all (To View Created Tunnels, Output Below) i. Notice that the tunnel is Inactive 48

49 Configure FCIP Tunnels Configure Remote FCIP Tunnel GE1 (optional) a. portcfg fciptunnel ge1 create b. portcfg fciptunnel ge1 create c. portshow fciptunnel ge1 all (To View Created Tunnels, Output Below) ii. Notice that the tunnel is Inactive. 49

50 Configure FCIP Tunnels NOTE: Create as many tunnel ID s as necessary. Maximum of 8 Tunnels per GbE port. You cannot use more than the avail max of 1G per physical link. 50

51 Verify FCIP Tunnels a. Portshow fciptunnel ge0 all i. Notice that the tunnel is now Active SW7500_D11:admin> portshow fciptunnel ge0 all Port: ge Tunnel ID 1 Remote IP Addr Local IP Addr Remote WWN Not Configured Local WWN 10:00:00:05:1e:37:8c:35 Compression off Committed Rate Kbps ( Gbps) SACK on Min Retransmit Time 100 Keepalive Timeout 10 Max Retransmissions 8 Status : Inactive 51

52 Persistentenable FCIP Tunnels Persistentenable portcfgpersistentenable {port} 52

53 Verify Ports switchshow to verify VE port(s) are online Offline Disabled (Persistent) Online VE-Port 10:00:00:05:1e:37:8d:c1 "SW7500_D12" (downstream) Online VE-Port 10:00:00:05:1e:37:8d:c1 "SW7500_D12" Offline Disabled (Persistent) Offline Disabled (Persistent) Offline Disabled (Persistent) Offline Disabled (Persistent) Offline Disabled (Persistent) Offline Disabled (Persistent) Online VE-Port 10:00:00:05:1e:37:8d:c1 "SW7500_D12" Online VE-Port 10:00:00:05:1e:37:8d:c1 "SW7500_D12 53

54 Configuration Overview 54

55 Configure LSANS AND ZONING s 55

56 Configure LSANS AND ZONING Create a zone with the same members (e.g., HBA in fabric A, storage port in fabric B) coded with the PWWN of the device. The zone must use the naming convention LSAN_ZONENAME or lsan_zonename Note that the name of the zone to the right of the underscore character can be anything you want, as long as the above convention is used. It is administratively easier if the zone name is the same in each edge fabric, though this is not required as long as the members of the zone are identical. 56

57 Configure LSANS AND ZONING An LSAN consists of zones in two or more edge or backbone fabrics that contain the same device(s). LSANs essentially provide selective device connectivity between fabrics without forcing you to merge those fabrics. The SilkWorm 7500, with a FR4-18i blade, and AP7420 Multiprotocol Router provide multiple mechanisms for you to manage interfabric device connectivity through extensions to existing switch management interfaces. You can define and manage LSANs using Brocade Advanced Zoning or Brocade Fabric Manager. Zones are locally defined. Names and memberships, with the exception of hosts and targets exported from one fabric to another, do not need to be coordinated with other fabrics. 57

58 Configure LSANS AND ZONING Zones that contain hosts and targets that are shared between the two fabrics need to be explicitly coordinated. Although an LSAN is managed using the same tools as any other zone on the edge fabric, two behaviors distinguish an LSAN from a conventional zone: A required naming convention. The name of an LSAN begins with the prefix LSAN_. The LSAN name is letter case insensitive; for example, lsan_ is equivalent to LSAN_, Lsan_, and so on. Members must be identified by their port WWN because PIDs are not necessarily unique across fabrics. The names of the zones need not be explicitly the same, and membership lists of the zones need not be in the same order. 58

59 Configure LSANS AND ZONING NOTE: If you are managing other switches in a fabric, it is recommended that you run the defzone show command on your Fabric OS v5.1.0 switches as a precaution. Default zoning behavior in Fabric OS v5.1.0 operates differently compared to other Fabric OS versions (for example, versions 2.x, 3.x 4.x and 5.0.1). For example, if you issue the defzone -- noaccess command on a Fabric OS v5.1.0 switch, then default zoning configurations will be created on each switch in the fabric (v2.x, v3.x, v4.x or v5.0.1 switches). Fabric OS v5.1.0 switches do not indicate that a default configuration is enabled when you use the cfgshow or cfgactvshow commands. 59

60 Configure LSANS AND ZONING a. nsshow to list the WWN of the host. The port WWN must be used for LSANs i. Record Host port WWN b. Create The LSAN Zone i. zonecreate lsan_zonename, WWN ii. Creates LSAN_Zone & adds Host c. Add Target member(s) to the LSAN Zone i. zoneadd lsan_zonename, WWN ii. Adds Target to Zone 60

61 Configure LSANS AND ZONING d. Create the LSAN Zone Configuration i. cfgcreate Zone_Cfg, lsan_zone Name e. Verify that the Created LSAN Zones are correct i. cfgshow f. Enable the LSAN Zone Configuration i. cfgenable zone_cfg 61

62 Configure LSANS AND ZONING g. Complete Steps A F on the 2nd Fabric Configuration Second Fabric as previous 62

63 Configure LSANS AND ZONING b. lsanzoneshow s i. Displays the LSAN c. fcrphydevshow i. Displays the physical devices in the LSAN d. fcrproxydevshow i. Displays the Proxy Devices in the LSAN 63

64 Verify LSANS AND ZONING Run the command lsanzoneshow s on each router. The PWWN for the zoned device physically present in the edge fabric will show up in the output with the comment Exist, while the PWWN for the device presented to the edge fabric through the router will show up with the comment Imported. Note that the Exist/Imported relationship to the associated PWWN will be opposite on each router. Verify that the host can see assigned storage 64

65 WAN Analysis Introduced in Fabric OS v5.2.0, WAN analysis tools are designed to estimate the end-to-end IP path performance characteristics between a pair of Brocade FCIP port endpoints. WAN tools include the following commands and options: portcmd ipperf Characterizes end-to-end IP path performance between a pair of Brocade FCIP ports. You can use the WAN tool ipperf only on the FR4-18i or SilkWorm 7500 FCIP ports running Fabric OS v5.2.0 or later software. portshow fciptunnel Displays performance statistics generated from the WAN analysis. 65

66 Perf Terminology s 66

67 Brocade Services Offerings Unmatched Expertise for Ongoing Customer Needs Professional Services and Support: Assess Design Implement Maintain Support 67