Firmware Download. Best Practice Notes. Supporting Fabric OS v4.x and 5.x. Supporting SilkWorm 200E, 3250, 3850, 3900, 4100, 12000, 24000, and 48000

Transcription

1 Firmware Download Best Practice Notes Supporting Fabric OS v4.x and 5.x Supporting SilkWorm 200E, 3250, 3850, 3900, 4100, 12000, 24000, and * * Publication Date: 11/16/2007

2 Copyright 2005, Brocade Communications Systems, Incorporated. ALL RIGHTS RESERVED. Brocade, the Brocade B weave logo, Secure Fabric OS, and SilkWorm are registered trademarks of Brocade Communications Systems, Inc., in the United States and/or in other countries. FICON, IBM BladeCenter are registered trademarks of IBM Corporation in the U.S. and other countries. All other brands, products, or service names are or may be trademarks or service marks of, and are used to identify, products or services of their respective owners. Notice: The information in this document is provided AS IS, without warranty of any kind, including, without limitation, any implied warranty of merchantability, noninfringement or fitness for a particular purpose. Disclosure of information in this material in no way grants a recipient any rights under Brocade's patents, copyrights, trade secrets or other intellectual property rights. Brocade reserves the right to make changes to this document at any time, without notice, and assumes no responsibility for its use. The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with respect to any loss, cost, liability, or damages arising from the information contained in this book or the computer programs that accompany it. Notice: The product described by this document may contain open source software covered by the GNU General Public License or other open source license agreements. To find-out which open source software is included in Brocade products, view the licensing terms applicable to the open source software, and obtain a copy of the programming source code, please visit support/oscd. Export of technical data contained in this document may require an export license from the United States Government. Brocade Communications Systems, Incorporated Corporate Headquarters Brocade Communications Systems, Inc Technology Drive San Jose, CA Tel: Fax: info@brocade.com European and Latin American Headquarters Brocade Communications Switzerland Sàrl Centre Swissair Tour A - 2ème étage 29, Route de l'aéroport Case Postale 105 CH-1215 Genève 15 Switzerland Tel: Fax: emea-info@brocade.com Asia-Pacific Headquarters Brocade Communications Singapore Pte. Ltd. 9 Raffles Place #59-02 Republic Plaza 1 Singapore Tel: Fax: apac-info@brocade.com Document History The following table lists all versions of the Firmware Download Best Practice Notes. Document Title Publication Number Changes Publication Date Firmware Download Best Practice Notes New document. June 2005 Firmware Download Best Practice Notes Updated content. September 2005 Firmware Download Best Practice Notes , Rev. A Added note on page 7 November of 14 Firmware Download Best Practice Notes

3 Firmware Download Best Practice Notes This document describes the best practices for upgrading firmware in a SilkWorm switch, and contains the following topics: Preparing for Firmware Download next Firmware Download Recommendations on page 4 Single CP Firmware Download Procedure on page 6 Validating the Firmware Download on page 9 Troubleshooting on page 10 Configuration Forms on page 12 Preparing for Firmware Download Before you execute a firmware download, be sure to perform the following tasks. In the unlikely event of a failure or timeout, the preparation tasks that are described in this section will enable you to provide Brocade Support all the information required to perform advanced troubleshooting. Note If you are upgrading a SilkWorm director that is configured with two logical domains, perform these steps for both logical switches. 1. Establish a telnet session and log in to the SilkWorm switch. 2. Verify that you have session logging enabled so that the output of your commands is saved to a file. 3. Enter the switchshow command to display switch information. 4. Enter the portcfgshow command to display current switch port settings. 5. Enter the nsshow command to display the total number of devices in the switch local Name Server database. 6. Enter the nsallshow command to display the total number of devices in the switch global Name Server database. 7. Enter the fabricshow command to display the total number of domains in the fabric. If you are changing a dual domain SilkWorm director to a single domain SilkWorm director this value will be one domain less after the operation. 8. Display the MIB configuration information using the snmpmibcabshow or agtcfgshow commands. 9. Upload the switch configuration settings to an FTP server using the configupload command. Firmware Download Best Practice Notes 3 of 14

4 10. Enter the supportshow and supportsave commands (these commands are version dependent) to provide baseline information for advanced support. The supportshow command outputs a large amount of data that you can browse, and the supportsave command produces a file that can only be viewed by your switch service provider. Make sure that you enter the supportsave command on the standby CP (in SilkWorm 12000, 24000) as well. Note If you do not know the CP address, use the ipaddrshow command to view a list of all CP IP addresses associated with the switch. 11. Establish a telnet session with the standby CP and execute the savecore (on both the active and standby CPs) and supportsave commands (versions v4.4.0 and later for supportsave) and remove all extra core files prior to executing the firmware download. Firmware Download Recommendations This section contains specific recommendations for upgrading firmware on a SilkWorm switch or director. For firmware download procedures, see the Fabric OS Administrator s Guide. General Recommendations Below are general recommendations when upgrading the firmware on a SilkWorm switch: Before you enter the firmwaredownload command, read the release notes for the new firmware to find out if there are any firmware download issues. For advanced users who administer production environments, use firmwaredownload -s -n if you want to control the download process with more precision, and if: - You want to test drive a new version of firmware with the intension of restoring to the original firmware afterwards. - The existing switch firmware is older than v The existing switch firmware and the test drive switch firmware are more than two releases apart. - In a director switch, the two CPs have different versions of firmware. - In a director switch, the two CPs are not in HA synchronization. Brocade supports firmware upgrades within two feature releases (a feature release is a major release indicated by the second digit "Y" of the release number, for example, X.Y.Z); while upgrades of two releases is supported, single release upgrades are recommended. Following are the major upgrade versions for the Fabric OS: - v4.0 - v4.1 - v4.2 - v v v5.1.0 On initial setup of a factory-delivered switch, make sure that all IP address have been set and the switch has been rebooted prior to running a firmware download. 4 of 14 Firmware Download Best Practice Notes

5 If you get an error stating that the plist file cannot be found, make sure you have entered the path correctly. When you enter the firmwaredownload command, the root directory of the firmware distribution must be entered even though the directory does not contain a release.plist file. Also, review the release notes to ensure that your platform is supported for the release. Open a serial connection to the switch, and enable session logging during the firmware download to monitor the process. For improved support, use the serial console to perform the firmware upgrade or downgrade because additional realtime information is sent to the console (which can expedite problem diagnosis). Note that a serial console session is always CP-specific, whereas a telnet session always logs into the active CP. FTP Server Recommendations The firmwaredownload command has a timeout of ten minutes for v4.0 and v4.1 and thirty minutes for v4.2 and above. The following notes may be of help if you are having problems with the firmware download timing out before the process is complete: If you encounter a cannot find.plist message, verify on the FTP server that the path to the firmware download archive is entered using the correct case (that is, the capitalization of directories used in the path). Verify that you can ping the FTP server from another host on the LAN, prior to running the upgrade. Disable any firewall or anti-virus applications on the FTP server. Remove any Ethernet hub between the FTP server and the switch. Optionally set the switch's autonegotiating Ethernet port to match the speed and duplex setting of the IP environment (for example, enter the ifmodeset command to change the switch settings to match both ends of the Ethernet link. Enter help ifmodeset and help ifmodeshow on the switch to view more details about these commands). Enable session logging on the FTP server so that the log can be viewed during the execution of the firmwaredownload command. Set the FTP server's timeout value to sixty minutes. Ensure that the unzip process created SWBDxx folders in the main folder. If the files are unpacked without folder creation, then the firmwaredownload command will be unable to locate the.plist file. SilkWorm Director Recommendations The following recommendations are for SilkWorm directors: Verify that you can use telnet to access each CP. Enter the ipaddrshow command to list all assigned IP addresses for the switch. Do not attempt to perform a firmware downgrade from to when you have a zone configuration larger than 128K. If test driving do not enable new features in a different version and then attempt to downgrade.the older firmware may not be able to handle the newer settings. If your fabric is set to the extended edge PID format and you want to downgrade to an older Fabric OS version that does not support extended edge, you must change the PID to a supported format. For more information about PID formats, refer to the Fabric OS Administrator s Guide. Firmware Download Best Practice Notes 5 of 14

6 Use the hashow command to verify that your CPs are synchronized prior to running a firmware download. If the CPs are not in sync run the hasyncstart command. If the problem persists, review Troubleshooting on page 10; If the troubleshooting information fails to help you resolve the issue, contact your switch service provider. Open a serial connection to both CPs and enable session logging during the firmware download to monitor progress. Use the savecore command to save any session log files and then delete them from the switch. Using the savecore command is the only way to remove core files; in this way you can make more space available (To remove all core files in all directories, you can use the savecore -R command). Use the supportsave command (v4.4.0 and above) to create a snapshot of the switch before starting a firmware download operation. Single CP Firmware Download Procedure This procedure enables you to perform a firmware download on each CP and verify that the procedure was successful before committing to the new firmware. The old firmware is saved in the secondary partition of each CP until you enter the firmwarecommit command. If you decide to back out of the installation prior to the firmwarecommit you can enter the firmwarerestore command to restore the old firmware version. Typically, users upgrade or downgrade firmware to briefly test drive a new (or old) version and then optionally restore the original firmware. Testing a new version of firmware in this manner ensures that you do not compromise your existing firmware because the test drive version uses a partition on your standby CP. Note Brocade recommends that under normal operating conditions you maintain the same firmware version on both CPs, and on both partitions of each CP. This procedure enables you to test a firmware download before you commit; however, you should not run mixed firmware levels on CPs as a standard practice. For enhanced support, ensure that all serial consoles (both CPs for bladed products) and all telnet sessions are logged and included with any trouble reports. 1. Prepare a. Start a telnet session to the Brocade logical switch IP address. b. Enter the ipaddrshow command and note the address of CP0 and CP1. c. Enter the hashow command and note which CP is active and which CP is standby. Verify that both CPs are in sync. If the CPs are not in sync, refer to Troubleshooting on page 10. If you still cannot synchronize the CPs, contact your service provider. d. Enter the firmwareshow command and confirm that the current firmware on both partitions on both CPs is as expected. e. Exit the telnet session. 6 of 14 Firmware Download Best Practice Notes

7 2. Update firmware on standby CP a. Start a telnet session or connect though the serial port to the standby CP. b. Enter the firmwaredownload -s command. When prompted respond as follows: Answer Y to perform a full install. Answer N to autocommit Answer N to reboot system. At this point the firmware should download to the standby CP only. c. When finished, enter the firmwareshow command to confirm that the secondary partition of the standby CP contains the new firmware. d. Enter the reboot command on standby CP. The telnet session is disconnected automatically. Note The message System going down for reboot now! appears, however the director is not shutting down. Do not be mislead by this message the director will reboot the standby CP only and the active CP will continue to pass traffic. 3. Failover to standby CP a. Start a telnet session on the active CP. b. Enter the hashow command to get status of standby CP. c. Once the standby CP is reporting status, run the firmwareshow command to confirm the standby CP has new firmware in primary partition and previous firmware in the secondary partition. d. Enter the hashow command to verify that HA synchronization is complete. e. Enter the hafailover command. f. The telnet session is disconnected automatically. At this point the active and standby functions have changed CPs. 4. Verify failover a. Start a telnet session on the active CP. b. Enter the hashow command and confirm the CP is in active role. c. Enter the hashow command until the standby CP is reporting. It will take a minute or two for the standby CP to reboot and synchronize with the active CP. d. Exit the telnet session. e. The upgraded (or downgraded) version of firmware is now running on the active CP (you can confirm this by entering the firmwareshow command). Also, make sure that servers using the fabric can access their storage devices. 5. Update firmware on standby CP a. Start a telnet session on the standby CP. b. Enter the hashow command to confirm connection to the standby CP and also to confirm that the CPs are in sync. Firmware Download Best Practice Notes 7 of 14

8 c. Enter the firmwaredownload -s command. When prompted respond as follows: Enter Y to perform a full install. Enter N to autocommit. Enter N to reboot the system. At this point, the firmware should download to the standby CP only. d. After the firmware has been downloaded to the standby CP, enter the firmwareshow command to confirm that the secondary partition of standby CP contains the new firmware. e. Enter the reboot command on the standby CP. The telnet session is disconnected automatically. Note Stop! If you wish to restore the firmware, stop here and skip ahead to step 8; otherwise, continue to step 6 to commit the firmware on both CPs. 6. Perform commit on standby CP a. Wait 5 minutes to ensure the firmware download is complete. b. Start a telnet session on the standby CP. c. Enter the firmwareshow command and confirm both CPs have the new Fabric OS version in the primary partition, and the old Fabric OS version in the secondary partition. d. Enter the firmwarecommit command to update the secondary partition with new firmware. e. Enter the firmwareshow command to confirm the update. f. Exit the telnet session. 7. Perform commit on active CP a. Start a telnet session on the active CP. b. Enter the firmwareshow command and confirm that only the active CP secondary partition contains the old firmware. c. Enter the firmwarecommit command to update the secondary partition with new firmware. d. Enter the firmwareshow command to confirm both partitions on both CPs contain the new firmware. e. Enter the hashow command to confirm that the HA state is in sync. Note that it takes several minutes to complete the commit operation and see the new firmware after entering the firmwareshow command. f. Exit the telnet session. Note Stop! If you have completed step 7, then you have committed the firmware on both CPs and you have completed the firmware download procedure. Steps 8-10 describe how to restore the original firmware, and should be performed after step 5. 8 of 14 Firmware Download Best Practice Notes

9 8. Restore the firmware a. Start a telnet session on the standby CP and enter the firmwarerestore command. The session will end and both partitions will be made equal after several minutes. 9. Perform hafailover on active CP a. Start a telnet session on the active CP. Enter the hashow command until you can see that the CPs are in sync. b. Enter the hafailover command. Your switch is now running the original firmware. 10. Restore firmware on the new standby CP a. Start a telnet session on the new standby CP (the former standby CP is now your active CP) and enter the firmwarerestore command. The session will end and both partitions will be made equal after several minutes. Your system is now restored to the original partitions on both CPs. Verifying Compact Flash Usage Prior to executing the firmwaredownload command on a SilkWorm director, verify that there is enough room on the compact flash: 1. Open a telnet or hyperterminal session to the switch that supports session logging. 2. Enable logging on the session so that the output is saved to a file. 3. Enter the supportshow command. 4. Search the file for the following information: /bin/df: Filesystem 1k-blocks Used Available Use% Mounted on /dev/root % / /dev/hda % /mnt 5. Verify that the compact flash usage is not above 90%. 6. If the compact flash usage is above 90%, enter the savecore command to clear any excess core files. Validating the Firmware Download Validate the firmware download by running the following commands: firmwareshow, nsshow, nsallshow, and fabricshow. All of the connected servers, storage, and switches should be present in the output of these commands. If there is a discrepancy, it is possible that a device or switch cannot connect to the fabric and further troubleshooting is necessary. firmwareshow Displays the current firmware level on the switch. For SilkWorm directors this command displays the firmware loaded on both partitions (primary and secondary) for both CPs. Brocade recommends that you maintain the same firmware level on both partitions of each CP within the SilkWorm director. Firmware Download Best Practice Notes 9 of 14

10 nsshow nsallshow fabricshow Displays all devices directly connected to the switch that have logged into the Name Server. Make sure the number of attached devices after the firmware download is exactly the same as the number of attached devices prior to the firmware download. Displays all connected devices to a fabric. Make sure the number of attached devices after the firmware download is exactly the same as the number of attached devices prior to the firmware download. Displays all switches in a fabric. Make sure the number of switches in the fabric after the firmware download is exactly the same as the number of attached devices prior to the firmware download. Troubleshooting Good troubleshooting practices for firmware download should begin before you start the procedure, and include: Keep all telnet session and serial console logs. Enter the supportsave (for Fabric OS v4.4.0 or 5.0.1; for Fabric OS 4.2 or earlier, enter supportshow) command after completion of the firmware download. Ensure that you save all support information gathered at the start of the procedure. If a problem persists, enter the supportsave command again, and package together all of the information (the telnet session logs and serial console logs, output from the supportsave command) for support. Synchronizing Firmware Versions on CPs If you end up with different versions of firmware on your CPs, for example, CP0 is running v5.0.1 on the primary and secondary partitions, and CP1 is running v4.4.0e on the primary and secondary partition, then synchronize them as follows: 1. Start a telnet session on the CP that is out of sync. 2. Enter the firmwaredownload -sb command. The commit is automatic after the reboot. Caution If CP1 is the active CP, then the firmware download could be disruptive. 10 of 14 Firmware Download Best Practice Notes

11 Synchronizing Firmware Versions on Partitions If you end up with different versions of firmware on one of your partitions, for example, CP0 is running v5.0.1 on the primary and secondary partitions, and CP1 is running v5.0.1 on the primary partition and v4.4.0e on the secondary partition, then synchronize the partitions on CP1 as follows: 1. Start a telnet session on the CP with the out-of-sync partitions. 2. Enter the firmwarecommit command, which will copy the primary partition to the secondary partition. If you wish to make the secondary partition match the primary, then enter the firmwaredownload -sf command using the same version that is contained in the secondary partition; if this fails to synchronize the partitions, then contact your switch service provider. Note When you enter the firmwarecommit command, the secondary becomes the primary because the primary is copied over the secondary. For example, if the secondary partition is v4.4.0e, and the primary is v5.0.1, and you wish to have v5.0.1 running on both, then entering the firmwaredownload command with v5.0.1 will result in both partitions running v5.0.1 If there is a discrepancy in the number of switches or attached devices in the fabric after a firmware download it may be due to a fabric segmentation or a device that failed to log in. For assistance refer to the following: The Troubleshooting chapter in the Fabric OS Administrator s Guide for basic troubleshooting steps. Call your switch service provider. The following section provides forms for recording configuration information prior to the firmware download. The port setting tables can be used on 16- and 32- port blades to record configuration information. Firmware Download Best Practice Notes 11 of 14

12 Configuration Forms Use the following forms as a hardcopy reference for your configuration information. Table 1 SilkWorm Configuration and Connection SilkWorm Configuration Settings IP address Gateway address chassisconfig Option Management Connections Serial cable tag Ethernet cable tag Configuration Information Domain ID Switch Name Ethernet IP Address Ethernet Subnetmask Total number of local devices (nsshow) Total number of devices in fabric (nsallshow) Total number of switches in the fabric (fabricshow) 12 of 14 Firmware Download Best Practice Notes

13 Table 2 FC Port Configuration Device connected Speed SilkWorm FC Port Configuration Setting Port Numbers Trunk Long Distance VC Link Init Locked L_Port Locked G_Port Disable E-Port MCast loopback Delay Flogi ISL R_RDY mode Persistent disable Firmware Download Best Practice Notes 13 of 14

14 Table 3 FC Port Configuration Device connected Speed SilkWorm FC Port Configuration Setting Port Numbers Trunk Long Distance VC Link Init Locked L_Port Locked G_Port Disable E-Port MCast loopback Delay Flogi ISL R_RDY mode Persistent disable 14 of 14 Firmware Download Best Practice Notes