Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.3

Transcription

1 Release Notes for Cisco High-Performance Subnet Manager (HSM) Release 1.3 Release Date: March 17, 2009 Contents This document contains the following sections: Contents, page 1 Introduction, page 1 System Requirements, page 1 New and Changed Information, page 3 Caveats, page 6 Related Documentation, page 7 Service and Support, page 7 Obtaining Documentation and Submitting a Service Request, page 8 Introduction These release notes describe the features and known issues for the Cisco High-Performance Subnet Manager (HSM) 1.3. System Requirements This section describes the system requirements for this software release. Cisco supports HSM with all existing Cisco InfiniBand HCAs, Cisco InfiniBand switches, and Cisco Ethernet and Fibre Channel gateways. Americas Headquarters: Cisco Systems, Inc., 170 West Tasman Drive, San Jose, CA USA

2 System Requirements HSM requires that Cisco OFED 1.3 or higher, or Cisco Commercial InfiniBand host drivers are installed before installing HSM. Determining the Software Version If InfiniBand drivers are already installed on the host, they may be installed in one of several locations. To determine the version of the Cisco InfiniBand host drivers, log in to the host and enter the following commands at the shell prompt. If the first command produces output, the Cisco Commercial InfiniBand host drivers are installed. If the second or third commands produce a version number, OFED host drivers are installed. host$ rpm -qa grep topspin topspin-ib-mpi-rhel topspin-ib-mod-rhel elsmp topspin-ib-rhel host$ ofed_info grep OFED OFED-1.2 host$ grep OFED /usr/local/ofed/build_id OFED-1.0 To determine the version of the HSM, start the CLI and enter the show version command. ib_sm> show version Cisco High-Performance IB Subnet Manager 1.3. To determine the version of the Server Fabric Switch firmware, log in to the CLI and enter the show version EXEC command. SFS-7000P> show version ========================================================================= System Version Information ========================================================================= system-version : SFS-7000D TopspinOS releng #170 contact : tac@cisco.com name : SFS-7000P Upgrading to a New Software Release To verify that you are running the latest available release, compare your version against the latest version on the Cisco support website. After registering your product, you should have received a username and password that grant you access to this site. Old and new HSM releases can be used in the same InfiniBand fabric, although InfiniBand subnet manager synchronization will not occur between HSM 1.3 and HSM releases earlier than 1.3. For general information about upgrading to a new software release, see the Installing the Cisco High-Performance Subnet Manager section in the Cisco High-Performance Subnet Manager for InfiniBand Server Switches document. 2

3 New and Changed Information New and Changed Information HSM 1.3 is a release containing bug fixes only. Changes From HSM (build 161) to HSM 1.3 (build 165) This section describes the new features and resolved caveats since the HSM release. Note The ID number from the Cisco Defect Tracking System, if applicable, is included with this format: CSCxxyyyyy. The current status of all issues is available online at Contact Cisco Technical Support for more information. General CSCsl49070 HSM 1.3 requires OFED 1.3 or higher. When running HSM 1.3 on an older OFED release, HSM exits after startup, after the logging the message: Current OFED stack ABI is not supported. Please upgrade your OFED stack to version 1.3 or later. Also, when starting the HSM 1.3 via the /etc/init.d/ib_sm startup script, it now reports status FAILED instead of OK if using an OFED that is too old. Running HSM or lower on OFED 1.3 will produce the following benign syslog messages: user_mad: process ib_sm did not enable P_Key index support. user_mad: Documentation/infiniband/user_mad.txt has info on the new ABI. InfiniBand CSCtp06566 HSM now allows up to 20K multicast groups on 1024 MLIDs. Previously HSM was restricted to 512 multicast groups and 512 MLIDs. This allows HSM to support large OFED installations that use IPoIB (which requires IPv6), because each host is assigned a unique multicast group for IPv6 solicited node neighbor discovery. Before this, HSM could not support subnets with more than approximately 510 IPoIB hosts. 3

4 New and Changed Information Changes From HSM 1.2 (build 152) to HSM (build 161) This section describes the new features and resolved caveats since the HSM 1.2 release. General InfiniBand CSCsk95809 The maximum number of concurrent CLI sessions has been increased from 3 to 20, and has been made tunable via command-line parameters. CSCsl86900 Support has been added for correctly managing InfiniBand fabrics that include the Cisco SFS 3504 Multifabric Server Switch. CSCsl87074 Support has been added for correctly managing InfiniBand fabrics that include the Dell PowerEdge M1000e modular blade chassis. CSCsl47289 Support has been added for excluding IB ports that are down from the Performance Manager output. This feature adds a new config pm monitor downed-port-access CLI command. Note This new CLI command is not documented in the HSM 1.2 Cisco High-Performance Subnet Manager for InfiniBand Server Switches documentation. CSCsl47258 A problem has been fixed where the Performance Manager reported incorrect cumulative counters on the Cisco SFS 7012/7012D/7024/7024D Server Switch and the Cisco M SFS7000E Switch. CSCsl47303 A problem has been fixed where the Subnet Manager might not correctly program a switch that was reset while an InfiniBand fabric sweep was in progress. CSCsl48328 A problem has been fixed where the Subnet Manager might fail if an OFED host failed to return a response InfiniBand packet for a management transaction. CSCsk95757 A problem has been fixed where the Subnet Manager would become temporarily unresponsive while processing a large number of multicast groups. CSCsk41319 A problem has been fixed where the portmask output from the show mft CLI command was incorrect. CSCsi75556 A problem has been fixed where the Subnet Manager log information was not clear when subnet manager synchronization failed due to incompatible Subnet Manager versions. 4

5 New and Changed Information CSCsk66190 A problem has been fixed where the Subnet Manager did not properly handle PathRecord and MultiPathRecord SA queries that specify the tclass in the request. CSCsk05195 A problem has been fixed where the Subnet Manager would become temporarily unresponsive while processing SL-to-VL mapping table and VL arbitration table CLI commands. CSCsj51866 A problem has been fixed where the Subnet Manager log information was not clear when the Subnet Manager failed to start due to incorrect command-line arguments. CSCsj79514 A problem has been fixed where the Subnet Manager would fail if a node M_Key was not set properly. CSCsj32775 A problem has been fixed where the Subnet Manager might not correctly synchronize when using multiple standby Subnet Managers. Changes From HSM 1.1 (build 99) to HSM 1.2 (build 152) This section describes the new features and resolved caveats since the HSM 1.1 release. General InfiniBand CSCsh89582 Support has been added for running HSM on OFED 1.2 or OFED 1.1. CSCsg93161 Support has been added for Switched Port Analyzer (SPAN), also known as port mirroring. This feature adds a new span CLI command that enables users to mirror the packets ingressing one switch port to another port on that switch. By connecting an IB analyzer, users can capture and view the mirrored packets. Note that there are several restrictions to SPAN at this time: SPAN can mirror traffic onto ports on the SAME switch chip only. SPAN ports cannot have SMs running on them. SPAN is not supported by the SFS 3001 and SFS 3012 Server Switches. CSCsg71493 Support has been added for configuring low-level Quality of Service (QoS). This feature adds new CLI commands to configure SL-to-VL mapping tables and VL arbitration tables. CSCsg39670 Support has been added for IB SM synchronization between one master SM and two standby SMs. Previously, only one standby was allowed. 5

6 Caveats CSCsh89714 A problem has been fixed where the path MTU and rate returned in a PathRecord query could be set incorrectly, resulting in low throughput, especially for paths traversing DDR IB links. CSCse94345 A problem has been fixed where a deadlock could arise caused by a temporary InfiniBand packet credit loop while rerouting a network. The solution was to change the default packet lifetime from infinite (never discard) to approximately one second. CSCse95216 Support has been added for disabling IPoIB on an InfiniBand partition. This feature can be used to increase security on the default IB partition FFFF. Note that in TopspinOS the mgmt-ib management InfiniBand interface cannot be used with a non-default IB partition. CSCsd83004 Support has been added for routing around InfiniBand components that need maintenance. This feature adds a new route-around CLI command that isolates the component without disrupting traffic. CSCse38656 Support has been added for automatically determining the maximum number of hops (depth) that the Subnet Manager has to search when configuring the InfiniBand fabric. This feature adds a new value 0 to the max-hops CLI configure command, which will cause the Subnet Manager to optimize IB paths for shortest distance. CSCsg15550 A problem has been fixed where the CLI show neighbor command could show incorrect information. CSCsh48444 A problem has been fixed where the Subnet Manager did not always set the Attribute Offset in GetTable Response IB protocol messages. Caveats This section describes the limitations of this release. CSCsj88975 HSM is not supported running on OFED ppc64. Using non-cisco Subnet Managers on an InfiniBand fabric is not supported. The High-Performance Subnet Manager fails to initialize when there is a problem executing the startup cmd-file (such as an invalid file name, bad file permissions, or syntactic errors in the file). Users must search the syslog for error messages. Command line editing syntax is not permitted in cmd-file syntax. The HSM is not supported by VFrame. The HSM will synchronize with other instances of the HSM, but it will not synchronize with a switch-based Subnet Manager since the two products are aimed at different market segments and have different capabilities. 6

7 Related Documentation Related Documentation The following list describes the documentation available with HSM 1.3, which is available in electronic form and printed form upon request. Note Documentation is included on the HSM 1.3 CD Image. You can download the latest documentation updates on the Cisco support site at Cisco High-Performance Subnet Manager for InfiniBand Server Switches Release Notes for TopspinOS Release Cisco SFS Product Family Chassis Manager User Guide Cisco SFS Product Family Element Manager User Guide Cisco SFS Product Family Command Reference Guide Service and Support For additional support, you must first register your product at After registering, you may contact your supplier for support, or contact Cisco directly. Refer to the Obtaining Documentation and Submitting a Service Request section on page 8 in this document. When you call Cisco Technical Support or use the Cisco Technical Support website at be prepared to provide the following information to support personnel: General Information Technical Support registration number, if applicable Error messages received Detailed description of the problem and specific questions Description of any troubleshooting steps already performed and results Server Configuration Type of server, chip set, CPU, amount of RAM, and number of nodes Attached storage devices (output from cat /proc/scsi/scsi) InfiniBand configuration (output from /usr/local/topspin/sbin/hca_self_test) Chassis Configuration Chassis model Output from the show running-status all command Chassis Serial Number The chassis serial number and corresponding bar code are provided on the serial number label, as shown in this example: 7

8 Obtaining Documentation and Submitting a Service Request Model: TS360 SN UST323XXXXXXXXX This chassis serial number can be found on the bottom of the chassis or the outside of the chassis box packaging. It can also be found in the output of the show backplane command. Obtaining Documentation and Submitting a Service Request For information on obtaining documentation, submitting a service request, and gathering additional information, see the monthly What s New in Cisco Product Documentation, which also lists all new and revised Cisco technical documentation, at: Subscribe to the What s New in Cisco Product Documentation as a Really Simple Syndication (RSS) feed and set content to be delivered directly to your desktop using a reader application. The RSS feeds are a free service and Cisco currently supports RSS version 2.0. This document is to be used in conjunction with the documents listed in the Related Documentation section. CCDE, CCENT, Cisco Eos, Cisco HealthPresence, the Cisco logo, Cisco Lumin, Cisco Nexus, Cisco StadiumVision, Cisco TelePresence, Cisco WebEx, DCE, and Welcome to the Human Network are trademarks; Changing the Way We Work, Live, Play, and Learn and Cisco Store are service marks; and Access Registrar, Aironet, AsyncOS, Bringing the Meeting To You, Catalyst, CCDA, CCDP, CCIE, CCIP, CCNA, CCNP, CCSP, CCVP, Cisco, the Cisco Certified Internetwork Expert logo, Cisco IOS, Cisco Press, Cisco Systems, Cisco Systems Capital, the Cisco Systems logo, Cisco Unity, Collaboration Without Limitation, EtherFast, EtherSwitch, Event Center, Fast Step, Follow Me Browsing, FormShare, GigaDrive, HomeLink, Internet Quotient, IOS, iphone, iquick Study, IronPort, the IronPort logo, LightStream, Linksys, MediaTone, MeetingPlace, MeetingPlace Chime Sound, MGX, Networkers, Networking Academy, Network Registrar, PCNow, PIX, PowerPanels, ProConnect, ScriptShare, SenderBase, SMARTnet, Spectrum Expert, StackWise, The Fastest Way to Increase Your Internet Quotient, TransPath, WebEx, and the WebEx logo are registered trademarks of Cisco Systems, Inc. and/or its affiliates in the United States and certain other countries. All other trademarks mentioned in this document or website are the property of their respective owners. The use of the word partner does not imply a partnership relationship between Cisco and any other company. (0812R) Any Internet Protocol (IP) addresses used in this document are not intended to be actual addresses. Any examples, command display output, and figures included in the document are shown for illustrative purposes only. Any use of actual IP addresses in illustrative content is unintentional and coincidental Cisco Systems, Inc. All rights reserved. 8