HP InfiniBand Options for HP ProLiant and Integrity Servers Overview

Transcription

1 Overview HP supports 40Gbps 4x Quad Data Rate (QDR) and 20Gbps 4X Double Data Rate (DDR) InfiniBand products that include Host Channel Adapters (HCA), switches, and cables for HP ProLiant servers, and HP Integrity servers. For details on the InfiniBand support for HP BladeSystem c-class and server blades, please refer to the HP InfiniBand for HP BladeSystem c-class QuickSpecs at: HP supports InfiniBand Products from InfiniBand technology partners Mellanox, Voltaire and QLogic. The following InfiniBand products based on Mellanox technologies are available from HP HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA HP IB 4X DDR PCI-e Dual-port HCA Mellanox IB 4X QDR 324-port switch The HP IB 4X QDR CX-2 PCI-e G2 Dual-port and DDR CX-2 PCI-e G2 Dual-port HCAs are based on the Mellanox ConnectX-2 IB technology. The HP IB 4X DDR PCI-e Dual-port is based on the Mellanox InfiniHost III technology. The Mellanox ConnectX-2 InfiniBand technology delivers low-latency and high-bandwidth for performance-driven server and storage clustering applications in High-performance computing (HPC), and enterprise data centers. Parallelized HPC applications, clustered data bases, and latency and bandwidth sensitive transactional services will achieve significant performance improvements resulting in reduced completion time and lower cost per operation. InfiniBand host stack software (driver) is required to run on servers connected to the InfiniBand fabric. For HCAs based on Mellanox technologies, HP supports Mellanox OFED driver stacks on Linux 64-bit operating systems, and Mellanox WinOF driver stack on Microsoft Windows (HPC) server The Mellanox IB 4X QDR 324-port switch is the MTS3610 chassis switch that provides the high performance fabric solution by delivering high bandwidth and low-latency to Enterprise Data Centers and High-Performance Computing environments in a compact 19RU chassis. An InfiniBand fabric is constructed with one or more InfiniBand switches connected via inter-switch links. The most commonly deployed fabric topology is a fat tree or its variations. A subnet manager is required to manage an InfiniBand fabric. OpenSM is a host-based subnet manager that runs on a server connected to the InfiniBand fabric. Mellanox OFED software stack includes OpenSM for Linux, and Mellanox WinOF includes OpenSM for Windows. For comprehensive management and monitoring capabilities, Mellanox FabricIT is recommended for managing the InfiniBand fabric based on Mellanox InfiniBand products. The following InfiniBand products based on Voltaire technologies are available from HP Voltaire IB 4X QDR 36-port switch Voltaire IB 4X QDR 324-port director switch Voltaire IB 4X DDR 24-port internally managed, and externally managed switches Voltaire IB 4X DDR 96- port and 288-port DDR director switches Voltaire IB 4X QDR 36-port switch is an internally managed switch. Voltaire IB 4X 324-port switch is a director-class switch that features 324 ports of 40 Gb/s InfiniBand connectivity in a 19U chassis. With Voltaire HyperScale technology, two 324-port switches configured with 648P fabric boards can be connected via CXP cables to form a 648-port 4X QDR switch. For HCAs based on Mellanox technologies, HP supports Voltaire OFED driver stacks on Linux 64-bit operating systems, when Voltaire switches are used in the solution. A right-to-use (RTU) license is required for Voltaire OFED driver stack. A subnet manager is DA Worldwide Version 9 December 8, 2009 Page 1

2 Overview required to manage an InfiniBand fabric. For comprehensive management and monitoring capabilities, Voltaire Unified Fabric Manager (UFM) is recommended for managing the InfiniBand fabric based on Voltaire InfiniBand switch products and Mellanox HCA products with Voltaire OFED stack. The following InfiniBand products based on QLogic technologies are available from HP QLogic IB 4X QDR PCI-e G2 Dual-port HCA QLogic IB 4X QDR 36-port Switch QLogic IB 4X QDR 324-Port Switch QLogic IB 4X QDR 648-Port Switch The QLogic IB 4X QDR HCA is part of the QLogic family of InfiniBand Host Channel Adapters based on the TrueScale ASIC architecture. It has a unique hardware architecture that delivers unprecedented levels of performance, reliability, and scalability, making it an ideal solution for highly scaled High Performance Computing (HPC) and high throughput, low-latency enterprise applications. InfiniBand host stack software (driver) is required to run on servers connected to the InfiniBand fabric. For HCAs based on QLogic technology, HP supports QLogic OFED driver stacks on Linux 64-bit operating systems. QLogic IB 4X QDR 36 Port Switch, QLogic IB 4X QDR 324 Port Switch and QLogic IB 4X QDR 648 Port Switch are based on QLogic TrueScale technology. The QLogic 36-port switch supports QLogic BLc 4X QDR IB Management Module ( B21). QLogic 324- and 648-port switch chassis are configurable: with the QLogic 18-port high performance leaf modules, they can be configured to support up to 324 and 648 ports, respectively; with the QLogic 24-port high density leaf modules, they can be configured to support up to 432 and 864 ports, respectively, with 2:1 oversubscribed bandwidth on the backplane. An InfiniBand fabric is constructed with one or more InfiniBand switches connected via inter-switch links. The most commonly deployed fabric topology is a fat tree or its variations. A subnet manager is required to manage an InfiniBand fabric. OpenSM is a host-based subnet manager that runs on a server connected to the InfiniBand fabric. QLogic OFED software stack includes OpenSM for Linux. For comprehensive management and monitoring capability, QLogic InfiniBand Fabric Suite (IFS) is recommended for managing the InfiniBand fabric based on QLogic InfiniBand products. HP supports InfiniBand copper and fiber optic cables with CX4 to CX4, CX4 to QSFP, and QSFP to QSFP connectors. The CX4 to CX4 copper cables range from 0.5M to 8M for HCA to switch, or inter-switch links at DDR speed, and up to 12M for certain interswitch links at DDR speed. The CX4 to CX4 fiber optic cables range from 1M to 100M for HCA to switch, or inter-switch links at DDR speed. Please note that only 12 ports on Voltaire 24-port DDR switches support fiber optic cables. The CX4 to QSFP copper cables range from 1M to 5M for HCA to switch, or inter-switch links at either DDR or QDR speed. The QSFP to QSFP copper cables range from 1M to 7M for HCA to switch, or inter-switch links at either DDR or QDR speed (please note that QLogic QDR switches only support up to 5 meters at QDR speed), and up to 10M at DDR speed. The QSFP to QSFP fiber optic cables range from 3M to 30M for HCA to switch, or inter-switch links at either DDR or QDR speed. DA Worldwide Version 9 December 8, 2009 Page 2

3 Overview What's New InfiniBand Adapters HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA QLogic IB 4X QDR PCI-e G2 Dual-port HCA InfiniBand switches Voltaire IB 4X QDR 324-port director switch QLogic IB 4X QDR 36 Port Switch QLogic IB 4X QDR 324 Port Switch QLogic IB 4X QDR 648 Port Switch InfiniBand management software suites Voltaire Unified Fabric Manager (UFM) Mellanox FabricIT QLogic InfiniBand Fabric Suite (IFS) At A Glance InfiniBand HCA cards based on Mellanox technologies HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA Dual QSFP ports 4X QDR InfiniBand card based on ConnectX-2 technology Support PCI Express 2.0 x8 Support the following ProLiant servers: SL160z G6, SL170z G6, SL2x170z G6, DL170h G6, DL2x170h G6, DL4x170h G6, DL160 G6, DL180 G6, DL360 G6, DL380 G6 Support Mellanox OFED and Voltaire OFED Linux driver stacks, and Mellanox WinOF on Microsoft Windows HPC server 2008 HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA Dual CX4 ports 4X DDR InfiniBand card based on the ConnectX-2 technology Support PCI Express 2.0 x8 Support the following ProLiant servers: SL160z G6, SL170z G6, SL2x170z G6, DL170h G6, DL2x170h G6, DL4x170h G6, DL160 G6, DL180 G6, DL360 G6, DL380 G6 Support Mellanox OFED and Voltaire OFED Linux driver stacks, and Mellanox WinOF on Microsoft Windows HPC server 2008 HP IB 4X DDR PCI-e Dual-port HCA Dual CX4 ports 4X DDR InfiniBand card with128 MB memory, based on InfiniHost III EX technology Support PCI Express x8 Support the following ProLiant and Integrity servers: DL160 G6, DL360 G6, DL160 G5, DL165 G5, DL180 G5, DL185 G5, DL360 G5, DL365, DL365 G5, DL380 G5, DL385 G5p, DL580 G5, DL585 G5, DL785 G5 rx2660, rx3600 Support Voltaire OFED and Mellanox OFED Linux driver stacks, and Mellanox WinOF 2.0 on Microsoft Windows HPC server 2008 (ProLiant servers only) InfiniBand HCA cards based on QLogic technology QLogic IB 4X QDR PCI-e G2 Dual-port HCA Dual QSFP ports 4X QDR InfiniBand card based on QLogic TrueScale InfiniBand Support PCI Express 2.0 x8 Support the following ProLiant servers: SL160z G6, SL170z G6, SL2x170z G6, DL170h G6, DL2x170h G6, DL4x170h G6, DL160 G6, DL180 G6, DL360 G6, DL380 G6 Support QLogic OFED Linux driver stack DA Worldwide Version 9 December 8, 2009 Page 3

4 Overview InfiniBand switches based on Mellanox technology Mellanox IB 4X QDR 324-port switch 19U, 19" rack mountable chassis, configurable redundant management module, redundant (N+2) power supplies, up to port InfiniBand QDR line boards Up to 324 4X QDR QSFP ports, support 4X QDR InfiniBand copper, active copper, and fiber optic cables InfiniBand switches based on Voltaire technology Voltaire IB 4X QDR 36-port Internally managed switch 36 4X QDR QSFP ports, support 4X QDR InfiniBand copper, active copper, and fiber optics cables Voltaire IB 4X QDR 324-port director switch 19U, 19" rack mountable chassis with up to 9 fabric boards, up to port line board, up to 2 redundant modules, 2 redundant power supplies, 3 fan units Up to 324 4X QDR QSFP ports with 324P fabric boards, or up to 648 4X QDR QSFP ports with 648P fabric boards with 108 CPX cables, support 4X QDR InfiniBand copper, active, copper, and fiber optic cables Voltaire IB 4X DDR 24-port Externally Managed Switch 24 4X DDR CX4 ports, support 4X DDR InfiniBand copper cables, and optionally support InfiniBand fiber optic cables on the top row 12 ports Voltaire IB 4X DDR 24-port Internally Managed Switch 24 4X DDR CX4 ports, support 4X DDR InfiniBand copper cables, and optionally support InfiniBand fiber optic cables on the top row 12 ports Voltaire IB 4X DDR Rev B 96-port Switch Chassis 6U 19" rack mountable chassis, configurable with redundant management board, power supplies, up to 4 fabric boards (sfb-2004), and 4 line card slots for various types of line boards. Up to 96 4X DDR CX4 ports, support 4X DDR InfiniBand copper and fiber optic cables Voltaire IB 4X DDR Rev B 288-port Switch Chassis 15U, 19" rack mountable chassis, configurable with redundant management board, power supplies, up to 4 fabric boards (sfb-2012), and up to 12 InfiniBand line boards Up to 288 4X DDR CX4 ports, support 4X DDR InfiniBand copper and fiber optic cables InfiniBand switch based on Mellanox technology Mellanox IB 4X QDR 324-port Switch 19U, 19" rack mountable chassis, configurable redundant management module, redundant (N+2) power supplies, up to port InfiniBand 4X QDR line boards Up to 324 4X QDR QSFP ports, support 4X QDR InfiniBand copper, active copper, and fiber optic cables InfiniBand switch based on QLogic technology QLogic IB 4X QDR 36 Port Switch 36 4X QDR QSFP ports, support 4X QDR InfiniBand copper, active copper, and fiber optics cables. NOTE: This switch supports QLogic BLc 4X QDR IB Management Module option. QLogic IB 4X QDR 324 Port Switch QLogic switch chassis with up to 2 redundant management modules, 6 power supplies Up to 324 4X QDR QSFP ports with port leaf modules in a 1:1 none oversubscribed bandwidth configuration, or up to 432 4X QDR QSFP ports with port leaf modules in a 2:1 oversubscribed bandwidth configuration. QLogic IB 4X QDR 648 Port Switch QLogic switch chassis with up to 2 redundant management modules, 12 power supplies. Up to 648 4X QDR QSFP ports with port leaf modules in a 1:1 none oversubscribed bandwidth configuration, or up to 864 4X QDR QSFP ports with port leaf modules in a 2:1 oversubscribed bandwidth configuration. InfiniBand cables Copper cables from 1 meter to 7 meters at QDR speed Fiber optic cables from 3 meters up to 30 meters at QDR speed Active copper cables from 7 meters to 15 meters at QDR speed Copper cables from 0.5 meter up to 12 meters at DDR speed Fiber optic cables from 1 meter up to 100 meters at DDR speed DA Worldwide Version 9 December 8, 2009 Page 4

5 Overview HP IB PCIe HCA cards and options QLogic IB PCIe HCA cards Mellanox IB switch and options Voltaire IB switches and options NOTE: The HCA cards listed in this section are based on Mellanox technology. HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA B21 HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA B21 HP IB 4X DDR PCI-e Dual-port HCA B21 Voltaire OFED driver stack RTU license B21 QLogic IB 4X QDR PCI-e G2 Dual-port HCA B21 Mellanox IB 4X QDR 324P Switch Chassis B21 NOTE: Chassis ships with 1 management board ( B21, 2 are possible), 9 QDR spine blades, 4 line boards ( B21, 4 included, 14 additional possible), 8 power supplies (N+2 redundant), 8 power cords, and rack kit. Mellanox IB 4X QDR 18P Line Board B21 NOTE: Up to 14 additional line boards can be configuration into the Mellanox IB QDR 324P Switch Chassis. Each line board has 18 4X QDR QSFP ports. Mellanox IB 4X QDR 324P Mgmt Module B21 NOTE: One additional management module can be added to the Mellanox IB QDR 324P Switch Chassis for redundancy. Mellanox Fabric IT Mgr Per Node RTU B21 NOTE: Right to use (RTU) License for Mellanox FabricIT, 1 per node for every node connected to the Mellanox InfiniBand fabric. Voltaire IB 4X QDR 36-port Internally Managed Switch B21 Voltaire IB 4X QDR 324-port director switch chassis B21 NOTE: Voltaire Grid Director port QDR InfiniBand switch chassis ships with 1 management module ( B21, 2 are possible), 2 power supplies ( B21, 6 are possible), 0 fabric boards ( B21 or B21, 9 are possible), 0 line boards ( B21, 18 are possible), three fan units, Rack Kit and cable management kit. Voltaire IB 4X QDR 324P Switch Fabric Board B21 NOTE: Voltaire Grid Director 4700 QDR InfiniBand Fabric board for the 324 port switch version. Voltaire IB 4X QDR 648P Switch Fabric Board B21 NOTE: Voltaire Grid Director 4700 QDR InfiniBand Fabric board for the 648 port switch version. Voltaire IB 4X QDR 324P Switch18P Line Board B21 NOTE: Voltaire Grid Director 4700 line board with 18 QSFP ports. Voltaire IB 4X QDR 324P Switch Management Module B21 NOTE: Voltaire Grid Director 4700 management module. Voltaire 1500 Watt Power Supply B21 NOTE: Voltaire 1500 Power Supply the 324-port director switch. Voltaire IB QDR 648P Switch 2M Cable B22 NOTE: Voltaire Grid Director 4700 QDR CXP cable, 2 meters long, 28 gauge for use in connecting two 324 port chassis into one 648. Voltaire IB QDR 648P Switch 5M Cable B25 NOTE: Voltaire Grid Director 4700 QDR CXP cable, 5 meters long, 26 gauge for use in connecting two 324 port chassis into one 648. Voltaire IB 4X DDR 24-port Externally Managed Switch B21 Voltaire IB 4X DDR 24-port Internally Managed Switch B21 DA Worldwide Version 9 December 8, 2009 Page 5

6 Models QLogic IB switches and options Voltaire IB 4X DDR Rev B 96-port Switch Chassis B21 NOTE: Voltaire ISR 2004 InfiniBand 96 Port Chassis DDR ready, contains 0 fabric boards ( B21, 2 required, 4 possible), 0 line boards (1 line board of either type is required, B21, 4 possible; B21, 4 possible),1 management board ( B21, 2 possible), 1 Power Supply ( B2, 4 are possible), 1 rack kit, 1 cable kit. Voltaire IB 4X DDR Rev B 96-port Fabric Board B21 NOTE: A minimum of 2 required with the purchase of Voltaire IB DDR Rev B 96-port Switch Chassis (P/N B21). A maximum of 4 fabric boards supported. Voltaire IB 4X DDR Rev B 288-port Switch Chassis B21 NOTE: Voltaire ISR 2012 InfiniBand 288 Port Chassis DDR ready, contains 0 fabric boards ( B21, 2 required, 4 possible), 0 line boards (2 line boards of either type are required, B21, 12 possible; B21, 12 possible),1 management board ( B21, 2 possible), 2 Power Supplies ( B2, 5 are possible), 1 rack kit, 1 cable kit. Voltaire FB-2012 InfiniBand Fabric Board for 288-port chassis B21 NOTE: A minimum of 2 required with the purchase of Voltaire IB DDR Rev B 288-port Switch Chassis (P/N B21). A maximum of 4 fabric boards supported. Voltaire IB 4X DDR Rev B 24-port Line Board B21 NOTE: A minimum of 1 of either line board is required with the purchase of Voltaire IB DDR Rev B 96-port Switch Chassis (P/N B21). A maximum of 4 line boards supported. NOTE: A minimum of 2 of either line boards are required with the purchase of Voltaire IB DDR Rev B 288-port Switch Chassis (P/N B21) A maximum of 12 line boards supported. Voltaire 22P IB 2P 10GE Line Board B21 NOTE: This line board has 22 4x DDR IB ports, 2 10GbE Ports. Requires XFP module for 10GbE operation. Up to 2 modules ( B21 SR XFP Fiber Module, B21 LR XFP Fiber Module). NOTE: A minimum of 1 of either line board is required with the purchase of Voltaire IB DDR Rev B 96-port Switch Chassis (P/N B21). A maximum of 4 line boards supported. NOTE: A minimum of 2 of either line boards are required with the purchase of Voltaire IB DDR Rev B 288-port Switch Chassis (P/N B21) A maximum of 12 line boards supported. Voltaire InfiniBand Redundant Management Board B21 Voltaire switch power supply for 96-port and 288-port chasses B21 Voltaire Unified Fabric Mgr (UFM) Per Node RTU B21 NOTE: Right to use (RTU) License for Voltaire Unified Fabric Manager (UFM), 1 per node for every node connected to the Voltaire InfiniBand fabric. QLogic IB 4X QDR 36 Port Switch B21 QLogic BLc 4X QDR IB Management Module B21 NOTE: This management module is an option for the QLogic 4X QDR 36 Port Switch. QLogic IB 4X QDR 324/432 Port Switch Chassis B21 NOTE: QLogic X QDR IB switch chassis contains: 1 management board ( B21, 2 are possible), 4 double QDR spine fabric boards, 1 single QDR spine fabric board, 0 leaf module ( B21for 24-port leaf module or B21 for 18-port leaf module,18 are possible. Leaf module types cannot be mixed), 4 power supplies (6 are possible), 4 power cords, rack kit. DA Worldwide Version 9 December 8, 2009 Page 6

7 Models InfiniBand CX4 Copper Cables InfiniBand CX4 Fiber Optic Cables InfiniBand QSFP/CX4 Copper Cables QLogic IB 4X QDR 648/864 Port Switch Chassis B21 NOTE: QLogic X QDR IB switch chassis contains: 1 management board ( B21, 2 are possible), 9 double QDR spine fabric boards, 0 leaf module ( B21 for 24-port leaf module or B21 for 18-port leaf module, 36 are possible. Leaf module types cannot be mixed), 8 power supplies (12 are possible), 8 power cords, rack kit. QLogic IB QDR Management Module B21 NOTE: QLogic redundant management board for the series switch chassis. QLogic IB QDR DDR 24 Port Leaf Module B21 NOTE: QLogic series switch line card with 24 QSFP ports. QLogic IB QDR 18 Port Leaf Module B21 NOTE: QLogic series switch line card with 18 QSFP ports. QLogic IB QDR Power Supply B21 QLogic InfiniBand Fabric Suite (IFS) B21 NOTE: Right to use (RTU) License for QLogic IFS, 1 per node for every node connected to the QLogic InfiniBand fabric. NOTE: Maximum length of 12 meters; cable length support may depend on the actual configuration. Please consult a HPC expert on specifics. HP 4X DDR IB Copper Cable Meter B21 HP 4X DDR IB Copper Cable - 1 Meter B22 HP 4X DDR IB Copper Cable - 2 Meter B23 HP 4X DDR IB Copper Cable - 3 Meter B24 InfiniBand Copper Cables - 5 Meter B25 HP 4X DDR IB Copper Cable - 6 Meter B26 HP 4X DDR IB Copper Cable - 7 Meter B27 HP 4X DDR IB Copper Cable - 8 Meter B28 HP 4X DDR IB Copper Cable - 9 Meter B29 HP 4X DDR IB Copper Cable - 10 Meter B30 HP 4X DDR IB Copper Cable - 11 Meter B31 HP 4X DDR IB Copper Cable - 12 Meter B32 NOTE: Maximum length of 100 meters; cable length support may depend on the actual configuration. Please consult a HPC expert on specifics. HP 4X DDR IB Fiber Optic Cable - 1 Meter B21 HP 4X DDR IB Fiber Optic Cable - 3 Meter B22 HP 4X DDR IB Fiber Optic Cable - 5 Meter B23 HP 4X DDR IB Fiber Optic Cable - 7 Meter B24 HP 4X DDR IB Fiber Optic Cable - 10 Meter B25 HP 4X DDR IB Fiber Optic Cable - 15 Meter B26 HP 4X DDR IB Fiber Optic Cable - 20 Meter B27 HP 4X DDR IB Fiber Optic Cable - 30 Meter B29 HP 4X DDR IB Fiber Optic Cable - 50 Meter B30 HP 4X DDR IB Fiber Optic Cable Meter B33 HP 4X DDR/QDR QSFP/CX4 IB Cu Cable - 1 Meter B21 HP 4X DDR/QDR QSFP/CX4 IB Cu Cable - 2 Meter B22 HP 4X DDR/QDR QSFP/CX4 IB Cu Cable - 3 Meter B23 HP 4X DDR/QDR QSFP/CX4 IB Cu Cable - 5 Meter B24 HP 4X DDR QSFP/CX4 IB Cu Cable - 8 Meter B25 DA Worldwide Version 9 December 8, 2009 Page 7

8 Models InfiniBand QSFP/QSFP Copper Cables InfiniBand QSFP/QSFP Fiber Optic Cables InfiniBand QSFP Active Copper Cables HP 4X DDR QSFP/CX4 IB Cu Cable - 10 Meter B26 HP 4X DDR/QDR QSFP IB Cu Cable - 1 Meter B21 HP 4X DDR/QDR QSFP IB Cu Cable - 2 Meter B22 HP 4X DDR/QDR QSFP IB Cu Cable - 3 Meter B23 HP 4X DDR/QDR QSFP IB Cu Cable - 5 Meter B24 HP 4X DDR/QDR QSFP IB Cu Cable - 7 Meter B25 HP 3M 4X DDR/QDR QSFP IB Opt Cable B23 HP 5M 4X DDR/QDR QSFP IB Opt Cable B24 HP 10M 4X DDR/QDR QSFP IB Opt Cable B25 HP 15M 4X DDR/QDR QSFP IB Opt Cable B26 HP 20M 4X DDR/QDR QSFP IB Opt Cable B27 HP 30M 4X DDR/QDR QSFP IB Opt Cable B28 HP 7M 4X QDR IB Active QSFP Cu Cable - 7 Meter B21 HP 10M 4X QDR IB Active QSFP Cu Cable - 10 Meter B22 HP 12M 4X QDR IB Active QSFP Cu Cable - 12 Meter B23 HP 15M 4X QDR IB Active QSFP Cu Cable - 15 Meter B24 DA Worldwide Version 9 December 8, 2009 Page 8

9 Performance Bandwidth 4X QDR ports on 4X QDR HCA cards and switches run at 40 Gbps signaling rate, with a peak data rate of 32 Gbps each direction, 4X DDR ports on 4X DDR HCA cards and switches run at 20 Gbps signaling rate, with a peak data rate of 16 Gbps each direction. DA Worldwide Version 9 December 8, 2009 Page 9

10 Scalability and Reliability Standards support 4X QDR HCA cards (Mellanox and QLogic): PCI Express 2.0 x8 4X DDR ConnectX cards: PCI Express 2.0 x8 (1.1 compliant) InfiniHost III card: PCI Express revision 1.0a IBTA version 1.1 or 1.2 compatible Operating systems support Mellanox OFED for Linux (64-bit) RHEL 5, RHEL 5 U1, RHEL 5 U2SLES10, SLES10 SP1, SLES10 SP1 (up1) SLES 10 SP2,, RHEL 4 U4,U5, U6, Mellanox WinOF for Microsoft Windows HPC server 2008 (64-bit) Voltaire OFED for Linux: (64-bit) RHEL 4 U4, 5, 6, 7, and RHEL 5 U1, 2 SLES 10 SP1, 2, 3 QLogic OFED+ for Linux (64-bit) RHEL 5.2, 5.3 SLES 10 SP2, 11 CentOS (Rocks) 5.2, 5.3 Scientific Linux 5.2, 5.3 DA Worldwide Version 9 December 8, 2009 Page 10

11 InfiniBand Fabric Management Auto-negotiation/ self-discovery InfiniBand QDR ports support auto-negotiation down to DDR/SDR, InfiniBand DDR ports support autonegotiation down to SDR. For example, external uplink ports of a DDR switch blade will negotiate down to SDR speed if they are connected to a device which can only operate at SDR. Self-discovery is supported by subnet manager. Check the documents of the specific subnet manager for more details: Management Mellanox OFED, Voltaire OFED and QLogic OFED+ include drivers and utilities to configure and manage the HCA in a Linux environment and Mellanox WinOF includes drivers and utilities to configure and manage the HCA in the Microsoft Windows server HPC 2008 environment. InfiniBand fabric has to be set up with a subnet manager: see the subnet manager discussion above. DA Worldwide Version 9 December 8, 2009 Page 11

12 Additional Features HP Services and Support The IB HCA cards have one year for parts exchange only or the warranty of the server it is attached to whichever is greater. The IB switches have one year parts exchange warranty. Enhancements to warranty services are available through Flexible CarePack services. The following Flexible CarePack services are available for the IB switch products: 1, 3, 4, 5 year Next Business Day HW Support 1, 3, 4, 5 year Same Day HW Support 1, 3, 4, 5 year 24x7 HW Support 1, 3, 4, 5 year 6 hour Call to Repair HW Support 1, 3, 4, 5 year Support Plus Service 1, 3, 4, 5 year Support Plus 24 Service 1, 3, 4, 5 year Proactive 24 Service 1, 3, 4, 5 year Critical Service NOTE: InfiniBand management software suites licenses include one year support and updates. NOTE: For more information, visit HP Care Pack Services at: DA Worldwide Version 9 December 8, 2009 Page 12

13 Technical Specifications Compliance Power and Environmental Specification InfiniBand HCA cards HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA, HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA HP IB 4X DDR PCI-e Dualport HCA IBTA version 1.2 compatible ROHS-R5 QLogic 4X QDR IB PCI-e G2 Dual-port HCA IBTA version 1.2 compatible, RoHS 6 PCI Express 2.0 x8 (1.1 compatible) PCI Express 1.0a x8 compatible PCI Express 2.0 x8 (1.1 compliant) Operating Temperature HCA cards: 0 to 55º C. Humidity (non-condensing) Switches: NOTE: Please refer to Voltaire product specifications for Voltaire switch models. NOTE: Please refer to Mellanox product specification for Mellanox MTS3610Q. NOTE: Please refer to QLogic product specification for QLogic InfiniBand switches. NOTE: Please refer to Voltaire product specifications for Voltaire switch models. NOTE: Please refer to Mellanox product specifications for Mellanox MTS3610Q. NOTE: Please refer to QLogic product specifications for QLogic InfiniBand switches. Power requirement HCA cards: HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA, typical 8.7W, max 9.8W Switches: HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA, typical 8.1W, max 8.3W QLogic 4X QDR IB PCI-e G2 Dual-port HCA, max 8.1W. NOTE: Please refer to Voltaire product specifications for Voltaire switch models. DA Worldwide Version 9 December 8, 2009 Page 13

14 Technical Specifications NOTE: Please refer to Mellanox product specifications for Mellanox MTS3610Q. NOTE: Please refer to QLogic product specifications for QLogic InfiniBand switches. Emissions Classifications HCA cards: HP IB 4X QDR CX-2 PCI-e G2 Dual-port HCA HP IB 4X DDR CX-2 PCI-e G2 Dual-port HCA Switches: HP IB 4X DDR PCI-e Dual- port HCA USA: FCC, Class A Canada: ICES, Class A EU: EN55022, Class A EU: EN55024, Class A EU : EN , Class A EU : EN , Class A Japan : VCCI, Class A Korea: MIC, Class A Taiwan: BSMI, Class A QLogic 4X QDR IB PCI-e G2 Dual-port HCA US/Canada: FCC Part 15, Subpart B ICES-003 Europe: EN55022:1994+A1+A2 EN55024:1998+A1+A2 EN :2000 (Harmonic Current) EN :1995+A1 (Voltage Fluctuation & Flicker) Japan: VCCI V-3/ New Zealand/Australia: AN/NZS CISPR 22:2002 Korea: MIC (KN22, KN24) Taiwan: BSMI (CNS 13438) China: CCC NOTE: Please refer to Voltaire product specifications for Voltaire switch models. NOTE: Please refer to Mellanox product specification for Mellanox MTS3610Q. NOTE: Please refer to QLogic product specifications for QLogic InfiniBand switches. DA Worldwide Version 9 December 8, 2009 Page 14

15 Technical Specifications Environment-friendly Products and Approach End-of-life Management and Recycling Hewlett-Packard offers end-of-life HP product return, trade-in, and recycling programs in many geographic areas. For trade-in information, please go to: To recycle your product, please go to: or contact your nearest HP sales office. Products returned to HP will be recycled, recovered or disposed of in a responsible manner. The EU WEEE directive (2002/95/EC) requires manufacturers to provide treatment information for each product type for use by treatment facilities. This information (product disassembly instructions) is posted on the Hewlett Packard web site at: These instructions may be used by recyclers and other WEEE treatment facilities as well as HP OEM customers who integrate and re-sell HP equipment. Copyright 2009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Windows and Microsoft are registered trademarks of Microsoft Corp., in the U.S. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein DA Worldwide Version 9 December 8, 2009 Page 15