QuickSpecs HP Cluster Platform 3000 and HP Cluster Platform 4000

Transcription

1 Overview An HP Cluster Platform 3000 or 4000 with 128 compute nodes (HP ProLiant DL140 G2 or HP ProLiant DL145 G2 Servers), a Myricom Myrinet XP high-speed interconnect, and an MSA1000 SAN storage array is shown above. The configuration consists of 3 compute building blocks (CBB) racks containing 114 compute nodes and Ethernet switches. A utility building block (UBB) rack contains 1 control node, 14 compute nodes, a Myrinet switch, an MSA1000 SAN storage array, a TFT display, and the root Ethernet switches. What's New Application node options expanded to include HP ProLiant DL140 G2 and HP ProLiant DL145 G2 servers, in addition to HP ProLiant DL360 G4 and HP ProLiant DL585 Servers HP ProLiant DL145 G2 and HP ProLiant DL585-based nodes offered with dual core processor options, in addition to latest single core processors New cluster fabric options include 96-port InfiniBand switch and Myricom "F' Cards At A Glance Comprehensive cluster offerings for high performance computing (HPC), integrating servers, networks and rack infrastructure with choice of HPC software and services Modular framework supports configurations from 5 to 512 nodes (larger configurations available through regional HPC Competency Centers). Two packaging options are offered: Dense packaging is available in configurations up to 128 nodes and is designed for lowest solution footprint and optimized cost infrastructure. The modular packaging is available in configurations up to 512 nodes and is designed to facilitate easy scalability and possible future growth. HP Cluster Platform 3000 feature HP ProLiant servers utilizing dual Intel Xeon processors with EM64T technology, and cluster interconnect choice of Myrinet, InfiniBand and Gigabit Ethernet. HP Cluster Platform 4000 feature HP ProLiant servers utilizing AMD Opteron processors, and cluster interconnect choice of Myrinet, Quadrics, InfiniBand and Gigabit Ethernet. In addition to dual socket node options (HP ProLiant DL145 and HP ProLiant DL385 servers), the HP ProLiant DL585 is also offered. HP Cluster Platforms are also available with Integrity servers, featuring the Intel Itanium2 processor. See for more information. Software options include operating systems (Linux or Windows 2003), and cluster management (HP XC System software or Scali Manage and Scali MPI Connect), with optional in-factory installation. Complementary HPC software products are offered DA Worldwide Version 1 August 15, 2005 Page 1

2 Overview by HP, tested and supported on HP Cluster Platforms by leading developers of cluster tools and applications. In additional, the HP ProLiant HPC Partner Software Suite is also available for customers wishing a broad coverage of infrastructure software including: compilers and cluster development tools, Job Management, Grid Resource Management, and Storage Management solutions suited for both Linux and Windows environments. Clusters are assembled to worldwide design specifications developed, tested and supported by HP. Configured and tested within HP Integration centers, final integration occurs at customer site for tasks such as rack-to-rack cabling. HP Consulting and Integration services offered include: Start-up Services and Knowledge Transfer, Cluster Implementation Program Management, Quckstart Services, including applications migration, and On-site Training. HP Cluster Platforms are available from HP Sales Representatives and HPC-Certified Resellers, utilizing Cluster Platform configurators and menus. Basic Architecture Components: Nodes One control node is included per cluster. Choice of node is often based on capability to support external networks and/or attached storage. The control node can be optionally connected to the high-speed cluster interconnect Up to 512 compute and utility nodes: Compute (or application) nodes: nodes are primarily used for application computation, rather than administrative workloads. Each HP Cluster Platform is engineered to support up to two pools of different compute nodes within the same processor family (e.g., AMD Opteron). For example, one pool may have set of nodes based on 2 processor HP ProLiant DL145 G2 servers, while another pool in same cluster will feature 8 processor (4 socket/dual core) HP ProLiant DL585 Servers. Utility nodes: used for any particular task including running applications. They can also provide I/O and file system access by adding a Fibre Channel host bus adapter to be connected to an MSA1000 subsystem or an external SAN. Two groups/pools of utility nodes can be defined for each cluster. Basic Architecture Components: Networks One High-Performance Cluster Interconnect: A dedicated network to support inter-nodal application traffic (such as MPI communications) and file transfer can be selected. Cluster Interconnects offered are Gigabit Ethernet, InfiniBand, Myrinet, and Quadrics (not currently available on HP Cluster Platform 300) Administrative network: The administrative network facilitates administration and management of the cluster, such as management of the user's applications. A choice of Fast Ethernet or Gigabit Ethernet is offered. The Gigabit Ethernet admin network can also be used as alternate to having a dedicated high-performance interconnect, although not recommended for deployments anticipating volume of inter-nodal application traffic. One console network provides access to the node's console network, enabling use of node-specific command functions such as power on. Each compute node IPMI or ilo port is connected to the Fast Ethernet-based console network. The administrative and console networks can be connected, based upon user requirements. Basic Architecture Components: Storage The HP Cluster Platform system can be attached to an external storage subsystem as a raid array integrated into the cluster configuration or as a separate HP storage subsystem. The HP StorageWorks Modular Smart Array 1000 (MSA1000) is the option available for integration in the Cluster Platform. An HP StorageWorks Enterprise Virtual Array 3000 (EVA 3000) can be connected to an HP Cluster Platform 4000 utility node or control node equipped with a Fiber Channel adapter The HP StorageWorks Scalable File Share system can be connected to the HP Cluster Platform system via the high-speed interconnect. If selected, additional interconnect ports must be allocated to connect the HP StorageWorks Scalable File Share servers. Basic Architecture Components: Infrastructure Rack: The HP Rack is the only model used. All HP Cluster Platform components are factory integrated and shipped within the racks on shock pallets. Side panels and joiner kit are available, to be ordered based on computer room layout. DA Worldwide Version 1 August 15, 2005 Page 2

3 Overview Power: Two to four PDUs per rack, based on packaging selections. They are all high voltage ( VAC) models for all countries, equipped with different terminations. A rack-mount keyboard/monitor (RKM) is supplied with each HP Cluster Platforms. This 1U RKM with TFT display is attached to the control node that is designated as the cluster system administration node. A TFT display provides local user access to the cluster. In systems with utility nodes, an 8-port KVM switch is also available to connect the RKM to multiple utility nodes (up to 7) to allow for failover connectivity to other nodes. Cable management kits specifically designed for HP Cluster Platforms are included. Basic Architecture Components: Software The following components are available on the HP Cluster Platform product menu, and can be factory installed by HP: Operating systems options Linux: Red Hat Enterprise Linux 3.0 or 4.0 ES or AS subscriptions. HPC 8 packs subscriptions offered for WS V3.0. SUSE SLES8 or SLES 9 available per node, or in HPC 8 pack. A Red Hat compatible Linux is also included with the XC System Software management option below. Windows Server 2003 per node Standard and Enterprise Edition, or HPC 16-pack Standard Edition licenses. HPC 8 packs require purchase of one 10-incident Care Pack from HP Services, unless systems are covered by broad HP Service agreement for Linux support. Cluster management software options HP XC System Software, developed and supported HP cluster solution integrates Linux OS, HP-MPI, Platform LSF HPC, and open source components to deliver comprehensive solution Scali Manage and Scali MPI Connect are supported partner offerings, offered with HP Cluster Platforms with Red Hat or SUSE software OS selections Summary Table of Cluster Platform Options Control node Compute node Utility node Cluster interconnect Cluster Platform 3000 HP ProLiant DL140 G2 HP ProLiant DL360 G4 HP ProLiant DL360 G4p HP ProLiant DL380 G4 HP ProLiant DL140 G2, HP ProLiantDL360 G4 HP ProLiant DL360 G4p HP ProLiant DL380 G4 GigE, IB, Myrinet Cluster Platform 4000 HP ProLiant DL145 G2 HP ProLiant DL385 HP ProLiant DL145 G2 HP ProLiant DL585 HP ProLiant DL385 GigE, IB, Myrinet, Quadrics DA Worldwide Version 1 August 15, 2005 Page 3

4 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular Design) Packaging for HP Cluster Platform 3000 and Dense Design One cabinet: up to 32 compute nodes with Myrinet, Gigabit Ethernet and InfiniBand, 31 with Quadrics Two cabinets: up to 64 compute nodes with Myrinet & Gigabit Ethernet and InfiniBand, 51 w/ Quadrics Three cabinets: up to 96 compute nodes with Myrinet, Gigabit Ethernet and InfiniBand, 89 w/ Quadrics Four cabinets: up to 128 compute nodes with Myrinet & Gigabit Ethernet and InfiniBand, 127 w/ Quadrics Maximums based on selecting 1U compute nodes and no utility nodes. Selection of larger nodes (e.g., HP ProLiant DL585 or HP ProLiant DL380) or MSA Storage option will reduce node count per cabinet. Each dense cluster includes one Utility Building Block (UBB) cabinet, which houses the control node, RKM, and the optional high-performance interconnect switch, and utility nodes. Other cabinets are used to house the compute nodes. Compute nodes may be integrated into the UBB, as space permits, in dense configurations. Total utility node count in dense configurations can not exceed 7 nodes Each cabinet includes two ProCurve switches: one for administrative network, and one for console network. Optional MSA1000 storage subsystem, with a single one expansion disk shelf option Delivered on shock resistant pallet Servers, Switches, RKM & storage are rack installed Fully pre-wired and factory integrated Packaging for HP Cluster Platform 3000 and Modular Design HP Cluster Platform modular solutions are organized in building blocks that can be easily replicated to build large-scale clusters. The compute building block (CBB) is a cabinet that contains, among other things, up to 38 2-way 1U compute nodes or up to nine 4U compute nodes. The utility building block (UBB) is the core cabinet of the cluster that contains the control node and its keyboard/monitor, additional utility nodes if required, cluster management root switches, one optional high-speed interconnect switch for solutions up to 128 nodes, optional MSA1000 raid arrays. The utility expansion rack (UXR) is an optional cabinet that can contain up to ten utility nodes when no more room is available in the UBB. The interconnect building block (IBB) is a cabinet that contains multiple interconnect switches (up to four) when solutions are larger than 128 nodes. Smallest configuration: one UBB cabinet and one CBB cabinet-up to 38 compute nodes Maximum number of CBB: 35 Maximum number of UBB: 1 Maximum number of UXR: 1 Maximum number of IBB: 3 with Myrinet, 1 with Gigabit Ethernet, 4 with InfiniBand, 6 with Quadrics Largest configuration: 40 cabinets with Myrinet, 38 with Gigabit Ethernet, 41 with InfiniBand, 43 with Quadrics-512 node Each CBB and UBB includes two ProCurve switches: one for administrative network, and one for console network. Console interfaces for the UXR and IBB are connected to the root switch housed in the UBB. Each UBB, UXR and CBB includes three PDUs. Two PDUs are utilized In each IBB (three Pocus for Quadrics based IBB). Delivered on shock resistant pallet DA Worldwide Version 1 August 15, 2005 Page 4

5 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular Design) Servers, switches, RKM & storage are rack installed Fully pre-wired and factory integrated HP Cluster Platforms 3000: Dense and Modular Design Control Node (HP Cluster Select One Server Platform 3000) HP ProLiant DL380 G4 Server (recommended for PCI slot availability) HP ProLiant DL360 G4 or G4p Server HP ProLiant DL140 G2 Server NOTE: Complete information on the HP ProLiant Servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for each control node are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options Redundant Power Supply HP ProLiant DL140 G2, HP ProLiant DL360 G4p and HP ProLiant DL380 are available with PC3200 memory. HP ProLiant DL360 G4 is available with PC2700 memory. Maximum memory will vary by server. DVD is required option for control nodes in HP Cluster Platforms One disk minimum for control nodes. HP ProLiant DL380 G4 Server available with up to six SCSI drives. HP ProLiant DL140 G2 and HP ProLiant DL360 G4 or HP ProLiant DL360 G4p available with up to two SATA drives. Control nodes feature option to connect to the high-performance cluster interconnect. Other PCI options include Fibre Channel HBA, and additional GigE interface. When supported on selected control node, PCI-Express riser cards are optional with InfiniBand Recommended for control nodes Compute Node Specify Node per Pool and Number of Nodes HP ProLiant DL360 G4 or G4p Server HP ProLiant DL140 G2 Server Configure servers as base for one or two compute pools. Total nodes cannot exceed 512 nodes. NOTE: Complete information on the servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for each compute node are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options Redundant Power Supply HP ProLiant DL140 and HP ProLiant DL360 G4p are available with PC3200 memory. HP ProLiant DL360 G4 is available with PC2700 memory. Maximum memory will vary by server. Optional One or two SATA or SCSI Drives. SCSI Drives requires low profile PCI adapter When nongige interconnect selected, compute nodes are configured with supported adapter. Other PCI options include Fibre Channel HBA, and additional GigE interface. When supported on selected control node, PCI- Express riser cards are optional with InfiniBand Offered for HP ProLiant DL360 G4. Not available with HP ProLiant DL140 G2. DA Worldwide Version 1 August 15, 2005 Page 5

6 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular Design) Utility Node Select Node Configuration per Pool and Number of Nodes HP ProLiant DL380 G4 server NOTE: Complete information on the servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for the HP ProLiant DL380 G4 node are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options Redundant Power Supply HP ProLiant DL380 G4 is available with up to 12 GB PC3200 memory per processor DVD is optional One disk minimum for control nodes. HP ProLiant DL380 G4 Server available with up to six SCSI drives. When nongige interconnect selected, compute nodes are configured with supported adapter. PCI options include Fibre Channel HBA, and additional GigE interface. PCI-X card for InfiniBand. Optional HP Cluster Platforms 4000: Dense and Modular Design Control Node (HP Cluster Select One Server Platform 4000) HP ProLiant DL385 Server (recommended for PCI slot availability) HP ProLiant DL145 G2 Server NOTE: Complete information on the HP ProLiant Servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for each control node are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options Redundant Power Supply HP ProLiant DL145 G2 and HP ProLiant DL385 nodes are available with up to 8 GB PC3200 memory per processor. DVD is required option for control nodes in HP Cluster Platforms One disk minimum for control nodes. HP ProLiant DL385 Server available with up to six SCSI drives. HP ProLiant DL145 G2 available with up to two SATA or SCSI drives.(scsi option on HP ProLiant DL145 G2 requires low profile PCI adapter). Control nodes feature option to connect to the high-performance cluster interconnect. Other PCI options include Fibre Channel HBA, and additional GigE interface. When supported on selected control node, PCI-Express riser cards are optional with InfiniBand Recommended for control nodes DA Worldwide Version 1 August 15, 2005 Page 6

7 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular Design) Compute Node Utility Node Specify Node per Pool and Number of Nodes HP ProLiant DL585 Server HP ProLiant DL145 G2 Server Configure servers as base for one or two compute pools. Total nodes cannot exceed 512 nodes. NOTE: Complete information on the servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for each compute node are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options HP ProLiant DL585 is available with up to 64GB PC2100 DDR SDRAM running at 266MHz memory, 48GB PC2700 DDR SDRAM running at 333MHz, or 32GB PC3200 DDR SDRAM running at 400MHz memory. HP ProLiant DL145 G2 is available with up to 8 GB PC3200 memory per processor Optional HP ProLiant DL585 Server available with up to four SCSI drives. HP ProLiant DL145 G2 available with up to two SATA or SCSI drives. NOTE: SCSI option on HP ProLiant DL145 G2 requires low profile PCI adapter. When nongige interconnect selected, compute nodes are configured with supported adapter. Other PCI options include Fibre Channel HBA, and additional GigE interface. When supported on selected control node, PCI- Express riser cards are optional with InfiniBand Redundant Power Supply Offered for HP ProLiant DL385. Not available with HP ProLiant DL145 G2. Select Node Configuration per Pool and Number of Nodes HP ProLiant DL385 server NOTE: Complete information on the servers can be found in the following QuickSpecs: Choose Processor Option All currently shipping processors for HP ProLiant DL385 Servers are available. Select one or two processors Memory Options DVD Disk Options PCI - I/O Options Redundant Power Supply HP ProLiant DL385 is available with up to 8 GB PC3200 memory per processor DVD is optional HP ProLiant DL385 Server available with up to six SCSI drives. When nongige interconnect selected, compute nodes are configured with supported adapter. PCI options include Fibre Channel HBA, and additional GigE interface. PCI-X card for InfiniBand. Optional DA Worldwide Version 1 August 15, 2005 Page 7

8 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Hi Speed Interconnects (up to one interconnect fabric per Cluster Platform) InfiniBand Alternate InfiniBand implementations are supported. Depending on the bandwidth requirement, the Full Bandwidth (1:1) or High Bandwidth (2:1) can be selected. The Full Bandwidth is only available in Modular packing. High Bandwidth (2:1) topology relies on eight uplinks for every sixteen node connections while the Full Bandwidth (1:1) offers twelve uplinks for every twelve node connections, avoiding bottlenecks. Only PCI Express host bus adapters can take advantage of the Full Bandwidth topology. Three switches are offered for InfiniBand cluster interconnect. Myricom Myrinet The InfiniBand 288-port switch can be used as a standalone switch for configurations up to 288 nodes, in pair for configurations up to 384 nodes or as root switch in tree topologies with configurations up to 512 nodes. It must be equipped with two management boards, two or four Fabric boards, up to twelve 24-port Line Boards and power supply modules in N+1 configuration. The InfiniBand 96-port switch can be used as a standalone switch for configurations up to 96 nodes The InfiniBand 24-port switch can be used as a standalone switch for configurations up to 24 nodes, in pair for (2:1) configurations up to 32 nodes, as root and node-level switch in tree topologies with configurations up to 96 nodes or as node-level switch in tree topologies with 288- port switch(es). In one switch or two switch solutions, the internally managed model must be selected. In multiple 24-port switch solutions, two internally managed models must be selected, others being externally managed models. When 288-port switch(es) are selected with some 24- port switches, all models must be externally managed models. The Myricom Myrinet XP high-speed interconnect consists of these components: Low-latency, cut-through, crossbar switches, with SNMP monitoring card for high-availability applications, available in three different types of chassis: 10U 17-slot 128-port maximum switch (for all modular solutions and 3 to 4 cabinet dense solutions) 5U 9-slot 64-port maximum switch (for two cabinet dense solutions only) 3U 5-slot 32-port maximum switch (for one cabinet dense solutions only) The 8-port fiber line card with crossbar and Myrinet 2000 fiber ports (8): each Gb/s at a frontpanel LC connector to a 50/125 fiber pair up to 200 meters in length. Flow control, error control, and "heartbeat" continuity monitoring on every link The 8-port fiber spine card-no crossbar (for federated topologies when more than 128 ports are required) The SNMP monitor card-one per chassis The fiber optic cables in 5 lengths Two types of PCI-X adapters, the dual-port RevE adapter. And the new RevF (XMB) adapter Myrinet switch configurations with more than 128 ports require multiple node and link-level chassis, equipped with switch line cards and spine cards. For HP Cluster Platform configurations of 128 nodes or less, the utility building block with a single Myrinet chassis and Myrinet line cards is used. The IBB consists of an HP Series 42U rack, two power distribution units, and rackmount kits with up to four 128-port Myrinet switches. DA Worldwide Version 1 August 15, 2005 Page 8

9 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Quadrics QsNet (Cluster Platform 4000 only) The Quadrics QsSNetII high-speed interconnect consists of these components: High bandwidth, ultra low-latency switches available in five different types of chassis: 17U 10-slot 128-port maximum switch for reduced bandwidth solutions (for modular and dense solutions) 17U 10-slot 64-port node level switch for full bandwidth or reduced bandwidth (for IBB in modular solutions) 17U 10-slot 64-port top level switch for full bandwidth or reduced bandwidth (for IBB in modular solutions) 4U 32-port switch for full bandwidth solutions (for modular and dense solutions) 4U 16-port switch for full bandwidth solutions (for modular and dense solutions) Timing and control card: One slot on each side of the enclosure is reserved for the timing and control cards-to be connected to clock distribution boxes in federated solutions Four slots on each side of the enclosure can be populated with the following cards: 16-port switch card for reduced bandwidth 128-port switch Switch card for reduced bandwidth 128-port switch (no port for connections) 16-port switch card for 64-port node level switch 3rd level switch card for 64-port node level and top level switches Clock distribution box The copper link cables in 8 lengths up to 10m The clock cables in 7 lengths up to 20m QsSNetII PCI-X adapter For HP Cluster Platform 4000 solutions requiring no more than 32 high-speed interconnect ports, one 32-port switch or one 16-port switch is selected. No options required. For HP Cluster Platform 4000 solutions requiring more than 32 ports, switch card configuration and networks are offered for both reduced and full bandwidth, utilizing required number of 64-port chassis and top level switches. Gigabit Ethernet The HP ProCurve 2824 switch is only used as a standalone switch for small configurations up to 20 nodes connected to the interconnect-non-blocking up to 20 ports. The HP ProCurve 2848 switch can be used as a standalone switch for configurations up to 40 nodes (non-blocking up to 40 ports), in pair (one) for configurations up to 64 nodes (8 links between switches), or as root switch or node level switch in tree topologies (8 uplinks/32 node ports or 4 uplinks/40 node ports). The HP ProCurve 5308xl switch can be used as a standalone switch for configurations up to 32 nodes (eight 4-port 1000T modules) or as root switch in tree topologies with configurations up to 128 nodes (4 node level switches attached by 8 uplinks each). The HP ProCurve 93xxm switch series can be used as standalone switches for configurations up to 128 nodes or as root switches in tree topologies with configurations up to 512 nodes. They must be equipped with one management card, the HP ProCurve 9300EP Mini-GBIC redundant management module. Available options include the 16-port Gigabit Ethernet card (HP ProCurve 9300EP 100/1000BaseT Module), the mini GBIC (up to 8 HP ProCurve Gigabit-SX-LC Mini-GBIC for the management card), and the redundant power supplies. The Myricom Gigabit Ethernet 8-port line card provides Ethernet emulation in Myrinet switches. The Gigabit Ethernet ports are 1000Base-T on RJ45 connectors for Cat-5 Ethernet cables. All other DA Worldwide Version 1 August 15, 2005 Page 9

10 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) components are standard Myrinet options as described in Figure 9. Same configuration rules apply. The compute node is connected via its second embedded 1000T NIC. No PCI-X adapter required. Administrative and Console Network HP ProCurve 2650 HP ProCurve 2848 The HP ProCurve Switch 2650 and 2848 are used to build the internal administrative and console networks for the HP Cluster Platforms. These two networks are independent and organized in a flat tree topology with root switches and branch switches. The two root switches can be connected together based upon software or the end-user's requirements. The console network is built only with the HP ProCurve 2650 Fast Ethernet model, while the administrative network can use both models. Two alternatives are available for the administrative network: HP ProCurve 2848 Gigabit Ethernet for root and branch switches and HP ProCurve 2650 for root and branch switches. Multiple uplinks between branch and root switches can be aggregated by trunking. The Gigabit administrative network is configured with 2 uplinks. In HP Cluster Platform solutions with multiple Myrinet or Quadrics high-speed interconnect switches (use of IBB), an additional HP ProCurve 2650 switch is used to connect all high-speed interconnect switches to the administrative root switch /100 ports 2 Gigabit link ports 10/100 auto-sensing per port automatically detects and sets the speed A comprehensive LED display with per-port indicators provides an at-a-glance view of status, activity, and speed Special rack-mounting kit to allow integration into rack for shipment 44 10/100/1000 ports 4 dual-personality ports-each port can be used as either an RJ-45 10/100/1000 port or an open mini-gbic slot A comprehensive LED display with per-port indicators provides an at-a-glance view of status, activity, and speed Special rack-mounting kit to allow integration into rack for shipment Rack Infrastructure Keyboard and Monitor Racks Power A rackmount keyboard/monitor (RKM) is required with the HP Cluster Platforms. This 1U RKM with TFT display is attached to the control node that is designated as the cluster system administration node. The TFT display is mounted in the utility rack (UBB) and provides local user access to the cluster. In systems with utility nodes, an 8-port KVM switch is also available to connect the RKM to multiple utility nodes (up to 7) to allow for failover connectivity to other nodes. Rack series Cabinets The increasing power of new high-performance processor technology requires increased cooling efficiency for rack-mounted servers. The Series Racks provide enhanced airflow for maximum cooling, allowing these racks to be fully loaded with servers using the latest processors. HP Cluster Platform CBB, UBB, and UXR cabinets are equipped with three power distribution units while the IBB cabinet is equipped with two. These 1U units are installed front to back. They are all high voltage ( VAC) models for all countries, equipped with different terminations: North America, Japan 24A ( VAC): attached input cord NEMA L6-30P EMEA 32A ( VAC): attached input cord IEC A DA Worldwide Version 1 August 15, 2005 Page 10

11 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Documentation HP Cluster Platform systems include one hardware documentation kit. Each hardware documentation kit contains both a CD and a hard copy of: HP Cluster Platform Installation and Operation Guide HP Cluster Platform Overview and Site Preparation Guide The CD contains a soft copy of the same guides and Installation and User Guides of the various components integrated in the HP Cluster Platform system. Storage MSA1000 The HP StorageWorks Modular Smart Array 1000 (MSA1000) is a 2 Gb Fibre Channel storage system designed for the entry-level to mid-range Storage Area Network (SAN). The MSA1000 is a scaleable, high performance storage system. With the addition of one HP StorageWorks MSA30 disk enclosures with space for twenty-eight enterprise-class drives, the maximum storage capacity is 4TB. Control node and utility nodes can be attached to this SAN, depending on the end-user's requirements and required system I/O bandwidth. Select one Fibre Channel host bus adapter for each designated node. If larger capacity (up to 16TB) 8TB) or higher bandwidth is required, two MSA1000 storage subsystems can be configured. A ratio of one MSA for one host bus adapter (one node) is recommended for balanced performance in RAID 5 configuration. These two MSA storage subsystems can be integrated in the UBB, if space is dedicated to them. The HP StorageWorks Modular Smart Array 1000 includes the following components: Options: One MSA1000 controller with 256 MB cache One MSA1000 Fibre Channel I/O module with 2 Gb SFP short wave transceiver Redundant hot-pluggable power supply/blower assemblies Universal rackmounting kit MSA1000 support CD and documentation Serial cable Two power cables Two 3-foot very high density cable interconnect (VHDCI) to VHDCI SCSI cables MSA1000-one controller, 14 disk slots MSA1000 SAN switch 2/8 (integrated; includes four 2 Gb SFPs) 2 Gb SFP short-wave transceiver kit HP StorageWorks MSA30 disk enclosure (one maximum per MSA1000) 36.4 GB pluggable Ultra320 universal hard drive, 10,000 rpm (1") 72.8 GB pluggable Ultra320 universal hard drive, 10,000 rpm (1") GB pluggable Ultra320 universal hard drive, 10,000 rpm (1") 300 GB pluggable Ultra320 universal hard drive, 10,000 rpm (1") 36.4 GB pluggable Ultra320 universal hard drive, 15,000 rpm (1") 72.8 GB pluggable Ultra320 universal hard drive, 15,000 rpm (1") 146 GB pluggable Ultra320 universal hard drive, 15,000 rpm (1") PCI-X single channel 2 Gb Fibre Channel host bus adapter-fca2214 Necessary cabling Software OS Support Linux DA Worldwide Version 1 August 15, 2005 Page 11

12 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Red Hat EL ES and AS 3.0 and 4.0 (1 year and 3 year subscriptions) Standalone server HPC 8 pack for RH EL WS 3.0 (1-2 processor nodes only) SUSE SLES 9 (1 year and 3 year subscriptions) Standalone server HPC 8 packs: 1-2 processor nodes; 3-8 processor nodes HPC 8 packs for Red Hat and SUSE support up to 8 compute nodes per 8 pack. XC System Software includes full Linux distribution, compatible with Red Hat EL 3.0 HPC 8 pack ordering information Order one base kit for the 1st eight compute nodes: A standalone server subscription is recommended for control node Order add-on kits to cover remaining compute nodes(1 kit per 8 nodes) 8 packs require purchase of HPS 10 incident care pack (one per cluster - extension A for physical; E for electronic) RHEL WS3 1Yr Base 8 pack, Media for ProLiant (64 bit) B21 RHEL WS3 1Yr Add-on 8 pack for ProLiant (64-bit) B21 RHEL WS3 3Yr Base 8 pack, Media for ProLiant (64 bit) B21 HP 1y 9x5 10Incdt Red Hat IA32 SWTechSupp HP 1y 24x7 10Incdt Red Hat IA32 SWTechSup HP 1y 9x5 10Incdt Red Hat IA32 SWTechSupp (Electronic) HP 1y 24x7 10Incdt Red Hat IA32 SWTechSup (Electronic) U3402A U3406A U3402E U3406E SUSE SLES9 1Yr Base 8 pack, Media (64 & 32 bit) for ProLiant (1-2 processor nodes) B21 SUSE SLES9 1Yr Add-on 8 pack for ProLiant (64 & 32-bit (1-2 processor nodes) B21 SUSE SLES9 3Yr Base 8 pack, Media (64 & 32 bit) for ProLiant (1-2 processor nodes) B21 SUSE SLES9 3Yr Add-on 8 pack for ProLiant (64 & 32-bit) (1-2 processor nodes) B21 SUSE SLES9 1Yr Base 8 pack, Media (64 & 32 bit) for ProLiant (3-8 processor nodes) B21 SUSE SLES9 1Yr Add-on 8 pack for ProLiant (64 & 32-bit (3-8 processor nodes) B21 SUSE SLES9 3Yr Base 8 pack, Media (64 & 32 bit) for ProLiant (3-8 processor nodes) B21 SUSE SLES9 3Yr Add-on 8 pack for ProLiant (64 & 32-bit) (3-8 processor nodes) B21 HP 1y 9x5 10Incdt SuSE IA32 SWTechSupp HP 1y 9x5 10Incdt SuSE IA32 SWTechSupp (Electronic) HP 1y 24x7 10Incdt SuSE IA32 SWTechSupp HP 1y 24x7 10Incdt SuSE IA32 SWTechSupp (Electronic) Microsoft Windows Windows Server 2003 per node Standard and Enterprise Edition, For Control node, order one per node, based on number of users accessing the cluster Microsoft Windows Server 2003, Standard Edition with 5 client access licenses, English Microsoft Windows Server 2003, Enterprise Edition with 25 client access licenses, English Windows HPC edition: Order one for each compute node, in bundles of 16 licenses - factory installation is required Microsoft Windows Server 2003, Standard Edition for High Performance Computing, 16-license pack U9936A U9936E U9935A U9935E B B B21 DA Worldwide Version 1 August 15, 2005 Page 12

13 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) NOTE: For more complete and up-to-date information on how to buy server operating systems from HP please visit the OS product site at: Cluster Management HP XC System Software V2.1 The HP-developed XC System Software integrates leading open source cluster packages with the Linux operating system, HP MPI, and Platform Computing's LSF. The XC System software provides singlesystem management for job and resource scheduling and simplified software installation, resulting in unprecedented levels of ease-of-use, productivity, and scalability. On an XC System, all of the CPUs must be licensed. Every XC System must also include a base license for the appropriate processor architecture. The licenses can be combined. Licenses are combined with software support. Standard software support includes 9x5 telephone support and rights to new versions for the specified period of time (one year or three years). 24x7 software support extends the telephone support window to round-the-clock access. See the HP XC System Software Version 2.1 QuickSpecs for more information and specific part numbers. A required Base license includes one set of media and documentation. NOTE: Complete information on the XC System Software, including QuickSpecs, can be found at the following URL: Scali Manage/Connect Scali Manage enables rapid installation and configuration of clusters including the operating system, middleware, communication modules, third party applications and user data. Scali Manage provides a centralized point of installation and ongoing management for clusters, applications, interconnects and industry-standard hardware platforms. The Scali MPI Connect implementation is built on a direct data transfer model that leverages the standardized API intermediate layer based on the Direct Access Transport (DAT) specification. Highly optimized algorithm for message passing through the direct data transport mechanism eliminates overhead and reduces latency. Scali software products supplied by HP are governed exclusively by the manufacturer's license terms and other documentation accompanying such third-party software. NOTE: Ordering information on Scali Software can be found in the QuickSpecs for the HPC Partner Solution Suite at the following URL: DA Worldwide Version 1 August 15, 2005 Page 13

14 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Linux Control Nodes (factory installed or standalone) Scali Manage/Connect For TCP/IP - 1 Yr Bronze Support B21 Scali Manage/Connect For Myrinet - 1 Yr Bronze Support B21 Scali Manage/Connect For InfinBand - 1 Yr Bronze Support B21 Scali Manage/Connect For TCP/IP - Educational Edition B21 Scali Manage/Connect For Myrinet for Educational Edition B21 Scali Manage/Connect For Infiniband for Educational Edition B21 Scali Manage Media, Documentation, License B21 Scali Manage EDU Media, Doc, License B21 Scali 1Yr Support License - Bronze Support B21 Scali 1Yr Support License - Silver Support B21 Scali 1Yr Support License - Gold Support B21 Scali Manage/Connect - Compute Node License - 1 year Bronze support B21 Scali Manage/Connect - Compute Node - Education License B21 Scali Manage Compute Node License - no support B21 Scali Manage EDU Compute Node License - no support B21 Scali 1Yr Support License - Bronze Support B21 Scali 1Yr Support License - Silver Support B21 Scali 1Yr Support License - Gold Support B21 Service and Support HP Cluster Platform solutions warranties and service options are based on the offerings of the underlying components. HP customer support provides onsite hardware break/fix support and remote, remedial software callcenter support. Customer support offsite software services include level 1 and 2 support: Level 1 is defined as everyday user/system administration issues. Level 2 is defined as problems related to installation and configuration, along with other problems not solvable by following the vendor-supplied documentation. The HP software support team will work in parallel with the appropriate vendor and development groups to address level 3 and 4 support elevations: Level 3 elevations typically require that patches and modifications be generated by the vendor to resolve deficiencies in the product. Level 4 elevations deal with enhancements in the functionality of the product that will typically be included in future releases. Optional customer services HP has experience servicing systems, networks, storage devices, and software for HPC deployments and environments of all sizes. A wide range of purchasing options and solutions built from standards-based service modules ensure the service coverage and the level of expert assistance desired. Optional services may be purchased at the time of the product purchase as HP Care Pack services, easy to order and easy to use service packages. Optional services may also be purchased at a later point of time as HP Contractual or Per-Event Services to extend and/or expand and/or complement the standard product warranty. Hardware Support: Service capabilities include total lifecycle support, preventive and diagnostic services, access to a global service network, and support for an array of third-party peripherals. DA Worldwide Version 1 August 15, 2005 Page 14

15 Standard Features (HP Cluster Platform 3000 and 4000: Dense and Modular packaging) Hardware Support Services offer a full range of high-quality remote and onsite hardware support options to meet specific response or repair-time objectives. These support options range from next-day or 4-hour onsite response to 6-hour call-to-repair time commitments. To accommodate specific hours of operations, coverage window options range from standard business hours (9x5), Monday-Friday 8am- 5pm local time up to 24x7. Software Support: Standard software support includes 9x5 telephone support and rights to new versions for the specified period of time (one year or three years). 24x7 software support extends the telephone support window to round-the-clock access. Standard software support includes customer access to technical resources during standard hours (see later), problem analysis, escalation management, and resolution. HP also provides unlimited access to an electronic facility that includes a knowledge database with known symptoms and solutions, software product descriptions, specifications, and technical literature. Software support contracts can be obtained to meet the needs of customers, including remedial technical remote support along with migration and upgrade planning and a full suite of proactive deliverables. NOTE: For more complete information on HP Services offerings, customers and resellers, please visit us at: NOTE: Additional information regarding worldwide limited warranty and technical support is available at: DA Worldwide Version 1 August 15, 2005 Page 15

16 Configuration Information - Factory Integration IMPORTANT: The HP Cluster Platforms are customized by HP and resellers using the Internal Configure-To-Order configurator process to receive a complete factory integrated cluster with options delivered in a single package. The Purchase Order must list each part number individually. The steps below describe the Factory Integration services provided during assembly and delivery of HP Cluster Platforms Step 1: Determine Hardware Factory Integration services Factory Integration for HP Cluster Platforms Factory integration of all hardware components conforming to HP Cluster Platform configuration rules. This includes all cables routing and test of these components at hardware level. Factory integration requires a Base Service per each cluster, plus per rack charge, plus hardware installation service per node. No separate per node charge required if software installation is selected (Step 2) A Base Hardware Integration service is required per solution. Select one Modular or High Density base hardware integration Base Hardware Integration - Cluster Platforms - Modular (Min 0/Max 1) Base Hardware Integration - Cluster Platforms - High Density (Min 0/Max 1) AC067A AC068A A Rack Integration ( ) is required per rack One Node Hardware Integration is required for every Compute and Utility nodes in the solution AC069A Step 2: Determine Software Factory Installation Services HPTC Cluster Integration Service - predetermined schedule of charges based on total node count. Contact HP for current charges. H3370A#006 Step 3: Add on-site Field Installation Field installation of the cluster, ie unpacking, assembling, power up and quick check (if software is factory loaded) - Highly recommended. Order one per rack Installation of each cabinet HA124A1#568 Consulting and Integration Services C& I options include on-site systems software support and applications development and optimization, as well as clusters training. This is in addition to options for Factory and Field On-site installation (see above). Based on compute node counts. Start Up Services - On-site Introduction to Cluster Platform 3000/4000 Recommended for each cluster deployment. Required for platforms with HP installed cluster software (e.g., XC System Software and Scali Connect). up to 16 nodes - HPC Clusters-one day on-site systems software knowledge transfer and five hours of customer integration management up to 32 nodes - HPC Clusters-two days on-site systems software knowledge transfer and six hours of customer integration management up to 64 nodes - HPC Clusters-three days on-site systems software knowledge transfer and six hours of customer integration management up to 128 nodes - HPC Clusters-five days on-site systems software knowledge transfer and six hours of customer integration management up to 256 nodes - HPC Clusters-ten days on-site systems software knowledge transfer and twelve hours of customer integration management Greater than 256 nodes: Custom quote Recommended Services - (For clusters up to 32 nodes) U5628A#001 U5628A#002 U5628A#003 U5628A#004 U5628A#005 DA Worldwide Version 1 August 15, 2005 Page 16

17 Configuration Information - Factory Integration HPC Cluster Implementation Program Management - 40 hours implementation management consulting HPC Cluster systems software QuickStart - 5 days on site consulting and six hours management coordination HPC Cluster Applications Migration, Development, and Optimization QuickStart - 5 days on site consulting six hours mgt coordination HPC Applications Programming and Migration - 2 days on-site formal customer training HPC Cluster Systems Administration Course - 4 days on-site formal customer training Recommended Services - (For clusters from 33 nodes up to 128 nodes) HPC Implementation Program Management - 80 hours implementation management consulting HPC Cluster Systems QuickStart - 10 days on site consulting and twelve hours management coordination HPC Cluster Applications Migration, Development, and Optimization QuickStart - 10 days on site consulting and 20H mgt coordination HPC Applications Programming and Migration - 2 days on-site formal customer training HPC Cluster Systems Administration Course - 4 days on-site formal customer training Recommended Services - (For clusters from 129 nodes up to 256 nodes) HPC Implementation Program Management hours implementation management consulting HPC Cluster Systems QuickStart - 15 days on site consulting and sixteen hours management coordination HPC Cluster Applications Migration, Development, and Optimization QuickStart - 15 days on site consulting and 16H mgt coordination HPC Applications Programming and Migration - 2 days on-site formal customer training HPC Cluster Systems Administration Course - 4 days on-site formal customer training Recommended Services - For clusters above 256 nodes, customized service plan is recommended U5617A U5618A U5619A U5626A U5627A U5620A U5621A U5622A U5626A U5627A U5623A U5624A U5625A U5626A U5627A DA Worldwide Version 1 August 15, 2005 Page 17

18 Technical Specifications The following section contains information on components used in HP Cluster Platforms from our partner suppliers, and HP Cluster Platform Building Block Racks. Please refer to product-specific QuickSpecs for information on HP products offered in the Cluster Platform. Myricom Myrinet XP high- Myricom 128-port chassis speed interconnect Maximum BTUs per hour (with line cards in all slots) 3360 Power Maximum input current (100 to 127 V) Maximum input current (200 to 240 V) Height Depth Weight without line cards Weight with line cards in all slots 960 W 9.6 A 4.8 A 1U = 1.75 inches = mm 17.5 in (44.5 cm) 46.3 lb (21 kg) 68.3 lb (31 kg) Temperature (operating) 41 to 104 F (5 to 40 C) Temperature (storage) -40 to 158 F (-40 to 70 C) Relative humidity 90% at 65 C Shock and vibration Conforming to EN (IEC 68) Fan MTTF Power input voltage 500,000 hours (each) 100 to 127 V/200 to 240 V 50/60 Hz Power factor.99 Voltaire ISR port InfiniBand Switch Dimensions (H x W x D) Weight (single power system) 1.69 x x in (43 x 44.6 x 52.3 cm) (1U) 17 lb (7.7 kg max) Temperature (operating) 32 to 113 F (0 to 45 C) Temperature (storage) -13 to 185 F (-25 to 85 C) Humidity Voltage Power Heat dissipation Voltaire ISR port InfiniBand Switch Operating-15 to 80%, non-condensing Non-operating-5 to 90%, non-condensing 100 to 240 VAC 50/60 Hz 32.5 W (Internally Managed model) 24.5W (Externally Managed model) 111BTU/hr. max (internal Managed model) Dimensions (H x Wx D) 24.5 x 17.5 x in (62.2 x 44.4 x 57.8 cm)(14u) Weight (single power system) 110 to lb (50 to 85 kg) max Temperature (operating) 32 to 113 F (0 to 45 C) Humidity Voltage Power Heat dissipation Quadrics QsNet II 64/128 port Switch Dimensions (H x W x D) Operating-15 to 80%, non-condensing Non-operating-5 to 90%, non-condensing 85 to 265 VAC 50/60 Hz 2,500 W max for full configuration 8,000 BTU/hr. max for full configuration 75.5 x 44 x 51 cm (17U) DA Worldwide Version 1 August 15, 2005 Page 18

19 Technical Specifications Weight (single power system) 70 kg max Temperature (operating) 5 to 35 C Humidity Operating -10 to 90% Storage- 10 to 90% Voltage 110 to 128 VAC/220 to 250 VAC 50/60 Hz Power 700 W max Heat dissipation 2390 BTU/hr. Quadrics QsNet QS32A 16/32 port Switch Dimensions (H x W x D) 17.5 x 44 x 48 cm (4U) Weight 5 kg max Temperature (operating) 5 to 35 C Humidity Operating -10 to 90% Storage- 10 to 90% Voltage 100 to 120 VAC/200 to 240 VAC 50/60 Hz Power Consumption 180 W max Heat dissipation 614 BTU/hr. HP Cluster Platform Compute Building Block rack: The compute building block with one rack, 38 DL145G2 nodes, two HP ProCurve switches (one 2650 and one 2848), four PDUs, and cabling (maximum configuration) Total cabinet Shipping Height 78.7 in ( cm) in (219 cm) Depth in ( cm) 48 in ( cm) Width 24 in (60.96 cm) 32 in (81.28 cm) Weight (est.) 1335 lb (606 kg) 1407 lb (638 kg) Power connection-3 PDUs Power consumption (est.) 220 to 240, 24 amp, 50/60 Hz (each PDU) NA/Japan 19,000 W (maximum) -10,000 W (typical) 220 to 240, 32 amp, 50/60 Hz (each PDU) Int'l N/A Heat dissipation (est.) 39,000 BTU/hr. N/A Temperature range (est.) 50 to 95 F (10 to 35 C) operating Relative humidity (est.) (non-condensing) -22 to 122 F (-30 to 50 C) non-operating 20% to 80% operating 5% to 95% non-operating DA Worldwide Version 1 August 15, 2005 Page 19