HP Cluster Platform Server and Workstation Overview

Transcription

1 HP Cluster Platform Server and Workstation Overview HP Part Number: A-CPSOV-H Published: March 009

2 Copyright 009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein. Intel, Intel Xeon, and Itanium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the U.S. and other countries. AMD and AMD Opteron are trademarks or registered trademarks of Advanced Micro Devices, Inc. Microsoft Windows Vista, and Xp are registered trademarks of Microsoft Corporation. Red Hat is a trademark of Red Hat, Inc. Printed in the United States.

3 Table of Contents About This Manual... Audience... Organization...5 HP Cluster Platform Documentation...5 Bracket Installation Guides...6 Additional Documentation...6 HP Encourages Your Comments... Important Safety Information... Itanium Processor Servers...5. HP Integrity rx Network Port Assignments Supported Memory Configurations Supported Storage Configurations Cable Management Installing or Removing a PCI Card...8. HP Integrity rx Network Port Assignments..... Supported Memory Configurations..... Supported Storage Configurations..... Cable Management Installing or Removing a PCI Card...5. HP Integrity rx PCI Slot Assignments...8. HP Integrity rx PCI Slot Assignments..... Removing the I/O Backplane Assembly Integrity rx660 PCI X and PCI-X/PCI-E I/O Backplane Assembly Options..... Installing PCI Cards in the Integrity rx HP Integrity rx Supported Memory Configurations Upgrading the HP Integrity rx PCI-X Slot Assignment and Supported Options Installing or Removing a PCI Card Cable Management HP Integrity rx Supported Memory Configurations Upgrading the HP Integrity rx PCI-X Slot Assignment and Supported Options Installing or Removing a PCI Card Cable Management...5 Xeon Processor Servers HP ProLiant DL0 G HP ProLiant DL0 G PCI Slot Assignments HP ProLiant DL0 G Memory Configurations Installing a PCI Card in the HP ProLiant DL0 G HP ProLiant DL0 G Used in HP Cluster Platform and Scalable Visualization Array HP ProLiant DL0 G PCI Slot Assignments HP ProLiant DL0 G Memory Configurations Installing a PCI Card in the DL0 G...6. HP ProLiant DL60 G5 and G5p...6 Table of Contents

4 .. PCI Slot Assignments...6. HP ProLiant DL60 G, G, and Gp PCI Slot Assignments Embedded Technologies High-Availability Features Removing a Server from the Rack Accessing Internal Components Replacing a PCI Card HP ProLiant DL60 G HP ProLiant DL60 G5 Front Panel HP ProLiant DL60 G5 Rear Panel HP ProLiant DL60 G5 Front Panel LEDs HP ProLiant DL60 G5 Rear Panel LEDs and Buttons System Insight Display HP Systems Insight Display LEDs and Internal Health LED Combinations PCI Slot Assignments HP ProLiant DL60 G5 Embedded Technologies and Fault Tolerance Removing a ProLiant DL60 G5 Server from the Rack and Accessing Internal Components Replacing a PCI Card HP ProLiant DL80 G and G PCI Slot Assignments Removing the Server from the Rack Accessing Internal Components Replacing a PCI Card HP ProLiant DL80 G HP ProLiant DL80 G5 Front Panel HP ProLiant DL80 G5 Rear Panel ProLiant DL80 G5 Front LEDs ProLiant DL80 G5 Rear LEDs Systems Insight Display LEDs PCI Slot Assignments New DL80 PCI Slot Assignments (as of March 7, 008) Rack Mounting Holes for ProLiant DL80 G5 Cable Management Brackets Removing the Server from the Rack Accessing Internal Components Replacing a PCI Card...97 Opteron Processor Servers HP ProLiant DL HP ProLiant DL5 G PCI Slot Assignments Removing an HP ProLiant DL5 from a Rack Replacing a PCI card in the HP ProLiant DL5 G Installing or Replacing a PCI Card in the HP ProLiant DL5 G HP ProLiant DL5 G Removing an HP ProLiant DL5 G from a Rack..... Removing the DL5 G Access Panel..... DL5 G System Board Expansion Slots DL5 G PCI Slot Assignments ProLiant DL5 G Riser Board Assemblies Installing or Replacing the ProLiant DL5 G Riser Board Assemblies Removing or Installing a Riser Board Replacing a PCI Expansion Card in the ProLiant DL5 G...0. HP ProLiant DL65 G PCI Slot Assignments... Table of Contents

5 . HP ProLiant DL85 G..... PCI Slot Assignments Removing an HP ProLiant DL85 G from a Rack Replacing an HP ProLiant DL85 PCI Card HP ProLiant DL85 G ProLiant DL85 G Front and Rear Views PCI Slot Assignments New DL85 G PCI Slot Assignments (as of March 7, 008) Removing the ProLiant DL85 G from a Rack Replacing a ProLiant DL85 G PCI Card ProLiant DL85 G Systems Insight Display HP ProLiant DL85 G5 and G5p PCI Slot Assignments HP ProLiant DL HP ProLiant DL585 Memory Configuration Removing an HP ProLiant DL585 from the Rack Replacing a PCI Card....8 HP ProLiant DL585 G Removing an HP ProLiant DL585 G from the Rack Replacing a PCI Card HP ProLiant DL585 G PCI Slot Assignments...5 Server Blades...5. HP BladeSystem p-class Overview...5. HP ProLiant BL5p Server Blade Overview Supported Memory Configurations Supported Storage Removing the HP ProLiant BL5p from the Sleeve HP ProLiant BL5p Server Blade Overview Supported Memory Supported Storage Removing the HP ProLiant BL5p from the Rack Enclosure...6. HP BladeSystem c-class Enclosure Overview HP BladeSystem c Class Enclosure Features HP BladeSystem c Class Enclosure Device Bay Numbering Interconnect Module Bay Numbering HP BladeSystem c-7000 Interconnect Module Bay to Server Blade Type Port Mapping Server Blade Type vs Gigabit Ethernet Blade Switch with Bandwidth Ratios HP x DDR InfiniBand Switch Module for c-class BladeSystem HP x DDR InfiniBand Switch Module Removal and Installation Procedure HP ProLiant BLx0c G5 Server Blade HP ProLiant BL60c G5 Server Blade HP ProLiant BL60c and BL60c G5 Server Blade Overview HP ProLiant BL60c Front View HP ProLiant BL60c Front Panel LEDs HP ProLiant BL60c Internal View HP ProLiant BL60c System Board Memory Options Mezzanine HCA Card Supported Storage Removing the HP ProLiant BL60c from the c Class Enclosure HP ProLiant BL80c Server Blade Overview HP ProLiant BL80c Front View HP ProLiant BL80c Front Panel LEDs...8 Table of Contents 5

6 .0. HP ProLiant BL80c Internal View HP ProLiant BL80c System Board Memory Options Mezzanine HCA Card Supported Storage Removing the HP ProLiant BL80c from the c-class Enclosure HP ProLiant BL65c Server Blade Overview HP ProLiant BL65c Front View HP ProLiant BL65c Front Panel LEDs HP ProLiant BL65c Internal View HP ProLiant BL65c System Board Memory Options Mezzanine HCA Card Supported Storage Removing the HP ProLiant BL65c from the c Class Enclosure HP ProLiant BL65c G5 Server Blade HP ProLiant BL685c Server Blade Overview HP ProLiant BL685c Front View HP ProLiant BL685c Front Panel LEDs HP ProLiant BL685c Internal View HP ProLiant BL685c System Board Memory Options Mezzanine HCA Card Supported Storage Removing the HP ProLiant BL685c from the c-class Enclosure...0. HP ProLiant BL685c G5 Server Blade Overview HP Integrity BL860c Server Blade Overview HP Integrity BL860c Front View HP Integrity BL860c LEDs HP Integrity BL860c Internal View Configuring or Replacing Memory Mezzanine HCA Card Supported Storage Removing the HP Integrity BL860c from the c-class Enclosure Workstations HP xw800 Workstation Overview PCI Slot Assignments Replacing or Installing a PCI Card Removing a Workstation from the Rack HP xw800 Workstation Overview PCI Slot Assignments xw800 PCI Slot Rules NVIDIA Quadro FX 500 Graphics Card NVIDIA Quadro G-Sync Option Card NVIDIA Quadro FX 5500 Graphics Card Replacing or Installing a PCI Card Removing a Workstation from the Rack HP xw900 Workstation Overview PCI Slot Indentification Slot Assignment Rules Typical PCI Slot Configuration NVIDIA PCI Graphics Cards NVIDIA FX50 Graphics Card NVIDIA FX500 Graphics Card Table of Contents

7 5..5 Connecting PCI Graphics Cards to Displays The NVIDIA FX G-Sync PCI Graphics Card (Optional) System Interconnect Cards Memory Configurations PCI Card Installation and Removal Instructions PCI Card Support Removing and Installing PCI Express Cards Removing and Installing PCI or PCI-X Cards Removing a Workstation from the Rack HP xw900 Workstation Overview PCI Slot Indentification Slot Assignment Rules xw900 Graphics Options NVIDIA Quadro FX NVIDIA Quadro FX NVIDIA Quadro G-Sync Memory Configurations PCI Card Installation and Removal Instructions Removing a Workstation from the Rack... A USB Drive Key Support on ProLiant G Models... Index... Table of Contents 7

8 List of Figures - HP Integrity rx60 Front Panel HP Integrity rx60 Rear Panel Releasing the PCI I/O Riser Removing the PCI I/O Riser Assembly Removing the PCI Slot Cover Sliding the Card into the PCI Riser Connector HP Integrity rx600 Front Panel HP Integrity rx600 Rear View HP Integrity rx600 Network Ports Removing the Card Cage Opening the Card Cage Removing the Blank Inserting the Card HP Integrity rx60 Front Panel HP Integrity rx60 Rear Panel HP Integrity rx660 Front Panel HP Integrity rx660 Rear Panel Removing the I/O Backplane Assembly Integrity rx660 PCI-X I/O Backplane Assembly Integrity rx660 Mixed PCI-X/PCI E I/O Backplane Assembly... - HP Integrity rx600 Front View HP Integrity rx600 Rear View Removing the Screws that Secure the Server in the Rack Removing the Server's Top Panel Installing the PCI Card HP Integrity rx60 Front View HP Integrity rx60 Rear View Removing the Screws that Secure the Server in the Rack Removing the Server's Top Panel Installing the PCI Card HP ProLiant DL0 G Front Panel HP ProLiant DL0 G Rear Panel Removing the HP ProLiant DL0 G PCI Card Cage HP ProLiant DL0 G PCI Card Cage Installing an Interconnect Adapter in the HP ProLiant DL0 G PCI Card Cage HP ProLiant DL0 G Front Panel HP ProLiant DL60 G5 and G5p Front View HP ProLiant DL60 G5 and G5p Rear View HP ProLiant DL60 G Front Panel HP ProLiant DL60 G Rear Panel with Single Power Supply ProLiant DL60 G Front Panel HP ProLiant DL60 G Rear Panel ProLiant DL60 Gp Front Panel HP ProLiant DL60 Gp Rear Panel Front Unit Identification LEDs Rear Unit Identification LEDs Sliding the Server from the Rack Removing the Access Panel Inserting the PCI Riser Card HP ProLiant DL60 G5 Front Panel HP ProLiant DL60 G5 Rear Panel ProLiant DL60 G5 Front Panel LEDs List of Figures

9 - ProLiant DL60 G5 Rear Panel LEDs System Insight Display (Actual) System Insight Display Map PCI Riser Board Assembly Inserting a New PCI Adapter Into the PCI Riser Board HP ProLiant DL80 G front panel HP ProLiant DL80 G Front Panel HP ProLiant DL80 G and G Rear Panel ProLiant DL80 PCI Riser Cage Door ProLiant DL80 PCI Riser Cage Door Latch Removing the HP ProLiant DL80 PCI Riser Cage Unlocking the HP ProLiant DL80 PCI Retaining Clip Removing the HP ProLiant DL80 Expansion Board HP ProLiant DL80 G5 Front Panel HP ProLiant DL80 G5 Rear Panel HP ProLiant DL80 G5 Front LEDs HP ProLiant DL80 G5 Rear LEDs HP ProLiant DL80 G5 Systems Insight Display Rack Mounting Holes for ProLiant DL80 G5 Cable Management Brackets Removing the ProLiant DL80 G5 PCI Riser Cage Removing the ProLiant DL80 G5 PCI Riser Cage HP ProLiant DL5 G Front Panel HP ProLiant DL5 G Rear Panel HP ProLiant DL5 G Front Panel HP ProLiant DL5 G Rear Panel HP ProLiant DL5 G Front Thumbscrews Sliding the HP ProLiant DL5 G from the Rack Removing the HP ProLiant DL5 G Access Panel Removing the HP ProLiant DL5 G Access Panel HP ProLiant DL5 G Riser Cage Removing an HP ProLiant DL5 G PCI Card from the Riser Cage HP ProLiant DL5 G PCI Expansion Slots Removing the HP ProLiant DL5 G PCI Card Cage Removing the Cover of the Low-Profile Expansion Slot Removing the Cover of the Full-Length Expansion Slot Installing a Full-Length PCI Card in the HP ProLiant DL5 G HP ProLiant DL5 G Front Panel HP ProLiant DL5 G Rear Panel HP ProLiant DL5 G Front Thumbscrews Sliding the HP ProLiant DL5 G from the Rack Removing the HP ProLiant DL5 G Access Panel DL5 G System Board Expansion Slots Removing the HP ProLiant DL5 G Full-Sized PCI Riser Board Assembly Removing the HP ProLiant DL5 G Low-Profile PCI Riser Assembly Remove the Full-Sized Riser Board Remove the Low Profile Riser Board Removing a Full-Sized PCI Card in the HP ProLiant DL5 G Removing a Low-Profile PCI Card in the HP ProLiant DL5 G HP ProLiant DL65 G5 Front View HP ProLiant DL65 G5 Rear View HP ProLiant DL85 G Front Panel HP ProLiant DL85 G Rear Panel Extending the HP ProLiant DL85 from the Rack HP ProLiant DL85 PCI Riser Cage Door HP ProLiant DL85 PCI Riser Cage Door Latch...7 9

10 -5 Removing the HP ProLiant DL85 PCI Riser Cage Unlocking the HP ProLiant DL85 PCI Retaining Clip Removing the HP ProLiant DL85 Expansion Board HP ProLiant DL85 G Front Panel HP ProLiant DL85 G Rear Panel Removing the ProLiant DL85 G from a Rack... - Removing the ProLiant DL85 G PCI Riser Cage... - Removing a PCI Slot Cover in the PCI Riser Cage Removing a DL85 G PCI Card HP ProLiant DL585 Front Panel HP ProLiant DL585 Rear Panel Loosening Thumbscrews Sliding the HP ProLiant DL585 from the Rack Unlocking the HP ProLiant DL585 Access Panel Latch Sliding an HP ProLiant DL585 into a Rack HP ProLiant DL585 PCI-X Expansion Slots and Buses Removing a PCI Card from an HP ProLiant DL585 Server Installing a PCI Card in an HP ProLiant DL585 Server HP ProLiant DL585 G Front Panel HP ProLiant DL585 G Rear Panel Remove Server from Rack ProLiant DL585 G from the Rack Unlock the ProLiant DL585 G Access Panel Latch HP ProLiant DL585 G PCI Slots Removing a PCI Card from an HP ProLiant DL585 G Server HP ProLiant BL5p Front Panel HP ProLiant BL5p Internal Components Removing the HP ProLiant BL5p from the Enclosure Sleeve ProLiant BL5p Front Panel HP ProLiant BL5p Rear Panel Components HP ProLiant BL5p Primary System Board HP ProLiant BL5p Secondary System Board Removing the HP ProLiant BL5p from the Rack Enclosure HP BladeSystem c Class Enclosure Front View HP BladeSystem c Class Enclosure Rear View HP BladeSystem c Class Enclosure Device Bay Numbering (Full-Height Device Bays) HP c Class BladeSystem Enclosure Device Bay Numbering (Half-Height Device Bays) HP c Class BladeSystem Enclosure Example HP c Class BladeSystem Module Bay Numbering HP c Class BladeSystem Module Bay Numbering Descriptions Prepare the Bay to Install the x DDR IB Switch Module Install the x DDR IB Switch Module HP ProLiant BLx0c G5 Front View HP ProLiant BL60c Front View HP ProLiant BL60c Front View HP ProLiant BL60c Front Panel LEDs HP ProLiant BL60c Internal View HP ProLiant BL60c System Board Components Removing a ProLiant BL60c from the c Class Enclosure HP ProLiant BL80c Front View HP ProLiant BL80c Front Panel LEDs HP ProLiant BL80c Internal View HP ProLiant BL80c System Board Components Removing a ProLiant BL80c from the c Class Enclosure HP ProLiant BL65c Front View List of Figures

11 - HP ProLiant BL65c Front Panel LEDs HP ProLiant BL65c Internal View HP ProLiant BL65c System Board Components HP ProLiant BL65c G5 Front View HP ProLiant BL685c Front View HP ProLiant BL685c Front Panel LEDs HP ProLiant BL685c Internal View HP ProLiant BL685c System Board Components HP ProLiant BL685c G5 Front View HP ProLiant BL860c Front View HP Integrity BL860c LEDs HP Integrity BL860c Internal View HP xw800 Workstation Front Panel HP xw800 Workstation Rear Panel PCI Retainer PCI Levers PCI Express Levers Installing a PCI Card in the HP xw800 Workstation Installing a PCI Express Card in the HP xw800 Workstation HP xw800 Workstation Front Panel HP xw800 Workstation Rear Panel xw800 PCI Slots NVIDIA Quadro FX 500 Graphics Card NVIDIA Quadro G-Sync Card NVIDIA Quadro FX 5500 Graphics Card PCI Retainer PCI Retention Clamp Installing a PCI or PCI Express Card in the HP xw800 Workstation HP xw900 Workstation Rear Panel HP xw900 Slot Numbering Typical xw900 Slot Configuration Removing PCI Card Holders Installing PCI Card Holders Removing PCI Express Cards Installing PCI Express Cards Removing PCI, or PCI-X Cards Installing PCI or PCI-X Cards HP xw900 Workstation Rear View HP xw900 Slot Numbering NVIDIA Quadro FX 500 Graphics Card NVIDIA Quadro FX 500 Graphics Card NVIDIA Quadro G-Sync Card...

12 List of Tables HP Cluster Platform Supported Servers... - HP Integrity rx60 Front Panel HP Integrity rx60 Rear Panel Features HP Integrity rx600 Ports Used in Clusters... - Memory Slot Loading Order HP Integrity rx60 Features Quick Reference for HP Integrity rx60 Connections HP Integrity rx60 PCI Slot Assignments HP Integrity rx660 Features HP Integrity rx660 PCI Express Slot Assignments HP Integrity rx660 PCI Mixed Slot Assignments... - HP Integrity rx600 Ports Used in Clusters HP Integrity rx600 PCI slot assignments HP Integrity rx60 Ports Used in Clusters HP Integrity rx60 PCI slot assignments HP ProLiant DL0 G Features HP ProLiant DL0 G Front Panel Features HP ProLiant DL0 G Rear Panel Features HP ProLiant DL0 G PCI Slot Assignments HP ProLiant DL0 G Memory Module Sequence HP ProLiant DL0 G PCI Slots HP ProLiant DL0 G Features HP ProLiant DL0 G Front Panel Features HP ProLiant DL0 G PCI Express Slot Assignments HP ProLiant DL0 G PCI-X Slot Assignments HP ProLiant DL0 G Graphics Card PCI Express Slot Assignments (SVA) HP ProLiant DL0 G Memory Module Sequence ProLiant DL60 G, G and Gp Model Comparison HP ProLiant DL60 G and DL60 Gp PCI Slot Assignments HP ProLiant DL60 G5 Features ProLiant DL60 G5 Front Panel LEDs ProLiant DL60 G5 Rear Panel LEDs and Buttons System Insight Display LEDs System Insight Display LED and Internal Health LED Combinations HP ProLiant DL60 G5 PCI Slot Assignments ProLiant DL60 G and G model comparison HP ProLiant DL80 PCI Slot Assignments HP ProLiant DL80 G5 Features HP ProLiant DL80 G5 Front Panel LEDs HP ProLiant DL80 G5 Rear LEDs Systems Insight Display LEDs Status HP ProLiant DL80 G5 PCI Express Slot Assignments HP ProLiant DL80 G5 Mixed PCI Express/PCI-X Slot Assignments HP ProLiant DL80 G5 PCI Express Slot Assignments (as of March 7, 008) ProLiant DL5 G and G Comparison HP ProLiant DL5 G PCI Slot Assignments HP ProLiant DL5 G PCI Slots HP ProLiant DL5 G Specifications DL5 G System Board Expansion Slot Descriptions HP ProLiant DL5 G PCI Slot Assignments HP ProLiant DL85 G Rear Panel Ports HP ProLiant DL85 PCI Slot Assignments...6 List of Tables

13 -9 HP ProLiant DL85 G Features HP ProLiant DL85 G PCI Express Slot Assignments... - HP ProLiant DL85 G PCI Express/PCI-X Slot Assignments... - HP ProLiant DL85 G PCI-Express Slot Assignments (as of March 7th 008)... - HP ProLiant DL85 G5 PCI Express Slot Assignments Slot Assignments for the HP ProLiant DL ProLiant BL5p Characteristics HP BladeSystem c Class Enclosure Features HP BladeSystem c-7000 Interconnect Module Bay to Server Blade Type Port Mapping HP Cluster Platform Server Blade Configurations to InfiniBand Interconnect Module Types (Bandwidth Ratios) HP ProLiant BL60c Features HP Proliant BL80c Features HP ProLiant BL80c Front Panel LEDs HP ProLiant BL65c Server Blade Features HP Proliant BL685c Server Blade Features HP Proliant BL860c Server Blade Features HP Workstation xw800 features HP xw800 Workstation PCI Slots HP Workstation xw800 Features HP xw800 Workstation PCI Slots xw800 PCI Slot Rules HP Workstation xw900 Specifications HP xw900 Workstation PCI Slots Narrow (-Slot) Graphics Cards Wide (-Slot) Graphics Cards Supported Interconnect Cards Supported Memory Configurations HP Workstation xw900 Features HP xw900 Workstation PCI Slots Graphics Cards...7

14 About This Manual This manual presents an overview of the servers and workstations used in HP Cluster Platform solutions. This manual references the original component documentation for detailed information, except where information or procedures for the cluster differ from the standalone components. In these cases, this manual supersedes information supplied in existing component documentation. HP Cluster Platform products support the servers listed in Table. Table HP Cluster Platform Supported Servers Processor Intel Itanium Intel Xeon AMD Opteron Server HP Integrity rx60 HP Integrity rx600 HP Integrity rx60 HP Integrity rx660 HP Integrity rx600 HP Integrity rx60 HP Server Blade BL860c HP ProLiant DL0 G, G and G HP ProLiant DL60 G5 and G5p HP ProLiant DL60 G through G, Gp and G5 HP ProLiant DL80 G, G and G5 HP ProLiant BLx0c G5 Server Blade HP ProLiant BL60c Server Blade HP ProLiant BL60c Server Blade HP ProLiant BL60c G5 Server Blade HP ProLiant BL80c Server Blade HP ProLiant BL680c G5 Server Blade HP Workstations xw800 and xw800 HP ProLiant DL5 G, G and G HP ProLiant DL65 G5 HP ProLiant DL85 HP ProLiant DL85 G5 and G5p HP ProLiant DL585 G and G HP ProLiant DL585 G5 HP ProLiant BL5p HP ProLiant BL5p HP ProLiant BL65c Server Blade HP ProLiant BL65c G5 Server Blade HP ProLiant BL685c Server Blade HP ProLiant BL685c G5 Server Blade HP Workstation xw900 HP Workstation xw900 Audience This manual does not describe the procedures and tools that are required to install and configure the system hardware or software. It does contain references for cluster components, in addition to the servers, that have their own documentation. This manual is intended for experienced hardware system administrators of large-scale computer systems, and for HP Global Service representatives. This guide references skilled tasks and describes important safety considerations and is not intended as a training aide for untrained personnel.

15 The information in this manual assumes that the reader has the following knowledge: Is familiar with HP rack-mounted servers and associated rack hardware. Is familiar with basic networking concepts, network switch technology, and network cables. Is familiar with the theory and implementation of the high-speed system interconnect technology used to create clusters. Has read the HP Cluster Platform Overview and is familiar with HP Cluster Platform architecture and concepts. Organization This manual is organized as follows: Chapter Chapter Chapter Chapter Chapter Chapter 5 Description Describes the Itanium processor servers used in HP Cluster Platform solutions. Describes the Xeon processor servers used in HP Cluster Platform solutions. Describes the Opteron processor servers used in HP Cluster Platform solutions. Describes the HP ProLiant server blades supported in HP Cluster Platform solutions. Describes the workstations used in HP Cluster Platform solutions. HP Cluster Platform Documentation HP Cluster Platform documentation is available from the following HP website: Printed and bound books are not available. The typical HP Cluster Platform documentation set contains both cross-platform and platform-specific documents, as well as supplementary documents available at the time of release. Cross-platform documents The following items are cross-platform documents: Cluster Platform Customer Letter Cluster Platform Overview Cluster Platform Site Preparation Guide Cluster Platform Core Components Cluster Platform Server and Workstation Overview Platform-specific documents The following items are platform-specific documents: Platform road map One or more system interconnect guides A set of cabling tables One or more bracket installation guides Organization 5

16 Bracket Installation Guides Some HP Cluster Platform solutions use custom brackets for servers, switches, and cable management. The following documents can be used, depending on your configuration: Title XC000 Cluster Quad Bracket Kit Installation Guide HP XC Interconnect xx00 Cabinet Kit Installation Guide HP ProCurve Rail Kit Installation Guide HP XC6000 Cable Management Basket Installation Guide Integrity rx600 Cable Management Tray Installation Guide QsNet II Management Kit Installation Guide Myrinet Interconnect Rack Kit Installation Guide HP Cluster Platform Generic Cable Management Bracket Installation Guide HP Integrity rx60 Cable Bracket Installation Guide ProLiant DL80 G Cable Management Bracket Installation Guide Tab Mount Cable Management Bracket Installation Guide c Class Blade Cable Management Bracket Installation Guide DL6x Cable Management Bracket Installation Guide Associated Component U servers Myricom interconnects U Procurve switch Quadrics interconnects Integrity rx600 Quadrics interconnects Myricom interconnects ProLiant DL60, DL5 G, DL80, DL585 Integrity rx60 ProLiant DL80 G, and G5 ProLiant DL5 c-class Server Blade Enclosure ProLiant DL60 G5 and DL65 G5 Additional Documentation For more information about HP ProLiant servers used in HP Cluster Platform configurations, see the following table. Also refer to the documentation that shipped with your cluster. Server Model Web Location HP ProLiant DL0 G and G HP ProLiant DL0 G Server Maintenance and Service Guide HP ProLiant DL0 G Server Maintenance and Service Guide HP ProLiant 00 Series Servers User Guide c pdf c pdf c00689.pdf HP ProLiant DL5 G HP ProLiant DL5 Server User Guide c00689.pdf HP ProLiant DL5 G HP ProLiant DL5 Generation Server Maintenance and Service Guide HP ProLiant DL5 Generation Server Installation Sheet c00687.pdf c pdf HP ProLiant DL5 G HP ProLiant DL5 Generation Server Maintenance and Service Guide c00856.pdf HP ProLiant DL60 G5 6

17 Server Model ProLiant DL60 Generation 5 Server Maintenance and Service Guide ProLiant DL60 Generation 5 Server Installation Sheet Web Location c050.pdf c00.pdf HP ProLiant DL60 G5p ProLiant DL60 Generation 5p Server Maintenance and Service Guide ProLiant DL60 Generation 5p Server Installation Sheet c pdf c pdf HP ProLiant DL65 G5 ProLiant DL65 Generation 5 Server Maintenance and Service Guide ProLiant DL65 Generation 5 Server Installation Sheet c0878.pdf c088.pdf HP ProLiant DL60 G ProLiant DL60 Generation Server Setup and Installation Guide ProLiant DL60 Generation Server Maintenance and Service Guide HP ProLiant DL60 G ProLiant DL60 Generation Server Maintenance and Service Guide ProLiant DL60 Generation Server Reference and Troubleshooting Guide ProLiant DL60 Generation SCSI Cabling Matrix HP ProLiant DL60 Gp ProLiant DL60 Generation p Server Maintenance and Service Guide HP ProLiant DL60 Generation p User Guide c009.pdf c00990.pdf HP ProLiant DL60 G and Gp Server High-Density Deployment Solution White Paper HP ProLiant DL60 G5 c pdf ProLiant DL60 Generation 5 Server Maintenance and Service Guide c pdf HP ProLiant DL80 G ProLiant DL80 Generation Server User Guide ProLiant DL80 Generation Server Maintenance and Service Guide HP ProLiant DL80 G ProLiant DL80 Generation Server Maintenance and Service Guide c pdf Additional Documentation 7

18 Server Model ProLiant DL80 Generation Server Reference and Troubleshooting Guide ProLiant DL80 Generation SCSI Cabling Matrix Web Location c pdf c00857.pdf HP ProLiant DL80 G5 ProLiant DL80 Generation 5 Server Maintenance and Service Guide HP ProLiant DL80 Generation 5 Server User Guide c pdf c00706.pdf HP ProLiant DL85 G ProLiant DL85 Server User Guide ProLiant DL85 Server Maintenance and Service Guide f79.html f79.html HP ProLiant DL85 G ProLiant DL85 G Server User Guide ProLiant DL85 G Server Maintenance and Service Guide c pdf c pdf HP ProLiant DL85 G5 ProLiant DL85 G5 Server User Guide ProLiant DL85 G5 Server Maintenance and Service Guide c00655.pdf c0075.pdf HP ProLiant DL85 G5p ProLiant DL85 G5p Server User Guide ProLiant DL85 G5p Server Maintenance and Service Guide c pdf c pdf HP ProLiant DL585 G HP ProLiant DL585 Server User Guide HP ProLiant DL585 Server Maintenance and Service Guide c pdf c0006.pdf HP ProLiant DL585 G HP ProLiant DL585 G Server User Guide HP ProLiant DL585 G Server Maintenance and Service Guide c pdf c pdf HP ProLiant DL585 G5 HP ProLiant DL585 G5 Server User Guide HP ProLiant DL585 G5 Server Maintenance and Service Guide c08.pdf c08.pdf HP p-class BladeSystems 8

19 Server Model HP ProLiant BL5p Server Blade Maintenance and Service Guide HP ProLiant BL5p Server Blade Maintenance and Service Guide Web Location c00907.pdf c pdf HP BladeSystem p-class Enclosure HP BladeSystem p-class Maintenance and Service Guides c pdf HP BladeSystem c-class Xeon Server Blades HP ProLiant BLx0c Generation 5 Server Blade User Guide HP ProLiant BLx0c Generation 5 Server Blade Maintenance and Service Guide HP ProLiant BL60c Generation 5 Server Blade User Guide HP ProLiant BL60c Generation 5 Server Blade Maintenance and Service Guide HP ProLiant BL60c Server Blade User Guide (includes the HP ProLiant BL60c G5) c0689.pdf c06866.pdf c0668.pdf c067.pdf c pdf HP ProLiant BL60c Server Blade Maintenance and Service Guide (includes the HP ProLiant BL60c G5) c pdf HP ProLiant BL80c Server Blade User Guide HP ProLiant BL80c Server Blade Maintenance and Service Guide c pdf c pdf HP c-class BladeSystems Opteron Server Blades HP ProLiant BL65c Server Blade User Guide HP ProLiant BL65c Server Blade Maintenance and Service Guide HP ProLiant BL65c G5 Server Blade User Guide HP ProLiant BL65c G5 Server Blade Maintenance and Service Guide HP ProLiant BL685c Server Blade User Guide HP ProLiant BL685c Server Blade Maintenance and Service Guide HP ProLiant BL685c G5 Server Blade User Guide HP ProLiant BL685c G5 Server Blade Maintenance and Service Guide c pdf c pdf c0877.pdf c pdf c pdf c pdf c pdf c pdf HP c-class BladeSystems Itanium Server Blades Additional Documentation 9

20 Server Model HP Integrity BL860c Server Blade QuickSpecs Web Location HP BladeSystem c-class Enclosure HP BladeSystem c-class Maintenance and Service Guides HP BladeSystem c7000 Enclosure Setup and Installation Guide HP BladeSystem c-class Site Planning Guide HP BladeSystem c-class Firmware & Upgrades c0077.pdf c pdf c0085.pdf?jumpid=reg_r00_usen c-class-compmatrix.html Additional ProLiant Documents The Intel processor roadmap for industry-standard servers Technologies for HP ProLiant 00-series servers technology brief Optimizing facility operation in high density data center environments Critical factors in intra-rack power distribution planning for high-density systems Data center cooling strategies Disk drive technology overview Fully-Buffered DIMM technology in HP ProLiant servers HP ProLiant Servers Troubleshooting Guide HP BIOS Serial Console User Guide HP Integrated Lights-Out User Guide for HP Integrated Lights-Out firmware.9 HP Integrated Lights-Out User Guide for Firmware.5 Planning and configuration recommendations for Integrated Lights-Out processors c00655.pdf c06.pdf c00067.pdf c00757.pdf c057.pdf c00796.pdf c00996.pdf c pdf c000.pdf c00090.pdf c00550.pdf c pdf HP Integrated Lights-Out Management Processor Scripting and Command Line Resource Guide for HP Integrated Lights-Out versions.8 and.9 and HP Integrated Lights-Out versions.x,.x, and.0 c00968.pdf HP Integrated Lights-Out Addendum Remote Insight Lights-Out Edition II User Guide c08008.pdf c009.pdf 0

21 Server Model Integrated Lights-Out Security Technology Brief, Fifth Edition ROM-Based Setup Utility User Guide HP BladeSystem Onboard Administrator User Guide Web Location c00796.pdf c pdf c pdf For more information about HP Integrity servers used in HP Cluster Platform configurations, see the following table. Also refer to the documentation that shipped with your cluster. Server Model Web Location HP Integrity rx60 Overview of the HP Integrity rx60-, rx60-, and rx60-8 Servers HP Integrity rx600 HP Integrity Server rx600 and HP Workstation zx Getting Started Guide (English A ) HP Integrity rx600 Server and HP Workstation zx Operations and Maintenance Guide, nd Edition (5969-6) HP Integrity rx600 and HPIntegrity rx5670 Management Processor Card Firmware Upgrade Product Update rx600rx56xx_update.pdf HP Integrity rx60 HP Integrity rx60 Installation Guide HP Integrity rx60 Maintenance Guide HP Integrity rx60 Operations Guide HP Integrity rx60 Single-Core to Dual-Core Processor Upgrade HP Integrity rx660 HP Integrity rx660 Installation Guide HP Integrity rx660 Site Prep Guide HP Integrity rx660 User Service Guide HP Integrity Integrated Lights-out Management Processor (ilo MP) Operations Guide for the HP Integrity BL860c, rx660, rx600, and rx HP Integrity rx600 HP Integrity rx600 overview HP Integrity rx60 HP Integrity rx60 Installation Guide HP Integrity rx60 Maintenance Guide Additional Documentation

22 Server Model HP Integrity rx60 Operations Guide HP Integrity rx60 Server Upgrade Guide, Second Edition Web Location For more information about HP Workstations used in HP Cluster Platform configurations, see the following table. Also refer to the documentation that shipped with your cluster. Workstation Model Web Location All models Getting Started Guide HP Workstations HP Workstations User Manual for Linux: A collection of installation, configuration and setup papers Front Card Guide and Fan Kit Installation HP Workstation xw Series Fixed Rack Kit Installation for HP Workstations c00066/c00066.pdf c000605/c pdf c0000/c0000.pdf c0087/c0087.pdf HP xw800 HP Workstation xw800 Service and Technical Reference Guide c000/c000.pdf HP xw800 HP Workstation xw800 Service and Technical Reference Guide c /c pdf HP xw900 HP Workstation xw900 Service and Technical Reference Guide c009075/c pdf HP xw900 HP Workstation xw900 Service and Technical Reference Guide c /c pdf For more information about the HP XC Software that was designed to run on HP Cluster Platform solutions, go to the following HP website: If you can not locate a specific HP Cluster Platform or HP XC Software document, try using the search feature available from the following websites: If you can not locate a specific document, contact your HP representative for assistance. HP Encourages Your Comments HP encourages your comments concerning this document. We are committed to providing documentation that meets your needs. Send any errors found, suggestions for improvement, or compliments to docsfeedback@hp.com Include the document title, manufacturing part number, and any comment, error found, or suggestion for improvement you have concerning this document.

23 Important Safety Information This manual provides only an overview of the procedures for removing servers from a cluster rack and for installing PCI cards. Before performing such procedures, read the safety information provided in the following documents: HP Cluster Platform Site Preparation Guide The servers are installed in HP 0000-series racks. Read and follow the rack safety information before starting any server maintenance operation such as removing a server from a rack or opening a server chassis. Pay particular attention to the rack power distribution information. Server Documentation Your HP Cluster Platform ships with a full documentation set for each component, including all server models used in the cluster. Read and follow the server safety information before starting any server maintenance operation, such as removing a server from a rack or opening a server chassis. Pay particular attention to warning labels and icons Cable Management Documentation Servers used as nodes in HP Cluster Platform do not always use the rack-mount kits and cable management systems that are standard for the server. HP Cluster Platform solutions use special rack-mount and cable management systems that are designed to manage the many heavy cables used by some system interconnect models. Refer to the appropriate cable management guide for each server model. Also consider the following general warnings before working on an HP Cluster Platform component: zk-07! WARNING: The front panel Power On/Off switch does not shut off all system power completely. Portions of the power supply and some internal circuitry remain active until AC power is removed. zk-07! WARNING: To reduce the risk of personal injury or damage to the equipment, be sure that only one component is extended at a time. A rack may become unstable if more than one component is extended at a time for any reason. zk-07! WARNING: To reduce the risk of personal injury from hot surfaces, allow the internal system components to cool before touching them. zk-07! WARNING: To reduce the risk of personal injury or damage to the equipment, place the server on a sturdy table or workbench whenever it is removed from the rack for device accessibility. zk-07! CAUTION: Before removing the server top cover, be sure that the server is powered down and that the power cord is disconnected from the server or the electrical outlet. Important Safety Information

24 zk-07! CAUTION: To avoid the risk of damage to the system or expansion boards, remove all power cords before installing or removing expansion boards. When the Power On/Off switch is in the Off position, auxiliary power is still connected to the PCI expansion slot and can damage the card. zk-07! CAUTION: Electrostatic discharge can damage electronic components. Be sure you are properly grounded before beginning any installation procedures.

25 Itanium Processor Servers The following Itanium processor servers in the HP Integrity series are supported in HP Cluster Platform solutions. This chapter presents the following information: An overview of the HP Integrity rx60 (Section.) An overview of the HP Integrity rx600 (Section.) An overview of the HP Integrity rx60 (Section.) An overview of the HP Integrity rx660 (Section.) An overview of the HP Integrity rx600 (Section.5) An overview of the HP Integrity rx60 (Section.6). HP Integrity rx60 HP Integrity rx60 is a U, dual-processor Itanium -based server. It can be used as an application node, control node, or utility node. It accommodates up to 8 DIMMs and internal peripherals, including disks and DVD-ROM. It can have up to two low-voltage differential (LVD),.5-inch form factor hard disk drives installed. Optionally, either a DVD or CD-RW/DVD drive can be added. Figure - shows the front panel of the HP Integrity rx60, and Table - describes its features. Figure - HP Integrity rx60 Front Panel The following list describes the callouts shown in Figure -.. DVD drive. LVD HDD. Locator button and LED. Diagnostic LEDs 5. LVD HDD 6. LAN LED 7. System LED 8. Power On/Off button 9. Power On/Off LED Table - HP Integrity rx60 Front Panel Name DVD Drive Locator Button and LED Function Optional removable media drive. The locator button and LED are used to help locate this server within a rack of servers. When the button is engaged, the blue LED illuminates and an additional blue LED on the rear panel of the server illuminates. This function may be remotely activated.. HP Integrity rx60 5

26 Table - HP Integrity rx60 Front Panel (continued) Name Diagnostic LEDs LAN LED System LED Power On/Off LED LVD HDD and LVD HDD Power On/Off button Function The four diagnostic LEDs operate in conjunction with the system LED to provide diagnostic information about the system. The LAN LED provides status information about the LAN interface. When the LAN LED is flashing, there is activity on the LAN. The System LED provides system status information. When operation is normal, the LED is green. When there is a system warning, the LED flashes yellow. When there is a system fault, the LED flashes red. The green power on/off LED is illuminated when the power is on. Low-voltage differential (LVD),.5-inch form factor hard disk drives. The power on/off switch for the server. Figure - shows the rear panel of the HP Integrity rx60. It includes communication ports, I/O ports, AC power connector, and the locator LED/button. Table - describes the rear panel features. Figure - HP Integrity rx60 Rear Panel a b c The following list describes the callouts shown in Figure -:. LVD/SE SCSI. Optional management board connectors a) 0/00 LAN C, b) Video, c) Serial. 0/00/000 LAN A Gb. 0/00/000 LAN B Gb 5. MP reset 6. Locator button and LED 7. Serial port 8. USB port 9. PCI slot 0. PCI slot Table - HP Integrity rx60 Rear Panel Features Connector/Switch AC Power LVD/SE SCSI 0/00/000 LAN A Function Primary power connection for the server. 68-pin, LVD, single-ended U0 SCSI. This connector provides external SCSI connection on SCSI Channel B. 0/00/000 base-t ethernet LAN A connector. Wake-on-LAN and Alert-on-LAN capabilities. 6 Itanium Processor Servers

27 Table - HP Integrity rx60 Rear Panel Features (continued) Connector/Switch 0/00/000 LAN B Serial USB Locator Button and LED 0/00 LAN C (optional) Video (optional) Serial (optional) Function 0/00/000 base-t ethernet LAN B connector. Wake-on-LAN and Alert-on-LAN capabilities. 9-pin male serial connector. This the console connector if the optional management processor card is not installed. Two universal serial bus (USB.0) connectors. The locator button and LED are used to help locate a server within a rack of servers. When the button is engaged, the blue LED illuminates and an additional blue LED on the front panel of the server illuminates. This function can remotely activated. 0 MB/00 MB LAN C connector for the optional management processor card. 5-pin female video connector for the optional management processor card. 5-pin female serial data bus connector for the optional management processor card... Network Port Assignments The HP Integrity rx60 has three network ports: LAN A, a 0/00/000 base-t Ethernet LAN A Gb port, optionally connected to the local WAN, enabling remote access. LAN B, a 0/00/000 base-t Ethernet LAN A Gb port, connected to the administrative network. LAN C, a 0/00 Ethernet port for the Management Processor (MP) card. This port is connected to the cluster's console network switch. Refer to the cluster's cabling tables for more information... Supported Memory Configurations The HP Cluster Platform does not enforce any memory configuration rules on the HP Integrity rx60 nodes other than those associated with the server. For the HP Integrity rx60 these rules are:. The system has eight memory slots for installing DDR SDRAM memory modules.. The system supports a maximum of 6 GB of memory and a minimum of 5 MB.. Memory modules can either be 56MB, 5MB, GB, or GB, and they must be arranged as ordered pairs of equal size. For example, if you place a GB memory module in slot 0A then you must insert a GB memory module in slot 0B.. Memory in the rx60 must be loaded in quads. This means that you must load two memory cards per cell. For example, using the loading order in rule, place DIMMs in slots 0A and 0B of memory cell 0 and in slots A and B of memory cell. 5. DDR SDRAM must be loaded as matched pairs. To determine if the DIMMs are matched pairs, look at the HP part number on the DIMMs. If the HP part numbers match, then the DIMMs can be loaded together as pairs. 6. You can mix module sizes in the system, provided that the DIMMs within each pair share the same HP part number. For example, you can load a pair of 56 MB DIMMs in slots 0A and 0B, a pair of GB DIMMs in slots A and B, and pairs of 5 MB DIMMs in slots A, B, A, and B. 7. You must install the first DDR SDRAM matched pair in memory cell 0 and in the slots labeled 0A and 0B. Load the second matched pair in memory cell and in the slots labeled A and B. Continue loading successive matched pairs. The HP Integrity rx60 supports the chip spare feature, enabling the server's error handling to bypass an entire DDR SDRAM chip on a DIMM if a multibit error is detected. To use the chip spare feature, you must install only DIMMs built with x SDRAM. Load the memory in quads,. HP Integrity rx60 7

28 that is, two DIMMs per memory cell, loaded in the same location in each memory cell and using the following upgrade rules: Begin with four identical DIMMs, loading them into the slots labeled Load Order st and nd. Add four identical DIMMs (identical to each other, but potentially different from the original quad), loading them into the slots labeled Load Order rd and th. Finally, add four identical DIMMs (identical to each other, but potentially differing from the existing two quads), loading them into the slots labeled Load Order 5th and 6th... Supported Storage Configurations The HP Integrity rx60 server supports up to two hot-pluggable low-voltage differential (LVD).5-inch SCSI drives. A node's requirement for local storage varies depending upon the role of the node. The following drives are supported: 6 GB 7 GB 6 GB Important: Power subsystem design for racks containing nodes must be designed for nodes that have disk configurations that draw maximum current. The physical procedures used to insert and remove a disk drive are discussed in the document that comes with the drive. However, the operating system must be prepared for insertion or removal of a disk, or unexpected and harmful effects may occur. Note: There is a significant difference between the terms hot-pluggable and hot-swappable. The hot-swappable process enables you to replace a component in a high-availability system while it is running without using operating system commands. The hot-pluggable process enables you to replace a component in a high-availability system while it is running, but a manual software procedure is necessary to complete the task. The disk drives in the HP ProLiant DL60 G are hot-pluggable, not hot-swappable. In addition to the two LAN ports and the MP port, the HP Integrity rx60 also has two PCI-X slots. Each slot is on a separate bus, but only one bus has sufficient throughput in its connection memory to support the full PCI-X bandwidth (approximately GB per second). The other three slots provide approximately 5 MB per second... Cable Management Each HP Integrity rx60 that has a connection to the system interconnect requires one cable bracket installed on the rear rack column. This component is documented in the HP Cluster Platform Tab Mount Cable Management Installation Guide...5 Installing or Removing a PCI Card The HP Integrity rx60 server can contain up to PCI cards. PCI cards are located on the I/O riser assembly. The PCI slots are numbered and. Slot (top) is a single, full size PCI slot that runs at MHz. Slot (bottom) is a single, half-size PCI slot that runs at MHz. Inserting a PCI card into a slot that is not configured to accept it can cause operation failure or can cause the PCI card to operate at less than optimum speed. When installing or removing a PCI card, heed the warnings and cautions listed in Section (page ). An overview of the PCI card installation procedure follows: 8 Itanium Processor Servers

29 . Remove the server cover.. Release the PCI I/O riser by turning the jackscrew, as shown in Figure -. This action frees the PCI I/O riser from the system board. Figure - Releasing the PCI I/O Riser. Remove the PCI I/O riser from the chassis (Figure -). Figure - Removing the PCI I/O Riser Assembly HPTC-07. Remove the PCI slot cover, as shown in Figure -5.. HP Integrity rx60 9

30 Figure -5 Removing the PCI Slot Cover HTPC-0 5. Grasp the edges of the PCI card being installed and gently press the connector into the PCI I/O riser connector, as shown in Figure -6. Figure -6 Sliding the Card into the PCI Riser Connector HPTC Insert the card mounting screw and secure it with a T-5 driver. 7. Replace the PCI I/O riser assembly by positioning the connector over the mating connector on the system board and then turning the jackscrew to complete the connector mating. 8. Connect any cables that are required by the PCI card. 9. Replace the server cover. More detailed information about this procedure is provided in the HP Integrity rx60 Installation Guide.. HP Integrity rx600 The dual-processor U HP Integrity rx600 can be used as an application node, control node, or utility node. HP Integrity rx600 nodes have. GHz or.5 GHz dual Intel Itanium processors and 6 MB of on-chip L cache. All nodes are fitted with a management processor (the outlined area in Figure -8) that provides access to system console, reset, power management, firmware upgrade, and system status via 0/00 LAN connections. The Management Processor (MP) is powered from the node's standby power source and is independent of the power on/off state of the node. Figure -7 shows the front of the HP Integrity rx Itanium Processor Servers

31 Figure -7 HP Integrity rx600 Front Panel 5 The following list describes the callouts shown in Figure -7: Item 5 Description SCSI drives Locator LED Diagnostic LEDs Power switch CD-ROM drive Table - describes the ports on the rear of the HP Integrity rx600 that are used for connections to other cluster components. These ports are identified by the callouts in Figure -8. Refer to the cabling tables for explanations of the connection origins and destinations. Figure -8 HP Integrity rx600 Rear View The following list corresponds to the callouts shown in Figure -8.. Power (PWR). LAN 0/00. 0/00/000 LAN. MP VGA, serial, LAN, reset 5. 0/00 LAN 6. USB ports (mouse and keyboard ports labelled) 7. PCI Slot 0. HP Integrity rx600

32 Table - HP Integrity rx600 Ports Used in Clusters Callout Port Label Node Role Cluster Cabling Name and Description PWR All Power input is used for the single power connection. MP 0/00 Control and utility MP Console, CES The management processor Ethernet LAN connection. This 0/00 Base-T port is connected to the root console switch (CES) in the Utility Building Block (UBB). LAN Gb Control and utility NIC (Administrative, AES) The Gigabit Ethernet Port. This Base-T 0/00/000 Ethernet port is connected to the root administrative switch (AES) in UBB. VGA Control Video Port. This port is optionally connected to the cluster's KVM console 5 LAN 0/00 All NIC The LAN Ethernet Port. This 0/00 Base-T Ethernet port is optionally connected to the site WAN, enabling remote connections to the cluster's control node. 6 USB Control Upper of the two stacked USB ports. Use this port only for the optional connection to the KVM mouse and keyboard. Do not use the ports labelled keyboard and mouse. 7 PCI Slot 0 Optional for the control node The PCI-X slot in which the interconnect card is installed. Slot 0 is at the top and slot is at the bottom. The node role column in Table - defines whether the connection is used in an application node, a control node, or a utility node. Refer to the server documentation for definitions of the remaining ports, but be aware that you should never make additional connections to a server that is configured for a specific role in the cluster... Network Port Assignments The HP Integrity rx600 has three embedded network ports: Management processor (MP) 0/00 Ethernet port, connected to the cluster's console network switch. NIC 0/00 Ethernet port, optionally connected to the local WAN, enabling remote access. NIC Gigabit Ethernet port, connected to the administrative network. Figure -9 HP Integrity rx600 Network Ports The following list describes the callouts in Figure -9. Itanium Processor Servers

33 . LAN 0/00 (management port). Management card. VGA. GSP reset (soft) 5. GSP reset (hard) 6. LAN 0/00 (NIC ) 7. LAN Gb (NIC ) The ports, their labels, and the corresponding HP Cluster Platform cabling identifiers are shown in Figure -9. A single embedded gigabit Ethernet port is available on the HP Integrity rx600 (NIC). This Gigabit Ethernet port is dedicated to the cluster's administrative network. This connection differs from the HP Integrity rx60 where NIC is the connection to the cluster's administrative network. Refer to the cluster's cabling tables for more information... Supported Memory Configurations HP Cluster Platform does not enforce any memory configuration rules on the HP Integrity rx600 nodes, other than those associated with the server used. For the HP Integrity rx600 these rules are: The system has memory slots for installing DDR SDRAM memory modules. The system supports a maximum of GB of memory and a minimum of 5 MB. Memory modules can either be 56 MB, 5 MB, or GB, and they must be arranged as ordered pairs of equal size. For example, if you place a GB memory module in slot 0A, you must insert a GB memory module in slot 0B. Memory in the HP Integrity rx600 must be loaded in quads. This means that you must load two memory cards per cell. For example, using the loading order provided above, place two DIMMs in slots 0A and 0B of memory cell 0, and two DIMMs in slots A and B in memory cell. DDR SDRAM must be loaded as matched pairs. To determine if the DIMMs are matched pairs, look at the HP part number on the DIMMs. If the HP part numbers match, then the DIMMs can be loaded together as a pair. You can mix module sizes in the system, provided that DIMMs in each pair share the same HP part number. For example, it is acceptable to load a pair of 56 MB DIMMs in slots 0A and 0B, a pair of GB DIMMs in slots A and B, then load 5 MB DIMMs in slots A, B, A, and B. You must install the first DDR SDRAM matched pair in memory cell 0 and in the slots labeled DIMM 0A and DIMM 0B. Load the second matched pair in memory cell and in the slots labeled DIMM A and DIMM B. Continue loading successive matched pairs using the sequence described in Table -. Table - Memory Slot Loading Order Load Order Memory Cell 0 Load Order Memory Cell A Slots st DIMM 0A nd DIMM A 5th DIMM A 6th DIMM 5A rd DIMM A th DIMM A B Slots st DIMM 0B nd DIMM B. HP Integrity rx600

34 Table - Memory Slot Loading Order (continued) Load Order Memory Cell 0 Load Order Memory Cell 5th DIMM B 6th DIMM 5B rd DIMM B th DIMM B The HP Integrity rx600 supports the chip spare feature, enabling the server's error handling to bypass an entire DDR SDRAM chip on a DIMM if a multi-bit error is detected. To use the chip spare feature, you must install only DIMMs built with DDR SDRAM. Load the memory in quads, that is, two DIMMs per memory cell, loaded in the same location in each memory cell and according to the sequence described in Table -. Use the following upgrade rules: Begin with four identical DIMMs. Load them into the slots labeled Load Order st and nd. Add four identical DIMMs (identical to each other, but potentially different from the original quad). Load them in the slots labeled Load Order rd and th. Finally, add four identical DIMMs (identical to each other, but potentially differing from the existing two quads). Load them in the slots labeled Load Order 5th and 6th... Supported Storage Configurations The HP ProLiant DL60 G server supports up to three hot-pluggable LVD.5-inch SCSI drives. Local storage for a node varies depending on the role of the node. The following drives are supported: 6 GB 0K RPM 6 GB 5K RPM 7 GB 0K RPM Important: Power subsystem design for racks containing nodes must be designed for nodes that have disk configurations that draw maximum current. The physical procedures used to insert and remove a disk drive are discussed in the document that comes with the drive. However, the operating system must be prepared for insertion or removal of a disk, or unexpected and harmful effects may occur. Note: There is a significant difference between the terms hot-pluggable and hot-swappable. The hot-swappable process enables you to replace a component in a high-availability system while it is running without using operating system commands. The hot-pluggable process enables you to replace a component in a high-availability system while it is running, but a manual software procedure is necessary to complete the task. The disk drives in the HP Integrity rx600 are hot-pluggable, not hot-swappable. In addition to the Ethernet connection from the management processor, the HP Integrity rx600 server provides a 0/00 Base-T port and a 0/00/00 Base-T port. It also has four PCI-X slots. Each slot is on a separate bus, but only one bus has sufficient throughput in its connection memory to support the full PCI-X bandwidth (approximately GB per second). The other three slots provide approximately 5 MB per second... Cable Management Each HP Integrity rx600 with a connection to the system interconnect requires one cable management tray installed on the end of its rail kit. This component is described in HP XC6000 Cable Management Tray Installation Guide. Itanium Processor Servers

35 ..5 Installing or Removing a PCI Card The HP Integrity rx600 has four 6-bit, MHz PCI-X card slots in a removable PCI/AGP cage. To remove and replace a PCI card, remove the server s cover and take out the PCI card cage. Removal instructions are provided on the card cage label. Detailed information is provided in HP Integrity rx600 Server and HP Workstation zx Operations and Maintenance Guide. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). An overview of the PCI installation procedure follows:. Remove the AGP shipment retainer and slide off the lid of the card cage as shown in Figure -0. Identify slot, which is the topmost slot when the card cage is installed in the server. Figure -0 Removing the Card Cage HPTC-00. Remove the AGP shipment retainer and slide off the lid of the card cage as shown in Figure -. Figure - Opening the Card Cage HPTC-00 When installing a card, first remove the bulkhead screw and blanking plate as shown in Figure -.. Install the card into PCI slot only.. HP Integrity rx600 5

36 Figure - Removing the Blank Retain the screw to secure the card and save the blank plate for later use if the card is removed.. Insert (or remove) the card and secure it with a bulkhead screw as shown in Figure -. Figure - Inserting the Card HPCT If you remove a card, ensure that you replace the blank plate to maintain the correct airflow for optimum cooling.. HP Integrity rx60 The HP Integrity rx60 is an updated version of the rx600 described in Section.. It has the same physical format, but provides additional features and specifications described in Table -5. Table -5 HP Integrity rx60 Features Component Processor board Specification Up to processors Chipset: HP zx System bus bandwidth: 6. GB/s Processors supported Type: Intel Itanium processor Speeds:.6 GHz and. GHz Level cache: KB Level cache: 56 KB Level cache: 6 MB or MB at.6 GHz, MB at. GHz Main memory Bus bandwidth: 8.5 GB/s RAM type: PC00 ECC registered DDR66A SDRAM Capacity: GB maximum Memory slots: DIMM slots 6 Itanium Processor Servers

37 Table -5 HP Integrity rx60 Features (continued) Component Internal storage devices Specification Internal hard disk drive bays: Disk drive sizes: 6 GB, 7 GB, and 6 GB drives available Disk drive interface: Ultra0 SCSI Removable media: open bay for DVD-ROM or DVD+RW Maximum internal storage Expansion slots Core I/O and management processor interconnect 8 GB ( x 6 GB) full-length 6-bit/MHz PCI-X Two 0/00/000 Base-T Ethernet One 0/00Base-T management LAN Dual channel Ultra0 SCSI USB.0 ports RS- serial ports for general use, and RS- serial ports Figure - and Figure -5 show the front and rear panel of the HP Integrity rx60, including labels for the ports. The port assignments in HP Cluster Platform are the same as those of the HP Integrity rx600, described in Table -. Figure - HP Integrity rx60 Front Panel 5 6 The following table describes the callouts in Figure -. Item 5 6 Description Control panel DVD drive LVD HDD LVD HDD LVD HDD System product label (pull-out). HP Integrity rx60 7

38 Figure -5 HP Integrity rx60 Rear Panel 5 9 WARNING Unplug all power cords from system before servicing PWR PWR LAN 0/00 Management Card CONSOLE VGA MP CONSOLE / REMOTE / UPS RESET SERIAL A Automatic Internal SCSI Termination SCSI LVD/SE LAN Gb A LAN Gb B TOC USB SERIAL B The following table describes the callouts in Figure -5. Item Description AC power receptacles (AC on the left and AC on the right) LVD/SE SCSI 0/00 management LAN LAN Gb A (0/00/000 LAN) VGA port LAN Gb B (0/00/000 LAN) Locator button/led ToC button Console/Remote/UPS USB ports Console/Serial Port A Serial port B PCI slots ( through, beginning at the top) Table -6 provides a quick reference to these connections. Table -6 Quick Reference for HP Integrity rx60 Connections Label LAN 0/00 LAN Gb A VGA USB PCI slot Description Management LAN Gigabit Ethernet LAN Video Out Upper port of the two stacked USB ports Top of the four full-length 6-bit/MHz PCI-X slot Connection Console ProCurve Switch, CES. Administrative ProCurve Switch, AES. Optionally connect to KVM, if this is a control node. Optionally connect to KVM USB mouse and keyboard, if this is a control node. (Do not use the USB ports that are labeled with a mouse and keyboard icon.) Install an HBA or HCA adapter for the appropriate interconnect... PCI Slot Assignments The HP Integrity rx60 has four PCI slots. Table -7 summarizes the slot assignments and the PCI cards. 8 Itanium Processor Servers

39 Table -7 HP Integrity rx60 PCI Slot Assignments Slot Assignment PCI interconnect (optional) 0/00/000 BaseT NIC (optional) Fibre Channel HBA (optional) Fibre Channel HBA (optional) or 0/00/00 BaseT NIC (optional) or empty To install an interconnect host bus adapter (HBA) or host channel adapter (HCA) card in the HP Integrity rx60, use the procedure described in Section..5. See the following documents for more information: HP Integrity rx60 Installation Guide: HP Integrity rx60 Maintenance Guide: To upgrade the processor(s) in the HP Integrity rx60, see the HP Integrity rx60 Single-Core to Dual-Core Processor Upgrade Guide HP Integrity rx660 The HP Integrity rx660 is a U rack-mount system. The server s internal peripherals include serial-attached SCSI (SAS) disks and a DVD or DVD+RW drive. Its high availability features include N+ hot-swappable fans, + hot-swappable power supplies, and SAS disks. It contains up to two single- or dual-core Itanium processors and up to GB of memory. Table -8 describes the components and specifications of the HP Integrity rx660. Table -8 HP Integrity rx660 Features Component Processors Specification Up to Itanium processors:.6 GHz / 6 MB cache single-core. GHz / MB cache dual-core.6 GHz / 8 MB cache dual-core Memory Eight DIMM slots located on the system board: Supported DDR DIMM sizes: 5 MB, GB, GB, and GB Minimum memory ( x 5 MB DIMMs): GB Maximum memory (8 x GB DIMMs): GB Disk Drives One to eight hot-pluggable SAS hard drives: 6 GB SAS hard drive 7 GB SAS hard drive PCI slots Three public PCI-X/e slots: One MHz, two 66MHz for PCI-X systems, OR One MHz, two PCI-e x8 for PCI-e systems, OR Three PCI-e x8 for PCI-e systems (future release) SAS core I/O Eight-port SAS core I/O card. HP Integrity rx660 9

40 Table -8 HP Integrity rx660 Features (continued) Component Specification There are also a pair of internal slots dedicated to optional RAID 5/PCI-e for the SAS drives. LAN system I/O Management core I/O Two GigE LAN ports One serial port, and one 0 Base-T/00 Base-T LAN port Note: There is an additional serial port, USB ports, ( front, rear), and VGA ports ( front, rear) on the server Optical device Power supply One DVD or DVD+RW One power supply (900 watts at 0 VAC; 000 watts at 0 VAC, + redundancy with second power supply Figure -6 shows the front panel of the HP Integrity rx660. Figure -6 HP Integrity rx660 Front Panel The following table describes the callouts shown in Figure -6. Item Description System Insight Display Small form factor (SFF).5 inch serial-attached SCSI (SAS) disk drives Power button External health LED Internal health LED System health LED Init (Transfer of Control) button Unit ID (UID) button USB port VGA port DVD or DVD-RW drive Figure -7 shows the rear panel of the HP Integrity rx Itanium Processor Servers

41 Figure -7 HP Integrity rx660 Rear Panel The following table describes the callouts shown in Figure -7. Item Description PCI-X/PCI-E slot PCI-X/PCI-E slot PCI-X/PCI-E slot System LAN port Auxiliary serial port VGA port Power supply Console serial port Power supply LED Power supply ilo MP reset button UID Locator button/led Standby power ilo MP heartbeat BMC heartbeat ilo MP self-test LAN link status LED LAN link speed LED ilo MP LAN port USB ports LAN link status LED (LAN port ) Comments PCI Express Interconnect Optional outside world Connect to Console Network Switch (CES). HP Integrity rx660

42 Item Description System LAN port LAN link speed LED (LAN port ) Comments Connect to Administrative Network Switch (AES).. PCI Slot Assignments The HP Integrity rx660 has three PCI slots. Table -9 and Table -0 summarize the slot assignments and the PCI cards. Table -9 HP Integrity rx660 PCI Express Slot Assignments Slot PCI-e Bus Assignment: PCI Configuration Comment A PCI Express x B PCI Express x C PCI Express x D PCI Express x8 5 E PCI Express Interconnect x8 Table -0 HP Integrity rx660 PCI Mixed Slot Assignments Slot PCI-Mixed Bus Assignment: PCI Configuration Comment A PCI Slot x B PCI Slot x C PCI Express Interconnect x8 D PCI Slot 6 bit MHz 5 E PCI-X Interconnect 6 bit MHz.. Removing the I/O Backplane Assembly The I/O backplane assembly consists of the I/O backplane board and a sheet metal enclosure. The I/O backplane board contains three full-length public I/O slots. To remove a PCI card from the HP Integrity rx660, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis. Caution: Observe all ESD safety precautions before attempting this procedure. Failure to follow ESD safety precautions may result in damage to the server.. Power down the server. Itanium Processor Servers

43 . Disconnect the AC power cord, first from the AC outlet and then from the server. Warning! Ensure that the system is powered off and all power sources have been disconnected from the server prior to performing this procedure. Voltages are present at various locations within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Failure to observe this warning may result in personal injury or damage to equipment.. Remove the server from the rack. 5. Remove the access panel from the server. 6. Disconnect all internal and external cables attached to the I/O cards in the I/O backplane assembly. Caution: Record the slot location of all PCI cards as they are removed. Depending on the operating system, replacing the PCI cards in a different location may require system reconfiguration and may cause boot failure. 7. Loosen the two captive screws as shown by callout in Figure -8. Check the removal instructions on the backplane assembly (see callout in Figure -8). Figure -8 Removing the I/O Backplane Assembly a. Press the blue button to release the black knob. b. Turn the black knob counterclockwise until the captive screw is free from the system board. 8. Using the sheet metal tab (see callout in Figure -8) lift the assembly straight up and out of the server.... Integrity rx660 PCI X and PCI-X/PCI-E I/O Backplane Assembly Options Figure -9 shows an Integrity rx660 PCI-X I/O backplane assembly and Figure -0 shows a mixed PCI-X/PCI-E I/O backplane assembly.. HP Integrity rx660

44 Figure -9 Integrity rx660 PCI-X I/O Backplane Assembly The following list describes the callouts shown in Figure -9:. Gate latches. PCI-X backplane assembly. Guide tabs. Slotted T5 screws 5. PCI slot covers 6. PCI-X slot 7. PCI-X slot 8. PCI-X slot 9. PCI-X riser board Figure -0 Integrity rx660 Mixed PCI-X/PCI E I/O Backplane Assembly The following list describes the callouts shown in Figure -0:. PCI-E slot. PCI-E slot Itanium Processor Servers 5

45 . PCI-X slot. Mixed PCI-X/PCI-E riser board.. Installing PCI Cards in the Integrity rx660 Ensure that you install the proper drivers for the PCI-X/PCI-E card before installing the card. To install a PCI-X/PCI-e card, follow these steps:. Remove the I/O backplane assembly as described in Section.... Remove the defective PCI card or install a new PCI-X or PCI-E card.. If not already removed, remove the appropriate slot cover (see callout 5 in Figure -9) for the PCI slot to be used.. Insert the replacement card into the PCI slot: a. Insert the tab at the base of the card bulkhead into the slot in the server. b. Align the card connectors with the slots on the I/O backplane board. c. Apply firm, even pressure to both sides of the card until it fully seats into the slot. Caution: Ensure that you fully seat the card into the slot or the card may fail after power is applied to the slot. 5. Close the gate latch to secure the end of the card. 6. Replace the slotted T5 screw that attaches the card bulkhead to the server; use a T5 driver to turn the screw clockwise until it tightens to the server. 7. Install the I/O backplane assembly into the server. 8. Connect all internal and external cables to the PCI cards in the I/O backplane assembly. 9. Replace the top cover. 0. Slide the server completely back into the rack.. Reconnect the power cables and power on the server..5 HP Integrity rx600 The HP Integrity rx600 is a U, quad processor server that typically functions as a control node, utility node, or I/O node. It is a -socket system IPF rack-mount server based on the Itanium processor family architecture. The server accommodates up to DIMMs and internal peripherals, including disks and DVD-ROM. Its high availability features include hot-swappable fans and 00-0 VAC power supplies, hot-pluggable disk drives, and hot-pluggable PCI-X cards. Figure - shows the front view of the HP Integrity rx600. Figure - HP Integrity rx600 Front View All nodes are fitted with an MP that provides access to system console, reset, power management, firmware upgrade, and system status via 0/00 LAN connections. The MP is powered from the node's standby power source and is independent of the power on/off state of the node. Figure - shows rear ports of the HP Integrity rx HP Integrity rx600 5

46 Figure - HP Integrity rx600 Rear View 5 6 Table - describes the ports on the rear of the HP Integrity rx600 that are used for connections to other cluster components. These ports are identified by the callouts in Figure -. Refer to the cabling tables for explanations of the connection origins and destinations. Table - HP Integrity rx600 Ports Used in Clusters Callout 5 6 Port Label PWR 0 and PWR Screen Icon USB ports MP LAN LAN Gb N/A Cluster Cabling Name and Description When used as a control node only, both power supplies are used to provide redundancy. Otherwise, utility nodes use only PWR 0. VGA Video Port. When used as a control node, this port is optionally connected to the cluster's KVM console. Use only the upper of the two stacked USB ports. When this server is used as a control node, use USB port for the optional connection to the KVM mouse and keyboard. Do not use the ports labeled keyboard and mouse. MP (Console, CES). The MP Ethernet LAN connection. This 0/00 Base-T port is connected to the root console switch (CES) in the UBB. NIC (Administrative, AES) The gigabit Ethernet port in PCI slot. This 0/00/000 Base-T Ethernet port is connected to the root administrative switch (AES) in the UBB. PCI (slot 8). The spare Ethernet port in PCI slot is designated NIC and might also be used for an optional connection to the site WAN, depending on the server's role. Refer to the server documentation for definitions of the remaining ports, but be aware that you should never make additional connections to a server that is configured for a specific role in the cluster..5. Supported Memory Configurations The HP Cluster Platform does not enforce any memory configuration rules on the control node and utility nodes other than those associated with the server used. You can use DIMMs of 56 6 Itanium Processor Servers

47 MB, 5 MB, GB, and GB providing you follow the upgrade rules for mixed DIMMs. For the HP Integrity rx600 these rules are: The HP Integrity rx600 has a sixteen-dimm memory extender board that is minimally configured with GB of memory, four 56 MB DIMMs loaded in quad 0 (slots 0A, 0B, 0C, and 0D. An optional DIMM memory extender board is available to replace the 6-DIMM memory extender board. Configure the extender board with a minimum of GB in quad 0. Install additional DIMMs into both 6 and DIMM boards. When adding DIMMs, use a minimum of four DIMMs of identical size, and install them in the next available quad. You can use DIMMs of varying size across the entire extender board, but all four DIMMs in each quad must be of an identical size. Remove slot fillers only to add DIMMs. Do not leave any empty slots without a filler because this can affect system cooling..5. Upgrading the HP Integrity rx600 To upgrade the processor(s) in the HP Integrity rx600, see the HP Integrity rx600 Server Upgrade Guide, Second Edition PCI-X Slot Assignment and Supported Options PCI-X slots are numbered from through 8, with the interconnect card in slot 8 on the far right of the enclosure, as shown in Figure -. The configuration requirements for slots through 8 are as follows: PCI slots and are dedicated for use by the core I/O cards SCSI HBA card in slot and dual-port gigabit Ethernet LAN card in slot. Slots and are not hot-pluggable capable. Do not install additional PCI-X expansion cards in slots or. Slots and are the first pair of shared slots, and slots 5 and 6 are the second pair of shared slots. The maximum capability of each of the shared slots is PCI-X 66 MHz. If a PCI-X MHz card is installed in a shared slot, its maximum capability is PCI-X 66 MHz. If different modes (PCI instead of PCI-X) or slower speeds ( MHz) are installed, the slot automatically downgrades to accept the change. Slots 7 and 8 are single slots. The maximum capability of each slot is PCI-X MHz. Only slots 7 and 8 will allow MHz, PCI-X cards to run at full speed. These two slots are not limited by bus-mode, frequency-related incompatibilities. Slot 8 is always used for the interconnect PCI card. Table - summarizes the slot assignments and the required and optional PCI cards. Table - HP Integrity rx600 PCI slot assignments Slot Bus Assignment Maximum Speed Core I/O: SCSI HBA 66MHz PCI-X Core I/O: Dual Port Gbit/sec Ethernet NIC 66MHz PCI-X 66MHz PCI-X First Gb/s Fibre Channel HBA (optional) 66MHz PCI-X 5 66MHz PCI-X 6 Second Gb/s Fibre Channel HBA (optional) 66MHz PCI-X 7 MHz PCI-X 8 5 Interconnect PCI adapter MHz PCI-X.5 HP Integrity rx600 7

48 The HP Cluster Platform hardware does not impose any restrictions on supported options. However, the system software can restrict supported options to guarantee performance, or to reduce qualification test matrices..5. Installing or Removing a PCI Card The HP Integrity rx600 provides eight PCI slots across five PCI-X buses and supports hot-pluggable PCI-X devices. However, you should not install the interconnect PCI adapter while the server is running. Also, take care to use only slot 8 on bus 5, which is the designated slot for HP Cluster Platform installations. Detailed information on installing PCI cards is provided in the HP Integrity rx600 Maintenance Guide When installing or removing PCI cards, heed the warnings and cautions listed in the Important Safety Information (page ). An overview of the PCI installation procedure follows:. Extend the server from the rack by removing the 5mm Torx screws that retain it in the rack and flip out the server s two pull handles. Use these handles to pull the server from the rack until it locks in place and the cover is accessible, as shown in Figure -. Figure - Removing the Screws that Secure the Server in the Rack. Remove the server s top rear cover to access the PCI slots by unscrewing the thumbscrews at the rear of the server, as shown in Figure -. 8 Itanium Processor Servers

49 Figure - Removing the Server's Top Panel. If you are inserting a card, remove the bulkhead screw that attaches the blank plate to the server chassis. Retain both the screw and the plate.. Insert the PCI adapter into slot 8, which is closest to the side of the server s case and furthest from the power inlet. Ensure that the card is level, as shown in Figure -5. Figure -5 Installing the PCI Card Secure the card using the bulkhead screw. 5. If you remove a card, ensure that you replace the blank plate to maintain the correct airflow for optimum cooling..5 HP Integrity rx600 9

50 .5.5 Cable Management Each HP Integrity rx600 that has a connection to the system interconnect requires one cable bracket installed on the rear rack column. This component is documented in the HP Cluster Platform Integrity rx600 Cable Bracket Installation Guide..6 HP Integrity rx60 The HP Integrity rx60 is a U, quad-processor server that typically functions as a control node, utility node, or I/O node. It is a -socket system rack-mount server based on the Itanium processor family architecture. The server accommodates up to DIMMs and internal peripherals including disks and DVD-ROM. Its high availability features include hot-swappable fans and 00-0 VAC power supplies, hot-pluggable disk drives, and hot-pluggable PCI-X cards. Figure -6 HP Integrity rx60 Front View All nodes are fitted with an MP that provides access to system console, reset, power management, firmware upgrade, and system status via 0/00 LAN connections. The MP is powered from the node's standby power source and is independent of the power on/off state of the node. Figure -7 shows the rear ports of the HP Integrity rx60. Figure -7 HP Integrity rx60 Rear View 5 6 Table - describes the ports on the rear of the HP Integrity rx60 that are used for connections to other cluster components. These ports are identified by the callouts in Figure -7. Refer to the cabling tables for explanations of the connection origins and destinations. 50 Itanium Processor Servers

51 Table - HP Integrity rx60 Ports Used in Clusters Callout 5 6 Port Label PWR 0 and PWR Screen Icon USB ports MP LAN LAN Gb N/A Cluster Cabling Name and Description When used as a control node only, both power supplies are used to provide redundancy. Otherwise, utility nodes use only PWR 0. VGA Video Port. When used as a control node, this port is optionally connected to the cluster's KVM console. When this server is used as a control node, use only the top USB port for the optional connection to the KVM mouse and keyboard. Do not use the ports labeled keyboard and mouse. MP (Console, CES). The MP Ethernet LAN connection. This 0/00 Base-T port is connected to the root console switch (CES) in the UBB. NIC (Administrative, AES) The Gigabit Ethernet Port in PCI slot. This 0/00/000 Base-T Ethernet port is connected to the root administrative switch (AES) in the UBB. PCI (slot 8). The spare Ethernet port in PCI slot is designated NIC and might also be used for an optional connection to the site WAN, depending on the server's role. Refer to the server documentation for definitions of the remaining ports, but be aware that you should never make additional connections to a server that is configured for a specific role in the cluster..6. Supported Memory Configurations The HP Cluster Platform does not enforce any memory configuration rules on the control node and utility nodes other than those associated with the server used. You can use DIMMs of 56 MB, 5 MB, GB, and GB providing you follow the upgrade rules for mixed DIMMs. For the HP Integrity rx60 these rules are: The HP Integrity rx60 has a 6-DIMM memory extender board that is minimally configured with GB of memory, four 56 MB DIMMs loaded in quad 0 (slots 0A, 0B, 0C, and 0D). An optional DIMM memory extender board is available to replace the 6-DIMM memory extender board. Configure the extender board with a minimum of GB in quad 0. Install additional DIMMs into both 6 and DIMM boards. When adding DIMMs, use a minimum of four DIMMs of identical size, and install them in the next available quad. You can use DIMMs of varying size across the entire extender board, but all four DIMMs in each quad must be of an identical size. Remove slot fillers only to add DIMMs. Do not leave any empty slots without a filler because this can affect system cooling..6. Upgrading the HP Integrity rx60 To upgrade the processor(s) in the HP Integrity rx60, see the HP Integrity rx60 Server Upgrade Guide, Second Edition HP Integrity rx60 5

52 .6. PCI-X Slot Assignment and Supported Options PCI-X slots are numbered from through 8, with the interconnect card in slot 8 on the far right of the enclosure, as shown in Figure -7. The configuration requirements for slots through 8 are as follows: PCI slots and are dedicated for use by the core I/O cards SCSI HBA card in slot and dual-port gigabit Ethernet LAN card in slot. Slots and are not hot-pluggable capable. Do not install additional PCI-X expansion cards in slots or. Slots and are the first pair of shared slots, and slots 5 and 6 are the second pair of shared slots. The maximum capability of each of the shared slots is PCI-X 66 MHz. If a PCI-X MHz card is installed in a shared slot, its maximum capability is PCI-X 66 MHz. If different modes (PCI instead of PCI-X) or slower speeds ( MHz) are installed, the slot automatically downgrades to accept the change. Slots 7 and 8 are single slots. The maximum capability of each slot is PCI-X MHz. Only slots 7 and 8 will allow MHz, PCI-X cards to run at full speed. These two slots are not limited by bus-mode, frequency-related incompatibilities. Slot 8 is always used for the interconnect PCI card. Table - summarizes the slot assignments and the required and optional PCI cards. Table - HP Integrity rx60 PCI slot assignments Slot Bus Assignment Maximum Speed Core I/O: SCSI HBA 66MHz PCI-X Core I/O: Dual Port Gbit/sec Ethernet NIC 66MHz PCI-X 66MHz PCI-X First Gb/s Fibre Channel HBA (optional) 66MHz PCI-X 5 66MHz PCI-X 6 Second Gb/s Fibre Channel HBA (optional) 66MHz PCI-X 7 MHz PCI-X 8 5 Interconnect PCI adapter MHz PCI-X The HP Cluster Platform hardware does not impose any restrictions on supported options. However, the system software can restrict supported options to guarantee performance, or to reduce qualification test matrices..6. Installing or Removing a PCI Card The HP Integrity rx60 provides eight PCI slots across five PCI-X buses and supports hot-pluggable PCI-X devices. However, you should not install the interconnect PCI adapter while the server is running. Also, take care to use only slot 8 on bus 5, which is the designated slot for HP Cluster Platform installations. Detailed information on installing PCI cards is provided in the HP Integrity rx60 Maintenance Guide When installing or removing PCI cards, heed the warnings and cautions listed in the Important Safety Information (page ). An overview of the PCI installation procedure follows:. Extend the server from the rack by removing the two 5mm Torx screws that retain it in the rack and flip out the server s two pull handles. Use these handles to pull the server from the rack until it locks in place and the cover is accessible (see callout in Figure -8). 5 Itanium Processor Servers

53 Figure -8 Removing the Screws that Secure the Server in the Rack. Remove the server s top rear cover to access the PCI slots by unscrewing the thumbscrews at the rear of the server (see callout in Figure -9). Figure -9 Removing the Server's Top Panel. If you are inserting a card, remove the bulkhead screw that attaches the blank plate to the server chassis. Retain both the screw and the plate.. Insert the PCI adapter into slot 8, which is closest to the side of the server s case and furthest from the power inlet. Ensure that the card is level, as shown in Figure HP Integrity rx60 5

54 Figure -0 Installing the PCI Card Secure the card using the bulkhead screw. 5. If you remove a card, ensure that you replace the blank plate to maintain the correct airflow for optimum cooling..6.5 Cable Management Each HP Integrity rx60 that has a connection to the system interconnect requires one cable bracket installed on the rear rack column. This component is documented in the HP Cluster Platform Integrity rx60 Cable Bracket Installation Guide. 5 Itanium Processor Servers

55 Xeon Processor Servers Several servers based on the Xeon processor are supported in HP Cluster Platform solutions. This chapter presents overviews of the following servers: HP ProLiant DL0 G (Section.). HP ProLiant DL0 G (Section. ). HP ProLiant DL60 G5 and G5p(Section.) HP ProLiant DL60 G, G, and Gp (Section.). HP ProLiant DL60 G5 (Section.5). HP ProLiant DL80 G and G (Section.6) HP ProLiant DL80 G5 (Section.7).. HP ProLiant DL0 G The HP ProLiant DL0 G server is a U, dual-processor capable server supporting Intel Xeon processors to.6 GHz/800 MHz with MB L cache. It provides 8 DIMM slots, enabling a maximum 6GB of PC-00 DDR memory. A standard full-height/full-length PCI express slot and an additional low-profile, half-length PCI slot are provided for adapters. The DL0 G supports non hot-pluggable serial ATA (SATA) and SCSI hard disk drives. Table - lists the features of the HP ProLiant DL0 G. Table - HP ProLiant DL0 G Features Feature Available processor and cache, maximum processors per chassis Specification Intel Xeon.6 GHz/800 MHz - M Intel Xeon. GHz/800 MHz - M Intel Xeon.8 GHz/800 MHz - M Memory type Maximum memory Storage (Maximum hard drives of one type) PC-00 DDR 6 GB Non-hot-pluggable Serial ATA (integrated controller) Non-hot-pluggable SCSI removable media bay Storage Controller Standard integrated dual channel SATA controller (SATA models) Optional single channel wide Ultra SCSI adapter (in a PCI slot; SCSI Models) Network ( ports) Remote management Dual integrated 0/00/000 Broadcom 57 Lights Out 00i Figure - and Figure - identify the front and rear panel features of the HP ProLiant DL0 G, which has the same physical features as the AMD Opteron-based ProLiant DL5 G.. HP ProLiant DL0 G 55

56 Figure - HP ProLiant DL0 G Front Panel 6 8 HP ProLiant DL The following table describes the callouts in Figure -. Table - HP ProLiant DL0 G Front Panel Features Item Description Hard disk drive (HDD) bays Optical media device bay Unit identification (UID) button with LED indicator (blue) System health LED indicator (amber) Activity/link status LED indicators for NIC and NIC (green) HDD activity LED indicator (green) USB.0 ports Power button with LED indicator (bicolor: green and amber) Thumbscrews for the front bezel Figure - HP ProLiant DL0 G Rear Panel The following table describes the callouts in Figure -. Table - HP ProLiant DL0 G Rear Panel Features Item Description Ventilation holes Thumbscrew for the top cover Thumbscrews for the PCI riser board assembly Gigabit Ethernet LAN ports for NIC (RJ-5) Gigabit Ethernet LAN ports for NIC (RJ-5) Low-profile 6-bit MHz PCI-X riser board slot cover USB.0 ports (black) Video port (blue) 56 Xeon Processor Servers

57 Table - HP ProLiant DL0 G Rear Panel Features (continued) Item 9 0 Description Serial port (teal) Standard height, full-length 6-bit/ MHz PCI-X riser board slot cover. You can convert the PCI-X functionality of this slot to PCI Express using the PCI Express riser board option kit. PS/ keyboard port (purple) PS/ mouse port (green) 0/00 MB/s LAN port for IPMI management (RJ-5) IEC power inlet.. HP ProLiant DL0 G PCI Slot Assignments The ProLiant DL0 G has two PCI Express slots on the rear of the chassis. Table - summarizes the slot assignments. Table - HP ProLiant DL0 G PCI Slot Assignments Slot Assignment PCI-X interconnect 6-bit MHz PCI-X.. HP ProLiant DL0 G Memory Configurations The HP ProLiant DL0 G has eight DIMM slots that support up to 6 GB maximum system memory ( GB in each of the eight DIMM slots). Observe the following rules when installing memory modules: Use only HP supported PC-00 (00 MHz) registered ECC DIMMs in 5 MB, GB, or GB capacities. Install memory modules in pairs of the same size. Install memory modules in progressively larger capacity, following the slot sequence listed in Table -5. Table -5 HP ProLiant DL0 G Memory Module Sequence Slot DIMMA and DIMMB DIMMA and DIMMB DIMMA and DIMMB DIMMA and DIMMB Capacity Smallest capacity modules, such as 5 MB. Next largest capacity modules Next largest capacity modules Largest capacity modules, such as GB.. Installing a PCI Card in the HP ProLiant DL0 G There are two PCI expansion slots on the system board, as shown by callouts 6 and 0 in Figure -. Table -6 HP ProLiant DL0 G PCI Slots Slot 6-bit MHz PCI-X slot (left) 6-bit MHz PCI-X slot (right) Capabilities Supports a low profile 6-bit, MHz PCI-X riser board Supports a standard height, full-length 6-bit MHz PCI-X riser board To install a standard height interconnect host bus adapter (HBA) or host channel adapter (HCA) in PCI slot (right side), follow these steps:. HP ProLiant DL0 G 57

58 . Remove the cover as follows: a. Loosen the captive thumbscrew on the rear panel. This screw is identified by item in Table -. b. Slide the cover approximately.5 cm (0.5 in) toward the rear of the unit, then lift the cover to detach it from the chassis. c. Place the top cover in a safe place for reinstallation later.. Loosen the two captive thumbscrews that secure the PCI card cage to the chassis, as shown in Figure -. Figure - Removing the HP ProLiant DL0 G PCI Card Cage. Lift and remove the PCI card cage from the chassis, as shown in Figure -. Figure - HP ProLiant DL0 G PCI Card Cage. Identify the wider standard height, full-length 6-bit/ MHz PCI-X slot that is compatible with the interconnect adapter (see Figure -). 5. Slide the interconnect adapter board into the PCI slot, as shown in Figure -5. Press the board firmly to seat it properly on the connector. 58 Xeon Processor Servers

59 Figure -5 Installing an Interconnect Adapter in the HP ProLiant DL0 G PCI Card Cage 6. Reinstall the PCI riser board assembly as follows: a. Align the assembly with the system board expansion slots, then press it down to ensure full connection to the system board. b. Tighten the two captive thumbscrews to secure the assembly to the chassis. 7. Replace the server lid by reversing the procedure described in Step. For more information, see the following documents: HP ProLiant DL0 Generation Server Installation Sheet HP ProLiant DL0 Generation Server Maintenance and Service Guide. HP ProLiant DL0 G Used in HP Cluster Platform and Scalable Visualization Array The HP ProLiant DL0 G server is a U, dual-processor capable server supporting Intel Xeon dual-core processors to.0 GHz/ MHz with MB ( x MB) Level cache (500 series), or MB ( x MB) Level cache (5000 series). It provides 8 DIMM slots, enabling a maximum 6 GB of PC-500 DDR 667 memory. A standard full-height, full-length PCI express slot and an additional low-profile, half-length PCI slot are provided for adapters. The DL0 G supports non hot-pluggable serial ATA (SATA) and SCSI.5-inch hard disk drives. The DL0 G also supports up to two hot-pluggable Serial ATA (SATA) or Serial Attached SCSI (SAS).5 inch hard drives and is used as a compute node in HP Cluster Platform configurations. It is also used as a compute node or as a render node in HP Cluster Platform Scalable Visualization Array (SVA) configurations. Table -7 lists the features of the HP ProLiant DL0 G. Table -7 HP ProLiant DL0 G Features Feature Up to two () dual-core processors per chassis Specification Dual-Core Intel Xeon Processor 560,.00 GHz, MHz Front Side Bus (FSB) Dual-Core Intel Xeon Processor 550,.66 GHz, MHz FSB Dual-Core Intel Xeon Processor 50,. GHz, MHz FSB Dual-Core Intel Xeon Processor 50,.0 GHz, MHz FSB Dual-Core Intel Xeon Processor 50,.60 GHz, 066 MHz FSB Dual-Core Intel Xeon Processor 5080,.7 GHz, 066 MHz FSB Dual-Core Intel Xeon Processor 5060,.0 GHz, 066 MHz FSB Dual-Core Intel Xeon Processor 5050,.00 GHz, 667 MHz FSB. HP ProLiant DL0 G Used in HP Cluster Platform and Scalable Visualization Array 59

60 Table -7 HP ProLiant DL0 G Features (continued) Feature Cache Specification 500 series: MB (x MB L cache) 5000 series: MB (x MB L cache) Memory type Maximum memory Storage (Maximum two.5 hard drives of one type) PC-500 Fully Buffered DIMMs (DDR-667) with Advanced ECC 6 GB Non hot-pluggable Serial ATA Non hot-pluggable SCSI Hot-pluggable Serial ATA (SATA) Serial Attached SCSI (SAS) removable media bay Storage Controller Non hot-pluggable models: HP embedded SATA RAID controller (non hot-pluggable SATA models) Hot-pluggable models: HP 8 internal port SAS HBA with RAID 0,, 0 (hot-pluggable SATA/SAS models) Network ( ports) Remote management Dual integrated 0/00/000 Broadcom 57 (Wake on LAN and PXE capable) HP ProLiant Lights Out 00i Figure -6 identifies the front panel features of the HP ProLiant DL0 G with hot-pluggable drives. The rear panel features of the DL0 G are the same as the DL0 G as shown in Figure -. Figure -6 HP ProLiant DL0 G Front Panel The following table describes the callouts in Figure -6. Table -8 HP ProLiant DL0 G Front Panel Features Item Description Hard disk drive (HDD) bays with hot-pluggable drives shown (otherwise, the front panel is the same as the DL0 G) Optical media device bay Unit identification (UID) button with LED indicator (blue) System health LED indicator (amber) Activity/link status LED indicators for NIC and NIC (green) HDD activity LED indicator (green) USB.0 ports 60 Xeon Processor Servers

61 Table -8 HP ProLiant DL0 G Front Panel Features (continued) Item 8 9 Description Power button with LED indicator (bicolor: green and amber) Thumbscrews for the front bezel.. HP ProLiant DL0 G PCI Slot Assignments The ProLiant DL0 G has two PCI Express slots (optional PCI-X) on the rear of the chassis. All slots can accept universal keyed PCI cards. Table -9, Table -0, and Table - summarize the PCI slot assignments. Table -9 summarizes the PCI Express slot assignments for the DL0 G. Table -9 HP ProLiant DL0 G PCI Express Slot Assignments Slot Assignment x6 PCI Express (full-length, full-height) x PCI Express (half-length, low-profile) Comment Interconnect Table -0 summarizes optional PCI-X slot assignments for the DL0 G. Table -0 HP ProLiant DL0 G PCI-X Slot Assignments Slot Assignment Full-length, full-height PCI-X 00 ( MHz capable if only one PCI-X card is installed) Half-length, low-profile PCI-X 00 ( MHz capable if only one PCI-X card is installed) Comment Interconnect Table - summarizes the PCI Express graphics card slot assignments used in HP Cluster Platform SVA configurations. Table - HP ProLiant DL0 G Graphics Card PCI Express Slot Assignments (SVA) Slot Assignment x6 PCI Express (full-length, full-height) PCI Express Comment Dual-port graphics adapter.. HP ProLiant DL0 G Memory Configurations The HP ProLiant DL0 G has eight DIMM slots that support up to 6 GB maximum system memory ( GB in each of the eight DIMM slots). Observe the following rules when installing memory modules: Use only HP supported PC-500 fully buffered DIMMs (DDR 667) with advanced ECC capability in 5 MB, GB, or GB capacities. Install memory modules in pairs of the same size. Install memory modules in progressively larger capacity, following the slot sequence listed in Table -. Table - HP ProLiant DL0 G Memory Module Sequence Slot DIMMA and DIMMB DIMMA and DIMMB Capacity Smallest capacity modules, such as 5 MB Next largest capacity modules. HP ProLiant DL0 G Used in HP Cluster Platform and Scalable Visualization Array 6

62 Table - HP ProLiant DL0 G Memory Module Sequence (continued) Slot DIMMA and DIMMB DIMMA and DIMMB Capacity Next largest capacity modules Largest capacity modules, such as GB.. Installing a PCI Card in the DL0 G Installation of PCI cards in the DL0 G PCI riser board is the same as the DL0 G described previously in Section... The HP ProLiant DL0 Generation Server supports up to two optional PCI-X riser boards. For more information on HP ProLiant DL0 G, see the ProLiant 00 Series Servers User Guide.. HP ProLiant DL60 G5 and G5p The HP ProLiant DL60 G5 uses 500-series Intel Xeon processors and chipsets, with four disk drive bays in a U form factor. The DL60 G5 has two x6 PCI Express.0 slots, four.5-inch drives with terabytes (TB) of storage capacity. The DL60 G5 also has a 600MHz front-side bus. The DL60 G5 and G5p can be used as a control node, a utility node, and a compute node in HP Cluster Platform configurations. For the features and specifications of the HP ProLiant DL60 G5, go to: For the features and specifications of the HP ProLiant DL60 G5p, go to: Figure -7 shows the front view of the ProLiant DL60 G5 and G5p. Figure -7 HP ProLiant DL60 G5 and G5p Front View The following list describes the callouts shown in Figure -7:. Thumbscrews for rack mounting (quantity ). Optical disk drive bay. Serial number pull tab. Two front USB.0 ports 5. Unit identification (UID) LED button 6. System health LED 7. NIC LED 8. NIC LED 9. Power button with LED indicator (bicolor: green and amber) 0. Hard disk drive (HDD) LED. HDD bays,,, and 6 Xeon Processor Servers

63 Figure -8 shows the rear view of the ProLiant DL60 G5 and G5p. Figure -8 HP ProLiant DL60 G5 and G5p Rear View The following list describes the callouts shown in Figure -8:. Power supply cable socket. PS/ mouse port (green). GbE LAN port for NIC. Captive thumbscrew for top cover 5. Serial port (teal) 6. Low profile/half length expansion slot 7. Full-height/Full-length expansion slot 8. T0/T5 wrench 9. Thumbscrew for PCI cage 0. UID LED button. VGA port. HP LO00i management LAN port. Two rear USB.0 ports. GbE LAN port for NIC/Management 5. PS/ keyboard port (purple).. PCI Slot Assignments The following table describes the PCI slot assignments when the DL60 G5 is used in HP Cluster Platform solutions: PCI Slot Assignment PCI Interconnect/ PCI-E x6 Gen PCI-E x6 Gen For additional information, such as the system board layout and installing PCI cards, see the HP ProLiant DL60 Generation 5 Server Maintenance and Service Guide: For additional information, such as the system board layout and installing PCI cards, see the HP ProLiant DL60 Generation 5p Server Maintenance and Service Guide: HP ProLiant DL60 G, G, and Gp By combining concentrated U compute power, integrated lights-out management, and essential fault tolerance, the HP ProLiant DL60 is optimized for space constrained data center installations. Table - compares the features of the HP ProLiant DL60 G and the HP ProLiant DL60 G.. HP ProLiant DL60 G, G, and Gp 6

64 Table - ProLiant DL60 G, G and Gp Model Comparison Feature Processor Processor cache FSB Drive controller NIC Memory Drive bays Management i/o slots Maximum memory Power supply Fan Chassis Power HP ProLiant DL60 G.+GHz Xeon, 5MHz Front Side Bus (P) 5K L, MB L, Or MB L 5MHz Embedded Smart Array 5I+, With 6 MB Memory, Optional Bbwc Embedded Nc778 Gigabit NICs pc00,66mhz DDR, : interleaved -.0" (U0 drives only) Embedded ilo or PCI-X Slots ( with redundant power installed, without) 8Gb ECC SDRAM Optional HP redundant Non-HP, non redundant U; fixed rails standard, optional sliding rails 5W HP ProLiant DL60 G and Gp Intel Xeon processor.,., and.6 GHz Xeon, 800MHz front side bus and EM6T(P) Mb L (Mb L advanced transfer cache In the Gp) 800 MHz Embedded Smart Array 6I, optional 8 MB BBWC (SCSI Models) Dual port NC778 Gigabit NIC pc700 MHz DDR, can be configured for : or : interleaving, with online spare memory and advanced ECC (00MHz DDR in the Gp -.0" (U0 SCSI disk drive models; SATA disk drive models) Embedded ilo full length and half length PCI-X slots; optional PCI Express slots 8Gb ECC SDRAM ( GB in the Gp) Optional HP redundant Redundant (standard) U; sliding rails standard, optional cable management arm 60W There are three embedded network ports on an HP ProLiant DL60. The ilo port connects to the console network switch and is used for server management. The NIC port is used for the administrative network, and the NIC port is used for the system interconnect. See Figure -0 and Figure - to locate the ports. Fan redundancy is standard in the HP ProLiant DL60 G model and is optional in the G model. It allows for continued operation until maintenance can be scheduled to replace a failed fan assembly. Similarly, optional hot-pluggable power supply redundancy means no down time to repair failure because each power supply has its own power cord. Hard disk drives for the HP ProLiant DL60 are optional. If used, each disk drive must be the same size and speed. Figure -9 and Figure -0 describe the front and rear panels of the ProLiant DL60 G. 6 Xeon Processor Servers

65 Figure -9 HP ProLiant DL60 G Front Panel The following table describes the callouts in Figure -9. Item Description Floppy drive SCSI drive bay CD-ROM drive SCSI drive bay Fan module Power switch Signal LEDs Figure -0 HP ProLiant DL60 G Rear Panel with Single Power Supply The following table describes the callouts in Figure -0. Item Description ilo NIC NIC Serial connector Video connector Mouse connector (green) PCI Slot. HP ProLiant DL60 G, G, and Gp 65

66 Item Description Keyboard connector (purple) USB ports UID PCI Slot Power supply Figure - and Figure - show the front and rear panels of the ProLiant DL60 G servers. The DL60 G front panel is the same as the DL60 G with the exception that the G has a USB port below the power switch. Figure - ProLiant DL60 G Front Panel The following table describes the callouts in Figure -: Item Description Floppy drive SCSI drive bay CD-ROM drive SCSI drive bay Fan module Power switch Signal LEDs USB port Figure - HP ProLiant DL60 G Rear Panel Xeon Processor Servers

67 The following table describes the callouts in Figure -. Item Description PCI-X expansion slot (6-bit/-MHz.V) Serial connector (teal) Video connector (blue) Keyboard connector (purple) Mouse connector (green) ilo connector 0/00/000 NIC 0/00/000 NIC PCI-X expansion slot (6-bit/00 MHz.V) USB connector Power supply bay (optional) Power supply bay The ProLiant DL60 Gp is a variant of the ProLiant DL60 G. It provides support for four Serial SCSI or Serial ATA disk drives, a high performance RAID controller, and external Serial SCSI connector for MSA50 storage connectivity. It also offers redundant fans and optional redundant power supplies, online spare memory, and optional transportable battery-backed write cache. Figure - and Figure - show the front and rear panels, respectively, of the ProLiant DL60 Gp, a variant of the DL60 G. Figure - ProLiant DL60 Gp Front Panel 5 The following table describes the callouts in Figure -: Item 5 Description Floppy drive Hard drive bay CD-ROM drive Hard drive bay 0 Front USB port. HP ProLiant DL60 G, G, and Gp 67

68 Figure - HP ProLiant DL60 Gp Rear Panel The following table describes the callouts in Figure -: Item Description PCI-X expansion slot, 6-bit -MHz.V (optional PCI Express slot, x8) Serial connector (teal) Video connector (blue) Keyboard connector (purple) Mouse connector (green) ilo connector PCI-X expansion slot, 6-bit MHz.V (optional PCI Express slot, x8) 0/00/000 NIC 0/00/000 NIC USB connector Power supply bay Power supply bay.. PCI Slot Assignments The HP ProLiant DL60 G and the HP ProLiant DL60 Gp have two PCI slots on the rear of the chassis. Table - summarizes the slot assignments when the server is used as a control node or utility node. Table - HP ProLiant DL60 G and DL60 Gp PCI Slot Assignments Slot Assignment PCI-X interconnect 6-bit MHz PCI-X.. Embedded Technologies Embedded technologies and full-length slots offer configuration flexibility in an ultradense form factor. The embedded technologies of an HP ProLiant DL60 include Integrated Lights Out (ilo) remote management, dual 0/00/000 Fast Ethernet network interface cards (NICs), and Smart Array 5i+. Integrated Lights Out The ilo device is the console power manager for this cluster. It enables you to power off and power on groups of nodes directly from the console. The ilo hardware is self contained. It is powered as long as the machine is powered. The power manager also provides access to a node's 68 Xeon Processor Servers

69 console. By default, an ilo uses the Dynamic Host Configuration Protocol (DHCP) to obtain its IP address. The system software uses this feature when configuring the cluster. Standard features of ilo include remote power on/off, a text interface for remote viewing and management of the server's boot sequence, server logs, alert forwarding, diagnostics, group administration, and security features, including 8-bit Secure Socket Layer (SSL) encryption. Dual Embedded NICs The ProLiant DL60 G and DL80 G include a dual-port embedded NC778 PCI-X gigabit Ethernet NIC. The NC778 is an auto negotiating 0/00/000 MB/s network interface controller, selecting either standard Ethernet (0 MB/s), Fast Ethernet (00 MB/s), or gigabit Ethernet (000 MB/s). NIC is the bottom NIC in the DL60 G. The DL60 G and DL80 G include an embedded NC778 dual-port PCI-X gigabit NIC. The NC778 is an auto negotiating 0/00/000 MB/s network interface controller, selecting either standard Ethernet (0 MB/s), Fast Ethernet (00 MB/s), or gigabit Ethernet (000 Mb/s). NIC is the left-hand NIC, (middle RJ5 connector, between the ilo connection and (NIC ) in a DL60 G. NIC is the right-hand NIC in a DL80 G... High-Availability Features The HP ProLiant DL60 servers also offer the following high-availability features: Advanced ECC memory Redundant ROM Automatic Server Recovery- (ASR-) Online spare memory Advanced ECC memory Advanced ECC memory detects and corrects single-bit memory errors. It can also correct -bit memory errors that occur within a single DRAM chip on a DIMM. Advanced ECC memory is standard on the HP ProLiant DL60 server. It provides more robust error detection and correction capabilities than ECC memory. Redundant ROM Redundant ROM reduces the risk associated with system upgrades because the existing ROM setup is saved as backup during a BIOS upgrade in the event the procedure fails. Automatic Server Recovery Automatic Server Recovery- (ASR-) increases server availability by restarting the server after a system hang or shutdown without IT intervention for server restart. Online spare memory Online spare memory is a high level of memory protection that complements Advanced ECC support. With online spare memory enabled, the system still takes advantage of Advanced ECC but one bank of memory is designated as a spare bank. In this mode, the designated bank is not used for total available system memory. If the correctable error threshold is exceeded by a DIMM in a particular bank of memory, that bank will be taken offline and the spare bank activated instead. Once the original bank is deactivated, the system stops using the memory that exhibited the failure. After switching to the spare bank of memory, the system continues to monitor correctable threshold errors, and logs any failures. With online spare memory, degraded memory is automatically disengaged and a fresh set of memory is used in its place. This brings the reliability of the system to the pre-failure level without any service interruption and without compromising system availability.. HP ProLiant DL60 G, G, and Gp 69

70 .. Removing a Server from the Rack To access internal components in the HP ProLiant DL60 G and G servers, you must first power down the server and then remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. The front panel power button on the HP ProLiant DL60 G and G,, as shown in Figure -5, toggles power between on and standby. If you press the Power On/Standby switch (callout ) to power down the server, the Power On/Off LED changes from green to amber, indicating standby mode. In Standby, the server removes power from most electronics and drives, portions of the power supply, and some internal circuitry remain active. If you press the Unit Identification switch on the front panel (callout ), an LED illuminates blue on the server front and rear panels. Figure -5 Front Unit Identification LEDs The rear Unit Identification LED, as shown in Figure -6, identifies the server being serviced. Figure -6 Rear Unit Identification LEDs To completely remove all power, disconnect the power cord first from the AC outlet and then from the server. When performing this task, heed the warnings and cautions listed in Section. To remove a server from the rack without shutting down the entire cluster, as shown in Figure -7, follow these steps:. Power down the server.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which ethernet and interconnect cables are connected to which ports.. Loosen the thumbscrews securing the server to the rack (callout ).. Slide the server out of the rack until the rail locks engage. 5. Press and hold the rail locks (callout ), extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. 70 Xeon Processor Servers

71 MC MC Figure -7 Sliding the Server from the Rack MC MC MC MC... Accessing Internal Components To access internal components in the ProLiant DL60 servers, remove the access panel. When performing this task, heed the warnings and cautions listed in Important Safety Information (page ). To remove the access panel, as shown in Figure -8, take the following steps:. Remove the server from the rack.. Lift up on the hood latch (callout ). The access panel slides toward the back of the chassis.. Pull up to remove the access panel (callout ). Figure -8 Removing the Access Panel To replace the top cover, reverse steps through.. HP ProLiant DL60 G, G, and Gp 7

72 ..5 Replacing a PCI Card When replacing a PCI card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the product for any signs of obvious damage, such as chipped or loose components. To replace a PCI card, follow these steps:. Attach the grounding strap to your wrist or ankle and to a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the cover from the server and locate the PCI slots. 5. Disconnect any cables connected to any existing expansion boards. 6. Loosen the PCI riser board assembly thumbscrews. 7. Lift the front of the assembly slightly and unseat the riser boards from the PCI riser board connectors. Note: Be sure that all DIMM slot latches are closed to provide adequate clearance before removing the PCI riser board assembly with a half-length expansion board. 8. Remove the riser card from the PCI connector side of the card. 9. Remove the new PCI adapter from its antistatic plastic bag. Handle the adapter only by the edges. Do not touch the card-edge connectors. 0. Record the adapter serial number located on the card for future reference.. Insert the new PCI into the riser card, as shown in Figure -9. Figure -9 Inserting the PCI Riser Card HPTC-008 Important: A 6-bit riser card must be used in a 6-bit PCI slot; likewise, a -bit riser card must be used in a -bit PCI slot. Otherwise, the PCI interface might not be correctly detected and serious performance irregularities might result.. Insert the riser card into a PCI slot. Handle the interface card gently, preferably by the front panel or card edges. The front panel of the interface card is the metal plate or molding that contains two LEDs and the port connector. Be sure the adapter is securely seated.. Secure the card in place.. Tighten the screws beneath the ports. 5. Replace the exterior cover of the server, and attach the cable between the card and the switch. 6. Power on the server and check that the card is detected. 7 Xeon Processor Servers

73 .5 HP ProLiant DL60 G5 The HP ProLiant DL60 G5 allows up to two dual-core Intel Xeon 500/5000 series processors and offers up to six hot-pluggable SATA/SAS drive bays (depending on the model). There are three different model classifications of the HP ProLiant DL60 G5, such as: Performance The HP ProLiant DL60 G5 performance models feature two dual-core Intel Xeon 560/550 processors and up to six active SATA/SAS drive bays. Base Entry Four base models feature one dual core Intel Xeon 560/550/50 processor and offer four active SATA/SAS drive bays with an option for six when using an optional storage cable. There are three entry models that feature one dual-core Intel Xeon 50/50/50 processor, with four active SATA/SAS drive bays standard. Features of the HP ProLiant DL60 G5 are described in Table -5. Table -5 HP ProLiant DL60 G5 Features Feature Processor (one of the following depending on model) NOTE: Intel 500/5000 series processors are 6-bit, dual-core, support hyper threading, and Intel VT technology. Processor cache (one of the following depending on model) Memory Storage controller Internal drive support Optical drives (Slimline drive bay) Hard drives Model/Type Performance and Base models Entry models Optional Base models Optional Performance models Base models Entry models Performance and Base models Description Dual-Core Intel Xeon 560 Processor,.00 GHz, Front Side Bus (FSB) Dual-Core Intel Xeon 550 Processor,.66 GHz, FSB Dual-Core Intel Xeon 50 Processor,. GHz, FSB Dual-Core Intel Xeon 50 Processor,.00 GHz, FSB Dual-Core Intel Xeon 50 Processor,.86 GHz, 066 FSB Dual-Core Intel Xeon 50 Processor,.60 GHz, 066 FSB Dual-Core Intel Xeon 5080 Processor,.7 GHz, 066 FSB Dual-Core Intel Xeon 5060 Processor,. GHz, 066 FSB Dual-Core Intel Xeon 5050 Processor,.0 GHz, 667 FSB MB ( x MB) Level cache (5000 series) or MB ( x MB) Level cache (500 series) Type: PC-500 Fully Buffered DIMMs (DDR-667) Standard (Entry or Base Models): GB ( x 5 MB) Standard (Performance Models): GB ( x GB) Maximum: GB (8 x GB) Smart Array P00i Controller with 56MB battery-backed write cache (RAID 0//5/6) Smart Array P00i Controller with 56MB cache (RAID 0//5) Smart Array E00i Controller (6MB; 8MB BBWC optional) Up to six small form factor hot-plug drive bays Up to 7 GB SAS with optional hard drives Optional CD-ROM, DVD-ROM, DVD/CD-RW Combo (standard in performance models), DVD-RW, or Slimline floppy drive Up to six Small Form Factor bays.5 HP ProLiant DL60 G5 7

74 Table -5 HP ProLiant DL60 G5 Features (continued) Feature Network controller Expansion slots USB.0 Ports Redundancy Management Power supply Fan Model/Type Entry models Description Four Small Form Factor bays Embedded Dual NC7i Multifunction Gigabit Network Adapters with TCP/IP Offload Engine, including support for Accelerated iscsi through an optional ProLiant Essentials Licensing Kit Two PCI Express expansion slots: one full-length, full-height slot; one low-profile slot Front or rear accessible video port Four Total: one front, one internal, and two rear accessible ports Multiple layers of fault tolerance through critical component redundancy (power supply and fan redundancy), mirrored memory, embedded RAID capability, and full-featured remote Lights-Out management New Integrated Lights-Out featuring Integrated Remote Console with KVM over IP performance over shared network access HP Power Meter and Power Regulator for ProLiant, delivering integrated power monitoring and server level, policy based power management with industry leading energy efficiency and savings on system power and cooling costs Convenient slide-out Systems Insight Display for quick and easy front view server diagnostics ProLiant Essential Foundation Pack standard, including HP Systems Insight Manager, SmartStart, SmartStart Scripting Toolkit, Subscriber's Choice and ROM Based Setup Utility (RBSU) Automatic Server Recovery (ASR), ROM Based Setup Utility (RBSU), HP System Insight Manager, Status LEDs including system health, UID, and SmartStart 700 W, optional ( + redundant) power supply Nine fans ship standard; N+ fan redundancy standard.5. HP ProLiant DL60 G5 Front Panel The front of the HP ProLiant DL60 G5 is shown in Figure -0. Figure -0 HP ProLiant DL60 G5 Front Panel Xeon Processor Servers

75 The following table describes the callouts in Figure -0: Item Description Hard drive bay 5 (an optional controller is required when the server is configured with six hard drives) Hard drive bay 6 (an optional controller is required when the server is configured with six hard drives) Multi-bay drive bay USB port Slide-out System Insight Display Video connector Hard drive bay Hard drive bay Hard drive bay Hard drive bay Slide out asset tag.5. HP ProLiant DL60 G5 Rear Panel Figure - shows the rear panel of the HP ProLiant DL60 G5. Figure - HP ProLiant DL60 G5 Rear Panel The following table describes the callouts in Figure -. Item Description Low-profile PCI Express slot Full-size PCI Express slot Redundant power supply Redundant power supply ilo 0/00 NIC USB.0 port USB.0 port Video port Serial port PS Mouse PS Keyboard.5 HP ProLiant DL60 G5 75

76 Item Description Multifunction Gigabit Ethernet NIC Multifunction Gigabit Ethernet NIC.5. HP ProLiant DL60 G5 Front Panel LEDs The HP ProLiant DL60 G5 front panel LEDs are shown in Figure -. Figure - ProLiant DL60 G5 Front Panel LEDs 5 6 The following table describes the callouts in Figure -. Table -6 ProLiant DL60 G5 Front Panel LEDs Item 5 Description Power On/Standby button and system power LED Unit Identification Button (UID) button Internal health LED External health LED (power supply) NIC link/activity LED Status Green = System is on. Amber = System is shut down, but power is still applied. Off = Power cord is not attached, power supply failure has occurred, no power supplies are installed, facility power is not available, or disconnected power button cable. Blue = Identification is activated. Flashing blue = System is being remotely managed. Off = Identification is deactivated. Green = System health is normal. Amber = System health is degraded. To identify the component in a degraded state, see Section.5.5. Red = System health is critical. To identify the component in a critical state, see Section.5.5. Off = System health is normal (when in standby mode). Green = Power supply health is normal. Amber = Power redundancy failure occurred. Off = Power supply health is normal when in standby mode. Green = Network link exists. Flashing green = Network link and activity exist. Off = No link to network exists. 76 Xeon Processor Servers

77 Table -6 ProLiant DL60 G5 Front Panel LEDs (continued) Item 6 Description NIC link/activity LED Status If power is off, the front panel LED is not active. View the LEDs on the RJ-5 connector for status by referring to the rear panel LEDs. Green = Network link exists. Flashing green = Network link and activity exist. Off = No link to network exists. If power is off, the front panel LED is not active. View the LEDs on the RJ-5 connector for status by referring to the rear panel LEDs..5. HP ProLiant DL60 G5 Rear Panel LEDs and Buttons The HP ProLiant DL60 G5 rear panel LEDs are shown in Figure -. Figure - ProLiant DL60 G5 Rear Panel LEDs The following table describes the callouts in Figure -. Table -7 ProLiant DL60 G5 Rear Panel LEDs and Buttons Item Description ilo NIC activity LED ilo NIC link LED 0/00/000 NIC activity LED 0/00/000 NIC link LED 0/00/000 NIC activity LED 0/00/000 NIC link LED UID button/led Status Green = Activity exists. Flashing green = Activity exists. Off = No activity exists. Green = Link exists. Off = No link exists. Green = Activity exists. Flashing green = Activity exists. Off = No activity exists. Green = Link exists. Off = No link exists. Green = Activity exists. Flashing green = Activity exists. Off = No activity exists. Green = Link exists. Off = No link exists. Blue = Identification is activated..5 HP ProLiant DL60 G5 77

78 Table -7 ProLiant DL60 G5 Rear Panel LEDs and Buttons (continued) Item 8 9 Description Power supply LED Power supply LED Status Flashing blue = System is being managed remotely. Off = Identification is deactivated. Green = Normal. Off = System is off or power supply has failed. Green = Normal. Off = System is off or power supply has failed..5.5 System Insight Display The HP ProLiant DL60 G5 has a slide-out System Insight Display. Figure - shows the slide-out System Insight Display, which enables diagnosis with the access panel installed. Figure - System Insight Display (Actual) 78 Xeon Processor Servers

79 Note: The System Insight Display LEDs represent the board layout (see Figure -5). Figure -5 System Insight Display Map Table -8 describes the status of the System Insight Display LEDs. Table -8 System Insight Display LEDs LED Description Online Spare Memory Status Green = Protection enabled Flashing amber = Memory configuration error Amber = Memory failure occurred Off = No protection Mirrored Memory Green = Protection enabled Flashing amber = Memory configuration error Amber = Memory failure occurred Off = No protection All Other LEDs Amber = Failure Off = Normal For additional information detailing the causes for the activation of these LEDs, see Section HP Systems Insight Display LEDs and Internal Health LED Combinations When the internal health LED on the front panel illuminates either amber or red, the server is experiencing a health event. Combinations of illuminated system LEDs and the internal health LED indicate system status. The front panel health LEDs indicate only the current hardware status. In some situations, HP System Insight Manager (SIM) may report server status differently than the health LEDs because the software tracks more system attributes. Table -9 lists the the System Insight Display and Internal Health LED Combinations..5 HP ProLiant DL60 G5 79

80 Table -9 System Insight Display LED and Internal Health LED Combinations HP Systems Insight Display LED and Color Processor failure, socket X (amber) Processor failure, both sockets (amber) PPM failure (amber) FBDIMM failure, slot X (amber) FBDIMM failure, all slots (amber) Over temperature (amber) Riser interlock (amber) Online spare memory (amber) Fan module (amber) Fan module (amber) Internal Health LED Color Red Amber Red Red Red Amber Red Amber Red Red Amber Amber Red Status One or more of the following conditions may exist: Processor in socket X has failed. Processor X is required, but not yet installed in the socket. Processor X is unsupported. Processor in socket X is in a prefailure condition. Processor types are mismatched. Integrated PPM has failed. One or more of the following conditions may exist: FBDIMM in slot X has failed. FBDIMM in slot X is an unsupported type, and no valid memory exists in another bank. One or more of the following conditions may exist: FBDIMM in slot X has reached single-bit correctable error threshold. FBDIMM in slot X is in a prefailure condition. FBDIMM in slot X is an unsupported type, but valid memory exists in another bank. No valid or usable memory is installed in the system. The health driver has detected a cautionary temperature level. The server has detected a critical temperature level. The PCI riser board assembly is not seated properly. Bank X failed over to the online spare memory bank. A redundant fan has failed. The minimum fan requirements are not being met in one or more of the fan modules. One or more fans have failed or are missing..5.6 PCI Slot Assignments The HP ProLiant DL60 G5 has two PCI slots on the rear of the chassis. Table -0 summarizes the slot assignments when the server is used as a control node, utility node, or compute (application) node. Table -0 HP ProLiant DL60 G5 PCI Slot Assignments Slot (Low-profile) (Full-profile) Assignment (PCI Express) x8 PCI Express x8 PCI Express (PCI Interconnect) Assignment (PCI-X) x8 PCI Express (PCI Interconnect) 6 Bit/ MHZ PCI-X (Optional) 80 Xeon Processor Servers

81 .5.7 HP ProLiant DL60 G5 Embedded Technologies and Fault Tolerance The HP ProLiant DL60 G5 is similar to prior generations in that it also has embedded technologies, including: ilo features Integrated Remote Console with KVM over IP performance over shared network access which is used to connect to the console network. Dual-embedded NICs The HP ProLiant DL60 G5 also includes high-availability features and is optimized for fault tolerance with: Fan redundancy Hot-pluggable power supply with optional redundancy Smart Array RAID controller with transportable battery-backed write cache and RAID 6 options Advanced ECC memory Online spare memory.5.7. Removing a ProLiant DL60 G5 Server from the Rack and Accessing Internal Components Removal of a ProLiant DL60 G5 from the rack and access to internal components is the same as in prior generations of ProLiant DL60 servers. Follow the procedures described in Section.. (page 70) and Section... (page 7). If the DL60 G5 is installed with an optional cable management arm, redundant power supplies, and hot-pluggable devices, then the system might be able to be serviced without bringing the server down. See the HP ProLiant DL60 G5 Server Maintenance and Service Guide for more information on servicing the system's hot-pluggable devices such as a hot-pluggable disk or a power supply..5.8 Replacing a PCI Card When replacing a PCI card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the product for any signs of obvious damage, such as chipped or loose components. To replace a PCI card, follow these steps:. Attach the grounding strap to your wrist or ankle and to a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the cover from the server and locate the PCI slots. 5. Disconnect any cables connected to any existing expansion boards. 6. Loosen the four PCI riser board assembly thumbscrews (see callout in Figure -6)..5 HP ProLiant DL60 G5 8

82 Figure -6 PCI Riser Board Assembly 7. Lift the front of the assembly slightly and unseat the riser boards from the PCI riser board connectors (see callout in Figure -6). Note: Be sure that all of the DIMM slot latches are closed to provide adequate clearance before removing the PCI riser board assembly with a half-length expansion board. 8. Remove the riser card from the PCI connector side of the card. 9. Remove the new PCI adapter from its antistatic plastic bag. Handle the adapter only by the edges. Do not touch the card-edge connectors. 0. Record the adapter serial number located on the card for future reference.. Insert the new PCI adapter into the riser board, as shown in Figure -7. Figure -7 Inserting a New PCI Adapter Into the PCI Riser Board 8 Xeon Processor Servers

83 Important: A 6-bit riser card must be used in a 6-bit PCI slot; likewise, a -bit riser card must be used in a -bit PCI slot. Otherwise, the PCI interface might not be correctly detected and serious performance irregularities might result.. Insert the riser card into a PCI slot (callout in Figure -7). Handle the interface card gently, preferably by the front panel or card edges. The front panel of the interface card is the metal plate or molding that contains two LEDs and the port connector. Be sure the adapter is securely seated.. Secure the card in place.. Tighten the screws beneath the ports. 5. Replace the exterior cover of the server, and attach the cable between the card and the switch. 6. Power on the server and check that the card is detected..6 HP ProLiant DL80 G and G Table - compares the features of the HP ProLiant DL80 G and the HP ProLiant DL80 G. Table - ProLiant DL60 G and G model comparison Feature Processor Drive controller NIC Drive bays Management I/O slots Video USB Fan Chassis Power HP ProLiant DL80 G Xeon,.0 GHz/5 MHz FSB processors with -MB L cache Integrated Smart Array 5i+, with 6MB memory, optional BBWC Embedded HP NC778 dual-port PCI-X 0/00/000 Gigabit NICs Up to six -inch hot-pluggable U0 hard drives Embedded ilo Three available PCI-X slots: two hot-pluggable 6-bit, 00 MHz, one 6-bit, MHz Integrated ATI RAGE XL video controller with 8-MB SDRAM video memory Two USB connections Hot-pluggable fans with optional redundancy U form factor (8.90 cm/.5in) 00W with optional redundancy HP ProLiant DL80 G Two Intel Xeon.0 GHz/800 MHz FSB processors with MB L cache Integrated Smart Array 6i Controller Embedded HP NC778 Dual Port PCI-X 0/00/000 Gigabit NICs Up to six -inch hot-pluggable U0 hard drives Embedded ilo Two 6-bit, 00MHz and one 6-bit, MHz.V PCI-X slots (hot-pluggable is optional) Integrated ATI RAGE XL video controller with 8 MB SDRAM video memory Three USB connections (one on the front, and two on the back) Hot-pluggable fans with optional redundancy U form factor (8.90 cm/.5in) 575 watt power supply with optional hot-pluggable redundant AC power supply Figure -8 shows the front panel of the HP ProLiant DL80 G..6 HP ProLiant DL80 G and G 8

84 Figure -8 HP ProLiant DL80 G front panel The following table describes the callouts in Figure -8. Item Description Tape drive bay or hard drive and tape drive blank Diskette drive Hard drive bays CD-ROM drive Figure -9 shows the front panel of the HP ProLiant DL80 G. Figure -9 HP ProLiant DL80 G Front Panel 5 The following table describes the callouts in Figure -9. Item 5 Description USB port Bay for tape drive Diskette drive Six hard drive bays CD-ROM drive The rear panel of the HP ProLiant DL80 G and G is identical, as shown in Figure Xeon Processor Servers

85 Figure -0 HP ProLiant DL80 G and G Rear Panel The following table describes the callouts in Figure -0. Item Description Hot-pluggable PCI-X expansion slot (bus 6) 6-bit/00 MHz.V Hot-pluggable PCI-X expansion slot (bus 6) 6-bit/00 MHz.V VHDCI SCSI connector (port ) Non-hot-pluggable PCI-X expansion slot (bus ) 6-bit/ MHz.V Serial connector Video connector ilo connector USB connectors Mouse connector NIC connector NIC connector Keyboard connector Power cord connector Connector Color N/A N/A N/A Teal N/A Green N/A Purple N/A N/A Black Blue N/A The HP ProLiant DL80 servers share the same embedded technologies as the HP ProLiant DL60 servers, as described in Section.. (page 68)..6. PCI Slot Assignments The ProLiant DL80 has three PCI slots on the rear of the chassis. Table - summarizes the slot assignments. Table - HP ProLiant DL80 PCI Slot Assignments Slot PCI-X Bus PCI Express Bus Assignment Comment A PCI-X interconnect 6-bit MHz PCI-X ( Gb/s) B Optional Gb/s Fibre Channel HBA 6-bit MHz PCI-X ( Gb/s) A PCI Express interconnect X.6 HP ProLiant DL80 G and G 85

86 Table - HP ProLiant DL80 PCI Slot Assignments (continued) Slot PCI-X Bus PCI Express Bus Assignment Comment B PCI-X slot 6-bit MHz PCI-X ( Gb/s) B PCI Express X.6. Removing the Server from the Rack To access internal components in the HP ProLiant DL80 G or G server, you must first power down the server and then remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. The front panel power button on the HP ProLiant DL80 G and G toggles power between On and Standby. If you press the Power On/Standby switch to power down the server, the Power On/Off LED changes from green to amber, indicating standby mode. In Standby, the server removes power from most electronics and drives; portions of the power supply and some internal circuitry remain active. If you press the Unit Identification switch on the front panel, an LED illuminates blue on the server front and rear panels. The rear Unit Identification LED identifies the server being serviced. To completely remove all power, disconnect the power cord first from the AC outlet and then from the server. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). To remove a server from the rack, follow these steps:. Power down the server following the steps previously outlined.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Loosen the thumbscrews securing the server to the rack.. Slide the server out of the rack until the rail locks engage. 5. Press and hold the rail locks, then extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety..6.. Accessing Internal Components To access internal components in the HP ProLiant DL80 servers, remove the access panel. When performing this task, heed the warnings and cautions listed in Section. To remove the access panel, as shown in Figure -8, follow these steps:. Remove the server from the rack, as described in Section.6... Lift up on the hood latch. The access panel slides toward the back of the chassis.. Pull up to remove the access panel. To replace the access panel, reverse steps through..6. Replacing a PCI Card When replacing a PCI card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the product for any signs of obvious damage, such as chipped or loose components. To replace an HP ProLiant DL80 PCI card, follow these steps: 86 Xeon Processor Servers

87 . Attach the grounding strap to your wrist or ankle and a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the cover from the server, and locate the PCI riser cage. 5. Disconnect any cables connected to any existing expansion boards. 6. Open the PCI riser cage door, as shown in Figure -. Figure - ProLiant DL80 PCI Riser Cage Door HPTC Remove the PCI riser cage door latch, as shown in Figure -. Figure - ProLiant DL80 PCI Riser Cage Door Latch 8. Remove the PCI riser cage. Lift the PCI riser cage thumbscrews (see callout in Figure -) and turn them counter clockwise (see callout in Figure -). Lift the cage upward (see callout in Figure -)..6 HP ProLiant DL80 G and G 87

88 Figure - Removing the HP ProLiant DL80 PCI Riser Cage 9. Unlock the PCI retaining clip, as shown in Figure -. Figure - Unlocking the HP ProLiant DL80 PCI Retaining Clip HPTC Remove the expansion board, as shown by callouts and in Figure Xeon Processor Servers

89 Figure -5 Removing the HP ProLiant DL80 Expansion Board Caution: To prevent improper cooling and thermal damage, do not operate the server unless all PCI slots have either an expansion slot cover or an expansion board installed.. To reinsert the PCI card cage, reverse the removal procedure..7 HP ProLiant DL80 G5 The HP ProLiant DL80 G5 is a U rack-mount server with up to two Intel Xeon 5000 series processors with Hyper Threading and Intel VT technology. The HP ProLiant DL80 G5 has improved management features, including ilo, Systems Insight Display, Smart Power and thermal and dual power supplies (optional) and eight fans standard. Table - lists the features of the HP ProLiant DL80 G5. Table - HP ProLiant DL80 G5 Features Feature Processors Storage Controller HP ProLiant DL80 G5 Dual-core Intel Xeon 5000 and 500 series processors with MB Level cache Smart Array P00 Controller with 56MB cache (RAID 0,,5) optional battery (adds write cache and RAID 6); option 5MB write cache (adds write cache and RAID 6) Smart Array E00 Controller with 6MB cache (RAID 0,) optional 8MB write cache (adds RAID 5 capability) Cache Memory (depending on model) NIC Max Drive Bays Remote Management Expansion Slots USB Ports: MB ( x MB) Level cache (5000 series) MB ( x MB) Level cache (500 series) Embedded Dual NC7i Multifunction Gigabit Network Adapters with TCP/IP Offload Engine, including support for Accelerated iscsi through an optional ProLiant Essentials Licensing Kit Eight SFF (Small Form Factor) hot-pluggable drive bays to support SAS (Serial Attached SCSI) and SATA (Serial ATA) drives Integrated Lights-Out (ilo ) Four available PCI Express slots, optional mixed PCI-X / PCI Express configurations available USB.0 ports with support for 5 total ports: two ports up front; two ports in back; one port internal.7 HP ProLiant DL80 G5 89

90 P Table - HP ProLiant DL80 G5 Features (continued) Feature Redundancy HP ProLiant DL80 G5 fully redundant hot plug fans Hot-pluggable power supply with optional redundancy (Included in Performance models) Chassis Power U 800 Watt, CE Mark Compliant (Optional Hot-Pluggable AC Redundant Power Supply).7. HP ProLiant DL80 G5 Front Panel Figure -6 shows the front panel of the HP ProLiant DL80 G5. Figure -6 HP ProLiant DL80 G5 Front Panel 5 6 P W P O S P P F A I O V U ID The following table describes the callouts in Figure -6: Item 5 6 Description Media drive bay (IDE/diskette multi-bay) Video connector USB connectors () Systems Insight Display Hard drive bays through 8 Quick release levers ().7. HP ProLiant DL80 G5 Rear Panel Figure -7 shows the rear panel of the HP ProLiant DL80 G5. 90 Xeon Processor Servers

91 Figure -7 HP ProLiant DL80 G5 Rear Panel The following table describes the callouts in Figure -7: Item Description T-0/T-5 Torx screwdriver Expansion slot (PCI Interconnect) Expansion slot Expansion slot 5 Expansion slot External option blank Expansion slot NIC connector NIC connector Power supply bay Power cord connector () one for each power supply Power supply bay ilo connector Video connector USB connectors () Serial connector Mouse connector Keyboard connector.7. ProLiant DL80 G5 Front LEDs Figure -8 shows the ProLiant DL80 G5 front panel LEDs..7 HP ProLiant DL80 G5 9

92 Figure -8 HP ProLiant DL80 G5 Front LEDs P S W P P O P P F A I O V 5 6 Table - describes the callouts in Figure -8. Table - HP ProLiant DL80 G5 Front Panel LEDs Item 5 6 Description UID LED button Internal health LED External health LED (power supply) NIC link/activity LED NIC link/activity LED Power On/Standby button/system power LED Status Blue = Activated Flashing = System being remotely managed Off = Deactivated Green = Normal Amber = System degraded. To identify component in degraded state, see Section.7.5 Red = System critical. To identify component in critical state, see Section.7.5 Green = Normal Amber = Power redundancy failure. To identify component in degraded state, seesection.7.5 Red = Critical power supply failure. To identify component in critical state, seesection.7.5 Green = Network link Flashing = Network link and activity Off = No link to network. If power is off, view the rear panel RJ-5 LEDs for status. Green = Network link Flashing = Network link and activity Off = No link to network. If power is off, view the rear panel RJ-5 LEDs for status. Green = System on Amber = System shut down, but power still applied Off = Power cord not attached or power supply failure.7. ProLiant DL80 G5 Rear LEDs The ProLiant DL80 G5 rear panel LEDs are shown in Figure Xeon Processor Servers

93 Figure -9 HP ProLiant DL80 G5 Rear LEDs 5 6 The following table describes the callouts in Figure -9. Table -5 HP ProLiant DL80 G5 Rear LEDs Item 5 6 Description Power supply LEDs NIC activity LED NIC link LED ilo activity LED ilo link LED UID LED button Status Green = Normal Off = System is off or power supply has failed Green = Network activity Flashing = Network activity Off = No network activity Green = Network link Off = No network link Green = Network activity Flashing = Network activity Off = No network activity Green = Network link Off = No network link Blue = Activated Flashing = System being remotely managed Off = Deactivated.7.5 Systems Insight Display LEDs The Systems Insight Display is on the front panel of the ProLiant DL80 G5. Figure -0 shows the ProLiant DL80 G5 Systems Insight Display LEDs and Table -6 lists the description and status of the Systems Insight Display LEDs..7 HP ProLiant DL80 G5 9

94 Figure -0 HP ProLiant DL80 G5 Systems Insight Display ONLINE SPARE POWER SUPPLY POWER SUPPLY MIRROR DIMMS PCI RISER CAGE PPM PPM PROC PROC FANS INTER LOCK OVER TEMP Table -6 Systems Insight Display LEDs Status LED Description Online spare Status Off = No protection Green = Protection enabled Amber = Memory failure occurred Flashing amber = Memory configuration error Mirror Off = No protection Green = Protection enabled Amber = Memory failure occurred Flashing amber = Memory configuration error All other LEDs Off = Normal Amber = Failure Note: The HP Systems Insight Display LEDs represent the system board layout. For more information on HP Systems Insight Display and Internal Health LED combinations, see the ProLiant DL80 Generation 5 Server Maintenance and Service Guide..7.6 PCI Slot Assignments The HP ProLiant DL80 G5 has four PCI Express expansion slots standard and an optional PCI-X. The following tables describe the slot assignments: Table -7 summarizes the default PCI Express slot assignments. Table -8 summarizes the mixed PCI Express/PCI-X slot assignments. 9 Xeon Processor Servers

95 Table -7 HP ProLiant DL80 G5 PCI Express Slot Assignments Slot Default PCI Express Bus Assignment Comment A PCI Express (used with SAS controller) x B PCI Express x C PCI Express x D PCI Express x8 5 E PCI Express (InfiniBand interconnect) x8 Table -8 HP ProLiant DL80 G5 Mixed PCI Express/PCI-X Slot Assignments Slot Mixed PCI Express/PCI X Bus Assignment Comment A PCI Express Slot (used with SAS controller) x B PCI Slot x C PCI Express (Interconnect) x8 D PCI-X 6 bit/ MHz 5 E PCI-X (Interconnect) 6 bit/ MHz.7.7 New DL80 PCI Slot Assignments (as of March 7, 008) The following table describes the new PCI slot assignments for DL80 G5 as of March 7, 008. The are no performance issues with the previous slot assignments and it is not necessary to move the HCAs in previously sold configurations. Use Table -8 when a PCI-X HCA is used, if necessary. For the appropriate cable management bracket mounting holes for the new PCI slot assignments, see Section.7.8. Table -9 HP ProLiant DL80 G5 PCI Express Slot Assignments (as of March 7, 008) Slot 5 Assignment PCI Express PCI Express PCI Express PCI Express (Interconnect) PCI Express Comment x x x x8 x8.7.8 Rack Mounting Holes for ProLiant DL80 G5 Cable Management Brackets Each HP ProLiant DL80 G5 server requires U of rack space referred to as upper U and lower U. Each U has three holes: top, middle, and bottom. Different cable management brackets and the rack-mounting holes used to mount them are necessary for the ProLiant DL80 G5 depending on the PCI slot and the type of HCA used in HP Cluster Platform configurations. Figure - shows the location of the holes used to mount the cable management brackets when either PCI slot or PCI slot 5 is used in the ProLiant DL80 G5. When a PCI-X HCA is used in slot 5 of the ProLiant DL80 G5, mount the appropriate cable management bracket in the middle hole (callout in Figure -) of the upper U location (callout in Figure -)..7 HP ProLiant DL80 G5 95

96 When a PCI Express HCA is used in slot of the ProLiant DL80 G5, mount the appropriate cable management bracket in the top hole (callout 5 in Figure -) of the lower U location (callout in Figure -). When a PCI Express HCA is used in slot of the ProLiant DL80 G5, mount the appropriate cable management bracket in the bottom hole (callout in Figure -) of the upper U location (callout in Figure -). Figure - Rack Mounting Holes for ProLiant DL80 G5 Cable Management Brackets T M B 6 T 5 M B The following list describes the callouts in Figure -:. Upper U location (top, middle, and bottom). Lower U location (top, middle, and bottom). Middle hole of upper U location. Bottom hole of upper U location 5. Top hole of lower U location 6. Two U locations U is required to rack mount the HP ProLiant DL80 G5.7.9 Removing the Server from the Rack To access internal components in the ProLiant DL80 G5, you must first power down the server and then remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. The front panel power button on the ProLiant DL80 G5 toggles power between On and Standby. If you press the Power On/Standby switch to power down the server, the Power On/Off LED changes from green to amber, indicating standby mode. In Standby mode, the server removes power from most electronics and drives; portions of the power supply and some internal circuitry remain active. If you press the Unit Identification switch on the front panel, an LED illuminates blue on the server front and rear panels. The rear Unit Identification LED identifies the server being serviced. To completely remove all power, disconnect the power cord first from the AC outlet and then from the server. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). To remove a server from the rack, follow these steps: 96 Xeon Processor Servers

97 . Power down the server following the steps previously outlined.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Loosen the thumbscrews securing the server to the rack.. Slide the server out of the rack until the rail locks engage. 5. Press and hold the rail lock and extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety Accessing Internal Components To access internal components in the HP ProLiant DL80 G5 servers, remove the access panel. When performing this task, heed the warnings and cautions listed in Important Safety Information (page ). To remove the access panel, as shown in Figure -8 (page 7), follow these steps:. Remove the server from the rack, as described in Section.7.9 (page 96).. Lift up on the hood latch. The access panel slides toward the back of the chassis.. Pull up to remove the access panel. To replace the access panel, reverse steps through..7.0 Replacing a PCI Card When replacing a PCI card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the product for any signs of obvious damage, such as chipped or loose components. Caution: To prevent damage to the server or expansion boards, power down the server and remove all AC power cords before removing or installing the PCI riser cage. To replace an HP ProLiant DL80 G5 PCI card in slots through 5, follow these steps:. Attach the grounding strap to your wrist or ankle and a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the cover from the server, and locate the PCI riser cage. 5. Disconnect any cables connected to any existing expansion boards. 6. Press the blue button to release the black knobs (see callout in Figure -). 7. Turn the black knobs counter clockwise (see callout in Figure -). 8. Lift the PCI riser cage upward and remove it (see callout in Figure -)..7 HP ProLiant DL80 G5 97

98 Figure - Removing the ProLiant DL80 G5 PCI Riser Cage 9. Remove the expansion board, as shown in Figure -. Figure - Removing the ProLiant DL80 G5 PCI Riser Cage Caution: To prevent improper cooling and thermal damage, do not operate the server unless all PCI slots have either an expansion slot cover or an expansion board installed. 0. To reinsert the PCI riser card cage, reverse the removal procedure. 98 Xeon Processor Servers

99 Opteron Processor Servers Several servers based on the AMD Opteron processor are supported in HP Cluster Platform solutions. This chapter presents the following information: HP ProLiant DL5 G and G (Section.) HP ProLiant DL5 G (Section.) HP ProLiant DL65 G5 (Section.) HP ProLiant DL85 (Section.) HP ProLiant DL85 G (Section.5) HP ProLiant DL85 G5 and G5p (Section.6) HP ProLiant DL585 (Section.7) HP ProLiant DL585 G (Section.8 ) HP ProLiant DL585 G5 (Section.9) Chapter describes the HP ProLiant server blades, also based on the Opteron processor, that are supported in HP Cluster Platform solutions.. HP ProLiant DL5 The HP ProLiant DL5 G and G are supported servers in HP Cluster Platform solutions. The U HP ProLiant DL5 server supports up to two AMD Opteron processors and can be used as an application node, utility node, or control node. All HP ProLiant DL5 servers in an HP Cluster Platform solution are configured with two processors. Memory is two-way interleaved. and must be added in pairs. Ideally, memory is configured identically for each CPU board, up to 6 GB (8 x GB). In most cases, the PCI-X slot is used for the interconnect host adapter. For configurations in which the HP ProLiant DL5 is the control node and is not connected to the system interconnect, an alternative I/O option can be installed. The HP ProLiant DL5 also has an integrated ProLiant 00-series management processor (MP) that operates independently from the operating system and is powered by auxiliary power. It provides system administrators with access to the server at any time, even prior to an operating system being installed on the server. This MP provides a text remote console and a command-line interface (CLI). The ProLiant 00-series MP is Intelligent Platform Management Interface (IPMI) v.5 compliant. In addition to IPMI, the HP ProLiant DL5 G has ProLiant Lights Out 00i Remote Management. There are three embedded network ports on an HP ProLiant DL5. The ilo port connects to the console network switch and is used for server management. The NIC port is used for the administrative network, and the NIC port is used for the Gigabit Ethernet system interconnect. See Figure -, and Figure - to locate the ports. Table - describes the characteristics of the HP ProLiant DL5 G and the HP ProLiant DL5 G servers. Table - ProLiant DL5 G and G Comparison Features Processor Chipset RAM std/max HP ProLiant DL5 G AMD Opteron up to. GHz MB L cache 800 MHz HyperTransport AMD 8 and AMD 8 GB- GB / 6 GB HP ProLiant DL5 G AMD Opteron up to.6 GHz and future dual-core support MB L cache GHz HyperTransport AMD 8 for PCI-X and NVIDIA CK8-0 for PCI Express GB- GB / 6 GB. HP ProLiant DL5 99

100 Table - ProLiant DL5 G and G Comparison (continued) Features Memory technology Drive controller RAID controller NIC Hard drive bays Slots Management Video Removable media HP ProLiant DL5 G PC700 ECC DDR MHz Integrated dual-channel ATA Optional PCI card Integrated dual Broadcom 570 0/00/000 Two non hot-pluggable ATA or SCSI MHz PCI-X IPMI.0 Integrated ATI Rage 8 MB Two USB ports ( front and rear) HP ProLiant DL5 G PC00 ECC DDR 00MHz Integrated dual-channel ATA Optional PCI card Integrated dual Broadcom 57 0/00/000 Two non hot-pluggable SATA or SCSI MHz PCI-X (one full-length and one low-profile) Optional PCI x6 in place of full-length PCI-X slot HP ProLiant Lights Out 00i Remote Management and IPMI.0 Integrated NVIDIA 6 MB Four USB Ports ( front and rear) Figure - shows the front panel of the HP ProLiant DL5 G, and Figure - shows its rear panel. Figure - HP ProLiant DL5 G Front Panel 6 hp ProLiant DL5 5 The following table describes the callouts in Figure -. Item 5 6 Description LEDs Power button USB port Hard drive bay Hard drive bay Media bay Figure - HP ProLiant DL5 G Rear Panel Opteron Processor Servers

101 The following table describes the callouts in Figure -. Item Description Mouse Keyboard Video USB Dedicated Management NIC NIC NIC COM/management processor Figure - shows the front panel of the HP ProLiant DL5 G, and Figure - shows the rear panel of the HP ProLiant DL5 G. Among other features, the G model has a new bezel design with unit ID (UID) light diagnostics for easy system identification in large rack-mount environments. Figure - HP ProLiant DL5 G Front Panel 6 8 HP ProLiant DL The following table describes the callouts in Figure -. Item Description Hard disk drive bays Optical media device bay Unit Identification button with LED indicator (blue) System health LED indicator (amber) Activity/link status LED indicators for NIC and NIC (green) Hard disk drive activity LED indicator (green) USB.0 ports Power button with LED indicator (green and amber) Thumbscrew for the front bezel. HP ProLiant DL5 0

102 Figure - HP ProLiant DL5 G Rear Panel The following table describes the callouts in Figure -. Item Description Ventilation holes Thumbscrew for the access panel Thumbscrews for the PCI riser board assembly GbE LAN ports for NIC (RJ-5) GbE LAN ports for NIC (RJ-5) Low profile 6-bit/ MHz PCI-X riser board slot cover USB.0 ports (black) Video port (blue) Serial port (teal) Standard height/full-length 6-bit/ MHz PCI-X riser board slot cover. You can convert the PCI-X functionality of this slot to PCI Express using the PCI Express riser board option kit. PS/ Keyboard port (purple) PS/ mouse port (green) 0/00 Mbps LAN port for IPMI management (RJ-5) Power supply cable socket The front and rear panels of the HP ProLiant DL5 G are identical to the front and rear panels of the HP ProLiant DL0 G. However, the DL5 G has Opteron processors, and the DL0 G has Xeon processors... HP ProLiant DL5 G PCI Slot Assignments The ProLiant DL5 G has two PCI slots on the rear of the chassis. Table - summarizes the slot assignments. Table - HP ProLiant DL5 G PCI Slot Assignments Slot Assignment PCI-X interconnect 6-bit MHz PCI-X.. Removing an HP ProLiant DL5 from a Rack To access internal components in any HP ProLiant DL5 model, you must first shut down power to the server and remove it from the rack. All of the servers in the cluster are secured to the rack 0 Opteron Processor Servers

103 on a sliding rail. This section describes how you shut down power, remove a server from the rack, and access internal components. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). The front panel power button on the HP ProLiant DL5 toggles between On and Off. If you press the Power button on an HP ProLiant DL5 to power down the server, the LED turns off. To completely remove all power from the server, disconnect the power cord first from the AC outlet and then from the server. To remove an HP ProLiant DL5 from the rack, follow these steps:. Power down the server.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Loosen the front thumbscrews securing the server to the rack (see callout in Figure -5). Figure -5 HP ProLiant DL5 G Front Thumbscrews. Extend the server on the rack rails (see callout in Figure -5) until the server rail locks. 5. Press and hold the rail locks (see callout in Figure -6), and extend the server until it clears the rack (see callout in Figure -6).. HP ProLiant DL5 0

104 Figure -6 Sliding the HP ProLiant DL5 G from the Rack 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. To remove the access panel on the HP ProLiant DL5, as shown in Figure -7, follow these steps:. Remove the server from the rack, as described in Section.... To detach the access panel from the chassis, follow these steps: For the DL5 G, loosen the two captive thumbscrews at the back of the server, as shown in Figure -7. Figure -7 Removing the HP ProLiant DL5 G Access Panel Mouse Kybd USB Mng LAN 000T LAN 000T LAN Item Description Access panel screws Access panel latch For the DL5 G, loosen the one captive thumbscrew at the back of the server, as shown in Figure Opteron Processor Servers

105 Figure -8 Removing the HP ProLiant DL5 G Access Panel Item Description Access panel screw Access panel latch. Slide the cover approximately.5 cm (0.5 in) toward the rear of the unit.. Pull up the latch to remove the access panel from the chassis. To replace the access panel and return the server to the rack, reverse the previous steps... Replacing a PCI card in the HP ProLiant DL5 G The HP ProLiant DL5 G has one PCI-X expansion slot. To replace the PCI expansion card, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. When the server powers down, the system power LED turns off.. Disconnect the AC power cord, first from the AC outlet and then from the server. Note: The front panel Power button does not completely shut off system power. Portions of the power supply and some internal circuitry remain active until AC power is removed.. Remove the server from the rack, as described in Section Remove the access panel from the server, as shown in Figure Disconnect the cable attached to the PCI card. 7. Pull the PCI riser cage upward, as shown in Figure -9.. HP ProLiant DL5 05

106 Figure -9 HP ProLiant DL5 G Riser Cage HPTC-0 8. Remove the screw located on the left side of the riser cage before removing the PCI card from the slot, as shown in Figure -0. Figure -0 Removing an HP ProLiant DL5 G PCI Card from the Riser Cage 9. Remove the new PCI card from its antistatic plastic bag. Handle the adapter gently, preferably by the front panel or card edges. Do not touch the connectors. The front panel of the adapter is the metal plate that contains the port connector and LEDs. 0. Record the adapter card serial number located on the card for future reference.. Insert the new PCI card into the riser cage, applying even pressure to seat the board securely. Be sure the adapter is securely seated.. Replace the screw that secures the card in the riser cage.. Return the riser cage to its slot.. Reinstall the access panel, reversing the steps in Section Replace the server in the rack, reversing the steps in Section Attach the cable between the card and the switch, and reconnect the AC power cord. 7. Press the Power button on the server. Check that the card is detected. Refer to your software documentation for further installation instructions. 06 Opteron Processor Servers

107 .. Installing or Replacing a PCI Card in the HP ProLiant DL5 G The HP ProLiant DL5 G has three PCI expansion slots on the system board. The system supports up to two expansion boards at a time. Figure - shows the PCI slots on the HP ProLiant DL5 G system board. Figure - HP ProLiant DL5 G PCI Expansion Slots The following table describes the callouts in Figure -. Table - HP ProLiant DL5 G PCI Slots Item Slot 6-bit, MHz PCI-X slot 6-bit, MHz PCI-X slot PCI Express x6 slot Capabilities Supports a low profile 6-bit, MHz PCI-X riser board Supports a standard height, full-length 6-bit, MHz PCI-X riser board Supports a full-length PCI Express x6 riser board When replacing a PCI card in an HP ProLiant DL5 G, use only HP supported expansion boards that meet the following specifications: PCI or PCI-X compliant Connector: or 6 bits wide,. V Speed PCI board speed: 66 MHz PCI-X board speed: 00 or MHz Form factor: low profile or standard height, full-length boards PCI Express x6 compliant (available only when the optional PCI Express riser board is installed) To replace a PCI expansion card, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. When the server powers down, the system power LED turns off.. Disconnect the AC power cord, first from the AC outlet and then from the server. Note: The front panel Power button does not completely shut off system power. Portions of the power supply and some internal circuitry remain active until AC power is removed.. Remove the server from the rack, as described in Section Remove the access panel from the server, as shown in Figure Disconnect the cable attached to the PCI card. 7. Lift and remove the PCI riser board assembly from the chassis as follows:. HP ProLiant DL5 07

108 a. Loosen the two captive thumbscrews that secure the assembly to the chassis, as shown by callout in Figure -. Figure - Removing the HP ProLiant DL5 G PCI Card Cage b. Lift the assembly away from the chassis, as shown by callout in Figure -. c. Identify the slot that is compatible with the expansion board you intend to install. d. If you are adding an expansion board, pull out the slot cover from the selected slot. Store it for reassembly later. Figure - shows how to remove the cover from a low-profile expansion slot, and Figure - shows how to remove the cover from a standard height, full-length expansion slot. Important: Do not discard slot covers. If the expansion board is removed in the future, the slot cover must be reinstalled to maintain proper cooling. Figure - Removing the Cover of the Low-Profile Expansion Slot HPTC Opteron Processor Servers

109 Figure - Removing the Cover of the Full-Length Expansion Slot HPTC Remove the PCI expansion board from its protective packaging, handling it by the edges. Some expansion boards can only be installed in one slot but other boards can be configured to fit in either slot by replacing the default bracket (attached to the board) with a different sized bracket. The different sized bracket and instructions on how to attach it to the board is included in the option kit. 9. Verify that the board s default bracket is compatible with the configuration of the selected slot. If it is not compatible, replace the bracket with one that is compatible. 0. Pull the PCI riser cage upward, as shown in Figure -9.. Remove the screw located on the left side of the riser cage before removing the PCI card from the slot, as shown in Figure -0.. Remove the new PCI card from its antistatic plastic bag. Handle the card gently, preferably by the front panel or card edges. Do not touch the connectors. The front panel of the card is the metal plate that contains the port connector and LEDs.. Record the card serial number located on the card for future reference.. Insert the new PCI card into the riser cage, applying even pressure to seat the board securely. Be sure the adapter is fully seated. Figure -5 shows the installation of a full-length 6-bit, MHz PCI-X card in an HP ProLiant DL5 G. Figure -5 Installing a Full-Length PCI Card in the HP ProLiant DL5 G HPTC Replace the screw that secures the card in the riser cage. 6. Reinstall the PCI riser cage assembly as follows: a. Align the assembly with the system board expansion slots, then press it down to ensure full connection to the system board. b. Tighten the two captive thumbscrews to secure the assembly to the chassis.. HP ProLiant DL5 09

110 7. Reinstall the access panel, reversing the steps in Section Replace the server in the rack, reversing the steps in Section Attach the cable between the card and the switch, and reconnect the AC power cord. 0. Press the Power button on the server. Check that the card is detected. Refer to your software documentation for further installation instructions. For more information, refer to the following documents: PCI Express Riser Board Installation Instructions for HP ProLiant DL00 Series Generation Servers HP ProLiant 00 Series Servers User Guide HP ProLiant DL5 Generation Server Maintenance and Service Guide HP ProLiant DL5 Generation Server Installation Sheet. HP ProLiant DL5 G The HP ProLiant DL5 G is supported in HP Cluster Platform solutions. The HP ProLiant DL5 G server supports up to two AMD Opteron processors and can be used as an application node, utility node, or control node. Table - lists the features of the HP ProLiant DL5 G. Table - HP ProLiant DL5 G Specifications Feature Processors Specification Supports up to two AMD Opteron 000 series processors Supports dual-core.6 GHz, MB cache processors Supports DirectConnect Architecture Memory Internal Drive Support 8 DIMM slots supporting up to 6 GB PC-500 DDR-667 MHz memory with Advanced ECC Supports up to two: Hot Plug Serial Attached SCSI (SAS).5"/Serial ATA (SATA) hard drives, or; Non-Hot Plug Serial ATA (SATA).5" hard drives Internal storage capacity of up to.5 TB ( x 750 GB hot-pluggable.5 inch SATA hard drives), or 600 GB ( x 00 GB hot plug.5" SAS hard drives) Network Controller Storage Controllers NC6i PCIe Dual Port Gigabit Server Adapter HP Embedded SATA Controller on Non-Hot Plug SATA Models HP Smart Array E00 Controller with 6 MB cache, optional Upgradeable to 8 MB write back cache HP 8 Internal Port SAS HBA with RAID 0, on hot-pluggable SATA/SAS Models Expansion Slots Standard - PCI Express assembly includes: Slot : full-length/full-height PCI Express x6 Slot : half-length/low-profile PCI Express x (x8 connector) Optional - PCI-X assembly includes: Slot : half-length/low-profile PCI-X (note: PCI-X slots are 6 bits; MHz capable) Optional - HTX assembly includes: Slot : full-length/full-height HTX Management IPMI.0 support HP ProLiant Lights Out 00i Remote Management support ROM Setup Utility 0 Opteron Processor Servers

111 Table - HP ProLiant DL5 G Specifications (continued) Feature USB Ports Optical Drive Power Supply Specification Four USB ports (two front, two rear) Support for one (optional): CD-ROM, DVD-ROM, DVD RW, DVD/CD RW 650 W Power supply (non hot-pluggable, auto-switching) Figure -6 shows the front panel of the HP ProLiant DL5 G. Figure -6 HP ProLiant DL5 G Front Panel The following table describes the callouts in Figure -6. Item Description Serial number pull tab Ventilation holes Optical drive bay Unit identification (UID) button with LED indicator (blue) System health LED indicator (amber) Activity LED indicators for NIC and NIC (green) Hard disk drive (HDD) activity LED indicator (green) Power button with LED indicator (bicolor: green and amber) USB.0 ports HDD bay.5" Hot-plug SAS/SATA or.5" Non-hot plug SATA drive HDD bay.5" Hot-plug SAS/SATA or.5" Non-hot plug SATA drive Thumbscrews for the front bezel ( places) Figure -7 shows the rear panel of the HP ProLiant DL5 G.. HP ProLiant DL5 G

112 Figure -7 HP ProLiant DL5 G Rear Panel The following list corresponds to the callouts shown in Figure -7. Item Description Ventilation holes Thumbscrew for the low-profile riser board assembly (two places) Low-profile riser board assembly slot cover Link status LED indicator for the 0/00 Mbps LAN port Solid green A valid network link exists Off No network link detected 5 Activity status LED indicator for the 0/00 Mbps LAN port Flashing amber Network data activity was detected within the preceding one second Off No network data activity was detected within the preceding one second /00 Mbps LAN port for IPMI management (RJ-5) Captive screw for the top cover GbE LAN port for NIC (RJ-5) GbE LAN port for NIC (RJ-5) Full-sized riser board assembly slot cover Power supply cord Ventilation holes GbE LAN port for NIC (RJ-5) activity LED indicator Flashing amber Network data activity was detected within the preceding one second (same for NIC ) Off No network data activity was detected within the preceding one second (same for NIC ) GbE LAN port for NIC (RJ-5) link status LED indicator Flashing amber Network data activity was detected within the preceding one second (same for NIC ) Opteron Processor Servers

113 Item Description Off No network data activity was detected within the preceding one second (same for NIC ) USB.0 ports (black) PS/ keyboard port (purple) PS/ mouse port (green) Serial port Video port (blue) Non-Maskable Interrupt (NMI) button (recessed) UID button and separate LED indicator (blue).. Removing an HP ProLiant DL5 G from a Rack To access internal components in any HP ProLiant DL5 G, you must first shut down power to the server and remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. This section describes how you shut down power, remove a server from the rack, and access internal components. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). The front panel power button on the HP ProLiant DL5 G toggles between On and Off. If you press the Power button on an HP ProLiant DL5 G to power down the server, the LED turns off. To completely remove all power from the server, disconnect the power cord from the AC outlet. To remove an HP ProLiant DL5 G from the rack, follow these steps:. Power down the server.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Loosen the front thumbscrews securing the server to the rack, as shown by callout in Figure -8. Figure -8 HP ProLiant DL5 G Front Thumbscrews. Extend the server on the rack rails until the server rail locks, as shown by callout in Figure -8.. HP ProLiant DL5 G

114 5. Press and hold the rail locks (see callout in Figure -9), and extend the server until it clears the rack (see callout in Figure -6). Figure -9 Sliding the HP ProLiant DL5 G from the Rack 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. To replace the access panel and return the server to the rack, reverse the previous steps... Removing the DL5 G Access Panel To remove the access panel on the HP ProLiant DL5 G, as shown in Figure -0, follow these steps: Opteron Processor Servers

115 . Remove the server from the rack, as described in Section.... To detach the access panel from the chassis, follow these steps: Loosen the captive screw on the back of the ProLiant DL5 G server, as shown by callout in Figure -0. To loosen the screw, HP recommends using the L-shaped wrench that ships with the server. Figure -0 Removing the HP ProLiant DL5 G Access Panel Item Description Access panel screws Access panel latch. Slide the cover approximately.5 cm (0.5 in) toward the rear of the unit, as shown by callout in Figure -0.. Use the two circular grips on the top cover to help you slide the cover more easily... DL5 G System Board Expansion Slots There are four expansion slots on the system board that support four different PCI riser boards. Figure - shows the system board expansion slots and Table -5 summarizes the types of slots available on the system board.. HP ProLiant DL5 G 5

116 Figure - DL5 G System Board Expansion Slots The following list describes the callouts shown in Figure -. Table -5 DL5 G System Board Expansion Slot Descriptions Item Component HTX slot PCI Express x6 slot PCI-X slot PCI Express x slot Description Supports a full-sized GHz, 6x6 HTX expansion board installed on an HTX riser board Supports a full-sized PCI Express x6 expansion board installed on a PCI Express x6 riser board Supports a low-profile 6-bit, MHz PCI-X expansion board installed on a PCI X riser board Supports a low-profile PCI Express x expansion board installed on a PCI Express x riser board.. DL5 G PCI Slot Assignments Table -6 summarizes the PCI slots assignments in the ProLiant DL5 G. 6 Opteron Processor Servers

117 Table -6 HP ProLiant DL5 G PCI Slot Assignments PCI Slot (Full-Sized) (Low-Profile) PCI Express Assignment X6 PCI-X Interconnect X PCI Express Interconnect PCI Mixed Assignment X6 PCI Express PCI -X..5 ProLiant DL5 G Riser Board Assemblies The DL5 G server supports up to two expansion boards installed on riser boards. With the appropriate riser boards, the two riser board assemblies that come with the server convert the expansion slots on the system board to slots that are positioned at a 90 angle from the system board. You can then install expansion boards in a position parallel to the system board. The system comes with one full-sized assembly and one low-profile assembly. The full-sized assembly supports either an HTX riser board or a PCI Express x6 riser board. The low-profile assembly supports either a PCI Express x riser board or a PCI-X riser board. Note: You cannot install the PCI Express x and PCI-X riser boards at the same time. You also cannot install the HTX and PCI Express x6 riser boards at the same time. Expansion Board Installation Guidelines Use only HP-supported expansion boards that meet the following specifications: HTX: Full-sized, GHz, 6x6 PCI Express x: Low-profile PCI Express x6: Full-sized PCI-X: Low-profile, 6-bit,. V, MHz..5. Installing or Replacing the ProLiant DL5 G Riser Board Assemblies To install or replace the riser board assemblies, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. When the server powers down, the system power LED turns off.. Disconnect the AC power cord from the AC outlet.. Remove the server from the rack, as described in Section Remove the access panel from the server, as shown in Figure Disconnect the cable attached to the PCI card, if necessary.. HP ProLiant DL5 G 7

118 7. Lift and remove the appropriate PCI riser board assembly from the chassis as follows: Figure - Removing the HP ProLiant DL5 G Full-Sized PCI Riser Board Assembly Figure - Removing the HP ProLiant DL5 G Low-Profile PCI Riser Assembly a. b. c. Loosen the two captive thumbscrews that secure the assembly to the chassis, as shown by callout in Figure - and Figure -. Lift the assembly away from the chassis as shown by callout in Figure - and Figure -. If you are adding an expansion board, pull out the slot cover from the selected slot. Store it for reassembly later. Important: Do not discard slot covers. If the expansion board is removed in the future, the slot cover must be reinstalled to maintain proper cooling. 8 Opteron Processor Servers

119 ..5. Removing or Installing a Riser Board To remove or install a riser board in either the full-sized or low-profile riser board assemblies, follow these steps:. Perform the procedure described in Section..5 to remove the appropriate riser board assembly.. If an expansion board is installed in the assembly, perform the procedure described in Section..6 to remove the expansion board.. HP ProLiant DL5 G 9

120 . Remove the installed riser board from the riser board assembly as shown in Figure - and Figure -5. Figure - Remove the Full-Sized Riser Board Figure -5 Remove the Low Profile Riser Board Note: Keep the two screws you remove in this step for installing the new riser board later. a. b. Remove the two screws securing the riser board to the assembly. Remove the riser board from the assembly. To install a new riser board, reverse the removal procedure...6 Replacing a PCI Expansion Card in the ProLiant DL5 G To replace a PCI expansion card, follow these steps: 0 Opteron Processor Servers

121 . Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. When the server powers down, the system power LED turns off.. Disconnect the AC power cord from the AC outlet. Note: The front panel Power button does not completely shut off system power. Portions of the power supply and some internal circuitry remain active until AC power is removed.. Remove the server from the rack, as described in Section Remove the access panel from the server, as shown in Figure Disconnect the cable attached to the PCI card. 7. Lift and remove the appropriate PCI riser board assembly from the chassis as described in Section Remove the PCI expansion board from its protective packaging, handling it by the edges. 9. Verify that the board s default bracket is compatible with the configuration of the selected slot. If it is not compatible, replace the bracket with one that is compatible. 0. Remove the new PCI card from its antistatic plastic bag. Handle the card gently, preferably by the front panel or card edges. Do not touch the connectors. The front panel of the card is the metal plate that contains the port connector and LEDs.. Record the card serial number located on the card for future reference.. Remove the PCI expansion card from the appropriate riser board assembly as shown in Figure -6 and Figure -7. Figure -6 Removing a Full-Sized PCI Card in the HP ProLiant DL5 G. HP ProLiant DL5 G

122 Figure -7 Removing a Low-Profile PCI Card in the HP ProLiant DL5 G To install a PCI expansion board, reverse the removal procedure. Insert the new PCI card into the riser cage, applying even pressure to seat the board securely. Be sure the adapter is fully seated. For more information, refer to the following documents: HP ProLiant 00 Series Servers User Guide HP ProLiant DL5 Generation Server Maintenance and Service Guide. HP ProLiant DL65 G5 The HP ProLiant DL65 G5 supports up to two AMD Opteron 00 series Quad-Core processors and up to four SATA hot plug or non-hot plug midline and entry hard drives. The ProLiant DL65 G5 can be used as a control node, utility node, and a compute node in HP Cluster Platform configurations. For the features and specifications of the HP ProLiant DL65 G5, go to: Figure -8 shows the front view of the HP ProLiant DL65 G5. Figure -8 HP ProLiant DL65 G5 Front View The following list describes the callouts shown in Figure -8:. Thumbscrews for rack mounting. Optical disk drive bay. Serial number pull tab Opteron Processor Servers

123 . Two front USB.0 ports 5. Unit identification (UID) LED button 6. System health LED 7. NIC LED 8. NIC LED 9. Power button with LED indicator (bicolor: green and amber) 0. Hard disk drive (HDD) LED. HDD bays,,, and Figure -9 shows the rear view of the HP ProLiant DL65 G5. Figure -9 HP ProLiant DL65 G5 Rear View The following list describes the callouts shown in Figure -9:. Power supply. PS/ mouse port (green). GbE LAN port for NIC. Captive thumbscrew for top cover 5. Serial port (teal) 6. Low profile/half length expansion slot 7. Full Height/Full Length expansion slot 8. T0/T5 Wrench 9. Thumbscrew for PCI cage 0. UID LED button. VGA port. HP LO00i Management LAN Port. Two rear USB.0 ports. GbE LAN port for NIC 5. PS/ keyboard port (purple).. PCI Slot Assignments The following table describes the PCI slot assignments when the DL65 G5 is used in HP Cluster Platform solutions. PCI Slot Assignment PCI Interconnect/PCI-E x6 PCI-E x For additional information, such as the system board layout and installing PCI cards, see the HP ProLiant DL65 Generation 5 Server Maintenance and Service Guide: HP ProLiant DL65 G5

124 . HP ProLiant DL85 G The dual-processor, U HP ProLiant DL85 G server can be used as a control node, directing the management and administrative functions, or as a utility node for any specific task, including running applications. It supports up to two.6 GHz MB L cache GHz HyperTransport AMD Opteron processors, 6 GB of PC00 DDR SDRAM memory running at 00MHz, and three full-length PCI-X slots, two at 00MHz and one at MHz PCI-X. Each processor memory controller is directly connected to two dedicated memory banks. A minimum of GB of memory is required for the first bank of each processor. Both processors must be populated with the same DIMM types and sizes. The server also has an integrated HP ProLiant Lights Out port to be connected to the console network, six hot-pluggable hard disk drive bays, and dual embedded Gigabit Ethernet NICs, one of which is connected to the administrative network. The HP ProLiant DL85 G has the following features: Feature Available processors Specification AMD Opteron GHz, MB L AMD Opteron GHz, MB L Processor capacity Memory type Maximum memory PCI-X expansion slots PC00 DDR 6 MB of -way interleaved 00 MHz DDR SDRAM non hot-pluggable 6-bit, 00 MHz non hot-pluggable 6-bit, MHz Advanced memory protection NIC Storage type Maximum drive bays Removable media bays Storage controller Networking Remote management Redundant power supply Redundant fans Advanced ECC NC778 dual port Gigabit Ethernet NIC SCSI hot plug 6 Integrated Smart Array 6i Dual HP NC778 PCI-X Gigabit server adapters (embedded) Integrated Lights Out standard (advanced features available via optional Integrated Lights Out Advanced Pack); ROM-based setup utility and redundant ROMs Optional hot plug Optional hot plug Figure -0 shows the front panel (six drive bays) of the ProLiant DL85 G, and Figure - shows its rear panel. Opteron Processor Servers

125 Figure -0 HP ProLiant DL85 G Front Panel HPTC-05 Figure - HP ProLiant DL85 G Rear Panel MHz 00 MHz MHz The following ports are available on the rear panel of the HP ProLiant DL85 G Table -7 HP ProLiant DL85 G Rear Panel Ports Item Label or Icon 00 MHz 00 MHz MHz Screen icon 000 ilo Network icon Network icon Mouse icon Keyboard icon Description PCI X 00 MHz PCI X 00 MHz PCI X MHz VGA out DB9 Serial (COM) port and management processor port Stacked USB ports Integrated Lights Out, dedicated management NIC Gigabit Ethernet NIC Gigabit Ethernet NIC Serial mouse Serial keyboard IEC power inlet.. PCI Slot Assignments The ProLiant DL85 has three PCI slots on the rear of the chassis. Table -8 summarizes the slot assignments.. HP ProLiant DL85 G 5

126 Table -8 HP ProLiant DL85 PCI Slot Assignments Slot Bus Assignment Comment A PCI-X interconnect 6-bit 00 MHz PCI-X ( Gb/s) A Optional Gb/sec Fibre Channel HBA 6-bit 00 MHz PCI-X ( Gb/s) B PCI interconnect 6-bit MHz PCI-X ( Gb/s).. Removing an HP ProLiant DL85 G from a Rack To access internal components in the HP ProLiant DL85 G server, you must first power down the server and then remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. To remove the HP ProLiant DL 85 G from the rack, follow these steps:. Power down the server. a. Press the UID LED button on the front panel. Blue LEDs illuminate on the front and rear panels of the server. b. Press the Power On/Standby button to place the server in standby mode (). When the server activates Standby power mode, the system power LED changes to amber. c. Locate the server by identifying the illuminated rear UID LED button, and disconnect the power cord, first from the AC outlet, then from the server. Note: The front panel power button on the HP ProLiant DL85 G toggles between On and Off. To completely remove all power from the server, you must disconnect the power cord first from the AC outlet and then from the server. d. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Pull down the quick release levers on each side of the server to release the server from the rack, as shown in Figure -. Figure - Extending the HP ProLiant DL85 from the Rack. Extend the server on the rack rails until the rail locks.. Press and hold the rail locks, and extend the server until it clears the rack. 6 Opteron Processor Servers

127 5. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. 6. To access internal components in the HP ProLiant DL85 G, lift up on the hood latch handle and remove the access panel... Replacing an HP ProLiant DL85 PCI Card When replacing a PCI adapter card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the card for any signs of obvious damage, such as chipped or loose components. To replace an HP ProLiant DL85 G PCI card, follow these steps:. Attach the grounding strap to your wrist or ankle and to a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the access panel from the server, and locate the PCI riser cage. 5. Disconnect any cables connected to any existing expansion boards. 6. Open the PCI riser cage door, as shown in Figure -. Figure - HP ProLiant DL85 PCI Riser Cage Door HPTC Remove the PCI riser cage door latch, as shown in Figure -. Figure - HP ProLiant DL85 PCI Riser Cage Door Latch 8. Remove the PCI riser cage. Lift the PCI riser cage thumbscrews and turn them counter clockwise. Lift the cage upward, as shown in Figure -5.. HP ProLiant DL85 G 7

128 Figure -5 Removing the HP ProLiant DL85 PCI Riser Cage 9. Unlock the PCI retaining clip, as shown in Figure -6. Figure -6 Unlocking the HP ProLiant DL85 PCI Retaining Clip HPTC Remove the expansion board, as shown in Figure Opteron Processor Servers

129 Figure -7 Removing the HP ProLiant DL85 Expansion Board Caution: To prevent improper cooling and thermal damage, do not operate the server unless all PCI slots have either an expansion slot cover or an expansion board installed.. To replace the component, reverse the removal procedure..5 HP ProLiant DL85 G The dual processor, U HP ProLiant DL85 G is used as a control node and utility node in HP Cluster Platform. The features of the ProLiant DL85 G are described in Table -9. Table -9 HP ProLiant DL85 G Features Feature Processor(s) Cache Memory Memory Network Controller Model/Type Performance Base (one of the following depending on model) Entry Performance Base Entry Performance Base Entry Description Two Dual-core AMD Opteron 8 Processors (.6 GHz, 95 Watts) One Dual-Core AMD Opteron 8 Processor (.6 GHz, 95 Watts) One Dual-Core AMD Opteron 6 HE Processor (. GHz, 68 Watts) One Dual-Core AMD Opteron HE Processor (. GHz, 68 Watts) One Dual Core AMD Opteron 0 HE Processor (.8 GHz, 68 Watts) MB ( x MB) Level cache Series MB ( x MB) Level cache Series MB ( x MB) Level cache Series GB ( x GB of : interleaved PC-500 DIMMs (DDR-667) with Advanced ECC capabilities GB ( x GB) PC-500 DIMMs (DDR-667) with Advanced ECC capabilities GB ( x 5 MB) PC-500 DIMMs (DDR-667) with Advanced ECC, capabilities Embedded NC7i MFN Gigabit Server Adapters.5 HP ProLiant DL85 G 9

130 Table -9 HP ProLiant DL85 G Features (continued) Feature Storage Controller Hard Drive Internal Storage Optical Drive Form Factor Availability Model/Type Performance Base Entry Performance Base Entry Performance Base Entry Description HP Smart Array P00/5MB BBWC Controller (RAID 0//5/6) HP Smart Array P00/56MB Controller (RAID 0//5) HP Smart Array E00/6MB Controller (RAID 0/) None ship standard.68tb max - 8 x 6GB SAS drives (with optional hard drives) IDE DVD-ROM/CDRW combo Optional DVD, DVD/CD-RW combo, DVD+R/RW or floppy drive Optional DVD, DVD/CD-RW combo, DVD+R/RW or floppy drive Rack (U), (.5-inch) Hot Plug Fully Redundant Fans and Redundant Power Supplies Hot Plug Fully Redundant Fans Standard Hot Plug Fully Redundant Fans Standard For more information on ProLiant DL85 G supported storage, memory, and other options, see the HP ProLiant DL85 Generation (G) QuickSpecs..5. ProLiant DL85 G Front and Rear Views Figure -8 shows the front panel of the ProLiant DL85 G. Figure -8 HP ProLiant DL85 G Front Panel The following list corresponds to the callouts shown in Figure -8:. Quick release levers. Media drive bay. Video connector. USB connectors () 5. Systems Insight Display 6. Hard drive bays 7. Power On/Standby button/system power LED 8. NIC link/activity LED 0 Opteron Processor Servers

131 9. NIC link/activity LED 0. External health LED (power supply). Internal health LED. UID LED button Figure -9 shows the rear panel of the ProLiant DL85 G. Figure -9 HP ProLiant DL85 G Rear Panel The following list corresponds to the callouts shown in Figure -9:. T-0/T-5 Torx screwdriver. Expansion slot 5. Expansion slot. Expansion slot 5. Expansion slot 6. External option blank 7. NIC connector 8. NIC connector (connected to administrative network switch, AES) 9. Expansion slot 0. Keyboard connector. Mouse connector. Serial connector. Power supply bay. USB connectors () 5. Video connector 6. Power supply LED 7. ilo connector (connected to console network switch, CES) 8. Power cord connector 9. UID LED button 0. Power supply bay (populated). NIC/iLO activity LED. NIC/iLO link LED.5. PCI Slot Assignments The ProLiant DL85 G has five PCI slots on the rear of the chassis. Table -0 summarizes the PCI Express slot assignments..5 HP ProLiant DL85 G

132 Table -0 HP ProLiant DL85 G PCI Express Slot Assignments Slot 5 Assignment PCI Express PCI Express PCI Express PCI Express PCI Express Interconnect Comment x8 x8 x x8 x8 Table - summarizes a PCI Express/PCI-X mixed configuration. Table - HP ProLiant DL85 G PCI Express/PCI-X Slot Assignments Slot 5 Assignment PCI Express PCI Express PCI Express Interconnect PCI PCI Express Interconnect Comment x8 x8 x8 6-Bit MHz 6-Bit MHz.5. New DL85 G PCI Slot Assignments (as of March 7, 008) The following table describes the new PCI slot assignments for DL85 G as of March 7, 008. The are no performance issues with the previous slot assignments and it is not necessary to move the HCAs in previously sold configurations. When a PCI-X HCA is used, use Table -. Table - HP ProLiant DL85 G PCI-Express Slot Assignments (as of March 7th 008) Slot 5 Assignment PCI-Express PCI-Express PCI-Express PCI-Express (Interconnect) PCI-Express Comment x8 x8 x x8 x8.5. Removing the ProLiant DL85 G from a Rack To access internal components in the ProLiant DL85 G, you must first power down the server and then remove it from the rack. All of the servers in the HP Cluster Platform configuration are secured to the rack on a sliding rail. To remove the HP ProLiant DL85 G from a rack, follow these steps: Warning! To reduce the risk of personal injury, electric shock, or damage to the equipment, remove the power cord to remove power from the server. The front panel Power On/Standby button does not completely shut off system power. Portions of the power supply and some internal circuitry remain active until AC power is removed.. Back up the server data and power off the server.. Shut down the operating system as directed by your operating system documentation. Opteron Processor Servers

133 Note: If the operating system automatically places the server in Standby mode, omit the next step.. Press the Power On/Standby button to place the server in Standby mode. When the server activates Standby power mode, the system power LED changes to amber. Important: Pressing the UID button illuminates the blue UID LEDs on the front and rear panels. In a rack environment, this feature facilitates locating a server when moving between the front and rear of the rack.. Disconnect the power cords. The system is now without power. 5. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports. 6. Pull down the quick-release levers on each side of the server as shown in Figure -0. Figure -0 Removing the ProLiant DL85 G from a Rack 7. Extend the server until the server rail-release latches engage. Warning! To reduce the risk of personal injury or equipment damage, be sure that the rack is adequately stabilized before extending a component from the rack. 8. Press and hold the rail locks, and extend the server until it clears the rack. 9. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. 0. To access internal components, lift up on the hood latch handle and remove the access panel..5 HP ProLiant DL85 G

134 . To put the server back into the rack, press the server rail-release latches and slide the server fully into the rack. Warning! To reduce the risk of personal injury, be careful when pressing the server rail-release latches and sliding the server into the rack. The sliding rails could pinch your fingers..5.5 Replacing a ProLiant DL85 G PCI Card When replacing a PCI adapter card, you need a grounding strap. The adapter card is sensitive to electrostatic discharge. Take care to avoid mishandling, which could damage the card. Before beginning installation, and without removing the adapter card from its antistatic bag, inspect the card for any signs of obvious damage, such as chipped or loose components. To replace a PCI card in the ProLiant DL85 G riser cage, follow these steps:. Attach the grounding strap to your wrist or ankle and to a metal part of the chassis.. Power off the server.. Remove the server from the rack.. Remove the access panel from the server, and locate the PCI riser cage (slots 5). 5. Disconnect any cables connected to any existing expansion boards. 6. Remove the PCI riser cage, as shown in Figure -. Figure - Removing the ProLiant DL85 G PCI Riser Cage 7. It might be necessary to remove a slot cover, or move a slot cover to a different slot. Remove a slot cover in the PCI riser cage, as shown in Figure -. Opteron Processor Servers

135 Figure - Removing a PCI Slot Cover in the PCI Riser Cage Caution: To prevent improper cooling and thermal damage, do not operate the server unless all of the PCI slots have either an expansion slot cover or an expansion board installed. 8. Remove the expansion board, as shown in Figure -. Figure - Removing a DL85 G PCI Card 9. To replace the component, reverse the removal procedure..5 HP ProLiant DL85 G 5

136 Note: See the HP ProLiant DL85 Generation Server User Guide and the HP ProLiant DL85 Generation Server Maintenance and Service Guide for information on the ProLiant DL85 G PCI slots and..5.6 ProLiant DL85 G Systems Insight Display The HP Systems Insight Display LEDs represent the system board layout. See the HP ProLiant DL85 Generation Server User Guide and the HP ProLiant DL85 Generation Server Maintenance and Service Guide for information on the ProLiant DL85 G Systems Insight Display..6 HP ProLiant DL85 G5 and G5p HP ProLiant DL85 G5 is used as a control node and utility node in HP Cluster Platform. For the features and specifications of the HP ProLiant DL85 G5, see the QuickSpecs at: For the features and specifications of the HP ProLiant DL85 G5p, see the QuickSpecs at: The front and rear views of the HP ProLiant DL85 G5 and G5p are the same as the ProLiant DL85 G. For the front view, see Figure -8 (page 0) and for the rear view, see Figure -9 (page )..6. PCI Slot Assignments HP ProLiant DL85 G5 has five PCI slots on the rear of the chassis. Table - summarizes the PCI Express slot assignments. Table - HP ProLiant DL85 G5 PCI Express Slot Assignments Slot 5 Assignment PCI Express PCI Express PCI Express PCI Express (Interconnect) PCI Express Comment x8 x8 x x8 x8 For additional information for the ProLiant DL85 G5, such as the system board layout and installing PCI cards, see the HP ProLiant DL85 Generation 5 Server Maintenance and Service Guide: For additional information for the ProLiant DL85 G5p, see the HP ProLiant DL85 Generation 5p Server Maintenance and Service Guide: HP ProLiant DL585 The quad-processor, U HP ProLiant DL585 typically functions as a control node, utility node, or I/O node. When using the HP ProLiant DL585 as the control node, a redundant power supply is mandatory. Otherwise, a redundant power supply is optional. The HP ProLiant DL585 server ships standard with a diskette drive and an IDE CD drive in the universal media bays. You can replace the CD or diskette drive with a DVD drive, another diskette drive, or another CD drive. The server supports up to four hot-pluggable Ultra or Ultra0 drives. For the drives to operate at Ultra0 speeds, however, an optional PCI-X-based Ultra0 6 Opteron Processor Servers

137 SCSI controller must be installed. The server ships in duplex configuration, but the SCSI backplane can be configured for either simplex or duplex mode. Note: Simplex configuration means all four drives in the server are connected to one SCSI channel. Duplex configuration means there are two drives, each connected to one of two SCSI channels. The HP ProLiant DL585 server has the following features: U system chassis Up to four AMD Opteron processors with HyperTransport technology MB L processor cache Base memory of Gb or Gb, depending on the model -way interleaved PC00 DDR SDRAM/66 MHz Redundant ROM Advanced error-checking and correcting (ECC) memory Four -inch Ultra0 hot-pluggable hard disk drive bays Embedded Smart Array 5i Plus controller (Ultra-based technology) with transportable battery-backed write cache enabler Hot-pluggable floppy drive and CD or DVD drive Six 00 MHz 6-bit PCI-X and two MHz 6-bit PCI-X An embedded dual-channel Gigabit Ethernet NIC with PXE support and Wake on LAN (WOL) Redundant hot-pluggable power supplies with optional power supply installed Redundant hot-pluggable fans with N+ redundancy Integrated Lights Out (ilo) technology QuickFind diagnostic display for troubleshooting at the server level ROM-based setup utility The HP ProLiant DL585 has eight slots, two of which are MHz PCI-X. The remainder are 00 MHz PCI-X. The two MHz slots are on separate PCI-X busses. The remaining slots are located as pairs on three busses. Table - shows the required HP Cluster Platform Gigabit Ethernet slot assignments for an HP ProLiant DL585 when it is used as a control node or compute node. Available slots can be used for other supported I/O options, if required. Table - Slot Assignments for the HP ProLiant DL585 Slot Bus Assignment Description 5 000Base-TX Gigabit Ethernet adapter card MHz PCI-X MHz PCI-X Gb/s Ethernet NIC 00 MHz PCI-X 00 MHz PCI-X 5 First Gb/s Fibre Channel HBA (optional) 00 MHz PCI-X 6 00 MHz PCI-X 7 Second Gb/s Fibre Channel HBA (optional) 00 MHz PCI-X 8 00 MHz PCI-X There are three embedded network ports on an HP ProLiant DL585. The ilo port connects to the console network switch and is used for server management. NIC port is used for the.7 HP ProLiant DL585 7

138 administrative network, and the NIC port is used for the Gigabit Ethernet system interconnect. See Figure -5 to locate the ports. Figure - displays the front panel of the HP ProLiant DL585, and Figure -5 displays its rear panel. Figure - HP ProLiant DL585 Front Panel hp The following table describes the callouts in Figure -: SCSI IDs Item Description Simplex Duplex Hot-pluggable power supply (optional) Eject button for universal media bay Universal media bay (diskette drive) Hot-pluggable power supply (primary) 5 Universal media bay (CD-drive) 6 Eject button for universal media bay 7 SCSI hot-pluggable hard drive bay SCSI hot-pluggable hard drive bay 9 SCSI hot-pluggable hard drive bay 0 0 SCSI hot-pluggable hard drive bay Figure -5 HP ProLiant DL585 Rear Panel Opteron Processor Servers

139 The following table describes the callouts in Figure -5: Item Description Integrated Lights Out manager connector USB connector USB connector Rear Unit Identification (UID) button and LED Keyboard connector Mouse connector Video connector Serial connector NIC connector NIC connector AC inlet (primary) AC inlet (optional) Integrated Lights Out Integrated Lights Out (ilo) technology provides server health and remote server manageability. The ilo subsystem includes an intelligent microprocessor, secure memory, and a dedicated network interface. This design makes ilo independent of the host server and its operating system. The ilo subsystem provides remote access to any authorized network client, sends alerts, and provides other server management functions. It enables you to perform the following tasks: Remotely power up, power down, or reboot the host server Send alerts from ilo regardless of the state of the host server Access advanced troubleshooting features through the ilo interface Diagnose ilo using Insight Manager 7 through a Web browser and SNMP alerting For more information about ilo features, see the Integrated Lights-Out User Guide on the HP Cluster Platform CD or on the HP website: HP ProLiant DL585 Memory Configuration The HP Cluster Platform 000 enforces the following memory configuration rules for the HP ProLiant DL585: DIMMs on a processor memory board must be installed in pairs and in bank order. All DIMMs on a processor memory board must be of the same size. Minimum of two DIMMs must be installed in the processor memory board in slot. For optimal performance, HP recommends that at least four DIMMs (two banks) be installed in every processor memory board..7. Removing an HP ProLiant DL585 from the Rack To access internal components in the HP ProLiant DL585 server, you must first shut down power to the server and remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. This section describes how you shut down power, remove the server from the rack, and access internal components. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page )..7 HP ProLiant DL585 9

140 hp hp hp The front panel power button on the HP ProLiant DL585, as shown in Figure -, toggles between On and Standby. If you press the Power button on an HP ProLiant DL585 to power down the server, the LED changes from green to amber, indicating Standby mode. In Standby mode, the server removes power from most electronics and drives. Portions of the power supply and some internal circuitry remain active. To completely remove all power from either server, disconnect the power cord first from the AC outlet and then from the server. To remove the ProLiant DL585 from the rack, follow these steps:. Power down the server.. Disconnect all of the remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Loosen the thumbscrews securing the server to the rack, as shown in Figure -6. Figure -6 Loosening Thumbscrews HPTC-00. Slide the server out of the rack until the rail locks engage, as shown in Figure -7. Figure -7 Sliding the HP ProLiant DL585 from the Rack HPTC Press and hold the rail locks and extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. To remove the access panel on the HP ProLiant DL585, as shown in Figure -8, follow these steps: 0 Opteron Processor Servers

141 . Remove the server from the rack, as described in Section.7... Locate and remove the Torx T-5 tool that is stored on the back of the server chassis, between the fans and the PCI slots.. Unlock the access panel latch using the Torx T-5 tool, as shown in Figure -8, that you removed from the back of the server. Figure -8 Unlocking the HP ProLiant DL585 Access Panel Latch hp Item Description Access panel Torx T-5 tool Access panel latch Access panel. Lift up on the latch and remove the access panel. To replace the access panel, place the panel on top of the server with the latch open. Allow the panel to extend past the rear of the server approximately.5 cm (0.5 in). Push down on the latch. The access panel slides to a closed position. To return an HP ProLiant DL585 server into a rack, press the rail-release levers at the front of both server rails and slide the server into the rack, as shown in Figure -9. Secure the server by tightening the thumbscrews. Figure -9 Sliding an HP ProLiant DL585 into a Rack HPTC-0.7 HP ProLiant DL585

142 .7. Replacing a PCI Card The HP ProLiant DL585 supports the installation of both PCI ( MHz and 66 MHz) and PCI-X (66 MHz, 00 MHz, and MHz) expansion boards. All PCI-X slots are 6-bit,.-V keyed. Figure -50 shows the HP ProLiant DL585 PCI-X expansion slots and buses. The system BIOS detects the PCI-X devices in the slots in the following order: Figure -50 HP ProLiant DL585 PCI-X Expansion Slots and Buses The following table describes the callouts in Figure -50. Item Slot Bus Description Slot Fifth bus MHz Slot Fourth bus MHz Slot Third bus 00 MHz Slot Third bus 00 MHz 5 Slot 5 Second bus 00 MHz 6 Slot 6 Second bus 00 MHz 7 Slot 7 First bus 00 MHz 8 Slot 8 First bus 00 MHz To replace a PCI expansion card, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. Note: When the server powers down, the Power button LED changes from green to amber, indicating Standby mode. In Standby mode, the server removes power from most electronics and drives, but portions of the power supply and some internal circuitry remain active until AC power is removed.. Disconnect the AC power cord, first from the AC outlet and then from the server.. Remove the server from the rack, as shown in Section Remove the access panel from the server, as shown in Figure -8, and locate the PCI slot. Opteron Processor Servers

143 6. Disconnect any cables connected to the expansion board. 7. Using the callouts shown in Figure -5 as a guide, press the PCI-X retaining clip toward the front of the server to lock it in the open position (callout ). Figure -5 Removing a PCI Card from an HP ProLiant DL585 Server 8. Press down on the expansion slot latch to release it (callout ). 9. Open the latch (callout ). 0. Remove the board from the slot (callout ).. Remove the new PCI card from its antistatic plastic bag. Handle the adapter gently, preferably by the front panel or card edges. Do not touch the connectors. The front panel of the adapter is the metal plate that contains the port connector and LEDs.. Record the adapter card serial number located on the card for future reference.. Insert the new PCI card in the slot, as shown in by callout in Figure -5, applying even pressure to seat the board securely. Be sure the adapter is fully seated. Figure -5 Installing a PCI Card in an HP ProLiant DL585 Server. Close the expansion slot latch (callout ). 5. Close the PCI-X retaining clip. 6. Reinstall the access panel, reversing the steps in Section Replace the server in the rack, reversing the steps in Section HP ProLiant DL585

144 8. Attach any cables between the card and the switch, and reconnect the AC power cord. 9. Press the Power button on the server. Check that the card is detected. Refer to your software documentation for further installation instructions..8 HP ProLiant DL585 G The HP ProLiant DL585 G typically functions as a control node, utility node, or I/O node. When using the ProLiant DL585 G as the control node, a redundant power supply is mandatory. Otherwise, a redundant power supply is optional. The U ProLiant DL585 G server can be configured with up to four AMD Rev F Opteron Dual-Core processors. The HP ProLiant DL585 G server has the following features: Feature Processors Memory Cache Memory Chipset Memory Protection & Functionality Memory Network Controller Manageability Storage Controllers (One of the following depending on Model) Storage Data Protection Type Type Standard Maximum Specification Dual-Core AMD 800 Series Processors Up to 8 GB of memory, supported by slots of PC-500 Registered DIMMs at 667 MHz MB Integrated Level Cache memory per core nvidia NForce Professional 00 and 050 chipsets, and AMD-8 chipset Advanced ECC PC-500 Registered DIMMs at 667 MHz One of the following depending on model: GB ( x 5 MB) GB ( x GB) 8 GB (8 x GB) 8 GB (6 x 8 GB) Dual embedded NC7i Multifunction Gigabit Network Adapters with TCP/IP Offload Engine, including support for Accelerated iscsi and RDMA through optional ProLiant Essentials Licensing Kits Integrated Lights-Out (ilo ) Standard Management (ASIC on the System Board) HP Smart Array P00/56 MB Controller (in a PCI Express slot) Note: Standard on.0 GHz and. GHz models HP Smart Array P00/5 MB BBWC Controller (in a PCI Express slot) Note: Standard on. GHz,.6 GHz, and.8 GHz models The Battery-Backed Write Cache (BBWC) Enabler for the Smart Array P00 Controller protects up to 5-MB write cache memory from hard boot, power, controller, or system board failures. Standard on all HP ProLiant DL585 G Models Battery charge/life: Up to 7 hours/ years Transportable data protection Increases overall controller performance Opteron Processor Servers

145 Feature Type Specification Storage Maximum Internal Storage Type Graphics Diskette Drive Optical Drive Hard Drives Hard Disk Drive Backplane Hot Plug SAS Hot Plug SATA Note: Safely transport your write cache data to another HP ProLiant DL585 G in the data center by removing the BBWC Enabler and Smart Array P00 Controller Memory Module simultaneously (connected by short cable).. MB Diskette Drive (slimline) - ejectable for security and serviceability Slimline DVD/CD-RW Drive Standard on all models - ejectable for security and serviceability None ship standard Internal SAS backplane supports up to eight SFF hard disk drive.68 TB (8 x 6 GB SFF SAS drives; internal hot plug) 80 GB (8 x 60 GB SFF SATA; internal hot plug) Integrated ATI-RN50 with MB DDR memory Figure -5 shows the ProLiant DL585 G front panel features. Figure -5 HP ProLiant DL585 G Front Panel The following list corresponds to the callouts shown in Figure -5.. Hard drive bay. Hard drive bay. Hard drive bay. Hard drive bay 5. Hard drive bay 5 6. Hard drive bay 6 7. Hard drive bay 7.8 HP ProLiant DL585 G 5

146 8. Hard drive bay 8 9. Video connector 0. USB connectors (two). Media drive blank or optional media drive. DVD drive. UID switch and LED. Internal system health LED 5. External system health LED 6. NIC link/activity LED 7. NIC link/activity LED 8. Power on/standby button and LED 9. Processor memory module Figure -5 shows the rear panel of the HP ProLiant DL585 G server. Figure -5 HP ProLiant DL585 G Rear Panel UID The following list corresponds to the callouts shown in Figure -5.. Redundant hot-plug power supply (optional). PCI Express and PCI-X non-hot-plug expansion slots. Hot-plug power supply (primary). Power supply Fail LED (amber) 5. Power supply Power LED (green) 6. T-5 Torx screwdriver 7. NIC Activity LED 8. NIC Link LED 9. NIC connector 0. NIC connector. ilo connector. Serial connector. USB connectors (two). Keyboard connector 5. Mouse connector 6 Opteron Processor Servers

147 6. Video connector 7. Rear UID button and LED.8. Removing an HP ProLiant DL585 G from the Rack To access internal components in the HP ProLiant DL585 G server, you must first shut down power to the server and remove it from the rack. All of the servers in the cluster are secured to the rack on a sliding rail. This section describes how you shut down power, remove the server from the rack, and access internal components. When performing these tasks, heed the warnings and cautions listed in Important Safety Information (page ). The front panel power button on the HP ProLiant DL585 G, as shown in Figure -5, toggles between On and Standby. If you press the Power button on an HP ProLiant DL585 G to power down the server, the LED changes from green to amber, indicating Standby mode. In Standby mode, the server removes power from most electronics and drives. Portions of the power supply and some internal circuitry remain active. To completely remove all power from either server, disconnect the power cord first from the AC outlet and then from the server. To remove the ProLiant DL585 G from the rack, follow these steps:. Power down the server.. Disconnect all remaining cables on the server rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Pull down the quick-release levers on each side of the server to release the server from the rack, as shown by callout in Figure -55, and callout in Figure -56. Figure -55 Remove Server from Rack. Slide the server out of the rack until the rail locks engage, as shown in Figure HP ProLiant DL585 G 7

148 Figure -56 ProLiant DL585 G from the Rack 5. Press and hold the rail locks (see callout in Figure -56) and extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. To remove the access panel on the HP ProLiant DL585 G, as shown in Figure -57, follow these steps:. Remove the server from the rack, as described in Section.8... Locate and remove the Torx T-5 tool that is stored on the back of the server chassis to unlock the access panel latch. 8 Opteron Processor Servers

149 Figure -57 Unlock the ProLiant DL585 G Access Panel Latch. Lift up on the latch and remove the access panel. To replace the access panel, place the panel on top of the server with the latch open. Allow the panel to extend past the rear of the server approximately.5 cm (0.5 in). Push down on the latch. The access panel slides to a closed position. To return an HP ProLiant DL585 G server into a rack, press the rail-release levers at the front of both server rails and slide the server into the rack, as shown in Figure -56. Secure the server by snapping in the release latches..8. Replacing a PCI Card Figure -58 shows the HP ProLiant DL585 G PCI expansion slots..8 HP ProLiant DL585 G 9

150 Figure -58 HP ProLiant DL585 G PCI Slots The following table describes the callouts in Figure -58. Item Slot Bus Description Comment Slot 66 PCI-X, 6-bit/00-MHz (half length) PCI Interconnect Slot 66 PCI-X, 6-bit/00-MHz (full-length) Slot 7 PCI Express x (full-length) gigabit/sec Ethernet NIC Slot 76 PCI Express x (full-length) 5 Slot 5 70 PCI Express x8 (full-length) First GB/second Fibre Channel HBA (Optional) 6 Slot 6 79 PCI Express x (full-length) 7 Slot 7 PCI Express x8 (full-length) Second GB/second Fibre Channel HBA (Optional) 8 Slot 8 5 PCI Express x8 (full-length) 9 Slot 9 8 PCI Express x (half-length) To replace a PCI expansion card, follow these steps:. Attach a grounding strap to your wrist or ankle and a metal part of the chassis.. Press the Power button to power down the server. 50 Opteron Processor Servers

151 Note: When the server powers down, the Power button LED changes from green to amber, indicating Standby mode. In Standby mode, the server removes power from most electronics and drives, but portions of the power supply and some internal circuitry remain active until AC power is removed.. Disconnect the AC power cord, first from the AC outlet and then from the server.. Remove the server from the rack, as shown in Section Remove the access panel from the server, as shown in Figure -57, and locate the PCI slot. 6. Disconnect any cables connected to the expansion board. 7. Using the callouts in Figure -59 as a guide, press the PCI card retaining clip toward the front of the server to lock it in the open position (see callout ). Figure -59 Removing a PCI Card from an HP ProLiant DL585 G Server 8. Press down on the expansion slot latch to release it (callout ). 9. Unlock the retaining clip (callout ), if necessary, such as for full-length PCI expansion cards. 0. Remove the board from the slot (callout ).. Remove the new PCI card from its antistatic plastic bag. Handle the adapter gently, preferably by the front panel or card edges. Do not touch the connectors. The front panel of the adapter is the metal plate that contains the port connector and LEDs.. Record the adapter card serial number located on the card for future reference.. Insert the new PCI card in the slot, applying even pressure to seat the board securely. Be sure the adapter is fully seated.. Close the expansion slot latch (callout ). 5. Close the PCI retaining clip (callout ), if necessary. 6. Reinstall the access panel, reversing the steps in Section Replace the server in the rack, reversing the steps in Section HP ProLiant DL585 G 5

152 8. Attach any cables between the card and the switch, and reconnect the AC power cord. 9. Press the Power button on the server. Check that the card is detected. Refer to your software documentation for further installation instructions..9 HP ProLiant DL585 G5 The HP ProLiant DL585 G5 server typically functions as a control node, utility node, or compute (application) node in HP Cluster Platform. When using the ProLiant DL585 G5 as the control node, a redundant power supply is mandatory. Otherwise, a redundant power supply is optional. The U ProLiant DL585 G5 server can be configured with up to four AMD Opteron quad-core processors and up to 8 MB of memory. For the features and specifications of the ProLiant DL585 G5, go to the QuickSpecs on the HP website: The front and rear panel features of the ProLiant DL585 G5 are the same as the ProLiant DL585 G. See Figure -5 (page 5) and Figure -5 (page 6)..9. PCI Slot Assignments The following table provides the PCI slot assignments for ProLiant DL585 G5 when the server is used in HP Cluster Platform solutions. Slot Assignment PCI-X Interconnect Gigabit/second Ethernet NIC st Gigabit/second Fibre Channel HBA (Optional) PCI Express Interconnect Comment PCI-X, 6-bit/00-MHz PCI-X, 6-bit/00-MHz PCI Express x PCI Express x PCI Express x8 PCI Express x PCI Express x8 PCI Express x8 PCI Express x For additional information, such as the system board layout and installing PCI cards, see the HP ProLiant DL585 Generation 5 Server Maintenance and Service Guide: 5 Opteron Processor Servers

153 Server Blades An HP Cluster Platform solution can be configured with p-class or c-class enclosures. This chapter describes the BladeSystem enclosures and ProLiant BL servers and devices used in HP Cluster Platform solutions. All server blades feature high-performance memory, ilo/ilo advanced functionality, multiple general purpose Gigabit Ethernet network controllers, and optional FC SAN connectivity. This chapter presents overviews of the following: HP BladeSystem p-class (Section.) HP ProLiant BL5p (Section.) HP ProLiant BL5p (Section.) HP BladeSystem c-class enclosure (Section.) HP ProLiant BLx0c (Section.7) HP ProLiant BL60c (Section.8) HP ProLiant BL60c (Section.9) HP ProLiant BL80c (Section.0) HP ProLiant BL65c (Section.) HP ProLiant BL65c G5(Section.) HP ProLiant BL685c (Section.) HP ProLiant BL685c G5(Section.) HP Integrity BL860c (Section.5). HP BladeSystem p-class Overview The HP BladeSystem p-class solution consists of HP ProLiant BL server blades, network interconnect components, a rack-centralized power subsystem, and management tools that enable adaptive computing and is optimized for rapid deployment. Server blades feature high-performance DDR memory, BIOS-enhanced RAID, ilo advanced functionality, two general-purpose Gigabit Ethernet network controllers, and optional FC SAN connectivity. HP BladeSystem p-class 6U enclosures hold server blades and network interconnect options. The server blades slide into the blade enclosure backplanes for power and network connections. Each server blade enclosure has eight server blade bays in the center of the enclosure and two interconnect bays at each end. The signals are routed from the server blades, across the server blade enclosure backplane, and to the interconnect blades. The middle eight bays support server blades. Combinations of different series server blades are supported in the same server blade enclosure. Each enclosure supports a pair of switch or patch panel interconnects for network cable management. The upgraded enclosure also provides a single Ethernet port for connecting to the ilo interface of every installed server blade. Some models of server blades, including the BL5p, require the use of the enclosure with enhanced backplane components. HP BladeSystem p-class interconnects pass the network adapter (NIC) signals from the server blades to external networks. The p-class solution power subsystem is a U power enclosure that holds up to six hot-pluggable power supplies. Additional power supplies and power enclosures can be added to a system for redundancy. Power is carried from the power supplies in the power enclosures to the server blade enclosures through bus bars (for powering multiple enclosures) or a power bus box (for powering a single enclosure).. HP ProLiant BL5p Server Blade Overview The HP ProLiant BL5p features up to two AMD Opteron 00 series low-power processors per server blade. It has a modular, space-saving design that consumes less power and enables dense rack architectures.. HP BladeSystem p-class Overview 5

154 The HP ProLiant BL5p server blade has the following features: Feature Available processors Processor capacity Memory type Maximum memory NIC Slots Storage type Maximum hard drive bays Connects to fibre channel storage Storage controller Chassis Networking Remote management Power Specification AMD Opteron Model GHz, MB L (68W) PC00 DDR 00 MHz ( slots) : interleave 8 GB Two 0/00/000 NICs on mezzanine card + dedicated ilo port No ATA non-hot plug Optional small form factor ATA 60 GB hard disk drives Yes Integrated with chipset 6 server blades per 6U enclosure - 0/00/000T NICs + Dedicated ilo Port ilo Advanced Rack-centralized redundant power subsystem, with hot-pluggable power supplies Figure - shows the front panel of the HP ProLiant BL5p and Figure - shows its internal components. Figure - HP ProLiant BL5p Front Panel 5 UID NIC NIC Server Blades

155 The following table describes the callouts in Figure -. Item Description UID LED Internal system health LED NIC LED (actual NIC numeration depends on several factors, including the operating system installed on the server blade) NIC LED (actual NIC numeration depends on several factors, including the operating system installed on the server blade) Hard drive activity LED Power On/Standby button Local I/O port Figure - HP ProLiant BL5p Internal Components HP ProLiant BL5p Server Blade Overview 55

156 The following table describes the callouts in Figure -. Item Description Hard drive cage Fan assembly Fan assembly connectors () System maintenance switch (SW) Hard drive cable connector Processor socket DIMM bank B Processor socket (populated) DIMM bank A (populated) Adapter card connectors () Battery The HP ProLiant BL5p server blades require the support of an HP BladeSystem p-class sleeve in a server blade enclosure with enhanced backplane components (enhanced server blade enclosure). Each sleeve holds two HP BL5p server blades and installs in a single bay in the enclosure. Up to eight sleeves can be installed in the enclosure and each sleeve holds two blades for a total of 6 HP ProLiant BL5p blades per 6U enclosure. The enhanced server blade enclosure also provides a single rear ilo connector for single-cable remote management of all installed HP ProLiant BL5p server blades. For more information about the enhanced server blade enclosure, see the HP ProLiant BL p-class Server Blade Enclosure Upgrade Installation Guide or the HP ProLiant BL p-class Server Blade Enclosure Installation Guide. Each HP ProLiant BL5p server blade includes three network adapters: two Broadcom 570 Gigabit Ethernet Embedded 0/00/000T WOL (Wake On LAN) enabled with Preboot execution Environment (PXE) plus one additional 0/00T Ethernet adapter dedicated to ilo management... Supported Memory Configurations Each processor in the HP ProLiant BL5p has a bank consisting of two DIMM slots. The server blade supports up to 8 GB of memory. The following guidelines apply to the HP BL5p DIMMs: All DIMMs must be PC00 DDR 00-MHz SDRAM DIMMs. Both DIMM slots in a bank must be populated. Both DIMMs in a bank must be identical. DIMM bank A must always be populated. DIMM bank B is only active when processor socket is populated. For best performance, each processor should have a populated memory bank. Caution: Use only HP DIMMs. DIMMs from other sources may adversely affect data integrity. PC00 DIMMs can either be single- or dual-rank. A dual-rank DIMM is similar to having two separate DIMMs on the same module. Although only a single DIMM module, a dual-rank DIMM acts as if it were two separate DIMMs. The primary reason for the existence of dual-rank DIMMs is to provide the largest capacity DIMM given the current DIMM technology. If the maximum DIMM technology allows for creating GB single-rank DIMMs, a dual-rank DIMM using the same technology would be GB. 56 Server Blades

157 .. Supported Storage The HP ProLiant BL5p supports up to up to two 60 GB parallel ATA hard disk drives. The drive cage assembly lower drive bay is designated as the primary hard drive. The physical aspect of inserting and removing a disk drive is discussed in the document that ships with the drive and in the HP ProLiant BL5p Server Blade User Guide. In addition to the hard drives, the HP ProLiant BL5p has SAN storage capability. It can be configured for SAN connectivity when used with the following components: Fibre Channel adapter SAN-compatible interconnect SFP transceivers (included with the Dual Port FC Adapter) Optical FC cables Supported SAN and associated software For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant p-class server blade products web page: The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem p-class storage web page: Removing the HP ProLiant BL5p from the Sleeve To remove an HP ProLiant BL5p from the HP BladeSystem p-class sleeve in the blade enclosure, follow these steps: Back up all server blade data. Power down the server blade, using one of the following methods: Press the Power On/Standby button on the server blade front panel. Be sure that the server blade is in Standby mode by observing that the power LED is amber. This process may take 0 seconds, during which time some internal circuitry remains active. Use the virtual power button feature in the ilo Remote Console to power down the server blade from a remote location. After initiating a manual or virtual power down command, be sure that the server blade goes into Standby mode by observing that the power LED is amber. Important: When the server blade is in Standby mode, auxiliary power is still being provided. To remove all power from the server blade, remove the server blade from the server blade enclosure. Removing the sleeve from the server blade enclosure is not necessary. Important: Remote power procedures require the most recent firmware for the power enclosure and server blade enclosure management modules. Remove the server blade from the sleeve, as shown in Figure -.. HP ProLiant BL5p Server Blade Overview 57

158 Figure - Removing the HP ProLiant BL5p from the Enclosure Sleeve To install and power up a server blade, reverse the removal procedure. Server blades are set to power up automatically upon insertion. If you changed the setting, use the power button or ilo Virtual Power Button feature to power up the server blade. For more information about ilo, see the HP Integrated Lights-Out User Guide.. HP ProLiant BL5p Server Blade Overview The ProLiant BL5p four-processor server blade features AMD Opteron 800 series processors with dual-core technology, increased density, SAN storage capability, GB memory capacity and four gigabit Ethernet NICs standard. It supports maximum performance DDR memory, integrated SmartArray RAID controller, universal hot-pluggable SCSI hard drives, ilo advanced functionality, four general-purpose gigabit Ethernet network controllers, and optional FC SAN connectivity. The HP ProLiant BL5p also shares the same infrastructure components as all other p-class server blades. Each server blade supports up to four. GHz AMD Opteron Dual-Core processors with GHz HyperTransport and MB L cache. Two universal hot-pluggable SCSI hard drives provide up to 600 GB capacity, plus an embedded Smart Array 6i Plus controller with Ultra performance and optional battery-backed cache option. Sixteen DIMM slots have a maximum capacity of GB of 00-MHz, ECC PC00 DDR. Server blades feature x interleaved memory for added performance. DIMMs must be added in pairs. The characteristics of the HP ProLiant BL5p server blade are described in Table -. Table - ProLiant BL5p Characteristics Feature Available processors Processor capacity Memory type Maximum memory Storage type Specification AMD Opteron Model GHz, MB L cache (dual-core) or.6 GHz, MB L cache (single-core) PC00 DDR GB SCSI hot plug 58 Server Blades

159 Table - ProLiant BL5p Characteristics (continued) Feature Maximum hard drive bays Connects to Fibre Channel storage Storage controller Chassis Networking Remote management Power Specification.5" universal SCSI hot-pluggable hard disk drive bays Yes Smart Array 6i Plus server blades per 6U enclosure - 0/00/000T NICs + Dedicated ilo Port ilo Advanced Rack-centralized redundant power subsystem, with hot-pluggable power supplies Figure - displays the front panel of the HP ProLiant BL5p. Figure - ProLiant BL5p Front Panel The following table describes the callouts in Figure -. Item Description Hot-pluggable SCSI hard disk drive bay I/O port Power On/Standby button Hot-pluggable SCSI hard disk drive bay The I/O port is used with the local I/O cable to perform some server blade configuration and diagnostic procedures. Figure -5 displays the rear panel components of the HP ProLiant BL5p.. HP ProLiant BL5p Server Blade Overview 59

160 Figure -5 HP ProLiant BL5p Rear Panel Components Item Description Power connectors Signal connector The HP ProLiant BL5p has two system boards. The primary system board relates to the first and second processor, and the second system board relates to the third and fourth processors. Figure -6 displays the primary system board, and Figure -7 displays the secondary system board. Figure -6 HP ProLiant BL5p Primary System Board Server Blades

161 The following table describes the callouts in Figure -6. Item Description Fibre Channel adapter (optional) Power converter modules Smart Array 6i controller Smart Array 6i battery-backed write cache enabler (optional) Processor memory bank Processor memory bank (shown populated) DIMMs - Processor socket (shown populated) SCSI backplane board connector Power button/led board connector System maintenance switch (SW) DC filter module Standard NIC mezzanine card System battery Processor memory bank Processor memory bank (shown populated) DIMMs 5-8 Processor socket (shown populated) SCSI backplane board connector Fan connectors. HP ProLiant BL5p Server Blade Overview 6

162 Figure -7 HP ProLiant BL5p Secondary System Board The following table describes the callouts in Figure -7. Item Description DC filter module Processor memory bank Processor memory bank (shown populated) DIMMs 9- Processor socket (shown populated) Fan connectors Power converter modules Processor memory bank Processor memory bank (shown populated) DIMMs -6 Processor socket (shown populated).. Supported Memory The HP ProLiant BL5p server blade ships with two DIMMs installed in memory bank for each installed processor. Each processor has two banks, and each bank consists of two DIMM slots. 6 Server Blades

163 DIMM banks are active only when the corresponding processor socket is populated. The following guidelines apply to the BL5p DIMMS: All DIMMs must be PC00 DDR 00-MHz SDRAM DIMMs. Both DIMM slots in a bank must be populated. Both DIMMs in a bank must be identical. Processor memory bank must always be populated. If mixing dual- and single-rank DIMMs, the dual-rank DIMMs must be installed in memory bank. For optimal performance in most applications, populate memory bank for every populated processor socket. For DIMM slots and, remove the air baffle, if necessary. Caution: Use only HP DIMMs. DIMMs from other sources may adversely affect data integrity. PC00 DIMMs can either be single- or dual-rank. A dual-rank DIMM is similar to having two separate DIMMs on the same module. Although only a single DIMM module, a dual-rank DIMM acts as if it were two separate DIMMs. The primary reason for the existence of dual-rank DIMMs is to provide the largest capacity DIMM given the current DIMM technology. If the maximum DIMM technology allows for creating -GB single-rank DIMMs, a dual-rank DIMM using the same technology would be GB.. Supported Storage The HP ProLiant BL5p supports up to two Optional Wide Ultra SCSI drives for a maximum of 600 GB internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that comes with the drive and in the HP ProLiant BL5p Server Blade User Guide. The HP ProLiant BL5p server blade also delivers optional Fibre Channel support for SAN implementations and clustering capabilities. Fibre Channel capability is achieved using a Dual Port Fibre Channel Mezzanine Card ( GB) specifically designed for the HP ProLiant BL5p. For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant p-class server blade products Web page: The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem p-class storage Web page: Removing the HP ProLiant BL5p from the Rack Enclosure To remove an HP ProLiant BL5p server from the blade enclosure, follow these steps: Back up all server blade data. Power down the server blade, using one of the following methods: Press the Power On/Standby button on the server blade front panel. Be sure that the server blade is in Standby mode by observing that the power LED is amber. This process may take 0 seconds, during which time some internal circuitry remains active. Use the virtual power button feature in the ilo Remote Console to power down the server blade from a remote location. After initiating a manual or virtual power down. HP ProLiant BL5p Server Blade Overview 6

164 command, be sure that the server blade goes into Standby mode by observing that the power LED is amber. Important: When the server blade is in Standby mode, auxiliary power is still being provided. To remove all power from the server blade, remove the server blade from the server blade enclosure. Removing the sleeve from the server blade enclosure is not necessary. Important: Remote power procedures require the most recent firmware for the power enclosure and server blade enclosure management modules. Remove the server blade from the blade enclosure, as shown in Figure -8. Figure -8 Removing the HP ProLiant BL5p from the Rack Enclosure To install and power up a server blade, reverse the removal procedure. Server blades are set to power up automatically upon insertion. If you changed the setting, use the power button or ilo Virtual Power Button feature to power up the server blade. For more information about ilo, see the HP Integrated Lights-Out User Guide.. HP BladeSystem c-class Enclosure Overview The HP BladeSystem c-class Enclosure provides all the power, cooling, and I/O infrastructure needed to support today s modular server, interconnect, and storage components as well as to meet these needs throughout the next several years. The c-class enclosure (see Section..) is 0U high and holds up to 6 server and/or storage blades plus optional redundant network and storage interconnect modules. It includes a shared, multiterabit high-speed midplane for wire-once connectivity of server blades to network and shared storage. Power is delivered through a pooled power backplane that ensures the full capacity of the power supplies is available to all server blades... HP BladeSystem c Class Enclosure Features The HP BladeSystem c Class enclosure consolidates the essential elements of a datacenter power, cooling, management, connectivity, redundancy, security into a modular, self-tuning unit with built-in intelligence. The 0U rack-mount c-class enclosure supports up to 6 multicore dual-processor server blades, and is offered in single or three-phase power options for maximum power configuration flexibility. The c Class enclosure offers up to four redundant I/O fabrics and a five Terabit backplane to support current and future I/O connections. The c Class enclosure 6 Server Blades

165 includes Onboard Administrator enclosure management, ilo server management, and HP Insight Control so you can manage servers and enclosures locally and remotely with complete control regardless of the state of the server operating system. The c Class enclosure can be populated with the following components: Up to eight full-height server blades or up to 6 half-height server and/or storage blades per enclosure Up to eight interconnect modules supporting a variety of network interconnect fabrics such as Ethernet, Fibre Channel (FC), InfiniBand (IB), Internet Small Computer System Interface (iscsi), or Serial-attached SCSI (SAS) simultaneously within the enclosure Active Cool fan kits for a maximum of 0 fans Up to six power supplies Redundant Onboard Administrator management modules (optional active-standby design) All devices are customer replaceable and hot-pluggable. Table - describes the features of the HP Bladesystem c-class enclosure. Figure -9 and Figure -0 show the front and rear views of an HP BladeSystem c Class enclosure. Table - HP BladeSystem c Class Enclosure Features Item Description Capacity Device bays Up 6 half-height server blades Up to eight full-height server blades Mixed configurations supported Interconnect bays Power supply Fans Onboard Administrator Eight, in any I/O fabric Up to 6 x 50W or 6 standard, up to 0 total Power -phase North America & Japan model -phase International model Single-phase model x NEMA L5-0p x IEC 09 5-Pin, 9h, Red, 6A 6 x IEC-0 C0 Interconnects Ethernet HP Gb Ethernet Pass-Thru Module Cisco Catalyst Blade Switch 00 GbEc Ethernet Blade Switch Fibre Channel HP 6 port Gb FC Pass-Thru Module Brocade Gb SAN Switch InfiniBand HP x DDR IB Switch Module Dimensions Height Width Depth 0U 7.5in (5 mm) fits 9 inch rack in (8 mm). HP BladeSystem c-class Enclosure Overview 65

166 Note: This guide only addresses the HP BladeSystem c7000 enclosure. For information about the HP BladeSystem c000 enclosure, see either of the following documents depending on how the HP BladeSystem c000 enclosure is provided: If the c000 enclosure is rack-mounted, see the Workgroup System and Cluster Platform Express Overview and Hardware Installation Guide. If the c000 enclosure is the pedestal version, see the HP Cluster Platform Workgroup System Tower Hardware Installation Guide. Figure -9 HP BladeSystem c Class Enclosure Front View 5 The following list corresponds to the callouts shown in Figure -9:. Device bay (up to 6 half-height server blades). Device bay 6. Onboard Administrator Insight Display. Power supply bay ( 6 standard, up to 0 optional) 5. c-class (c7000) BladeSystem enclosure 66 Server Blades

167 Figure -0 HP BladeSystem c Class Enclosure Rear View 5 The following list corresponds to the callouts in Figure -0:. Active cool fan bays (up to 0 fans). Interconnect bays. Power connections single phase shown (three phase power is hard-wired to chassis). Onboard Administrator 5. Redundant Onboard Administrator Note: See the HP BladeSystem c7000 Enclosure Setup and Installation Guide for more information on LEDs and buttons for the Onboard Administrator... HP BladeSystem c Class Enclosure Device Bay Numbering The BladeSystem c Class enclosure can be loaded with eight full-height or 6 half-height device bays, as shown in Figure - and Figure -.. HP BladeSystem c-class Enclosure Overview 67

168 Figure - HP BladeSystem c Class Enclosure Device Bay Numbering (Full-Height Device Bays) Figure - HP c Class BladeSystem Enclosure Device Bay Numbering (Half-Height Device Bays) Figure - shows a sample configuration with half-height and full-height server blades. 68 Server Blades

169 Figure - HP c Class BladeSystem Enclosure Example The following list corresponds to the callouts in Figure -.. Two full-height ProLiant BL80c server blades. Six half-height ProLiant BL60c server blades. Six blanks (must be installed if not using server bays for proper airflow and cooling). Front rail mounting screw (four) 5. Hot-swap power supply bays (occupied) 6. Onboard Administrator Insight Display 7. ProLiant BL80c server blade hard drive 8. Systems manager display connector.. Interconnect Module Bay Numbering You must install interconnect modules in the appropriate bay(s) to support network connections for specific signals. Figure - shows the module bay numbers in the c-class enclosure and Figure -5 provides descriptions for each bay.. HP BladeSystem c-class Enclosure Overview 69

170 Figure - HP c Class BladeSystem Module Bay Numbering Figure -5 HP c Class BladeSystem Module Bay Numbering Descriptions 70 Server Blades

171 Note: For information on the location of LEDs and ports on individual interconnect modules, see the documentation that ships with the interconnect module... HP BladeSystem c-7000 Interconnect Module Bay to Server Blade Type Port Mapping The following table maps the server blade's embedded NICs and mezzanine port slot assignments for various server blade types (single density full-height, single density half-height, and double density half-height server blades) to the HP BladeSystem c-7000 enclosure interconnect module bays. Table - HP BladeSystem c-7000 Interconnect Module Bay to Server Blade Type Port Mapping Interconnect Bay Single-Density Half-Height Server Blade Double-Density Half-Height Server Blade - Server A Double-Density Half-Height Server Blade - Server B Single-Density Full-Height Server Blade NIC (embedded) NIC (embedded) N/A NIC (embedded) NIC (embedded) NIC (embedded) N/A NIC (embedded) NIC (embedded) NIC (embedded) Mezzanine slot, port NIC (embedded) N/A N/A NIC (embedded) Mezzanine slot, port 5 6 Mezzanine slot, port Mezzanine port N/A Mezzanine slot, port Mezzanine slot, port 7 8 Mezzanine slot, port N/A Mezzanine port Mezzanine slot, port Mezzanine slot, port For more information on mapping to interconnect ports, see the HP BladeSystem c7000 Enclosure Setup and Installation Guide.. HP BladeSystem c-class Enclosure Overview 7

172 .5 Server Blade Type vs Gigabit Ethernet Blade Switch with Bandwidth Ratios The following table provides the server blade type to gigabit Ethernet blade switch bandwidth (BW) ratios. For more information on the gigabit Ethernet switch modules listed in the table below, see the HP Cluster Platform Gigabit Ethernet Hardware Guide. Server Blade Type One 6-Port Pass-Through Module Per HP BladeSystem c-7000 Enclosure (0670-B) Two 6-Port Pass-Through Modules Per HP BladeSystem c-7000 Enclosure (0670-B) One 8-Port Cisco Switch Module per HP BladeSystem c-7000 Enclosure (096 B) Two 8-Port Cisco Switch Modules per HP BladeSystem c-7000 Enclosure (096 B) One -Port HP GbEc Switch Module per HP BladeSystem c-7000 Enclosure (097-B) Two -Port HP GbEc Switch Modules per HP BladeSystem c-7000 Enclosure (097-B) Single density full-height : BW N/A : BW N/A : BW N/A Single density half-height : BW N/A : BW N/A : BW N/A Double density half-height N/A : BW N/A : BW N/A : BW Note: The part numbers listed in the table above are subject to change without notice..6 HP x DDR InfiniBand Switch Module for c-class BladeSystem The HP x DDR InfiniBand switch module is inserted in a double-wide module bay in the back of the HP c-class BladeSystem enclosure. The x DDR InFiniBand switch module is based on the Mellanox -port InfiniScale III x DDR InfiniBand switch chip. The x DDR InfiniBand switch module provides InfiniBand x DDR ports with 0 Gb/s port-to-port connectivity. The ports are arranged as 6 downlinks to connect up to 6 server blades in the enclosure, and eight uplinks to connect to external InfiniBand switches to build an InfiniBand fabric. The x DDR InfiniBand switch module is designed to fit into the double-wide switch bays in the c-class enclosure. Section.6. describes the installation procedures for the x DDR InfiniBand switch module..6. HP x DDR InfiniBand Switch Module Removal and Installation Procedure Depending on the mezzanine connectors used for the x DDR InfiniBand Mezzanine HCA, the x DDR IB switch module has to be inserted into switch bays and, 5 and 6, or 7 and 8. The default x DDR InfiniBand double-wide switch module ( ports w/6 DDR links down, and 8 DDR links up) will occupy I/O Bay Row- (Bays 5 and 6) of the c-class (c7000) enclosure for both half-height (HH) and full-height (FH) server blades. A full-height server blade can support an additional InfiniBand mezzanine option in mezzanine slot, along with a second double-wide x DDR InfiniBand switch module installed in I/O bay row- which corresponds to bays 7 and 8 in the rear of the c-class enclosure. In this configuration, a full-height server blade configuration can be viewed as having a : I/O ratio. For the bandwidth ratios for different server blade mezzanine HCA to interconnect module bays in HP Cluster Platform BladeSystem configurations, see Table -. 7 Server Blades

173 Table - HP Cluster Platform Server Blade Configurations to InfiniBand Interconnect Module Types (Bandwidth Ratios) Server Blade Type One -Port InfiniBand Module per HP BladeSystem c-7000 Enclosure (i.e. 098-B) Two -Port InfiniBand Modules per HP BladeSystem c-7000 Enclosure (i.e. 098-B) One -Port InfiniBand Module per HP BladeSystem c-7000 Enclosure (i.e. TBD) Two -Port InfiniBand Modules per HP BladeSystem c-7000 Enclosure (i.e. TBD) Single density full-height : Bandwidth N/A : Bandwidth N/A Single density half-height : Bandwidth : Bandwidth : Bandwidth N/A Double density half-height N/A : Bandwidth N/A : Bandwidth Note: The part numbers listed in the table above are subject to change without notice. Note: In order to add another x DDR InfiniBand switch module to a c-class enclosure, it may be necessary to remove the existing c-class cable management bracket. If the c-class blade cable management bracket needs to be removed, reverse the installation procedure described in the HP Cluster Platform c-class Blade Cable Management Bracket Installation Guide. In most instances, it is not necessary to remove the cables from the bracket, however, it might be necessary to remove the cables from the interconnect module. To install the HP x DDR InfiniBand Switch Module, follow these steps:. Prepare the bay by removing any devices, blanks and the divider, as shown by callouts and in Figure -6. Figure -6 Prepare the Bay to Install the x DDR IB Switch Module.6 HP x DDR InfiniBand Switch Module for c-class BladeSystem 7

174 . Install the x DDR IB switch module into the appropriate double-wide bay and close the release lever as shown by callouts and in Figure -7. Figure -7 Install the x DDR IB Switch Module.7 HP ProLiant BLx0c G5 Server Blade The HP ProLiant BLx0c G5 server blade can be used as a control node, a utility node, and a compute node in HP Cluster Platform configurations. The HP BladeSystem c-7000 enclosure can accommodate up to 6 HP ProLiant BLx0c G5 half-height double-density server blades. For the features and specifications of the HP ProLiant BLx0c G5, see the QuickSpecs on the HP website: Figure -8 shows the front view of a ProLiant BLx0c G5 server blade. Figure -8 HP ProLiant BLx0c G5 Front View Server Blades The following list describes the callouts shown in Figure -8:

175 . Server B Power On/Standby button and power LED. Server B UID LED. Server B health LED. Server B NIC link and activity LED 5. Server B serial label pull tab 6. Server B HP c-class Blade SUV cable connector 7. Server blade handle 8. Server A Power On/Standby button and power LED 9. Server A UID LED 0. Server A health LED. Server A NIC link and activity LED. Server A serial label pull tab. Server A HP c-class Blade SUV cable connector For an internal view of the HP ProLiant BLx0c G5 and additional information, such as the system board layout and installing mezzanine HCAs, see the HP ProLiant BLx0c Generation 5 Server Maintenance and Service Guide: HP ProLiant BL60c G5 Server Blade The HP ProLiant BL60c G5 server blade can be used as a control node, a utility node, and a compute node in HP Cluster Platform configurations. For the features and specifications of the HP ProLiant BL60c G5, see the QuickSpecs on the HP website: Figure -9 shows the front view of a ProLiant BL60c G5 server blade. Figure -9 HP ProLiant BL60c Front View The following list describes the callouts shown in Figure -9:. Serial label pull tab. Local I/O connector. UID LED/button. Health LED 5. NIC LED 6. NIC LED 7. Hard drive activity LED 8. Release button.8 HP ProLiant BL60c G5 Server Blade 75

176 9. Power On/Standby button and system power LED 0. Server blade handle For an internal view of the HP ProLiant BL60c G5 and additional information, such as the system board layout and installing mezzanine HCA cards, see the HP ProLiant BL60c Generation 5 Server Maintenance and Service Guide: HP ProLiant BL60c and BL60c G5 Server Blade Overview The HP BladeSystem c Class enclosure supports up to 6 HP ProLiant BL60c server blades. The HP ProLiant BL60c provides dual-processor, dual-core Intel Xeon processors, DDR fully buffered DIMMs, serial attached SAS or SATA hard drives, support of multifunction NICs, and multiple I/O cards. The HP ProLiant BL60c includes high-availability features such as hot-pluggable hard drives, mirrored-memory, online spare memory, memory interleaving, embedded RAID capability, and enhanced remote Lights-Out management. Table -5 lists the features of the HP ProLiant BL60c server blade. Table -5 HP ProLiant BL60c Features Item Processor Description Up to two Intel and Xeon 5000 and 500 series dual-core processors Supports up to.0 GHz MHz or 066 MHz FSB; MB level cache memory Intel 5000P chipset supporting up to a MHz Front Side Bus Memory Up to GB of memory, supported by eight slots of PC-500 fully buffered DIMMs at 667 MHz Supporting memory interleaving ( x ); memory mirroring and online spare capacity Storage Controller Internal Drive Support Network Controller Integrated Smart Array E00i RAID controller with 6 MB cache (with optional battery-backed write-cache with an upgrade to 8MB cache (BBWC). Supports RAID 0, Up to two small form factor (SFF) SAS or SATA hot-plug hard disk drives Two embedded single port NC7i multifunction gigabit network adapters One additional 0/00 NIC dedicated to ilo management Mezzanine Support Two additional I/O expansion slots via mezzanine card Supports up to two mezzanine cards: Dual-port Fibre Channel mezzanine (-Gb) options for SAN connectivity (choice of Emulex or QLogic). Ethernet NIC mezzanine options for additional network ports HP NC7m PCI Express Dual Port Multifunction Gigabit Server Adapter HP NC6m PCI Express Dual Port Gb Server Adapter for c-class BladeSystem InfiniBand and 0GbE Internal USB Support Form Factor Management Operating Systems Enclosures One internal USB.0 connector for security key devices and USB drive keys HP ProLiant BL60c server blade plugs vertically into the BladeSystem c-class enclosure Integrated Lights-Out (ilo ) Standard Blade Edition (includes virtual KVM and graphical remote console) Supports Windows, Linux, and Netware operating systems HP ProLiant BL60c server blade plugs vertically into the BladeSystem c-class enclosure 76 Server Blades

177 For the features and specifications of the HP ProLiant BL60c G5, go to: HP ProLiant BL60c Front View Figure -0 shows the front view of a ProLiant BL60c server. Figure -0 HP ProLiant BL60c Front View The following list describes the callouts shown in Figure -0:. Hard drive bay. Power On/Stand-by button. Local I/O connector. Hard drive bay 5. Server blade handle 6. Release button 7. Serial label pull tab.9. HP ProLiant BL60c Front Panel LEDs Figure - shows the front panel LEDs of the ProLiant BL60c. Figure - HP ProLiant BL60c Front Panel LEDs 5 The following table describes the callouts in Figure -: Item Description UID LED Status Blue = Identified Blue flashing = Active remote management.9 HP ProLiant BL60c and BL60c G5 Server Blade Overview 77

178 Item 5 Description Health LED NIC LED NIC LED System power LED Status Off = No active remote management Green = Normal Flashing = Booting Amber = Degraded condition Red = Critical condition Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = On Amber = Standby (auxiliary power available) Off = Off Actual NIC numbers depend on several factors, including the operating system installed on the server blade..9. HP ProLiant BL60c Internal View Figure - shows the internals of the HP ProLiant BL60c. Figure - HP ProLiant BL60c Internal View The following list corresponds to the callouts in Figure -:. Two hot-plug SAS/SATA drive bays. Embedded Smart Array Controller integrated on drive backplane. Two mezzanine slots: one x, one x8. Eight fully buffered DIMM slots DDR II 667Mhz.9. HP ProLiant BL60c System Board 78 Server Blades Figure - shows the system board components of an HP ProLiant BL60c.

179 Figure - HP ProLiant BL60c System Board Components The following list describes the callouts in Figure -:. System board thumbscrew. Processor socket. Processor socket (populated). Hard drive backplane connector 5. FBDIMMs (8) 6. Embedded NICs () 7. Mezzanine connector [Type I mezzanine only (shown)] 8. Battery 9. Mezzanine connector [Type I (shown) or Type II mezzanine] 0. System maintenance switch (SW). System board thumbscrew. Enclosure connector.9.5 Memory Options The HP ProLiant BL60c server contains eight FBDIMM slots. You can expand server memory by installing supported DDR- FBDIMMs. Caution: Use only HP FBDIMMs. FBDIMMs from other sources may adversely affect data integrity. The HP ProLiant BL60c supports the following Advanced Memory Protection (AMP) options to optimize server availability: Advanced ECC supporting up to 6 GB of active memory using -GB FBDIMMs. Online Spare Memory providing additional protection against degrading FBDIMMs, supporting up to GB of active memory and GB of online spare memory utilizing -GB FBDIMMs. Mirrored memory providing protection against failed FBDIMMs supporting up to 8 GB of active memory and 8 GB of mirrored memory utilizing -GB FBDIMMs..9 HP ProLiant BL60c and BL60c G5 Server Blade Overview 79

180 Maximum memory capacities for all AMP modes will increase with the availability of -GB FBDIMMs, including a maximum of GB in Advanced ECC mode. For the latest memory configuration information, see the QuickSpecs at: The Advanced Memory Protection option is configured in RBSU. By default, the server is set to Advanced ECC mode. For more information, see the HP ROM-Based Setup Utility in the HP ProLiant BL60c Server Blade User Guide. If the configured AMP mode is not supported by the installed FBDIMM configuration, the system boots in Advanced ECC mode. The following configuration requirements apply to all AMP modes: FBDIMMS must be ECC registered DDR- SDRAM FBDIMMs. FBDIMMs must be installed in pairs. FBDIMM pairs in a memory bank must have identical HP part numbers. FBDIMMS must be populated as specified for each AMP memory mode. The memory subsystem for this server blade is divided into two branches. Each memory branch is essentially a separate memory controller. The FBDIMMs map to the two branches as indicated in the following table: Branch 0 FBDIMM A FBDIMM A FBDIMM C FBDIMM C Branch FBDIMM 5B FBDIMM 7B FBDIMM 6D FBDIMM 8D This multibranch architecture provides enhanced performance in Advanced ECC mode. The concept of multiple branches is important for the operation of online spare mode and mirrored memory mode. If the server blade contains more than GB of memory, consult the operating system documentation about accessing the full amount of installed memory. For memory options information see the HP ProLiant BL60c Server Blade User Guide..9.6 Mezzanine HCA Card In HP Cluster Platform, the HP ProLiant BL60c server blades are preconfigured with an HP x DDR IB Mezzanine HCA for the HP c-class BladeSystem, which works with the HP x DDR InfiniBand Switch Module installed in the rear of the c-class enclosure. For more information on the mezzanine HCA card, see the HP ProLiant BL60c Server Blade User Guide. For more information on the x DDR InfiniBand Switch Module, see the HP Cluster Platform InfiniBand Interconnect Installation and User's Guide..9.7 Supported Storage The HP ProLiant BL60c supports up to two optional Hot Plug Serial Attach SCSI (SAS) drives for a maximum of GB ( x 7 GB Serial SCSI) internal storage or up to two optional hot-plug serial ATA (SATA) drives for a maximum of 0GB ( x 60 GB serial ATA) internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that comes with the drive and in the HP ProLiant BL60c Server Blade User Guide. Two optional Fibre Channel HBAs are supported by the HP ProLiant BL60c. Both mezzanine circuit boards connect directly to the server blade system board. These Fibre Channel HBAs are available via option kits and must be ordered separately. 80 Server Blades

181 For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant c-class server blade products web page: The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem c-class storage web page: Removing the HP ProLiant BL60c from the c Class Enclosure To remove the HP ProLiant BL60c server blade from the c Class enclosure, follow these steps:. Identify the proper server blade and back up the data.. Depending on the Onboard Administrator configuration, use one of the following methods to power down the server blade: Use a virtual power button selection through ilo. This method initiates a controlled remote shutdown of applications and the operating system before the server blade enters Standby mode. Press and release the Power On/Standby button. This method initiates a controlled shutdown of applications and the operating system before the server blade enters Standby mode. Press and hold the Power On/Standby button for more than seconds to force the server blade to shut down. This method forces the server blade to enter standby mode without properly exiting applications and the operating system. It provides an emergency shutdown method in the event of a hung application. Important: When the server blade is in Standby mode, auxiliary power is still being provided. To remove all power from the server blade, remove the server blade from the enclosure. After initiating a virtual power down command, be sure that the server blade goes into Standby mode by observing that the system power LED is amber.. Remove the server blade by pressing the release button (see callout in Figure -), pulling down the release lever (see callout in Figure -), and sliding the server blade out from the enclosure (see callout in Figure -)..9 HP ProLiant BL60c and BL60c G5 Server Blade Overview 8

182 Figure - Removing a ProLiant BL60c from the c Class Enclosure. Place the server blade on a flat, level work surface. Warning! To reduce the risk of personal injury from hot surfaces, allow the drives and the internal system components to cool before touching them. Caution: 8 Server Blades To prevent damage to electrical components, properly ground the server blade before beginning any installation procedure. Improper grounding can cause electrostatic discharge. To install and power up a server blade, reverse the removal procedure. The Onboard Administrator initiates an automatic power-up sequence when the server blade is installed. If the default setting is changed, use one of the following methods to power up the server blade: Use a virtual power button selection through ilo. Press and release the Power On/Standby button. When the server blade goes from the standby mode to the full power mode, the system power LED changes from amber to green. For more information about the Onboard Administrator, see the HP BladeSystem c7000 Enclosure Setup and Installation Guide at: The ilo subsystem is a standard component of selected ProLiant servers that provides server health and remote server manageability. The ilo subsystem includes an intelligent microprocessor, secure memory, and a dedicated network interface. This design makes ilo independent of the host server and its operating system. The ilo subsystem provides remote access to any authorized network client, sends alerts, and provides other server management functions. Using ilo, you can: Remotely power up, power down, or reboot the host server. Send alerts from ilo regardless of the state of the host server. Access advanced troubleshooting features through the ilo interface. Diagnose ilo using HP SIM through a web browser and SNMP alerting. For more information about ilo, see the ilo documentation on the HP web page:

183 .0 HP ProLiant BL80c Server Blade Overview The HP BladeSystem c Class enclosure supports up to eight HP ProLiant BL80c server blades. The HP ProLiant BL80c provides dual-processor, dual-core Intel Xeon processors, DDR fully buffered DIMMs, serial attached SAS or SATA hard drives, support of multifunction NICS, and multiple I/O cards. The HP BL80c includes high-availability features such as hot-pluggable hard drives, mirrored-memory, online spare memory, memory interleaving, embedded RAID capability, and enhanced remote Lights-Out management. Table -6 lists the features of the HP ProLiant BL80c server blade. Table -6 HP Proliant BL80c Features Item Processor Description Up to two dual-core Intel Xeon 5000 or 500 Sequence processors Intel 5000P chipset supporting up to a MHz front-side bus (FSB) Memory Up to 8 GB of memory supported by PC-500, fully buffered DIMMs at 667 MHz Supports memory interleaving ( x ), memory mirroring, and online spare capacity Storage Controller Internal Drive Support Network Controller Integrated Smart Array P00i RAID controller with 56 MB cache (with optional battery-backed write cache) supports RAID 0//5 Up to four small form factor (SFF) SAS or SATA hot-plug hard drives Four embedded NIC ports, plus one additional management NIC port: One embedded NC6i dual-port Gigabit server adapter Two embedded NC7i multifunction Gigabit server adapters One additional 0/00 NIC dedicated to ilo management Mezzanine Support Three additional I/O expansion slots via mezzanine card Supports up to three mezzanine cards: Dual-port Fibre Channel mmezzanine ( Gb) options for SAN connectivity (choice of Emulex or QLogic). Ethernet NIC mezzanine options for additional network ports HP NC6m PCI Express dual-port Gb server adapter for c-class BladeSystem HP NC7m PCI Express dual-port multifunction Gigabit server adapter Infiniband (IB) and 0 GbE Internal USB Support Management Operating Systems Enclosures One internal USB.0 connector for security key devices and USB drive keys Integrated Lights-Out (ilo ) Standard Blade Edition (includes virtual KVM and graphical remote console) Supports Windows, Linux, and NetWare operating systems HP ProLiant BL80c server blade plugs vertically into the BladeSystem c-class enclosure.0. HP ProLiant BL80c Front View Figure -5 shows the front view of a ProLiant BL80c server..0 HP ProLiant BL80c Server Blade Overview 8

184 Figure -5 HP ProLiant BL80c Front View The following list describes the callouts in Figure -5:. Hard drive bay. Hard drive bay. Hard drive bay. Hard drive bay 5. Server blade handle 6. Server blade handle release button 7. Serial label pull tab 8. Local I/O cable connector (the local I/O cable connector is used with the local I/O cable to perform some server blade configuration and diagnostic procedures) 9. Power On/Standby button.0. HP ProLiant BL80c Front Panel LEDs Figure -6 shows the front panel LEDs of the HP ProLiant BL80c. Figure -6 HP ProLiant BL80c Front Panel LEDs Table -7 HP ProLiant BL80c Front Panel LEDs Item Description UID LED Health LED Status Blue = Identified Blue flashing = Active remote management Off = No active remote management Green = Normal Flashing = Booting 8 Server Blades

185 Table -7 HP ProLiant BL80c Front Panel LEDs (continued) Item Description NIC LED NIC LED NIC LED NIC LED System power LED Status Amber = Degraded condition Red = Critical condition Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = On Amber = Standby (auxiliary power available) Off = Off Actual NIC numbers depend on several factors, including the operating system installed on the server blade..0. HP ProLiant BL80c Internal View Figure -7 shows the internals of the HP ProLiant BL80c..0 HP ProLiant BL80c Server Blade Overview 85

186 Figure -7 HP ProLiant BL80c Internal View The following list describes the callouts in Figure -7:. Four hot-pluggable SAS/SATA drive bays. Embedded smart array controller integrated on drive backplane. Three mezzanine slots: one x, two x8. Twelve fully buffered DIMM slots DDR II 667 Mhz.0. HP ProLiant BL80c System Board Figure -8 shows the system board components. 86 Server Blades

187 Figure -8 HP ProLiant BL80c System Board Components The following list describes the callouts in Figure -8:. Processor socket (populated). System board thumbscrew. Processor socket. Bezel LED connector 5. Hard drive backplane connector 6. System battery 7. System maintenance switch (SW) 8. Embedded NICs 9. Mezzanine connector (Type I or Type II mezzanine) 0. Enclosure connector. Mezzanine connector (Type I mezzanine only). System board thumbscrew. Mezzanine connector (Type I or Type II mezzanine). Enclosure connector 5. System board thumbscrew 6. FBDIMM slots (-).0.5 Memory Options The HP ProLiant BL80c server blade contains memory expansion slots. You can expand server memory by installing supported DDR- FBDIMMs..0 HP ProLiant BL80c Server Blade Overview 87

188 Caution: Use only HP FBDIMMs. FBDIMMs from other sources may adversely affect data integrity. The ProLiant BL80c supports the following Advanced Memory Protection (AMP) options to optimize server availability. Advanced ECC supporting up to 8 GB of active memory using GB FBDIMMs. Online Spare Memory supporting up to 0 GB of active memory and 8 GB of online spare memory using GB FBDIMMs. Online Spare Memory provides additional protection against degrading memory. Mirrored memory supporting up to GB of active memory and GB of mirrored memory using GB FBDIMMs. Mirrored memory provides protection against failed memory. For the latest memory configuration information, see the QuickSpecs on the HP Wweb page: For memory options information, see the HP ProLiant BL80c Server Blade User Guide. For more information on HP ROM-Based Setup Utility (RBSU), see the HP ROM-Based Setup Utility User Guide on the HP web page: Mezzanine HCA Card In HP Cluster Platform, the HP ProLiant BL80c server blades are pre-configured with an HP x DDR InfiniBand Mezzanine HCA for HP c-class BladeSystems which works with the HP x DDR InfiniBand Switch Module installed in the rear of the c Class enclosure. For more information on the mezzanine HCA card, see the HP ProLiant BL80c Server Blade User Guide. For more information on the HP x DDR InfiniBand switch module, see the HP Cluster Platform InfiniBand Interconnect Installation and User's Guide..0.7 Supported Storage The HP ProLiant BL80c supports up to four optional hot-pluggable serial attached SCSI (SAS) drives for a maximum of GB ( x 7GB Serial SCSI) internal storage or up to two optional hot-pluggable serial ATA (SATA) drives for a maximum of 0 GB ( x 60 GB Serial ATA) internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that ships with the drive and in the HP ProLiant BL80c Server Blade User Guide. Two optional Fibre Channel HBAs are supported by the HP ProLiant BL80c. Both mezzanine circuit boards connect directly to the server blade system board. These Fibre Channel HBAs are available via option kits and must be ordered separately. For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant c-class server blade products web page: The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem c-class storage web page: 88 Server Blades

189 .0.8 Removing the HP ProLiant BL80c from the c-class Enclosure To remove the HP ProLiant BL80c server blade from the c Class enclosure, follow these steps:. Identify the proper server blade and back up the data.. Depending on the Onboard Administrator configuration, use one of the following methods to power down the server blade: Use a virtual power button selection through ilo. This method initiates a controlled remote shutdown of applications and the operating system before the server blade enters standby mode. Press and release the Power On/Standby button. This method initiates a controlled shutdown of applications and the operating system before the server blade enters standby mode. Press and hold the Power On/Standby button for more than seconds to force the server blade to shut down. This method forces the server blade to enter standby mode without properly exiting applications and the operating system. It provides an emergency shutdown method in the event of a hung application. Important: When the server blade is in standby mode, auxiliary power is still being provided. To remove all power from the server blade, remove the server blade from the enclosure. After initiating a virtual power down command, be sure that the server blade goes into standby mode by observing that the system power LED is amber.. Remove the server blade, as shown in Figure -9. Figure -9 Removing a ProLiant BL80c from the c Class Enclosure.0 HP ProLiant BL80c Server Blade Overview 89

190 . Place the server blade on a flat, level work surface. Warning! To reduce the risk of personal injury from hot surfaces, allow the drives and the internal system components to cool before touching them. Caution: To prevent damage to electrical components, properly ground the server blade before beginning any installation procedure. Improper grounding can cause electrostatic discharge. To install and power up a server blade, reverse the removal procedure. The Onboard Administrator initiates an automatic power-up sequence when the server blade is installed. If the default setting is changed, use one of the following methods to power up the server blade: Use a virtual power button selection through ilo. Press and release the Power On/Standby button. When the server blade goes from the standby mode to the full power mode, the system power LED changes from amber to green. For more information about the Onboard Administrator, see the HP BladeSystem c7000 Enclosure Setup and Installation Guideon the HP web page: The ilo subsystem is a standard component of selected ProLiant servers that provides server health and remote server manageability. The ilo subsystem includes an intelligent microprocessor, secure memory, and a dedicated network interface. This design makes ilo independent of the host server and its operating system. The ilo subsystem provides remote access to any authorized network client, sends alerts, and provides other server management functions. Using ilo, you can: Remotely power up, power down, or reboot the host server. Send alerts from ilo, regardless of the state of the host server. Access advanced troubleshooting features through the ilo interface. Diagnose ilo using HP SIM through a web browser and SNMP alerting. For more information about ilo, see the ilo documentation on the HP web page: HP ProLiant BL65c Server Blade Overview The HP BladeSystem c Class enclosure supports up to 6 HP ProLiant BL65c server blades. The HP ProLiant BL65c provides AMD Opteron 000 series 6-bit, dual-core processors, and supports AMD virtualization. Memory options include PC-500 registered DIMMs at 667 MHz. The HP ProLiant BL65c also accommodates serial attached SAS or SATA hard drives, support of multifunction NICs and multiple I/O cards. The HP ProLiant BL65c includes high-availability features such as hot-pluggable hard drives, mirrored-memory, online spare memory, memory interleaving, embedded RAID capability, and enhanced remote Lights-Out management. Table -8 lists the features of the HP ProLiant BL65c server. Table -8 HP ProLiant BL65c Server Blade Features Item Processor Description Up to two AMD Opteron 000 series processors Supports up to.8 GHz GHz HyperTransport; MB Level cache memory per core ServerWorks HT-000 and HT-00 chipsets 90 Server Blades

191 Table -8 HP ProLiant BL65c Server Blade Features (continued) Item Memory Description Up to GB of memory, supported by eight slots of PC-500 Registered DIMMs at 667 MHz Supporting memory interleaving (:) Storage Controller Internal Drive Support Network Controller Integrated smart array E00i RAID controller with 6 MB cache (with optional battery-backed write-cache with an upgrade to 8MB cache (BBWC)). Supports RAID 0,. Up to two small form factor (SFF) SAS or SATA hot-pluggable hard disk drives Two embedded NC70i multifunction gigabit network adapters One additional 0/00 NIC dedicated to ilo management Mezzanine Support Two additional I/O expansion slots via mezzanine card. Supports up to two mezzanine cards: Dual-port Fibre Channel mezzanine (-Gb) options for SAN connectivity (choice of Emulex or QLogic). Ethernet NIC mezzanine options for additional network ports HP NC5m PCI Express quad-port gigabit server adapter for c-class BladeSystem HP NC6m PCI Express dual-port Gb server adapter for c-class BladeSystem HP NC7m PCI Express dual-port multifunction gigabit server adapter for c-class BladeSystem X DDR InfiniBand (IB) mezzanine (0 Gb/s) options for low latency server interconnectivity (based on Mellanox technology) 0GbE planned for future support Internal USB Support Form Factor Management Operating Systems Enclosures One internal USB.0 connector for security key devices and USB drive keys HP ProLiant BL65c server blade plugs vertically into the BladeSystem c-class enclosure Integrated Lights-Out (ilo ) standard blade edition (includes virtual KVM and graphical remote console) Supports Windows and Linux HP ProLiant BL65c server blade plugs vertically into the BladeSystem c-class enclosure.. HP ProLiant BL65c Front View Figure -0 shows the front view of a ProLiant BL65c server.. HP ProLiant BL65c Server Blade Overview 9

192 Figure -0 HP ProLiant BL65c Front View The following list describes the callouts in Figure -0:. Hard drive bay. Power On/Stand by button. Local I/O connector. Hard drive bay 5. Serial label pull tab 6. Release button 7. Server blade handle.. HP ProLiant BL65c Front Panel LEDs Figure - shows the front panel LEDs of the ProLiant BL65c. Figure - HP ProLiant BL65c Front Panel LEDs 5 9 Server Blades

193 The following table describes the callouts in Figure -: Item 5 Description UID LED Health LED NIC LED NIC LED System power LED Status Blue = Identified Blue flashing = Active remote management Off = No active remote management Green = Normal Flashing = Booting Amber = Degraded condition Red = Critical condition Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = On Amber = Standby (auxiliary power available) Off = Off Actual NIC numbers depend on several factors, including the operating system installed on the server blade... HP ProLiant BL65c Internal View Figure - shows the internals of the HP ProLiant BL65c. Figure - HP ProLiant BL65c Internal View The following list describes the callouts in Figure -:. HP ProLiant BL65c Server Blade Overview 9

194 . Two hot-pluggable SAS/SATA drive bays. Embedded smart array controller integrated on drive backplane. Two mezzanine slots: one x, one x8. Eight fully buffered DIMM Slots DDR II 667Mhz.. HP ProLiant BL65c System Board Figure - shows the system board components of an HP ProLiant BL65c. Figure - HP ProLiant BL65c System Board Components The following list corresponds to the callouts in Figure -:. Bezel LED connector. Internal USB connector (under hard drive cage). Processor socket. DIMM slots (processor memory banks A and B) 5. Processor socket (populated) 6. Mezzanine connector (Type I or Type II mezzanine) 7. System maintenance switch (SW) 8. Enclosure connector 9. Battery 0. System board thumbscrew. Mezzanine connector (Type I mezzanine only). Embedded NICs (two). DIMM slots (Processor memory banks C and D). HP Smart Array E00i cache module (under hard drive cage) 5. System board thumbscrew 9 Server Blades

195 ..5 Memory Options You can expand server memory by installing PC-500 registered DDR SDRAM DIMMs. The server supports up to GB of memory using eight -GB DIMMs (four DIMMs per processor). Observe the following guidelines when installing additional memory: Install only ECC PC-500 registered DDR SDRAM DIMMs that meet the following specifications: Supply voltage:.8 V Bus width: 7 bits Observe the following special conditions when installing memory with a second processor: Processor can be installed without memory. Any memory installed into banks for processor can be used only if processor is installed. DIMMs must always be installed in pairs. HP recommends installing DIMMs with the greatest capacity in the banks farthest from each populated processor first. DIMMs installed in the same memory bank must have the same part number. DIMMs installed in different banks can be of different sizes. For the latest memory configuration information, see the QuickSpecs on the HP web page: For memory options information, see the HP ProLiant BL65c Server Blade User Guide...6 Mezzanine HCA Card In HP Cluster Platform systems with InfiniBand, HP ProLiant BL65c server blades are preconfigured with an InfiniBand mezzanine HCA for the HP c-class BladeSystem that maps to the HP x DDR InfiniBand Switch Module installed in the rear of the c-class enclosure...7 Supported Storage The HP ProLiant BL65c supports up to two optional Hot Plug Serial Attach SCSI (SAS) drives for a maximum of GB ( x 7GB Serial SCSI) internal storage or up to two optional Hot Plug Serial ATA (SATA) drives for a maximum of 0GB ( x 60 GB Serial ATA) internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that comes with the drive and in the HP ProLiant BL65c Server Blade User Guide. Two optional Fibre Channel HBAs are supported by the HP ProLiant BL65c. Both mezzanine circuit boards connect directly to the server blade system board. These Fibre Channel HBAs are available via option kits and must be ordered separately. For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant c-class server blade products web page: The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem c-class storage web page: HP ProLiant BL65c Server Blade Overview 95

196 ..8 Removing the HP ProLiant BL65c from the c Class Enclosure The procedure to remove an HP ProLiant BL65c server blade from the c-class enclosure is the same as previously described in Section HP ProLiant BL65c G5 Server Blade The HP ProLiant BL65c G5 server blade can be used as a control node, a utility node and a compute node in HP Cluster Platform configurations. For the features and specifications of the HP ProLiant BL65c G5, see the QuickSpecs on the HP website: Figure - shows the front view of a ProLiant BL65c G5 server blade. Figure - HP ProLiant BL65c G5 Front View The following list describes the callouts shown in Figure -:. Serial label pull tab. Local I/O connector. UID LED/button. Health LED 5. NIC LED 6. NIC LED 7. Hard drive activity LED 8. Release button 9. Power On/Standby button and system power LED 0. Server blade handle. SUV connector (The SUV connector and the HP c-class Blade SUV cable are for some server blade configuration and diagnostic procedures.) For an internal view of the HP ProLiant BL65c G5 and additional information, such as the system board layout and how to install mezzanine HCA cards, see the HP ProLiant BL65c Generation 5 Server Maintenance and Service Guide: HP ProLiant BL685c Server Blade Overview The HP BladeSystem c Class enclosure supports up to eight full-height HP ProLiant BL685c server blades. The HP ProLiant BL685c supports up to four AMD Opteron 8000 Series processors, up to 6 GB of memory supporting 6 DDR-667 memory DIMMS, and serial attached SAS or SATA hard drives. The BL685c includes high-availability features such as hot-pluggable hard drives, and remote management. Table -9 lists the features of the HP ProLiant BL685c server blade. 96 Server Blades

197 Table -9 HP Proliant BL685c Server Blade Features Item Processor Memory Storage Controller Description Up to four AMD Opteron 8000 Series processors Up to 6 GB of memory. Supporting 6 DDR-667 memory DIMMS Embedded Smart Array E00i controller integrated on system board Standard RAID 0/ controller with optional BBWC Internal Drive Support Network Controller Supports up to two two small form factor (SFF) SAS or SATA hot-pluggable hard drives Four integrated NICs consisting of: Embedded NC6i dual-port gigabit server adapter Two embedded NC7i multifunction gigabit server adapters Plus one additional 0/00 NIC dedicated to ilo management Mezzanine Support Three additional I/O expansion slots via mezzanine card. Supports up to three mezzanine cards: Dual-port Fibre Channel mezzanine (-Gb) options for SAN connectivity (choice of Emulex or QLogic). Ethernet NIC mezzanine options for additional network ports HP NC5m PCI Express quad-port Gb server adapter for c-class BladeSystem HP NC6m PCI Express dual-port Gb Server adapter for c-class BladeSystem HP NC7m PCI Express dual-port multifunction gigabit server adapter for c-class BladeSystem X DDR InfiniBand (IB) mezzanine (0 Gb/s) options for low latency server interconnectivity (based on Mellanox technology) 0GbE planned for future support Internal USB Support Management One internal USB.0 connector for security key devices and USB drive keys Integrated Lights-Out (ilo ) Standard Blade Edition.. HP ProLiant BL685c Front View Figure -5 shows the front view of a ProLiant BL685c server. Figure -5 HP ProLiant BL685c Front View The following list describes the callouts in Figure -5:. HP ProLiant BL685c Server Blade Overview 97

198 . Hard drive bay. Server blade handle. Server blade handle release button. Serial label pull tab 5. Hard drive bay 6. Local I/O cable connector (the local I/O cable connector is used with the local I/O cable to perform some server blade configuration and diagnostic procedures) 7. Power On/Standby button.. HP ProLiant BL685c Front Panel LEDs Figure -6 shows the front panel LEDs of the HP ProLiant BL685c. Figure -6 HP ProLiant BL685c Front Panel LEDs The following table describes the callouts in Figure -6: Item 5 Description System power LED NIC LED NIC LED NIC LED NIC LED Status Green = On Amber = Standby (auxiliary power available) Off = Off Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity Green = Network linked Green flashing = Network activity Off = No link or activity 98 Server Blades

199 Item 6 7 Description Health LED UID LED Status Green = Normal Flashing = Booting Amber = Degraded condition Red = Critical condition Blue = Identified Blue flashing = Active remote management Off = No active remote management Actual NIC numbers depend on several factors, including the operating system installed on the server blade... HP ProLiant BL685c Internal View Figure -7 shows the internals of the HP ProLiant BL685c. Figure -7 HP ProLiant BL685c Internal View The following list describes the callouts in Figure -7:. Two SAS/SATA drive bays. Embedded smart array controller integrated on drive backplane. Up to 6 DIMM slots available. Three mezzanine slots (all x8).. HP ProLiant BL685c System Board Figure -8 shows the system board components.. HP ProLiant BL685c Server Blade Overview 99

200 Figure -8 HP ProLiant BL685c System Board Components The following list describes the callouts in Figure -8:. Bezel LED connector. Processor socket. DIMM slots (Processor memory banks G and H). Processor socket (populated) 5. DIMM slots (Processor memory banks C and D) 6. Internal USB connector 7. Embedded dual-port NIC 8. Mezzanine connector (Type I or Type II mezzanine) 9. Mezzanine connector (Type I mezzanine only) 0. Enclosure connector. System board thumbscrew. Mezzanine connector (Type I or Type II mezzanine). Enclosure connector. System board thumbscrew 5. Embedded NIC 6. Embedded NIC 7. Smart Array E00i cache module (under mezzanine card ) 8. SAS cable 9. Processor socket (populated) 0. DIMM slots (Processor memory banks A and B). System battery. DIMM slots (Processor memory banks E and F). Processor socket 00 Server Blades

201 . System board thumbscrew 5. System maintenance switch (SW) 6. Hard drive backplane connector..5 Memory Options The HP ProLiant BL685c server blade contains 6 memory expansion slots. Observe the following guidelines when installing additional memory: Install only ECC PC-500 registered DDR SDRAM DIMMs that meet the following specifications: Supply voltage:.8 V Bus width: 7 bits Install DIMMs in pairs (banks) beginning with banks farthest from each populated processor. Install DIMMs with the greatest capacity in the banks farthest from the processor. Install identical DIMMs with the same part number in a bank. DIMMs must be installed for processor. DIMMs installed in different banks can be of different sizes. For best performance, populate one bank of memory for each installed processor before populating more than one bank for a specific processor. DIMMs installed in banks for processor and can be used only if processor and are installed. Processors and can be installed without memory. For the latest memory configuration information and Advanced Memory Protection (AMP) options, see the HP ProLiant BL685c Server Blade User Guide...6 Mezzanine HCA Card In HP Cluster Platform, the HP ProLiant BL685c server blades are preconfigured with an HP x DDR InfiniBand Mezzanine HCA for HP c-class BladeSystems which works with the HP x DDR InfiniBand Switch Module installed in the rear of the c Class enclosure. For more information on the mezzanine HCA card, see the HP ProLiant BL685c Server Blade User Guide. For more information on the HP x DDR InfiniBand Switch Module, see the HP Cluster Platform InfiniBand Interconnect Installation and User's Guide...7 Supported Storage The HP ProLiant BL685c supports up to two optional Hot Plug Serial Attach SCSI (SAS) drives for a maximum of GB ( x 7 GB Serial SCSI) internal storage or up to two optional hot-pluggable serial ATA (SATA) drives for a maximum of 0 GB ( x 60 GB serial ATA) internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that ships with the drive and in the HP ProLiant BL685c Server Blade User Guide. Two optional Fibre Channel HBAs are supported by the HP ProLiant BL685c. Both mezzanine circuit boards connect directly to the server blade system board. These Fibre Channel HBAs are available via option kits and must be ordered separately. For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP ProLiant c-class server blade products web page: The HP StorageWorks SAN documentation: HP ProLiant BL685c Server Blade Overview 0

202 Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem c-class storage web page: Removing the HP ProLiant BL685c from the c-class Enclosure The procedure to remove the HP ProLiant BL685c server blade from the c Class enclosure is the same as described previously in Section HP ProLiant BL685c G5 Server Blade Overview The HP BladeSystem c Class enclosure supports up to eight full-height HP ProLiant BL685c G5 server blades. For the features and specifications of the HP ProLiant BL685c G5, see the QuickSpecs on the HP website: Figure -9 shows the front view of a ProLiant BL685c G5 server blade. Figure -9 HP ProLiant BL685c G5 Front View The following list describes the callouts shown in Figure -9:. UID LED Serial label pull tab. Health LED. NIC LED. NIC LED 5. NIC LED 6. NIC LED 7. Power On/Standby button and system power LED 8. Local I/O connector 9. Hard drive bay 0. Hard drive bay. Release button. Server blade handle For an internal view of the HP ProLiant BL685c G5 and additional information, such as the system board layout and how to install mezzanine HCA cards, see the HP ProLiant BL685c Generation 5 Server Maintenance and Service Guide: HP Integrity BL860c Server Blade Overview 0 Server Blades The HP Integrity BL860c server blade is a two-socket full-height server blade featuring three models of the latest Intel Itanium dual-core processors supported by up to 8 GB memory (

203 DIMM slots). The BL860c features four Gigabit Ethernet ports standard, support for three standard c-class I/O mezzanine cards and up to two internal SFF SAS hot-pluggable disk drives.table -0 lists the features of the HP ProLiant BL860c server. Table -0 HP Proliant BL860c Server Blade Features Item Processor Memory Storage Controller Description Up to two Intel Itanium 9000 Series processors: Intel Itanium Processor (900).6GHz/8MB L cache dual-core Intel Itanium Processor (905).GHz/MB L cache dual-core Intel Itanium Processor (900).6GHz/6MB L cache single-core Up to 8 GB of memory. Supporting twelve DDR-5 ECC memory DIMMS Embedded smart array E00i controller integrated on system board Standard RAID controller Internal Drive Support Network Controller Supports up to two small form factor (SFF) SAS hot-pluggable hard drives Four integrated NICs consisting of: Four embedded standard Gigabit NICs Plus one additional 0/00 NIC dedicated to Integrity ilo Management Mezzanine Support Three additional I/O expansion slots via mezzanine card. Supports up to three mezzanine cards: Dual-port Fibre Channel mezzanine (-Gb) options for SAN connectivity (QLogic). X DDR InfiniBand (IB) mezzanine (0 Gb/s) options for low latency server interconnectivity Internal USB Support Management No internal USB port on the BL860c Integrity Integrated Lights Out (ilo ) management processor.5. HP Integrity BL860c Front View HP Integrity Integrated Light Out (ilo ) with Advanced Pack (shipped standard) Ignite-UX for HP-UX HP System Insight Manager HP System Management Homepage Figure -0 shows the front view of a ProLiant BL860c server blade..5 HP Integrity BL860c Server Blade Overview 0

204 Figure -0 HP ProLiant BL860c Front View 5 The following list describes the callouts in Figure -0:. Hard drive bays. Status indicator. Power button. Server blade handle 5. Local I/O cable connector (the local I/O cable connector is used with the local I/O cable to perform some server blade configuration and diagnostic procedures).5. HP Integrity BL860c LEDs Figure - shows the HP Integrity BL860c LEDs. 0 Server Blades

205 Figure - HP Integrity BL860c LEDs The following list describes the callouts in Figure -:. Unit identification (UID) LED. System health LED. Internal health LED. NIC LED 5. NIC LED 6. NIC LED 7. NIC LED.5. HP Integrity BL860c Internal View Figure - shows the internals of the HP Integrity BL860c..5 HP Integrity BL860c Server Blade Overview 05

206 Figure - HP Integrity BL860c Internal View The following list describes the callouts in Figure -:. SAS backplane. Memory DIMMs. Mezzanine card. Mezzanine card 5. Mezzanine card 6. Processors 7. System board 8. Trusted platform module 9. Front panel 0. SAS disk drives.5. Configuring or Replacing Memory When installing additional memory in the HP Integrity BL860c server blade, observe the following guidelines:. All DIMMs must be PC-00 DIMMs (DDR 5 MHz).. Both DIMM slots in a memory bank must be populated.. Banks must be populated in sequential numeric order, starting with bank 0.. Both DIMMs in a memory bank must be identical. Install identical DIMMs in pairs, starting with DIMM socket A, bank Server Blades

207 5. Double Chip Spare requires that DIMMs are loaded in like quads. 6. DIMMs must be installed in decreasing capacity with the largest DIMMs installed in the smallest numbered DIMM slot. For the latest memory configuration information or for replacing memory information, see the HP Integrity BL860c Server Blade QuickSpecs at: Mezzanine HCA Card In HP Cluster Platform, the HP Integrity BL860c server blades are pre-configured with the appropriate mezzanine card for the configuration type selected. For more information on the mezzanine HCA card, see the HP Integrity BL860c Server Blade QuickSpecs at: Supported Storage The HP Integrity BL860c supports up to two optional hot-pluggable serial attach SCSI (SAS) drives for a maximum of 9 GB ( x 6 GB serial SCSI) internal storage. The physical aspect of inserting and removing a disk drive is discussed in the document that comes with the drive. For more detailed SAN configuration information for the server blade, see the following documents: The model-specific QuickSpecs document located on the HP c-class server blade products web page: c-class-bladeservers.html The HP StorageWorks SAN documentation: Search for the SAN product required, and navigate to technical documentation. The HP BladeSystem c-class storage web page: Removing the HP Integrity BL860c from the c-class Enclosure The procedure to remove the HP Integrity BL860c server blade from the c Class enclosure is the same as described previously in Section HP Integrity BL860c Server Blade Overview 07

208 5 Workstations Some HP Cluster Platform solutions support HP workstations. This chapter presents an overview of the following HP workstations: HP xw800 Workstation (see Section 5.) HP xw800 Workstation (see Section 5.) HP xw900 Workstation (see Section 5.) HP xw900 Workstation (see Section 5.) 5. HP xw800 Workstation Overview The HP xw800 is an Intel-based dual processing workstation with Hyper-Threading technology. It is equipped with the Intel E755 high-end performance chipset for Intel Xeon processors. Hyperthreading technology, developed by Intel, enables a single processor to execute multiple threads of instructions simultaneously. Hyperthreading technology enables the processor to use its execution resources more efficiently, delivering performance increases and improving user productivity. Table 5- describes the standard features of the HP xw800 Workstation. Table 5- HP Workstation xw800 features Feature Processor Front side bus Chipset Memory Expansion bays Drive controllers Removable media Expansion slots Graphics High Performance Tuning Framework I/O ports and connectors Communications Specification One or two Intel Xeon processor(s) at.8,.,., and.6 GHz with MB L cache with Hyper-Threading 800 MHz Intel E755 Up to 6 GB of registered ECC DDR-00 SDRAM (8 DIMMs in pairs, dual channel architecture) Three external 5.5-inch bays (one used for optional floppy), five internal.5-inch bays Integrated dual-channel SATA/50 controller with RAID (0 or ) capability, integrated dual-channel Ultra0 SCSI controller with RAID (0 or ) capability, optional channel SATA controller with RAID (0 or ) capability, optional single channel Ultra0 SCSI controller with RAID (0,, 0, 5) capability 8X CD-ROM, 8X CD-RW, 6X DVD-ROM, 8X CD-RW/DVD combo, 8X DVD+RW Seven slots: one PCI Express (x6) graphics slot, one PCI Express PCI Express (x6) graphics NVIDIA NVS 80 PCI/ PCI-E NVIDIA Quadro FX 50, ATI FireGL V00 NVIDIA Quadro FX 00 ATI FireGL V500 NVIDIA Quadro FX 00 HP Performance Tuning Framework guides system setup, allowing a custom configuration that best matches the workstation to user requirements. This custom feature ensures availability of the graphics drivers and removes some memory restraints. For specific application support and download instructions, go to the following web site: Front: headphone, microphone, and two USB.0, IEEE 9 Rear: 6 USB, one standard serial port, one parallel port, PS/ keyboard and mouse, one RJ-5, one audio in, one audio out, one mic in, IEEE 9 Integrated Intel Pro MT 0/00/000 LAN, optional Intel Pro MT PCI NIC, optional Intel Pro XT PCI-X NIC, optional Broadcom Gigabit PC NIC 08 Workstations

209 Table 5- HP Workstation xw800 features (continued) Feature Power supply Input devices Specification 600 W USB or PS/ keyboard; choice of -button scroll mouse (optical or mechanical); -button mouse (optical or mechanical) Figure 5- displays the front panel of the HP xw800 Workstation, and Figure 5- displays its rear panel. Figure 5- HP xw800 Workstation Front Panel The following table describes the callouts shown in Figure 5-: Item Description Optical drive Optical drive activity lights 5.5-inch drive bays Optical drive eject button Power on light Power button Hard drive activity light USB ports (two) Headphone connector Microphone connector IEEE-9 connector 5. HP xw800 Workstation Overview 09

210 Figure 5- HP xw800 Workstation Rear Panel The following table describes the callouts shown in Figure 5-: Item Description Power cord connector Keyboard connector Serial connector (teal) USB ports (six) IEEE 9 connector Microphone connector (pink) Audio line out connector (lime) Universal chassis clamp openings Access panel key Padlock loop Cable lock slot Mouse connector (green) Parallel connector (burgundy) RJ-5 network connector Audio line-in connector (light blue) Graphics adapter (blue) 5.. PCI Slot Assignments The HP xw800 workstation has seven PCI expansion slots. Table 5- summarizes the slot assignments, the appropriate PCI cards, and the maximum slot power. 0 Workstations

211 Table 5- HP xw800 Workstation PCI Slots Slot Assignment Maximum Slot Power Comment PCI 0W PCI Express X6 50W Graphics adapter PCI 5W PCI Express X 5W PCI Express interconnect 5 PCI-X 5W PCI interconnect 6 PCI-X 00 5W 7 PCI-X 00 5W External Gigabit Ethernet 5.. Replacing or Installing a PCI Card Use the following procedures to install and replace PCI cards. Replacing a PCI Card To replace a PCI or PCI Express card from an HP xw800 workstation, follow these steps:. Disconnect the power cord from the AC outlet and then from the workstation.. Disconnect all peripheral device cables from the workstation.. Remove the access panel by pulling up on the handle and lifting it off the chassis.. Lay the workstation on its side with the system board facing up. 5. Remove the PCI retainer, as shown in Figure 5-. Figure 5- PCI Retainer HPTC-0 6. Remove the PCI card support, if necessary. 7. Lift the PCI levers by first pressing down, then out. If you are removing a PCI Express card, remove the power supply cable, if required, and move the hockey stick lever to release the card. Figure 5- shows the procedure for a PCI card, and Figure 5-5 shows the procedure for a PCI Express card. 5. HP xw800 Workstation Overview

212 Figure 5- PCI Levers HPTC-0 Figure 5-5 PCI Express Levers HPTC Lift the PCI card out of the chassis and store it in an antistatic bag. Installing a New PCI Card To install a new PCI or PCI Express card from an HP xw800 workstation, follow these steps:. Disconnect the power cord from the AC outlet, then from the workstation.. Disconnect all peripheral device cables from the workstation.. Remove the access panel as follows: a. If necessary, unlock the access panel. b. Pull up on the handle and lift off the cover.. Lay the workstation on its side with the system board facing up. 5. Remove the PCI retainer, as shown in Figure Lift the PCI levers by first pressing down on them and then out, as shown by callout in Figure 5-6. Workstations

213 Figure 5-6 Installing a PCI Card in the HP xw800 Workstation 7. Remove the PCI slot cover, as shown by callout in Figure Lower the PCI or PCI Express card into the chassis. Verify that the keyed components of the card align with the socket, as shown by callout in Figure Close the PCI levers. If the PCI levers do not close, be sure all cards are properly seated and then try again, as shown by callout in Figure If you are installing a PCI Express card, see Figure 5-7. Figure 5-7 Installing a PCI Express Card in the HP xw800 Workstation 5 Plug in the power supply cable, if required. 5.. Removing a Workstation from the Rack To access internal components in the HP xw800 workstation, you must first shut down power to the server and remove it from the rack. All of the workstations in the cluster are secured to the rack on a sliding rail. To remove the HP xw800 workstation from the rack, follow these steps:. Power down the workstation.. Disconnect all remaining cables on the workstation rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports. 5. HP xw800 Workstation Overview

214 . Remove the two screws on each mounting flange.. Slide the server out of the rack until the rail locks engage. 5. Press and hold the rail locks, extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. 5. HP xw800 Workstation Overview The HP xw800 is an Intel-based dual processing, dual-core, high-end graphics workstation. It is equipped with the high-end performance Intel 5000X 6 GB chipset for Intel Xeon processors. HP Performance Tuning Framework (PTF) comes pre-installed to guide workstation setup and custom configuration to help increase performance of selected applications and overall productivity. Table 5- describes the standard features of the HP xw800 workstation. Table 5- HP Workstation xw800 Features Feature Processor Specification One or two Dual-Core Intel Xeon Processor 5000 Sequence.00 GHz/ 667 MHz FSB,.0 GHz/066 MHz FSB,.7 GHz/066 MHz FSB with EM6T ( MB L cache per processor core) One or two Dual-Core Intel Xeon Processor 500 Sequence.60 GHz/066 MHz FSB,.86 GHz/066 MHz FSB,.00 GHz/ MHz FSB, with EM6T ( MB shared L cache per processor). GHz/ MHz FSB,.66 GHz/ MHz FSB,.00 GHz/ MHz FSB Chipset Memory Intel 5000X Up to 8 GB of ECC registered channel DDR 667 MHz fully buffered DIMMS via GB DIMMs in 8 DIMMs slots Up to 6 GB of memory via GB DIMMs; Up to GB of memory via GB DIMMs The HP xw800 is enabled to achieve the maximum memory supported by the chipset of 6 GB Drive bays Three external 5.5-inch bays Five internal.5-inch bays Drive controllers Integrated six-channel SATA Gb/s controller with RAID levels 0,, 0, 5 capability Integrated four-channel SAS controller with RAID 0, capability Hard drives Up to five SATA drives,.5 TB max.; 80 GB (700 RPM) SATA Gb/s, or 60, 50, 500 GB (700 RPM) SATA Gb/s NCQ, or 80, 60 GB (0K RPM) SATA.5 Gb/s NCQ Up to five serial attached SCSI (SAS) drives, 70 GB max.; 6 GB (0K RPM) or 7, 6 GB (5K RPM) NOTE: Populating all five drives with SAS will require an additional (optional) SAS controller Optical drives Expansion slots Graphics 8x CD-ROM, 6X DVD-ROM, 8X CD-RW/DVD combo, 6X DVD+/-RW DL with LightScribe Direct Disc Labeling (Microsoft Windows XP Professional only, requires LightScribe media for labeling) Seven slots: one PCIe x6 graphics slot, one PCIe x6 mechanically (x electrically), one PCIe x8 mechanically (x electrically), three PCI-X slots (one MHz, two 00 MHz slots) and one legacy PCI slot Professional D: NVIDIA Quadro NVS 85 (8 MB, dual display) Workstations

215 Table 5- HP Workstation xw800 Features (continued) Feature Specification Entry D: NVIDIA Quadro FX 560 (8 MB), ATI FireGL V00 (8 MB) Midrange D: NVIDIA Quadro FX 500 (56 MB), ATI FireGL V700 (56 MB) High-end D: NVIDIA Quadro FX 500 (56 MB), NVIDIA Quadro FX 500 (5 MB) with opt. Quadro G-Sync card Audio Network Ports Integrated High Definition audio with Jack Retasking technology, optional Sound Blaster X-Fi XtremeMusic (PCI) Integrated Broadcom 575 Netxtreme Gigabit PCIe LAN on Motherboard, opt. Broadcom 575 Gigabit PCIe NIC Front: USB.0, one audio line out, one microphone line in, IEEE 9 Rear: five USB.0, one standard serial port, one parallel port, PS/ keyboard and mouse, one RJ-5, audio line in, audio line out, one IEEE 9 Internal: one USB.0 Input devices Power USB or PS/ keyboard; choice of -button scroll mouse (USB optical or PS/ mechanical); -button mouse (USB optical); USB SpaceMouse; USB SpaceBall, USB SpacePilot 800 W Figure 5-8 displays the front panel of the HP xw800 Workstation, and Figure 5-9 displays its rear panel. The xw800 front and rear panels are similar to the xw800. Enhancements for the HP xw800 Workstation include a Built-In Self Test LED and an optional MiniSAS port connector on the rear panel. Figure 5-8 HP xw800 Workstation Front Panel HP xw800 Workstation Overview 5

216 The following table describes the callouts shown in Figure 5-8: Item Description Optical drive Optical drive activity lights 5.5-inch drive bays Optical drive eject button Power on light Power button Hard drive activity light USB ports (two) Headphone connector Microphone connector IEEE-9 connector Figure 5-9 HP xw800 Workstation Rear Panel The following table describes the callouts shown in Figure 5-9: Item 5 Description Power cord connector Keyboard connector Serial connector (teal) USB ports (six) IEEE 9 connector 6 Workstations

217 Item Description Microphone connector (pink) Audio line out connector (lime) Universal chassis clamp openings Access panel key Padlock loop Cable lock slot Mouse connector (green) Parallel connector (burgundy) RJ-5 network connector Audio line-in connector (light blue) Graphics adapter (blue) MiniSAS port connector (optional) not shown, but item is in lower right corner Built In Self Test (BIST) LED not shown, but item is in upper left corner 5.. PCI Slot Assignments The HP xw800 Workstation has seven PCI expansion slots. Figure 5-0 shows the xw800 slots and Table 5- summarizes the slot assignments, the appropriate PCI cards, and the maximum slot power. Figure 5-0 xw800 PCI Slots Table 5- HP xw800 Workstation PCI Slots Slot Assignment Maximum Slot Power Comment PCI ( bit, MHz) 0W G-Sync PCI Express x6 50W PCI Express graphics adapter PCI Express x8 mechanical (x electrical) 5W N/A 5. HP xw800 Workstation Overview 7

218 Table 5- HP xw800 Workstation PCI Slots (continued) Slot Assignment Maximum Slot Power Comment PCI Express x6 mechanical (x electrical) 5W SI gigabit Ethernet or InfiniBand 5 PCI-X 5W SI Myrinet or Quadrics 6 PCI-X 00 5W Available 7 PCI-X 00 5W NIC 5.. xw800 PCI Slot Rules The slot rules for the xw800 are shown in Table 5-5. Table 5-5 xw800 PCI Slot Rules Slot Number Slot Type - CPU, -slot GPU - CPU, -slot GPU - CPU, Two -slot GPU - CPU, Two -slot GPU PCI G-Sync G-Sync G-Sync G-Sync PCI Express x6 Graphics Graphics Graphics -slot Graphics PCI Express x8 (x) available NA SI-E NA PCI Express x6 (x) SI-E SI-E Graphics -slot Graphics 5 PCI-X SI-X SI-X SI-X NA 6 PCI-X 00 available available available SI-X 7 PCI-X 00 NIC NIC NIC NIC NA = not available, slot is blocked by GPU IB or GigE PCI-E adapters Myrinet or Quadrics PCI-X adapters ISS card installed by Integration Center Note: The -slot GPU is an NVIDIA FX500 or FX NVIDIA Quadro FX 500 Graphics Card The NVIDIA Quadro FX 500 graphics card includes the following features: G70GL graphics processor 5 MB GDDR graphics memory Dual dual-link DVI-I SLI capable New dual slot thermal solution High Precision Dynamic Range Technology (HPDR) Full 8-bit Precision Graphics Pipeline, -bit sub-pixel precision Rotated Grid FSAA Infinite length vertex programs and dynamic flow control Fully Programmable Video GPU Figure 5- shows an NVIDIA Quadro FX 500 graphics card. 8 Workstations

219 Figure 5- NVIDIA Quadro FX 500 Graphics Card 5.. NVIDIA Quadro G-Sync Option Card The NVIDIA Quadro G-Sync Option Card enables the synchronization of multiple displays/sources to drive HP workstation based solutions such as: Cluster visualization Power walls Caves/Immersive environments On-Air Broadcast Graphics and Post Production Station The NVIDIA Quadro G-Sync option card is supported as an option to the NVIDIA Quadro FX 500. Features include: Enables full Genlock/Framelock functionality through GUI or API ATX form factor x PCI-E interface for stability only can be plugged into any PCI-E or PCI slot Draws power from FX 500 board Ribbon cable = 6 inches in length Windows and Linux drivers One G-Sync card can support FX 500 cards in the HP xw900 Figure 5- shows an NVIDIA Quadro G-Sync card. 5. HP xw800 Workstation Overview 9

220 Figure 5- NVIDIA Quadro G-Sync Card 5..5 NVIDIA Quadro FX 5500 Graphics Card The NVIDIA Quadro FX 5500 graphics card includes the following features: Quadro FX 5500 graphics processor GB GDDR SDRAM Dual dual-link DVI-I SLI capable New dual slot thermal solution High Precision Dynamic Range (HPDR) technology Full 8-bit Precision Graphics Pipeline, -bit sub-pixel Precision Rotated Grid FSAA Infinite length vertex programs and dynamic flow control Fully Programmable Video GPU Figure 5- shows an NVIDIA Quadro FX 5500 graphics card. Figure 5- NVIDIA Quadro FX 5500 Graphics Card 0 Workstations

221 5..6 Replacing or Installing a PCI Card Use the following procedures to install and replace PCI cards. Replacing a PCI Card To replace a PCI or PCI Express card from an HP xw800 workstation, follow these steps:. Disconnect the power cord from the AC outlet and then from the workstation.. Disconnect all peripheral device cables from the workstation.. Remove the access panel by pulling up on the handle and lifting it off the chassis.. Lay the workstation on its side with the system board facing up. 5. Remove the PCI retainer, if necessary. Note: For added protection, some cards have PCI retainers installed to prevent movement during shipping. For short or tall cards, lift the PCI retainer arm (callout ) with one hand, press in on the sides (callout ) of the retainer, and rotate it (callout ) out of the chassis as shown in Figure 5-. Figure 5- PCI Retainer 6. Open the PCI retention clamp by pressing down on the two green clips (callout in Figure 5-5) at the ends of the clamp and rotating the clamp toward the back of the system. 5. HP xw800 Workstation Overview

222 Figure 5-5 PCI Retention Clamp 7. Lift the PCI card out of the chassis (callout in Figure 5-5). If you are removing a PCI Express high-end graphics card, remove the auxiliary power supply cable (not illustrated) if required, and move the lever to release the card and lift it out of the chassis (callout in Figure 5-5). Store the card in an anti-static bag. Installing a New PCI Card To install a new PCI or PCI Express card in an HP xw800 workstation, follow these steps:. Disconnect the power cord from the AC outlet, then from the workstation.. Disconnect all peripheral device cables from the workstation.. Remove the access panel as follows: a. If necessary, unlock the access panel. b. Pull up on the handle and lift off the cover.. Lay the workstation on its side with the system board facing up. 5. If necessary, remove the PCI retainer, as shown in Figure Lift the PCI retention clamp by first pressing down on them and then out, as shown by callout in Figure 5-6. Figure 5-6 Installing a PCI or PCI Express Card in the HP xw800 Workstation Workstations

223 7. Remove the PCI slot cover (callout in Figure 5-6). 8. Lower the PCI or PCI Express card into the chassis (callout in Figure 5-6). Verify that the keyed components of the card align with the socket. 9. If installing a card with an auxiliary power connector, plug in the power supply cable or adapter cable supplied with the card (callout in Figure 5-6). This type of card includes, but is not limited to, a PCI Express graphics card greater than 75 W, and a 9a I/O card. 0. Close the PCI retention clamps. If the PCI retention clamps do not close, be sure all cards are properly seated and then try again Removing a Workstation from the Rack To access internal components in the HP xw800 workstation, you must first shut down power to the server and remove it from the rack. All of the workstations in the cluster are secured to the rack on a sliding rail. To remove the HP xw800 workstation from the rack, follow these steps:. Power down the workstation.. Disconnect all remaining cables on the workstation rear panel, including cables extending from external connectors on expansion boards. Make note of which Ethernet and interconnect cables are connected to which ports.. Remove the two screws on each mounting flange.. Slide the server out of the rack until the rail locks engage. 5. Press and hold the rail locks, extend the server until it clears the rack. 6. Remove the server from the rack and position it securely on a workbench or other solid surface for stability and safety. 5. HP xw900 Workstation Overview The HP xw900 Workstation is a 6-bit personal workstation designed for visualization and compute intensive environments. It supports dual PCI Express x6 graphics and dual singleand dual-core AMD Opteron processors. The AMD Direct Connect Architecture connects the HP xw900's memory and I/O directly to the CPU, optimizing performance. This helps balance throughput and enable expandable I/O. The CPUs are interconnected allowing more Linear Symmetrical Multiprocessing capability. The HP xw900 has two x6 PCI Express ports supporting dual, high-end graphics and SLI-enablement. Enabling up to four, full-performance, D displays, the HP xw900 provides cost-effective, scalable visualization capability for demanding high-performance graphics solutions such as parallel rendering or compositing. In addition, the HP xw900 with PCI Express will accommodate future upgrades to the latest graphics and I/O components. Table 5-6 describes the standard features of the HP xw900 workstation. Table 5-6 HP Workstation xw900 Specifications Feature Processor System bus Chipset Memory Expansion bays Drive controllers Specification Single or dual AMD Opteron 00 series processors 6 (.0 GHz), 8 (. GHz), 50 (. GHz), 5 (.6 GHz), 5 (.8 GHz); dual-core processors 70 (.0 GHz), 75 (. GHz), 80 (. GHz) with AMD6 Technology and AMD HyperTransport GHz AMD HyperTransport NVIDIA nforce Professional with AMD-8 HyperTransport PCI-X tunnel 6 GB maximum; 8 registered DIMMs; DDR-00 ECC (5 MB, GB, GB); up to.8 GB/sec throughput Three external 5.5 inch bays, 5 internal.5 inch bays Integrated SATA Gb/s controller ( channels) with RAID 0,, 0+ capability; Integrated dual channel Ultra0 SCSI controller with opt. external connector; 5. HP xw900 Workstation Overview

224 Table 5-6 HP Workstation xw900 Specifications (continued) Feature Specification Opt. Ultra 0 SCSI controller basic; Opt. Ultra 0 SCSI controller advanced with RAID 0,, 0, 5, 50, JBOD capability, opt. channel Gb/s SATA RAID controller Removable media Expansion slots Graphics High Performance Tuning Framework I/O ports and connectors Communications Power supply Input devices 8x CD-ROM, 8X CD-RW, 6X DVD-ROM, 8X CD-RW/DVD combo, 6X DVD+/- RW DL LightScribe Disc Labeling (Windows K & XP only, requires LightScribe media for labeling) Six slots: PCI Express (PCIe) x6 graphics and I/O; full-height PCI-X slots (one MHz, two 00 MHz slots); fulllength PCI slot Professional D: NVIDIA Quadro NVS 80 (PCIe) or Quadro NVS 85 with NVIDIA TurboCache Technology (PCIe) Entry D: NVIDIA Quadro FX 50 Mid-range D: NVIDIA Quadro FX 00; NVIDIA SLI Technology capable High-end D: NVIDIA Quadro FX 50, Quadro FX 500 with opt. Quadro G-Sync card; NVIDIA SLI Technology capable HP Performance Tuning Framework guides system setup, allowing a custom configuration that best matches the workstation to user requirements. This customization ensures availability of the graphics drivers and removes some memory restraints. For specific application support and download instructions, go to the following Web site: Front: USB.0, Headphone, Microphone, IEEE 9 Back: USB.0, standard serial port, IEEE 9, PS/ keyboard and mouse, RJ-5 to integrated Gigabit LAN, Audio In, Audio Out, Mic In Integrated NVIDIA Gigabit LAN-on-motherboard; optional Broadcom 575 Gigabit (PCIe) 700 W USB or PS/ keyboard; choice of two-button scroll mouse (optical or mechanical); three-button mouse (optical or mechanical); USB SpaceBall 5000, USB SpacePilot The front panel of the xw900 is identical to the front panel of the xw800, as shown in Figure 5-. Figure 5-7 shows the rear panel of the xw900. Workstations

225 Figure 5-7 HP xw900 Workstation Rear Panel The following tables describes the callouts in Figure 5-7: Item Description Power cord connector Power supply built-in self test (BIST) LED Serial connector (teal) PS/ keyboard connector (purple) USB (x) IEEE 9 connector Microphone connector (pink) Universal chassis clamp opening Access panel keys Padlock loop Cable lock slot PS/ mouse connector (green) RJ-5 network connector Audio line-in connector (light blue) Audio line-out connector (lime) Graphics adapter 5.. PCI Slot Indentification The HP xw900 workstation has six PCI expansion slots. Figure 5-8 shows a rear view of the xw900 workstation, and Table 5-7 identifies the slots. 5. HP xw900 Workstation Overview 5

226 Note: Although the xw900 has six PCI slots on the mother board, there are seven apertures in the chassis. Ensure that you remove the correct blank when installing a card. See Figure 5-8. Figure 5-8 HP xw900 Slot Numbering Table 5-7 HP xw900 Workstation PCI Slots Slot Assignment Blank PCI Express x 6 graphics PCI PCI Express x 6 graphics PCI-X 00 PCI-X 00 PCI-X 5.. Slot Assignment Rules The slot assignment rules for the xw900 are complicated by the availability of dual-slot graphics cards, and by the optional G-sync card used in some configurations. The rules are as follows: Slot : This slot always contains a PCI Express 6X graphics card (either a single-width or dual-width card). Slot : If used in the configuration, a PCI Express interconnect card (HCA or HBA) is always installed in slot, a PCI-E 6X slot. Otherwise, if there is a second graphics card, it must be installed in slot (a PCI Express 6X slot) and you cannot use a PCI-E interconnect in this slot Slot : The G-sync card is installed in slot as a first choice, slot 6 is the second choice. Slot 5: The network interface (NIC) card is installed in slot 5. If two graphics cards are installed and an interconnect card is in slot 6, then the G-sync card must be installed in slot 5 (the only open slot) and there is no slot available for a NIC. Slot 6: If used in the configuration, a PCI-X interconnect card (HCA or HBA) is always installed in slot 6, the PCI-X slot. If unused by an HCA or HBA, the G-sync card is installed in slot 6 as the second choice. 6 Workstations

227 Table 5-8 and Table 5-9 list the slot assignments for narrow ( slot), or wide ( slot) graphics cards. Table 5-8 Narrow (-Slot) Graphics Cards Slot Single CPU CPU, GFX CPU, GFX GFX GFX GFX GFX G-sync G-sync G-sync 5 NIC NIC NIC 6 Interconnect Interconnect Interconnect Table 5-9 Wide (-Slot) Graphics Cards Slot Single CPU CPU, GFX CPU, GFX GFX GFX GFX GFX GFX GFX GFX G-sync G-sync GFX 5 NIC NIC NIC, or G-sync 6 Interconnect Interconnect Interconnect 5.. Typical PCI Slot Configuration Figure 5-9 shows a typical PCI slot configuration for the xw HP xw900 Workstation Overview 7

228 Figure 5-9 Typical xw900 Slot Configuration Figure 5-9 shows the slot usages for a typical xw900 configuration: Slot 0 is a blank chassis aperture; there is no PCI slot on the motherboard. Slot contains a narrow graphics card Slot is empty. Slot contains a narrow graphics card. Slot is empty, and available for an optional G-sync card. Slot 5 contains a NIC card Slot 6 contains a high-speed interconnect card. The actual configuration of a workstation depends on the customer s original specification and the workstation role. For example, it might be a display node rather than a render node. 5.. NVIDIA PCI Graphics Cards NVIDIA PCI Express 6x graphics cards are used in xw900 workstations. The Quadro FX50 is a high-end graphics card, and the Quadro FX500 is an ultra high-end graphics card. The following sections describe these graphics cards NVIDIA FX50 Graphics Card The FX50 graphic card has the following features: PCI Express 6x, single slot Two DVI-I outputs, each can provide: digital output for flat-panel analog output via a dongle for CRT 8 Workstations

229 -pin Mini DIN stereo output (used for shutter glasses) Connects to system power supply 5... NVIDIA FX500 Graphics Card The FX500 graphics card has the following features: PCI-E 6x, Dual slot Two DVI-I outputs, each can provide: digital output for flat-panel analog output via a dongle for CRT Three-pin mini DIN stereo output (used for shutter glasses) Connects to system power supply 5..5 Connecting PCI Graphics Cards to Displays Connection to display devices is done at the customer site Digital and analog displays are supported by the graphics card Display nodes connect to display devices via DVI-I output on graphics card Second (lower) DVI-I output connects to KVM using analog adapter Render nodes are not connected to display devices Display devices may be: HP monitors (digital or analog) or projectors Third party devices such as projection systems from: Fakespace Barco Others Connection from the graphics card to the display device may be via: Direct cable-acceptable cable length depends on display resolution (typically a couple of meters) A third-party product that extends the reach of the video cable Indirectly through a third-party video switch 5..6 The NVIDIA FX G-Sync PCI Graphics Card (Optional) You might choose the optional NVIDIA FX G-sync PCI graphics card. The NVIDIA FX G-sync PCI graphics card: Synchronizes video refresh and frames for multi-tile displays and stereo. Connects FX 500 cards across nodes externally. Synchronizes the refresh of multiple cards in multiple workstations. Required for active stereo. Interconnected using CAT-5 cables. The G-Sync card uses the PCI slot only for physical support. An internal cable attaches the G-sync card to one, or both of the graphics cards. Connections to the G-Sync card are not defined in the Cluster cabling tables. If you are using the Quadro FX G-Sync board in conjunction with a graphics card, the following additional setup steps are required. 5. HP xw900 Workstation Overview 9

230 Important: These steps must be performed when the system is off.. On the Quadro FX G-Sync board, locate the fourteen-pin connector labeled "primary". Connect the ribbon cable to this card.. Install the Quadro FX G-Sync board in any available slot. Note that the slot itself is only used for support. The slot must be close enough to the graphics card that the ribbon cable can reach.. Connect the other end of the ribbon cable to the fourteen-pin connector on the graphics card.. Only the end-user customer makes external connections to this card. The G-Sync card provides two modular connectors similar to Ethernet RJ-5 jacks. NVIDIA G-sync cards are connected by using CAT-5 cables. Warning! The voltage and signal on the frame lock ports are different from Ethernet signals. Do not connect a Frame lock port to an Ethernet card, or network hub. Doing so can cause damage to the hardware System Interconnect Cards Table 5-0 shows the supported interconnect cards depending on the system configuration. Some configurations depend on whether there are one or two graphics processor units (GPUs). Table 5-0 Supported Interconnect Cards Interconnect Gigabit Ethernet Myrinet XP Rev D Myrinet XP Rev E InfiniBand Quadrics PCI-X 9056-B (if GPU) B 8099-B (if GPU) AC07A PCI Express PP68AV (if GPU) 8098-B (if GPU) 5..8 Memory Configurations Table 5- shows the supported memory configurations. Table 5- Supported Memory Configurations Memory Size GB (x5) SDR-00 GB (x5) DDR-00 GB (xgb) DDR-00 GB (8x5) DDR-00 6 GB(xG+x5) DDR-00 8 GB (8xGB) DDR-00 8 GB (xgb) DDR-00 CPU PP69AV PR788AV PR789AV EM99AV CPU. PP6AV PP6AV PP6AV PP6AV PP65AV PU987AV 0 Workstations

231 Table 5- Supported Memory Configurations (continued) Memory Size 6 GB (xgb) DDR- GB (8xGB) DDR- CPU CPU EK78AV EK77AV 5..9 PCI Card Installation and Removal Instructions This section describes PCI card installation, and removal procedures for the xw900 workstation. Note: The HP xw900 Workstation contains two PCI Express x6 slots. PCI Express slot three is only active in the dual-processor configuration. This slot cannot be used in a single-processor configuration PCI Card Support For added protection, some cards have PCI holders installed to stabilize the card. To remove the PCI card holder, follow these steps:. Disconnect power from the system and remove the access panel.. Referring to the callouts in Figure 5-0, for short or tall PCI cards, lift up on the holder arm (callout ) with one hand and press in on the sides (callout ) of the holder and rotate it out (callout ) of the chassis. Figure 5-0 Removing PCI Card Holders To install the PCI card support holder, follow these steps:. Disconnect power from the system and remove the access panel.. Referring to the callouts in Figure 5-, for short or tall PCI cards, attach the lips of the support arm (callout ) under the slots on the rear of the chassis, then rotate the card support down until the black part of the arm (callout ) supports the card. 5. HP xw900 Workstation Overview

232 5..9. Removing and Installing PCI Express Cards Figure 5- Installing PCI Card Holders To remove a PCI Express Card, refer to the callouts in Figure 5-, and follow these steps:. Disconnect power from the system and remove the access panel. Remove the PCI card support, if installed.. Lift the PCI levers (callout ) by first pressing down and then up.. Remove the power supply cable (callout ), if installed, and press in on the hockey stick lever (callout ) while lifting the card (callout ) out of the chassis. Store the card in an antistatic bag.. Install a PCI slot cover and close the PCI levers. If the PCI levers do not close, be sure all of the cards are properly seated and then try again. Figure 5- Removing PCI Express Cards Workstations To install a PCI Express card, refer to the callouts in Figure 5-, and follow these steps:. Disconnect power from the system, remove the access panel and remove the PCI card support, if installed.. Lift the PCI levers (callout ) by first pressing down and then up.. Remove the PCI slot cover (callout ).. Lower the PCI Express (callout ) card into the chassis. Verify that the keyed components of the card align with the socket.

233 5. If required, plug in the power supply cable (callout ). 6. Close the PCI levers (callout 5). If the PCI levers do not close, be sure all of the cards are properly seated. Figure 5- Installing PCI Express Cards Removing and Installing PCI or PCI-X Cards Note: The following illustration shows a PCI card being removed from a PCI slot. A PCI-X card is removed from a PCI-X slot. To remove a PCI or PCI-X card, refer to the callouts in Figure 5- and follow these steps:. Disconnect power from the system, remove the access panel and remove the PCI card support, if installed.. Lift the PCI levers (callout ) by first pressing down and then up.. Lift the PCI card (callout ) out of the chassis. Store the card in an antistatic bag.. Install a PCI slot cover and close the PCI levers. If the PCI levers do not close, be sure all cards are properly seated and then try again. Figure 5- Removing PCI, or PCI-X Cards 5. HP xw900 Workstation Overview

234 Note: Figure 5-5 shows a PCI card being installed in a PCI slot. A PCI-X card must be installed in a PCI-X slot. To install a PCI or PCI-X card, refer to the callouts in Figure 5-5 and follow these steps:. Disconnect power from the system, remove the access panel, and remove the PCI card support.. Lift the PCI levers (callout ) by first pressing down and then up.. Remove the PCI slot cover (callout ).. Lower the PCI (callout ) card into the chassis. Verify that the keyed components of the card align with the socket. 5. Close the PCI levers (callout ). If the PCI levers do not close, be sure all of the cards are properly seated and then try again. Figure 5-5 Installing PCI or PCI-X Cards 5..0 Removing a Workstation from the Rack The procedure for removing the xw900 from the rack the same as the xw800. See Section HP xw900 Workstation Overview The HP xw900 Workstation mechanical design is based on the xw800 and xw900 designs. It incorporates improvements made for the xw800 while keeping the features from the xw900 specific to the AMD architecture. Nearly all of the customer-accessible components can be removed and replaced without a tool. The airflow, especially through the disk drives and PCI area has been improved, and it incorporates a number of additional features that enhance the HP xw900 Workstation. The xw900 supports dual AMD Opteron microprocessors, each one having four memory slots available. The AMD Opteron architecture, in conjunction with the NVIDIA nforce Professional 600 and NVIDIA nforce Professional 650, enables the xw900 to drive dual, high-performance graphics slots (entry level to High End D) at full PCI e x6 bandwidth. Additionally, the use of SLI (Scalable Link Interface) between two graphics boards enhances graphics performance. Table 5- describes the standard features of the HP xw900 workstation. Workstations

235 Table 5- HP Workstation xw900 Features Feature Operating systems Processor Chipset Memory Drive controllers Hard drive(s) Optical drives Drive bays Slots Graphics Specification Genuine Windows XP -bit Edition SP (WHQL certified) Genuine Windows XP Professional x6 Edition (WHQL certified) Microsoft Vista capable Red Hat Enterprise Linux (Optional -bit or 6-bit: Red Hat Enterprise Linux WS or WS and HP Linux Installer Kit) Single or Dual Core AMD Opteron 000 series processors 0 (.80 GHz), (.00 GHz), (.0 GHz), 6 (.0 GHz), 8 (.60 GHz), 0E (.8 GHz) with AMD6 Technology, MB of L cache per core and GHz AMD HyperTransport technology NVIDIA nforce Professional 600 and NVIDIA nforce Pro 050 Up to 6 GB of ECC registered DDR 667 MHz SDRAM in 8 DIMM slots (a max. of 6 GB with one processor). The HP xw900 is expected to support 6 GBiv of memory with 8 GB DIMMs. Integrated SATA Gb/s controller (6 channels) with RAID 0,, 5 and 0 capability; Integrated SAS controller (8 channels) with opt. external connector and RAID 0,, and 0 Up to five SATA drives supported natively (.75 TB max.); 80, 60 GB (0K rpm) SATA.5 Gb/s or 80 GB (700 rpm) SATA Gb/s, 60, 50, 500, 750 GB SATA Gb/s NCQ; or up to five serial attached SCSI (SAS) drives supported natively (.5 TB max.); 6 GB (0K rpm) or 6, 00 GB (5K rpm) SAS drives. CD-ROM, DVD-ROM, CD-RW/DVD combo, DVD+/- RW Dual-Layer with LightScribe Direct Disc Labeling (Microsoft XP only, requires LightScribe media for labeling) Three external 5.5 inch bays (opt. StorCase enclosure enables.5 inch SATA drive to be added to 5.5 inch bay), five internal.5 inch bays Seven slots: PCI Express (PCIe) x6 graphics, PCIe x6 (x8 electrical) I/O; full-height PCI-X 00 MHz slots; full-length PCI Professional D: NVIDIA Quadro NVS 85 (8 MB, up to cards supported) Entry D: NVIDIA Quadro FX 560 (8 MB) Mid-range D: NVIDIA Quadro FX 500 (56 MB, up to cards supported) High-end D: NVIDIA Quadro FX 500 (56 MB), NVIDIA Quadro FX 500 (5 MB with optional Quadro G-Sync card), NVIDIA Quadro FX 5500 (5 MB, up to cards supported) Audio Network Ports Integrated High Definition audio with jack retasking capability, opt. PCI Sound Blaster X-Fi XtremeMusic Dual NVIDIA Gigabit LAN-On-Motherboardx, opt. Broadcom 575 NetXtreme Gigabit PCIe NICx, opt. Intel Pro/000 GT Gigabit PCIe NICx Front: two USB.0, Headphone, Microphone In, Audio Out, optional IEEE 9 Back: six USB.0, one standard serial port, IEEE 9, PS/ keyboard and mouse, two RJ-5 to integrated Gigabit LAN, Audio In, Audio Out, Mic In Input devices Dimensions (H W D) Power supply USB or PS/ keyboard; choice of -button scroll mouse (optical or mechanical); USB -button mouse (optical); USB SpaceBall, USB SpacePilot 7.9 inch (5.5 cm) x 8. inch (.0 cm) x 0.7 inch (5.5 cm) 800 W The front panel of the xw900 is identical to the front panel of the xw800, as shown in Figure 5-. Figure 5-6 shows the rear view of the xw HP xw900 Workstation Overview 5

236 Figure 5-6 HP xw900 Workstation Rear View The following table describes the callouts in Figure 5-6: Item Description Power cord connector Power supply built-in self test (BIST) LED Serial connector (teal) SPDIF OUT (single RCA jack to support SPDIF digital audio output via coax cable) Keyboard connector USB.0 ports Microphone connector (pink) Audio line-out connector MiniSAS port connector (optional) Graphics adapter Audio line-in connector RJ-5 network connectors IEEE-9a connector Mouse connector Cable lock slot Padlock loop Universal chassis clamp opening Access panel key 6 Workstations

237 5.. PCI Slot Indentification The HP xw900 workstation has seven PCI expansion slots. Figure 5-7 shows the PCI slots available in the xw900 workstation, and Table 5- identifies the slots. Figure 5-7 HP xw900 Slot Numbering Table 5- HP xw900 Workstation PCI Slots Slot 5 6 Assignment PCI Express x6 (x8) PCI Express x6 graphics PCI bit, MHz PCI Express x6 (x8) PCI Express x6 graphics PCI X 00 7 PCI X 00/ Slot is for short cards only 5.. Slot Assignment Rules Table 5- lists the slot assignments for graphics cards. Table 5- Graphics Cards Slot Slot Type CPU CPU, Graphics Card CPU, Graphics Cards PCI Express, x6 Graphics Graphics Graphics PCI Express, x6 N/A N/A N/A PCI / N/A SI Gigabit Ethernet or InfiniBand Graphics PCI Express, x6 G-Sync G-Sync N/A 5. HP xw900 Workstation Overview 7

238 Table 5- Graphics Cards (continued) Slot Slot Type CPU CPU, Graphics Card CPU, Graphics Cards 5 PCI Express, x6 NIC NIC G-Sync or NIC 6 PCI-X 00 SI All SI Myrinet or Quadrics SI All 7 PCI-X 00/ 5.. xw900 Graphics Options The following graphics options are used in xw900 workstations: NVIDIA Quadro FX 500 (see Figure 5-8) NVIDIA Quadro FX 500 (see Figure 5-9) NVIDIA Quadro G-Sync (see Figure 5-0) 5... NVIDIA Quadro FX 500 The NVIDIA Quadro FX 500 includes the following features: G7GL-U graphics processor 56 MB GDDR graphics memory Dual dual-link DVI-I Stereo output SLI Capable High Precision Dynamic Range Technology (HPDR) Full 8-bit Precision Graphics Pipeline, -bit sub-pixel Precision Rotated Grid FSAA Infinite length vertex programs and dynamic flow control Fully Programmable Video GPU Figure 5-8 shows an NVIDIA Quadro FX 500 graphics card. 8 Workstations

239 Figure 5-8 NVIDIA Quadro FX 500 Graphics Card 5... NVIDIA Quadro FX 500 The NVIDIA Quadro FX 500 includes the following features: G70GL graphics processor 5 MB GDDR graphics memory Dual dual-link DVI-I SLI Capable New dual slot thermal solution High Precision Dynamic Range Technology (HPDR) Full 8-bit Precision Graphics Pipeline, -bit sub-pixel Precision Rotated Grid FSAA Infinite length vertex programs and dynamic flow control Fully Programmable Video GPU Figure 5-9 shows an NVIDIA Quadro FX 500 graphics card. 5. HP xw900 Workstation Overview 9