SIEM9750 Release 1.0. Chassis (FRU) Information and Troubleshooting Guide. Issue: 02. Date: Page 1 of 90

Transcription

1 SIEM9750 Release 1.0 Chassis (FRU) Information and Troubleshooting Guide Issue: 02 Date: Page 1 of 90

2 This document is intended for Symantec support personnel, IBM, or other authorized Symantec Service Partners. Symantec Corporation Address: 350 Ellis St., Mountain View, CA Website: Copyright Symantec Corporation All rights reserved. No part of this document may be reproduced or transmitted in any form or by any means without prior written consent of Symantec Corporation. Trademarks and Permissions and other Symantec trademarks are trademarks of Symantec Corporation. All other trademarks and trade names mentioned in this document are the property of their respective holders. Notice The purchased products, services and features are stipulated by the contract made between Symantec and the customer. All or part of the products, services and features described in this document may not be within the purchase scope or the usage scope. Unless otherwise specified in the contract, all statements, information, and recommendation in this document are provided AS IS without warranties, guarantees or representation of any kind, either express or implied. The information in this document is subject to change without notice. Every effort has been made in the preparation of this document to ensure accuracy of the contents, but all statements, information and recommendations in this document do not constitute the warranty of any kind, express or implied. Page 2 of 90

3 Table of Contents 1. Safety Notice and Warnings Ratings Electrical and General Safety Guidelines Prerequisites for All Hardware Replacement Procedures Hardware Configuration of the SIEM Front and Rear Pics of Server FRU 2U Base Chassis Local Control Panel Intel Local Control Panel Menus Symptoms of a Failed Local Control Panel FRU 2U Base Chassis System Status LED Hard Disk Drive Support FRU 2U Base Chassis Power Subsystem PCI Riser Cage Add In Cards and On-Board NICs Hard Drive / RAID Management BIOS Level RAID Utilities BIOS Level RAID Utility RAID Controller Event Log File RAID Priorities Cooling Sub-System FRU 2U Base Chassis Server Board Memory Processers (CPUs) Intel Remote Management Module 3 - Overview Intel Remote Management Module 3 Viewing Field Replaceable Unit (FRU) Information Active Midplane SAS / SATA Backplane Layout Server Diagnostics and Troubleshooting POST Code Diagnostic LED Decoder All Possible LED Codes Video POST Code Errors POST Error Beep Codes List of Acronyms Page 3 of 90

4 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) Hardware Maintenance Page 4 of 90

5 1. Safety Notice and Warnings FCC Notice This device complies with part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This device may not cause harmful interference. 2. This device must accept any interference received, including interference that may cause undesired operation. No Telecommunications Network Voltage (TNV)-connected PCBs shall be installed. This class A digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada. CE Mark Warning This is a Class A product. In a domestic environment, this product may cause radio interference, in which case the user may be required to take adequate measures. VCCI Warning This is a product of VCCI Class A Compliance. Environmental Warning Perchlorate Material - special handling may apply. See This notice is required by California Code of Regulations, Title 22, Division 4.5, Chapter 33: Best Management Practices for Perchlorate Materials. This product/part includes a battery that contains Perchlorate material. Page 5 of 90

6 2. Ratings POWER INPUT: Volts: VAC (auto-range); Hz Amps: 12-6 amps VA: 960 PFC Watts: 960 OUTPUT: Watts: 750W BTUs/hr: 2550 % Efficiency of the Power Supplies:* 80% * Typical and varies with load ENVIRONMENT: Temperature: Operating temperature range: 50 to 95 o F (10 to 35 o C) Non-operating temperature range: -40 to 158 o F (-40 to 70 o C) Humidity: Operating humidity range: Non-operating humidity range: 8 to 90% non-condensing at 35 o C 5 to 95% non-condensing DIMENSIONS: Form Factor: 2U rack mount Height: 3.5 (88.9 mm) Width: 16.9 (430 mm) Depth: 29.5 (749.3 mm) Weight: Typical - 71 lbs. (32.2 kg) when fully configured (2 PSUs, 8 HDDs) Page 6 of 90

7 3. Electrical and General Safety Guidelines CAUTION This appliance is intended for installation in restricted areas only. Initial setup and maintenance should be performed by qualified personnel. CAUTION Power down the appliance following the operating system s proper power down procedure from the front panel. Unplug all AC power cord(s) before servicing. CAUTION To avoid electrical shock, check the power cords as follows. This product is to be installed in Restricted Access Location only. Use the exact type of power cords required. Use power cord(s) that came with safety certifications. Power cord(s) must comply with AC voltage requirements in your region. The power cord plug cap must have an electrical current rating that is at least 125% of the electrical current rating of this product. The power cord plug cap that plugs into the AC receptacle on the power supply must be an IEC 320, sheet C13, type female connector. Plug the power cord(s) into a socket that is properly grounded before turning on the power. CAUTION Required operating conditions for the appliance are - Temperature: 10 to 35 o C. Humidity, non-condensing: 8 to 90%. CAUTION Risk of explosion if the battery is installed upside down or is replaced by an incorrect type. Dispose of used batteries according to the instructions. DISPOSING OF BATTERY BACKUP UNITS - IF APPLICABLE WARNING If the BBU is damaged in any way, toxic chemicals may be released. The material in the battery pack contains heavy metals that can contaminate the environment. Federal, state, and local regulations prohibit the disposal of rechargeable batteries in public landfills. Be sure to recycle the old battery packs properly. Comply with all applicable battery disposal and hazardous material handling laws and regulations in the country or other jurisdiction where you are using the BBU. WARNING There is danger of an explosion if the battery is incorrectly replaced. Replace it only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer s instructions. Page 7 of 90

8 3. Electrical and General Safety Guidelines (continued) WARNING Disconnect the power supply at the circuit breaker before accessing any components. Turning off the system power supply switch does not reduce the risk of electrical shock from the power supply terminal block. CAUTION To prevent the unit from overheating, never install the appliance in an enclosed area that is not properly ventilated or cooled. For proper airflow, keep the front and back sides of the appliance clear of obstructions and away from the exhaust of other equipment. Be aware of the locations of the power switches on the chassis and in the room, so you can disconnect the power supply if an accident occurs. Take extra precautionary measures when working with high voltage components. Do not work alone. Before removing or installing main system components, be sure to disconnect the power first. Turn off the system before you disconnect the power supply. Use only one hand when working with powered-on electrical equipment to avoid possible electrical shock. Use rubber mats specifically designed as electrical insulators when working with computer systems. The power supply or power cord must include a grounding plug and must be plugged into grounded outlets. CAUTION Electric Static Discharge (ESD) can damage electronic components. To prevent damage to your system board, it is important to handle it very carefully. The following measures can prevent ESD damage to critical components. Use a grounded wrist strap designed to prevent static discharge. Keep all components and printed circuit boards (PCBs) in their antistatic bags until ready for use. Touch a grounded metal object before removing the board from the antistatic bag. Do not let components or PCBs come into contact with your clothing, which may retain a charge even if you are wearing a wrist strap. Handle a board by its edges only; do not touch its components, peripheral chips, memory modules or contacts. When handling chips or modules, avoid touching their pins. Put the motherboard and peripherals back into their antistatic bags when not in use. For grounding purposes, make sure your computer chassis provides excellent conductivity between the power supply, the case, the mounting fasteners and the motherboard. Page 8 of 90

9 4. Prerequisites for All Hardware Replacement Procedures 1. Technician that is performing the hardware replacement must be statically grounded and observe ESD compliance practices. 2. All hardware replacements should be performed with the Server Chassis/Enclosure powered off and power cables removed. The only exception to this will be Hot Swap components: HDD hard drives and power supplies, Cooling Fans. 3. All externally connected device cables should be labeled so that they can be plugged into their exact same position/ports if replacement is needed. 4, If the Server is installed in a rack, the technician must determine if the Server, as installed, needs to be removed completely or partially for parts replacement. Space limitations and cable lengths will determine if the replacement swap can be done without removing the machine from the rack. Foot Strap for ESD Protection Wrist Strap for ESD Protection Page 9 of 90

10 5. Hardware Configuration of the SIEM 9750 Components: Details Main features: 2U (1 U = mm (1.75 )) Eight customer removable disk slots on the front panel Two non removable solid state drives on the mainboard Processor : Two quad-core E5640 CPUs Memory : Disks : Memory:16 GB eight 2 GB DIMMs 8 x 600 GB, 7,200 rpm SAS (Serial Attached SCSI) data disks Two 120 GB solid state drives RAID: RAID 1 and RAID 5 System disk: RAID 1 (software RAID) Data disk: RAID 5 (RAID chip on mainboard) Access ports Front panel: Rear panel: Two USB 2.0 ports on the control panel One 100 Mbit/s IPMI management network port One Video Graphics Array (VGA) port One RJ-11 serial port, with a transfer rate of 115,200 baud Four Universal Serial Bus (USB) 2.0 ports One GE Gigabit Ethernet service network port, with RJ-45 connector and link/active indicator LEDs One GE Gigabit Ethernet private network port, with RJ-45 connector and link/active indicator LEDs3 Page 10 of 90

11 6. Front and Rear Pics of Server Front view Front and top view Rear view Page 11 of 90

12 6. Front and Rear Pics of Server (continued) Page 12 of 90

13 7. FRU 2U Base Chassis Local Control Panel The Intel Local Control Panel is an optional accessory installed in the SIEM 9750 that enhances the manageability of the Server Board in the chassis. Combined with the installed Remote Management Module, the Local Control Panel allows a user to monitor the health of an Intel Server or configure an Intel Server for remote IPMI management. This allows for monitoring, configuration and control of the Server, independently from the Operating System. Perhaps the most useful feature of the control panel is the ability to view the events of the System Event Log (SEL) without having to reboot the system. NOTE: The following parts within the SIEM9750 are not FRUs and therefore when they fail, a replacement Base Chassis will be installed instead. Local Control Panel (LCD Display) CPUs Server Board Power Distribution Module RAID Activation Key for Active Midplane Memory Module on Active Midplane Intel Remote Management Module 3 SAS Backplane PCI Riser Card Cage Any I/O ports on the Server such as Onboard NICs, USB and Video ports Page 13 of 90

14 7. FRU 2U Base Chassis Local Control Panel(continued) [Source: Intel SR2625UR Service Guide] Page 14 of 90

15 8. Intel Local Control Panel Menus The root menu of the Intel Local Control Panel is the Intel Local Control Panel main menu. This menu appears after power on or reset, and after the user presses a button to stop the Intel Local Control Panel monitor. The following sections are organized based on the menu structure of the Intel Local Control Panel. 8.1 Intel Local Control Panel Main Menu This menu includes a help screen that describes each of the symbols used by the Intel Local Control Panel display. The help screen does not have sub-menus. Page 15 of 90

16 8. Intel Local Control Panel Menus (continued) 8.2 Table Help Symbols 8.3 Server Monitoring Menu This menu item provides options for monitoring the current server status such as sensors, chassis status, and viewing the System Event Log (SEL). Page 16 of 90

17 8. Intel Local Control Panel Menus (continued) 8.4 System Event Log (SEL) This menu item displays the system event log. When this menu item is selected, the Intel Local Control Panel downloads the SEL from the system. This download may take several seconds, depending on the number of SEL entries. The Intel Local Control Panel displays the SEL entries in order, with the most recent entries at the top of the display. An hourglass icon indicates that the entries are loading. The Intel Local Control Panel translates the standard IPMI SEL entries form HEX format. Due to the limited display area, the Intel Local Control Panel uses special icons to translate frequently used translation terms. For example: an SEL event indicating a sensor has crossed its upper non-critical threshold uses the icon. See the Help Symbols Table for a selection of icons. The Intel Local Control Panel can display up to two translated SEL entries on the screen at a time. The SEL entry at the top of the Intel Local Control Panel display is the active SEL entry. Pressing the Enter button on the Intel Local Control Panel on the active SEL entry causes the Intel Local Control Panel to display the raw SEL data for the entry in HEX. NOTE: The Intel Local Control Panel does not provide an option to clear the SEL. Use the current Intel System Management software tools to clear the SEL. Some Intel servers also provide the capability to clear the SEL in BIOS setup. Page 17 of 90

18 8. Intel Local Control Panel Menus (continued) Navigating the SEL on the Intel Local Control Panel Step 1 Choose Server Monitoring. Step 2 Choose System Event Log. Step 3 View System Event Log contents. Page 18 of 90

19 9. Symptoms of a Failed Local Control Panel Nothing on the display at all. Display is not readable. System will not power on (power button). System will power but no LEDs light. Page 19 of 90

20 10. FRU 2U Base Chassis System Status LED The SIEM 9750 uses an LED on the front of the control panel to indicate System Faults. This LED is called the System Status LED and is represented by a triangle with an exclamation mark in the middle of it. The Control Panel LED Operation table shown denotes the possible System Status LED color states and their meanings. Page 20 of 90

21 10. FRU 2U Base Chassis System Status LED (continued) 10.1 Table: Control Panel LED Operation Page 21 of 90

22 10. FRU 2U Base Chassis System Status LED (continued) To summarize, the following are possible causes for the System Status to be lit in an abnormal fashion (Amber): 1) Power Supply / Voltage problem 2) CPU Problem 3) Fan or Thermal problem 4) Memory Module problem 5) PCI Bus problem 6) System cover / lid has been opened (chassis intrusion switch) In order to find out the reason why an abnormal status may be lit on the LED, it is necessary to retrieve the System Event Log (SEL) from the Server. Instructions on how to retrieve the SEL log will be discussed in the System Event Log (SEL) Section of this document. Page 22 of 90

23 11. Hard Disk Drive Support Overview The SIEM 9750 incorporates 2 different hard drive and RAID configurations RAID 1 There will be 2 Internal solid state drives installed with the optional 2 Flex Bay located just to the left of the LCD display. These 2 drives will be using the onboard SATA Host RAID on the Server Board, set up for Software RAID. Symptoms of a Failed hard drive in the RAID 1: 2 Internal Drives NOTE: There are no LEDs on the hard drives to signal a hard drive failure. 1) The RAID Array is Degraded within the RAID Management Software 2) When the machine is rebooted the onboard RAID Controller will display a message about a Degraded array at POST. 3) A hard drive scan within the RAID Management Software does not find one or more of the hard drives. Possible Causes: 1) Hard drive has failed. 2) SATA cable to the SATA ports on the Server Board are unplugged. Page 23 of 90

24 11. Hard Disk Drive Support (continued) 11.2 RAID 5 There will be 8 Hot Swap hard drives with 1 drive being a Global Hot Spare. Disks in slots 0 through 6 are data disks that form a RAID 5 group. These disks provide storage capacity. The 8 Hot Swap hard drives are located on the left side of the chassis with labeling below. Symptoms of a Failed Hard drive in the RAID 5 of the ) Disk Status LED is Red on one or more drives. 2) A Scan of the hard drives does not detect all 8 hard drives. Possible Causes: 1) The hard drive is faulty. 2) The hard drive is not inserted properly. 3) The SAS cable is not installed properly. 4) SAS Backplane is faulty. Page 24 of 90

25 12. FRU 2U Base Chassis Power Subsystem Overview The power subsystem of the system consists of an integrated Power Distribution Module (PDM), a power module enclosure, and support for up to two 750-Watt power supply modules. The SIEM 9750 SubSystem will be configured as a redundant configuration 2 power supplies. In a 1+1 configuration, a single failed power module can be hot-swapped with the system running. This configuration supports up to a maximum of 750 Watts of power. [Source: Intel SR2625_tps.pdf] 12.1 Power Distribution Module The purpose of the power distribution module is to convert and supply AC power to the various components inside the Server Chassis. For this reason, it is possible to have fully functioning power supply modules but a chassis that will not power on. When this condition occurs, it is likely that the power distribution module is faulty. NOTE: When the power supplies are inserted into the chassis, the male edges of the power supply modules are actually inserting into the female connectors of the power distribution module Power Distribution Module Page 25 of 90

26 12. FRU 2U Base Chassis Power Subsystem (continued) 12.2 Power Supplies Power Supply Module Power Supply Status LED Each power 750W supply module has a single bi-color LED to indicate power supply status. The LED is located on the rear exterior of the power supply. A solid green LED indicates normal operation so any other signal should be investigated. Page 26 of 90

27 12. FRU 2U Base Chassis Power Subsystem (continued) Table: Possible LED Colors and Meanings 12.3 Steps to Troubleshoot a Failed Power Supply (Amber or No LED) Step 1 System Status LED is lit Amber on the front local control panel. Step 2 Amber LED on the exterior of the Power Supply. Step 3 Check the connection of the power supply in its slot. Reseat the power supply if its connection to the chassis looks suspect. Step 4 Check the power cable going into the power supply and verify that it is fully seated. Step 5 Check that power cable is good. Step 6 Check that the incoming voltage meets the requirements for the cable and power supply Hot Swapping a Power Supply Overview Hot swapping a power supply is the process of inserting and extracting a power supply from an operating power system. The power supply can be hot swapped by the following method: Extraction: The AC power will be disconnected from the power supply before the power supply being extracted from the system. This could occur in standby mode or powered on mode. Insertion: The AC power will be connected to the power supply after the power supply is inserted into the system and the power supply will power on into standby mode or powered on mode. Page 27 of 90

28 12. FRU 2U Base Chassis Power Subsystem (continued) Power Supply Handle and Retention Mechanism Each power supply module includes a handle for module insertion into (or removal from) the module enclosure. Each module has a simple retention mechanism to hold the power module in place once it is inserted. This mechanism withstands the specified platform mechanical shock and vibration requirements. The tab on the retention mechanism is colored green to indicate it is a hot-swap touch point. The latch mechanism is designed to prevent insertion or removal of the module when the power cord is plugged in. This aids the hotswapping procedure. All replacement procedures are covered in the replacement section of this document. Page 28 of 90

29 13. PCI Riser Cage The PCI Riser Cage is the assembly that contains all of the PCI add in cards, such as Fibre and Ethernet cards. Symptom of a failed Riser Cage Assembly NOTE: Always make sure that the PCI Riser Cage is fully seated into the Server Board. Add in cards are not seen by the System. Notice the copper pins connector that fits into a slot on the Server Board. Notice the 3 open slots for add in cards. Page 29 of 90

30 14. Add In Cards and On-Board NICs The SIEM 9750 has a total of 2 optional Add In Cards and On-Board NICs QLogic QLE2562 and QLogic QLE2564 8Gb Fibre Channel to PCI Express Adapter Dual Port and Quad Port Page 30 of 90

31 14. Add In Cards and On-Board NICs(continued) 14.2 QLogic QLE2562 and QLogic QLE2564 8Gb Fibre Channel to PCI Express Adapter Dual Port and Quad Port Table: LEDs and Diagnostics for QLogic QLE2562 and QLogic QLE Troubleshooting Steps for the QLogic QLE2562 and QLogic QLE2564 Step 1 Verify that the cable is correctly connected to the card. Step 2 Verify that the far end of the cable is correctly connected to the other equipment. Step 3 Unplug and replug the cable at both ends. Step 4 Replace the cable with a new cable. Step 5 Reseat the PCI card. Page 31 of 90

32 14. Add In Cards and On-Board NICs (continued) 14.3 Physical Locations of On-Board NICS SIEM 9750 network ports (rear panel) Port NIC 1 NIC 2 IPMI Details (eth0) 100 Gbps Ethernet port (eth1) 100 Gbps Ethernet port Intelligent Platform Management Interface port Enables data gathering and monitoring of hardware status. Page 32 of 90

33 14. Add In Cards and On-Board NICs (continued) 14.4 Troubleshooting Steps for Network Connectivity Issues Step 1 Verify that the cable is correctly connected to the card. Step 2 Verify that the far end of the cable is correctly connected to the other equipment. Step 3 Unplug and replug the cable at both ends. Step 4 Replace the cable with a new cable. Step 5 Reseat the PCI card. Another possibility if the Add In Card or On-Board NIC is not working properly: the card may be configured incorrectly. Page 33 of 90

34 Page 34 of 90

35 16. Hard Drive / RAID Management BIOS Level RAID Utilities 16.1 Introduction The SIEM 9750 has 2 RAID Arrays configured. Traditionally a RAID Management utility can be accessed during POST of the machine or within the Operating System of the machine. The main purpose for needing to access these utilities is to initiate a Rebuild of an Array after a faulty hard drive has already been physically replaced. Prior to starting work on any RAID array, you should ensure that you have a full complete backup of the data contained on the RAID. NOTE: Instructions for physically replacing the hard drive can be This section discusses the available BIOS level Raid Utilities for: found in the Replacement section of this document. The 2 drive RAID 1 installed in the Flex Bay The 8 drive RAID 5 with a Global Hot Spare installed on the left side of the 9750 Page 35 of 90

36 16. Hard Drive / RAID Management BIOS Level RAID Utilities) (continued) 16.2 Intel RAID BIOS Console 2 Configuration Utility During the boot process (before the OS is loaded), the system will display the 2 hard drives and a Status of the RAID 1 array denoted by arrows. At the bottom of the screen are the keys to be pressed in order to access the RAID management utility (Ctrl + E). Step 1 Type in Ctrl+E ; the following window will appear: 16. Hard Drive / RAID Management BIOS Level RAID Utilities) (continued) Step 2 Choose the Rebuild option; the following window will appear: Page 36 of 90

37 NOTE: In this picture example, the Array is already in an Online state so therefore there is not a newly introduced drive shown in the 2 choices of drives. Step 3 Highlight the newly replaced hard drive and then press the F10 key to start the rebuild process. Step 4 Escape out of the utility and then the machine will reboot. Upon reboot, the machine should display the Status of the Array as Rebuilding. The machine should then boot into the operating system normally and complete the rebuild in the background. Page 37 of 90

38 16. Hard Drive / RAID Management BIOS Level RAID Utilities) (continued) 16.3 BIOS Level RAID utility for the RAID 5 with a Global Hot Spare on the 9750 The Intel RAID BIOS Console 2 configuration utility provides a graphical user interface to manage all aspects of the RAID subsystem and many features of the RAID controller. Step 1 To access this utility, press Ctrl+ G during system boot time. Page 38 of 90

39 16. Hard Drive / RAID Management BIOS Level RAID Utilities) (continued) Step 2 Click Start to see the next window. Step 3 Click on Physical View. The RAID 5 array is configured with a Hot Spare drive. Therefore, when there is a hard drive failure in the array, the hot spare automatically rebuilds into the RAID array. The failed drive is then marked as failed until it is replaced by a new drive. The new drive then needs to be configured as the Hot Spare drive. When the new hard drive is installed it is marked as Unconfigured Good as shown in the picture above. Page 39 of 90

40 16. Hard Drive / RAID Management BIOS Level RAID Utilities) (continued) Step 4 Click on the drive to go into its properties. Step 5 Click the radio button called Make Hot Spare and then click Go. The physical view should show the drive as a Hot Spare drive. Step 6 Exit the utility and the machine should reboot normally to the OS Table: RAID Utility Possible Physical Drive Statuses 16.4 Table: RAID Utility Possible Statuses for the Virtual (Logical) Drive (RAID Array) Status Designation Optimal Partially Degraded Degraded Offline Status Description A virtual drive with online member drives A virtual disk with a redundant RAID level capable of sustaining more than one member disk failure, where there is one or more member failure but the virtual disk in not degraded or offline a partially degraded array still has redundancy. Example: A RAID 5 with one drive failed A virtual disk with a redundant RAID level and one or more member failures that cannot sustain a subsequent drive failure there is no redundancy left A virtual disk with one or more member disk failures that make the data inaccessible Page 40 of 90

41 17. BIOS Level RAID Utility RAID Controller Event Log File 17.1 Introduction The Intel RAID Web Console 2 utility monitors the activity and performance of all controllers in the server and any devices attached to them. When an event such as the completion of an array rebuild or the removal of a physical drive occurs, an event message is displayed in the log, which is displayed at the bottom of the Intel RAID Web Console 2 screen Navigating to the Event Log file within the Utility Step 1 On the Main screen, select Events from the menu at the left. The Events screen appears. Intel RAID BIOS Console 2 Event Information Screen Step 2 Select the component to display from the Event Locale list. Step 3 Select the type of event to display from the Event Class drop-down. Step 4 Type the Start Sequence number and the number of Events to display Step 5 Click Go to view Events. Page 41 of 90

42 17. BIOS Level RAID Utility RAID Controller Event Log File (continued) 17.3 Error Event Log Levels Event Type Progress Information Warning Critical Fatal Dead Conditions, Information, Actions Required This is a progress posting event -- progress events are not saved in NVRAM Informational message no user action is necessary A component may be close to a failure point A component has failed, but the system has not lost data A component has failed and data loss has occurred or will occur. A catastrophic error has occurred and the controller has failed. This is seen only after the controller has been restarted. Page 42 of 90

43 18. RAID Priorities The following list shows RAID adapter priorities, with the highest priority listed first: 8 hot-swappable disk drives in slots 0 to 7 in the front panel of the SIEM non-hot-swappable disk drives pre-installed in the drive tray of the SIEM 9750 Adapter numbers are assigned in the following order: ao 8 hot-swappable disk drives in slots 0 to 7 in the front panel of the SIEM 9750 a1 2 non-hot-swappable disk drives pre-installed in the drive tray of the SIEM 9750 Page 43 of 90

44 19. Cooling Sub-System 19.1 Overview Several components and configuration requirements make up the cooling sub-system of the server system. These include the system fan module, the power supply fans, air baffles, CPU air duct, and drive bay population. All are necessary to provide and regulate the airflow and air pressure needed to maintain the system s thermals when operating at or below maximum specified thermal limits.(from Intel sr2625_tps.pdf) The SIEM 9750 is equipped with the optional redundant cooling fan solution. This cooling option utilizes two fan types: (2) 60-mm variable-speed fans (4) 80-mm variable- speed fans. The system uses a variable fan speed control engine to provide adequate cooling for the system at various ambient temperature conditions, under various server workloads, and with the least amount of acoustic noise possible. To minimize acoustics, the fans operate at the lowest speed for any given condition. (from Intel sr2625_tps.pdf) Page 44 of 90

45 19. Cooling Sub-System (continued) 19.2 Fan Numbering Redundant Cooling Fans and their numbering are shown below as connected to the Active Midplane. NOTE: Make careful note of the numbering of fans 5 and 6 compared to fans 1-4. NOTE: If a single fan fails, then a Fan Kit will be used to replace that entire row of 3 fans. A Green LED indicates normal operation. A Red LED indicates a fan problem Fan Details The Integrated Baseboard Management Controller (Integrated BMC) on the Intel Server Board S5520UR is used for the variable fan speed control function. The Integrated BMC monitors selective component temperatures, the ambient temperature, and each fan s RPM to determine the necessary airflow. The Integrated BMC sets the fan speeds to the appropriate RPM to maintain proper cooling. The Integrated BMC also logs errors into the System Event Log (SEL) when temperature sensors exceed their safe operating ranges, or if any of the fans fail to operate at safe airflow speeds. Page 45 of 90

46 19. Cooling Sub-System (continued) If a fan fails, the Integrated BMC boosts the remaining fans to compensate for the lost airflow. A system with redundant fans can continue to operate in this degraded condition while the non-redundant system may not. If the cooling is not sufficient under a failed fan condition, the system eventually shuts down to protect its primary components from thermal damage. Additionally, this fan boost causes additional vibration in this system. Some hard drives are very susceptible to vibration. (From Intel sr2625_tps.pdf) 19.4 Table: Fan Cooling Zones Each fan is responsible for cooling a specific zone of the system. If the components in the zone begin to exceed a safe operating temperature as programmed by the SDR, the Integrated BMC firmware increases the speed for the fans tied to that zone. Page 46 of 90

47 19. Cooling Sub-System (continued) 19.5 Steps to Troubleshoot a Failed Fan See Prerequistites in Section 4 of this document. Step 1 Open the cover on the Server and look at the fan modules. Each fan will have a status LED illuminated when failed. What color is the LED? Green is normal. Red indicates a fault. Step 2 Check System Status LED on the local control panel for a solid or blinking amber LED. Step 3 Check the Intel System Event Log (SEL) for a fan or temperature entry into the log. Step 4 Listen for an increase in system fan noise to indicate higher RPMS. Step 5 Login to the system remotely to check hardware events. Step 6 Verify that the fan in question is fully seated. Secure any loose connections. Step 7 Check that the fan connection to the Active Midplane is secure. See picture above for Fan and corresponding connection port on the backplane Other Reason for System Temperature Issues (in case of no Cooling Fan Failure) Chassis cover is not installed properly. Power Supply Fan has Failed Clear Plastic Air Baffle is not properly installed CPU Heatsinks are not properly installed DIMM blanks are not installed in the appropriate DIMM slots Page 47 of 90

48 20. FRU 2U Base Chassis Server Board 20.1 Server Board Components The Server Board installed is an Intel model # s5520ur. Components of the server board are located below. Page 48 of 90

49 20. FRU 2U Base Chassis Server Board (continued) 20.2 Back Panel Feature Overview Page 49 of 90

50 20. FRU 2U Base Chassis Server Board (continued) 20.3 Configuration Jumpers of the Server Board Page 50 of 90

51 20. FRU 2U Base Chassis Server Board (continued) Page 51 of 90

52 21. Memory 21.1 Overview The SIEM 9750 will have 8 memory DIMMs installed. The Spec on each DIMM is: 2GB, DDR3-1333, Registered, ECC, Dual Rank The slot numbering on the Server Board is displayed below: Page 52 of 90

53 21. Memory (continued) The LED will light up for its corresponding faulty DIMM in the event of a failure Symptoms of a Faulty DIMM Module System Status LED on front control panel will be lit Amber System Event Log (SEL) will have an entry for faulty DIMM Server Board will illuminate an LED next to faulty DIMM BIOS POST will display an error message and change (lower) in the amount of memory in the system. Possible Causes: One or more DIMMs are faulty One or more DIMM slots are faulty NOTE: When replacing Memory DIMMs, it is not necessary to enter the BIOS and perform a Memory Retest as in some platforms. Memory Retest is not an option in the BIOS of this Server Board. Page 53 of 90

54 22. Processers (CPUs) The SIEM 9750 is equipped with (2) XEON Quad Core 2.66GHZ CPUs. Single Processor with Heatsink installed NOTE: There is not an option called Processor Retest in the BIOS of this Server Board. Indications that a CPU may be faulty System status LED will turn Amber. An entry (CPU Failure) in the System Event Log will be recorded. No System POST at all or visible error at POST on Monitor. POST Code LEDs will signal CPU problem. System Beep Codes of Page 54 of 90

55 23. Intel Remote Management Module 3 - Overview 23.1 Overview The Intel RMM3 is a 1.23-inch x 2.30-inch printed circuit board. When installed onto the Intel RMM3 connector on Intel server boards, it provides an increased level of manageability over the basic server management available to the server board. It works as an integrated solution on your server system Intel RMM3 Features The Intel RMM3 add-on card offers convenient, remote KVM access and control via LAN or Internet. It captures, digitizes, and compresses video and transmits it with keyboard and mouse signals to and from a remote computer. Remote access and control software runs in the integrated Baseboard Management Controller, utilizing expanded capabilities provided by the Intel RMM3 hardware. In addition, the Intel RMM3 add-on card offers integrated remote power management using IPMI. Page 55 of 90

56 23. Intel Remote Management Module 3 - Overview (continued) Key features of the Intel RMM3 add-on card Embedded Web Console UI supports Remote Power on\off, system health, system info, Event log. KVM redirection via either the RMM3 NIC or the baseboard NIC used for management traffic; high performance, up to two simultaneous KVM sessions USB 2.0 media redirection - boot over remote media Security open SSL, open LDAP OEM Customization of the Web Console. IPMI V2.0 Compliance KVM - Automatically senses video resolution for best possible screen capture, high performance mouse tracking and synchronization. It allows remote viewing and configuration in pre-boot POST and BIOS setup 23.3 Client System The following client operating system and Internet browser combinations have been tested: SuSE* 10.2/Firefox* Page 56 of 90

57 24. Intel Remote Management Module 3 Viewing Field Replaceable Unit (FRU) Information 24.1 Viewing Field Replaceable Unit (FRU) Information The FRU Information page displays information from the FRU (Field Replaceable Unit) repository of the host system. Page 57 of 90

58 24. Intel Remote Management Module 3 - Viewing Field Replaceable Unit (FRU) Information (continued) 24.2 Server Health The Server Health page shows you data related to the server's health, such as sensor readings and the event log. Click on the Server Health Tab to display the page. Page 58 of 90

59 24. Intel Remote Management Module 3 - Viewing Field Replaceable Unit (FRU) Information (continued) 24.3 Viewing Event Log Page 59 of 90

60 Page 60 of 90

61 24. Intel Remote Management Module 3 - Viewing Field Replaceable Unit (FRU) Information (continued) 24.4 Remote Control (Power Control) Options Option Task Reset Server Power OFF Server Power ON Server Power Cycle Server Perform Action button Select option to hard reset the host without powering off. Select option to. immediately power off the host Select option to power on the host Select option to immediately power off the host, then power it back on after one second Click to execute the selected remote power command Page 61 of 90

62 25. Active Midplane This section will include information on the following: Active Midplane LI-ION Battery Module Mini DIMM memory Raid Activation Key 25.1 Active Midplane The Active Midplane 2 or FALSASMP2 is a SAS/SATA controller that includes a RAID activation key, memory and Li-Ion battery all installed on the board. Because the Active Midplane serves as a RAID controller, it can be considered as a point of failure for the RAID 5 subsystem on the SIEM Page 62 of 90

63 25. Active Midplane (continued) 25.2 Li-ION The Li-ION Battery Module is used to supply power to the active midplane (RAID controller) in the event of a power failure. This will prevent the loss of cached data during a write operation. NOTE: The Battery Status is displayed at POST Intel RAID Cache Support Mini DIMM Memory To further enable support for hardware RAID, the active midplane provides a 244-pin mini-dimm connector (J8C1), supporting a single registered ECC non-parity DDR2-400 MHz Mini-DIMM to provide Intel RAID cache. Supported mini-dimm capacities range from 128 MB to 1 GB RAID Activation Key The Intel RAID Activation Key enables the full intelligent SAS Hardware RAID solution. The activation key plugs directly into a connector (J1A10) on the midplane board. With no RAID activation key installed, only SAS Software RAID levels 0, 1, and 10 are supported. Page 63 of 90

64 26. SAS / SATA Backplane Layout SAS / SATA Backplane Layout The hot-swap backplane installs on the back side of the hot-swap drive bay inside the system. Alignment features on the system and backplane assembly make for easy tool-less installation. For instructions on installing and removing the backplane, see the Intel Server System SR2600UR/SR2625UR Service Guide. The following diagram shows the layout of components and connections found on the board. Page 64 of 90

65 28. Server Diagnostics and Troubleshooting 28.1 Intel System Event Log (SEL) The System Event Log (SEL) is a valuable tool for troubleshooting the SIEM It will likely be the primary source of information when troubleshooting the system during a hardware failure. The reason for this is that the System Status LED, when Amber, will record the explanation of why it is lit within the SEL log. System Events can be accessed through multiple utilities on the On a system whereby the Operating System is still intact, System Events can be accessed through the SIEM 9750 Shell Menu software utility that uses a CLI. The Intel Remote Management Module. The picture below shows the Server Health Menu with the Event Log selection available on the left side of the window: The BIOS level SEL Viewer Utility. This version of the SEL Viewer utility runs on the target servers in the Extensible Firmware Interface (EFI) v1.1 and v2.0 shell. This utility is useful when the Operating System is no longer intact. Page 65 of 90

66 [Source: Intel SEL Viewer User Guide] Page 66 of 90

67 27. Server Diagnostics and Troubleshooting (continued) 27.2 Run the SEL Viewer in the EFI Shell The SEL Viewer utility runs on the target servers in the Extensible Firmware Interface (EFI) v1.1 or v2.0 shell depending on the platform: Download the SEL Viewer from the following location Step 1 Extract the file preferably to a USB pen. Step 2 Connect the device ( e.g. USB pen) with the extracted SEL Viewer utility to the server you wish to extract the SEL from. Step 3 Power on the server and press F6 to enter the boot device selection menu. Step 4 Choose the EFI shell option and hit enter. Step 5 Once in the EFI Shell, change drive station to the USB pen by typing fs0: (0 is usually the USB pen) followed by enter. Step 6 If this does not work, remap the USB pen drive by using the command map r, then changing to the drive station accordingly Step 7 Open the folder containing the SEL Viewer by typing: cd: <foldername> followed by enter Step 8 Browser to the directory containing the SEL Viewer and execute the file selview.efi (From Intel SEL Viewer Guide) Page 67 of 90

68 27. Server Diagnostics and Troubleshooting (continued) This is the SEL Viewer Utility (SEL Log). The interpreted data is displayed in several columns as follows: Num - Serial number of the system events being displayed; starting with 1, and increasing by one for each event Time Stamp Sensor Type, Name and Number Event Description Generator ID [Source: Intel] Within the File menu there is an option called Save As. Use this option to save the current SEL log file to the USB drive. You can choose any name that you want to save this text file, such as SEL.TXT. If help is needed reading and interpreting the contents of the file then the.txt file to Support. Page 68 of 90

69 28. POST Code Diagnostic LED Decoder During the system boot process, the BIOS executes a number of platform configuration processes, each of which is assigned a specific hex POST code number. As each configuration routine is started, the BIOS displays the POST code to the POST Code Diagnostic LEDs on the back edge of the server board. To assist in troubleshooting a system hang during the POST process, the Diagnostic LEDs can be used to identify the last POST process that was executed. Each POST code is represented by the eight amber diagnostic LEDs. The POST codes are divided into two nibbles an upper nibble and a lower nibble. The upper nibble bits are represented by diagnostic LEDs #4, #5, #6, and #7. The lower nibble bits are represented by diagnostic LEDs #0, #1, #2, and #3. If the bit is set in the upper and lower nibbles, then the corresponding LED is lit. IF the bit is clear, then the corresponding LED is off. The diagnostic LED #7 is labeled as MSB, and the diagnostic LED #0 is labeled as LSB. The System Status LED (the triangle symbol on the front control panel) is also displayed on the back of the Server machine. (A) Page 69 of 90

70 28. POST Code Diagnostic LED Decoder (continued) The LED on the far right is numbered #0. The LED on the far left is # 7. LED #7 LED #0 Back edge of Server Board Page 70 of 90

71 29. All Possible LED Codes These codes are helpful to read when the SIEM 9750 will not boot up. Check the LED codes when the system has stopped booting. The description of the code will be a good starting place for suspect hardware/firmware issues. During a normal power on and POST process, the LEDs will appear to flash semi-randomly as the state changes and each of the tests are performed. If the system completes the BIOS POST process normally, without any hardware failures, and is ready to pass control to the operating system, then all of the LEDs should be OFF. All LEDs OFF indicates that the BIOS has attempted to pass control to the operating system. If the system has all LEDs OFF and still does not boot to the operating system, then troubleshooting should continue by looking at the boot order in the BIOS and/or the boot image on the boot media. Page 71 of 90

72 29. All Possible LED Codes (continued) Page 72 of 90

73 29. All Possible LED Codes (continued) Page 73 of 90

74 29. All Possible LED Codes (continued) Page 74 of 90

75 29. All Possible LED Codes (continued) Page 75 of 90

76 30. Video POST Code Errors Whenever possible, the BIOS outputs the current boot progress codes on the video screen. Progress codes are 32-bit quantities plus optional data. The 32-bit numbers include class, subclass, and operation information. The class and subclass fields point to the type of hardware that is being initialized. The operation field represents the specific initialization activity. Based on the data bit availability to display progress codes, a progress code can be customized to fit the data width. The higher the data bit, the higher the granularity of information that can be sent on the progress port. The progress codes may be reported by the system BIOS or option ROMs Video POST Code Error Types The Response section in the following table is divided into three types: Error Type No Pause Pause Halt Symptom(s) and Required Action(s) On the screen during POST or the Error Manager screen The system continues booting with a degraded state. The user may want to replace the erroneous unit. The setup POST error Pause setting does not have any effect with this error. On the Error Manager screen and an error is logged to the SEL The setup POST error Pause setting determines whether the system pauses to the Error Manager for this type of error, where the user can take immediate corrective action or choose to continue booting. On the Error Manager screen, an error is logged to the SEL, and the system cannot boot unless the error is resolved The user needs to replace the faulty part and restart the system. The setup POST error Pause setting does not have any effect with this error. Page 76 of 90

77 30. Video POST Code Errors (continued) 30.2 Table: POST Error Messages and Handling Page 77 of 90

78 30. Video POST Code Errors (continued) Page 78 of 90

79 30. Video POST Code Errors (continued) Page 79 of 90

80 30. Video POST Code Errors (continued) Page 80 of 90

81 31. POST Error Beep Codes The following table lists the POST error beep codes possible to have when the system has trouble booting. Prior to system video initialization, the BIOS uses these beep codes to inform users on error conditions. The beep code is followed by a user-visible code on the POST Progress LEDs (LEDs on the back of the Server Board). This is also a good troubleshooting tool to use when the system is not giving video upon bootup. Here are the beep codes: The Integrated BMC may generate beep codes upon detection of failure conditions. Beep codes are sounded each time the problem is discovered, such as on each power-up attempt, but are not sounded continuously. Codes that are common across all Intel server boards and systems that use same generation chipset are listed in the following table. Each digit in the code is represented by a sequence of beeps whose count is equal to the digit. NOTE: All power control actions are done through the BMC and are immediate actions. It is suggested to gracefully shut down the operating system via the KVM interface or other interface before initiating power actions. Page 81 of 90

82 32. List of Acronyms BBU BIOS BMC CLI CPU DAS DIMM ESD FRU FRUSDR HBA HDD JBOD LED PCI PCIe PSU POST RAID RAM RMM SAS SATA SCSI SEL SFP Battery Backup Unit Basic Input/Output System Baseboard Management Controller Command Line Interface Central Processing Unit Direct Attached Storage Dual In-line Memory Module Electrostatic discharge Field Replaceable Unit Field Replaceable Unit/Sensor Data Record Host Bus Adapter Hard Disk Drive Just a Box Of Disks or Just a Bunch of Drives Light Emitting Diode(s) Peripheral Component Interconnect PCI Express Power Supply Unit Power On Self Test Redundant Array of Independent Disks Random Access Memory Remote Management Module Serial Attached SCSI Serial ATA Small Computer System Interface System Event Log Small Form-Factor Pluggable Page 82 of 90

83 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) 33.1 Introduction The Intel Server Board Platform Confidence Test package provides a method to determine if an Intelbased server system is correctly assembled and functioning properly. The package provides three test suites for the onboard resources. The test suites included in the package are: Quick Test Comprehensive Test, Continuous loop of the Comprehensive Test These tests can be run without user intervention. At the start of each test, the Platform Confidence Test package probes for the hardware present and reports the identified components. The probe will indirectly identify many assembly and cabling errors, such as broken or improperly seated cables, because the associated hardware component will not be located. Test results are reported directly to field replaceable units (FRUs), such as the installed processor modules, the server board, disks, and memory. Upon completion of the test, the test results are saved to the RESULT.LOG for viewing Installing the Server Board Platform Confidence Test Package The Platform Confidence Test program files are available on the software CD that accompanies the server board. Updates to this manual can be downloaded from the Intel support website at: Page 83 of 90

84 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) (continued) WARNING: Each Intel server board has a Platform Confidence Test package specific to that board. Do not attempt to run the wrong Platform Confidence Test package on your server board.running the wrong set of tests could cause unreliable results and may damage components on the server board. Step 1 Insert the Deployment Assistant CD/Resource CD into a Windows* based system, and allow the autorun feature launch the graphical user interface. If autorun does not launch the GUI, launch it manually by double clicking on your CD-ROM drive. Step 2 On the top menu, under Tools for Setup and Configuration, choose PCT.zip file with EFI Utilities. Step 3 Download and extract the files from the zip file to a USB thumb drive. Step 4 Insert the USB drive that you created in Step 3 into the server you want to test. Step 5 Power on the server and allow the system to boot the EFI Shell. Step 6 When the EFI Shell has booted, you will be presented with a menu of five options: Quick Test Comprehensive Test Comprehensive Test with continuous looping Display Help Text Exit These menu options will be discussed in greater detail. Page 84 of 90

85 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) (continued) 33.3 Summary of Available Tests Quick Tests The quick test suite runs a small subset of available tests. This suite identifies the processor type, speed, and the number of processors present. It also identifies the base and total memory sizes and external L2 cache size.when running the quick test, verify that the configuration that is displayed following the probe includes all of the hard disks, memory, and processors that are installed in the system. If the configuration does not identify all of these items, exit by pressing CTRL+BREAK or F10 and review the troubleshooting section later in this document. The quick test duration is dependent upon the number of processors and the amount of memory installed. With a 3.0GHz processor and 1 GB of memory the quick test will run to completion in about 2 minutes. Additional memory will cause the test to take longer. On completion of the test and after the test results are displayed, the program returns to the main menu Comprehensive Tests The comprehensive test probes for the same items as the Quick Test, but in greater depth. In addition, it identifies the keyboard and mouse, the COM1 and COM2 ports, the LPT port, the floppy drive, and the onboard video controller with its memory. The system will identify drives attached to any SAS/SATA/SCSI controllers in the system, not just the onboard controller. When running the comprehensive test, verify that the configuration that is displayed following the probe includes all of the hard disks, memory, and processors that are installed in the system. If the configuration does not identify all of these items, exit by pressing CTRL+BREAK or F10 and review the troubleshooting section later in this document. Page 85 of 90

86 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) (continued) An example of a comprehensive test configuration is shown below in the Using the Intel Server Board Platform Confidence Test section. The tests executed are a superset of the quick tests. The processor floating point unit (FPU) is tested and more extensive tests are run on the memory and cache. Extensive tests are also run on the onboard peripheral controllers, integrated components, and the chipset. The comprehensive test duration is dependent upon the number of processors and the amount of memory installed. With a 3.0GHz processor and 1 GB of memory the comprehensive test will run to completion in about 5 minutes. Additional memory will cause the test to take longer. The video tests drive the monitor using what appears as random test patterns. On completion of the test and after the test results are displayed, the program returns to the main menu Comprehensive Test with Continuous Looping The comprehensive test with continuous looping is identical to the comprehensive test, but it continuously loops through the tests until the user presses CTRL+BREAK or F10. This mode of operation will help to identify intermittent failures in a Field Replaceable Unit. When the test is halted, the normal comprehensive test result summary is displayed, but the status reflects the sum of all tests. Therefore, if a test failed one or more times during the run, it will be reported as failing. The number of times the test cycle was repeated is displayed in the result summary screen. Page 86 of 90

87 33. Intel Server Board Platform Confidence Test (Installation and Operating Instructions) (continued) 33.4 Using the Intel Server Board Platform Confidence Test Step 1 To begin the Platform Confidence Tests boot the server from the bootable media described above. The system displays the menu below: Step 2 Selecting the option Display Help Text results in a display of the help text file for the test options. Selecting EXIT saves the test results in a RESULT.LOG file and returns you to the DOS prompt. Typing testmenu at the prompt will restart the menu system. Select the test desired with the cursor and press <ENTER>. If the system under test is not supported by the Platform Confidence Test package being used, the following message is displayed: This motherboard is not supported by this Platform Confidence Test. Press any key to exit. Page 87 of 90