HPE Integrity MC990 X Server Getting Started Guide

HPE Integrity MC990 X Server Getting Started Guide Abstract This guide describes the HPE Integrity MC990 X Server computer system and provides information to get started using it. Part Number: 855699-003 Published: March 2018 Edition: 2

Contents HPE Integrity MC990 X Server overview... 4 MC990 X server chassis... 4 System components...5 Unit numbering...8 Rack numbering... 8 HPE Integrity MC990 X system features... 8 Distributed shared memory (DSM)...8 Distributed shared I/O... 9 Rack management controller... 9 Reliability, availability, and serviceability... 10 HPE Integrity MC990 X system specifications... 11 Integrity MC990 X system specifications...11 Integrity MC990 X system physical specifications...11 Integrity MC990 X system environmental specifications...12 Integrity MC990 X system electrical specifications... 13 Warranty and regulatory information...15 Warranty information...15 Regulatory information...15 Belarus Kazakhstan Russia marking... 15 Turkey RoHS material content declaration...17 Ukraine RoHS material content declaration... 17 2 Contents

Copyright 2016-2018 Hewlett Packard Enterprise Development LP Notices The information contained herein is subject to change without notice. The only warranties for Hewlett Packard Enterprise products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. Hewlett Packard Enterprise shall not be liable for technical or editorial errors or omissions contained herein. Confidential computer software. Valid license from Hewlett Packard Enterprise required for possession, use, or copying. Consistent with FAR 12.211 and 12.212, Commercial Computer Software, Computer Software Documentation, and Technical Data for Commercial Items are licensed to the U.S. Government under vendor's standard commercial license. Links to third-party websites take you outside the Hewlett Packard Enterprise website. Hewlett Packard Enterprise has no control over and is not responsible for information outside the Hewlett Packard Enterprise website. Acknowledgments Intel, Itanium, Pentium, Intel Inside, and the Intel Inside logo are trademarks of Intel Corporation in the United States and other countries. Microsoft and Windows are either registered trademarks or trademarks of Microsoft Corporation in the United States and/or other countries. Adobe and Acrobat are trademarks of Adobe Systems Incorporated. Java and Oracle are registered trademarks of Oracle and/or its affiliates. UNIX is a registered trademark of The Open Group.

HPE Integrity MC990 X Server overview This chapter provides an overview of the physical and architectural aspects of the HPE Integrity MC990 X system. The major components of the Integrity MC990 X system are described and illustrated. The Integrity MC990 X system is an advanced symmetric multiprocessing (SMP) computer system with multiple Intel processor sockets as a cache-coherent single system image (SSI). Each processor socket in the system houses multiple compute cores. In an SMP system, each MC990 X chassis contains memory that it shares with all other processors in the system. Because the Integrity MC990 X system is modular, it combines the advantages of lower entrylevel cost with global scalability in processors, memory, and I/O. You can install and operate the Integrity MC990 X system in your lab or server room. One 42U rack holds one or more MC990 X chassis, the rack management controller (RMC) unit, power distribution units (PDU), and optional mass storage units. MC990 X server chassis The basic enclosure within the Integrity MC990 X system is the MC990 X server chassis. The MC990 X server chassis contains one four-socket motherboard connected to support up to 28 NUMAlink ports, each with a maximum bidirectional bandwidth communication rate of up to 7.47 GB/sec. Each MC990 X server chassis has ports that are brought out to external NUMAlink connectors on the front of the enclosure. The single rack houses up to eight MC990 X server chassis (making up the MC990 X server), an RMC unit, and optional external storage. Figure 1: MC990 X server chassis on page 4 shows an example of an MC990 X server chassis prior to mounting in a rack. The system requires a minimum of one rack with enough PDUs to support as many as eight MC990 X server chassis, one RMC, and any optional equipment installed in the rack. You can also add PCIe expansion cards or RAID and non-raid disk storage to your server system. 1. System drive assembly 2. NUMAlink connectors (28) Figure 1: MC990 X server chassis 4 HPE Integrity MC990 X Server overview

System components The Integrity MC990 X system includes the following major components: 42U rack These racks are used for the MC990 X enclosures, RMC, and optional external storage in the Integrity MC990 X system. Up to eight MC990 X enclosures can be installed in each 42U rack. Server chassis The Integrity MC990 X system includes one base server chassis and can include one or more expansion server chassis. Each 5U-high server chassis contains four power supplies, one four-processor compute/memory board, and other optional riser enabled drives and boards for the Integrity MC990 X system. The base server chassis also has a BaseIO riser not present in the expansion server chassis. MC990 X base server chassis front components shows the MC990 X server chassis front panel components. 1. USB ports (4) 2. ETH0 3. DVD drive 4. System drive assembly 5. RMC 6. MGMT 7. Serial port 8. VGA port 9. Optional 1.8-inch SSD drive bays 10. NUMAlink ports (28) Figure 2: MC990 X base server chassis front components System components 5

1 6 5 4 3 2 1. PCIe card slots (16) 2. RMC port 3. MGMT port 4. Serial port 5. VGA port 6. NUMAlink ports (28) Figure 3: MC990 X expansion server chassis front components Motherboard Holds four processor sockets and eight memory risers. Each memory riser has up to 12 DIMMs, for a maximum of 96 DIMMs per motherboard. Each motherboard can be ordered with risers that enable the base MC990 X server chassis to support up to four full-height x16 PCIe cards and up to eight full-height x8 PCIe cards. Drives Each MC990 X base server chassis has a drive tray that supports one optional slim-line SATA DVD drive and four 2.5-inch hard disk or solid-state drives. An MC990 X expansion server chassis does not require a drive assembly and can accommodate four additional PCIe cards. Internal PCIe enabled slots The MC990 X enclosure and motherboard support the following types of PCIe option boards: Four full-height, half-length, Gen3 x8 PCIe slots Four full-height, 10.5-inch length, Gen3 x8 PCIe slots Four full-height, doublewide, 10.5-inch length, Gen3 x16 PCIe slots NOTE: The x16 PCIe slots support cards with a maximum power consumption of 300 watts. NUMAlink Connectors The external NUMAlink connectors are on the lower-front portion of each MC990 X enclosure. 6 HPE Integrity MC990 X Server overview

BaseIO board Optional I/O riser board, connected directly to the motherboard. Supports base system I/O functions including one Gbit Ethernet connector (top), four USB ports, and bays for two optional external 1.8-inch solid-state drives (SSDs). Internally, the BaseIO board supports: Four internal 3GB/s SATA ports (for the four 2.5-inch disk drives in the MC990 X server chassis) Two internal 6GB/s SATA ports (for the two optional mini 1.8-inch SSDs) One internal USB 2.0 port (for the internal DVD) NOTE: Each Integrity MC990 X system (or SSI within a system) requires one BaseIO board. BaseIO board front panel components shows the front components of the BaseIO board. The SSD drives (bottom) are enclosed with a metal cover. 1. Ethernet port 2. USB ports (4) 3. Solid-state Drives (2) Figure 4: BaseIO board front panel components RMC---This 1U-high rack management controller provides external LAN and USB connections into the Integrity MC990 X system. It acts as a top layer of system control. An internal 24-port Ethernet switch allows system control for up to multiple MC990 X enclosures in an expanded Integrity MC990 X system. HPE Integrity MC990 X Server overview 7

1. Network ports (24) 2. WAN port 3. AUX port 4. CNSL port 5. RST button 6. PG (Power Good) LED indicator 7. HB (Heart Beat) LED indicator Figure 5: RMC front panel connections Unit numbering Bays in the racks are numbered using standard units. A standard unit (U) is equal to 1.75 inches (4.445 cm). Because the chassis occupy multiple units, locations within a rack are identified by the bottom unit (U) in which the chassis resides. For example, in a 42U rack, an MC990 X server chassis positioned in U01 through U05 is identified as U01. Rack numbering Each rack is numbered with a three-digit number sequentially beginning with 001. A rack contains one or more MC990 X server chassis, one RMC, optional mass storage enclosures, and other optional components. In a single rack system, the rack number is always 001. HPE Integrity MC990 X system features The HPE Integrity MC990 X server is a modular system. The compute, memory, and PCIe components are housed in the MC990 X chassis. Additional optional mass storage may be added to the system along with additional MC990 X chassis. You can add different types of PCIe board options to a server to achieve the desired system configuration. You can easily configure systems around processing capability, I/O capability, memory size, or storage capacity. Each air-cooled MC990 X chassis has redundant, hot-swap fans and redundant, hotswap power supplies. Distributed shared memory (DSM) In the Integrity MC990 X system, memory is physically distributed both within and among the MC990 X server chassis (compute/memory/i/o); however, it is accessible to and shared by all NUMAlinked devices within the SSI. This means all NUMAlinked components sharing a single Linux operating system operate and share the memory fabric of the system. Memory latency is the amount of time required for a processor to retrieve data from memory. Memory latency is lowest when a processor accesses local memory. Note the following subtypes of memory within a system: 8 Unit numbering

If a processor accesses memory that it is connected to on an MC990 X server chassis motherboard, the memory is referred to as the processor local memory. Figure 6: MC990 X server chassis memory riser block diagram on page 9 shows a conceptual block diagram of the motherboard memory riser board pathways. If processors access memory located in another NUMAlinked MC990 X server chassis motherboard within the system, the memory is referred to as remote memory. The total memory within the NUMAlinked Integrity MC990 X system is referred to as global memory. Physical memory riser Physical memory nodes are memory risers and each is made up of two board assemblies: memory riser board and power board. Eight memory riser assemblies plug into each MC990 X server chassis motherboard. The memory riser power board receives power directly from the motherboard. A maximum of 12 DDR4 memory DIMMs are supported in each memory riser. Memory controller Figure 6: MC990 X server chassis memory riser block diagram Distributed shared I/O Like DSM, I/O devices are distributed within the MC990 X server chassis. Each BaseIO riser is accessible by all compute nodes within the SSI through the NUMAlink interconnect fabric. Rack management controller Each Integrity MC990 X system has a rack management controller (RMC) located directly above or below the MC990 X server chassis in a rack. The RMC supports powering up and down of the system motherboards and environmental monitoring of all Integrity MC990 X system units within the SSI. In addition, the RMC provides the top layer of system control for Integrity MC990 X system. Through the use of an internal 24-port Ethernet switch, a single RMC can provide system control for multiple MC990 X server chassis in an expanded Integrity MC990 X system. One GigE port from each MC990 X server chassis motherboard connects to the RMC via Cat-5 cable. Physical memory riser 9

Reliability, availability, and serviceability HPE Integrity MC990 X system components have the following features to increase the reliability, availability, and serviceability (RAS) of the systems. Power and cooling: MC990 X server chassis power supplies are redundant and can be hot-swapped. MC990 X server chassis have overcurrent protection at the motherboard and power supply level. MC990 X server chassis fans are redundant and can be hot-swapped. MC990 X server chassis fans run at multiple speeds. Speed increases automatically when temperature increases or when a single fan fails. System monitoring: System controllers monitor the internal power and temperature of the MC990 X server chassis components, and can automatically shut down an enclosure to prevent overheating. All main memory has Intel Single Device Data Correction to detect and correct 8 contiguous bits failing in a memory device. Additionally, the main memory can detect and correct any two-bit errors coming from two memory devices (8 bits or more apart). All high speed links including Intel Quick Path Interconnect (QPI), Intel Scalable Memory Interconnect (SMI), and PCIe have cyclic redundancy check (CRC) check and retry. The NUMAlink interconnect network is protected by CRC. Each MC990 X server chassis installed has status LEDs that indicate the server operational condition; LEDs are viewable at the front of the unit. Power-on and boot: Automatic testing occurs after you power on the system. These power-on self-tests or POSTs are also referred to as power-on diagnostics or PODs. Processors and memory are automatically disabled when a self-test failure occurs. Boot times are minimized. Further RAS features: Systems can report status inventory information, provide hardware logs of out-of-range conditions, or perform recovery procedures through remote commands. All system faults are logged in files. Memory can be scrubbed using error checking code (ECC) when a single-bit error occurs. 10 Reliability, availability, and serviceability

HPE Integrity MC990 X system specifications Integrity MC990 X system specifications Integrity MC990 X system configuration ranges summarizes the Integrity MC990 X system configuration ranges. While each MC990 X server chassis motherboard houses four processor sockets, each processor holds multiple processor cores. The number of cores supported will change based on customer selection and processor availability. Table 1: Integrity MC990 X system configuration ranges Category Minimum Maximum Processors per server chassis 4 processors (1 motherboard) 1 4 processors Cores per Processor 4 24 Server chassis 1 per system 8 per system Motherboards 1 per server 1 per server Memory risers on motherboard 8 per motherboard 8 per motherboard Motherboard DIMM capacity 32 DIMMs per board 96 DIMMs per board Memory capacity per DIMM 8GB 64 GB RMC units 1 per system 1 per system Number of BaseIO riser boards One per SSI One per SSI 1 The quad-socket MC990 X server chassis motherboard supports four processors using multiprocessor cores. Integrity MC990 X system physical specifications MC990 X server chassis and 42U rack physical specifications shows the physical specifications of the rack-mounted Integrity MC990 X system. Table 2: MC990 X server chassis and 42U rack physical specifications Feature Dimensions for single MC990 X server chassis Weight of single MC990 X server chassis (fully configured) Specification Height: 5U 8.64 inches (22 cm) Width: 17.5 inches (44.5 cm) Depth: 31.8 inches (80.8 cm) 136 lb. (62 kg) Table Continued HPE Integrity MC990 X system specifications 11

Feature Dimensions for a single 24-inch wide 42U rack, including doors and side panels Shipping dimensions (single rack) Single rack shipping weight (max) Single rack system weight installed (max) 42U rack access requirements: Specification Height: 78.75 in. (200 cm) Width: 28 in. (70.1 cm) Depth: 45.5 in. (115.6 cm) Height: 88.8 in. (225.8 cm) Width: 44 in. (111.8 cm) Depth: 62.75 in. (159.4 cm) 2,070 lb. (939 kg) air cooled (approximate) 1,579 lb. (716 kg) air cooled (approximate) *Empty rack weight is approximately 391 lb. (177 kg) Front: 48 in. (121.9 cm) Rear: 48 in. (121.9 cm) Top: 18 in. (45.7 cm) Integrity MC990 X system environmental specifications Environmental specifications lists the environmental specifications of the Integrity MC990 X system. Table 3: Environmental specifications Feature Temperature tolerance (operating) Temperature tolerance (nonoperating) Relative humidity Heat dissipation to air Cooling requirement Single chassis air-flow: intake (front), exhaust (rear) Specification +5 C (41 F) to +35 C (95 F) (up to 1500 m / 5000 ft.) +5 C (41 F) to +30 C (86 F) (1500 m to 3000 m /5000 ft. to 10,000 ft.) De-rate max ambient temperature by 1.8 F (1 C) per 1000 ft. (305 m) of altitude above 5000 ft. (1525 m) -40 C (-40 F) to +60 C (140 F) 20% to 80% operating (no condensation) 8% to 80% non-operating (no condensation) Approximately 17.74 kbtu/hr (1.48 tons) Ambient air or optional water cooling 650 CFM Max (1104 m3/hr) 475 CFM typical (407 m3/hr) Table Continued 12 Integrity MC990 X system environmental specifications

Feature Maximum altitude Acoustic sound pressure Specification 10,000 ft. (3,049 m) operating 40,000 ft. (12,195 m) non-operating Approximately 77 dba (at rear of rack) Integrity MC990 X system electrical specifications MC990 X system electrical specifications shows the power specifications for the MC990 X system. Table 4: MC990 X system electrical specifications Feature Server chassis power supply (4 per chassis) Server chassis power cords Specification 12-Volt, 1600 Watt (Platinum) [200-240 VAC] Four 8-ft (2.4 m) drop cables Server chassis power requirements Voltage Frequency Power (maximum per MC990 X server chassis) Hold-up time 200-240V (180-264 VAC min/max) 50-60 Hz (47-63 Hz min/max) 5.33 kva (5.22kW) per chassis 10 ms Single-phase PDU power requirements Voltage Frequency 180-264 VAC 50-60 Hz Three-phase PDU power requirements Voltage Frequency Total harmonic distortion 180-264 VAC (North America) 312-457 VAC (International) 50-60 Hz Less than 10% at full load The Integrity MC990 X system RMC power and technical specifications are provided in RMC specifications. Integrity MC990 X system electrical specifications 13

Table 5: RMC specifications Feature Height Width Depth Weight RMC power supply RMC power cords Specification 1.72 inches (44 mm) 17.2 inches (43.7 cm) 29.84 inches (75.8 cm) 20 lb. (9.1 kg) Two per RMC Two 8-ft (2.4 m) drop cables RMC power requirements Voltage Frequency Power Hold-up time Air flow (front to back) Acoustical noise Heat dissipation to air 200-240V (180-264 VAC min/max) 50-60 Hz (47-63 Hz min/max) (50W) per supply 20 ms Maximum = 35 CFM (60 m3) per hour Approximately 68 dba Approximately 171 BTU (0.02 tons) per hour 14 HPE Integrity MC990 X system specifications

Warranty and regulatory information Warranty information To view the warranty for your product or to view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products reference document, go to the Enterprise Safety and Compliance website: www.hpe.com/support/safety-compliance-enterpriseproducts Additional warranty information HPE ProLiant and x86 Servers and Options www.hpe.com/support/proliantservers-warranties HPE Enterprise Servers www.hpe.com/support/enterpriseservers-warranties HPE Storage Products www.hpe.com/support/storage-warranties HPE Networking Products www.hpe.com/support/networking-warranties Regulatory information To view the regulatory information for your product, view the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products, available at the Hewlett Packard Enterprise Support Center: www.hpe.com/support/safety-compliance-enterpriseproducts Additional regulatory information Hewlett Packard Enterprise is committed to providing our customers with information about the chemical substances in our products as needed to comply with legal requirements such as REACH (Regulation EC No 1907/2006 of the European Parliament and the Council). A chemical information report for this product can be found at: www.hpe.com/info/reach For Hewlett Packard Enterprise product environmental and safety information and compliance data, including RoHS and REACH, see: www.hpe.com/info/ecodata For Hewlett Packard Enterprise environmental information, including company programs, product recycling, and energy efficiency, see: www.hpe.com/info/environment Belarus Kazakhstan Russia marking Manufacturer and Local Representative Information Warranty and regulatory information 15

Manufacturer information: Hewlett Packard Enterprise Company, 3000 Hanover Street, Palo Alto, CA 94304 U.S. Local representative information Russian: Russia: Belarus: Kazakhstan: Local representative information Kazakh: Russia: Belarus: Kazakhstan: Manufacturing date: The manufacturing date is defined by the serial number. CCSYWWZZZZ (serial number format for this product) Valid date formats include: YWW, where Y indicates the year counting from within each new decade, with 2000 as the starting point; for example, 238: 2 for 2002 and 38 for the week of September 9. In addition, 2010 is indicated by 0, 2011 by 1, 2012 by 2, 2013 by 3, and so forth. YYWW, where YY indicates the year, using a base year of 2000; for example, 0238: 02 for 2002 and 38 for the week of September 9. 16 Warranty and regulatory information

Turkey RoHS material content declaration Ukraine RoHS material content declaration Turkey RoHS material content declaration 17