HP BladeSystem c-class Server Blades OpenVMS Blades Management John Shortt Barry Kierstein Leo Demers OpenVMS Engineering 1 19 March 2009
Agenda Overview c-class Infrastructure Virtual Connect Updating Firmware HP System Management ilo (MP) VCM/VCEM HP SIM/VSE 2 19 March 2009
HP BladeSystem c-class Server Blades HP BladeSystem Overview 3 19 March 2009
c-class Components Enclosures C7000 C3000 Interconnect Modules On-board Administrator Server Blades Storage and Expansion Blades Virtual Connect 4 19 March 2009
c7000 Enclosure 10U form factor Fits in a standard 19 rack, 32 deep Capacity 8 full-height or 16 half-height Blade slots 8 Switch Module (SWM) slots 2 On-board Administrator (OA) slots 6 Hot pluggable power supplies 10 Hyperjet Coolers 5 March 19, 2009
c7000 Enclosure Half-Height Blade Server Up to 16 per enclosure Full-Height Blade Server Up to 8 per enclosure 10U Integrated power Simplified configuration and greater efficiency Same flexibility, capacity and redundancy Onboard Administrator HP Insight Display, set-up simplification 6 March 19, 2009
c7000 Enclosure fully redundant Active Cool fans Interconnect bays Onboard Administrator(s) Power management 7 March 19, 2009
Interconnect/Switch Modules HP 4Gb FC pass-thru HP 1Gb Ethernet pass-thru Brocade 4Gb SAN switch HP GbE2c Ethernet Blade Switch Cisco Catalyst Blade Switch 3020 HP 1Gb Virtual Connect Ethernet HP 10Gb Virtual Connect Ethernet (Proliant only today) HP 4Gb Virtual Connect FC 8 March 19, 2009
c7000 Mid-plane Routing Server IO Interconnect Bay Comments NIC1 and NIC2 1 and 2 Integrated Ports Mezz Slot 1 3 and 4 Type I slot Mezz Slot 2 5 and 6 Type II slot *Mezz Slot 2 7 and 8 Ports 3 and 4 Mezz Slot 3 7 and 8 Type II slot *Mezz Slot 3 5 and 6 Ports 3 and 4 * Secondary channels for a 4 port mezzanine card 9 19 March 2009
c3000 Enclosure 6U Form Factor New Midplane and Power Supply Capacity 4 full height/8 half-height slots 6 Power Supplies 6 Fans 4 Interconnect bays 1 OA DVD 10 March 19, 2009
C3000 11 March 19, 2009
c3000 Midplane Routing Server IO Interconnect Bay Comments NIC1 and NIC2 1 Integrated Network Ports Mezz Slot 1 2 Type I slot Mezz Slot 2 3 and 4 Type II slot Mezz Slot 3 3 and 4 Type II slot 12 19 March 2009
On-board Administrator (OA) Manages all enclosure related items thermal, power, Switch Modules, Blades Interfaces HTML-based GUI via HTTPS CLI interface via RS-232 (Local connector), SSH, or Telnet Management Protocols SNMP today IPMI via ilo on local 10/100 link 13 March 19, 2009
OA e-key to link Mezzanine card with SWM Power on grant for the Blade Dynamic Power and Cooling control Enclosure Profile setup once Real time monitoring data Provides data to higher level management tools like Insight Power Manager Firmware updates SWM console interface 14 March 19, 2009
Integrity Server Blades Today BL860c BL870c Processor Intel Itanium 9100 Processors 1.66 GHz/18MB FSB667 1.42GHz/12MB FSB400 1.6GHz/12MB FSB533, single-core Note: 9000 series proc (Montecito) also supported Intel Itanium 9100 Processors 1.6 GHz/24MB FSB533 1.6 GHz/18MB FSB533 1.42 GHz/12MB FSB533 Chipset hp zx2 Memory PC2-4200 DDR-SDRAM (533 MHz) 12 Sockets 48GB max (using 4GB DIMMs) PC2-4200 DDR-SDRAM (533 MHz) 24 Sockets 96GB max (using 4GB DIMMs) HDD and Controller 2 SFF Hot-Plug SAS HDDs HW RAID 1 support 4 SFF Hot-Plug SAS HDDs HW RAID 1 support Networking 4 Integrated Gigabit NICs Management Integrity ilo 2 Advanced Pack OS Support HP-UX 11i v3 and v2; OpenVMS v8.3-1h1; Linux (Red Hat and SUSE); and Windows BL860c Enclosure Mezzanine Cards 8 Server Blades in c7000/ 4 Server Blades in a3000 3 mezzanine cards Choices: 4Gb FC; IB; PCI-e pass-thru; 4-port NIC; expansion 4 Server Blades in c7000/ 2 Server Blades in c3000 3 mezzanine cards Choices: 4Gb FC, IB, 4-port NIC ; expansion BL870c 15 19 March 2009
SB40c Storage Blade Direct Attach storage Smart Array raid controller Support for up to 6 SAS drives Connects to adjacent Server Blade with PCIe pass-thru mezzanine card Half-height Blades put module in mezz slot 2 Full height Blades put module in mezz slot 3 Can go in either slot of a partition (left or right of the pair) 16 March 19, 2009
Ultrium 448c Tape Blade LTO Ultrium 2 400GB capacity Requires PCIe Pass-thru module in mezzanine slot 3 of adjacent Server Blade Supported on Proliant today, Integrity around the end of the year 17 March 19, 2009
PCI Expansion IO Blade for PCIx or PCIe stand up modules Comes with a backplane for each Install the desired flavor Each has 2 available slots Support for 3 rd party modules only no HP modules are supported 18 March 19, 2009
Virtual Connect Network and Fibre Channel SWMs plus Virtual Connect Manager (VCM) VCM runs on Network SWM in bay 1 or bay 2 (at least one Network VC switch is required for VC support) With 2 network switches you get redundant network paths and VCM failover highly recommended Create VCM domain that describes your VC environment Networks SANs Blade profiles Virtual Connect provides a wire once infrastructure VCM adds no overhead to Network and FC transfers! 19 March 19, 2009
HP Virtual Connect Ethernet Module MidPlane 16x 1Gb Ethernet Connects to one NIC in each HH blade server bay 1x 10Gb Cross-link between adjacent VC-Enet modules Mgmt Interfaces to Onboard Administrator (Enet & I2C) 2x 10Gb Ethernet (CX4) Usable as data center links or as stacking links. Recessed module reset button 8x 1Gb Ethernet (RJ45) Usable as data center links or as stacking links. Port Number & Status Indicators Indicates whether a data center link (green), stacking link (amber), or highlighted port (blue). Next button (unused in initial release firmware) 20 March 19, 2009
HP Virtual Connect FC Module MidPlane 16x 4Gb FC Connects to one HBA port in each HH blade server bay Mgmt Interfaces to Onboard Administrator Module LEDs Health and UID Faceplate Port LEDs Link and Activity Note: VC-FC requires VC-Ethernet also installed in same enclosure 4x 1/2/4 Gb FC (SFP) Connects to data center Fibre Channel switches. Port Number & Status Indicators Indicates whether a port is configured (green) or highlighted (blue). 21 March 19, 2009
Adding c-class Blades General rule is left to right installation Half-height Blades can be stacked, as well as half-height Blades on top of Storage Blades There is no requirement that empty slots are to be avoided Blades can be added or removed without powering off anything Remember, all server slots are routed to each interconnect slot Mezzanine cards must be configured based on Interconnect module requirements 22 March 19, 2009
Adding Interconnect Modules Network modules must be placed in Bay 1 and/or Bay 2 Both for redundancy For VC, both for VCM failover Bays 3-8 depend on mezzanine cards Bays 3 and 4 relate to mezz slot 1 Bays 5 and 6 (7 and 8) to mezz slot 2 Bays 7 and 8 (5 and 6) to mezz slot 3 23 March 19, 2009
Enclosure Module Access On-board Administrator Get IP address from OA display Browse to the ilo TELNET to the CLI Serial Connection Use tag for OA name and password Configure IP, name, password, etc. Interconnect Modules Local CLI Browse via OA Look for tag 24 March 19, 2009
Management Processor Access TELNET to the Management Processor on each individual Blade Traditional method of console access Browse to the MP (ilo2) SUV cable for serial/usb/vga connection to each Blade Use Tag for login information Future support for Virtual KVM (vkvm) 25 March 19, 2009
Check Firmware Server Blade Baseboard Management Controller (BMC) Management Processor (MP) System Firmware (SFW) Integrated IO (FRU EEPROMs for example) Mezzanine Cards Update the OA Interconnect Modules Storage Blades 26 March 19, 2009
HP BladeSystem c-class Server Blades HP BladeSystem Enclosure Updates 27 19 March 2009
Enclosure Updates OA Use GUI Firmware Update Tab In a redundant configuration, both must be the same level If not at the same version Versions prior to 2.xx, remove one and update individually, otherwise update cannot proceed Versions 2.xx and above, perform update if necessary Interconnect modules Use `update show command in the OA cli> to view interconnect module versions and update as necessary (not VC modules) 28 19 March 2009
OA Firmware Update 29 19 March 2009
OA CLI and Update Example 30 19 March 2009
Updating a Switch Module 31 19 March 2009
HP BladeSystem c-class Server Blades HP Integrity Server Blades 32 19 March 2009
Server Blade Update Check hp.com for latest images Download the firmware components onto a USB memory stick Use the USB port on the SUV cable attached to the Server Blade and insert the USB drive Get to the Extensible Firmware Interface (>shell) prompt If VMS is running, use shutdown.com and select reboot When the Server Blade completes its reset process it will boot to EFI and display the EFI Boot Menu Select the EFI Shell option 33 19 March 2009
EFI Boot Menu 34 19 March 2009
Server Blade Update At the EFI >shell prompt Map r to display the available file system devices (FSx:) Look for the FS device that has USB in the description FS0 for example Type FS0: <return> Type ls to show the device contents Use CD if you created a directory holding the firmware files to change directories Follow the update procedures to update all necessary firmware on the Server Blade For example: >shell fs0: >fs0: fwupdate_bl860c_0405.efi f 35 19 March 2009
FS Device containing firmware files 36 19 March 2009
Integrity Blade Base Firmware Update 37 19 March 2009
Integrity Blade Firmware Update (cont) 38 19 March 2009
Verify Firmware Revisions 39 19 March 2009
Integrated IO and Mezzanine Cards Use HP.COM for the rest of the firmware stack Shell info command will provide a list of FRUs and their firmware versions Broadcom NICs--Broadcom Update Utility SAS 1068 Controller Update SAS Utility Qlogic 4Gb Fibre Channel Mezz card Intel NIC mezzanine cards EFI Executable 40 19 March 2009
Virtual Connect Virtual Connect Firmware contains the VCM, VC Ethernet and VC Update can be done by the VCM GUI or the VC Support Utility Switch operation will be interrupted All Blades should be shutdown and powered off 41 19 March 2009
Virtual Connect Firmware Update 42 19 March 2009
OpenVMS Blade Management Overview of HP System Management Overview of a Blade enclosure Overview of ilo (MP) Overview of OA Overview of VCM/VCEM Overview of HP SIM/VSE March 19, 2009 43
Overview of HP System Management Simplify system management and configuration by use of software and virtualization Simplify steps to do various management tasks Ease hardware replacement user-removable parts Ease system migration between Blades Faster recovery from hardware failure Hardware or firmware upgrades Provide a single pane of glass for all platforms and operating systems to monitor all Blade systems Facilitate and automate configuration, monitoring, workload management and capacity planning as much as possible March 19, 2009 44
Overview of HP System Management To implement these goals, provide hardware and software capabilities to make this possible Remote management of Blade via IP Enclosure monitors temperature and health of various components - Blades, fans, power supplies, network adapters, etc. Add capabilities to Blades, network adapters, SAN connects, so one Blade can be configured to look like another Blade and assume any work that it was doing System management software running under HP SIM takes advantage of the flexibility of the hardware to monitor and migrate systems as needed March 19, 2009 45
Overview of a Blade - Front March 19, 2009 46
Overview of a Blade - Front March 19, 2009 47
Overview of ilo (MP) Each Integrity system has an integrated Lights Out (Management Processor) to control the Blade through a browser via the IP protocol Can turn the Blade on/off, configure the console inputs and outputs, set boot options, etc. Gives access to the Blade console that is used by the operating system for booting and general system access (text or graphics based) Can install or upgrade an operating system onto the Blade (provisioning) or a remote DVD on a PC In the case of OpenVMS, an Infoserver can also be used March 19, 2009 48
Overview of ilo (MP) March 19, 2009 49
Overview of OA The Online Administrator allows for management of the enclosure itself through a browser using the IP protocol Implemented as a hardware module that plugs into the back of the enclosure. Two can be installed to provide for failover. View configuration and health of each component of the enclosure Blades, management components like the OA and VC-enet, VC FC module, network switches, power supplies, fans, etc. Quick access to the ilo of each Blade March 19, 2009 50
Overview of OA March 19, 2009 51
Overview of OA March 19, 2009 52
Overview of OA March 19, 2009 53
Overview of OA March 19, 2009 54
Overview of OA VC-enet March 19, 2009 55
Overview of OA March 19, 2009 56
Overview of OA March 19, 2009 57
Overview of VCM (Virtual Connect Manager) Virtual Connect enables Blades to assume the role of another Blade Workload the operating system and applications that do work or provide services Logical server a virtualized hardware platform that runs a workload, and consists of the following: MAC address for network adapters SAN WWIDs for SAN storage CPU IDs required for software licensing of software The logical server attributes are stored in a profile by the Virtual Connect software, and can apply the profile to any Blade in the enclosure Assumes that the operating system is on a SAN disk March 19, 2009 58
Overview of VCM Virtual Connect pools resources into a Virtual Connect Domain MAC addresses, SAN WWIDs and virtual CPU IDs are allocated to a Virtual Connect Domain, and can be allocated to any Blade in the domain Allows easy replacement of Blades Network administrators and SAN administrators are only engaged when the Virtual Connect Domain is initially configured with a pool of MAC addresses, SAN WWIDs and CPU IDs Virtual Connect Domains were initially one enclosure, but will soon span 4 enclosures March 19, 2009 59
Overview of VCM VCM manages a Virtual Connect Domain through a browser using the IP protocol Implemented as a hardware module (VC-enet) that plugs into the back of the enclosure. Two can be installed to provide for failover. Allows the migration of a logical server from one Blade to another Shut down the operating system Migrate the profile to another Blade using VCM Boot the operating system on the other Blade Manages Blades in a Virtual Connect Domain March 19, 2009 60
Overview of VCM March 19, 2009 61
Overview of VCM Edit profile 1 March 19, 2009 62
Overview of VCM Edit profile 2 March 19, 2009 63
Overview of VCEM Virtual Connect Enterprise Manager Extends the VCM style of management over multiple Virtual Connect Domains Software spans Virtual Connect Domains to provide logical server migration over a large computer facility Uses Virtual Connect to do its work March 19, 2009 64
Overview of HP SIM/VSE HP SIM/Virtual Server Environment is HP s single pane of glass for managing computer installations Goal to scale to the largest computer installations Support both the Proliant and Integrity platforms March 19, 2009 65
Overview of HP SIM/VSE HP SIM/VSE supports various management tasks Creation, configuration, management and migration of logical servers and virtual machines Performance and power usage data gathering/capacity planning Optimize workload placement Optimize power usage Tool for planning server consolidation Power monitoring and regulation Maximum performance, maximum power savings, and somewhere in between Manage capacity (icap) and workloads (gwlm) March 19, 2009 66
Overview of HP SIM/VSE HP SIM/VSE supports various management tasks Goal of optimizing server and energy use Lower power and cooling costs Compute what-if placements of workloads on various servers existing or proposed acquisitions Migrate workloads on off-peak times to fewer physical servers and shut down the servers needed at peak times Goal of reducing downtime to perform repairs, preventative maintenance and software/firmware upgrades Migrate a logical server to another Blade, fix/upgrade the Blade, migrate the logical server back to the original Blade Can do this in VCM/VCEM, but number of steps reduced March 19, 2009 67
Overview of HP SIM/VSE March 19, 2009 68
Overview of HP SIM/VSE March 19, 2009 69
Overview of HP SIM/VSE March 19, 2009 70
Overview of HP SIM/VSE March 19, 2009 71
Overview of HP SIM/VSE March 19, 2009 72
Overview of HP SIM/VSE March 19, 2009 73
Questions? March 19, 2009 74