Optimizing Cluster Utilisation with Bright Cluster Manager

Transcription

1 Optimizing Cluster Utilisation with Bright Cluster Manager Arno Ziebart Sales Manager Germany HPC Advisory Council

2 About us Specialists in Compute, Storage & GPU Clusters (Tailor-Made, Turn-Key) Unique position in Europe (EMEA) Offices in Amsterdam, Gloucester, Munich, Paris, Milan, Geneva, Madrid, Oslo, USA 50 Staff, most technical, all specialized in clusters Hardware independent Background in Science, Research, Engineering At forefront of clustering technology Award winning (Intermediair, Vosko, NBCC, Deloitte Rising Star) Financially strong, profitable, growing Over 300 customers Madrid Gloucester Paris Amsterdam Oslo Munich Geneva Milan 2

3 Customers Government 3

4 Customers Industry 4

5 Customers Academia 5

6 Customers TOP500 TOP500 (2008/2009/) University Frankfurt RU Groningen Saudi Aramco (Saudi Arabia) University of Cambridge (UK) University of Bristol (UK) University College London (UK) CASPUR (Italy) University of Gent (Belgium) 6

7 ClusterVision Customers 22nd on TOP500 list (Nov. ) CPU cores (2.1GHz) 772 Ati Radeon HD 5870 GPUs Fastest x86-based System in Germany Fastest system in the world based on AMD/ATI GPUs 60.7% efficiency 7

8 Customers TOP

9 Products & Services Turnkey clusters Compute clusters Storage clusters GPU clusters Cluster software Bright Cluster Manager MS Windows HPC Server 2008 HPC Services Cluster design Cluster deployment Cluster support Cluster cooling Parallel file systems Lustre Fraunhofer Global Filesystem (FhGFS) IBM GPFS (Official world-wide OEM) NAS 9

10 Servers 10

11 Cluster Architecture x 24 Storage001 Storage002 Storage015 Storage016 HeadNode02 HeadNode01 node001 PDUs x 16 Switch node002 MonitoringNode01 SNMP node003 x 8 Racks MonitoringNode02 node511 ProvisioningNode01 ProvisioningNode02 FabricNode01 LoginNode01 LoginNode02 LoginNode03 LoginNode04 node

12 Cluster Architecture x 24 Storage001 Storage002 Storage015 Storage016 HeadNode02 HeadNode01 node001 PDUs x 16 Switch node002 MonitoringNode01 SNMP node003 x 8 Racks MonitoringNode02 Cluster Management node511 ProvisioningNode01 ProvisioningNode02 FabricNode01 LoginNode01 LoginNode02 LoginNode03 LoginNode04 node

13 Bright Cluster Manager 18

14 Cluster Management Most solutions use the toolkit approach Tools typically used: Ganglia, Cacti, Nagios, Cfengine, xcat, etc Issues with the toolkit approach: Tools rarely designed to work together Tools rarely designed for HPC Tools rarely designed to scale Each tool has its own command line interface and GUI Each tool has its own daemon and database Roadmap dependent on developers of the tools Making a collection of unrelated tools work together Requires a lot of expertise and scripting Rarely leads to a really easy-to-use and scalable solution Often leads to long installation and ramp uptime Low throughput 19

15 Cluster Management Bright Cluster Manager takes a much more fundamental & integrated approach Designed and written from the ground up Single cluster management daemon provides all functionality Single, central database for configuration and monitoring data Single CLI and GUI for ALL cluster management functionality Which makes Bright Cluster Manager Extremely easy to use Extremely scalable Secure & reliable Complete Flexible 20

16 Bright Integrated Approach Utilisation Faster time to full system readiness Faster time to full User Productivity Better throughput and Utilisation Strong Policies driven allocation of resources Sweat the Assets much earlier Time in months

17 Bright Cluster Manager Cluster Manager Intel Cluster Ready certified Integration and Support Molecular QCD Biophysic Physics Chemical CFD Manufacturing Years of HPC expertise Cluster Manager User Moduls Environment Workloadmanager HPC User Environment Workload Management Account. Cluster Administration HPC Middleware Monitoring Node boot and provisioning system Cluster Administration Parallel Filesystem MPI Libraries Provisioning Application Libraries Monitoring Linux distribution Scientific CentOS Suse Redhat 22

18 Management Interface Graphical User Interface (GUI) Offers administrator full cluster control Standalone desktop application Manages multiple clusters simultaneously Runs on Linux, Windows, MacOS X Built on top of Mozilla XUL engine Admin GUI Command Line Interface (CLI) All GUI functionality also available through Command Line Interface (CLI) Interactive and scriptable in batch mode Admin CLI 24

19

20

21

22

23

24

25 Architecture Monitoring Cluster Admin GUI CMDaemon metrics events metrics monitoring data node001 metrics monitoring data Head Node monitoring data node002 metrics Raw data Consolidated data node003

26 43

27

28

29 Bright GPU Metrics 46

30 Bright GPU Metrics 47

31 Bright Cluster Manager Advanced Features Daemon with low resource consumption Synchronised daemon to prevent OS jitter Multiple, load-balanced provisioning nodes Node discovery using Ethernet switch port detection Live & incremental image updates Automated BIOS updates and configurations Infiniband only storage & diskless client support Node and service checks (pre/post to scheduler) Roadmap Features More power saving features Virtualisation, Cloud computing 53

32 Professional Services Application Analysis Cluster design Benchmarking Cluster installation Training Hardware support Collect and Return Onsite Repair Next Business Day Repair 4 Hour Response 24 x 7 Software support Bright Cluster Manager (Bright) System administration (onsite/remote) User helpdesk Code porting, optimisation & parallelization 54

33 Conclusions Proven track-record in cluster computing Hardware independent, partnering with Dell Best cluster software stack on the market Easy manage and use Suitable for very large clusters Comprehensive HPC user environment Complete & consistently integrated 100% committed to cluster computing 63

34 Questions? 64

35 The End 65