HPE Moonshot for HPC. HPCN Workshop 2016 Göttingen.

Transcription

1 HPE Moonshot for HPC HPCN Workshop 2016 Göttingen

2 HPE Apollo platforms and solutions optimized for HPC, IoT and Big Data Platforms Apollo 8000 Supercomputing Apollo 6000 Rack Scale HPC Apollo 2000 Enterprise Bridge to Scale-Out Compute Moonshot Converged Edge Data Acquisition Compute System Apollo 4000 Server Solutions Purpose Built for Big Data Solutions / ISVs HPC Workloads Oil and gas Life Sciences Financial Services Halliburton Paradigm Schlumberger BIOVIA Gaussian Redline Manufacturing CAD/CAE ANSYS Synopsys Academia Custom Apps Intel Mellanox NVIDIA Seagate Next Gen Workloads HPC IoT Mobile workplace Video encoding Object Storage Ceph Cleversafe Scality Lustre Big Data Workloads HPC Storage Data Analytics Cloudera Hadoop Hortonworks BeeGFS

3 What is the Moonshot System Family? 1 Reduces data center space 2 Reduces power required 3 Reduces complexity 4... and performance and workload optimized

4 What is the Moonshot System Family? Example performance and workload optimized solutions: Whole solutions Mobile Workspace Hosted desktops Application delivery Trader & Engineering WS Customer Value Focus Communities of Experts Market-defined ecosystem Media Processing HPC Web Hosting Big Data & Analytics Repatriation Motion graphic sites SoMe, news sites NoSQL (Apache Cassandra) Hadoop Enterprise Search Analytics Moonshot 1500

5 How Has Moonshot Been Reinvented? 1) Intel Xeon Processors Intel s premier processor brand, in high demand Integrated caches and GPUs outperform Intel E5 in many applications 2) World Class HPE Systems Management New management HW & SW Industry leading HPE ilo 3) New Chassis 45 server blades 4 server blades 1 server blade 4) New Moonshot Global Collaborations Intel Alliances Expanded Citrix solutions Virtualization with VMware SI partnership with Accenture Altair for new HPC workloads

6 What is the Moonshot System Family? Moonshot 1500 Up to 180 servers, 45 server blades Standard 4.3U rack-mount form factor Integrated NW Switch and Systems Management Moonshot 1500 Moonshot 400, coming this summer Up to 64 Xeon cores, 4 server blades Standard 1U rack-mount form factor 4 standard PCIe slots Coming soon Optional shock, vibration, temperature rugged Moonshot 400 Moonshot 100 Moonshot 100, coming this summer 1 server blade Small mountable form factor 2 standard PCIe Coming slotssoon Optional shock, vibration, temperature rugged

7 What is the Moonshot System Family? Super dense, converged system Integrated NW switches Simple cable management Moonshot server blades Rear View Coming this summer Moonshot server blades Coming this summer Moonshot server blade

8 What is the Moonshot System Family? Moonshot server blades Server Blade Options: m300, m350 Intel Atom m400, m800 ARM m700 AMD with GPU m710p Intel Xeon with GPU Coming this summer Moonshot server blades Coming this summer Same server blades Moonshot server blade Server Blades Coming Soon: m700p AMD with GPU m510 Intel Xeon 16 cores m710x Intel Xeon with GPU

9 HPC Hybrid infrastructure Same Application Same Scheduling Same Monitoring Same Management Same OS 1 X 1.51 X X 1.3 X X 12.2 X X Weather Forecast CFD Science Apps Cryptography Accelerated Workloads Hybrid something (as a power plant, vehicle, or electronic circuit) that has two different types of components performing essentially the same function a thing made by combining two different elements; a mixture. The right compute for the right application yes even in HPC 9

10 The first Hybrid cluster 1st HPC and Moonshot usecase The Formula 1 story The solution Multiple HPE platforms for specific CFD workloads A complete solution architecture Not only Moonshot HP ProLiant m350 Servers To produce the largest possible number of CFD solver jobs in a 8 weeks period To have a low power solution that would save energy costs and prepare them for the next regulations. HP ProLiant SL230s Servers For urgent CFD solver tasks HP ProLiant BL460c Gen9 Servers To run pre- and post-processing tasks, and CFD solving jobs not related with the current racing car

11 Networking What we can do in a solution Solution 1 Moonshot Chassis #2 2x (3x40G) uplink 45x m710p 2 x 10G / node IRF 45x10 24x10(6x40) 1.87:1 IRF 45x m710p 2 x 10G / node 2x (3x40G) uplink Moonshot Chassis #30 Solution 2 Moonshot Chassis #2 4 x40g uplink 2 x 10G / node 45x m710p 45x10 16x10 (4x40) 2.81:1 45x m710p 2 x 10G / node 4x40G uplink Moonshot Chassis #30

12 Networking What we can do in a solution Solution 3

13 Moonshot Cartridge M710p HP ProLiant m710p Server Cartridge CPU Intel Xeon E3-1284L v4 Broadwell-H with Iris Pro P6300 GPU Intel C220 LynxPoint PCH CPU 4c (8t), base 2.9 GHz (3.8 GHz single-core Turbo), 128 MB edram (L4) shared with GPU GPU MEMORY NETWORK STORAGE 0.5 GHz (1.15 GHz Turbo). Address up to 16 GB of main memory (1.5 GB in Haswell-H). Enhancements in Execution Unit (EU) performance, Intel GVT (vgpu), 3D and transcoding Support for OpenCL 1.2 (Linux), OpenCL 2.0 (Windows) and OpenGL 4.2. Total of 32 GB of ECC protected memory, dual-memory channels (4) 8 GB DDR3 1600MHz LV non-ecc SO-DIMMs with (8) embedded DRAMs for ECC protection. Integrated NIC: dual port 10GbE Mellanox CX3 PRO with RoCE. Supported Switch(s): - Moonshot 45XGc - 45 port 10Gb Downlinks, (4) 40GbE QSFP uplinks. Aspirational 16 SFP+. - Moonshot 180G 180 port 1Gb Downlinks, (4) 40GbE QSFP uplinks 1 SATA x1/pcie G2 x1 attached M.2 SSD. 120GB or 480GB M.2 (2280). Local SSD boot, PXE boot, iscsi boot and storage (iser acceleration for enabled targets) POWER Cartridge: <69W OS AND SOFTWAR E Ubuntu 15.04, LTS (Aug 2015/ P1), RHEL 6.7, 7.1, CentOS 6.7, 7.2, SuSE 11.4, 12 Windows Server 2012, 2012 R2, Windows 7 x64, 8.1. Aspirational Hyper-V, XenServer.

14 m710p: Xeon E3 mono-socket processor with RDMA capable 10GB NIC Key Features Memory Performance : Typical performance for all 4 "C" STREAM kernels : 1-core-bw 15GB/s, 4-cores-bw 21GB/s The cartridge offers about 5GB/s of memory bandwidth per core; it is comparable to what the new Xeon Haswell cores get from dual-socket servers; Sequential Bandwidth of Local Storage: 130MB/s Write, 440 MB/s Read Write performance similar to SATA LFF drive; read 2.6 faster than the SATA LFF Interconnect Performance measured with MPI Latency/Bandwidth between 2 servers 2.0us, 1080MB/s Low latency between M710 cartridges results from RDMA capabilities of the Mellanox chip, close to IB FDR 1us; The asymptotic bandwidth is very close to what 10GbE can achieve but 6 time lower than IB-FDR 6000 MB/s , ,91 1 2,00 0 1, ,00 2,00 4,00 6,00 Message size (MB) 8,00 10,00 12,00 14,00 Bandwidth (MB/s) Latency (us) OpenMPI IMPI PMPI MPICH PMPI IMPI MPICH3 OpenMPI

15 Stream Stream per server MB/s , , , , , , ,00 0,00 Copy Scale Add Triad m710p-4 cores 20869, , , ,00 E5-2680v3-24 cores , , , ,00 m710x-4 cores memory 27176, , , ,00 m710x-4 cores memory 29350, , , ,60 Stream per core MB/s 8000, , , , , , , ,00 0,00 Copy Scale Add Triad m710p-4 cores 5217, , , ,00 E5-2680v3-24 cores 4433, , , ,75 m710x-4 cores memory 6794, , , ,00 m710x-4 cores memory 7337, , , ,40

16 Benchmarking clusters Hardware Moonshot m710p 1x E3-1284Lv4 ( 4 cores) 32 GB(4x8GB) L4 cache (128MB) 10GB Mellanox RoCE 1 SDD M.2 Fast storage available as: NFS mounted over IB Lustre (DDN, Seagate/Xyratex) Panasas Software RHEL7.1 + MLNX OFED GNU, Intel, PGI compilers Intel MKL, AMD ACML, OpenBLAS OpenMPI, MVAPICH, Intel MPI, Platform MPI Many monitoring/profiling tools... Management HP Insight CMU with Collectl metrics SLURM with enhanced prologs/epilogs and many extended features

17 Benchmarks vs Haswell - Applications Used CFD/CAE Dassault Systemes Abaqus Explicit finite element analysis product LSTC s - LS-DYNA advanced general-purpose multiphysics simulation software package ( crash) ESI Group s PamCrash - crash simulation CD-Adapco s STARCCM Multipurpose CFD Ansys s Fluent CFD code Altair s Radioss Crash simulation Altair s Optistruct structural Analysis Science Apps Molecular Dynamics : Amber, Gromacs, Lamps Bioinformatics: Bowtie, BWA Cryptography

18 CAE Apps 1,2 1 0,8 0,6 0,4 Low is better 0,2 0 Abaqus Optistruct Fluent StarCCM ConvergeCFD PowerFlow PamCrash LS-DYNA Radioss Feko Haswell Architecture:E v3 (2.5 GHz) M710p Architecture::E3-1284L v4 (2.9 GHz)

19 Science Apps Dynamics Bioinformatics Quantum 1,0 0,9 0,8 0,7 Relative Time 0,6 0,5 0,4 0,3 0,2 0,1 0,0 AMBER GROMACS LAMMPS NCBI BLAST BLASTBENCH BOWTIE BWA Gaussian Siesta Low is better XL230a Gen9 - Haswell RH EL 6.6 Architecture:E v3 (2.3 GHz) m710p RH EL 6.7 Beta Architecture::E3-1284L v4 (2.9 GHz)

20 Cryptography ( Everything is secret) 1210 Test Total time (s) ,00 Test , E5-2698v3 1043,13 427,73 310,00 E3-1284Lv4 339,76 193,83 160,55 Time used (s) 40,00 30,00 20,00 10,00 0, E5-2698v3 45,15 55,61 55,12 55,21 E3-1284Lv4 38,61 40,43 40,83 40,57

21 Fluent - M710p vs E5-2690v4 Numbers are not in seconds but SOLVER RATINGS the bigger the better. Solver Ratings Aircraft_Wing_2m e5-2690v4 194,8 741,9 1408,9 2554,3 3549, m710p 243,1 762,1 1505,9 2958,9 5316,9 9340,5 Solver Ratings Aircraft_Wing_14m e5-2690v4 22,6 84,4 161,9 288,4 389,4 762,6 m710p 28 80,3 160,8 326,6 582,6 1171,1 The higher the better

22 TAU - checking the partitioner Private vs zoltan partitioner Zoltan's partitioner impact : Solver elapsed time performs around 15 % faster vs private partitioner Global elapsed time is around 20 % faster with Zoltan Seconds Total time 0 96 cores Private - Intra chassis Private Inter-chassis Zolta -Inter-chassis 9869 SEcinds Solver time 0 96 cores Private Inter-chassis Zolta -Inter-chassis

23 e5-2698v3 vs e5-2690v4 vs e3-1284lv4 Zoltan partitioner Seconds v v e3-1284lv

24 Comparison example application performance dependent! m710p xl230a E5-2698v3 xl230a E5-2680v3 Chassis per rack Cartridges per chassis 45 Power per rack with HPL Watts Cores per rack Memory per core 8,0 4,0 5,3 NW Bandwidth per core 250,0 31,3 41,7 MB/s Perf per core 1,38 0,90 1,00 Power per core 19,2 14,1 17,5 Watts Power/perf ratio 13,94 15,65 17,50 Perf per rack 1,38 1,20 1,00 Price 102% 139% 100% Price/performance ratio 74,15% 116,24% 100,00% 24

25 Benefits Full binary compatibility with dual-socket x86 servers Fast compute cores Excellent memory bandwidth shorter time to solution Save on license costs => even better TCO Parallelize on less cores: better scaling 8GB of memory per core Excellent network bandwidth per core (equivalent to IB FDR on a dual-socket server) Integrate with Infiniband fabric if necessary Better isolation (security / fault tolerance): one server has only 4 cores Potential extra compute performance with embedded GPU (OpenCL) Remote visualization capabilities for free Simple = very robust platform 3 years base warranty included

26 2H 2016 HPE ProLiant m510 Typical Workload All Purpose Compute Workhorse, Big Data, Media Processing, and more! SoC Graphics Memory Network Controller Onboard Storage External Storage Intel Xeon D Broadwell-DE 2.4GHz, 8 core 12MB of L3 Cache N/A ECC DDR4 SDRAM (2133/2400MHz) (8GB, 16GB, 32GB) Four (4) DIMM slots Maximum Configuration 128GB (4x32GB) Mellanox Connect-X3, Dual 10GbE NIC Three (3) m.2 Modules (1) - SATA m.2 (2242) 32GB or 64GB (2) - PCIe m.2 (2280): up to 960GB Coming soon iscsi with iser acceleration Power OS Cartridge Max: TBD, Typical: 90W (Includes system overhead) Ubuntu 15.04, Ubuntu LTS RHEL 6.7/ 7.2 SLES 11 SP4, SLES12 Windows Server 2012/2012 R2/v.NEXT CentOS 6.7/7.2 November 12, 2015

27 2H 2016 HPE ProLiant m710x Workload Application Delivery, Video Transcoding, Big Data Analytics SoC Graphics Memory Network Controller Onboard Storage External Storage Power OS Intel Xeon E3-1285L v5 3.0GHz (3.9 GHz Turbo), 4-core 128MB eddr Integrated Intel Iris Pro GT4e GPU with 72 execution units ILO Remote Console (4) DDR4 SODIMMS (2133/2400MHz) (8GB, 16GB) Maximum Configuration 64GB (4x16GB) Mellanox Connect-X3, Dual 10GbE NIC Five (5) m.2 Modules (1) SATA m.2 (2242) 64GB, 120G or 240G (4) NVMe m.2 (22110): up to 960GB iscsi with iser acceleration Up to 99W Coming soon Ubuntu, RHEL SUSE, SLES Windows Server 2012/2012 R2/V.next,Windows 7/ 8.1/10 CentOS, Xenserver February 2016

28 Please Have Another Look at Moonshot Reinvented... Consider using one of our Moonshot Global Discovery Labs: Test and pre-validation of Moonshots system and end-to-end solutions On-site access or secure remote access Grenoble, France Houston, Texas Singapore 28