KIRA-EMTA. Why KIRA-EMTA Multi-Threaded Supercomputer. Inside KIRA-EMTA. Elastic Supercomputing Architecture. Exa-Converged Architecture

Transcription

1 Explring New Supercmputer Perfrmance Scenaris Fr New Emerging Applicatins Why KIRA-EMTA Multi-Threaded Supercmputer The A3Cube KIRA-EMTA supercmputer realizes an adaptive supercmputing architecture that prvides extreme scalability, sustained perfrmance, unique resurces cnvergence, and elastic use f memry devices. Inside KIRA-EMTA KIRA-EMTA system leverages the advantages f A3Cube enhanced Dragnfly-Hypercube and Flattened Butterfly cmbined netwrk tplgy, InfiniBand intercnnect, latest Intel Xen Knights Landing (KNL) prcessrs, integrated cnvergent parallel strage, elastic caching slutins and latest A3Cube Frtissim Fundatin OS suite and prgramming envirnment. Sustained and scalable applicatin perfrmance Tight HPC ptimizatin and integratin Upgradability by design User prductivity A3Cube KIRA-EMTA Elastic Supercmputing Architecture Exa-Cnverged Architecture Understanding that n single prcessr engine and static system cnfiguratin is ideal fr every type f user applicatin, the KIRA-EMTA supercmputer platfrm highlights the flexibility f scalar prcessing, cprcessing and acceleratrs, shared memry OS cperative-kernels, elastic memry, and cnverged parallel data and IO access, t build a new generatin f hybrid systems capable f leveraging the strengths f each technlgy int ne elastic HPC envirnment.

2 Intel Knights Landing Prcessr Cres X86 ISA binary cmpatible 4 threads / cre Threading: back-t-back fetch and issue per thread Cre resurces dynamically repartitined (shared) between threads at thread selectin pints KNL Instructin Set (ISA) First prcessr that supprts AVX-512 (512 bit Vectr Instructins) Binary cmpatible with Intel Xen : Prir Intel Xen prcessr binaries will run n KNL withut recmpilatin Bth native and fflad prgramming paradigms supprted A3Cube s Enhanced Versatile Tplgy netwrk Ultra-lw latency Extreme IO perfrmance Nearest-Neighbrs special length cables 64 ndes max 2 hps (Rack level) 1024 ndes max 3 hps (16 Racks) Island latency <690ns Max latency 128 ndes <800ns Max latency ndes 890ns Enhanced Dragnfly, Flattened-Butterfly 100 Giga bit/s x PE (200 Gbit/s Dual- Rail) 2/4 Tera bit/s Island t Island Bandwidth 7.2/14.4 Tera bit/s Glbal Bandwidth Up t 400 Millins MPI messages/secnds per PE Up t mre than 14 Billins MPI Messages/secnd Ruting Capability

3 A3Cube Custmized ROUTER Each ruter prvides bth intra-grup (Cmputing- Island) links that cnnect it t ther cmputing ndes in its grup and inter-grup links (als knwn as glbal links) that cnnect it t ther grups. The ruter in a grup pls its inter-grup links, enabling each grup t be directly cnnected t all the ther grups. A3Cube s (CDMK ) Cllabrative Distributed Multi Kernels (CDMK ) An unique, nn-cherent, elastic remte memry cluster level ver the fabric. Frtissim Fundatin Cmbines distributed elements, memry hierarchy ptimizatin, high speed data prcessing, building an ALL IN ONE high perfrmance, high parallel and fully cnverged system. It includes : FrtissimFS engine Unique cnvergent parallel file system engine with cperative caching that prvides very high-perfrmance parallel access t multi-server-based disk strage, and guaranties efficient use f the available resurces t parallel and distributed applicatins Enables in-netwrk cmputing thrugh scalable hierarchical aggregatin prtcl technlgy: 7Tb/s f nn-blcking bandwidth 200 Millins f messages per prt Executes MPI cllectives peratins in the netwrk 10X perfrmance imprvement fr MPI and SHMEM/PGAS applicatins Operates as a C-Prcessr fr A3Cube s Cllabrative Distributed Multi Kernels (CDMK ) and RAM Over Fabric Built-In A3Cube parallel IO architecture Aggressive distributed memry caching accessible by any applicatin (Ultra Cache) Cnfigurable system-wide replicatin t survive hardware failure RamStr An advanced, unique feature f FF capable f putting a real parallel, scalable file system cmpletely in-memry Cluster-wide distributed scheduler Alng with each CPU is an high perfrmance IO ptimized netwrk cnnectin, data and memry bus run in parallel t prvide unmatched high perfrmance data access t all the applicatins running in KIRA-EMTA

4 Basic System Cnfiguratin & Features Cmputing Memry Strage Fabric KIRA-EMTA 4096 Cres per Rack* Threads* 12 TB RAM* 100 Gbit/s per PE* 200 Millins Messages/Secnd per nde* * Standard Cnfiguratin Built-in fully graphic user interface

5 Applicatin Examples Main System Sftware Cmputing Sftware suite KIRA-EMTA Frtissim Fundatin Operating System: Linux Based (kernel 4.4.x lng term) Exa-Cnverged Scale-ut Distributed File System Autmatic Resurce Discvery Dynamic Wrklad Distributin Autmatic iinfrmatics Lad-balancing A3Cube s Cllabrative Distributed Multi Kernels (CDMK ) A3Cube s RamStr A3Cube s Cmplete Integrated Management Sftware (system, strage, memry, fabric) Cmplete Cmputing Tls (MPI, SHMEM ) MVAPICH ptimized fr KIRA-EMTA fabric (MPI 3.1) Supprt fr OpenMPI (MPI3.x) Offlader fr cllectives cmmunicatin frm MPI prcess nt KIRA-EMTA intercnnect hardware Message-based iinfrmatics and streaming applicatins acceleratr OpenSHMEM Supprt fr Intra-nde shared memry cmmunicatin Intel KNL sftware cmpilers and tlkits KIRA-EMTA is designed t run efficiently bth memry intensive, IO-intensive and cmputatinal intensive applicatins in the same machine. The fabric tplgy is realized t extl the applicatin maximum perfrmance dramatically imprving the cmmunicatin efficiency at the entire system level. Climate/Weather Gephysics CFD Energy Financial Services Mlecular Dynamics Cmputatinal Chemistry Biinfrmatics Memry Intensive Cmputatin/IO Intensive

6 KIRA-EMTA MVAPICH KIRA-EMTA ptimized MVAPICH prvides advanced MPI 3 features (such as User Mde Memry Registratin - UMR, Dynamic Cnnected Transprt - DCT and Cre-Direct-based supprt fr Nn-blcking cllectives (Hardware supprted by KIRA Intercnnect). KIRA-EMTA incrprates hybrid designs that use Shared memry, and IB channels ver hybrid Dragnfly-Flattened Butterfy tplgy that guarantee latency under 1us in the wrst case up t 1024 ndes. KIRA-EMTA MVAPICH implementatin prvides a unified high-perfrmance runtime that supprts bth MPI and PGAS prgramming mdels n KIRA- EMTA clusters. It enables develpers t prt parts f large MPI applicatins that are suited fr PGAS prgramming mdel. The unified runtime als delivers superir perfrmance cmpared t using separate MPI and PGAS libraries by ptimizing the use f netwrk and memry resurces in cmbinatin with A3Cube distributed parallel file system engine (FrtissimFS ) KIRA-EMTA MVAPICH supprts: Unified Parallel C (UPC) UPC++ OpenSHMEM Carray Frtran (CAF) as PGAS mdels It can be used t run: Pure MPI applicatins, MPI+OpenMP applicatin Pure UPC, pure UPC++ Pure OpenSHMEM Pure CAF Hybrid MPI(+OpenMP) + PGAS applicatins KIRA-EMTA Intel KNL Prcessr explained What is, and what is nt Knights Landing is NOT Knights Crner. Knights Crner, the first Intel Xen Phi prduct, was a cprcessr. Knights Crner has been extrardinarily successful pwering many f the wrld s fastest cmputers. Nevertheless, Knights Crner required a ht prcessr, shuffling f data ver the PCIe bus, and ften the use f fflad-style prgramming due t limited memry capacity and strng Amdahl s Law effects when running less parallel cde. Knights Landing is a full-fledged, highly scalable, Intel prcessr. This prcessr can reach unprecedented levels f perfrmance and parallelism, withut giving up prgrammability. Yu can use the same parallel prgramming mdels, the same tls, and the same binaries that run tday n ther Intel prcessrs. Prgramming languages that wrk fr prcessrs, just wrk fr Knights Landing t. Prgramming mdels, like OpenMP, MPI and TBB, just wrk fr Knights Landing als. Restrictive mdels tailred fr GPUs, including kernel prgramming in CUDA and OpenCL, d nt apply t prcessrs, it des nt need them. Knights Landing is NOT ging t invalidate prir prcessr cding effrts Knights Landing is flexible Unprecedented cnfigurability allws it t be perated in different memry mdes. MCDRAM can either be treated as a high bandwidth memry-side cache, r it can be identified as high bandwidth memry, r a little f each. Knights Landing als supprts different cluster mdes, allwing it t behave as a cluster with ne, tw r fur NUMA dmains per prcessr, making easy the cde perfrmance ptimizatin.