KIRA-CS. Why KIRA-CS Supercomputer. Inside KIRA-CS. Elastic Supercomputing Architecture. Exa-Converged Architecture

Transcription

1 Explring Exa-Supercmputing Scenaris Fr New Emerging Challenges Why Supercmputer The series delivers n A3Cube s cmmitment t an adaptive supercmputing architecture that prvides bth extreme scalability and sustained perfrmance. A3Cube Inside supercmputer is enabled by a rbust Intel Xen prcessr rad map, A3Cube ultra-lw latency hybrid high perfrmance intercnnect and flexible 2D/3D Flattened Butterfly/ Hybrid Dragnfly netwrk tplgy, prviding lw latency and scalable glbal bandwidth t satisfy the mst challenging multipetaflps applicatins. Sustained and scalable applicatin perfrmance Tight HPC ptimizatin and integratin Upgradability by design User prductivity Elastic Supercmputing Architecture Exa-Cnverged Architecture Understanding that n single prcessr engine and static system cnfiguratin is ideal fr every type f user applicatin, the KIRA Family supercmputer platfrms highlights the flexibility f scalar prcessing, c-prcessing and acceleratrs, shared memry OS cperative-kernels, elastic memry, and cnverged parallel data and IO access, t build a new generatin f hybrid systems capable f leveraging the strengths f each technlgy int ne elastic HPC envirnment

2 Supercmputing fr mdern challenges It s becme imperative t make decisins with near immediacy, cntinuusly pivt strategy and tactics, and merge streams f inquiries int meaningful actin. ultra-dense (ptimized high perfrmance machine) represents a step frward in big data, technical and scientific appliances. delivers a ptent cmbinatin f system agility, cmputing density (128 prcessrs in a single rack), incredible netwrk perfrmance (mre than 11 terabits/s f glbal bandwidth per rack) and pervasive cmputing and IO speed. fr Integrated Supercmputing and Analytics T unleash the full prmise f big data analytics, nly a real supercmputing apprach in an enterpriseaccessible frmat will prvide the agility and perfrmance required fr high-frequency insights. As analytics wrkflws are becming increasingly sphisticated, businesses are mving beynd Hadp t integrate a breadth f analytics, like Spark and graph. In this dynamic envirnment, data scientists need t iterate quickly. And their pipelines require an assembly f task-specific tls. This requires a platfrm that efficiently handles the entire spectrum f wrklads frm batch analytics, where thrughput is key, t iterative and interactive wrklads, where near real-time matters mst.

3 Hlistic Apprach uses hlistic and integrated methds t develp the wrld s mst cmplete and rbust HPC systems. Rather than assembling cluster-like cmpnents and cmmdity netwrks that can degrade r act unpredictably at high nde cunts, A3Cube uses a grund-up design apprach that includes deeply ptimized fabric and tplgy architecture in cmbinatin with system-centric file system and resurce sharing built-in that guarantees unique linearly scaling in bth cmputatin and IO perfrmance Regardless f yur applicatin requirements, the KIRA-CS series scales acrss the perfrmance spectrum f dimensin and applicatin types, frm smaller ftprint, lwer-density cnfiguratins up t the mst cmplex data Analytics challenges. The unique built-in GPUs cmputing-sharing guarantees unmatchable flexibility and cmputing perfrmance delivering the nly exa-scale elastic accelerated cmputing platfrm available n the market. A3Cube s Built-in Enhanced Versatile Tplgy netwrk Ultra lw latency Extreme IO perfrmance Nearest-Neighbrs special length cables 64 ndes max 2 hps (Rack level) 1024 ndes max 3 hps (16 Racks) Island latency <690ns Max latency 128 ndes <800ns Max latency ndes 890ns Enhanced Dragnfly, Flattened-Butterfly 100 Giga bit/s x PE (200 Gbit/s Dual-Rail) 2/4 Tera bit/s Island t Island Bandwidth 7.2/14.4 Tera bit/s Glbal Bandwidth Up t 400 Millins MPI messages/secnds per PE Up t mre than 14 Billins MPI Messages/secnds Ruting Capability Unique Scalability Withut Perfrmance Degradatin

4 A3Cube Custmized ROUTER Each ruter prvides bth intra-grup (Cmputing- Island) links that cnnect it t ther cmputing ndes in its grup and inter-grup links (als knwn as glbal links) that cnnect it t ther grups. The ruter in a grup pls its inter-grup links, enabling each grup t be directly cnnected t all the ther grups. Frtissim Fundatin Cmbines distributed elements, memry hierarchy ptimizatin, high speed data prcessing, building an ALL IN ONE high perfrmance, high parallel and fully cnverged system. It includes : FrtissimFS engine Unique cnvergent parallel file system engine with cperative caching that prvides very high-perfrmance parallel access t multi-server-based disk strage, and guaranties efficient use f the available resurces t parallel and distributed applicatins Enables in-netwrk cmputing thrugh scalable hierarchical aggregatin prtcl technlgy: 7Tb/s f nn-blcking bandwidth 200 Millins f messages per prt Executes MPI cllectives peratins in the netwrk 10X perfrmance imprvement fr MPI and SHMEM/PGAS applicatins Operates as a C-Prcessr fr A3Cube s Cllabrative Distributed Multi Kernels (CDMK ) and RAM Over Fabric Built-In A3Cube parallel IO architecture Aggressive distributed memry caching accessible by any applicatin (Ultra Cache) Cnfigurable system-wide replicatin t survive hardware failure RamStr An advanced, unique feature f FF capable f putting a real parallel, scalable file system cmpletely in-memry Cluster-wide distributed scheduler Alng with each CPU is an high perfrmance IO ptimized netwrk cnnectin, data and memry bus run in parallel t prvide unmatched high perfrmance data access t all the applicatins running in

5 Hybrid Cmputing Integratin Optin Integrating cmputing system with remte cprcessr arrays paving the rad t exa-deep analytics and exa-supercmputing Virtual Cprcessrs Ultra high perfrmance fabric + Ultra dense CPU driven cmputing + Ultra dense Acceleratr driven blades = Exa-Supercmputing Physical Cprcessrs Intercnnectin Fabric Acceleratr Array Acceleratr Cluster Sharing Cprcessr driven applicatins will be able t use all the remte cprcessr available as they were lcal t the prcessing elements. The applicatin can leverage mre than ne GPU per nde and use all the remte acceleratrs. Mre GPUs fr a single applicatin withut buying custm dedicated systems Cheaper cluster upgrade Easy integratin Investment prtectin and GPU cnslidatin

6 Basic System Cnfiguratin & Features Cmputing Memry Strage Fabric bit Intel Xen Prcessr/Rack Starting frm 2,560 Threads* Starting frm 8 TB RAM* 100 Gbit/s per PE* 200 Millins Messages per Secnds per nde* * Standard Cnfiguratin Built-in fully graphic user interface

7 Analytics Tls Applicatin Examples Main System Sftware Cmputing Sftware suite Frtissim Fundatin Cmplete Cmputing Tls (MPI, SHMEM ) Operating System: Linux Based (kernel 4.4.x lng term) Exa-Cnverged Scale-ut Distributed File System Autmatic iinfrmatics Resurce Discvery Dynamic Wrklad Distributin Autmatic Lad-balancing A3Cube s RamStr A3Cube scmplete Integrated Management Sftware (system, strage, memry, fabric) MVAPICH ptimized fr KIRA-CS fabric (MPI 3.1) Supprt fr OpenMPI (MPI3.x) Offlader fr cllectives cmmunicatin frm MPI prcess nt KIRA-CS intercnnect hardware Message-based iinfrmatics and streaming applicatins acceleratr OpenSHMEM Supprt fr Intra-nde shared memry cmmunicatin Enterprise Grade HDFS plug & play cnnectr Enables t Keep Data in a POSIX-cmpatible data strage Enables t Run Directly Data Analytics with Hadp Map-Reduce n the Strage Enables Enterprise Grade in Place Cnverged Analytics withut migrating the Data in r ut HDFS (Eliminates the Limitatin f Traditinal Strage Systems) Cmpatible with any Hadp Based Applicatins ( Hive, Pig, Hbase, Tez, Sqp, Flume ) is designed t run efficiently bth memry intensive, IO-intensive and cmputatinal intensive applicatin in the same machine (with r withut GPUs sharing). Climate/Weather Gephysics CFD Energy Financial Services Mlecular Dynamics Cmputatinal Chemistry Biinfrmatics Analitycs / Big-Data Analytics/ Memry Intensive Cmputatin/IO Intensive

8 Frtissim Cnverged Filesystem FrtissimFS Engine prvides a unique cncurrent, ultrascalable, parallel, strage layer that incrprates in a prprietary way DRAM, NVMe and Flash delivering unmatched perfrmance. MVAPICH ptimized MVAPICH prvides advanced MPI 3 features (such as User Mde Memry Registratin - UMR, Dynamic Cnnected Transprt - DCT and Cre- Direct-based supprt fr Nn-blcking cllectives (Hardware supprted by KIRA Intercnnect). incrprates hybrid designs that use Shared memry, and IB channels ver hybrid Dragnfly-Flattened Butterfy tplgy that guarantee latency under 1us in the wrst case up t 1024 ndes. MVAPICH implementatin prvides a unified high-perfrmance runtime that supprts bth MPI and PGAS prgramming mdels n clusters. It enables develpers t prt parts f large MPI applicatins that are suited fr PGAS prgramming mdel. d The unified runtime als delivers superir perfrmance cmpared t using separate MPI and PGAS libraries by ptimizing the use f netwrk and memry resurces in cmbinatin with A3Cube distributed parallel file system engine (FrtissimFS ) MVAPICH supprts: Unified Parallel C (UPC) UPC++ OpenSHMEM Carray Frtran (CAF) as PGAS mdels It can be used t run: Supprt fr direct accelerate cmmunicatin fr Analytics framewrks: Acceleratin fr Apache Hbase Acceleratin Apache Spark Acceleratin Apache Hadp 2.x HDFS enterprise grade replacement with ultra lw latency and POSIX interface fr data access Pure MPI applicatins, MPI+OpenMP applicatin Pure UPC, pure UPC++ Pure OpenSHMEM Pure CAF Hybrid MPI(+OpenMP) + PGAS applicatins