The Development of Modeling, Simulation and Visualization Services for the Earth Sciences in the National Supercomputing Center of Korea

Transcription

1 icas2013 (September 9~12, Annecy/France) The Development of Modeling, Simulation and Visualization Services for the Earth Sciences in the National Supercomputing Center of Korea Min-Su Joh, Joon-Eun Ahn, Oh-kyoung Kwon Supercomputing Service Center National Institute of Supercomputing & Networking Korea Institute of Science and Technology Information

2 Presentation Outline Ⅰ Infrastructure Supercomputer, Network Ⅱ User Support Government supported Research Institute Personnel : About 350 Annual revenue : USD 120M Location : Daejeon Users, Requirements, Services Ⅲ Achievements Modeling, Simulation, Visualization Ⅳ Future Plans Decision Making Support System

3 I.1 Supercomputer (1/2) 호기 4th 1st 2nd 3rd 2016? 30PF? GF 16GF 131GF 242GF 786GF 5.2 TF 8.6 TF 29.9 TF TF 01/20

4 I.1 Supercomputer (2/2) KISTI Machine Room Total TF Nick Name GAIA 1 GAIA 2 TACHYON 1 TACHYON 2 Processor Type POWER GHz POWER6 5.0 GHz AMD B. 2.0 GHz Intel X GHz No. of Node No. of Core 640 1,536 3,008 (3,072) 25,408 (25,600) Peak Performance (TF) (24.6) (299.5) Disk Storage (TB) Official Service Open Jan., 2008 Oct., 2009 Sep., 2008 Jan., 2011 Operation Period 6 year 4 year 5 year 3 year Service Close (plan) June, 2014 Dec., 2014 Dec., 2015? 02/20

5 I.2 Network (1/2) KREONET Korea Research Environment Open NETwork National Research Network for R&D community in Korea National-wide Optical Gigabit Network Facility (10~200Gbps) 강릉 Seoul 200Gbps Daejeon 10Gbps 인천 10Gbps 서울송도 10Gbps 수원오창 200Gbps 천안 10Gbps 10Gbps 대전 10Gbps Pohang 10Gbps 20Gbps 대구 포항 전주 90Gbps 울산 Gwangju Busan 광주 40Gbps 80Gbps 창원 부산 HQ Daejeon Regional Center (4) - Seoul, Gwangju, Busan, Pohang 10Gbps 제주 03/20

6 I.2 Network (2/2) GLORIAD GLObal RIng Network for Advanced Application Development Global Research Network for R&D community in the world World-wide Optical Gigabit Network Facility (10Gbps) 04/20

7 Ocean A / O ATMOS. II.1 Major Users Operation Research Dedicated nodes (gaia1-2, gaia2-1) Dedicated nodes (tachyon2-200) Dedicated nodes (tachyon2-250) KISTI is a KMA s Backup Site. Dedicated nodes (tachyon2-100) Dedicated nodes (tachyon2-200) 05/20

8 II.2 Requirements Providing Scientific & Technological Support for Modeling Model Development Simulation Numerical Experiment Visualization Data Analysis Huge Computing Resources Easy Available Environment Realistic Visual Representation 06/20

9 MPI wall time (s) II.3 Services (1/3) speed up( n) Modeling single process run time multiple processes (n) run time Supporting Code Optimization & Providing Computing Resources SPH DFS 100% 99.5% 99% T510 Speedup % 1000 T254 openmpi : > 4096 cores X T126 2 mvapich1,2 : mpi_alltoallv X Number of CPUs The number of CPUs - Computing Resources ( > 2000 cores ~ 24 TF ) - Parallel library & Optimization - Model Development - Model Operation 07/20

10 II.3 Services (2/3) Simulation Providing Easy Available Environment MPP Gaia2 Cluster Tachyon2 Select computing system Web-Based User Interface, WUI Analysis simulation results 08/20

11 II.3 Services (3/3) Visualization Realistic Visual Representation AvizoGree n 09/20

12 III.1 Achievements (1/6) Modeling Supporting the Development of the Numerical Model GRIMs (Global Regional Integrated Model system) Improving the Scalability of MPI code up to 4,000 cores with YONSEI University. Supporting the Ocean Data Assimilation System using MOM4 (Modular Ocean Model 4) Memory Optimization of MPI code with Korea Institute of Ocean Science & Technology. Developing the High-resolution Regional Ocean Model based on MOM4 Optimization up to 36*43 grids per the partitioned domain using 640 cores Getting ready for much high-resolution domains 09/20

13 III.2 Achievements (2/6) Modeling Provided by YONSEI CPU : 200 core Memory : 100 GB Provided by YONSEI 10/20

14 III.3 Achievements (3/6) Simulation Design & Implementation of Web/GRID KSC ~ CAM3 Web Portal (new) MM5 GRID Portal (new) WRF GRID Portal (new) WRF Web Portal (new) WRF Web Portal (modified) GRIMS Web Portal (new) WRF Web Portal (modified) + GRIMS Web Portal (modified) KSC 2 nd Supercomputer (NEC SX-6) KSC GRID Testbed (Cluster) KSC GRID Testbed (Cluster) KSC 4 th Supercomputer (Cluster) KSC 4 th Supercomputer (Cluster) KSC 4 th Supercomputer (Cluster) Sun Blade 6275 Intel Nehalem 2.93 GHz NEC SX-6 PVP Rpeak : 160GF Memory : 128GB CPU # : 16 8 core/node (4 core/2 socket) 3200 node 76.8 TB (24 GB/node) TF 11/20

15 III.3 Achievements (4/6) Simulation 12/20

16 III.3 Achievements (5/6) Visualization Realistic Visual Representation Communication, Ocean, Meteorological Satellite (the 7 th meteorological satellite in the world) WRF Model Prediction ( :00 KST) COMS Observation ( :00 KST) 13/20

17 III.3 Achievements (6/6) Ocean Atmosphere Monthly mean potential temperature (upper) and salinity (bottom) of January visualized by VAPOR2.2.4 (will be released soon) Provided by CHAOS KISTI 14/20

18 III.4 DMSS (Prototype) Decision Making Support System (Prototype) In the preparation of Typhoon-induced flood-disaster Observation Data Colleting System Prediction Data Generating System Analysis Data Visualization System Related to the Old Project: (Period) 2007 ~ 2010 (Fund) USD 2.2M for 2.5 year 15/20

19 IV.1 DMSS (Service System) Engineering Challenge : Design & Deployment Observation Prediction Analysis Visualization Related to the New Project: (Period) 2014 ~ 2018 (Fund) USD 3M for every year 16/20

20 IV. 2 Fine Resolution Modeling Scientific Challenge : Accuracy Improvement Model Development 15km 60km Model Validation Next Generation Weather Prediction Model (MPAS) Typhoon Simulation Bolaven & TEMBIN Done by SHPark (NCAR Scientist) using KISTI Supercomputer (August 22, 2013) 17/20

21 IV.3 Coupling Simulation (Portals) GRIMs WRF Regional Modeling Coupling of KSC-GRIMs & KSC-WRF portal WRF can use GRIMs Output directly 18/20

22 IV.4 Realistic Visualization Ocean 1 Ocean 2 Flying Mode Satellite Mode Flying Flood 19/20

23 KISTI New Computer Building Construction 2014 January ~ 2014 December Building ~ 8,000 M*M Computer Room ~1,500 M*M 20/20

24 Thank You!