The Earth Simulator Current Status SC13. 2013 Ken ichi Itakura (Earth Simulator Center, JAMSTEC) http://www.jamstec.go.jp 2013 SC13 NEC BOOTH PRESENTATION 1
JAMSTEC Organization Japan Agency for Marine-Earth Science and Technology Research Institute for Global Change Institute for Research on Earth Evolution Institute of Biogeosciences Research Sector (700) Leading Project Laboratory System Research Support Department Kochi Institute for Core Sample Research Mutsu Institute for Oceanography Development and Promotion Sector (300) Marine Technology Center Data Research Center for Marine-Earth Sciences Earth Simulator Center Center for Deep Earth Exploration Advanced Research and Technology Promotion Department Management Sector (100) Planning Administration Dept. Dept. Safety and Environment Management Office Finance and Contracts Dept. Audit and Compliance Office 2013 SC13 NEC BOOTH PRESENTATION 2
Location of Earth Simulator Facilities Tokyo Yokohama Earth Simulator Site Yokosuka Headquarter 2013 SC13 NEC BOOTH PRESENTATION 3
Earth Simulator Earth Simulator March, 2002 ~ March.2009 (1/2 : ~ Sep.2008) Peak Performance : 40 T Flops Main Memory : 10 T Bytes Earth Simulator(ES2) March, 2009 ~ Peak Performance : 131 T Flops Main Memory : 20 T Bytes 2013 SC13 NEC BOOTH PRESENTATION 4
ES2 System outline Labs, User Terminals 10GbE (partially link aggregation 40GbE) User Network Processor nodes (PNs) Login server Storage server Usable Capacity 1.5PB RAID6 HDD SX-9/E 160 processor nodes (PNs) (including interactive 2nodes) Total peak performance 131TFLOPS Total main memory 20TB Data storage system 500TB Inter nodes network (IXS) 64GB/sec (bidirectional) /node Operation Network Maintenance Network 4Gbps Fiber Channel SAN (Storage Area Network) FC Switch FC Switch FC Switch NQS2 batch job system on PNs Agent request support Use statistical and resource information management Automatic power saving management Operation Servers 2013 SC13 NEC BOOTH PRESENTATION Maximum power consumption 3000kVA 5
TOP500 Rank ES 22nd ES2 94th 145th 2002 2002 2003 217 th in ember 2012 (18 th in Japan) Peak performance ratio is 93.38% (2nd in the world) 2003 2004 2004 2005 2005 2006 2006 2007 系列 1 1 1 1 1 1 3 4 7 10 14 20 30 49 73 22 31 37 54 68 94 145 217 2007 2008 2008 2009 2009 2010 2010 2011 217th 2011 2012 2012 2013 342nd 2013 472nd 2013 SC13 NEC BOOTH PRESENTATION 6
HPC Challenge Benchmark HPC Challenge Awards Class1 Best performance on a base or optimized run submitted to the HPC Challenge website. The benchmarks to be judged are: Global HPL, Global RandomAccess, EP STREAM (Triad) per system and Global FFT. http://www.hpcchallenge.org/ System TOP500(Linpack) #cores G FFT Effective Ratio #cores JAMSTEC ES2 (SX 9) Rank 217 122 TF 1,280 Rank 3 11.9 TF 9.1 % 1,280 RIKEN AICS (K Computer) Rank 3 10,510 TF 705,024 Rank 1 205.9 TF 1.94 % 663,552 Ratio x 86 x 550 x 17.3 x 4.7 x 519 2013 SC13 NEC BOOTH PRESENTATION 7
JAMSTEC Research Projects 40% Research projects organized by JAMSTEC and Collaboration Projects Projects FY2013 Funded research and Industrial Use Program for Risk Information on Climate Change (SOUSEI) 27% (3 themes) Proposed Research Projects 30% Earth Science 30% (24 Projects) The Strategic Industrial Use 3% Contract Research Projects 30% Total resource 1,300,000 node hour L batch nodes 156 * 24 hour * (365 17.7 maintenance days) 2013 SC13 NEC BOOTH PRESENTATION 8
515 Users 137 Organizations (January 2013) 64 Universities, 15 Labs, 41 Companies, 17 Overseas 250 Users 200 150 海外 Overseas 民間企業 Companies 公的機関 Labs 大学 Universities 100 50 0 2002 2003 2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 SC13 NEC BOOTH PRESENTATION 9
Operation Results October 31th, 2013 Over 90% operation was achieved. 2013 SC13 NEC BOOTH PRESENTATION 10
Post-ES2 system 2013 SC13 NEC BOOTH PRESENTATION 11
The Earth Simulator Roadmap FY 2007 2008 2009 2010 2011 2012 2013 2014 2015 2016 2017 2018 2019 2020 ES Operation until March 2009 Half system operation, data migration ES2 Future System 6 years operation from March 2009 to February 2015 3rd system (5 years?) FS target 4th system 2013 SC13 NEC BOOTH PRESENTATION 12
Positioning of ES in JAMSTEC long-term vision Observational data of the real world Verification and accuracy improvement of modeling One employment of observation and a simulation is a strong point of JAMSTEC. (i) (ii) (iii) (iv) long-term vision (Next 15 years) Analysis and prediction of global environment change Plate dynamics and disaster prevention research of an earthquake and tsunami Evolution of a life, and the history of a sea life Resource engineering of a material and energy 2013 SC13 NEC BOOTH PRESENTATION 13
Science Targets for the post-es2 Global environment change Submesoscale (ensemble calculations) Extreme Events Prediction, Guerrilla rainstorm, urban heat island Nesting/downscaling data assimilation Earthquake, Tsunami Seismic tomography, plate tectonics, database of earthquake scenarios Information of the optimal evacuation route/place from tsunami Geo-marine-bio science New Evolution of a life, and the history of a sea life Life model building which took in the information on a meta-genome High technology development New Resource engineering of a material and energy High resolution analysis of VIV( Vortex Induced Vibration) problem with long cable The on-the-ocean operation real-time supporting system of a vessel Planning of the energy-saving efficient operation schedule of a vessel 2013 SC13 NEC BOOTH PRESENTATION 14
Request from JAMSTEC Researchers Relative Peak Performance (v.s. ES2) B/F Throughput Relative Memory Capacity Fig.1 Calculation Power and Memory Capacity (v.s. ES2) Fig.2 Architecture classification High Peak Performance In order to advance main researches of the earth science field in post-es2, (1) 10 times or more faster calculation performance, (2) and 5 times or 10 bigger memory capacity are need on the assumption that resource allocation and execution efficiency comparable as ES2. There are many users who are thinking the B/F performance as important and this can be called common view from the position of promoting earth science. 2013 SC13 NEC BOOTH PRESENTATION 15
Key point of post-es2 Peak Performance: 1.3~13PFlops (10 times or more faster than ES2) Memory Capacity: 100~200TB (5 times or 10 times bigger than ES2) Storage Capacity: 10~20PB (5 times or 10 times bigger than ES2) High data bandwidth between CPU and main memory (High B/F) Cooperation with other small systems Shared memory based storage Cooperation job scheduler system The most important problem is a benchmark program for an assessment system. Communication with a main user is required. 2013 SC13 NEC BOOTH PRESENTATION 16
ES2 current operation Summary 6 years operation from March 2009 to February 2015 Top 500 rank :217 th and HPCC G-FFT: 3rd in ember 2012 Calculation resource is centralized on earth science. Future Plan (1) Feasibility Study of exa-scale system in 2018 or later. (2) Post-ES2 system in March 2015. Peak Performance: 1.3~13PFlops (10 times or more faster than ES2) Memory Capacity: 100~200TB (5 times or 10 times bigger than ES2) High data bandwidth between CPU and main memory (High B/F) Cooperation with other small systems The main user required benchmark programs for an assessment system are need. 2013 SC13 NEC BOOTH PRESENTATION 17
Japan Agency for Marine-Earth Science and Technology JAMSTEC Thank you for your kind attention! Visit JAMSTEC at booth #2545 2013 SC13 NEC BOOTH PRESENTATION 18