Current Progress of Grid Project in KMA

Size: px
Start display at page:

Download "Current Progress of Grid Project in KMA"

Transcription

1 Current Progress of Grid Project in KMA CUG 2006 Kim, Hee-Sik Cray Korea Inc. This Presentation May Contain Some Preliminary Information, Subject To Change

2 Outline KMA s Cray X1E system Relationship between Cray and KMA Grid Grid Project at KMA UNICORE Current Status Future plan This Presentation May Contain Some Preliminary Information, Subject To Change 2

3 History of Supercomputer in Korea (Gflps) The Sequence of Halo Exchange GDPS T106 30L RSL_LITE_INIT_EXCH RSL_LITE_PACK NEC SX5 CRAY T3E RSL_LITE_EXCH_Y Gflops 115Gflops RSL_LITE_PACK CRAY C RSL_LITE_INIT_EXCH 16Gflops RSL_LITE_PACK RSL_LITE_EXCH_X Fujitsu VPX Cyber932 RSL_LITE_PACK Gflops 10 Cray-2S Gflops 1 RDPS MM5 30km 10km 5km 33L GDPS T213 30L NEC SX Gflops (Memory allocation for Y halo exchange) PC Cluster Gflops ENSE T106 30L (Local copy of halo region in Y direction) (Halo exchange in Y direction) (Copy to Y halo region of received data) IBM P IBM P Tflops (Memory 665.6Gflops allocation for X halo exchange) (Local copy of halo region in X direction) (Halo exchange in X direction) TeraCluster (Copy to X halo region of received data) CRAY X1E Tflops (year) This Presentation May Contain Some Preliminary Information, Subject To Change 3 NEC SX6 160Gflops High Performance computing resources in KMA and KISTI 2.9Tflops GDPS T426 40L ENSE T213 30L KISTI : Korea Institute of Science and Technology Information

4 The specification of KMA s Cray X1E system Ref CRAY X1E Installation CPU MSP Peak performance 18.5 TF CRAY X1E Main Memory Capacity of DAS Disk 4 TB 67 TB Capacity of SAN Disk 21 TB Capacity of Tape drive 1 PB ADIC Scalar 10K 1PB Functions For NWP Operation Research & Development This Presentation May Contain Some Preliminary Information, Subject To Change 4

5 Network Configuration This Presentation May Contain Some Preliminary Information, Subject To Change 5

6 Relationship between Cray and KMA Cray Korea supports KMA s role including code optimization and Grid project with 9 local engineers. The joint KMA-Cray Earth System Research Center (ESRC) Established by KMA and Cray. To promote the advancement of atmospheric modeling over the East Asia Pacific region. ESRC internship & Grant Projects ESRC Workshop Presenters 05 ESRC Workshop 05 ESRC Workshop Winners of 06 ESRC This Presentation May Contain Some Preliminary Information, Subject To Change Internship & Grant Project6

7 What is a Grid? 1001 definitions Distributed, networked computing & data resources Networking and computing infrastructure for utility computing Distributed platform for sharing scientific experiments and instruments The next generation of enterprise IT architecture The next generation of the Internet and the WWW Computing from the wall socket The Advanced Network... and 994 more * Wolfgang Gentzsch, This Presentation May Contain Some Preliminary Information, Subject To Change 7

8 What is a Grid? To integrate the distributed computing platforms via express network to share computing and data resources Computational Grid Data Grid Access Grid This Presentation May Contain Some Preliminary Information, Subject To Change 8

9 Grid Project at KMA Other Portal GISC User Other Observation User User Stakeholder Interface (Decision making) General User Interface Grid Portal (Web Service+Gridsphere) User Specific Interface User Specific Interface Application Component Application Component User Observation System Data Archiving Center Human Resource Access Grid Data Management System Data Base File System Data Grid High Performance Computing Computational Grid Interface (metadata, Security, Resource control Etc.) Data Broker, Interoperability, standard High Performance Network This Presentation May Contain Some Preliminary Information, Subject To Change 9

10 Current Status ROKAF NWP and model research APCC Climate research KMA HQ 4Gbps KMA KIDC SEOUL DWD Run a simple script successfully to DWD For MetGrid ROKAF APCC This Presentation May Contain Some Preliminary Information, Subject To Change 10

11 UNICORE? A vertically integrated Grid middleware system Provides seamless, secure, and intuitive access to distributed resources and data Used in production and project worldwide Features intuitive GUI with single sign-on matured job monitoring X.509 certificates interactive access with UNICORE-SSH only one opened port in firewall required workflow engine for compliex multi-site/multi-step workflows resource managments production quality, * Achim Streit, This Presentation May Contain Some Preliminary Information, Subject To Change 11

12 Why UNICORE Allow remote users to run on KMA supercomputer while minimizing security risks of unauthorized use Provide a simple interface to beginners in running meteorological applications on KMA supercomputer More practical to use operationally This Presentation May Contain Some Preliminary Information, Subject To Change 12

13 UNICORE Software package UNICORE S/W consists of 5 packages Client: Java based Gateway: Java based NJS (Network Job Supervisor): Java based UUDB (UNICORE User Data Base): Java based TSI (Target System Interface): Perl based UNICORE certificates web tool Perl based need openssl This Presentation May Contain Some Preliminary Information, Subject To Change 13

14 Install status Certificate Authority Install the general CA Create Gateway certificate, NJS certificate, User certificate Install web CA issue site in Login server Packages Client: PC Gateway: installed in Login server NJS: installed in Login server UUDB: installed in Login server TSI: installed in X1E ( with PBS ) Test to run simple job and meteorological application This Presentation May Contain Some Preliminary Information, Subject To Change 14

15 UNICORE structure with VPN VPN User -UNICORE Client Gateway -UNICORE Main Gateway -NJS, UUDB, TSI ( cross compile) Firewall KMA Intranet Login server - NJS, UUDB ( Job submit ) Cray X1 - TSI ( Job submit ) This Presentation May Contain Some Preliminary Information, Subject To Change 15

16 Running application on UNICORE DWD Gateway KMA Gateway This Presentation May Contain Some Preliminary Information, Subject To Change 16

17 Remote access to KMA s Cray X1E system APCC PC ROKAF PC other PC DWD V V P N Internet UNICORE Gateway P N It is impossible for everyone to connect with KMA Supercomputer except of someone who was certificated Authority by KMA DMZ UNICORE & PBS APCC : Asia Pacific Climate Center ROKAF : Republic of Korean Air Force intranet This Presentation May Contain Some Preliminary Information, Subject To Change 17

18 Future directions umeteo-k ubiquitous Meteorology-Korea: ubiquitous Korea for meteorological research cooperation system Data grid for climate prediction Data transportation Wu-Ftp Connecting Atmospheric e-science Data Grid Model output NCEP KMA KMA Model output Forecast output Supercom Model output Data input Data input NASA SNU Forecast output PKNU Observation data Forecast output NASA Model output KISTI Supercom This Presentation May Contain Some Preliminary Information, Subject To Change 18

19 Future directions MetGrid Purpose of MetGrid All major global weather forecasting centers Partners of METGRID Name System To share their global forecasts with each other as a multi-model ensemble To agree on areas of the world which merited further studies Current Status & Goal Simple UNICORE test with DWD Setting up UNICORE including user interface for 2nd Supercomputer System Sharing data and computational resources Set up a project for carrying out the study and agree on resources Start of pilot phase ( 01/2006 ~ ) CMA DWD ECMWF KMA Météo France NCAR UKMet IBM Power 4 IBM Power 3 IBM Power 4/5 CRAY X1E Fujitsu VPP 5000 IBM Power 3/4 NEC SX This Presentation May Contain Some Preliminary Information, Subject To Change 19

20 Current Progress of Grid Project in KMA Questions? / Comments! CUG 2006 Thank You! This Presentation May Contain Some Preliminary Information, Subject To Change

Victor Alessandrini IDRIS - CNRS

Victor Alessandrini IDRIS - CNRS Victor Alessandrini IDRIS - CNRS va@idris.fr Cooperative effort of national HPC centres, major HPC users and technology providers, to contribute to the development of computational grid infrastructures

More information

TIGGE and the EU Funded BRIDGE project

TIGGE and the EU Funded BRIDGE project TIGGE and the EU Funded BRIDGE project Baudouin Raoult Head of Data and Services Section ECMWF Slide 1 Slide 1 The TIGGE core dataset THORPEX Interactive Grand Global Ensemble Global ensemble forecasts

More information

The Development of Modeling, Simulation and Visualization Services for the Earth Sciences in the National Supercomputing Center of Korea

The Development of Modeling, Simulation and Visualization Services for the Earth Sciences in the National Supercomputing Center of Korea icas2013 (September 9~12, Annecy/France) The Development of Modeling, Simulation and Visualization Services for the Earth Sciences in the National Supercomputing Center of Korea Min-Su Joh, Joon-Eun Ahn,

More information

Computer Architectures and Aspects of NWP models

Computer Architectures and Aspects of NWP models Computer Architectures and Aspects of NWP models Deborah Salmond ECMWF Shinfield Park, Reading, UK Abstract: This paper describes the supercomputers used in operational NWP together with the computer aspects

More information

Scientific Computing with UNICORE

Scientific Computing with UNICORE Scientific Computing with UNICORE Dirk Breuer, Dietmar Erwin Presented by Cristina Tugurlan Outline Introduction Grid Computing Concepts Unicore Arhitecture Unicore Capabilities Unicore Globus Interoperability

More information

Progress on TIGGE Archive Center in CMA

Progress on TIGGE Archive Center in CMA THORPEX Interactive Grand Global Ensemble (TIGGE) Progress on TIGGE Archive Center in CMA China Meteorological Administration TIGGE-WG meeting, Boulder, 25-27 June Provider Summary Progress Overview Archive

More information

UNICORE Globus: Interoperability of Grid Infrastructures

UNICORE Globus: Interoperability of Grid Infrastructures UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057

More information

Applications and Tools for High-Performance- Computing in Wide-Area Networks

Applications and Tools for High-Performance- Computing in Wide-Area Networks Applications and Tools for High-Performance- Computing in Wide-Area Networks Dr.Alfred Geiger High-Performance Computing-Center Stuttgart (HLRS) geiger@hlrs.de Distributed Computing Scenarios Tools for

More information

PLAN-E Workshop Switzerland. Welcome! September 8, 2016

PLAN-E Workshop Switzerland. Welcome! September 8, 2016 PLAN-E Workshop Switzerland Welcome! September 8, 2016 The Swiss National Supercomputing Centre Driving innovation in computational research in Switzerland Michele De Lorenzi (CSCS) PLAN-E September 8,

More information

Shared Services Canada Environment and Climate Change Canada HPC Renewal Project

Shared Services Canada Environment and Climate Change Canada HPC Renewal Project Shared Services Canada Environment and Climate Change Canada HPC Renewal Project CUG 2017 Redmond, WA, USA Deric Sullivan Alain St-Denis & Luc Corbeil May 2017 Background: SSC's HPC Renewal for ECCC Environment

More information

Grid and Cloud Activities in KISTI

Grid and Cloud Activities in KISTI Grid and Cloud Activities in KISTI March 23, 2011 Soonwook Hwang KISTI, KOREA 1 Outline Grid Operation and Infrastructure KISTI ALICE Tier2 Center FKPPL VO: Production Grid Infrastructure Global Science

More information

Seasonal forecast modeling application on the GARUDA Grid infrastructure

Seasonal forecast modeling application on the GARUDA Grid infrastructure Seasonal forecast modeling application on the GARUDA Grid infrastructure 1, S. Janakiraman, Mohit Ved and B. B. Prahlada Rao Centre for Development of Advanced Computing CDAC Knowledge Park, Byappanahalli,

More information

WORLD METEOROLOGICAL ORGANIZATION CAgM/MG-2010/Doc ( ) COMMISSION FOR AGRICULTURAL METEOROLOGY AGENDA ITEM: 10 MANAGEMENT GROUP MEETING

WORLD METEOROLOGICAL ORGANIZATION CAgM/MG-2010/Doc ( ) COMMISSION FOR AGRICULTURAL METEOROLOGY AGENDA ITEM: 10 MANAGEMENT GROUP MEETING WORLD METEOROLOGICAL ORGANIZATION CAgM/MG-2010/Doc. 10.3 (20.01.2010) COMMISSION FOR AGRICULTURAL METEOROLOGY AGENDA ITEM: 10 MANAGEMENT GROUP MEETING GENEVA, SWITZERLAND 1 3 FEBRUARY 2010 Original: ENGLISH

More information

WAMIS Grid Portal Recent Implementation

WAMIS Grid Portal Recent Implementation WAMIS Grid Portal Recent Implementation from Web Portal to Grid Portal under WIS umbrella by Byong Lyol Lee Feb. 2010 National Center for AgroMeteorology, Seoul National University CALS/NICEM blleesnu@snu.ac.kr

More information

NVIDIA Update and Directions on GPU Acceleration for Earth System Models

NVIDIA Update and Directions on GPU Acceleration for Earth System Models NVIDIA Update and Directions on GPU Acceleration for Earth System Models Stan Posey, HPC Program Manager, ESM and CFD, NVIDIA, Santa Clara, CA, USA Carl Ponder, PhD, Applications Software Engineer, NVIDIA,

More information

GREASE Grid Aware End-to-end Analysis and Simulation Environment

GREASE Grid Aware End-to-end Analysis and Simulation Environment GREASE Grid Aware End-to-end Analysis and Simulation Environment Mark ter Linden 25 October 2002 Project! Started July 2002, ends June 2003 URD ready SSD, SVVP in progress Prototyping in progress Setup

More information

The next generation supercomputer. Masami NARITA, Keiichi KATAYAMA Numerical Prediction Division, Japan Meteorological Agency

The next generation supercomputer. Masami NARITA, Keiichi KATAYAMA Numerical Prediction Division, Japan Meteorological Agency The next generation supercomputer and NWP system of JMA Masami NARITA, Keiichi KATAYAMA Numerical Prediction Division, Japan Meteorological Agency Contents JMA supercomputer systems Current system (Mar

More information

CISL Update. 29 April Operations and Services Division

CISL Update. 29 April Operations and Services Division CISL Update Operations and Services CISL HPC Advisory Panel Meeting Anke Kamrath anke@ucar.edu Operations and Services Division Computational and Information Systems Laboratory 1 CHAP Meeting 14 May 2009

More information

The Architecture and the Application Performance of the Earth Simulator

The Architecture and the Application Performance of the Earth Simulator The Architecture and the Application Performance of the Earth Simulator Ken ichi Itakura (JAMSTEC) http://www.jamstec.go.jp 15 Dec., 2011 ICTS-TIFR Discussion Meeting-2011 1 Location of Earth Simulator

More information

Global Earth Observation System of Systems. GEO Secretariat Geneva, Switzerland

Global Earth Observation System of Systems. GEO Secretariat Geneva, Switzerland Global Earth Observation System of Systems GEO Secretariat Geneva, Switzerland Group on Earth Observations Intergovernmental Organization with 81 Members and 58 Participating Organizations (including WMO)

More information

NCEP HPC Transition. 15 th ECMWF Workshop on the Use of HPC in Meteorology. Allan Darling. Deputy Director, NCEP Central Operations

NCEP HPC Transition. 15 th ECMWF Workshop on the Use of HPC in Meteorology. Allan Darling. Deputy Director, NCEP Central Operations NCEP HPC Transition 15 th ECMWF Workshop on the Use of HPC Allan Darling Deputy Director, NCEP Central Operations WCOSS NOAA Weather and Climate Operational Supercomputing System CURRENT OPERATIONAL CHALLENGE

More information

The Logical Data Store

The Logical Data Store Tenth ECMWF Workshop on Meteorological Operational Systems 14-18 November 2005, Reading The Logical Data Store Bruce Wright, John Ward & Malcolm Field Crown copyright 2005 Page 1 Contents The presentation

More information

ALICE Grid Activities in US

ALICE Grid Activities in US ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions

More information

Introduction to ECMWF resources:

Introduction to ECMWF resources: Introduction to ECMWF resources: Computing and archive services. and how to access them Paul Dando User Support Paul.Dando@ecmwf.int advisory@ecmwf.int University of Reading - 23 January 2014 ECMWF Slide

More information

Just on time to face new challenges with NEC super-computer at Meteo-France

Just on time to face new challenges with NEC super-computer at Meteo-France Just on time to face new challenges with NEC super-computer at Meteo-France Agenda of the procurement Presentation of the first phase Installation phase (power supply, air cooling) Use of a porting machine

More information

Cluster Network Products

Cluster Network Products Cluster Network Products Cluster interconnects include, among others: Gigabit Ethernet Myrinet Quadrics InfiniBand 1 Interconnects in Top500 list 11/2009 2 Interconnects in Top500 list 11/2008 3 Cluster

More information

FUJITSU Cloud Service S5. Introduction Guide. Ver. 1.3 FUJITSU AMERICA, INC.

FUJITSU Cloud Service S5. Introduction Guide. Ver. 1.3 FUJITSU AMERICA, INC. FUJITSU Cloud Service S5 Introduction Guide Ver. 1.3 FUJITSU AMERICA, INC. 1 FUJITSU Cloud Service S5 Introduction Guide Ver. 1.3 Date of publish: September, 2011 All Rights Reserved, Copyright FUJITSU

More information

The EU-funded BRIDGE project

The EU-funded BRIDGE project from Newsletter Number 117 Autumn 2008 COMPUTING The EU-funded BRIDGE project doi:10.21957/t8axr71gg0 This article appeared in the Computing section of ECMWF Newsletter No. 117 Autumn 2008, pp. 29-32.

More information

Kenneth A. Hawick P. D. Coddington H. A. James

Kenneth A. Hawick P. D. Coddington H. A. James Student: Vidar Tulinius Email: vidarot@brandeis.edu Distributed frameworks and parallel algorithms for processing large-scale geographic data Kenneth A. Hawick P. D. Coddington H. A. James Overview Increasing

More information

Data Management Components for a Research Data Archive

Data Management Components for a Research Data Archive Data Management Components for a Research Data Archive Steven Worley and Bob Dattore Scientific Computing Division Computational and Information Systems Laboratory National Center for Atmospheric Research

More information

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or

More information

The Earth Simulator Current Status

The Earth Simulator Current Status The Earth Simulator Current Status SC13. 2013 Ken ichi Itakura (Earth Simulator Center, JAMSTEC) http://www.jamstec.go.jp 2013 SC13 NEC BOOTH PRESENTATION 1 JAMSTEC Organization Japan Agency for Marine-Earth

More information

Practical Scientific Computing

Practical Scientific Computing Practical Scientific Computing Performance-optimised Programming Preliminary discussion, 17.7.2007 Dr. Ralf-Peter Mundani, mundani@tum.de Dipl.-Ing. Ioan Lucian Muntean, muntean@in.tum.de Dipl.-Geophys.

More information

Grid Scheduling Architectures with Globus

Grid Scheduling Architectures with Globus Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents

More information

Approaches to I/O Scalability Challenges in the ECMWF Forecasting System

Approaches to I/O Scalability Challenges in the ECMWF Forecasting System Approaches to I/O Scalability Challenges in the ECMWF Forecasting System PASC 16, June 9 2016 Florian Rathgeber, Simon Smart, Tiago Quintino, Baudouin Raoult, Stephan Siemen, Peter Bauer Development Section,

More information

Index Introduction Setting up an account Searching and accessing Download Advanced features

Index Introduction Setting up an account Searching and accessing Download Advanced features ESGF Earth System Grid Federation Tutorial Index Introduction Setting up an account Searching and accessing Download Advanced features Index Introduction IT Challenges of Climate Change Research ESGF Introduction

More information

How LambdaGrids are Transforming Science"

How LambdaGrids are Transforming Science How LambdaGrids are Transforming Science" Keynote igrid2005 Calit2@UCSD La Jolla, CA September 29, 2005 Dr. Larry Smarr Director, California Institute for Telecommunications and Information Technology

More information

Unified Model Performance on the NEC SX-6

Unified Model Performance on the NEC SX-6 Unified Model Performance on the NEC SX-6 Paul Selwood Crown copyright 2004 Page 1 Introduction The Met Office National Weather Service Global and Local Area Climate Prediction (Hadley Centre) Operational

More information

FGCP/S5. Introduction Guide. Ver. 2.3 FUJITSU LIMITED

FGCP/S5. Introduction Guide. Ver. 2.3 FUJITSU LIMITED FGCP/S5 Introduction Guide Ver. 2.3 FUJITSU LIMITED FGCP/S5 Instruction Guide Ver. 2.3 Date of publish: July, 2012 All Rights Reserved, Copyright FUJITSU LIMITED No reproduction or republication without

More information

The Cray Rainier System: Integrated Scalar/Vector Computing

The Cray Rainier System: Integrated Scalar/Vector Computing THE SUPERCOMPUTER COMPANY The Cray Rainier System: Integrated Scalar/Vector Computing Per Nyberg 11 th ECMWF Workshop on HPC in Meteorology Topics Current Product Overview Cray Technology Strengths Rainier

More information

Earth System Sciences in the Times of Brilliant Technologies

Earth System Sciences in the Times of Brilliant Technologies Earth System Sciences in the Times of Brilliant Technologies ICES Biennial Workshop, Geneva, Switzerland Prof. Dr. Thomas Ludwig German Climate Computing Center (DKRZ) University of Hamburg, Department

More information

HPC Resources & Training

HPC Resources & Training www.bsc.es HPC Resources & Training in the BSC, the RES and PRACE Montse González Ferreiro RES technical and training coordinator + Facilities + Capacity How fit together the BSC, the RES and PRACE? TIER

More information

Fujitsu s Activities in Grid Computing

Fujitsu s Activities in Grid Computing Fujitsu s Activities in Grid Computing V Andreas Savva V Takumi Ouchi V Hiro Kishimoto (Manuscript received August 27, 2004) Fujitsu has been actively involved in the research and development of Grid computing:

More information

N. Marusov, I. Semenov

N. Marusov, I. Semenov GRID TECHNOLOGY FOR CONTROLLED FUSION: CONCEPTION OF THE UNIFIED CYBERSPACE AND ITER DATA MANAGEMENT N. Marusov, I. Semenov Project Center ITER (ITER Russian Domestic Agency N.Marusov@ITERRF.RU) Challenges

More information

Data Serving Climate Simulation Science at the NASA Center for Climate Simulation (NCCS)

Data Serving Climate Simulation Science at the NASA Center for Climate Simulation (NCCS) Data Serving Climate Simulation Science at the NASA Center for Climate Simulation (NCCS) MSST2011, May 24-25, 2011 Ellen Salmon ( Ellen.Salmon@nasa.gov ) High Performance Computing, Code 606.2 Computational

More information

The Icosahedral Nonhydrostatic (ICON) Model

The Icosahedral Nonhydrostatic (ICON) Model The Icosahedral Nonhydrostatic (ICON) Model Scalability on Massively Parallel Computer Architectures Florian Prill, DWD + the ICON team 15th ECMWF Workshop on HPC in Meteorology October 2, 2012 ICON =

More information

NCAR Computation and Information Systems Laboratory (CISL) Facilities and Support Overview

NCAR Computation and Information Systems Laboratory (CISL) Facilities and Support Overview NCAR Computation and Information Systems Laboratory (CISL) Facilities and Support Overview NCAR ASP 2008 Summer Colloquium on Numerical Techniques for Global Atmospheric Models June 2, 2008 Mike Page -

More information

ACET s e-research Activities

ACET s e-research Activities 18 June 2008 1 Computing Resources 2 Computing Resources Scientific discovery and advancement of science through advanced computing Main Research Areas Computational Science Middleware Technologies for

More information

Conference The Data Challenges of the LHC. Reda Tafirout, TRIUMF

Conference The Data Challenges of the LHC. Reda Tafirout, TRIUMF Conference 2017 The Data Challenges of the LHC Reda Tafirout, TRIUMF Outline LHC Science goals, tools and data Worldwide LHC Computing Grid Collaboration & Scale Key challenges Networking ATLAS experiment

More information

Supercomputing at the United States National Weather Service (NWS)

Supercomputing at the United States National Weather Service (NWS) Supercomputing at the United States National Weather Service (NWS) Rebecca Cosgrove Deputy Director, NCEP Central Operations United States National Weather Service 18th Workshop on HPC in Meteorology September

More information

The Center for Computational Research & Grid Computing

The Center for Computational Research & Grid Computing The Center for Computational Research & Grid Computing Russ Miller Center for Computational Research Computer Science & Engineering SUNY-Buffalo Hauptman-Woodward Medical Inst NSF, NIH, DOE NIMA, NYS,

More information

Advanced Topics in Computer Architecture

Advanced Topics in Computer Architecture Advanced Topics in Computer Architecture Lecture 7 Data Level Parallelism: Vector Processors Marenglen Biba Department of Computer Science University of New York Tirana Cray I m certainly not inventing

More information

The PRISM infrastructure System Architecture and User Interface

The PRISM infrastructure System Architecture and User Interface The PRISM infrastructure System Architecture and User Interface Claes Larsson ECMWF UK PRISM Hamburg D&M presentation p.1/20 Architecture goals PRISM architecture to provide an efficient climate modelling

More information

The NASA/GSFC Advanced Data Grid: A Prototype for Future Earth Science Ground System Architectures

The NASA/GSFC Advanced Data Grid: A Prototype for Future Earth Science Ground System Architectures The NASA/GSFC Advanced Data Grid: A Prototype for Future Earth Science Ground System Architectures Samuel D. Gasster, Craig A. Lee, Brooks Davis, Matt Clark, Mike AuYeung, John R. Wilson Computer Systems

More information

Garuda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore.

Garuda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore. Garuda : The National Grid Computing Initiative Of India Natraj A.C, CDAC Knowledge Park, Bangalore. natraj@cdacb.ernet.in 1 Agenda About CDAC Garuda grid highlights Garuda Foundation Phase EU-India grid

More information

New Approaches To Challenges Facing Enterprise ICT

New Approaches To Challenges Facing Enterprise ICT New Approaches To Challenges Facing Enterprise ICT April 7, 2015 Gideon Senderov Director, Advanced Storage NEC Corporation of America Contents Introduction to NEC Challenges faced by enterprises today

More information

DVS, GPFS and External Lustre at NERSC How It s Working on Hopper. Tina Butler, Rei Chi Lee, Gregory Butler 05/25/11 CUG 2011

DVS, GPFS and External Lustre at NERSC How It s Working on Hopper. Tina Butler, Rei Chi Lee, Gregory Butler 05/25/11 CUG 2011 DVS, GPFS and External Lustre at NERSC How It s Working on Hopper Tina Butler, Rei Chi Lee, Gregory Butler 05/25/11 CUG 2011 1 NERSC is the Primary Computing Center for DOE Office of Science NERSC serves

More information

GPU Developments in Atmospheric Sciences

GPU Developments in Atmospheric Sciences GPU Developments in Atmospheric Sciences Stan Posey, HPC Program Manager, ESM Domain, NVIDIA (HQ), Santa Clara, CA, USA David Hall, Ph.D., Sr. Solutions Architect, NVIDIA, Boulder, CO, USA NVIDIA HPC UPDATE

More information

Enabling BigData Workflows in Earth Observation Science

Enabling BigData Workflows in Earth Observation Science Enabling BigData Workflows in Earth Observation Science A RESEARCH NETWORKING PERSPECTIVE Jakob Tendel Maria Minaricova DFN GÉANT Outline Research and Education Networking National Research and Education

More information

Kepler Scientific Workflow and Climate Modeling

Kepler Scientific Workflow and Climate Modeling Kepler Scientific Workflow and Climate Modeling Ufuk Turuncoglu Istanbul Technical University Informatics Institute Cecelia DeLuca Sylvia Murphy NOAA/ESRL Computational Science and Engineering Dept. NESII

More information

Supercomputer and grid infrastructure! in Poland!

Supercomputer and grid infrastructure! in Poland! Supercomputer and grid infrastructure in Poland Franciszek Rakowski Interdisciplinary Centre for Mathematical and Computational Modelling 12th INCF Nodes Workshop, 16.04.2015 Warsaw, Nencki Institute.

More information

Travelling securely on the Grid to the origin of the Universe

Travelling securely on the Grid to the origin of the Universe 1 Travelling securely on the Grid to the origin of the Universe F-Secure SPECIES 2007 conference Wolfgang von Rüden 1 Head, IT Department, CERN, Geneva 24 January 2007 2 CERN stands for over 50 years of

More information

Distributed Online Data Access and Analysis

Distributed Online Data Access and Analysis Distributed Online Data Access and Analysis Ruixin Yang George Mason University Slides from SIESIP Partners and from NOMADS PI, Glenn K. Rutledge of US NCDC on NOMADS SIESIP: Seasonal-to-Interannual Earth

More information

ECMWF's Next Generation IO for the IFS Model and Product Generation

ECMWF's Next Generation IO for the IFS Model and Product Generation ECMWF's Next Generation IO for the IFS Model and Product Generation Future workflow adaptations Tiago Quintino, B. Raoult, S. Smart, A. Bonanni, F. Rathgeber, P. Bauer ECMWF tiago.quintino@ecmwf.int ECMWF

More information

Status and Prospect of QA/QC Activities in GAW Central Facilities of JMA

Status and Prospect of QA/QC Activities in GAW Central Facilities of JMA Status and Prospect of QA/QC Activities in GAW Central Facilities of JMA Hiroshi Koide Japan Meteorological Agency Tsunami Damages around the GAW Regional Station at Ryori Tsunami Inundation Area kilo

More information

Toward the Development of a Comprehensive Data & Information Management System for THORPEX

Toward the Development of a Comprehensive Data & Information Management System for THORPEX Toward the Development of a Comprehensive Data & Information Management System for THORPEX Mohan Ramamurthy, Unidata Steve Williams, JOSS Jose Meitin, JOSS Karyn Sawyer, JOSS UCAR Office of Programs Boulder,

More information

Overview of HPC at LONI

Overview of HPC at LONI Overview of HPC at LONI Le Yan HPC Consultant User Services @ LONI What Is HPC High performance computing is to use supercomputers to solve problems computationally The most powerful supercomputer today

More information

Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners

Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners Building a Global Data Federation for Climate Change Science The Earth System Grid (ESG) and International Partners 24th Forum ORAP Cite Scientifique; Lille, France March 26, 2009 Don Middleton National

More information

What SMT can do for You. John Hague, IBM Consultant Oct 06

What SMT can do for You. John Hague, IBM Consultant Oct 06 What SMT can do for ou John Hague, IBM Consultant Oct 06 100.000 European Centre for Medium Range Weather Forecasting (ECMWF): Growth in HPC performance 10.000 teraflops sustained 1.000 0.100 0.010 VPP700

More information

Introduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill

Introduction to FREE National Resources for Scientific Computing. Dana Brunson. Jeff Pummill Introduction to FREE National Resources for Scientific Computing Dana Brunson Oklahoma State University High Performance Computing Center Jeff Pummill University of Arkansas High Peformance Computing Center

More information

Historical Disaster Data Grid for Natural Disaster Events

Historical Disaster Data Grid for Natural Disaster Events Historical Disaster Data Grid for Natural Disaster Events Prof. Guoqing Li CEODE, CAS 11 March, 2010 Presented to 4th GEO-AP Symposium, Bali, Indonesia Why we need Historical Disaster Data? Global distribution

More information

Update on Cray Activities in the Earth Sciences

Update on Cray Activities in the Earth Sciences Update on Cray Activities in the Earth Sciences Presented to the 13 th ECMWF Workshop on the Use of HPC in Meteorology 3-7 November 2008 Per Nyberg nyberg@cray.com Director, Marketing and Business Development

More information

The Earth Simulator System

The Earth Simulator System Architecture and Hardware for HPC Special Issue on High Performance Computing The Earth Simulator System - - - & - - - & - By Shinichi HABATA,* Mitsuo YOKOKAWA and Shigemune KITAWAKI The Earth Simulator,

More information

Status of KISTI Tier2 Center for ALICE

Status of KISTI Tier2 Center for ALICE APCTP 2009 LHC Physics Workshop at Korea Status of KISTI Tier2 Center for ALICE August 27, 2009 Soonwook Hwang KISTI e-science Division 1 Outline ALICE Computing Model KISTI ALICE Tier2 Center Future Plan

More information

Sami Saarinen Peter Towers. 11th ECMWF Workshop on the Use of HPC in Meteorology Slide 1

Sami Saarinen Peter Towers. 11th ECMWF Workshop on the Use of HPC in Meteorology Slide 1 Acknowledgements: Petra Kogel Sami Saarinen Peter Towers 11th ECMWF Workshop on the Use of HPC in Meteorology Slide 1 Motivation Opteron and P690+ clusters MPI communications IFS Forecast Model IFS 4D-Var

More information

FUJITSU PHI Turnkey Solution

FUJITSU PHI Turnkey Solution FUJITSU PHI Turnkey Solution Integrated ready to use XEON-PHI based platform Dr. Pierre Lagier ISC2014 - Leipzig PHI Turnkey Solution challenges System performance challenges Parallel IO best architecture

More information

NEC SX Series and Its Applications to Weather and Climate Modeling

NEC SX Series and Its Applications to Weather and Climate Modeling The 4th International Workshop on Next Generation Climate Models for Advanced High Performance Computing Facilities NEC SX Series and Its Applications to Weather and Climate Modeling March 13, 2002 Hiroshi

More information

Advanced School in High Performance and GRID Computing November Introduction to Grid computing.

Advanced School in High Performance and GRID Computing November Introduction to Grid computing. 1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste

More information

Building Effective CyberGIS: FutureGrid. Marlon Pierce, Geoffrey Fox Indiana University

Building Effective CyberGIS: FutureGrid. Marlon Pierce, Geoffrey Fox Indiana University Building Effective CyberGIS: FutureGrid Marlon Pierce, Geoffrey Fox Indiana University Some Worthy Characteristics of CyberGIS Open Services, algorithms, data, standards, infrastructure Reproducible Can

More information

Brand-New Vector Supercomputer

Brand-New Vector Supercomputer Brand-New Vector Supercomputer NEC Corporation IT Platform Division Shintaro MOMOSE SC13 1 New Product NEC Released A Brand-New Vector Supercomputer, SX-ACE Just Now. Vector Supercomputer for Memory Bandwidth

More information

Leveraging the InCommon Federation to access the NSF TeraGrid

Leveraging the InCommon Federation to access the NSF TeraGrid Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois at Urbana-Champaign jbasney@ncsa.uiuc.edu

More information

Outline. March 5, 2012 CIRMMT - McGill University 2

Outline. March 5, 2012 CIRMMT - McGill University 2 Outline CLUMEQ, Calcul Quebec and Compute Canada Research Support Objectives and Focal Points CLUMEQ Site at McGill ETS Key Specifications and Status CLUMEQ HPC Support Staff at McGill Getting Started

More information

An evaluation of the Performance and Scalability of a Yellowstone Test-System in 5 Benchmarks

An evaluation of the Performance and Scalability of a Yellowstone Test-System in 5 Benchmarks An evaluation of the Performance and Scalability of a Yellowstone Test-System in 5 Benchmarks WRF Model NASA Parallel Benchmark Intel MPI Bench My own personal benchmark HPC Challenge Benchmark Abstract

More information

Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom

Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom The Met Office s Logical Store Bruce Wright, John Ward, Malcolm Field, Met Office, United Kingdom Background are the lifeblood of the Met Office. However, over time, the organic, un-governed growth of

More information

Distributed Data Management with Storage Resource Broker in the UK

Distributed Data Management with Storage Resource Broker in the UK Distributed Data Management with Storage Resource Broker in the UK Michael Doherty, Lisa Blanshard, Ananta Manandhar, Rik Tyer, Kerstin Kleese @ CCLRC, UK Abstract The Storage Resource Broker (SRB) is

More information

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT. Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies

More information

UNICORE - From Project Results to Production Grids

UNICORE - From Project Results to Production Grids UNICORE - From Project Results to Production Grids A. Streit, D. Erwin, Th. Lippert, D. Mallmann, R. Menday, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, and Ph. Wieder John von Neumann-Institute for

More information

The Grid: Feng Shui for the Terminally Rectilinear

The Grid: Feng Shui for the Terminally Rectilinear The Grid: Feng Shui for the Terminally Rectilinear Martha Stewart Introduction While the rapid evolution of The Internet continues to define a new medium for the sharing and management of information,

More information

Journey Towards Science DMZ. Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia

Journey Towards Science DMZ. Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia Malaysia's Computational Journey Towards Science DMZ Suhaimi Napis Technical Advisory Committee (Research Computing) MYREN-X Universiti Putra Malaysia suhaimi@upm.my In the Beginning... Research on parallel/distributed

More information

The Center for Computational Research

The Center for Computational Research The Center for Computational Research Russ Miller Director, Center for Computational Research UB Distinguished Professor, Computer Science & Engineering Senior Research Scientist, Hauptman-Woodward Medical

More information

ADRIAN and SUPERCOMPUTING.

ADRIAN and SUPERCOMPUTING. ADRIAN and SUPERCOMPUTING walter@zwieflhofer.eu 1 TIMELINE UoR 1978 Head of Numerical Aspects Section Head of Model/Data Division 1992/1995 2007 CDC 2 1972-1978 CDC 6600 designed by S. Cray Simplified

More information

Practical Scientific Computing

Practical Scientific Computing Practical Scientific Computing Performance-optimized Programming Preliminary discussion: July 11, 2008 Dr. Ralf-Peter Mundani, mundani@tum.de Dipl.-Ing. Ioan Lucian Muntean, muntean@in.tum.de MSc. Csaba

More information

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi GRIDS INTRODUCTION TO GRID INFRASTRUCTURES Fabrizio Gagliardi Dr. Fabrizio Gagliardi is the leader of the EU DataGrid project and designated director of the proposed EGEE (Enabling Grids for E-science

More information

APAC: A National Research Infrastructure Program

APAC: A National Research Infrastructure Program APSR Colloquium National Perspectives on Sustainable Repositories 10 June 2005 APAC: A National Research Infrastructure Program John O Callaghan Executive Director Australian Partnership for Advanced Computing

More information

Asia Pacific and European initiatives in HPC and PRP - South Korea

Asia Pacific and European initiatives in HPC and PRP - South Korea National Institute of Supercomputing and Networking SCAsia2018@Singapore Asia Pacific and European initiatives in HPC and PRP - South Korea Jeonghoon Moon 27 th Mar. 2018 National Institute of Supercomputing

More information

Second workshop for MARS administrators

Second workshop for MARS administrators Second workshop for MARS administrators MARS at ECMWF Manuel Fuentes Sebastien Villaume, Tiago Quintino, Baudouin Raoult mars@ecmwf.int mars-admin@lists.ecmwf.int ECMWF March 9, 2016 Outline Site configuration

More information

South African Science Gateways

South African Science Gateways Co-ordination & Harmonisation of Advanced e-infrastructures for Research and Education Data Sharing Research Infrastructures Grant Agreement n. 306819 South African Science Gateways Bruce Becker, Coordinator,

More information

Introduction to computing resources

Introduction to computing resources Introduction to computing resources Paul Dando User Support advisory@ecmwf.int Slide 1 20 W 15 W 20 W 15 W 10 W 10 W 5 W 800 5 W 200 0 40 N 35 N 30 N 0 5 E 10 E 10 E 5 E Overview Web services (ECaccess,

More information

The EGEE-III Project Towards Sustainable e-infrastructures

The EGEE-III Project Towards Sustainable e-infrastructures The EGEE-III Project Towards Sustainable e-infrastructures Erwin Laure EGEE-III Technical Director Erwin.Laure@cern.ch www.eu-egee.org EGEE-II INFSO-RI-031688 EGEE and glite are registered trademarks EGEE

More information

Deutscher Wetterdienst

Deutscher Wetterdienst Porting Operational Models to Multi- and Many-Core Architectures Ulrich Schättler Deutscher Wetterdienst Oliver Fuhrer MeteoSchweiz Xavier Lapillonne MeteoSchweiz Contents Strong Scalability of the Operational

More information