HTC/HPC Russia-EC. V. Ilyin NRC Kurchatov Institite Moscow State University

Transcription

1 HTC/HPC Russia-EC V. Ilyin NRC Kurchatov Institite Moscow State University some slides, with thanks, used available by Ian Bird (CERN) Alexey Klimentov (CERN, BNL) Vladimir Voevodin )MSU) V. Ilyin meeting FP7 PICTURE, Minsk 21 May 2014

2 Megascience - How to make a discovery? LHC, FAIR, XFEL, NICA, ITER Accelerator Experiment Analysis (Computing) (Grid / Cloud) Big Data Discovery

3 Some history of scale Date Collaboration sizes Data volume, archive technology Late 1950 s 2-3 Kilobits, notebooks 1960 s kb, punchcards 1970 s ~35 MB, tape 1980 s ~100 GB, tape, disk WWW 1990 s TB, tape, disk GRID 2010 s ~3000 PB, tape, disk + cloud + BigData ++ For comparison: 1990 s: Total LEP data set ~few TB Would fit on 1 tape today Today: 1 year of LHC data ~25 PB Where does all this data come from? Ian.Bird@cern.ch / October

4 Эксперименты БАК технологический вызов в области компьютерной обработки данных Data flow to permanent storage: 4-6 GB/sec MB/sec 1-2 GB/sec ~ 4 GB/sec 1-2 GB/sec 4

5

6 Data flow in CMS at LHC В.А. Ильин В мире BigData, ИТМО 10 апреля 2014г.

7 WLCG: A global collaboration Tier-0 (CERN): Data recording Initial data reconstruction Data distribution Tier-1 (11 centres): Permanent storage Re-processing Analysis Tier-2 (~140 centres): Simulation End-user analysis Tier 0 Tier 1 Tier 2 ~150 sites >250k CPU cores >150 PB disk

8 Number of jobs at CMS sites in Russia and at all CMS sites: Oct Sept jobs were submitted to Russian CMS sites Total number of CMS jobs by country jobs 3% 8

9 Global transfers > 10 GB/s (1 day) Data transfers Global transfers (May-June) CERN Tier 1s (with LHC on): 2 GB/s Planned rates: Tier 0 Tier 1: 650 MB/s + margin

10 J. Incandela for the CMS COLLA J. Incandela for the CMS COLLABORATION July 4th 2012 The Status of the Higgs Search July 4th 2012 The Status of the Higgs Search H #gg candidate Evolution of the excess with time Ian.Bird@cern.ch / October

11 Computing model evolution Evolution of computing models Hierarchy Mesh / October

12 BigData Technologies For Mega- Science Workload and Data Management System LHC Upgrade Timeline. 100 times more data in /24/

13 PB Big Data Outlook 450,0 400,0 350,0 300,0 250,0 200,0 150,0 CMS ATLAS ALICE LHCb 100,0 50,0 0,0 Run 1 Run 2 Run 3 Run 4 Very rough estimate of a new RAW data per year of running using a simple extrapolation of current data volume scaled by the output rates. To be added: derived data (ESD, AOD), simulation, user data

14 From Grid to Cloud(s) In order to reduce complexity national or regional T1/T2 centers could transform themselves into Cloud regions Providing IaaS and reliable data services with very good network between the sites, dedicated links to T0

15 Big Data Has Arrived at an Almost Unimaginable Scale Library of congress Business s sent per year 3000 PBytes ATLAS Managed Data Volume 130 PBytes Climate Content Uploaded to Facebook each year. 182 PBytes ATLAS Annual Data Volume 30 PBytes LHC Annual 15 PBytes US census Google search index 98 PBytes Nasdaq Youtube 15 PBytes Health Records 30 PBytes 9/12/13 NEC

16 Russian WLCG Tier-1 status From 2011 Tier1 centers are under creation in Russia for all 4 LHC experiments: ATLAS, ALICE, LHCb in NRC Kurchatov Institute (Moscow) CMS in JINR (Dubna) Today prototypes of these Tier1 s are working in WLCG Should be in production work in WLCG to the RUN-2 (spring 2015) Russian Tier1 s to join world-wide Tier1 level in WLCG, which now includes: UK (Oxfrod), Germany (Karlsrhue), France (Lion), Spain (Barcelona), Italy (), North Europe, USA (FNAL, BNL), Kanada (Vancuver), Taiwan.

17 KI and JINR: networking status Using 2 Gbit/sec channel to GEANT and LHCONE (transit from NORDUnet) Peering with ESnet on LHCONE space, Internet2 should come soon Establishing peering with SARA/NIKHEF (physical transport is ready, waiting for 100G link between SARA and NIKHEF, ETA is next week)

18 KI: networking status Connected to LHCOPN since April 22th 2014 via CERN: 10 Gbit/sec link from Moscow to Amsterdam Second LHCOPN circuit (Moscow Budapest Amsterdam) is ready, but waiting for Wigner DC last mile fiber Exchanging traffic on LHCOPN with all other Tier-1 sites, but FNAL (should be fixed next week)

19 KI: assorted pictures

20 JINR: running jobs

21 HOPSA project ( ICT EU-Russia Coordinated Project (FP EU-Russia) HOPSA project HOlistic Performance System Analysis EU partners: Forschungszentrum Juelich GmbH (EU coordinator); Rogue Wave Software AB; Barcelona Supercomputing Center; German Research School for Simulation Sciences; Technical University Dresden. Russian partners: Research Computing Center, Moscow State University (Russian coordinator); T-Platforms; Joint Supercomputer Center, Russian Academy of Sciences; Scientific Research Institute of Multiprocessor Computer Systems, Southern Federal University.

22 APOS project ( ICT EU-Russia Coordinated Project (FP EU-Russia) APOS project Advanced Performance Optimisation and Scalability EU partners: the University of Edinburgh (EU coordinator); CAPS Enterprise; Uniwersytet Warszawski; TOTAL S.A.; Höchstleistungs-Rechenzentrum Stuttgart. Russian partners: the Keldysh Institute of Applied Mathematics (Russian coordinator); NRC Kurchatov Institute ; the Ugra Research Institute; the Moscow Institute of Physics and Technology (State University).

23 Supercomputing, USA ISC, Германия

24 Supercomputing 11: Cluster Challenge Student team of NNSU is a winner of the contest.

25 Informatics Europe Curriculum Best Practices Award The First Prize: a Joint Proposal of MSU-NNSU: Parallelism & Concurrency: Changing the Landscape of IT-Education

26 Supercomputing Leaders In Moscow State University J.Dongarra D.Kirk M.Kagan S.Scott B.Mohr T.Sterling W.-M.Hwu