RES updates, resources and Access European HPC ecosystem. Sergi Girona RES Coordinator

Transcription

1 RES updates, resources and Access European HPC ecosystem Sergi Girona RES Coordinator

2 RES: HPC Services for Spain The RES was created in It is coordinated by the Barcelona Supercomputing Center (BSC-CNS). It forms part of the Spanish Map of Unique Scientific and Technical Infrastructures (ICTS).

3 RES: HPC Services for Spain RES is made up of 12 institutions and 13 supercomputers. BSC MareNostrum CESGA FinisTerrae CSUC Pirineus & Canigo BSC MinoTauro UV Tirant UC Altamira UPM Magerit CénitS Lusitania & SandyBridge UMA Picaso IAC La Palma UZ CaesarAugusta SCAYLE Caléndula UAM Cibeles TFlop/s (logarithmic scale)

4 RES: HPC Services for Spain Objective: coordinate and manage high performance computing services to promote the progress of excellent science and innovation in Spain. It offers HPC services for non-profit, open R&D purposes. Since 2006, it has granted more than 1,000 Million CPU hours to 2,473 research activities. Research areas Hours granted per area AECT 23% 30% BCV Mathematics, physics and engineering Astronomy, space and earth sciences Life and health sciences Chemistry and materials sciences FI 19% QCM 28%

5 BSC (MareNostrum 4) cores, Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: 390 TB Disk: 14 PB RES supercomputers UPM (Magerit II) Main processors : Memory: Disk: 3920 cores, 103 Tflops IBM Power7 3.3 GHz 7840 GB 1728 TB UMA (Picasso) 4016 cores, 84Tflops Main processors: Intel SandyBridge-EP E Memory: GB Disk: 720 TB UV (Tirant 3) 5376 cores, 111,8 Tflops Main processors: Intel SandyBridge-EP E Memory: GB Disk: TB CSUC (Pirineus) 2784 cores, 283,66 Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: GB Disk: 200 TB CSUC (Canigo) 384 cores, 33,2 Tflops Main processors: Intel(R) Xeon(R) Platinum 8160 Memory: 9000 GB Disk: 200 TB

6 RES supercomputers CénitS (Lusitania 2) Main processors Memory: Disk: 800 cores, 33,2 Tflops Intel Xeon E5-2660v3, 2.6GHz 10 GB 328 TB CénitS (SandyBridge) Main processors Memory: Disk: 2688 cores, 56 Tflops Intel Sandybridge Xeon 5376 GB 328 TB BSC (MinoTauro) Main processor: Memory: Disk: 624 cores, 251 Tflops 39x 2 Intel Xeon E v3 20 TB 14PB (shared with MN4) CESGA (FinisTerrae 2) 7712 cores, 328,3Tflops Main processor: Intel Xeon E5-2680v3 Memory: 40 TB Disk: 960 TB UC (Altamira 2+) Main processor: Memory: Disk: 5120 cores, 105 Tflops Intel SandyBridge 15,4 TB 2PB UZ (Caesaraugusta) Main processor: Memory: Disk: 2014 cores, 80.5 Tflops Intel E5-2680v3, 2.5GHz 5400 GB RAM memory 219TB

7 SCAYLE (Caléndula) Main processor: Memory: Disk: 2432 cores, 50,6 Tflops Intel SandyBridge Xeon 4864 GB 600 TB RES supercomputers UAM (Cibeles) Main processor: Memory: Disk: 368 cores, 14,1 Tflops Intel Xeon E v3, 2.40GHz 896 GB 80 TB UAM (SandyBridge) coming soon 2688 cores, 56Tflops Main processor: Intel SandyBridge Xeon, 2.60GHz Memory: 5376 GB Disk: 80 TB IAC (LaPalma) Main processor: Memory: Disk: 4032 cores, 83,85 Tflops Intel SandyBrigde 8064 GB 60 TB

8 Resources granted: CPU hours mh available Hours x Requested hours Awarded hours (A+B)

9 How to apply? RES resources are open to researchers and spin-offs: o o o Computing resources: CPU hours and storage Technical support: application analysis, porting of applications, search for the best algorithm to improve performance and ensure the most effective use of HPC resources. Free of cost at the point of usage Three open competitive calls per year. Next deadline: January 2019 Period Deadline for applications Starting date P1 January 1 st March P2 May 1 st July P3 September 1 st November

10 How to apply? RES intranet: Researchers present a proposal which includes research project description, technical requirements and research group experience. Accepted proposals have access to RES supercomputers for 4 months. Granted time can be: hours with priority (hours A) or without priority (hours B)

11 Proposal evaluation Submit Formal evaluation Technical evaluation Access committee Scientific experts panel Final report of accepted activities

12 Activity length Accepted proposals have access to RES supercomputers for 4 months. If your activity needs more time to be properly developed, you can ask for a continuation activity: New activity (4 months) Report dissemination information Continuation activity (4 months) Report dissemination information Continuation activities The application form is simplified Are preferably allocated to the same machine In the evaluation, one reviewer is kept from the previous activity and the second reviewer changes

13 RES Users Committee CURES aims to provide advice and feedback to RES coordinators: o o o Promotes optimal use of high performance computing facilities Shares information about users experiences Voices user concerns You can contact CURES through RES intranet:

14 Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project

15 Tips to write a strong proposal Read carefully all the protocols, guides and FAQs in: Project description section: highlight the importance of your project, not only from the scientific point of view but also from the return to society. Ø Why do you think that your project should deserve the resources requested?

16 Tips to write a strong proposal Activity description section: specify clearly why do you need supercomputing resources. Write as accurate as possible the flowchart of the simulations. Indicate that you have your own human resources in your group to run and process the output of all the simulations you propose. Ø Why do you need to carry out the simulations in the selected machine? Ø Is the amount of computing resources requested adjusted to your needs and properly justified? Doubts about software/hpc resources: ask support team! Ø Are your jobs adequate for parallel computing? support@bsc.es

17 Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project

18 Who can apply? RES resources are aimed at open R+D+I activities: o o o o Researchers from academia and public R&D institutions Spin-offs during their first 3 years from its creation Collaboration projects between private companies and research groups from academia or public institutions Open to international applicants, but we recommend the collaboration with researchers from Spanish institutions

19 Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project

20 RES events: technical training These workshops are organized by the RES nodes and aim to provide the knowledge and skills needed to use and manage the supercomputing facilities. Check the agenda in RES website: PATC courses in BSC (PRACE Advanced Training Center):

21 RES events: networking opportunities Scientific seminars The RES promotes scientific seminars which address supercomputing technology applications in specific scientific areas. These events are mainly organized by RES users and are open to the entire research community. In 2017: ü 5 scientific seminars ü More than 300 attendees Sep 27 Next Generation Sequencing and Supercomputing: life as a couple CBMSO-UAM (Madrid) Agenda 2018:

22 RES events: networking opportunities RES Users Meeting: 20 September Valencia The agenda includes: Information about RES and the European HPC ecosystem Plenary session: Research Open Data Parallel scientific sessions Poster session Networking opportunities Evening social event

23 Funded by the EC: ü Mobility grants for researchers using HPC resources ü Short stays to visit scientific hosts (3 weeks 3 months) ü Funds for travel and living allowance ü Access to European HPC facilities Nex td 20 S eadline epte : mbe r

24 Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project

25 RES forms In the RES we try to keep the administrative procedures short and simple for researchers: New activity application form: 10 pages on average Continuation activity application form: simplified Dissemination form: 3 pages on average o o o o Brief description of results (1-2 paragraphs) Publications Figures / pictures Optional: patents, PhD students Intermediate reports: 1-2 sentences ( Everything is ok ) Resubmission of non-accepted activities: one click

26 Which is/could be the main impediment to apply to RES resources? Ø I don't know how to write a strong application Ø I'm not sure if I can apply Ø Lack of HPC expertise in my research group Ø Too much paperwork Ø Not enough resources for my project

27 PRACE HPC Access Call for Proposals for Project Access: - 12, 24 or 36-month projects - Minimum request: 30 million core hours Next deadline: 30 October Call for Proposals for PRACE Preparatory Access: - From 2 to 12 month projects

28 EuroHPC

29 Distributed Supercomputing Infrastructure 24 members, including 5 Hosting Members (Switzerland, France, Germany, Italy and Spain) JUQUEEN Hazel Hen SuperMUC 524 scientific projects enabled Curie 70 PFlops/s of peak performance on 7 world-class systems > people trained by 6 PRACE Advanced Training Centers and others events Access Piz Daint Marconi MareNostrum prace-ri.eu/hpc_acces

30 Top500 (June 2018), European ranking Europe Rank Name Computer Site Country 1 6 Piz Daint 2 13 HPC Tera Marconi Intel Xeon Phi MareNostrum 7 23 JUWELS Module Hazel Hen 9 28 COBRA Pangea Cray XC50, Xeon E5-2690v3 12C 2.6GHz, Aries interconnect, NVIDIA Tesla P100 Proliant DL380 Gen10, Xeon Platinum C 2.1GHz, Mellanox InfiniBand EDR, NVIDIA Tesla P100 Bull Sequana X1000, Intel Xeon Phi C 1.4GHz, Bull BXI 1.2 CINECA Cluster, Lenovo SD530/S720AP, Intel Xeon Phi C 1.4GHz/Platinum 8160, Intel Omni-Path Cray XC40, Xeon E5-2695v4 18C 2.1GHz, Aries interconnect Lenovo SD530, Xeon Platinum C 2.1GHz, Intel Omni-Path Bull Sequana X1000, Xeon Platinum C 2.7GHz, Mellanox EDR InfiniBand/ParTec ParaStation ClusterSuite Cray XC40, Xeon E5-2680v3 12C 2.5GHz, Aries interconnect Intel Compute Module HNS2600BP, Xeon Gold C 2.4GHz, Intel Omni-Path SGI ICE X, Xeon Xeon E5-2670/ E5-2680v3 12C 2.5GHz, Infiniband FDR CSCS ENI Switzerland Italy Cores & Accel Rmax [PFlop/s] Rpeak [PFlop/s] 19,59 25,33 12,21 18,62 CEA France ,97 23,40 CINECA Italy ,41 16,21 UKMET United Kingdom ,04 8,13 BSC Spain ,47 10,30 Juelich Germany ,18 9,89 HLRS Germany ,64 7,40 Max-Planck- Gesellschaft MPI/IPP Germany ,61 9,79 Total France ,28 6,71

31 Top10 industrial machines (June 2018) Rank Name Computer Site Country 13 HPC4 30 Pangea Proliant DL380 Gen10, Xeon Platinum C 2.1GHz, Mellanox InfiniBand EDR, NVIDIA Tesla P100 SGI ICE X, Xeon Xeon E5-2670/ E5-2680v3 12C 2.5GHz, Infiniband FDR 35 Abel Cray XC30, Xeon E5-2698v3 16C 2.3GHz, Aries interconnect DGX Saturn V 49 HPC2 65 HPC3 78 Makman-3 79 NVIDIA DGX-1/Relion 2904GT, Xeon E5-2698v4 20C 2.2GHz/ E5-2650v4, Infiniband EDR, NVIDIA Tesla P100/Quadro GP100 NVIDIA DGX-1, Xeon E5-2698v4 20C 2.2GHz, Infiniband EDR, NVIDIA Tesla P100 idataplex DX360M4, Intel Xeon E5-2680v2 10C 2.8GHz, Infiniband FDR, NVIDIA K20x Lenovo NeXtScale nx360m5, Xeon E5-2697v4 18C 2.3GHz, Infiniband EDR, NVIDIA Tesla K80 PowerEdge R440/C6320p, Intel Xeon Phi 7250/Xeon Gold C 2.1GHz, Intel Omni-Path Inspur TS10000, Xeon Gold C 2.1GHz, NVIDIA Tesla V100, 25G Ethernet Eni S.p.A. Total Exploration Production Petroleum Geo- Services Facebook Italy Cores & Acc Rmax [PFlop/s] Rpeak [PFlop/s] 12,21 18,62 France ,28 6,71 United States ,04 5,37 United States NVIDIA Corporation United States Eni S.p.A. Energy Company (A) Italy Italy ,31 4,90 3,31 4,90 3,19 4,61 2,59 3,80 Saudi Aramco Saudi Arabia ,32 3,58 Internet Service P China ,29 4,89 80 Makman-2 Dell PowerEdge R630, Xeon E5-2680v3 12C 2.5GHz, Infiniband QDR Saudi Aramco Saudi Arabia ,25 3,04

32 Status of Signatory Countries Signatory European Countries

33 EuroHPC mission and objectives To develop, deploy, extend and maintain in the Union an integrated world-class supercomputing and data infrastructure and to develop and support a highly competitive and innovative High-Performance Computing ecosystem Provide European scientists, industry and the public sector with the latest HPC and data infrastructure and support the development of its technologies and applications across a wide range of fields Support an ambitious research and innovation agenda to develop and maintain in the Union world-class High Performance Computing ecosystem, exascale and beyond, covering all scientific and industrial value chain segments, including lowpower processor and middleware technologies, algorithms and code design, applications and systems, services and engineering, interconnections, knowhow and skills, for the next generation supercomputing era Infrastructure & Operations R&I, Applications & Skills HPC Ecosystem

34 Infrastructure and Operation Two exascale systems Possibly one on 2022 and a second one in 2023 At least one with European competitive technologies Expected budget on TCO: 500 m each Two pre-exascale systems In operation in January 2021 Expected budget on TCO: 240m each At least 2 petascale systems In operation in January 2021 Budget: TBD Next steps Identify the hosting sites User requirements to prepare RFP

35 EuroHPC Roadmap HPC and Accelerator Chips & Systems R&I Gen 1 Gen EuroHPC JU App & Software Software sw stack Apps Co-Design Software Applications EsD Intg. Integration Procurement Exascale technologies integration 2 Pre-Exa 2 Exascale (1 EU) 2 Peta

36 Visit our website: Subscribe to our newsletter Contact us! Follow us in

37 THANK YOU!