The European Supercomputing Research Programme. Dr Panagiotis Tsarchopoulos Future and Emerging Technologies DG CONNECT European Commission

Transcription

1 The European Supercomputing Research Programme Dr Panagiotis Tsarchopoulos Future and Emerging Technologies DG CONNECT European Commission

2 EU by the numbers 24 Official languages Over 508million combined population 28 Member States 15% of GLOBAL EXPORTS & IMPORTS 24% of global GDP 1.6million Square miles total surface area <1/2 of U.S. surface area.

3 Horizon the EU framework programme for research and innovation : a stronger, clearer focus H2020 Budget: 77B (current prices) Excellent Science 24,4 B Industrial Leadership 17B Societal Challenges 29,6 B OTHERS: 5,8B (Spreading excellence & widening participation, Science & Society, JRC, EIT)

4 H2020 covers the full innovation chain Excellent science Societal challenges Industrial leadership Basic Demonstration Research Technology R&D Large scale validation Prototyping Pilots Market uptake

5 Key EU policy developments in HPC Communication from the EC "High-Performance Computing: Europe's place in a global race" (2012) Council Conclusions on High-Performance Computing (Competitiveness Council 2013) Establishment of the European Technology Platform on High-Performance Computing (ETP4HPC ) and Strategic Research Agenda on HPC (2013) Horizon 2020 programme including HPC Calls adopted (end of 2013) Public-Private Partnership with ETP4HPC (1st January 2014)

6 An integrated HPC approach in H2020 "Excellent Science" part of H2020 HPC strategy combining three elements: (a) (b) (c) Computer Science: towards exascale HPC; A special FET initiative focussing on the next generations of exascale computing as a key horizontal enabler for advanced modelling, simulation and big-data applications [HPC in FET] achieving excellence in HPC applications; Centres of Excellence for scientific/industrial HPC applications in (new) domains that are most important for Europe [e-infrastructures] providing access to the best supercomputing facilities and services for both industry and academia; PRACE - world-class HPC infrastructure for the best research [e-infrastructures] complemented with training, education and skills development in HPC

7 Interrelation between the three elements "Excellent Science" part of H2020 Access to best HPC for industry and academia specifications of exascale prototypes technological options for future systems EU development of Exascale technologies Collaboration of HPC Centres and application CoEs provision of HPC capabilities and expertise Excellence in HPC applications (Centres of Excellence) identify applications for codesign of exascale systems Innovative methods and algorithms for extreme parallelism of traditional/emerging applications

8 The European HPC Ecosystem: Access to best HPC Partnership for Advanced Computing in Europe PRACE is an international not-for-profit association under Belgian law, with its seat in Brussels. PRACE counts 25 members and 2 observers. The PRACE Hosting Members are France, Germany, Italy and Spain. PRACE is governed by the PRACE Council in which each member has a seat. The daily management of the association is delegated to the Board of Directors. PRACE is funded by its members as well as through a series of implementation projects supported by the European Commission.

9 The European HPC Ecosystem: Access to best HPC PRACE 4 Hosting Members offering core hours on 6 world-class machines JUQUEEN: IBM BlueGene/Q GAUSS/FZJ Jülich, Germany SuperMUC: IBM GAUSS/LRZ Garching, Germany MareNostrum: IBM BSC, Barcelona, Spain Hazel Hen: Cray GAUSS/HLRS, Stuttgart, Germany Access through PRACE Peer Review Criterion: Scientific Excellence CURIE: Bull Bullx GENCI/CEA Bruyères-le-Châtel, France FERMI: IBM BlueGene/Q CINECA, Bologna, Italy

10 The European HPC Ecosystem: Technology development ETP4HPC Association, the European Technology Platform for High Performance Computing: An industry-led forum founded by stakeholders of HPC technology 70 organizations are currently members Open membership for organizations having HPC R&D based in Europe

11 The European HPC Ecosystem: Technology development Through the Strategic Research Agenda, the ETP4HPC Association has identified research areas and topics to reach a stronger European HPC environment that can benefit Europe and the rest of the world.

12 Public-Private Partnerships in H2020 Horizon 2020 may be implemented through Public-Private Partnerships where all the partners concerned commit to support the development and implementation of R&I activities of strategic importance to the Union. The Union enters a contractual agreement (cppp) with private partners Commitment for the duration of the Horizon 2020 programme Eight cppps launched in January 2014: Factories of the Future (FoF), Energy-efficient Buildings (EeB), European Green Vehicles Initiative (EGVI), Sustainable Process Industry (SPIRE), Advanced 5G network (5G), Robotics, Photonics High Performance Computing Public-Private Partnership with ETP4HPC Based on the ETP4HPC Strategic Research Agenda Started 1st January m EU funding for the period

13 Public-Private Partnership in HPC General objectives To build a European world-class HPC technology value chain that is globally competitive - synergy between the three pillars of the HPC ecosystem (technology development, applications and computing infrastructure) To achieve a critical mass of convergent resources in order to increase the competitiveness of European HPC vendors and solutions To leverage the transformative power of HPC in order to boost European competitiveness in science and business To expand the HPC user base, especially SMEs, and to facilitate the participation of SMEs in the provision of competitive HPC technology solutions To develop a EU leadership and world-wide excellence in key application domains for industry, science and society provision of innovative solutions for grand societal challenges development of the future applications for the exascale computing generation

14 FETHPC 2014 CALL Summary Budget: ~100 m FETHPC : HPC Core Technologies, Programming Environments and Algorithms for Extreme Parallelism and Extreme Data Applications (Research and Innovation Actions) a) HPC core technologies and architectures (e.g. processors, memory, interconnect and storage) and their optimal integration into HPC systems, platforms and prototypes b) Programming methodologies, environments languages and tools: new programming models for extreme parallelism and extreme data applications c) Application Programming Interfaces and system software for future extreme scale systems d) New mathematical and algorithmic approaches for existing or emerging applications FETHPC : HPC Ecosystem Development (Coordination and Support Actions) a) Coordination of the HPC strategy: coordination of the activities of stakeholders, development of Strategic Research Agenda, mapping and analysis of national and international R&I programmes, attracting young talents, b) Excellence in High Performance Computing Systems: boosting European research excellence on the key challenges towards the next generations of highperformance computing systems; cutting across all levels.

15 EINFRA CoEs Summary Budget: 40m Centres of Excellence for computing applications Specific Challenge: Establish a limited number of user-centred Centres of Excellence (CoE) in the application of HPC for addressing scientific, industrial or societal challenges CoEs may be: Thematic, Transversal, Challenge-driven, or a combination Proposals (Research and Innovation Actions) will address: a) Pan-European services b) Exascale R&D c) Sustainability d) New communities e) Governance structure

16 Results of the Calls Projects start: Autumn 2015 Complete HPC R&D project portfolio covering all elements of HPC stack Multinational, multi-partner consortia involved in all projects Specific actions to further develop the European HPC ecosystem Centres of Excellence for key HPC applications

17 Technology development Compute Design of a SoC/SoP with exascale-class performance Software ecosystem for the future SoC. Building on the previous Mont-Blanc projects Highly integrated, high-performance, heterogeneous SoC based on chiplets 3D integration with silicon interposer Reconfigurable accelerators Novel hierarchical architecture Coarse-grain reconfigurable architectures Optimized just-in time synthesis tools

18 Technology development Interconnect, Memory, Storage High throughput, low latency connectivity, suitable for exascale with congestion mitigation, QoS guarantees, and resilience Hyper-density system integration with total immersion liquid cooling Scalable I/O using non-volatile memory Hardware and software Next-generation multi-tiered object-based data storage system Hardware and software

19 Technology development Data-intensive Real-time MANGO Exploration of deeply heterogeneous architectures allowing dynamic adaptation to applications Add Predictability dimension for design of real-time HPC systems compared to the mainstream Power/Performance HPC design dimensions GREENFLASH Design and build a prototype for a Real-Time Controller targeting the European Extremely Large Telescope Adaptive Optics instrumentation (39m diameter telescope to see first light in the early 2020s; largest telescope on Earth) Tackle the combination of high data transfer bandwidth, low latency and high throughput requirements

20 Technology development Programming DSL for expressing adaptivity and auto-tuning strategies Performance and energy control using software knobs Advance the state of the art in operating applications at the maximum energy-efficient and thermally-safe point READEX Parallel programming model based on nested recursive parallelism automated porting of applications multiple objective optimisation Automatic optimization detecting application's dynamic behaviour and adapting system environment at run-time Interoperability between programming models/apis 7 key APIs: MPI, GASPI, OpenMP, OmpSs, StarPU, QUARK, PaRSEC Defining and encapsulating the fundamental algorithmic building blocks ("Weather & Climate Dwarfs") underlying weather and climate codes Software stack for weather and climate codes at exascale

21 Technology development Mathematics & Algorithms New exascale hyperbolic simulation engine based on communicationavoiding schemes NLAFET Parallel Numerical Linear Algebra Novel algorithms for extreme-scale systems Algorithm-based fault tolerance Exascale Fluid Dynamics Simulations Error control and adaptive mesh refinement Solver efficiency Heterogeneous modelling Multiscale computing at exascale based on generic computing patterns Approach tested on codes from fusion, biomedicine, materials and astrophysics Exascale Compound Activity Prediction Engine Machine learning for extreme-scale computing and data Specific application: predicting compound bioactivity for pharmaceuticals

22 Centres of Excellence Weather and Climate Improve efficiency and productivity of numerical weather and climate simulation on highperformance computing platforms by supporting the end-to-end workflow of global Earth system modelling in HPC environment. Scalability of models, tools and data management on state-of-the-art supercomputer systems Usability of models and tools throughout the European HPC eco-system, and Exploitability of the huge amount of resulting data. ESiWACE leverages two established European networks: the European Network for Earth System modelling (ENES) representing the European climate modelling community and the world leading European Centre for Medium-Range Weather Forecasts (ECMWF)

23 Centres of Excellence Energy Energy Oriented Centre of Excellence Accelerate the European transition to a reliable and low carbon energy supply Four renewable energy pillars with a heavy reliance on numerical modelling: Weather forecast, Materials, Water Fusion These four pillars are supported by a strong transversal multidisciplinary basis providing high-end expertise in applied mathematics and HPC.

24 Centres of Excellence Simulation and Modelling An e-infrastructure for software, training and consultancy in simulation and modelling Building on the network of CECAM (Centre Européen de Calcul Atomique et Moléculaire) it will create a distributed, sustainable centre for simulation and modelling at and across the atomic, molecular and continuum scales. Actions: 1. development, testing, maintenance, and dissemination of robust software modules targeted at end-user needs; 2. advanced training of current and future academic and industrial researchers able to exploit these capabilities; 3. multidisciplinary, coordinated, top-level applied consultancy to industrial end-users (both large multinationals and SMEs).

25 Centres of Excellence Biomolecular BioExcel Centre of Excellence for Biomolecular Research Covering structural and functional studies of the building blocks of living organisms - proteins, DNA, saccharides, membranes, solvents and small molecules like drug compounds. Efficiency and scalability of key codes for biomolecular research; Usability of ICT technologies for biomolecular researchers in academia and industry; Best practices and train end users in making good use of both software and e-infrastructure.

26 Centres of Excellence Global Systems Centre of Excellence for Global Systems Science Brings together HPC, HPDA and GSS to facilitate computer-aided policy making Development of an HPC-based framework to generate customized synthetic populations for Global System Science applications (a synthetic population provides a model of a given population, e.g. humans, plants, animals, cars, buildings etc.) Analytical methodology based on sound theoretical background from algorithmic game theory and a state-of-the-art understanding of socio-cultural evolution. Multi-dimension simulations with the help of synthetic populations for green growth, pandemics, urbanization

27 Centres of Excellence Materials Materials design at the exascale Porting, scaling, and optimising material science application codes for peta- and exascale platforms Integrate leading codes and make their results comparable Building on the NoMaD Repository

28 Centres of Excellence Performance Performance Optimisation and Productivity Computing applications of any sort, from a few hundred to many thousand processors? Application Performance Audit Primary service Identify performance issues of code! Application Performance Plan Follow-up on the audit service Identifies the root causes of the issues found and qualifies and quantifies approaches to address them Proof-of-Concept Experiments and mock-up tests for codes Kernel extraction, parallelization, mini-apps experiments to show effect of proposed optimizations

29 European HPC Ecosystem development Key action supporting the European Commission in the coordination, development and implementation of a common strategy for the European HPC Ecosystem Run by PRACE and ETP4HPC Technology and applications roadmaps towards exascale Develop international research collaborations Long-term research roadmap: Computing beyond exascale HPC curriculum development Improve HPC academia links with business and venture capital

30 The new European HPC research landscape NEXTGenIO ExaNEST ECOSCALE ExaNoDe Mont-Blanc 3 EXTRA SAGE ExaHYPE HPC Ecosystem EXDCI Eurolab-4-HPC Centres of Excellence Project Start: Autumn 2015 NLAFET ExaFLOW ExCAPE ComPat ESCAPE READEX ALLScale INTERTWINE ANTAREX Mango GreenFLASH BioExcel COEGSS EoCoE E-CAM ESiWACE MAX NOMAD PoP Biomolecular Global systems Energy Simulation Modelling Weather Climate Materials Materials Performance optimisation

31 Future HPC Calls

32 HPC-related calls Horizon 2020 WP Support to the Pan-European HPC infrastructure (einfrastructure) Implementation of PRACE (PRACE-4IP) 15 m Procurement of innovative solutions in HPC (PPI) 26 m HPC e-infrastructure for the Human Brain Project 25 m Support to exascale technologies development (FET) Co-design of HPC systems and applications 41 m Transition to exascale computing 40 m Exascale Ecosystem Development 4 m 32

33 Headline research challenges FETHPC 2016/2017 Calls Co-design of HPC systems and applications: bigger projects with 10-20m indicative funding per project [2016] Transition to exascale computing : smaller focused projects with 2-4m indicative funding per project [2017] High productivity programming environments for exascale Exascale system software and management Exascale I/O and storage in the presence of multiple tiers of data storage: Supercomputing for Extreme Data and emerging HPC use modes Mathematics and algorithms for extreme scale HPC systems and applications working with extreme data Exascale Ecosystem Development : Coordination and Support Actions with 1-2m indicative funding per project [2017]

34 HPC Overall strategy Horizon 2020 Calls WP ~155 M (~144 in the cppp) WP ~151 M (85 in the cppp) PRACE-4IP (15 m ) PRACE (15 m ) PPI for HPC (26 m ) Pan-European HPC Infrastructure HPC Capability HPC Services Support to innovation Flagship Applications (HBP) HBP HPC (25 m ) Training Education Skills Applications Societal challenges Scientific strategic applications Emerging domains (Big Data) New methods and algorithms Centres of Excellence (40 m ) Exascale technologies Architectures, programming. environments, tools Exascale Prototypes HIGH PERFORMANCE COMPUTING Core technologies (93,4 m ) Ecosystem development (4 m ) Co-design (41 m ) Transition to exascale (40 m ) Ecosystem development (4 m ) ADVANCED COMPUTING Clouds for Science CLOUDS SMEs Services, Competence Centres Network of SME competence centres (2 m )

35 HPC PPP timeline in H2020 (indicative) Exascale Technologies & Applications l l l l l l l l l l Projects from 2014 Call: Technology building blocks & 1 st round CoEs Projects start Projects from 2016 Call: 1 st level co-design Projects from 2017 Call: Exascale transition HPC Ecosystem development Future 2018/19/20 Calls: Extreme Scale Demonstrators (2 nd -level co-design / integration) & 2 nd round of CoEs

36 "Notre ambition c'est que d'ici 2020, l'europe se classe dans le top 3 mondial du calcul à haute performance." "Our ambition is that until 2020, Europe is in the world top 3 of high performance computing." 27 October 2015 European Commission President Jean-Claude Juncker

37 Thank you for your attention! Single point of access to all information about the EC HPC strategy, work programmes and HPC related news: ec.europa.eu/horizon2020-hpc PRACE Exhibition booth #247 Running European HPC technology development projects Exhibition booth #197 ~35 members of the ETP4HPC have their own booths in the exhibition Birds-of-a-Feather: Key Lessons and International Collaboration Opportunities Delivered by European Cutting-Edge HPC Initiatives Date: Thu, Nov 19 Time: 3:30-5:00pm Location: Room 13A