einfrastructure Use Roadmap (DRAFT)

Transcription

1 einfrastructure Use Roadmap (DRAFT) prepared by the einfrastructure Scientific Opportunities Panel Galen Gisler (UiO), chair Dag Bjørge (met.no) Elena Celledoni (NTNU) Trygve Ulf Helgaker (UiO) Kjetill Sigurd Jakobsen (UiO) Colin Jones (SMHI) Anna Lipniacka (UiB) Arvid Lundervold (UiB) Nils Reidar B. Olsen (NTNU) Stephan Oepen (UiO) Jacko Koster (UNINETT Sigma), secretary Gudmund Høst, advisor (Research Council) appointed by the evita Programme Committee

2 Our charge: Scientific Opportunities Panel The Science Opportunities Panel of the evita Programme Committee is responsible for monitoring the development of scientific use of einfrastructure, and in particular for producing an einfrastructure Use Roadmap for Norway. It works in collaboration with the NOTUR project leader, who is secretary to the panel. Terms of Reference By June 1st, 2010, develop the scientific case for the einfrastructure that can best serve Norwegian research groups and operational forecasting from einfrastructure in the present context covers electronic resources such as large data collections, large-scale computing resources and high-speed networks, as well as the tools and services enabling efficient use of these resources. By June 1st, 2011, produce a first version of an einfrastructure Use Roadmap. This Roadmap should cover current and new scientific areas for einfrastructure use, taking into account the opportunities offered by existing and emerging large-scale international collaborations. The roadmap should also make international comparisons and, in collaboration with the NOTUR project leader, match applications against hardware architectures. At the invitation of the evita Programme Committee, the panel should provide information and advice on einfrastructure applications to the Norwegian research community, including the participation in occasional workshops and other meetings. The panel is appointed for three years.

3 Our charge: Scientific Opportunities Panel The Science Opportunities Panel of the evita Programme Committee is responsible for monitoring the development of scientific use of einfrastructure, and in particular for producing an einfrastructure Use Roadmap for Norway. It works in collaboration with the NOTUR project leader, who is secretary to the panel. The scientific case for einfrastructure in Norway The einfrastructure Scientific Opportunities Panel Terms of Reference By June 1st, 2010, develop the scientific case for the einfrastructure that can best serve Norwegian research groups and operational forecasting from einfrastructure in the Done present context covers electronic resources such as large data collections, large-scale computing resources and high-speed networks, as well as the tools and services enabling efficient use of these resources. By June 1st, 2011, produce a first version of an einfrastructure Use Roadmap. This Roadmap should cover current and new scientific areas for einfrastructure use, taking into account the opportunities offered by existing and emerging large-scale international collaborations. The roadmap should also make international comparisons and, in collaboration with the NOTUR project leader, match applications against hardware architectures. At the invitation of the evita Programme Committee, the panel should provide information and advice on einfrastructure applications to the Norwegian research community, including the participation in occasional workshops and other meetings. The panel is appointed for three years.

4 Our charge: Scientific Opportunities Panel The Science Opportunities Panel of the evita Programme Committee is responsible for monitoring the development of scientific use of einfrastructure, and in particular for producing an einfrastructure Use Roadmap for Norway. It works in collaboration with the NOTUR project leader, who is secretary to the panel. The scientific case for einfrastructure in Norway The einfrastructure Scientific Opportunities Panel Terms of Reference By June 1st, 2010, develop the scientific case for the einfrastructure that can best serve Norwegian research groups and operational forecasting from einfrastructure in the Done present context covers electronic resources such as large data collections, large-scale computing resources and high-speed networks, as well as the tools and services enabling efficient use of these resources. By June 1st, 2011, produce a first version of an einfrastructure Use Roadmap. This Roadmap should cover current and new scientific areas for einfrastructure use, Draft taking into account the opportunities offered by existing and emerging large-scale international collaborations. The roadmap should also make international comparisons and, in collaboration with the NOTUR project leader, match applications against hardware architectures. At the invitation of the evita Programme Committee, the panel should provide information and advice on einfrastructure applications to the Norwegian research community, including the participation in occasional workshops and other meetings. The panel is appointed for three years.

5 Draft Table of Contents einfrastructure Use Roadmap Foreword Executive summary Table of Contents 0. Recommendations 1. Benefits to science, society and industry: opportunities and challenges 2. Definition of escience, einfrastructure, users, and jargon 3. Exponential growth / Hardware 3.1. Trends 3.2. Ecosystem, Pyramids 3.3. Heterogeneity 4. International comparisons 4.1 Organisation 4.2 Financing 4.3 Access 5. Necessary steps 5.1. Education 5.2. Software 5.3. Data storage and management 5.4. Power requirements 6. Niche opportunities for the Nordic region 7. Conclusions 7.1. Hardware procurement model 7.2. Service models

6 Panel Discussion General Overview - Galen Gisler Example - numerical weather forecasting - Dag Bjørge Example - data storage and algorithms - Elena Celedoni Example - HPC for the masses - Stephan Oepen To fill in the blanks - Jacko Koster for Notur To fill in more blanks - you, our lovely audience

7 Benefits to Society In general, einfrastructure enables: Advancements in scientific research Improvements in public health Improvements in weather forecasting/climate prediction Future sources of energy Response to natural disasters Particular advantages for Norway: Keep Norwegian science and industry competitive in the world market Attract high-calibre foreign researchers here Use attributes unique to Norway (clean power, waste heat utilisation) to sell dataprocessing to Europe and the world

8 What are escience and einfrastructure? Technologies of information and communication High-performance computers, fast data networks, robust and secure storage A new societal infrastructure, analogous to roads and railroads Fundamental to the performance of modern technological society

9 Trends in Hardware Norway is losing ground compared to the rest of the world

10 Organisation data centre 1 data centre 2 data centre 4 data centre 3 computer 1 data centre computer 3 computer 2 data centre 1 data centre 2 How should Norwegian computing be organised in the future? This is naturally a contentious subject! The alternatives should be carefully considered Is the status quo really our best option? Tier 0 NOTUR Tier 1 Tier 1 Tier 1 data centre 4 data centre 3 Tier 2 Tier 2 Tier 2 Tier 2

11 Ecosystem and Pyramids The einfrastructure pyramid (anno 2011) Capacity Greenest WLCG Tier-0 Capability Multi-Petaflop PRACE Greener NGIs Tier-1 (regional/national) Petaflop Nordic? Green(?) Tier-2 (Local/institutional) Development Competence Services Support Training Portals Tools Databases Data sources clouds Sub-Petaflop

12 Heterogeneity Computer architecture is becoming more heterogeneous AMD graphic But most practical problems are heterogeneous also! Wikipedia graphic of a jet engine

13 Trends in Power Consumption Megaflops/Watt Efficiency of computers from the Green500 list Built wisely, an Exaflop machine in 2020 may need no more than 20 MegaWatts year IBM s Silicon Integrated Nanophotonics Project

14 New Opportunities for Norway Lefdal Mine, Måløy 120,000 sq m Abundant Hydropower Access to fjord for cooling High safety, security Green Mountain Data Centre Rennesøy, near Stavanger Abundant Hydropower Access to fjord for cooling High safety, security

15 New Opportunities for Nordic Region Kajaani Paper Mill, Finland Abundant Hydropower Large Footprint River Cooling Thor Data Centre, Iceland Abundant, Cheap Energy Easy Cooling Advanced Filtration

16 New Opportunities for the Arctic HI ARSC UiB NTNU UNIS UiT Cryogenic cables under the Arctic Ocean?

17 Financing

18 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs

19 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs }

20 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs One-time, bulk-sum injections of funds cannot be used most effectively }

21 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs One-time, bulk-sum injections of funds cannot be used most effectively } Level of funding to keep pace?

22 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs One-time, bulk-sum injections of funds cannot be used most effectively } Level of funding to keep pace? ~30 M NOK annually for einfrastructure hardware alone

23 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs One-time, bulk-sum injections of funds cannot be used most effectively } Level of funding to keep pace? ~30 M NOK annually for einfrastructure hardware alone ~15 M NOK annually for people and services

24 Financing Need predictable, steady funding Lifecycle of a supercomputer ~ 5 yrs These are not commensurate with annual funding cycles! Time from purchase decision to active use ~2 yrs Time between introductions of new technologies ~1.5 yrs One-time, bulk-sum injections of funds cannot be used most effectively } Level of funding to keep pace? ~30 M NOK annually for einfrastructure hardware alone ~15 M NOK annually for people and services Should the funding stream for einfrastructure be moved from Forskningsrådet to Kunnskapsdepartementet or even to Nærings- og handelsdepartementet?

25 Governance & Access Aim to adopt a user-centric approach to governance Encourage industrial users to use the state-funded einfrastructures Effective mechanisms for coordination among computing centres, networks, and storage Make the user experience more uniform across centres documentation, support, webpages, software availability passwords and access control Authorisation and Access Infrastructures (as in e-irg White Paper)

26 Education from Svenn Hanssen (UiT), esop seminar 11.march

27 Education HPC Centre-based training for users, sysadmins, & consultants University-based training for researchers hard-science researchers with mathematical training social-science & humanities researchers with little math Primary & Secondary-school training, essentially for all must provide teachers with basic knowledge of the uses of einfrastructure Analogy with training to use transportation infrastructures

28 Analogy with transport infrastructure

29 Analogy with transport infrastructure

30 Analogy with transport infrastructure

31 Analogy with transport infrastructure

32 Analogy with transport infrastructure

33 Analogy with transport infrastructure

34 Analogy with transport infrastructure

35 Analogy with transport infrastructure

36 Analogy with transport infrastructure

37 Analogy with transport infrastructure

38 Analogy with transport infrastructure

39 Computer training is mostly aimed at adults

40 Computer training is mostly aimed at adults What s wrong with this picture?

41 Computer training is mostly aimed at adults What s wrong with this picture? We can do better than this!