Helix Nebula, the Science Cloud

Transcription

1 Helix Nebula, the Science Cloud A public-private partnership building a multidisciplinary cloud platform for data intensive science EUDAT 2d Conference, 29 October 2013 Maryline Lengert, ESA

2 Helix Nebula, the Science Cloud initiative is a Partnership between big science and big business to implement the Strategic Plan for a Scientific Cloud Computing Infrastructure in Europe EUDAT, 29 October Maryline Lengert, ESA

3 1. Set up a sustainable multi-tenant cloud computing infrastructure in Europe, initially based on the needs of the European Research Area & Space agencies 2. Identify and adopt policies for trust, security and privacy on a European-level 3. Create a light-weight governance structure involving all stakeholders 4. Define a short and medium term funding scheme EUDAT, 29 October Maryline Lengert, ESA

4 Synergy between HN and EUDAT EUDAT Vision: support a collaborative Data Infrastructure (cross domain for research) HN Vision: Provide Cloud Computing capacity and services that elastically meet big science s growing demand in a cross domain environment. In order to become Information as a Service ecosystem, we need: Data e-infrastructure providing sustainable platform of technology, tools, and services Platform for shared services that make it possible for data-intensive research to span all the scientific disciplines Wide spread access to data and long term-preservation of data for use and re-use EUDAT, 29 October Maryline Lengert, ESA

5 Building on European e- Infrastructures Existing European e-infrastructure long-term projects GEANT, EGI, PRACE, EUDAT Many pathfinder initiatives have prototyped aspects of what will be needed in the future Includes much of the work in the existing e-infrastructure projects Thematicprojects/ infrastructuressuch as BioMedBridges/ CRISP/ DASISH/ ENVRI, EMSO aswell ascoriolis / GEOWOW / DORIS and many others Future service infrastructure and tools must be fully based on open standards, open software, and enable open data access EUDAT, 29 October Maryline Lengert, ESA

6 Helix Nebula, the Science Cloud It is NOTa project! It doesn t have a paying customer: it is meeting strategic interest of each participant preparing the future It has been set up by Extreme Labs, IT & T- Com industry, SMEs (application & computing) to create something new by bringing together a fragmented landscapeand building on strength from sustainable diversity EUDAT, 29 October Maryline Lengert, ESA

7 Strategic Objective The European Research Area shall drive the development and implementation of a secure and globally recognised European Cloud Computing Infrastructure, initially targeting science users. This infrastructure will become THEplatform for Europe, under public governance, ensuring open standard and interoperabilityand adhering to European policies, norms and requirements. EUDAT, 29 October Maryline Lengert, ESA

8 To make this happen, we created Helix Nebula, the Science Cloud Partnership EUDAT, 29 October Maryline Lengert, ESA

9 Partnership Why? The scale and complexity of services needed to satisfy the foreseen needs of Europe s IT-intense scientific research & space organisations are beyond what can be provided by any single company and will require the collaboration of a variety of service providers and SMEs. By partnering with Science and Space Organizations, it shall cover most, if not all, of the needs of a public Cloud infrastructure. EUDAT, 29 October Maryline Lengert, ESA

10 Partnership Who & How? IT Providers -commit resources -share investments -agree on standard -interoperability Scientific and Space Organizations -commit resources -access to data & user communities SME s EC supports with -commit resources -Policy & Strategy -link between -through targeted Users and Providers calls under FP7 - Act as catalyser EC Projects -Standard/Open source -Contributing / using HN EUDAT, 29 October Maryline Lengert, ESA

11 Where do we want to go and why do we want to go there? EUDAT, 29 October Maryline Lengert, ESA

12 Long Term Goal To create a multi-tenant Open Market Place for Science, where data, scientists, funding bodies, SMEs and downstream industry are meeting to work along common interests. This ecosystem should implement many-to-many relationships, quickly being established, to transform data into valuable information EUDAT, 29 October Maryline Lengert, ESA

13 Operating as an Ecosystem An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system. An ecosystem is a community of living organisms (plants, animals and microbes) in conjunction with the nonliving components of their environment (things like air, water and mineral soil), interacting as a system. EUDAT, 29 October Maryline Lengert, ESA

14 Contributors to the Ecosystem IT Suppliers Funding Bodies R&D Labs SME s Data providers Scientists Downstream industry EUDAT, 29 October Maryline Lengert, ESA

15 Final Ecosystem: Discovery driven Demand Supplier A Scientist Funding bodies ( /$/ ) SME Discovery oriented approach Skills Brokerage Data & tools IT Brokerage Skills brokerage: Dynamic team building based on discovery Supplier Supplier X Supplier Y Data provider Supplier SME EUDAT, 29 October Maryline Lengert, ESA

16 Building the hybrid cloud Connecting commercial providers to the GÉANT/NRENs DANTE offering free IP connectivity in GÉANT for research traffic during the pilot phase NRENs have different commercial agreements (usually they apply a fee) EUDAT, 29 October Maryline Lengert, ESA

17 Helix Nebula and Public Infrastructures proposed hybrid model Big Science Academic Long tail Other market sectors Government Manufacturing Oil & gas, etc. EGI Fed Cloud Task Force HN as supplier to research Atos Blue Box Helix Nebula Cloud Sigma T- Systems Network Commercial/GEANT Front-end Front-end Public funded Commercial Front-end Front-end Front-end Meeting EUDAT, with 29 October Ifremer, October Maryline Lengert, ESA

18 Expected Benefits We build scaleto allow you and us to handle elasticity Risk sharing between partners Compliance with EC rules and policy (privacy, security, ethics) Business opportunities for SMEs Breakthrough in Science thanks to crossdomain fertilization (data, tools, funding, capacity, peers) EUDAT, 29 October Maryline Lengert, ESA

19 Validating our approach EUDAT, 29 October Maryline Lengert, ESA

20 Timeline Endorse the Common Strategy Agree on the Partnership Select flagships use cases Define governance model Pilot Phase Deploy flagships, Analysis of functionality, performance & financial model Start Operations Towards an open market for Science EUDAT, 29 October Maryline Lengert, ESA

21 Initial Flagship Use Cases Scientific challenges with societal impact Sponsored by user organisations Stretch what is possible with the cloud today EUDAT, 29 October Maryline Lengert, ESA

22 ESA Flagship SuperSiteExploitation Platform

23 What is a Super Site? Data sharing (all data space & in-situ) accessible at no cost through a one-stop shopping e- infrastructure (containing also tools and peers). Cross-domain: The supersites will lead to a new, more versatile generation of scientists that capitalize on information from multiple techniques. International collaboration with regional responsibilities: The backbone of the Supersites initiative is global collaboration of scientists and data providers. National organizations should coordinate efforts for establishing regional integrated research infrastructure in charge of long-term integration plans such as European Plate Observing System (EPOS) for Europe Knowledge EUDAT, 29 October Maryline Lengert, ESA

24 The Geohazard Supersites Support GEO to better understand the geophysical processes causing Geohazards (earthquakes and volcanoes) - Global partnership of scientists, satellite and in-situ data providers (multi-sensor InSAR, seismic, GPS - complete data sets) Brings together community & relevant data - Support national authorities and policy makers in risk assessment and mitigation strategies for Geohazards EUDAT, 29 October Maryline Lengert, ESA

25 Group on Earth Observations Intergovernmental Organization with 88 country members and 67 participating organizations (as of March 2013) Construct by 2015: Global Earth Observation System of Systems (GEOSS) GEO data sharing principles approved in 2010 Plenary: open & free data access for U.S. Department EUDAT, 29 of October State, 2013 Washington DC GEO Secretariat 25 Maryline Lengert, ESA July 31, 2003 science

26 GeoHazard Supersites: Infrastructure concept EO Science users will use the Supersites their first option to store and access data, for data processing and analysis because that's where they find all the data, tools and peers. EUDAT, 29 October Maryline Lengert, ESA

27 SSEP Expected Results 1. Science: better scientific understanding of geohazards with the aim of providing sound information about the risks and the potential mitigation measures 2. Data sharing: information extracted from different sources (satellite & in-situ) will open a wide range of new approaches: Cross-domain research 3. Building Communities : In return to SSEP access, scientists will be asked either: to provide results into the information repository on the Science Cloud, to provide their data processing open source code, to provide application tools ( Apps ) EUDAT, 29 October Maryline Lengert, ESA

28 Geo Hazard : Japan earthquake -Tohoku-oki: unprecedented >50 m slip in places (Simons et al., Science 2011, NASAfunded study). -Will another magnitude 9 occur further south? -It is unknown whether this fault segment has been accumulating slip. -Need all InSAR, GPS, Seismic, Petrology, Geochemistry,! (-2004 magnitude 9.2 Sumatra earthquake was followed by magnitude 8.7 half-a-year later) The Science Cloud with its unlimited resources on data, processing capacity and tools will allow cross-domain science and ease data sharing. The easy usage of this infrastructure will pull intelligence to apprehend the challenges. EUDAT, 29 October Maryline Lengert, ESA

29 Earth Observation Application Platform exploiting 20 years of satellite data EO Application Platform OpenNebula Data Catalogue and Access Map-Reduce computing model Software repository Utilities for sw development and testing Cloudification of application CNR / IREA (Italian Research Council in Naples) developed an application (SBAS) measuring the vertical movement of ground in sub cm from space. SBAS targets Time series over 20 years with ESA archive Points of Interest are at world scale TBytes of data to process EUDAT, 29 October Maryline Lengert, ESA ESA UNCLASSIED - For Offical Use 05/07/2012

30 A crack in a house His Res commercial Data policy ESA open and free Data policy In situ data from various providers Courtesy from DORIS Grant Agreement #: EUDAT, 29 October Maryline Lengert, ESA

31 Data for geo-hazard leading to Information as a Service Satellite data: structure, catalogued ESA data with medium res with open and free data policy (20 years of data in the archive) Commercial data TerraSAR-X, COSMOSkyMed, Radarsat High res optical data (IKONOS, GEOEYE, Quickbird, SPOT-5, FORMOSAT-2, KOMSAT-2, Pleiades ) In-situ data: Structured data: of Geological Surveys (e.g. EPOS) (Inclinometer, GPS, seismometer,..) from scientific & commercial measurements and national authorities Aerial fotos Digital Elevation Models Did you feel it? (e.g. App form USGS for Earthquake) Ground deformation maps and time series, Displacement & damage maps Unstructured data e.g. footage with meta data from Tsunami event EUDAT, 29 October Maryline Lengert, ESA

32 Satellites data Courtesy from DORIS EUDAT, 29 October Maryline Lengert, ESA

33 A European cloud computing partnership: big science teams up with big business Strategic Plan Establish multi-tenant, multi-provider cloud infrastructure To support the computing capacity needs for the ATLAS experiment Setting up a new service to simplify analysis of large genomes, for a deeper insight into evolution and biodiversity To create an Earth Observation platform, focusing on earthquake and volcano research Identify and adopt policies for trust, security and privacy Create governance structure Define funding schemes Adopters EUDAT, 29 October contact@helix-nebula.eu HelixNebula.TheScienceCloud Maryline Lengert, ESA