Coupled Computing and Data Analytics to support Science EGI Viewpoint Yannick Legré, EGI.eu Director yannick.legre@egi.eu Credit slides: T. Ferrari www.egi.eu This work by EGI.eu is licensed under a Creative Commons Attribution 4.0 International License.
EGI in a nutshell 1/2 2
EGI in a nutshell 2/2 Solutions Federated advanced computing, storage and data (HTC and Cloud) Federated operations User groups Individual researchers Research teams International collaborations (Education) Multidisciplinary Open Enables sharing of resources, tools, scientific software and knowledge 3
Service Catalogues Services for infrastructure federation Accounting Monitoring Service registry Policies Service management Compute, Storage and Data Cloud Compute HTC Cloud storage (block and object) File storage Durable storage Community platforms Virtual Labs Science gateways Data products Analysis pp pipelines Software Landscape of multiple providers Service Level Agreements with users Operational Level Agreements and Underpinning Agreements with services providers 4
Access Policies Policy-based: users are granted access based on policies defined by the EGI resource providers or by EGI.eu Wide access: users can freely access scientific data and digital services provided by EGI resource providers Market-driven: users can negotiate a fee to access services either directly with EGI resource providers or indirectly with EGI.eu 5
Overarching vision Researchers from all disciplines have easy, integrated and open access to the advanced digital services, scientific instruments, data, knowledge and expertise they need to collaborate to achieve excellence in science, research and innovation Data Instruments Digital services Knowledge & Expertise http://go.egi.eu/osc 6
Developing an OSC (1): Governance structure and funding models Analyse governance structure of existing infrastructure/knowledge resource systems in open science Identify best practices and patterns for commoning Develop guidelines Define a multi-level governance European and national bringing together the different stakeholders including communities Identify funding models for sustainability and capacity building 7
Developing an OSC (2): Open Science Backbone A set of standardised generic ICT capabilities across countries and communities offering Compute/Data intensive capabilities Easy discovery, access, use and reuse of open data Shared capacity for RIs and long tail Supporting open standards (both API and data formats) Complemented by community-specific and communitymanaged services Research Infrastructures 8
Developing an OSC (2): Shared Open Science Infrastructure Backbone Federated operations and support Service desk Monitoring and accounting Capacity management Service level management Network of CSIRT Federated IdPs, Auth and Authz Management of different levels of assurance Research Infrastructures and long tail of science Research platform built on top of shared capabilities plus community owned resources Data products, tools, scientific gateways, virtual labs Multi level governance with community participation Local National European Shared capabilities based on open standards Common national pools of resources From Member States Capacity dedicated to large RIs Free pools for long tail researchers Both publicly funded and commercial providers (all supporting open standards and no lock in) Core capabilities Open Science Cloud (e.g., VM management, Data storage/access/disco very) PID Service registry and marketplace 9
Developing an OSC (3): Research data Stimulate the creation of public repositories of open research data Stimulate a culture of sharing and the right incentives to contribute and maintain Address legal and policy issues Prefer minimal IPR or non-exclusive licensing Many initiatives exist (e.g. RDA, CODATA) 10
Developing an OSC (4): European open knowledge hubs A coordinated network of Competence Centres / Centre of Excellence Offering knowledge and expertise Distributed for scientific software, applications, Training and Competence education Centres tools from ESFRI RIs Knowledge and expertise from a network of European training and education centres Scientific software is open, documented, discoverable, supported Support to access different capabilities (HTC, HPC, cloud, open research data, tools, applications, software ) and VRE projects e Infrastructure support and training Open Knowledge Hub 11
The WeNMR example Credits: A. Bonvin 12
Why federating? Exchange of services Coordinated actions to promote open standards Ensure portability of applications and data across the federation Coordinated data access policies and replication when necessary Coordinated SLAs and OLAs to international research communities Coordinated support Possibility to federated services worldwide and to scale up with on-demand extra capacity 13
Thank you for your attention. Questions? www.egi.eu http://cf2015.egi.eu This work by EGI.eu is licensed under a Creative Commons Attribution 4.0 International License.