European Grid Infrastructure

Similar documents
Outline. Infrastructure and operations architecture. Operations. Services Monitoring and management tools

EGI: Linking digital resources across Eastern Europe for European science and innovation

A European Cloud federation

On-demand Research Computing: the European Grid Infrastructure

On the EGI Operational Level Agreement Framework

EGI FedCloud; Connecting Researchers to Clouds

EGI Operations and Best Practices

EGI federated e-infrastructure, a building block for the Open Science Commons

High Performance Computing from an EU perspective

EGI-InSPIRE. Cloud Services. Steven Newhouse, EGI.eu Director. 23/05/2011 Cloud Services - ASPIRE - May EGI-InSPIRE RI

Scientific data processing at global scale The LHC Computing Grid. fabio hernandez

EGI, LSGC: What s in it for you?

E u r o p e a n G r i d I n i t i a t i v e

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE

Some aspect of research and development in ICT in Bulgaria. Authors Kiril Boyanov and Stefan Dodunekov

Coupled Computing and Data Analytics to support Science EGI Viewpoint Yannick Legré, EGI.eu Director

Open Science Commons: A Participatory Model for the Open Science Cloud

Storage Management in INDIGO

Regional e-infrastructures

Parallel computing, data and storage

AAI in EGI Current status

The Role and Functions of European Grid Infrastructure

EU Projects. Christoph Witzig

EGI Strategy Enabling collaborative data- and compute-intensive science

The LHC Computing Grid

Federated access to e-infrastructures worldwide

EGI FedCloud Task Force Demo

StratusLab Cloud Distribution Installation. Charles Loomis (CNRS/LAL) 3 July 2014

Moving e-infrastructure into a new era the FP7 challenge

Travelling securely on the Grid to the origin of the Universe

EGI-InSPIRE. EGI Applications Database (TNA3.4) William Vassilis Karageorgos, et al.

Grids and Clouds Integration and Interoperability: an overview

Co-ordination & Harmonization of Advanced e-infrastructures Research Infrastructures Grant Agreement n (

e-infrastructures in FP7: Call 7 (WP 2010)

E GI - I ns P I R E EU DELIVERABLE: D4.1.

The EPIKH, GILDA and GISELA Projects

Giovanni Lamanna LAPP - Laboratoire d'annecy-le-vieux de Physique des Particules, Université de Savoie, CNRS/IN2P3, Annecy-le-Vieux, France

Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

Interconnection of Armenian e- Infrastructures with the pan- Euroepan Integrated Environments

e-infrastructures in Horizon 2020 e-infrastructures for data and computing

Introduction to EGI. Mission Services Governance International collaborations Contribution to DSM and EOSC.

Cloud interoperability and elasticity with COMPSs

e-infrastructure: objectives and strategy in FP7

SA1 and JRA1 Operations and Operational Tools

Enabling BigData Workflows in Earth Observation Science

First Experience with LCG. Board of Sponsors 3 rd April 2009

EUDAT- Towards a Global Collaborative Data Infrastructure

Grids and Clouds Integration and Interoperability: an overview

The EGEE-III Project Towards Sustainable e-infrastructures

Helix Nebula The Science Cloud

Grid Interoperation and Regional Collaboration

Enhancing Research Data Collaboration Using Science Gateways

The National Research and Education Network. Problems and Solutions

EGI-Engage: Impact & Results. Advanced Computing for Research

g-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.

EUDAT. Towards a pan-european Collaborative Data Infrastructure. Damien Lecarpentier CSC-IT Center for Science, Finland EUDAT User Forum, Barcelona

A short introduction to the Worldwide LHC Computing Grid. Maarten Litmaath (CERN)

2. HDF AAI Meeting -- Demo Slides

INDIGO-DataCloud Architectural Overview

Parallel Computing in EGI

Prototype DIRAC portal for EISCAT data Short instruction

South African Science Gateways

Pasquale Vitale Engineering Ingegneria Informatica. FIWARE Technology

WLCG and Grid Computing Summer 2011 Part1: WLCG Markus Schulz. IT Grid Technology Group, CERN WLCG

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

Grid and Cloud Activities in KISTI

A VOSpace deployment: interoperability and integration in big infrastructure

The EUDAT Collaborative Data Infrastructure

Agenda: Alberto dimeglio (AdM) Balazs Konya (BK) Helmut Heller (HH) Steve Crouch (SC)

Networking European Digital Repositories

Initial Operating Capability & The INSPIRE Community Geoportal

Preparing for High-Luminosity LHC. Bob Jones CERN Bob.Jones <at> cern.ch

Progress towards the EOSC

Operating the Distributed NDGF Tier-1

The CHAIN-REDS Project

Grid Scheduling Architectures with Globus

Enabling Intercontinental e-infrastructures a Case for Africa

EGI, the EOSC and the Hub

Orchestrating the Cloud Infrastructure using Cisco Intelligent Automation for Cloud

EuroHPC and the European HPC Strategy HPC User Forum September 4-6, 2018 Dearborn, Michigan, USA

Bob Jones. EGEE and glite are registered trademarks. egee EGEE-III INFSO-RI

EOSC Services & Architecture: the EOSC-hub approach Tiziana Ferrari, Project Coordinator, EGI Founda?on

Grid Computing at the IIHE

Hybrid cloud solutions that power business transformation

Europe and its Open Science Cloud: the Italian perspective. Luciano Gaido Plan-E meeting, Poznan, April

RUSSIAN DATA INTENSIVE GRID (RDIG): CURRENT STATUS AND PERSPECTIVES TOWARD NATIONAL GRID INITIATIVE

BeSTGRID. TEC IDF Fund. BeSTGRID planning began over 3 years ago. TEC Innovation and Development Fund. $2.5million: Sep 2006 March 2008

Networking European Digital Repositories

EGEE and Interoperation

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms

Operation of Site Running StratusLab toolkit v1.0

Garuda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore.

hybrid cloud for science Kickoff Phase 3 Pilot FeBRUARY, 6 th / 7 th 2018 Team T-Systems/Huawei/Cyfronet/Divia

European Open Science Cloud Implementation roadmap: translating the vision into practice. September 2018

New Zealand Government IBM Infrastructure as a Service

Best Practices for the use of e-infrastructures by large-scale research infrastructures

The Digitising European Industry strategy & H2020 calls related to Cyber-Physical Systems

Pre-Commercial Procurement project - HNSciCloud. 20 January 2015 Bob Jones, CERN

Using EUDAT services to replicate, store, share, and find cultural heritage data

Petaflop Computing in the European HPC Ecosystem

Transcription:

EGI-InSPIRE European Grid Infrastructure A pan-european Research Infrastructure supporting the digital European Research Area Michel Drescher Technical Manager, EGI.eu Michel.Drescher@egi.eu TPDL 2013 Panel:

EGI Vision To support the digital European Research Area through a pan-european research infrastructure based on an open federation of reliable services that provide uniform access to national computing, storage and data resources. 2

EGI Mission To connect researchers from all disciplines with the reliable and innovative ICT services they need to undertake their collaborative world-class and worldspanning research Core Values Leadership Reliability Openness Innovation 3

EGI European Over 35 countries Grid Secure sharing Infrastructure Computers Cloud Data Instruments. and others 4

EGI.eu Coordination for European Grid resources Established February 8th 2010 Central policy & services needed to run a grid Sustainable small coordinating organisation Based in Amsterdam Coordinating core (~25 people) in Amsterdam Technical services from partners (~20 people) EGI and EGI.eu: Supported by the EGI-InSPIRE project 5

EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4 year project with 25M EC contribution Project cost 72M Total Effort ~ 330M Effort: 9261PMs Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 partners) 6

Operational Infrastructure Registered Users: 22,197 VOs: 237 LCPUs: 361,300 Disk: 235PB Tape: 176PB Jobs: 1.44 million/day Resource Centres EGI-InSPIRE & EGI Council members 319 Including integrated RPs 347 Countries EGI-InSPIRE & EGI Council members 42 Including integrated RPs 53 Integrated EGI-InSPIRE Partners and EGI Council Members External Resource Providers (integrated) Internal/External Resource Providers (being integrated) Peer Resource Providers 7

EGI Solutions Portfolio Community Driven Innovations Federated Infrastructure Operations Community Networks and Support Federated High- Throughput Data Analysis Federated Infrastructure as a Service Cloud 8

EGI.eu Service Portfolio Coordination Consulting and Support Marketing and Outreach Software and Services Project and Programme Management Specialised Consultancy Marketing Federated Operations Operations Coordination Strategy and Policy Decision Support Outreach Repository of Validated Software Technology Coordination Policy Development Applications Database Security Coordination Technical Consultancy and Support Training Marketplace Helpdesk Support http:///services/ 9

NGI / RC Service Portfolio Core Platform HTC Platform Cloud Platform Information Service Grid Compute Cloud Compute VO Membership Management Grid Storage Cloud Storage Service Hosting Data Management Workflow Manager NGI = National Grid Infrastructure RC = Resource Centre http:///services/ work in progress 10

EGI Collaboration Platform Tools & Services enabling cross-community collaboration EGI s Platforms for H2020 ERA needs an open ecosystem of VREs & services Virtualised Community Platform (VRE) EGI Cloud Infrastructure Platform A federated IaaS Cloud infrastructure Hybrid Community Platform (VRE) Integrated Community Platform (VRE) EGI Core Infrastructure Platform Operational services necessary for the management of federated DCDIs 11

Thank you! Questions? 12

BACKUP 13

Decade-long legacy 2001 2004 EDG From 2010 EGI 2004 2010 EGEE I III 14

From Homogeneity EDG & EGEE were homogenous projects Resources, Software & Users EGEE served the Heavy User Communities High-energy Physics / WLCG Astrophysics Earth Sciences Life Sciences with one Grid middleware. 15

to Heterogeneity 20k researchers 2M researchers! Few related use cases Many diverse use cases 16

EGI s Core Infrastructure The services that federate and integrate the functional services deployed in the production infrastructure Information Discovery (BDII) Federated AAI Monitoring Accounting Metrics Visualisation (gstat) Service Catalogue (GOCDB) Messaging Operations Portal EGI Core Infrastructure Platform For e-infrastructures, Research Infrastructures & Community Platforms 17

EGI Collaboration Platform Image Metadata Marketplace Image Repository EGI s Cloud Infrastructure Enable an open ecosystem of services EGI Cloud Infrastructure Platform VM Mgmt Storage Mgmt Information Cloud Management Stacks (OpenStack, OpenNebula, ) Federated AAI Central Service Registry Monitoring EGI Core Infrastructure Platform Accounting 18

Cloud services for VREs EGI Core Infrastructure Service Availability SAM Configuration DB GOCDB Accounting APEL External Services Certification Authorities ID Management Federations OCCI Clients rocci; WNoDeS-CLI SlipStream, VMDIRAC, CompatibleOne VOMS proxy OCCI server CDMI server AAI VOMS Proxy User Interfaces Resource Providers OpenNebula OpenStack StratusLab WNoDeS Syneffo, others Marketplace client CDMI Clients Libcdmi-java SSM Vmcatcher Vmcaster LDAP Image Metadata Marketplace Appliance Repository Information System Top-DBII Monitoring Nagios + community probes VO PERUN server 19