From national to regional and global e- Infrastructures http://www.grnet.gr Dr. Ognjen Prnjat European and Regional e-infrastructure manager Greek Research and Technology Network WACREN Conference, Dakar
Outline National-level organization: GRNET case study Regional integrations Pan-European integrations Worldwide integrations
GRNET mission GRNET is a state-owned company operating under the Ministry of Education (General Secretariat of Research & Technology); non-profit Main mission is to provide high-quality e-infrastructure services to the Greek academic and research institutions: National and international connectivity services Computing and storage Infrastructure services Supporting activity is the promotion and dissemination of the use of ICT in the public and private sector towards an e- Government, e-learning and e-business environment GRNET was one of the first NRENs in Europe to expand its services to include computing, storage Being infrastructure-oriented and application-neutral serving all user e-science communities Adopting the EU e-infrastructure trends
GRNET main networking tasks Interconnects universities, research centers, academic organizations (>150), primary and secondary schools (15000) 500.000 end-users Continuously upgrades the national backbone: Dark fiber backbone (Nx10 Gbps), institutions access (1 10 Gbps per institution) and international backbone (4*10 Gbps) Operates the GR Internet Exchange (GR-IX), peering of Greek commercial ISPs at 10Gbps each Cooperates with Greek and international research and academic institutions for the development of innovative networking services
GRNET network >50 PoPs 9000km fibers (IRU) MANs Attiki & Thessaloniki DF loops 33 cities Single-mode fiber pair 15-years IRUs Availability > 99% 1GbE interconnection over DF to the closest IP router 10GbE links for the Power Users 5
GRNET main computing technologies Grid - HTC HPC Cloud 6
HELLASGRID infrastructure http://www.hellasgrid.gr/infrastructure HG-01 cluster (pilot phase): @Demokritos - Athens 64 CPU, 10TB FC SAN, 12TB Tape Library, glite middleware HG02-HG07 clusters (HG project): Athens (NDC/EKT,Min EDU, IASA), Thessaloniki (AUTH), Crete (ICS-FORTH).Patras (CTI) ~1200 Cores ~40 TBytes total raw SAN storage capacity ~80TBytes Tape Library 6 extra Sites offered by Greek Universities/Research institutes (FORTH-ICS, AUTH,IASA, UoA, UoI, UOI-HEPLAB, Upatras) ~600 Cores and 200 TB of Storage Part of pan-eu EGI infrastructure, with X509 access 7
HPC infrastructure ARIS supercomputer 180 Tflops supercomputing system 1PB of parallel file storage Hosted in GRNET s existing Datacenter Support for a wide range of scientific disciplines: Biomedicince, Bioinformatics, Computational Engineering, Physics, Meteorology, Climatology, Seismology, Computational Chemistry etc. Was top 500 when launched in 2015
Cloud: okeanos service ~okeanos is set to deliver Infrastructure Compute (Virtual Machines) Network (Virtual Networks, private Ethernets (L2) or public IPv4/6) and Storage (Virtual Disks) as a Service Target group: GRNET s customers direct: IT depts of connected institutions indirect: university students, researchers in academia Users manage resources over a simple, elegant UI, or a REST API, for full programmatic control 84 racks, 1200+ servers, 10000 Virtual Machines (windows, ubuntu, debian), 5 Petabytes of storage
okeanos service http://www.grnet.gr Virtual Compute Machines Virtual Network Ethernets Virtual Storage Disks Virtual Security Firewalls
5x 8x 2x 1x okeanos service http://www.grnet.gr
cloud storage - Pithos Online storage for all Greek academic and research community 50 or 100 GB/user; files, groups Access by web browsers, native test apps, iphone, Android Open source implementation and API (REST) v2 of the API, compatible with OpenStack object storage Also used in ~oceanos: Stores custom and user-created images Plankton provides image registry over pithos
Cloud Infrastructure: Data Centers Data Center 1 (NDC) Status Production operation Location National Documentation Center, Athens, Greece Purpose Central PoP of GRNET, Connection to GEANT, GR-IX, Cloud and Grid services Number of Racks - 16 Total Power 110KW with N+1 redundancy Data Center 2 (MINEDU) Status Production operation Location Ministry of Education Athens, Greece Purpose Cloud/HPC services Number of Racks - 28 Total Power 450KW with N+1 redundancy Data Center 3 (LOUROS) Status Design phase Location Hydroelectric Plant of Louros Purpose GRNET disaster recovery for cloud/hpc services, GREEN Data Center, PUE<1.3 Number of Racks - 14 Total Power 250KW with N+1 redundancy
Cloud snapshots
Outline National-level organization: GRNET case study Regional integrations Pan-European integrations Worldwide integrations
Network: SEELIGHT SEEREN projects set up regional NREN connectivity and GEANT links SEE-LIGHT: South-East European Lambda Network Facility for R&E Deployment of an advanced regional network infrastructure, fibres and equipment Under the Hellenic Plan for the Economic Reconstruction of the Balkans HiPERB (80-20) Serbia implementation stage, Bulgaria tender stage, Romania on own funds, FYR of Macedonia ongoing SEENet: a management body for SEELIGHT
Grid: the SEE-GRID series At end of SEE-GRID projects series: 55 sites in production
Grid: regional organisation
HP-SEE: regional HPC infrastructure 3 top 500 supercomputers in June 2015 (Bulgaria, Greece, Hungary) Heterogeneous infrastructure - Blue Gene/P SCs, large HPC clusters with advanced interconnects. Advantage to users To support a substantial number of libraries, toolkits, codes and application software HP-SEE 1 st Periodic Review Meeting, Belgrade, October 26, 2011 19
HPC: Distributed management Distributed set of services supports infrastructure operations AAA framework Resource Management System ARC-LDAP service Accounting System Helpdesk (Request Tracker based) Monitoring (Nagios + local tools) HP-SEE 1 st Periodic Review Meeting, Belgrade, October 26, 2011 20
HPC: Trans-national usage and sharing Local vs. External HP-SEE usage 100% 90% 80% 70% 60% 50% 40% 30% External HP-SEE usage Local HP-SEE usage 20% 10% 0%
VI-SEEM VRE for regional Interdisciplinary communities in SEE and EM Merging of SEE and EM regions SEE: network SEEREN1-2, Grid SEE- GRID-1/2/SCI, HPC HP-SEE EM: HPC LinkSCEEM1-2 Partici pant no. 1 (Coord Participant organisation name Part. short name Country GREEK RESEARCH AND TECHNOLOGY NETWORK GRNET Greece S.A. ) 2 THE CYPRUS INSTITUTE CyI Cyprus 3 INSTITUTE OF INFORMATION AND COMMUNICATION TECHNOLOGIES BULGARIAN ACADEMY OF SCIENCES IICT-BAS Bulgaria 4 INSTITUTE OF PHYSICS BELGRADE IPB Serbia 5 NATIONAL INFORMATION INFRASTRUCTURE DEVELOPMENT INSTITUTE NIIF Hungary 6 WEST UNIVERSITY OF TIMISOARA UVT Romania 7 POLYTECHNIC UNIVERSITY OF TIRANA UPT Albania 8 UNIVERSITY OF BANJA LUKA UNI BL Bosnia and Herzegovina 9 SS CYRIL AND METHODIUS UNIVERSITY OF SKOPJE UKIM FYR of Macedonia 10 UNIVERSITY OF MONTENEGRO UOM Montenegro 11 RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION OF MOLDOVA RENAM Moldova 12 INSTITUTE FOR INFORMATICS AND AUTOMATION PROBLEMS OF THE NATIONAL ACADEMY OF SCIENCES OF THE REPUBLIC OF ARMENIA IIAP-NAS- RA Armenia 13 GEORGIAN RESEARCH AND EDUCATIONAL NETWORKING ASSOCIATION GRENA Georgia 14 BIBLIOTHECA ALEXANDRINA BA Egypt 15 INTER UNIVERSITY COMPUTATION CENTER IUCC Israel 16 SYNCHROTRON-LIGHT FOR EXPERIMENTAL SCIENCE AND APPLICATIONS IN THE MIDDLE EAST SESAME Jordan
VI-SEEM Technology context Overall objective: Provide userfriendly integrated e- Infrastructure platform for Scientific Communities in Climatology, Life Sciences, and Digital Cultural Heritage for the SEEM region; by linking compute, data, and visualization resources, as well as services, software and tools. Diverse computing technologies Advent of big data Service orientation
VI-SEEM: User-centric approach
VI-SEEM: Key Performance Indicators e-infrastructure: 21500 CPU cores, 325000 GP-GPU cores and 18500 Intel Xeon Phi cores of HPC, 2900 grid cores, 10500 cloud VM cores, 11 PBytes of storage (of which dedicated 5-15%, 10-15%, 5% and 10% respectively) > 10 specific services, 30 data sets and 25 codes 39 applications, 45 research teams taking part. 100 publications, 50 presentations 17 dissemination events,12 training events
VI-SEEM: Types of applications Climate Life Sciences Cultural Heritage Regional Climate Modeling and Molecular Digital Libraries Modelling Dynamics (MD) study of important drug targets Global Climate Computer-aided drug Interactive Visualization Modelling Weather Forecasting Air Pollution/Quality Model Development Visualization, Datasets, etc. design Analysis of Next Generation DNA sequencing data and RNA profiling data Data mining to identify prevalent diseases/mutations in the SEEM region Image processing for biological applications Computational simulation of DNA and RNA Tools Semantic Referencing Image Classification Modelling of Built Environments and Advanced Representation Techniques Scientific simulation of materiality and systems' properties Other Synchrotron data analysis Geo-referencing Tools Other Bioarchaeology
Outline National-level organization: GRNET case study Regional integrations Pan-European integrations Worldwide integrations
Pan-EU infrastructures
Outline National-level organization: GRNET case study Regional integrations Pan-European integrations Worldwide integrations
MAGIC project Middleware for collaborative Applications and Global Virtual Communities Objective (sub): Develop a model for inter-operation between NREN application markets of participating world regions, taking advantage of applications developed and run by NRENs across different continents to create a model for a worldwide application market for collaboration tools and services
MAGIC project: service catalogue Providing application/service sharing platform via a catalogue In implementation now Current services: collaboratorio, file sender, docuwiki Based on GEANT cloud catalogue
MAGIC project: service catalogue
Conclusion GRNET as Case study for national-level developments Regional integrations very important WACREN and related partners as centre of gravity for technology, but also community Path to worldwide infrastructures and integrations Globally different e-infrastructure solutions available to scientists Resource sharing is key: VI-SEEM VRE as an example MAGIC project will establish a global catalogue of applications/services WA can contribute its open services to the global pool
Thank you!