Federated Services and Data Management in PRACE

Transcription

1 Federated Services and Data Management in PRACE G. Erbacci, (CINECA and PRACE) Collaborative Services for e-infrastructure Commons e-irg Workshop, Bratislava November 2016

2 Partnership for Advanced Computing in Europe PRACE is an international not-for-profit association under Belgian law, with its seat in Brussels. PRACE counts 25 members and 2 observers. The PRACE Hosting Members are France, Germany, Italy and Spain. PRACE is governed by the PRACE Council in which each member has a seat. The daily management of the association is delegated to the Board of Directors. PRACE is funded by its members as well as through a series of implementation projects supported by the European Commission.

3 4 Hosting Members offering core hours on 6 world-class machines + 1 JUQUEEN: IBM BlueGene/Q GAUSS/FZJ Jülich, Germany SuperMUC: IBM GAUSS/LRZ Garching, Germany Hazel Hen: Cray GAUSS/HLRS, Stuttgart, Germany CURIE: Bull Bullx GENCI/CEA Bruyères-le-Châtel, France MareNostrum: IBM BSC, Barcelona, Spain Marconi: Lenovo CINECA Bologna, Italy ~30 PFlop/s in total 11.4 thousand million core hours awarded since 2010 Piz Daint: Cray XC30 CSCS Lugano, Switzerland + Tier-1 Systems 26 PRACE national sites distributed in 19 different Countries are operational > 17 PFlop/s in total Apart Tier-1 for Tier-0 services, partners provide resources for DECI calls

4 465 scientific projects enabled 12.2 thousand million core hours awarded since 2010 with peer review, main criterion is scientific excellence. Open R&D access for industrial users with >50 companies supported >7 350 people trained by 6 PRACE Advanced Training Centers and others events 30 Pflop/s of peak performance on 7 world-class systems 530 M of funding for , access free at the point of usage 25 members, including 5 Hosting Members (France, Germany, Italy, Spain, Switzerland)

5 Access through PRACE Peer Review Free-of-charge required to publish results at the end of the award period Open to international projects Project Access (every 6 months) award period 1 to 3 years Individual researchers and groups No restriction on nationality for both researcher and centre Required to demonstrate technical feasibility of project Preparatory Access (cut-off date every 3 months) Optional support from PRACE experts Prepare proposals for Project Access

6 Project Access Open Call for Proposals Technical Review Scientific Peer Review Right to reply Priorisation + Resource Allocation Project + Final Report ~ 2 Months ~ 3 Months Up to 3 years Technical experts in PRACE systems and software Researchers with expertise in scientific field of proposal Access Committee Researcher

7 Type of Prep Access Type A Type B Type C Type D Code Already Scales to Tier-0 Minimum? Yes, this is a prerequisite Yes, this is a prerequisite Yes, this is a prerequisite Possibly, but not necessarily. Potential must be demonstrated. Preparatory Access Types System Duration Apps enabling work needed for efficient running? Tier-0 only 3 months No, scaling testing only Tier-0 only 6 months Yes, work will be done by researchers themselves Tier-0 only 6 months Yes, staffing resources from project requested Tier-1 and Tier-0 12 months Yes, staffing resources from project requested Expected outcome Application for Project Access for production runs Application for Project Access for production runs Application for Project Access for production runs Application to Prep Access A, B or C to prepare code for Tier-0 access, application for Project Access, SHAPE or DECI for production runs 7

8 SME HPC Adoption Programme in Europe Programme to raise awareness and assist SMEs in taking advantage of HPC Enable development of new products; reduce time-to-market and R&D costs; increase quality Aims to enable SMEs to overcome barriers to HPC adoption Such as cost, lack of expertise, access to resources, Successful applicants get effort from a PRACE HPC expert and machine time at a PRACE centre 8

9 Upcomming Seasonal Schools September 2016 Seasonal Schools Have been running since 2008 Offering top-quality face-to-face training events Organised around / all over Europe Topics range from generic intermediate to advanced From programming techniques to more specialised topical schools 9 PRACE Autumn School 2016, Austria - Modern HPC Development for Scientists and Engineers April 2017 PRACE Spring School 2017, Sweden - HPC in the Life Sciences

10 PATC Programme courses, 215 training days New courses on forward-looking topics New hardware and programming paradigms Data science Collaboration with CoEs on several courses 10

11 Training and Events Portal Single hub for the PRACE training events, training material and tutorials Number of page views increased by 25% and number of users by 45% since

12 Operation and Coordination of the Comprehensive common PRACE Operational Services - Common view of the PRACE infrastructure more than a collection of individual systems - Responsible for both Tier-0 systems and Tier-1 systems providing Tier-1 for Tier-0 services Key assets of the operational infrastructure 12 Infrastructure and common services Consolidated Operational Structure and Procedures PRACE Service Catalogue Implement operational Key Performance Indicators Security Forum to address security issues

13 PRACE Operational Coordination Team Matrix organisation for Operations Coordinated by WP6 Leader Task Leaders for the deployment of service categories: Networking, Data, Compute, AAA, User, Monitoring and Generic Site representatives are responsible for services at their site Bi-weekly telcos to discuss the status of services and sites and proposed or planned changes Changes are managed following a well defined procedure 13

14 Network services Current PRACE dedicated network A central L2/L3 switch in Frankfurt connecting 14 partners via 10 Gb/s wavelength An IPSEC/GRE gateway in Frankfurt connecting 5 partners with 1 Gb/s IPSEC/GRE tunnels two partners via 1 Gb/s GÉANT-L2VPN connections Future PRACE dedicated network The infrastructure will be setup on the combined GÉANT / NRENs backbone providing a VPN between the PRACE partners (MDVPN service) All partners will be connected by VLANs through their normal NREN connection to this PRACEVPN At NRENs, where MDVPN solutions are not available, partners can be connected via an MDVPN-Proxy provided by GÉANT 14

15 Monitoring of PRACE-RI Services INCA no more supported by SDSC Replaced by ICINGA 2 monitoring tools Deployed the new middleware and corresponding user interface for gathering and presenting monitoring data New domain name: 14 Hosts now connected 7 independent sets of services monitored Integration for all PRACE sites with valid user certificate 15 Checks: software.version.libraries software.version.compilers software.version.shells gsissh.port Host availability check based on gsissh port state gsissh.s2s site to site gsissh connection check gridftp.s2s site to site gridftp connection check software.version.tools

16 16 PRACE Security Forum Coordinates security activities Define Policies and Procedures: to build a trust model that allows smooth interoperation of the distributed PRACE services Risk reviews: to define and maintain An agreed list of software and protocols that are considered robust and secure enough to implement the minimal security requirements Operational security: coordination of incident handling All PRACE operational partners are members of the Security Forum Collaboration with other large distributed computing infrastructures (EGI, EUDAT, XSEDE, WLCG, OSG) on policies and procedures Continues the representation of PRACE as relying party of EUGridPMA, the policy authority for trusted Certificate Authorities

17 Operational Security AAI Security collaboration Collaboration with EGI CSIRT and EUDAT on sharing of information on incidents and vulnerabilities Accreditation of PRACE CSIRT team at Trusted Introducer service from GEANT ongoing PRACE is Relying Party of EUGridPMA, the policy authority for the distribution of trusted Certificate Authorities PRACE is represented in the AARC (Authentication and Authorisation for Research and Collaboration) Project AARC objective: Enable the use of existing user credentials by the federation of existing Identity Providers and Service Providers WISE Information Security for Collaborating E-Infrastructures A trusted global framework where security experts can share information on different topics like risk management, experiences about certification process and threat intelligence 17 Joint effort of GEANT SIG-ISM and SCI (EGI, EUDAT, HBP, PRACE, WLCG, XSEDE)

18 Analysis and Development of Prototypal New Services - Provision of urgent computing services - Link with large-scale scientific instruments Link with the European Synchrotron Radiation Facility (CaSToRC) MIC-oriented Multithreading for HEP and Health Geant4 Computations (NCSA) HPC support for Extreme Light Infrastructure ELI-ALPS project (NIIF) Linking Next Generation Sequencers with PRACE (UiO) Large Synoptic Survey Telescope (CNRS) - Smart post processing tools including in-situ visualisation - Provision of repositories for European open source scientific libraries and applications, to promote wide adoption of European products Analyse and investigate the prototypal implementations at the pre-production level (involving first Tier-1 systems and then Tier-0 systems) Investigate the possible adoption in a next phase as production services 18

19 Data Collaboration with EUDAT MoU signed between PRACE and EUDAT Data pilots proposal analysis to identify use cases Get required changes on EUDAT services roadmap Data pilot identification: DECI Call 13: 5 pilots Deliver data management training to data pilots team ongoing work to make it available for PRACE users Gather detailed requirements Resources available for the project Detailed timelines Data Management Plan Technical constraints Implementation ongoing in close collaboration with EUDAT team 19 Contacts with CoEs on Data Management Issues

20 Overview of the 4 pilots User scripts Workflows Module EUDAT Post processing Data User space Post processing Workspace Data MD Digital Object Registered Data Domain 20

21 PRACE GEANT Collaboration MoU signed between PRACE and GEANT Legal fundament to collaboration between both projects The current PRACE network infrastructure is spanning across several NRENs and the GÉANT infrastructure since more than 10 years A continuous adjustment to PRACE requirements but also to GÉANT and NREN services is essential to improve the performance and transfer capacity as well as to secure the communication streams across a global European network GEANT is interested in testing its upcoming services, if those fit user requirements, the same applies to PRACE where evaluating new services in an early state might be very valuable. 21

22 PRACE-EGI Collaboration MoU signed between PRACE and EGI Engage Projects Better identifying and coordinating common actions toward the interoperability and the cross-adoption of different resources Collaborating to define common services and defining an integrated catalogue of e-infrastructure services, adopted from research communities Defining common actions on security, participating to the common boards defined by the WISE series of conferences; Providing a joint training actions on security aspects 22

23 Federated Services and Data Management Toward the interoperability with other public and private e-infrastructures, lowering technical and policy barriers by piloting concrete use cases with user communities Is important to provide European researchers and industries a seamless access to HPC and data resources and services Combination of respective services catalogue Harmonization of access policy fostering the uptake of services on the long-term Security for Collaboration among Infrastructures Implement the Open Science vision where resources of any kind and size are accessible without any technical barrier 23