Gabriel Neagu Local project coordinator ICI Bucharest E_mail:

Transcription

1 SEE-GRID-SCI SEE-GRID-NGI project presentation and its application offer National Dissemination Event, September 26, 2009 Gabriel Neagu Local project coordinator ICI Bucharest E_mail: The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no

2 Outline References einfrastructure vision einfrastructure projects in the region SEE-GRID-SCI project overview SEE-GRID-SCI Infrastructure NGI support and monitoring Application services and Operational Tools Dissemination and training SEE-GRID-SCI application development SEE-GRID-SCI Vos Concluding remarks SEE-GRID-SCI National Dissemination Event, September 26,

3 References SEE-GRID-SCI Project presentation by Ognjen Prnjat project director Progress reports to the 5th Project Steering Committee meeting (September 9-11, 2009) SA1 Infrastructure operation / Antun Balaz, IPB, Serbia NA2 - National Grid Initiatives support and international collaboration Gabriel Neagu, ICI Bucharest NA3 Training and Dissemination Miklos Kozlovski, SZTAKI Budapest NA4 Regional Applications, Cevat Şener, METU Ankara, Turke VOs presentations: Seismology VO Dr. Can Özturan, Boğaziçi University, Turkey Meteorology VO - Dr. Vassiliki Kotroni, NOA, Greece Environmental VO / Dr. Emanouil Atanassov, IPP-BAS, Bulgaria SEE-GRID-SCI National Dissemination Event, September 26,

4 The pan-eu e-infrastructures vision The Research Network infrastructure provides fast interconnection and advanced services among Research and Education institutes of different countries The Research Grid infrastructure provides a distributed environment for sharing computing power, storage, instruments and databases through the appropriate software (middleware) in order to solve complex application problems Integrated networking & grid environment is called electronic infrastructure (einfrastructure) allowing new methods of global collaborative research - often referred to as electronic science (escience) The creation of the einfrastructure is a key objective of the European Research Area e-science Collaborations Grid Infrastructure Network Infrastructure SEE-GRID-SCI National Dissemination Event, September 26,

5 einfrasrtucture projects in SEE SEEREN1/2: establishing the regional inter-nrn interconnectivity and GEANT links [DGINFSO] SEEGRID1/2: building the regional Grid infrastructure within and beyond EGEE, building NGIs and user communities [DGINFSO] SEEFIRE: studying the feasibility of long-term solutions for dark fiber backbone in the region [DGINFSO] SEELIGHT: implementation of the lambda facility in the region [Greek HiperB] BSI: Caucasus region connections [DGINFSO] SEE-GRID-SCI: einfrastructure for large-scale environmental science: meteorology, seismology, env. protection. Inclusion of Caucasus. [DGINFSO] SEERA-EI: regional programme managers collaboration towards common einfrastructure vision and strategy [DGRTD] SEE-GRID-SCI National Dissemination Event, September 26,

6 Vision and context: converged communication and service infrastructure for SEE IPP.bg Seismology VO GRNET.gr Meteorology VO MTA SZTAKI.hu ICI.ro Environmental VO TUBITAK.tr UOB.rs RBI.hr UPT.al SEE-SCI SEE-GRID SEEFIRE + Geant Support UKIM.mk UoBL.ba RENAM.md UOM.me IIAP-NAS-RA.am e-infrastructure GRENA.ge SEE-GRID-SCI National Dissemination Event, September 26,

7 The project Contract n : RI Project type: I3 Start date: 01/05/2008 Duration: 24 months Total budget: Funding from the EC: Total funded effort, PMs: Web site: Contact person: Dr. Ognjen Prnjat, GRNET SEE-GRID-SCI National Dissemination Event, September 26,

8 The partnership Contractors GRNET CERN SZTAKI IPP-BAS ICI TUBITAK ASA/INIMA UoBL UKIM UOB UoM RENAM RBI IIAP-NAS-RA GRENA Greece Switzerland Hungary Bulgaria Romania Turkey Albania Bosnia-Herzegovina FYR of Macedonia Serbia Montenegro Moldova Croatia Armenia Georgia TUBITAK.tr UOB.rs RBI.hr IPP.bg UPT.al GRNET.gr MTA SZTAKI.hu SEE-GRID-SCI partnership UKIM.mk UoBL.ba RENAM.md ICI.ro UOM.me IIAP-NAS-RA.am GRENA.ge Third Party / JRU mechanism used associate universities / research centres SEE-GRID-SCI National Dissemination Event, September 26,

9 Project objectives Engaging international user communities (meteorology, seismology, environmental protection) and providing application-specific service extensions Providing infrastructure for new communities Consolidating actions towards long-term sustainability and European Grid Initiative inclusion Strengthening the regional and national human network SEE-GRID-SCI National Dissemination Event, September 26,

10 Work organization - PERT NA1 Project administrative and technical management SA1 einfrastructure operations Implementation of the advanced SEE- GRID infrastructure NA4 User communities support Study the Grid applications JRA1 Development of application-level services and operational tools Application requirements analysis Operational tools analysis Network Resource Provision Resource Centre Service Level Agreement monitoring and enforcement Adapt Grid applications Support the deployed applications Assess applications Grid usage and take-up Implementation of application-specific services Application extensions deployment and assessment Design, implementation and assessment of the applicationspecific monitoring and control tools NA2 NGI support and international collaboration NA3 Dissemination and Training SEE-GRID-SCI National Dissemination Event, September 26,

11 Grid infrastructure Dedicated CPUs: 1086 total Storage: 288 TB 40 sites in SEE-GRID-SCI production (increase in Y1: 6 sites) SEE-GRID-SCI National Dissemination Event, September 26,

12 Infrastructure management SEE-GRID-SCI National Dissemination Event, September 26,

13 Infrastructure operations Core services deployed redundantly, spread out Overall availability of resources Q4: 91.17% Catch-All Certification Authority + National CAs Operational tools as shown on previous slide Grid Operator on Duty (GOOD), Operations manual Fully interoperable with EGEE, overlapping Job success rate 94,27% SLA definition, monitoring and enforcement and corrective actions SEE-GRID-SCI National Dissemination Event, September 26,

14 Application Services and Operational Tools Objectives: Capture commonalities across scientific fields in terms of application requirements on Grid middleware Define development areas for middleware plug-ins and applicationlevel services Implement these 11 Application services / add-ons (4 in production) Examples: Seismic Data Server, User-Level Monitoring Tool, ESIP platform 7 Operational tools dedicated to: collect data relevant to the infrastructure operations from the point of view of application developers and users automate operational tasks and procedures which are particularly related to deployment and running of applications SEE-GRID-SCI National Dissemination Event, September 26,

15 National Grid Initiatives Initiating and structuring NGIs SEE-GRID pioneer of the NGI concept Significant developments in a number of areas: organisational stability, operational maturity, national-level support Armenia and Georgia very structured progress NGI development monitoring 44 detailed metrics, quarterly reporting and analysis NGI cookbook (detailed NGI setup guidelines, distributed to all other regions) NGI intermediate assessment (detailed assessment and recommendations) Providing active support for NGI establishment in other developing regions SEE-GRID-SCI National Dissemination Event, September 26,

16 NGI metrics 1. Organizational metrics 1.a. Set-up metrics 1.b. Organizational details 1.c. Membership 1.d.NGI Policy documents 2. Infrastructure, operations and middleware metrics 2.a. Infrastructure metrics 2.b. Operational metrics 2.c. Middleware metrics 3. User community metrics 4. Sustainability and international collaboration metrics 4.a. Funding Metrics 4.b. EGI related metrics 4.c. Industrial cooperation metric SEE-GRID-SCI National Dissemination Event, September 26,

17 NGI status Before SEE-GRID-SCI During SEE-GRID-SCI SEE-GRID-SCI National Dissemination Event, September 26,

18 Dissemination and training Dissemination Event Agenda: project website see-grid-sci.eu Training Event Agenda training portal Core promotional material Additional brochures and posters Harmonization of the training material Training material repository tinfrastructure: 18 sites, core services, mock CA A pool of 42 SEE-GRID-wide trainers, growing SEE-GRID-SCI National Dissemination Event, September 26,

19 Dissemination and training Large number of dissemination and training events duruind the 1st project year: 3 events at regional level dissemination events (meteorology workshop) 34 events at national level Total number of individuals Other dissemination-related activities: 2 newsletters; disseminations in public media: TV (3); Press Releases (3); Newspapers (3); E-newspapers (3); scientific papers (30+) and presentations (40+). SEE-GRID-SCI National Dissemination Event, September 26,

20 Application development NA4.1 Study the Grid applications Helps identify the requirements of target applications for adaptation and deployment NA4.2 Adapt Grid applications Support for initial application gridification and deployment. NA4.3 Support the deployed applications Operational and user support of the deployed applications. NA4.4 Assess applications Grid usage and take-up Three core VOs: meteorology, seismology and environmental protection SEE-GRID-SCI National Dissemination Event, September 26,

21 Application Questionnaire Topics of the Application questionnaire: 53 questions on General information, Primary scientific contact, Application details, Collaborations, Overall usage of Gridinfrastructure, Storage requirements, Hardware requirements for WNs, Parallelization, Overall performance imperatives Total of 16 applications Seismology VO: 6 Meteorology VO: 2 Environmental VO: 8 Application Review Committee: Review the progress of the applications belonging to its own VO based on such criteria as: Regional cooperation Regional user community Run on multi SEE-GRID sites SEE-GRID-SCI National Dissemination Event, September 26,

22 Application Life-Cycle SEE-GRID-SCI National Dissemination Event, September 26,

23 Applications: Seismology VO Acronym Application name Status Regional collaborators ELF Earthquake Location Finding Grid-mode deployed, Testing Grid-mode Boğaziçi Univ. (TR), Univ. of Ss Cyril and Methodius (MK), Middle East Tech. Univ. (TR) FPS Developing Gridmode MDSSP- WA NMMC3D SDS SRA Fault Plane Solution Massive Digital Seismological Signal Processing with the Wavelet Analysis Numerical Modelling of Mantle Convection in 3D Seismic Data Server Seismic Risk Assessment Developing Gridmode Grid-mode deployed, Testing Grid-mode Cluster-mode deployed Grid-mode prototype deployed Boğaziçi Univ. (TR), SZTAKI of HAS (HU) Faculty of Natural Sci. and Mathematics of Univ. of Ss. Cyril and Methodius (MK), Seismo. Dept. in Geophysical Inst. of BAS (BG), Seismo. Survey of Serbia (RS), Boğaziçi Univ. (TR) Seismo. Observatory in Geodetic and Geophysical Res. Inst. of HAS (HU), Dept. of Geophysics in Inst. of Geography and Earth Sci. of Eötvös Loránd Univ. (HU), Boğaziçi Univ. (TR) Boğaziçi Univ. (TR), Ss Cyril and Methodius Univ. of Skopje (MK), Middle East Tech. Univ. (TR) Middle East Tech. Univ. (TR), Geophysical Inst. of BAS (BG), Inst. of Geology and Seismo. of ASM (MD), Boğaziçi Univ. (TR) SEE-GRID-SCI National Dissemination Event, September 26,

24 Applications: Meteorology VO Acronym Application name Status Regional collaborators REFS WRF-ARW Regional scale multimodel, multianalysis Ensemble Forecasting System Weather Research Forecast Advanced Research WRF Grid-mode prototype deployed, Developing Grid-mode Grid-mode prototype deployed, Testing Grid-mode National Observatory of Athens (GR), South Environ. and Weather Agency (RS), Hydrometeo. Inst. of Montenegro (ME) Rudjer Boskovic Inst. (HR), Dept. of Geophysics, Faculty of Sci. at Univ. of Zagreb (HR), Republic Hydrometeo. Inst. Banja Luka (BA), Federal Hydrometeo. Inst. (BA), Georgian Res. and Educational Networking Association (GE), Faculty of Graphic Arts at Univ. of Zagreb (HR) SEE-GRID-SCI National Dissemination Event, September 26,

25 Applications: Environmental VO Acronym Application name Status Regional collaborators CHERS GreenView Study of CHanges of Environment with Remote Sensing Refinement of surface and vegetation parameters in SEE region based on satellite images Developing cluster-mode Developing Grid-mode Lizza-PAKP Lizza-PAKP Promotable MCSAES MSACM Monte Carlo Sensitivity Analysis for Environmental Systems Multi-scale atmospheric composition modeling Grid-mode prototype deployed Deployed at production-level Polytechnic Univ. of Tirana (AL), Inst. of Water, Energy and Environ. in Tirana (AL), IPP of BAS (BG) Tech. Univ. of Cluj-Napoca (RO), Eötvös Loránd Univ. (HU), Res. and Educational Networking Association of Moldova (MD), Univ. "Politehnica" Bucharest (RO), West Univ. of Timisoara (RO), State Hydrometeo. Service (MD), Tech. Univ. of Moldova Center for Sci. Res. and Univ. of Kragujevac (RS), IPP of BAS (BG), Inst. for Water Resources "Jaroslav Cerni" (RS), Belgrade Univ. Computing Centre (RS) IPP of BAS (BG), Ruder Boskovic Inst. (HR) Geophys. Inst. of BAS (BG), Inst. of Water, Energy and Environ. in Tirana (AL), IPP of BAS (BG), National Inst. of Meteo. and Hydrology of BAS (BG), State Agency "Civil Protection" (BG), Executive Environ. Ag. (BG), Aristotle Univ. Thessaloniki (GR), National Meteo. Admin. (RO) MSERRHSA Modelling System for Emergency Response to the Release of Harmful Substances in the Atmosphere Testing Gridmode Geophys. Inst. of BAS (BG), Inst. of Water, Energy and Environ. in Tirana (AL), State Agency "Civil Protection" (BG), National Inst. of Meteo. and Hydrology of BAS (BG), IPP of BAS (BG), Executive Environ. Agency (BG), Aristotle Univ. of Thessaloniki (GR), National Meteo. Admin. (RO) CCIAQ Assessment of Climate Change Impact on Air Quality Testing Gridmode Geophy. Inst. of BAS (BG), IPP of BAS (BG), National Inst. of Meteo. and Hydrology of BAS (BG), Aristotle Univ. of Thessaloniki (GR) ROMS Regional Ocean Modeling System Developing Grid-mode Division for Marine and Environ. Res. of RBI (HR), Faculty of Geology and Mining (AL), Inst. for Marine Biology of Univ. of Montenegro (ME) SEE-GRID-SCI National Dissemination Event, September 26,

26 Infrastructure usage by communities SEE-GRID-SCI sites have provided more than 15.4 million Normalized Elapsed CPU hours and more than 1.2 million number of jobs during Y1 SEEGRID VOs (seegrid, seismo, environ and meteo) National VOs (AEGIS VO, TRGRID VOs) Regional VOs (see) Number of jobs Normalized CPU time (hours) SEE-GRID-SCI National Dissemination Event, September 26,

27 Development support Application Support Group Structured on VOs Each application/sub-application is assigned a team of experts from the corresponding VO ASG provide support for gridification, deployment and certification of the applications. ASG Teams assigned to the applications were also defined in the Helpdesk Mailing list contact addresses were created to facilitate communication between the application developers and the corresponding ASG team. Collaboration Mechanisms VO specific mailing lists: {seismology, meteorology, environmental}@see-grid.eu Wiki sections for applications of 3 VOs at SEE-GRID-SCI National Dissemination Event, September 26, 2009 #SEE-GRID-SCI_VO_Applications 27

28 Collaboration Mechanisms VO meetings: EVO-based emeetings, workshops etc. Helpdesk groups and mailing lists created for the ASG members could be used as a communication medium for application support within VOs. SEE-GRID-SCI National Dissemination Event, September 26,

29 Application development assessing All VOs are actively developing their applications and using them as being developed. Unlike the applications from meteorology and environmental protection area, the seismological applications are more data than CPU intensive. They have also been progressing in the usage since the time when the seismic data schemas and access methods were made ready. They are also expected to increase the usage as more data is collected in the seismic repository. High-percentage of SEE-GRID-SCI VO users is MPI-based. Strong regional collaboration has been achieved in all the three scientific domains supported. VOs are maturing in terms of their applications, repositories and researchers, and in the use of the einfrastructure. SEE-GRID-SCI National Dissemination Event, September 26,

30 Concluding remarks Vision: Being on the technological par with the rest of Europe Enabling local scientists to use their potential Role-model for regional developments Strategic success metrics of regional initiatives: not Gbps/sec; number of nodes; TBs of storage Impact: Increasing the retention of talented scientists in the region Pursuing joint R&D efforts among countries in the region Easing the digital divide between the region and rest of EC Improvement of regional competitiveness SEE-GRID-SCI National Dissemination Event, September 26,