EGI, LSGC: What s in it for you? Sílvia Delgado Olabarriaga e-bioscience Group Bioinformatics Laboratory Dept of Epidemiology, Biostatistics and Bioinformatics
2 Summary Before EGI EGI Life Science Grid Community Taking part S. Olabarriaga, BioAssist Meeting 12 Aug 2011
3 Before EGI S. Olabarriaga, BioAssist Meeting 12 Aug 2011
4 EGEE Enabling Grids for e-science is the largest multi-disciplinary grid infrastructure in the world, which brings together more than 140 institutions to produce a reliable and scalable computing resource available to the European and global research community. At present, it consists of approximately 300 sites in 50 countries and gives its 10,000 users access to 80,000 CPU cores aroundthe-clock http://www.eu-egee.org/ 2 Phases of 2 years I, 2004-2006 II, 2006-2008 III, May 2008 April 2010 S. Olabarriaga, BioAssist Meeting 12 Aug 2011
5 EGEE & Biomedical Applications Life Sciences cluster BIOMED Virtual Organization (VO) 200+ Members Coord: Johan Montagnat Admins: team (shifts) Most active: France, Spain, Italy, UK Also: Greece, Vietnam, Latin America, and many others http://wiki.healthgrid.org/lsvrc:biomed S. Olabarriaga, WB Biolab, 27 April 2010
6 In the meantime in NL NBIC Bioassist Life Science Grid (LSGRID VO) VL-e project Various VO s: VLEMED, PVIER, VLEBIO, VLE BiGGrid S. Olabarriaga, BioAssist Meeting 12 Aug 2011
7 European Grid Initiative S. Olabarriaga, BioAssist Meeting 12 Aug 2011
8 EGI: May 1st, 2010 http://www.egi.eu/ European Grid Initiative an organisation being developed to coordinate the European Grid Infrastructure, based on the federation of individual National Grid Infrastructures, to support a multi-disciplinary user community. http://knowledge.eu-egi.eu/knowledge S. Olabarriaga, BioAssist Meeting 12 Aug 2011
EGI: Resources (Showing yearly increase) 338 Resource Centres Europe, Asia Pacific, North and South America 51 Countries Capacity 240,000 CPU cores 1.89 Million HEP-SPEC 06* 102 PB disk, 89 PB tape * Million HEP-SPEC 06 Normalised CPU time to a reference value of Mega HEP-SPEC 06 S. Olabarriaga, BioAssist Meeting 12 Aug 2011 9
10 EGI Collaboration Research Community Research Community Research Community NGI: National Grid Initiative EIRO: European Intergovernmental Research Organisation (e.g. CERN, EMBL, ESA, ) N G I E I R O N G I N G I EGI.eu 11/10/11 HealthGrid 2011, Bristol, UK E I R O N G I
d 2011, Bristol, UK EGI.eu Coordination for European Grid resources Established February 8th 2010 Central policy & services needed to run a grid Sustainable small coordinating organisation Based at Amsterdam Coordinating core (~20 people) in Amsterdam Technical services from partners (~20 people) EGI and EGI.eu are supported by EGI-InSPIRE project 11/10/11 11
HealthGri d 2011, Bristol, UK EGI-InSPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4 year project with 25M EC contribution Project cost 72M Total Effort ~ 330M Effort: 9261PMs Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 partners) Un-Funded 11/10/11 Funded 12
13 EGI Ecosystem National Resource MoU s& Providers OL As Us o M Current User Communities EGI.eu Technology Providers 11/10/11 s& U Mo A SL s New User Communities HealthGrid 2011, Bristol, UK
14 EGI Users? Organized in Virtual Research Communities (VRC) Formal agreement with EGI Memorandum of Understanding (MoU) Structured communication channels User Community Board (UCB) Actual user support needs to be organized by the user communities themselves!! S. Olabarriaga, BioAssist Meeting 12 Aug 2011
15 EGI: User Support Coordination Activity Management Flow of information, knowledge and Support teams NGI User Support Teams Experts Site administrators Processes Technical services Application Database VO services Training Marketplace Requirements Tracker HealthGrid 2011, Bristol, UK User Community Board VRC accreditation Requirements Training Advisory Group
16 VRCs and UCB explained.. VO: a group of researchers working collaboratively VRC: a grouping of research collaborations working in a common domain Benefits: EGI Helpdesk UCB User Community E G I. e u Training Events Trainers Technical Services VRC support units Other Other support Helpdes units k N G I 1.Defined communication channels: named contact points between communities & EGI 2.Application integration 3.Policy and procedures: define interaction between EGI and users 4.Requirements gathering: solutions and influence 5.Dissemination: sharing of news, breakthroughs, best practice and innovation User Community Board with representation from: Life Sciences, WLCG, WeNMR, Astronomy & Astrophysics, Earth Sciences, Computational Chemistry, Arts & Humanities, Hydrometeorology HealthGrid 2011, Bristol, UK
17 Technical Support Services Services provided by a few NGIs for the whole community To support the Virtual Research Communities To facilitate the work of NGI support teams To improve communication among NGIs, among users and with users Bring in expertise and services from Heavy User Communities (HUCs) Tools and services (current list will be expanded): 1.EGI Application Database 2.Services for VOs 3.Training Marketplace 4.Requirement Tracker
18 EGI Application Database Register applications/tools Reuse of applications/tools Map of application landscape AppDB gadget has been instantiated by: WeNMR, LSGC, GridPP, Serbian, UK and Hungarian NGIs HealthGrid 2011, Bristol, UK
Training marketplace Integration of: Training event calendar Digital library of training materials Service offering & requesting form 19
20 Life Science Grid Community http://wiki.healthgrid.org/lsvrc:index S. Olabarriaga, BioAssist Meeting 12 Aug 2011
21 Life-Science Grid Community History 2009-2010: brainstorms June 2010: open workshop at the HealthGrid conference June 2011: signature of MoU with EGI Participating user groups VOs: biomed (catch-all), vlemed, lsgrid German life-science user community Supporting NGIs Dutch, French, Italian, Spanish and Swiss Hosting body HealthGrid, a non-profit association
Purposes and goals (1) Represent the LS grid users, in particular to Negotiate resources Promote their requirements Liaise with the European Grid Initiative Coordinate actions Serve as a contact point for new users Share expertise in the community Avoid replication of efforts Define common requirements Encourage sharing of resources, data and tools 22
Purposes and goals (2) Provide technical services Training and induction Operate and support common VOs Operate shared services Provide targeted user support and application porting Organize community-specific training events Smooth the learning curve, lower the start-up cost Dissemination Transfer knowledge among VRC partners Advertise actions Liaise with other groups of interest 23
Memorandum of Understanding between EGI.eu and LSGC People Annex 5: Detailed Contact List Role Signing Authority EGI.eu Director of EGI.eu (Steven Newhouse Coordinator Policy Development Manager (Sergio Andreozzi) User support and training Chief Community Officer (Steve Brewer) Operational issues (GRIDrelated, operation, security) Technical Coordination Chief Operations Officer (Tiziana Ferrari) Technical Manager (Michel Drescher) EGI.eu Dissemination Manager (Catherine Gater): Dissemination VR C President of the HealthGrid association (Yannick Legré); and, Coordinator of LSGC (Tristan Glatard) Providing strategic and managerial input on the LSGC s activity (Tristan Glatard) LSGC User Support Coordinator/portal/gateway coordinator (Silvia Olabarriaga) LSGC Service Manager (Ignacio Blanquer) LSGC Service Manager (Franck Michel) LSGC Dissemination Manager (Dagmar Krefting) These contact points may be the same person. These representatives (or additional people) may be invited to participate in other EGI.eu bodies depending on the interests of the LSGC will make sure to keep EGI.eu Policy Development Team (policy@egi.eu) updated with any changes to the contact list. S. Olabarriaga, BioAssist Meeting 12 Aug 2011 24
The EGI.eu Policy Development Team (PDT) will coordinate the periodic review of the progress of the activities defined in Article 3 (Joint Work Plan), follow-up the milestones defined below and distribute reports to both Parties. Special meetings between the points of contact designated under Article 5 (Communication) shall be held, as often as necessary, to examine the progress in the implementing of this Agreement. Dates related to time elapsed from the signing of the MoU. Roadmap Date Activity Achievement Month 1 A.6 Both Parties to announce the collaboration agreement on their web sites. Month 1 A.1 Outline LSGC s areas of expertise Month 2 A.2 List of applications and services needed by LSGC from the EGI community. Initially by 3 months, then as services are added. A.2 List of applications and services that LSGC can offer to the EGI community. Annually All Summary of the main achievements, open issues and future plans related to the collaboration between LSGC and EGI.eu. The input must cover all of the activities that are defined in the Joint Work Plan section of the signed MoU. Every 3 months A.3 Participation in UCB with a minimum of two physical meetings per year As determined by LSGC A.4 Updated and prioritised requirements from the community Every 3 months A.4 Feedback from EGI on progress on requirements A R T IC L E 5 : C O M M U N IC A T IO N The Parties shall keep each other informed on all their respective activities and on their progress and shall consult regularly on areas that offer the potential for cooperation through the agreed channels. S. Olabarriaga, BioAssist Meeting 12 Aug 2011 25
26 Current actions User representation Collected and submitted technical requirements to the EGI Collecting tools and services (offered and required) Training Life-Science training event at EGI User Forum in 2011 Collect training material Review training requirements and offers Dissemination New members this
27 Current actions: coordination Improved VO management portal Catalog of existing software used by Vos VO operations survey
28 Current actions: technical Organize technical teams in the biomed VO Setup monitoring services Study and document VO issues Software development collaborations Application porting support centers
29 More information Contact Wiki page: http://wiki.healthgrid.org/lsvrc:index Mailing list: lsvrc@healthgrid.org
30 What s in it for you? S. Olabarriaga, BioAssist Meeting 12 Aug 2011
31 Announcements Conferences Training Workshops Requirements Knowledge Applications Methods Data New collaborations Visibility??? S. Olabarriaga, BioAssist Meeting 12 Aug 2011
32 Coming up EGI Technical Forum, Lyon, 19-23 September 2011 http://tf2011.egi.eu/ Data Management Workshop Portals for EGI Communities Workshop EGI Roadshows EGI Virtual Research Communities Amsterdam, May 2012 HealthGrid Conference Intl. Workshop on Scientific Gateways for Life Sciences S. Olabarriaga, BioAssist Meeting 12 Aug 2011
Thanks! www.bioinformaticslaboratory.nl S.D.Olabarriaga@amc.uva.nl Steve Brewer, EGI Tristan Glatard, LSGC The e-bioscience research group is funded and supported by various projects and organizations: BiGGrid project (Dutch Organisation for Scientific Research, NWO), SHIWA and SCI-BUS projects (FP7 e-infrastructures), AMC ICT research innovation programme, COMMIT project "e-biobanking with imaging for healthcare". 33