GridSphere and the GridLab Project

Transcription

1 GridSphere ad the GridLab Project Jaso Novoty Michael Russell Oliver Wehres Albert Eistei Istitute Portals Team

2 The State of Grid Computig Access to Grid services ad resources still difficult for ed users Curret API s ad tools are still very primitive Grid middleware ad tools are costatly evolvig makig it difficult to provide reliable, robust ifrastructure Ultimately ed users wat to be hidde from techical or implemetatio specific details of Grids Growig ifrastructure complexity meas dimiished usability May projects focusig o a arrow rage of services for a very specific set of users There is a real eed for higher level tools ad grid computig eviromets

3 GridLab Project Fuded by the EU (5+ M ), Jauary 2002 December 2004 Applicatio ad Testbed orieted Cactus Code, Triaa Workflow, all the other applicatios that wat to be Grideabled Mai goal: to develop a Grid Applicatio Toolkit (GAT) ad set of grid services ad tools...: resource maagemet (GRMS), data maagemet, moitorig, adaptive compoets, mobile user support, security services, A portal... ad test them o a real testbed with real applicatios

4 GridLab Services Resource Maagemet Services Resource Brokerig Job Submissio Usage Policy Maagemet Data Maagemet Services Data Replicatio Date Movemet Visualizatio Services Moitorig ad Adaptive Services Applicatio Performace Moitorig Resource Utilizatio The ability to alter applicatios at rutime Iformatio Services GIIS/GRIS Based Testbed Maagemet Services Form the basis of the GridLab Admiistrative Portlets Notificatio Services ad may more!

5 GridLab VO PSNC (Poza) - coordiatio AEI (Potsdam) ZIB (Berli) Uiv. of Lecce Cardiff Uiversity Vrije Uiv. (Amsterdam) SZTAKI (Budapest) Masaryk Uiv. (Bro) NTUA (Athes) Su Microsystems Compaq (HP) ANL (Chicago, I. Foster) ISI (LA, C.Kesselma) UoWiscosi (M. Livy) collaboratig with: Users! EU Astrophysics Network, DFN TiKSL/GriKSL NSF ASC Project other Grid projects Globus, Codor, GrADS, PROGRESS, GriPhy/iVDGL, CrossGrid ad all the other Europea Grid Projects (GRIDSTART) other...

6 GridLab Goals Get Computatioal Scietists usig the Grid ad Grid services for real, everyday, productio work (AEI Relativists, EU Network, Grav Wave Data Aalysis, Cactus User Commuity), all the other potetial grid apps Make it easier for applicatios to make flexible, efficiet, robust, use of the resources available to their virtual orgaizatios Dream up, prototype, ad test ew applicatio scearios which make adaptive, dyamic, wild, ad futuristic uses of resources Michael Russell 6

7 What Do Our Users Need? Applicatio orieted eviromet Flexible, easy-to-use, simple iterfaces Efficiet ad effective use of resources Robustess, fail-safety, adapability The ability to work i distributed teams Support for mobile workig eviromets 2004 Michael Russell <michael.russell@aei.mpg.de> 7

8 What Do Our Users Wat? Larger computatioal resources Memory/CPU Faster throughput Cleverer schedulig, cofigurable schedulig, co-schedulig, exploitatio of uused cycles Easier use of resources Portals, grid applicatio frameworks, iformatio services, mobile devices Remote iteractio with simulatios ad data Notificatio, steerig, visualizatio, data maagemet Collaborative tools Notificatio, visualizatio, video coferecig, portals Dyamic applicatios, New scearios Grid applicatio frameworks coectig to services 2004 Michael Russell 8

9 May Applicatio Scearios! Dyamic Stagig move to faster/cheaper/bigger machie Multiple Uiverse create cloe to ivestigate steered parameter Automatic Covergece Testig from iitial data or iitiated durig simulatio Look Ahead spaw off ad ru coarser resolutio to predict likely future Spaw Idepedet/Asychroous Tasks sed to cheaper machie, mai simulatio carries o Applicatio Profilig best machie/queue choose resolutio parameters based o queue Dyamic Load Balacig ihomogeeous loads multiple grids Portal User/virtual orgaisatio iterface to the grid. Itelliget Parameter Surveys farm out to differet machies Make use of Ruig with maagemet tools such as Codor, Etropia, etc. Scriptig thors (maagemet, lauchig ew jobs, etc) Dyamic use of eg MDS for fidig available resources 2004 Michael Russell <michael.russell@aei.mpg.de> 9

10 Portal Bridges Users ad Services

11 Virtual Orgaizatios A Virtual Orgaizatio (VO) cosists of resources, services, ad people collaboratig across istitutioal, geographical, ad political boudaries. Grid Portals provide a gateway for likig all of these elemets together Grid Portals hide the complexity of the uderlyig Grid ifrastructure that make VOs possible. Furthermore, Grid Portals ca provide value-added services with Web iterfaces tailored to the specific applicatios that are most importat to particular VO.

12 Grid Portals i the past... A Portal is oly as good as the uderlyig deployed ifrastructure Portlet developmet ofte ivolves debuggig uderlyig middleware Ofte difficult ad hard to maitai glue code must be writte coectig the portal to Grid services, due to lack of/evolvig stadards. Most portals are stovepipe solutios that provide a complete solutio with very little customizatio capabilities. Separatio of presetatio ad logi Geerally hard codig of uderlyig Grid ifrastructure details ad the codebase Lack of real usability has made it difficult to test ad evaluate user iterfaces. Web applicatio developmet still remais a tedious task with little i the way of reusable compoets, forcig developers to costatly reivet the wheel.

13 Portal stadards JSR 168 Portlet API ratified August 2003 Similar to Servlet API i providig reusable web applicatios Ratified by vedors icludig BEA, Su, IBM, Oracle, Plumtree ad others... WSRP (Web Services for Remote Portlets) ratified by OASIS committee Specifies how web services ca be cosumed by stadards compliat portals Java Server Faces ratified Specifies a evet based user iterface for web presetatio developmet

14 GridSphere Portal Framework GridLab Portal is developed usig the GridSphere Portal Framework GridSphere provides a geeric JSR 168 compliat portlet cotaier The GridSphere portal framework provides a architecture for deployig pluggable web applicatios usig the Portlet model. Provides a developmet eviromet for easily creatig ew portlet applicatios Offers a core set of portlets for the maagemet of portlets, users, groups ad layouts. A successful ope source developmet model: Active ad resposive mail list CVS access Bugtracker

15 GridLab Portlets The GridLab portal is a istace of GridSphere customized for the users ad requiremets of the GridLab project GridLab portlets ca easily plug ito GridSphere portlet cotaier-- ad hopefully ay other portlet cotaier. GridLab portlets provide access to GridLab services ad ca be modified/reused by other Grid projects. Core aspects of grid portlets iclude security, job executio, file maagemet/data trasfer ad providig resource iformatio

16 GridLab Portlets (cot.) Curretly developed portlets to support GridLab: Geeral job submissio portlet Supports GRMS Job Broker service developed by Work Package 9 Supports Globus job submissio Soo to come is GSI-SSH ad Codor submissio Geeral credetial maagemet portlet Uses Myproxy for the secure storage ad maagemet of users credetials. Allows users to selectively retrieve ad use credetials for performig Grid operatios. Moitorig portlet demostrates moitorig service developed by Work package 11

17 Exteral Collaboratios Workig to support GridSphere for the geeral Grid portal commuity: Albert-Eistei-istitute i Berli & LSU to develop portlets for studyig umerical relativity. Geo earth scieces, microscopy portal ad others at SDSC Caadia Natioal research Coucil (NRC) to develop grid data trasfer portlets usig GridFTP SZTAKI research ceter i Budapest to use GridSphere to support users of SuperGrid ad ClusterGrid projects Virtual Observatory project i Australia PSNC i Polad to support ClusterIX project May more: Iterested i promotig GridSphere, grid computig ad portlets to more commuities! Please us if iterested!