The Globus Toolkit : Introdution Dr Simon See Sun APSTC 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 2 Globus Toolkit TM An open source software toolkit addressing key technical problems in the development of Grid e nable d tools, s e rvices, a nd a pplications. Offer a modular bag of technologies Enable incremental development of gridenabled tools and applications Implement standard Grid protocols and APIs Make available under liberal open source Layered Architecture DRM Cactus GASS GridFTP Condor LSF Fork PBS Applications High-level Services and Tools MPICHG2 Core Services Metacomputing Globus Directory Security Replica Catalog Service Interface SGE globusrun PUNCH Local Services Nimrod/G Linux TCP AIX Grid Status Condor-G GRAM I/O UDP Solaris 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 3 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 4
09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 5 Certificates Security Infras tructure Grid Security Infras tructure (GSI) Proxies and Delegation PKI (CAs and Certificates) SSL/ TLS SSL for Authentication And message protection PKI for credentials Proxies and delegation (GSI Extensions) for secure single Sign-on 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 6 Secure Remote Startup 1 Host Cert User Cert Client Gatekeeper 2 3 4 Key Key 1. Exchange certificates, authenticate, 2. Check gridmap file 3. Look up services Map Service Job manager 4. Run service program or applications 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 7 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 8
09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 9 Grid Information Service Provide access to static and dynamic information regarding system components A basis for configuration and adaptation in heterogeneous, dynamic environments Requirements and characteristics Uniform, flexible access to information Scalable, efficient access to dynamic data Access to multiple information sources Decentralized maintenance Logical MDS Deployment GIIS Grid Index Information NTU-CG Service (GIIS) APSTC Provides aggregate directory PDP Hierarchical groups of resources NCSV Supports efficient queries a gainst informa tion which is GRIS spread across multiple GRIS server Grid Resource Information Service (GRIS) Provides resource description Modular content gateway 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 10 GRIS Information dev group= s dev=cpu0 dev=cpu1 dev=ram RAM RAM hn=hostname RAM dev group=memory dev= DISK NET dev group= disk DISK dev=/scratch1 DISK OS software=os OS dev group= net NET dev=eth0 NET 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 11 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 12
09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 13 Resource Management Service Resource Specification Language (RSL) parser Grid Resource Allocation and Management (GRAM) client API: simple client myjob API: parallel job bootstrapping jobmanager API: server infrastructure gatekeeper: root security & dispatch svc Resource Management Service A layered architecture allows applicationspecific resource brokers and co-allocators (e.g. DUROC) control API: client runtime API: job startup barriers, etc Bootstrap API: parallel job bootstrapping 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 14 GRAM Components Client MDS: Grid Index Info Server MDS client API calls Site boundary to get resource info GRAM client API calls to request resource allocation and process creation. MDS: Grid Resource Info Server Query current status GRAM client API state of resource change callbacks Grid Security Local Resource Manager Infrastructure Allocate & Request create processes Create Job Manager Gatekeeper Parse Monitor & control RSL Library 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 15 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 16
09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 17 Person Data Management Services Data transfer and access GASS: Simple, multi-protocol file transfer tools; integrated with GRAM GridFTP: Provides high-performance, reliable data transfer for modern WANs Data replication and management Replica Catalog: Provides a catalog service for keeping track of replicated datasets Replica Management: Provides services for creating and managing replicated datasets Data Grid Data request may Access local data Compute locally Compute remotely Access remote data Scheduling subject to local & global policies Local autonomy Major Archive Facilities Network caches & regional centers Local sites? 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 18 Conclus ion Create es at A and B that Communicate & Access Files at C Sign on User Proxy Site A (Kerberos) Computer Local id Kerberos ticket GSI-enabled GRAM server Restricted proxy Remote file access Proxy credential Create remote process Communications Site C (Kerberos) GSI-enabled FTP server Storage system GSI-enabled Site B GRAM server (Unix) Computer Local id Restricted proxy 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 19 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 20
09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 21 Conclus ion Globus Toolkit : APIs, SDKs, and tools which implement Grid protocols & services P rovides bas ic s oftwa re infra s tructure for s uite of tools addressing the programming problems. Provide the solution of resource sharing & corordination by introducing the dynamic, multiinstitutonal virtual organization, and virtual data. Implement the protocols & services to facilitate inte ropera bility a nd s hare d infra s tructure Useful Links APSTC, Sun Microsystems http://apstc.sun.com.sg Global Grid Forum (GGF) http://www.gridforum.org/ The Globus Project http://www.globus.org 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 22 Thank Yo u Jie Song songjie@apstc.sun.com.sg