Clusters & Grid Computing

Size: px
Start display at page:

Download "Clusters & Grid Computing"

Transcription

1 Clusters & Grid Computing A brief introduction to computational grids June 15 th 2004 Lorenzo Muttoni Anno Accademico

2 Clusters Nowadays PC computing power has considerably increased and it is interesting their use for supercomputing Also the bandwidth available in modern communication systems offers interesting opportunities to interconnect computation nodes Cluster: a set of PC (or Workstations), interconnected by a network, collaborating with each other Lorenzo Muttoni Impianti Informatici - A.A

3 Cluster Computer Architecture Sequential Applications Sequential Applications Sequential Applications Parallel Applications Parallel Applications Parallel Applications Parallel Programming Environment Cluster Middleware (Single System Image and Availability Infrastructure) PC/Workstation PC/Workstation PC/Workstation PC/Workstation Communications Communications Communications Communications Software Software Software Software Network Interface Hardware Network Interface Hardware Network Interface Hardware Network Interface Hardware Cluster Interconnection Network/Switch Lorenzo Muttoni Impianti Informatici - A.A

4 Prominent Components of Cluster Computers Parallel Programming Environments and Tools Threads (PCs, SMPs, NOW..) POSIX Threads Java Threads MPI Linux, NT, almost all UNIX PVM Software DSMs (Distributed Shared Memory) Compilers C/C++/Java Fortran 77/90 - HPF RAD (Rapid Application Development tools) GUI based tools for Parallel Program modeling Debuggers Performance Analysis Tools Visualization Tools Lorenzo Muttoni Impianti Informatici - A.A

5 Key operational characteristics of clustering Pros: High Performance (per node) Expandability and Scalability High Throughput High Availability low cost, easily scalable, easy setup Cons: performance are (generally) lower than those of a supercomputer network is (generally) the bottleneck Lorenzo Muttoni Impianti Informatici - A.A

6 Clusters Classification Application Target High Performance (HP) Clusters Grand Challenging Applications High Availability (HA) Clusters Mission Critical Applications Node Ownership Dedicated Clusters Non-dedicated clusters Adaptive parallel computing Communal multiprocessing Lorenzo Muttoni Impianti Informatici - A.A

7 Clusters Classification (2) Node Hardware Clusters of PCs (CoPs) Piles of PCs (PoPs) Clusters of Workstations (COWs) Clusters of SMPs (CLUMPs) Node Operating System Linux Clusters (e.g., Beowulf) Solaris Clusters (e.g., Berkeley NOW) NT Clusters (e.g., HPVM) AIX Clusters (e.g., IBM SP2) SCO/Compaq Clusters (Unixware) Digital VMS Clusters HP-UX clusters Microsoft Wolfpack clusters Lorenzo Muttoni Impianti Informatici - A.A

8 Clusters Classification (3) Node Configuration Homogeneous Clusters All nodes will have similar architectures and run the same OSs Heterogeneous Clusters All nodes will have different architectures and run different OSs Lorenzo Muttoni Impianti Informatici - A.A

9 Clusters Classification (4) Levels of Clustering Group Clusters (#nodes: 2-99) Nodes are connected by SAN like Myrinet Departmental Clusters (#nodes: 10s to 100s) Organizational Clusters (#nodes: many 100s) National Metacomputers (WAN/Internet-based) International Metacomputers (Internet-based, #nodes: 1000s to many millions) Metacomputing / Grid Computing Web-based Computing Agent Based Computing Lorenzo Muttoni Impianti Informatici - A.A

10 Cluster of Clusters: Hyperclusters Cluster 1 Scheduler Master Daemon The communication system is the typical bottleneck of a cluster Submit Graphical Control Clients Execution Daemon Cluster 3 Cluster 2 Scheduler Master Daemon LAN/WAN Scheduler Master Daemon Submit Graphical Control Execution Daemon Submit Graphical Control Clients Execution Daemon Clients Lorenzo Muttoni Impianti Informatici - A.A

11 Network Exponentials Network vs. computer performance Computer speed doubles every 18 months Network speed doubles every 9 months Difference = order of magnitude per 5 years 1986 to 2000 Computers: x 500 Networks: x 340, to 2010 Computers: x 60 Networks: x 4000 Moore s Law vs. storage improvements vs. optical improvements. Graph from Scientific American (Jan- 2001) by Cleo Vilett, source Vined Khoslan, Kleiner, Caufield and Perkins. Lorenzo Muttoni Impianti Informatici - A.A

12 New Opportunities (fast network) demand New Technology (Grid) When the network is as fast as the computer's internal links, the machine disintegrates across the net into a set of special purpose appliances (George Gilder) Lorenzo Muttoni Impianti Informatici - A.A

13 Grid Computing Grid Computing is a paradigm/infrastructure enabling the sharing, selection & aggregation of geographically distributed resources Computers PCs, workstations, clusters, supercomputers, laptops, notebooks, mobile devices, PDA, etc; Software e.g., ASPs renting expensive special purpose applications on demand; Wide area Catalogued data and databases e.g. transparent access to human genome database; Special devices/instruments e.g., radio telescope SETI@Home searching for life in galaxy. People/collaborators. [depending on their availability, capability, cost, and user QoS requirements] for solving large-scale problems/applications. Lorenzo Muttoni Impianti Informatici - A.A

14 Facilities required to build and use grids Middleware that make the systems Grid enabled Security mechanisms that allow resources to be accessed only by authorized users. (New) programming tools that make our applications Grid enabled. Tools that can translate the requirements of an application into requirements for computers, networks, and storage. Tools that perform resource discovery, trading, composition, scheduling and distribution of jobs and collects results. Lorenzo Muttoni Impianti Informatici - A.A

15 A Typical Grid Computing Environment Supercomputer Information Service Resource Broker Database PC R 2 Scientific instrument R 3 R 4 R 5 R 7 Resource Broker Cluster R 6 R N R 1 Resource Broker Info query Info update Resource mgmt Information Service Application Lorenzo Muttoni Impianti Informatici - A.A

16 The Grid World: Current Status Dozens of major Grid projects in scientific & technical computing/research & education Deployment, application, technology Considerable consensus on key concepts and technologies No official standards exists but Open source Globus Toolkit is a de facto standard for major protocols & services Far from complete or perfect, but out there, evolving rapidly, and large tool/user base Global Grid Forum a significant force Industrial interest emerging rapidly Lorenzo Muttoni Impianti Informatici - A.A

17 Layered Grid Architecture (Analogy to Internet Architecture) Coordinating multiple resources : ubiquitous infrastructure services, app-specific distributed services Sharing single resources : negotiating access, controlling use Talking to things : communication (Internet protocols) & security Controlling things locally : Access to, & control of, resources Application Collective Resource Connectivity Fabric Application Transport Internet Link Internet Protocol Architecture Lorenzo Muttoni Impianti Informatici - A.A

18 The Systems Problem My users need to be able to use my computing resources in tandem with resources at other sites. Need of resource sharing mechanisms that Address security and policy concerns of both resource owners and users Are flexible enough to deal with many resource types and sharing modalities Scale to large number of resources, many participants, many program components Operate efficiently when dealing with large amounts of data & computation The Globus Toolkit provides Grid Services within a standard Grid architecture to meet this need. Lorenzo Muttoni Impianti Informatici - A.A

19 The Programming Problem Applications require resources (compute power, storage, data, instruments, displays) at many sites. Need (presumably) of: Abstractions and models to add to speed/robustness/etc. of development Tools to ease application development and diagnose common problems Code/tool sharing to allow reuse of code components developed by others The Globus Toolkit provides a Grid SDK (Software Development Kit) designed to meet this need. GRADS project Lorenzo Muttoni Impianti Informatici - A.A

20 The Globus Toolkit A software toolkit addressing key technical problems in the development of Grid enabled tools, services, and applications Offer a modular bag of technologies Enable incremental development of grid-enabled tools and applications Implement standard Grid protocols and APIs Make available under liberal open source license Lorenzo Muttoni Impianti Informatici - A.A

21 A Practical Perspective The Globus Toolkit is not everything you ll need to build a Grid (most likely) everything you ll need to develop a Grid application (most likely) a complete, out of the box solution finished The Globus Toolkit is commercially supported by Platform, IBM, and Compaq (so far) available in source and binary forms being developed with real users in mind a starting point for many successful Grid projects Lorenzo Muttoni Impianti Informatici - A.A

22 Globus Toolkit structure: service oriented view MDS GRAM GRIS GIIS GridFTP GSI Data Management Information Services Resource Management Security Services Lorenzo Muttoni Impianti Informatici - A.A

23 Security Services Data Management Information Services Resource Management Security Lorenzo Muttoni Impianti Informatici - A.A

24 Why Grid Security is Hard Resources being used may be valuable & the problems being solved sensitive Resources are often located in distinct administrative domains Each resource has own policies & procedures Set of resources used by a single computation may be large, dynamic, and unpredictable Not just client/server, requires delegation It must be broadly available & applicable Standard, well-tested, well-understood protocols; integrated with wide variety of tools Lorenzo Muttoni Impianti Informatici - A.A

25 Grid Security Requirements User View 1) Easy to use 2) Single sign-on 3) Run applications ftp,ssh,mpi,condor,web, 4) User based trust model 5) Proxies/agents (delegation) Resource Owner View 1) Specify local access control 2) Auditing, accounting, etc. 3) Integration w/ local system Kerberos, AFS, license mgr. 4) Protection from compromised resources Developer View API/SDK with authentication, flexible message protection, flexible communication, delegation,... Direct calls to various security functions (e.g. GSS-API) or security integrated into higher-level SDKs: e.g. GlobusIO, Condor-G, MPICH-G2, HDF5, etc. Lorenzo Muttoni Impianti Informatici - A.A

26 Grid Security Infrastructure (GSI) Overview GSI provides elements for secure authentication and communication in a grid Infrastructure based on public key cryptography mechanisms X.509 certificates and SSL To provide single sign-on and delegation support some extensions have been added Lorenzo Muttoni Impianti Informatici - A.A

27 GSI Overview (Cont.d) Once the authentication succeeded (X.509 certificates), communication occurs with no cryptography (for performance reasons) Nevertheless, secure communication can be enabled GSI feature supports a mechanism to guarantee communication integrity: overhead smaller than that introduced by cryptography communication is "in the clear" but it is sure that the message has not been altered Lorenzo Muttoni Impianti Informatici - A.A

28 Review of Public Key Cryptography Asymmetric keys A private key is used to encrypt data A public key can decrypt data encrypted with the private key An X.509 certificate includes Someone s subject name (user ID) Their public key A signature from a Certificate Authority (CA) that: Proves that the certificate came from the CA. Vouches for the subject name Vouches for the binding of the public key to the subject Lorenzo Muttoni Impianti Informatici - A.A

29 Mutual Authentication User A 1. Connection established 2. A sends B its certificate User B Certificate A (C A ) 3. B sends A a random plaintext Certificate B (C B ) 4. A encrypt the plaintext using C A and sends it to B 5. 1) check validity of CA based on digital signature of CA 2) extract the public key of A 6. B decrypt the encrypted message If this matches with the original message, B can trust A now Lorenzo Muttoni Impianti Informatici - A.A

30 Delegation and Single Sign-On Typically, a grid computation involves a number of resources, and each resource has to carry out mutual authentication In this case, a proxy may avoid requiring the password every time a resource is accessed Delegation is the remote creation of a user proxy Results in a new new pair of keys and X.509 proxy certificate, signed by the user private key instead of the CA private key Allows remote process to act on behalf of the user Avoids sending passwords or private keys across the network Lorenzo Muttoni Impianti Informatici - A.A

31 Delegation and Single Sign-On (Cont.d) A proxy certificate has a limited temporal validity it contains the expiration time The use of proxies slightly modifies the mutual authentication process The target node (remote) receives the proxy certificate (signed by the user) and the user certificate signed by the CA. the user's public key is used to verify the validity of the proxy the CA public key is used to validate the user's certificate. Lorenzo Muttoni Impianti Informatici - A.A

32 User Proxies The use of User Proxies minimize exposure of user s private key A temporary, X.509 proxy credential for use by our computations We call this a user proxy certificate Allows process to act on behalf of user User-signed user proxy cert stored in local file Created via grid-proxy-init command Proxy s private key is not encrypted Rely on file system security, proxy certificate file must be readable only by the owner Lorenzo Muttoni Impianti Informatici - A.A

33 Other GSI Features Rights of delegated proxy can be restricted to a subset of those associated with the issuer Delegation Tracing Often want to know through what entities a proxy certificate has been delegated Solved by adding information to the signed proxy certificate about each entity to which a proxy is delegated Lorenzo Muttoni Impianti Informatici - A.A

34 Resource Management Services Data Management Information Services Resource Management Security Layer Lorenzo Muttoni Impianti Informatici - A.A

35 Resource Management Overview The Grid Resource Allocation Management (GRAM) protocol and client API provide services for remote process activation and execution status monitoring Resource Specification Language (RSL) is used to communicate requirements A layered architecture allows applicationspecific resource brokers and co-allocators to be defined in terms of GRAM services Integrated with Condor, PBS, MPICH-G2, Lorenzo Muttoni Impianti Informatici - A.A

36 Resource Management Overview (Cont.d) When a job is submitted, the request is sent to the remote host and handled by the gatekeeper daemon located in the remote host. The gatekeeper creates a job manager that starts and monitors the job. When the job is finished, the job manager sends the status information back to the client and terminates. Lorenzo Muttoni Impianti Informatici - A.A

37 GRAM Architecture GRAM Client globusrun GRAM Server gatekeeper RSL RSL HTTP HTTP GSI GSI globusrun callback fork RSL RSL Parser Job Manager use (optional) HTTP GSI Output File Transfer job status/cancel bsub fork Local Resource Manager Process qsub GASS Input File Transfer GASS PBS Job LSF Job Lorenzo Muttoni Impianti Informatici - A.A

38 Resource Specification Language (RSL) Descriptive language for exchange of information between components Syntax similar to MDS/LDAP filters RSL provides two types of information: Resource requirements: Machine type, number of nodes, memory, etc. Job configuration: executable path, program parameters, arguments, information to select resources, e.g. the amount of memory needed to execute a job on a remote machine Globus Toolkit provides an API/SDK for manipulating RSL Lorenzo Muttoni Impianti Informatici - A.A

39 GRAM Protocol GRAM-1: Simple HTTP-based RPC Job request Returns a job contact : Opaque string that can be passed between clients, for access to job Job cancel, status, signal Event notification (callbacks) for state changes Pending, active, done, failed, suspended GRAM-1.5 (U Wisconsin contribution) Add reliability improvements Once-and-only-once submission Recoverable job manager service Reliable termination detection GRAM-2: Based on Web Services (SOAP) Lorenzo Muttoni Impianti Informatici - A.A

40 Information Services Data Management Information Services Resource Management Security Layer Lorenzo Muttoni Impianti Informatici - A.A

41 Information Services overview System information is critical to operation of the grid and construction of applications What resources are available? Resource discovery What is the state of the grid? Resource selection How to optimize resource use Application configuration and adaptation We need a general information infrastructure to answer these questions Requirements and characteristics Uniform, flexible access to information Scalable, efficient access to dynamic data Access to multiple information sources Decentralized maintenance Lorenzo Muttoni Impianti Informatici - A.A

42 Examples of Useful Information Characteristics of a compute resource IP address, software available, system administrator, networks connected to, OS version, load Characteristics of a network Bandwidth and latency, protocols, logical topology Characteristics of the Globus infrastructure Hosts, resource managers Lorenzo Muttoni Impianti Informatici - A.A

43 Grid Information: Facts & Issues Information is always old Time of flight, changing system state Need to provide quality metrics Distributed state hard to obtain Complexity of global snapshot Component will fail Scalability and overhead Many different usage scenarios Heterogeneous policy, different information organizations, etc. Lorenzo Muttoni Impianti Informatici - A.A

44 The GIS Problem: Many Information Sources, Many Views VO A VO C VO B Lorenzo Muttoni Impianti Informatici - A.A

45 Grid Information Service (GIS) Provide access to static and dynamic information regarding system components A basis for configuration and adaptation in heterogeneous, dynamic environments Requirements and characteristics Uniform, flexible access to information Scalable, efficient access to dynamic data Access to multiple information sources Decentralized maintenance Lorenzo Muttoni Impianti Informatici - A.A

46 What is a Virtual Organization? A group of users collaborating across multiple domains who share (some of) their resources to solve particular classes of problems Collates and presents information about these resources in a uniform view Lorenzo Muttoni Impianti Informatici - A.A

47 Globus implementation of the GIS: Metacomputing Directory Service Uses LDAP as Inquiry (LDAP 3.0 Protocol Engine) Based on OpenLDAP with custom backend Integrated caching Access information in a distributed directory Directory represented by collection of LDAP servers Each server optimized for particular function Information dynamically available to tools and applications Lorenzo Muttoni Impianti Informatici - A.A

48 Information providers MDS Components Deliver resource information to backend APIs for accessing & updating MDS contents C, Java, PERL (LDAP API, JNDI) Directory can be updated by: Information providers Applications (i.e., users): various tools for manipulating MDS contents (command line tools, shell scripts & GUIs) Lorenzo Muttoni Impianti Informatici - A.A

49 Two Classes Of MDS Servers Grid Resource Information Service (GRIS) Supplies information about a specific resource Configurable to support multiple information providers LDAP as inquiry protocol Grid Index Information Service (GIIS) Supplies collection of information which was gathered from multiple GRIS servers Supports efficient queries against information which is spread across multiple GRIS server LDAP as inquiry protocol Lorenzo Muttoni Impianti Informatici - A.A

50 Grid Resource Information Service Server which runs on each resource Given the resource DNS name, you can find the GRIS server (well known port = 2135) Provides resource specific information Much of this information may be dynamic Load, process information, storage information, etc. GRIS gathers this information on demand White pages lookup of resource information Ex: How much memory does machine have? Yellow pages lookup of resource options Ex: Which queues on machine allows large jobs? Lorenzo Muttoni Impianti Informatici - A.A

51 Grid Index Information Service GIIS describes a class of servers describes a class of servers Gathers information from multiple GRIS servers Each GIIS is optimized for particular queries Ex1: Which Alliance machines are >16 process SGIs? Ex2: Which Alliance storage servers have >100Mbps bandwidth to host X? Akin to web search engines Organization GIIS The Globus Toolkit ships with one GIIS Caches GRIS info with long update frequency Useful for queries across an organization that rely on relatively static information (Ex1 above) Can be merged into GRIS Lorenzo Muttoni Impianti Informatici - A.A

52 Logical MDS Deployment Programming high level frameworks Grads Gusto GIIS GRISes Lorenzo Muttoni Impianti Informatici - A.A

53 Data Management Services Data Management Information Services Resource Management Security Layer Lorenzo Muttoni Impianti Informatici - A.A

54 Data Grid Problem Enable a geographically distributed community [of thousands] to pool their resources in order to perform sophisticated, computationally intensive analyses on Petabytes of data Note that this problem: Is common to many areas of science Overlaps strongly with other Grid problems Lorenzo Muttoni Impianti Informatici - A.A

55 Globus Toolkit Components Two major Data Grid components: 1. Data Transport and Access Common protocol Secure, efficient, flexible, extensible data movement Family of tools supporting this protocol 2. Replica Management Architecture Simple scheme for managing: multiple copies of files collections of files Lorenzo Muttoni Impianti Informatici - A.A

56 Why FTP? GridFTP Ubiquity enables interoperation with many commodity tools Already supports many desired features, easily extended to support others Well understood and supported We use the term GridFTP to refer to Transfer protocol which meets requirements Family of tools which implement the protocol Note GridFTP > FTP Note that despite name, GridFTP is not restricted to file transfer! Lorenzo Muttoni Impianti Informatici - A.A

57 GridFTP: Basic Approach FTP protocol is defined by several IETF RFCs Start with most commonly used subset Standard FTP: get/put etc., 3 rd -party transfer Implement standard but often unused features GSS binding, extended directory listing, simple restart Extend in various ways, while preserving interoperability with existing servers Striped/parallel data channels, partial file, automatic & manual TCP buffer setting, progress monitoring, extended restart Lorenzo Muttoni Impianti Informatici - A.A

58 Replica Management Maintain a mapping between logical names for files and collections and one or more physical locations Important for many applications Example: CERN HLT data Multiple petabytes of data per year Copy of everything at CERN (Tier 0) Subsets at national centers (Tier 1) Smaller regional centers (Tier 2) Individual researchers will have copies Lorenzo Muttoni Impianti Informatici - A.A

59 Replica Manager Components Low-level Replica Location Service Represents logical-to-physical mappings in a replica catalog High-level Replica Management API globus_replica_manager library Combines calls to file transfer operations and calls to low-level API functions: create, destroy, etc. Lorenzo Muttoni Impianti Informatici - A.A

60 A Model Architecture for Data Grids Metadata Catalog Attribute Specification Logical Collection and Logical File Name GridFTP Control Channel Application Selected Replica Replica Catalog Multiple Locations Replica Selection Performance Information & Predictions MDS NWS Disk Array GridFTP Data Channel Disk Cache Tape Library Disk Cache Replica Location 1 Replica Location 2 Replica Location 3 Lorenzo Muttoni Impianti Informatici - A.A

61 Globus Toolkit: Evaluation (+) Good technical solutions for key problems, e.g. Authentication and authorization Resource discovery and monitoring Reliable remote service invocation High-performance remote data access This + good engineering is enabling progress Good quality reference implementation, multilanguage support, interfaces to many systems, large user base, industrial support Growing community code base built on tools Lorenzo Muttoni Impianti Informatici - A.A

62 Globus Toolkit: Evaluation (-) Protocol deficiencies, e.g. Heterogeneous basis: HTTP, LDAP, FTP No standard means of invocation, notification, error propagation, authorization, termination, Significant missing functionality, e.g. Databases, sensors, instruments, workflow, Virtualization of end systems (hosting envs.) Little work on total system properties, e.g. Dependability, end-to-end QoS, Reasoning about system properties Lorenzo Muttoni Impianti Informatici - A.A

63 Globus Toolkit 3.0 OGSA - Open Grid Service Architecture OGSI - Open Grid Service Infrastructure

64 Web Services Increasingly popular standards-based framework for accessing network applications W3C standardization; Microsoft, IBM, Sun, others WSDL: Web Services Description Language Interface Definition Language for Web services SOAP: Simple Object Access Protocol XML-based RPC protocol; common WSDL target WS-Inspection Conventions for locating service descriptions UDDI: Universal Desc., Discovery, & Integration Directory for Web services Lorenzo Muttoni Impianti Informatici - A.A

65 Transient Service Instances Web services address discovery & invocation of persistent services Interface to persistent state of entire enterprise In Grids, must also support transient service instances, created/destroyed dynamically Interfaces to the states of distributed activities E.g. workflow, video conf., dist. data analysis Significant implications for how services are managed, named, discovered, and used In fact, much of our work is concerned with the management of service instances Lorenzo Muttoni Impianti Informatici - A.A

66 Open Grid Services Architecture Service orientation to virtualize resources From Web services: Standard interface definition mechanisms: multiple protocol bindings, multiple implementations, local/remote transparency Building on Globus Toolkit: Grid service: semantics for service interactions Management of transient instances (& state) Factory, Registry, Discovery, other services Reliable and secure transport Multiple hosting targets: J2EE,.NET, C, Lorenzo Muttoni Impianti Informatici - A.A

67 OGSA Service Model System comprises (a typically few) persistent services & (potentially many) transient services All services adhere to specified Grid service interfaces and behaviors Reliable invocation, lifetime management, discovery, authorization, notification, upgradeability, concurrency, manageability Interfaces for managing Grid service instances Factory, registry, discovery, lifetime, etc. => Reliable, secure mgmt of distributed state Lorenzo Muttoni Impianti Informatici - A.A

68 The Grid Service A (potentially transient) Web service with specified interfaces & behaviors, including Creation (Factory) Global naming (GSH) & references (GSR) Lifetime management Registration & Discovery Authorization Notification Concurrency Manageability Lorenzo Muttoni Impianti Informatici - A.A

69 Globus Toolkit v3 (GT3) Open Source OGSA Technology Implement core OGSI interfaces Support primary GT2 interfaces High degree of backward compatibility Multiple platforms & hosting environments J2EE, Java, C,.NET, Python New services SLA negotiation (GRAM-2), registry, replica location, community authorization, data, Lorenzo Muttoni Impianti Informatici - A.A

70 Globus Toolkit Refactoring Grid Security Infrastructure (GSI) Used in Grid service network protocol bindings Meta Directory Service 2 (MDS-2) Native part of each Grid service: Discovery, Registry, RegistryManagement, Notification Grid Resource Allocation & Mgmt (GRAM) Gatekeeper -> Factory for job mgr instances GridFTP Refactor control channel protocol Other services refactored to used Grid services Lorenzo Muttoni Impianti Informatici - A.A

71 Comparing GT2 and GT3 The same GSI certificates Command-line tools GRAM service GASS features GridFTP service Information architecture Grid architecture Open source Community-driven Standards-based but different! Proxy certificates OGSI-compliant information services OGSI-compliant GRAM service Web Services integration Hosting environments RSL XML Lorenzo Muttoni Impianti Informatici - A.A

Grid Architectural Models

Grid Architectural Models Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers

More information

Grid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen

Grid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Concrete Example I have a source file Main.F on machine A, an

More information

Day 1 : August (Thursday) An overview of Globus Toolkit 2.4

Day 1 : August (Thursday) An overview of Globus Toolkit 2.4 An Overview of Grid Computing Workshop Day 1 : August 05 2004 (Thursday) An overview of Globus Toolkit 2.4 By CDAC Experts Contact :vcvrao@cdacindia.com; betatest@cdacindia.com URL : http://www.cs.umn.edu/~vcvrao

More information

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.

More information

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem

More information

Layered Architecture

Layered Architecture The Globus Toolkit : Introdution Dr Simon See Sun APSTC 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 2 Globus Toolkit TM An open source software toolkit addressing key technical problems

More information

Grid Computing Middleware. Definitions & functions Middleware components Globus glite

Grid Computing Middleware. Definitions & functions Middleware components Globus glite Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid

More information

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of

More information

Introduction to Grid Technology

Introduction to Grid Technology Introduction to Grid Technology B.Ramamurthy 1 Arthur C Clarke s Laws (two of many) Any sufficiently advanced technology is indistinguishable from magic." "The only way of discovering the limits of the

More information

Design The way components fit together

Design The way components fit together Introduction to Grid Architecture What is Architecture? Design The way components fit together 12-Mar-14 MCC/MIERSI Grid Computing 1 Introduction to Grid Architecture Why Discuss Architecture? Descriptive

More information

Design The way components fit together

Design The way components fit together Introduction to Grid Architecture What is Architecture? Design The way components fit together 9-Mar-10 MCC/MIERSI Grid Computing 1 Introduction to Grid Architecture Why Discuss Architecture? Descriptive

More information

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT. Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies

More information

GT-OGSA Grid Service Infrastructure

GT-OGSA Grid Service Infrastructure Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base s User-Defined s

More information

Installation and Administration

Installation and Administration Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base Services User-Defined

More information

Globus GTK and Grid Services

Globus GTK and Grid Services Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature

More information

High Performance Computing Course Notes Grid Computing I

High Performance Computing Course Notes Grid Computing I High Performance Computing Course Notes 2008-2009 2009 Grid Computing I Resource Demands Even as computer power, data storage, and communication continue to improve exponentially, resource capacities are

More information

THE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid

THE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid THE GLOBUS PROJECT White Paper GridFTP Universal Data Transfer for the Grid WHITE PAPER GridFTP Universal Data Transfer for the Grid September 5, 2000 Copyright 2000, The University of Chicago and The

More information

Grid Computing Fall 2005 Lecture 16: Grid Security. Gabrielle Allen

Grid Computing Fall 2005 Lecture 16: Grid Security. Gabrielle Allen Grid Computing 7700 Fall 2005 Lecture 16: Grid Security Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Required Reading Chapter 16 of The Grid (version 1), freely available for download

More information

Grid Middleware and Globus Toolkit Architecture

Grid Middleware and Globus Toolkit Architecture Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities

More information

Grid Computing Fall 2005 Lecture 10 and 12: Globus V2. Gabrielle Allen

Grid Computing Fall 2005 Lecture 10 and 12: Globus V2. Gabrielle Allen Grid Computing 7700 Fall 2005 Lecture 10 and 12: Globus V2 Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen/ Globus 4 Primer Required Reading Coursework Essay: 4 pages Describe the

More information

UNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus

UNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus UNIT IV PROGRAMMING MODEL Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus Globus: One of the most influential Grid middleware projects is the Globus

More information

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007 Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software

More information

Cloud Computing. Up until now

Cloud Computing. Up until now Cloud Computing Lecture 4 and 5 Grid: 2012-2013 Introduction. Up until now Definition of Cloud Computing. Grid Computing: Schedulers: Condor SGE 1 Summary Core Grid: Toolkit Condor-G Grid: Conceptual Architecture

More information

Knowledge Discovery Services and Tools on Grids

Knowledge Discovery Services and Tools on Grids Knowledge Discovery Services and Tools on Grids DOMENICO TALIA DEIS University of Calabria ITALY talia@deis.unical.it Symposium ISMIS 2003, Maebashi City, Japan, Oct. 29, 2003 OUTLINE Introduction Grid

More information

Architecture Proposal

Architecture Proposal Nordic Testbed for Wide Area Computing and Data Handling NORDUGRID-TECH-1 19/02/2002 Architecture Proposal M.Ellert, A.Konstantinov, B.Kónya, O.Smirnova, A.Wäänänen Introduction The document describes

More information

Introduction to Grid Computing

Introduction to Grid Computing Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able

More information

Using the MyProxy Online Credential Repository

Using the MyProxy Online Credential Repository Using the MyProxy Online Credential Repository Jim Basney National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu What is MyProxy? Independent Globus Toolkit add-on

More information

Grid Scheduling Architectures with Globus

Grid Scheduling Architectures with Globus Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents

More information

Java Development and Grid Computing with the Globus Toolkit Version 3

Java Development and Grid Computing with the Globus Toolkit Version 3 Java Development and Grid Computing with the Globus Toolkit Version 3 Michael Brown IBM Linux Integration Center Austin, Texas Page 1 Session Introduction Who am I? mwbrown@us.ibm.com Team Leader for Americas

More information

Web-based access to the grid using. the Grid Resource Broker Portal

Web-based access to the grid using. the Grid Resource Broker Portal Web-based access to the grid using the Grid Resource Broker Portal Giovanni Aloisio, Massimo Cafaro ISUFI High Performance Computing Center Department of Innovation Engineering University of Lecce, Italy

More information

Outline. Definition of a Distributed System Goals of a Distributed System Types of Distributed Systems

Outline. Definition of a Distributed System Goals of a Distributed System Types of Distributed Systems Distributed Systems Outline Definition of a Distributed System Goals of a Distributed System Types of Distributed Systems What Is A Distributed System? A collection of independent computers that appears

More information

Irish and European Grid Projects

Irish and European Grid Projects Irish and European Grid Projects GRID Thibaut Lery, DIAS COSMOGRID Grids - Grids - Grids Why do we need Grids? What are Grids? Grids in Ireland? Grids in Europe? Why do we need Grids? An Exponential World

More information

Introduction to GT3. Overview. Installation Pre-requisites GT3.2. Overview of Installing GT3

Introduction to GT3. Overview. Installation Pre-requisites GT3.2. Overview of Installing GT3 Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base Services User-Defined

More information

DHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI

DHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI DHANALAKSHMI COLLEGE OF ENGINEERING, CHENNAI Department of Computer Science and Engineering CS6703 Grid and Cloud Computing Anna University 2 & 16 Mark Questions & Answers Year / Semester: IV / VII Regulation:

More information

UNICORE Globus: Interoperability of Grid Infrastructures

UNICORE Globus: Interoperability of Grid Infrastructures UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057

More information

Understanding StoRM: from introduction to internals

Understanding StoRM: from introduction to internals Understanding StoRM: from introduction to internals 13 November 2007 Outline Storage Resource Manager The StoRM service StoRM components and internals Deployment configuration Authorization and ACLs Conclusions.

More information

Globus Toolkit Firewall Requirements. Abstract

Globus Toolkit Firewall Requirements. Abstract Globus Toolkit Firewall Requirements v0.3 8/30/2002 Von Welch Software Architect, Globus Project welch@mcs.anl.gov Abstract This document provides requirements and guidance to firewall administrators at

More information

Classification and Characterization of Core Grid Protocols for Global Grid Computing

Classification and Characterization of Core Grid Protocols for Global Grid Computing 1 Classification and Characterization of Core Grid s for Global Grid Computing Harshad B. Prajapati and Vipul K. Dabhi Abstract Grid computing has attracted many researchers over a few years, and as a

More information

Advanced School in High Performance and GRID Computing November Introduction to Grid computing.

Advanced School in High Performance and GRID Computing November Introduction to Grid computing. 1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste

More information

An Evaluation of Alternative Designs for a Grid Information Service

An Evaluation of Alternative Designs for a Grid Information Service An Evaluation of Alternative Designs for a Grid Information Service Warren Smith, Abdul Waheed *, David Meyers, Jerry Yan Computer Sciences Corporation * MRJ Technology Solutions Directory Research L.L.C.

More information

Cloud Computing. Summary

Cloud Computing. Summary Cloud Computing Lectures 2 and 3 Definition of Cloud Computing, Grid Architectures 2012-2013 Summary Definition of Cloud Computing (more complete). Grid Computing: Conceptual Architecture. Condor. 1 Cloud

More information

Lecture 9: MIMD Architectures

Lecture 9: MIMD Architectures Lecture 9: MIMD Architectures Introduction and classification Symmetric multiprocessors NUMA architecture Clusters Zebo Peng, IDA, LiTH 1 Introduction A set of general purpose processors is connected together.

More information

Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management

More information

First evaluation of the Globus GRAM Service. Massimo Sgaravatto INFN Padova

First evaluation of the Globus GRAM Service. Massimo Sgaravatto INFN Padova First evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova massimo.sgaravatto@pd.infn.it Draft version release 1.0.5 20 June 2000 1 Introduction...... 3 2 Running jobs... 3 2.1 Usage examples.

More information

Grid Computing. Lectured by: Dr. Pham Tran Vu Faculty of Computer and Engineering HCMC University of Technology

Grid Computing. Lectured by: Dr. Pham Tran Vu   Faculty of Computer and Engineering HCMC University of Technology Grid Computing Lectured by: Dr. Pham Tran Vu Email: ptvu@cse.hcmut.edu.vn 1 Grid Architecture 2 Outline Layer Architecture Open Grid Service Architecture 3 Grid Characteristics Large-scale Need for dynamic

More information

glite Grid Services Overview

glite Grid Services Overview The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,

More information

Grid Computing Security hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1

Grid Computing Security hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1 Grid Computing Security 20.10.2006 hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1 What to expect from this talk Collection of bits about GC I thought you might find interesting Mixed bag:

More information

An Example Grid Middleware - The Globus Toolkit. MCSN N. Tonellotto Complements of Distributed Enabling Platforms

An Example Grid Middleware - The Globus Toolkit. MCSN N. Tonellotto Complements of Distributed Enabling Platforms An Example Grid Middleware - The Globus Toolkit 1 Globus Toolkit A software toolkit addressing key technical problems in the development of Grid enabled tools, services, and applications Offer a modular

More information

Design of Distributed Data Mining Applications on the KNOWLEDGE GRID

Design of Distributed Data Mining Applications on the KNOWLEDGE GRID Design of Distributed Data Mining Applications on the KNOWLEDGE GRID Mario Cannataro ICAR-CNR cannataro@acm.org Domenico Talia DEIS University of Calabria talia@deis.unical.it Paolo Trunfio DEIS University

More information

Realizing the Promise of SANs

Realizing the Promise of SANs Business without interruption. Realizing the Promise of SANs Bill North Director, Storage Network Programs Strategic Initiatives Group VERITAS Software Education Committee Chairman Storage Network Industry

More information

Cycle Sharing Systems

Cycle Sharing Systems Cycle Sharing Systems Jagadeesh Dyaberi Dependable Computing Systems Lab Purdue University 10/31/2005 1 Introduction Design of Program Security Communication Architecture Implementation Conclusion Outline

More information

Regular Forum of Lreis. Speechmaker: Gao Ang

Regular Forum of Lreis. Speechmaker: Gao Ang Regular Forum of Lreis Speechmaker: Gao Ang Content: A. Overview of Eclipse Project B. Rich Client Platform C. The progress of ustudio Project D. The development of Grid technology and Grid GIS E. Future

More information

The GridWay. approach for job Submission and Management on Grids. Outline. Motivation. The GridWay Framework. Resource Selection

The GridWay. approach for job Submission and Management on Grids. Outline. Motivation. The GridWay Framework. Resource Selection The GridWay approach for job Submission and Management on Grids Eduardo Huedo Rubén S. Montero Ignacio M. Llorente Laboratorio de Computación Avanzada Centro de Astrobiología (INTA - CSIC) Associated to

More information

My View Grid Computing: An Overview

My View Grid Computing: An Overview My View Grid Computing: An Overview Manish Parashar The Applied Software Systems Laboratory Rutgers, The State University of New Jersey http://www.caip.rutgers.edu/tassl/ LRIG, September 30, 2003 Ack:

More information

Functional Requirements for Grid Oriented Optical Networks

Functional Requirements for Grid Oriented Optical Networks Functional Requirements for Grid Oriented Optical s Luca Valcarenghi Internal Workshop 4 on Photonic s and Technologies Scuola Superiore Sant Anna Pisa June 3-4, 2003 1 Motivations Grid networking connection

More information

Scientific Computing with UNICORE

Scientific Computing with UNICORE Scientific Computing with UNICORE Dirk Breuer, Dietmar Erwin Presented by Cristina Tugurlan Outline Introduction Grid Computing Concepts Unicore Arhitecture Unicore Capabilities Unicore Globus Interoperability

More information

Knowledge-based Grids

Knowledge-based Grids Knowledge-based Grids Reagan Moore San Diego Supercomputer Center (http://www.npaci.edu/dice/) Data Intensive Computing Environment Chaitan Baru Walter Crescenzi Amarnath Gupta Bertram Ludaescher Richard

More information

Scott Lowden SAP America Technical Solution Architect

Scott Lowden SAP America Technical Solution Architect SAP NetWeaver Training Overview - SAP Web Application Server Scott Lowden SAP America Technical Solution Architect SAP NetWeaver Components Detail SAP Web Application Server SAP AG 2003, Title of Presentation,

More information

JXTA TM Technology for XML Messaging

JXTA TM Technology for XML Messaging JXTA TM Technology for XML Messaging OASIS Symposium New Orleans, LA 27-April-2004 Richard Manning Senior Software Architect Advanced Technology & Edge Computing Center Sun Microsystems Inc. www.jxta.org

More information

1.264 Lecture 16. Legacy Middleware

1.264 Lecture 16. Legacy Middleware 1.264 Lecture 16 Legacy Middleware What is legacy middleware? Client (user interface, local application) Client (user interface, local application) How do we connect clients and servers? Middleware Network

More information

A Distributed Media Service System Based on Globus Data-Management Technologies1

A Distributed Media Service System Based on Globus Data-Management Technologies1 A Distributed Media Service System Based on Globus Data-Management Technologies1 Xiang Yu, Shoubao Yang, and Yu Hong Dept. of Computer Science, University of Science and Technology of China, Hefei 230026,

More information

Research and Design Application Platform of Service Grid Based on WSRF

Research and Design Application Platform of Service Grid Based on WSRF DOI: 10.7763/IPEDR. 2012. V49. 27 Research and Design Application Platform of Service Grid Based on WSRF Jianmei Ge a, Shying Zhang a College of Computer Science and Technology, Beihua University, No.1

More information

Agent-Enabling Transformation of E-Commerce Portals with Web Services

Agent-Enabling Transformation of E-Commerce Portals with Web Services Agent-Enabling Transformation of E-Commerce Portals with Web Services Dr. David B. Ulmer CTO Sotheby s New York, NY 10021, USA Dr. Lixin Tao Professor Pace University Pleasantville, NY 10570, USA Abstract:

More information

A Simple Mass Storage System for the SRB Data Grid

A Simple Mass Storage System for the SRB Data Grid A Simple Mass Storage System for the SRB Data Grid Michael Wan, Arcot Rajasekar, Reagan Moore, Phil Andrews San Diego Supercomputer Center SDSC/UCSD/NPACI Outline Motivations for implementing a Mass Storage

More information

2 Model. 2.1 Introduction

2 Model. 2.1 Introduction 2 Model 2.1 Introduction The mostly used attempt to define Grid computing [77] is through an analogy with the electric power evolution around 1910. The truly revolutionary development was not the discovery

More information

Grid Compute Resources and Job Management

Grid Compute Resources and Job Management Grid Compute Resources and Job Management How do we access the grid? Command line with tools that you'll use Specialised applications Ex: Write a program to process images that sends data to run on the

More information

Distribution and web services

Distribution and web services Chair of Software Engineering Carlo A. Furia, Bertrand Meyer Distribution and web services From concurrent to distributed systems Node configuration Multiprocessor Multicomputer Distributed system CPU

More information

M. Roehrig, Sandia National Laboratories. Philipp Wieder, Research Centre Jülich Nov 2002

M. Roehrig, Sandia National Laboratories. Philipp Wieder, Research Centre Jülich Nov 2002 Category: INFORMATIONAL Grid Scheduling Dictionary WG (SD-WG) M. Roehrig, Sandia National Laboratories Wolfgang Ziegler, Fraunhofer-Institute for Algorithms and Scientific Computing Philipp Wieder, Research

More information

02 - Distributed Systems

02 - Distributed Systems 02 - Distributed Systems Definition Coulouris 1 (Dis)advantages Coulouris 2 Challenges Saltzer_84.pdf Models Physical Architectural Fundamental 2/58 Definition Distributed Systems Distributed System is

More information

Globus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009

Globus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009 Globus Toolkit 4 Execution Management Alexandra Jimborean International School of Informatics Hagenberg, 2009 2 Agenda of the day Introduction to Globus Toolkit and GRAM Zoom In WS GRAM Usage Guide Architecture

More information

Cisco Configuration Engine 2.0

Cisco Configuration Engine 2.0 Cisco Configuration Engine 2.0 The Cisco Configuration Engine provides a unified, secure solution for automating the deployment of Cisco customer premises equipment (CPE). This scalable product distributes

More information

Accounting in Grid Environments

Accounting in Grid Environments Umeå University Department of Computing Science Master s Thesis May 27, 2004 Accounting in Grid Environments An Architecture Proposal and a Prototype Implementation Author: Peter Gardfjäll Supervisor:

More information

GSI Online Credential Retrieval Requirements. Jim Basney

GSI Online Credential Retrieval Requirements. Jim Basney GSI Online Credential Retrieval Requirements Jim Basney jbasney@ncsa.uiuc.edu http://www.ncsa.uiuc.edu/~jbasney/ Online Credential Retrieval Defined Client Server Authenticate Request Credential Verify

More information

GLOBUS TOOLKIT SECURITY

GLOBUS TOOLKIT SECURITY GLOBUS TOOLKIT SECURITY Plamen Alexandrov, ISI Masters Student Softwarepark Hagenberg, January 24, 2009 TABLE OF CONTENTS Introduction (3-5) Grid Security Infrastructure (6-15) Transport & Message-level

More information

Grid Computing: Status and Perspectives. Alexander Reinefeld Florian Schintke. Outline MOTIVATION TWO TYPICAL APPLICATION DOMAINS

Grid Computing: Status and Perspectives. Alexander Reinefeld Florian Schintke. Outline MOTIVATION TWO TYPICAL APPLICATION DOMAINS Grid Computing: Status and Perspectives Alexander Reinefeld Florian Schintke Schwerpunkte der Informatik" Ringvorlesung am 05.06.2003 1 Outline MOTIVATION o What s a Grid? Why using Grids? TWO TYPICAL

More information

The Grid Architecture

The Grid Architecture U.S. Department of Energy Office of Science The Grid Architecture William E. Johnston Distributed Systems Department Computational Research Division Lawrence Berkeley National Laboratory dsd.lbl.gov What

More information

CmpE 596: Service-Oriented Computing

CmpE 596: Service-Oriented Computing CmpE 596: Service-Oriented Computing Pınar Yolum pinar.yolum@boun.edu.tr Department of Computer Engineering Boğaziçi University CmpE 596: Service-Oriented Computing p.1/53 Course Information Topics Work

More information

GSI-based Security for Web Services

GSI-based Security for Web Services GSI-based Security for Web Services Sriram Krishnan, Ph.D. sriram@sdsc.edu Topics Covered High-level Overview Message and Transport Level Security Authentication and Authorization Implementation details

More information

Globus Toolkit Manoj Soni SENG, CDAC. 20 th & 21 th Nov 2008 GGOA Workshop 08 Bangalore

Globus Toolkit Manoj Soni SENG, CDAC. 20 th & 21 th Nov 2008 GGOA Workshop 08 Bangalore Globus Toolkit 4.0.7 Manoj Soni SENG, CDAC 1 What is Globus Toolkit? The Globus Toolkit is an open source software toolkit used for building Grid systems and applications. It is being developed by the

More information

Deploying the TeraGrid PKI

Deploying the TeraGrid PKI Deploying the TeraGrid PKI Grid Forum Korea Winter Workshop December 1, 2003 Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu

More information

Juliusz Pukacki OGF25 - Grid technologies in e-health Catania, 2-6 March 2009

Juliusz Pukacki OGF25 - Grid technologies in e-health Catania, 2-6 March 2009 Grid Technologies for Cancer Research in the ACGT Project Juliusz Pukacki (pukacki@man.poznan.pl) OGF25 - Grid technologies in e-health Catania, 2-6 March 2009 Outline ACGT project ACGT architecture Layers

More information

S.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing.

S.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing. VALLIAMMAI ENGNIEERING COLLEGE SRM Nagar, Kattankulathur 603203. DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Year & Semester : IV & VII Section : CSE -1& 2 Subject Code : CS6703 Subject Name : Grid

More information

NUSGRID a computational grid at NUS

NUSGRID a computational grid at NUS NUSGRID a computational grid at NUS Grace Foo (SVU/Academic Computing, Computer Centre) SVU is leading an initiative to set up a campus wide computational grid prototype at NUS. The initiative arose out

More information

By Ian Foster. Zhifeng Yun

By Ian Foster. Zhifeng Yun By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance

More information

Chapter 3. Design of Grid Scheduler. 3.1 Introduction

Chapter 3. Design of Grid Scheduler. 3.1 Introduction Chapter 3 Design of Grid Scheduler The scheduler component of the grid is responsible to prepare the job ques for grid resources. The research in design of grid schedulers has given various topologies

More information

(9A05803) WEB SERVICES (ELECTIVE - III)

(9A05803) WEB SERVICES (ELECTIVE - III) 1 UNIT III (9A05803) WEB SERVICES (ELECTIVE - III) Web services Architecture: web services architecture and its characteristics, core building blocks of web services, standards and technologies available

More information

EUROPEAN MIDDLEWARE INITIATIVE

EUROPEAN MIDDLEWARE INITIATIVE EUROPEAN MIDDLEWARE INITIATIVE VOMS CORE AND WMS SECURITY ASSESSMENT EMI DOCUMENT Document identifier: EMI-DOC-SA2- VOMS_WMS_Security_Assessment_v1.0.doc Activity: Lead Partner: Document status: Document

More information

Chapter 18 Distributed Systems and Web Services

Chapter 18 Distributed Systems and Web Services Chapter 18 Distributed Systems and Web Services Outline 18.1 Introduction 18.2 Distributed File Systems 18.2.1 Distributed File System Concepts 18.2.2 Network File System (NFS) 18.2.3 Andrew File System

More information

What's new in IBM Rational Build Forge Version 7.1

What's new in IBM Rational Build Forge Version 7.1 What's new in IBM Rational Build Forge Version 7.1 Features and support that help you automate or streamline software development tasks Skill Level: Intermediate Rational Staff, IBM Corporation 13 Jan

More information

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or

More information

Grid Services and the Globus Toolkit

Grid Services and the Globus Toolkit Grid Services and the Globus Toolkit Lisa Childers childers@mcs.anl.gov The Globus Alliance Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved. This

More information

Integrating SGE and Globus in a Heterogeneous HPC Environment

Integrating SGE and Globus in a Heterogeneous HPC Environment Integrating SGE and Globus in a Heterogeneous HPC Environment David McBride London e-science Centre, Department of Computing, Imperial College Presentation Outline Overview of Centre

More information

Chapter 18: Database System Architectures.! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems!

Chapter 18: Database System Architectures.! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Chapter 18: Database System Architectures! Centralized Systems! Client--Server Systems! Parallel Systems! Distributed Systems! Network Types 18.1 Centralized Systems! Run on a single computer system and

More information

Customized way of Resource Discovery in a Campus Grid

Customized way of Resource Discovery in a Campus Grid 51 Customized way of Resource Discovery in a Campus Grid Damandeep Kaur Society for Promotion of IT in Chandigarh (SPIC), Chandigarh Email: daman_811@yahoo.com Lokesh Shandil Email: lokesh_tiet@yahoo.co.in

More information

MPI versions. MPI History

MPI versions. MPI History MPI versions MPI History Standardization started (1992) MPI-1 completed (1.0) (May 1994) Clarifications (1.1) (June 1995) MPI-2 (started: 1995, finished: 1997) MPI-2 book 1999 MPICH 1.2.4 partial implemention

More information

Programming Environment Oct 9, Grid Programming (1) Osamu Tatebe University of Tsukuba

Programming Environment Oct 9, Grid Programming (1) Osamu Tatebe University of Tsukuba Programming Environment Oct 9, 2014 Grid Programming (1) Osamu Tatebe University of Tsukuba Overview Grid Computing Computational Grid Data Grid Access Grid Grid Technology Security - Single Sign On Information

More information

JOB SUBMISSION ON GRID

JOB SUBMISSION ON GRID arxiv:physics/0701101v2 [physics.comp-ph] 12 Jan 2007 JOB SUBMISSION ON GRID An Users Introduction Rudra Banerjee ADVANCED COMPUTING LAB. Dept. of Physics, University of Pune March 13, 2018 Contents preface

More information

Boundary control : Access Controls: An access control mechanism processes users request for resources in three steps: Identification:

Boundary control : Access Controls: An access control mechanism processes users request for resources in three steps: Identification: Application control : Boundary control : Access Controls: These controls restrict use of computer system resources to authorized users, limit the actions authorized users can taker with these resources,

More information

GEMS: A Fault Tolerant Grid Job Management System

GEMS: A Fault Tolerant Grid Job Management System GEMS: A Fault Tolerant Grid Job Management System Sriram Satish Tadepalli Thesis submitted to the faculty of the Virginia Polytechnic Institute and State University in partial fulfillment of the requirements

More information

Grid Authentication and Authorisation Issues. Ákos Frohner at CERN

Grid Authentication and Authorisation Issues. Ákos Frohner at CERN Grid Authentication and Authorisation Issues Ákos Frohner at CERN Overview Setting the scene: requirements Old style authorisation: DN based gridmap-files Overview of the EDG components VO user management:

More information