THE WIDE AREA GRID. Architecture

Transcription

1 THE WIDE AREA GRID Architecture

2 Context The Wide Area Grid concept was discussed during several WGISS meetings The idea was to imagine and experiment an infrastructure that could be used by agencies to easily make available some of their applications The Wide Area Grid has become a R&D activity at CNES The WIDE Area Grid is also studied in the frame of an INTAS joined project between Institute of Informatics, Slovak Academy of Science (Slovakia) Space Research Institute of the NASU-NSAU (Ukraine) Institute of Space Research of the RAS, IKI RAN (Russia) Centre National d'etudes Spatiales (France) CNES first contribution to this project is a WAG architecture study by Capgemini (CNES contractor) WGISS 23, Hanoi, May

3 Methodology Integrated Architecture Framewok (IAF) overall approach that covers all areas of an architecture provides a model for architecure development and usage describes the format and content of the constituent elements of the architecture specifies the way in which these elements relate to each other consists of 6 aspect areas - each one adds knowledge business aspect area - objectives, activities, organization information aspect area - information used by the business information system aspect area - types of information systems supporting information processing technology infrastructure aspect area - infrastructure components that support information systems governance aspect area - manageability and quality of the architecture information ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ Contextual Contextual ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ WHY? WHY? ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇ Business Business Information Information Information Information Technology ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇ Systems Systems ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ Infrastructure Technology Infrastructure Conceptual Conceptual ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ WHAT? WHAT? ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ Logical Logical ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ HOW? HOW? ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ Physical ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ Physical ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ WITH WHAT? ÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓÓ ÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇÇ security aspect area - known risks to the architecture Emphasis put on IS and implementation TI aspects in this study consists of one contextual level (Why?) and three abstraction levels conceptual (What?) logical (How?) physical (with what?) Governance Governance Security Security WGISS 23, Hanoi, May

4 The WAG Context WGISS 23, Hanoi, May

5 Objectives of the study identify the technical elements necessary to complete the WAG identify a mechanism for service publication identify a portal for access to the WAG identify a generic business process management identify a mechanism of transfer and visaulization of service results draft of design and architecture Grid Technology The WAG is not a grid per se. But the WAG concept has grown up from the emerging grid technology. WGISS 23, Hanoi, May

6 WAG business mission merge existing resources (partners) from as many places as needed into a designated federation, each resource provider retaining within the federation the ownership of the provided resource low cost of WAG deployement and management technological interest WAG constraints take into account the technological choices of the partners the WAG is based on WAN, not on LAN security is not necessarily the same for all partners access to the WAG by users and administrator will be done through a web portal no WAG specific middleware development WAG principles and assumptions partners need to agree on the rule of the game (all resources be part of a network) protection against bottleneck achieved by an administration task WGISS 23, Hanoi, May

7 Business Services and Information WGISS 23, Hanoi, May

8 Resource management Business Services (1/2) an agency shall be able to bring/remove resources to/from the WAG at any time (after acceptation by a management comittee ) resources are managed and classified in categeories the user sees resources only through services that are attached to them the WAG shall allow for the definition of new services based on existing resources/services Service consumption the user shall access the WAG only in the frame of a session when opening a session, the user shall be prompted for a session type (or session name) identifying the services that will be available for the session the user logs in in anomymous or authenticated mode (available services may not be the same) the user selects services via some selection mechanism (from a list, from keywords, etc.); services may be transient, perennial, permanent the user is prompted for parameters needed to activate the service results are made available to the user (they may redirected in case of an authenticated user) WGISS 23, Hanoi, May

9 Administration Business Services (2/2) the administrator is a user with particular priviledges the administrator manages the resources (he adds/removes resources) the administrator defines the sessions (by type or name and by the services available for the session) the administrator knows the users who may authenticate themselves the administrator defines the services based on available resources and known constraints the administrator shall not be able to corrupt the WAG Non functional (operational) requirements the WAG shall be operated with as few interruptions as possible the WAG shall be protected from saturation (a service must not prevent other services from being run for a long time) WGISS 23, Hanoi, May

10 Credentials Business information A password shall be used to authenticate a user from the portal view. A certificate is created to authenticate the user from the WAG view. Resources A resource can be a physical device or a logical entity. Whatever its nature, a resource is uniquely identified in the WAG. Taxonomy Services shall be organized according to some taxonomy (e.g. ISO 19119). Resource Access Rights A resource is always provided by a resource provider. Each resource provider is defined as a Virtual Organization with its own certificate. Security Security is restricted to user authentication by name/password. Governance The administrator has a console to check WAG consistency. WGISS 23, Hanoi, May

11 Conceptual Architecture WGISS 23, Hanoi, May

12 Resource Management A resource has a type and characteristics. Information System Conceptual Services Each resource is linked to a service: a computer is linked to a computer service, a file is linked to a file serice, etc. A service has a type and properties. Services are available for resource publication (addition to the WAG), resource notification (the user is informed a new resource is available), resource modification (activation/decativation). Business Process Management Business process management consists in the ability to build dynamic applications which orchestrate distributed resources, the utilization of resources that are located in a particular domain, the execution of services spanning multiple administrative domains to obtain specific procesing capabilities. Business process management is composed of a workflow service. WAG access Services are available for user management, certificate management, user authentication, services policy WGISS 23, Hanoi, May

13 WAG Communication Infrastructure Technical Infrastructure Conceptual Services To fulfil WAG business objectives, software components communicate using the same protocol (or rely on bridges). Technical infrastructure is internet. Install a new Node or Grid Installation process must be as simple as possible: In the case when the partner owns a grid, the installation shall configure the new node so that it takes the WAG into account. After the installation, the new node is linked to the other published resources. Update a Node A node must be updated if the middleware has changed. A customized distribution is sent over systems with consistent installation and configuration settings. WGISS 23, Hanoi, May

14 Security Security in grids is very much concerned with virtual organizations use grid resources in a coordinate fashion Key issues provide authentication and authorization promote integration with existing systems and technologies Governance Each resource is monitored for resource availability and WAG consistency. WGISS 23, Hanoi, May

15 WAG Architecture Overview WGISS 23, Hanoi, May

16 Logical Architecture WGISS 23, Hanoi, May

17 WAG applicable standards Specifications from the Open Grid Services Architecture (OGSA) Working Group of the Global Grid Forum. OGSA is service oriented and related to the web service technology used in industry. Web Service Resource Framework (WSRF) has become an OASIS standard being adopted by many (UNICORE6, IBM, APACHE MUSE Tupelo, Teragrid) provides the mechanism to keed state information with web services provides the mechanisms for service composition, service lifetime management, service description, service messaging Web Service Notification provides the mechanism for web services to disseminate events topics may be defined to classify events non-web sercices may be notified via a brokered based mechanisme WGISS 23, Hanoi, May

18 Portal JSR 168 WAG applicable standards (2/2) provides the mechanism to implement the WAG portal as portlets Web Services for Remote Portlet (WSRP) is a (less used) alternate to JSR 168 Orchestration Processing Language Business Process Execution Language (BPEL4WS or WS BPEL) is the specification of the language defining the choreography of multiple web services this language is executable in a BPEL engine Job Submission Description Language is the specification of the language defining a job that can be submitted to all target systems offering a JSDL interface X.509 Certificate standard widely used in grid contexts for certification mechanisms WGISS 23, Hanoi, May

19 Information System Logical Components (2/2) Common Runtime libraries and tools needed to build web services and non web services Data Management manages WAG datasets based on WSRF and more particularly on OGSA-DAI for database integration Information Service commonly referred to as the Monotoring and Discovery Service based on WSRF and WSB Business Process Definition builds new services from existingresources based on a graphical tool using BEPL (and on WSRF for service state management) Execution management manages executable programs exposed as web services Portal based on JSR168 for the presentation layer - another layer need for WSRF interface WGISS 23, Hanoi, May

20 Security Using security components, based on the Grid Security Infrastructure (GSI) makes communications secure. The security is web service based, using WS Security and WS SecureConversation. Proxy certificates make the management by the users of their certificates easier. Governance Resource monitoring is performed using the properties of the resources. The administrator is made aware of bottlenecks via . WGISS 23, Hanoi, May

21 WAG based on OGSA and WSRF WGISS 23, Hanoi, May

22 Physical Architecture WGISS 23, Hanoi, May

23 Information Service Physical Components (1/2) Information from and into the WAG as well as user interaction with the WAG will rely on a WAG portal. The middleware chosen for the WAG is Globus toolkit GT4. One of the reasons for this choice is that most potentil partners are already running Globus. Common Runtime all the WSRF and WSN specifications are implemented in the Globus toolkit Information Services is implemented within the Globus MDS framework Data Management is implemented using OGSA-DAI, Reliable File Transfer, GRAM Execution Management is implemented using GRAM WGISS 23, Hanoi, May

24 Information Service Physical Components (2/2) Business Process Definition many workflow editors exist the one selected should implement BPEL and JSDL (e.g GPE Expert) Portlets OGCE, Uportal and GridSphere are among the most popular portals in the Globus World. Interoperability between these portals is provided by JSR168 specification. Middleware Update PACMAN (PACkage MANager) is a good candidate. WGISS 23, Hanoi, May

25 Technical Infrastructure Physical Components In order to build a low cost WAG platform at each VOM member site, it can be useful to take into account virtualization solutions. VMWare servers are free virtualization platforms that may be used to make a physical machine (disk, RAM, HDD and network interface) appear as an arbitrary collection of virtual machines with the same characteristics. The only limitation is the physical resources. VMWare server is available for Linux platforms. Native Linux virtualization solutions are also evolving and could be taken into account. Physical components Configuration Middleware GT4 Portal Hardware N/A N/A Operating System Linux RedHat Enterprise 4 Linux RedHat Enterprise 4 Connection Ethernet 100 Mb/s Ethernet 100 Mb/s Software Version OGCE IP address Fixed recommended N/A WGISS 23, Hanoi, May

26 At CNES, grid components will be in a DMZ. Security Security is handled via X509 certificate. Proxy certificates are based on the Globus myproxy component. A portlet is associated with a proxy. Governance Resource monitoring is performed by Globus MDS. Tools like Ganglia, Inca, GridIce and Monalisa could also be used. WGISS 23, Hanoi, May

27 Thank You! WGISS 23, Hanoi, May