A Distributed Media Service System Based on Globus Data-Management Technologies1
|
|
- Tracey Melton
- 5 years ago
- Views:
Transcription
1 A Distributed Media Service System Based on Globus Data-Management Technologies1 Xiang Yu, Shoubao Yang, and Yu Hong Dept. of Computer Science, University of Science and Technology of China, Hefei , PR, China Abstract. Recently, emerging high performance applications require the ability to exploit diverse, geographically distributed resources, specifically, in a Grid environment. A collection of software, called the Globus grid toolkit, is developed to address related drawbacks. In this paper, we describe an application (we call it Distributed Media Service System, DMSS for short) developed in this toolkit: we present the features and physical infrastructure of the goal system, the effectiveness of the toolkit approach, our heuristic enhancements, and draw a conclusion regarding future work. 1 Introduction Grid technology is deemed a critical element of future high performance computing environments that will enable entirely new classes of applications. We devised a media service system, called DMSS here, with the very prevalent Globus[1] toolkit. Basically, our DMSS system harnesses data management in the Globus toolkit, which enables various operations on files, namely, registration, publication, deletion, copy, inquiry, remote access, data transfer, security protection, etc, and effectively utilizes resources, avoiding the bottleneck caused by multiple users linked together in traditional central media service systems. The organization of this paper is as follows. In the next section, we describe the physical architecture and system functionalities of our DMSS. In section 3, we introduce the major technical supports from Globus. This is followed up by section 4, where we give a detailed explanation on the five s of DMSS system. A brief conclusion and future work is presented in the remainder of this paper. 1 This paper is supported by the National Natural Science Foundation of China (Contract No ) and the National 863 High-Tech Program of China (Contract No. 2002AA104560).
2 2 Physical Structure and Functionalities of DMSS 2.1 Physical Structure Our DMSS system, a virtual organization, consists of a server and a host of nodes. The server s main duties are providing users with access to the DMSS system, and enabling them to publish, access and maintain data files. Each node stores some data files or offers logical management of Replica catalogs, and its location is distributed geographically. As per figure 1, host Pi (i=1,2 ) beyond the dotted lines of each area does not belong to the effective member node set of the system (or rather, the DMSS virtual organization). Take area 4 for example, nodes N1 and N2 are member nodes of the system, while hosts P1, P2 and P3 have no membership. However, P1, P2 and P3 can be members of other VOs. That is to say, if area 4 is a VO, then nodes N1 and N2 are the member nodes of not only the DMSS system, but also VO area 4, but P1, P2, and P3 are member nodes of only the VO area 4. N1 P2 N2 P1 P3 N1 P1 N2 Area 4 Area 1 N1 P1 Portal & Server Disk Disk Area 2 DMSS N1 Area 3 Disk Fig. 1. Physical structure of DMSS system Theoretically, any node can enter or quit the system randomly, which guarantees the scalability of the DMSS system. Illustrated below is the membership procedure of a host entering the DMSS system: The node first obtains an effective certificate, whose publisher is a credential of DMSS system, so as to authenticate its legal identity. Then, the node registers to the DMSS server, declaring that it wants to become a member of the VO, offering its remaining disk space or Replica catalogue service. 2.2 Functionalities The DMSS system fully utilizes remaining resources in network, via the following:
3 1, Replica catalogs logically manage distributed media files. There are two sorts of nodes: A node has its own Replica catalog. A node can store files only, has no Replica catalog, so that its files are managed logically by Replica catalogs of other nodes. 2, When the user connects to the server, the server calls access function, and returns to the user the nearest download location of the file in question, or else, redirects the user to a nearest node, where the user directly gets the media service. 3, System evaluates the latency and checks if it has surpassed limitation. If so, the system searches for an effective node nearest to the user and stores a copy of the file. Next time, this very user or others near him would get faster service if they access the same file. 4, System is maintained periodically, deleting redundant replicas for optimal disk utilization. 3 Basic Globus Services Used in DMSS We harness various Globus services in our implementation, specifically, MDS, Replica, GSI, GridFtp, GASS and GRAM[1-6], which are only basic services, therefore, we combine with them our original access selection algorithm plus the strategy of event-recording and redundancy maintenance. MDS (Metacomputing Directory Service)[2] integrates LDAP (Lightweight Directory Access Protocol)[3] to construct its own schema and store static and dynamic information of Grid internal entities, then establishes a uniform namespace. We offer three MDS functions: 1) a unique global name for nodes 2) registration of legal member nodes 3) obtains host name, IP address and the volume of available disk space of effective nodes. Replica Catalogs offer services like registration, publication, deletion, copy and facilitates relevant publication, mutual information access between entities, and the distribution of information resources and information services[4]. In our DMSS system, Replica serves these purposes: catalog creation, logical file management, file publication and file access. GridFtp provides secure and effective data transfer[5]. In DMSS system, GridFtp provides three services: file upload, file download and physical storage of replicas. GSI (Globus Security Infrastructure) locates resources with X.509 certificate information provided by MDS service[6] together with RSA encryption algorithm, to achieve mutual authentication between user and resources. GRAM (Globus Resource Allocation Manager) handles resource requests, executes remote applications, allocates resources and manages system actions, computes and transmits information of resource updates to MDS. In DMSS, GRAM plays two roles via commands on the server s remote node: obtain latency by ping command and delete redundant copies by rm command. GASS (Global Access to Secondary Storage) services, which interoperates with other Globus s, mainly addresses the remote I/O problem in a Grid system.
4 4 DMSS System Architecture---the Five Modules We assume that each node owns legal identity and credential, and is member node of the DMSS system to guarantee security for each node and its information access. As shown in figure 2, the whole system is comprised of five s: Portal, Replica generation, Replica selection, Event recording, and Replica management. Replica generation Portal Replica selection Event recording Replica management Fig. 2. Architecture of DMSS system 4.1 Portal---Streaming Media Service Entry It provides users web-interface, and implements the redirection of users to optimized nodes for media services, or returns optimized node for the accessed files. Common Grid users need a GUI (graphic user interface) in grid application, which we call portal. We devised a user interface for implementation of the system, as in figure 3. Return address or redirect user to the selected node User Return selection result Portal entry Genetate selection parameters Dynamically obtain file Selection strategy Call replica selection Event recording Fig. 3. Flowchart of Portal JSP (Java Server Pages) and Java Servlet toolkits are adopted to implement the connection of user interface and back-platform. The critical problems are:
5 The media files are sorted into 3 categories in our DMSS system. Assume the system has got some audio files in storage, they can be categorized as such: catalog name (rc),set name (lc): lc represents the singer s name, file name (lf): lf represents the song s name. When the user accesses a file, JSP page offers parameter description of accessed files. Then, JSP relays these parameters to Java Servlet, which calls the Replica selection. The consults the selection strategy and returns the most effective node address of accessed files. 4.2 Replica Generation Module Although Globus provides file publication and registration, namely, media file catalogs, media file sets, logical media files and the mapping of logical location to physical location of media files, we must monitor the MDS information service to obtain optimal node for Replica generation, or else choose a node (with adequate physical space for the additional files) as the mapping from the additional logical file to a specific physical address. Replica generation includes replica catalog generation, logical set generation and file publication, as shown in figure 4. Call MDS to obtain current node information Administrator 1.replica catalog 3.file generation publication Generaion type? Generate new logical file name 2.logical set generaion Select node Generate new rc Select rc Generate new lc Call MDS to obtain physical node to map logical location to physical location Record event Event recording Generate lc that belong to above rc? yes no end Add new file that belong to above lc Replica management Fig. 4. Flowchart of Replica generation 1, Replica catalog generation: System calls MDS service for current node information and selects the most suitable node for generating duplicate catalog with the specified heuristic. 2, Logical set generation: Intuitively, a logical set is generated when its parent replica catalog is in existence, then new attributes are added to files in the set. 3, File publication: We come up with two operations in the file addition: 1) generation of logical file, 2) mapping from logical address of the file to its physical address (generation of physical address). However, the Replica generation doesn t guarantee the atomicity of the two operations, so we devised an Event recording
6 , which records current events with four different states. An event is in the finishing state only if all its operations are completed. The Event recording addresses the atomicity problem, which is further examined in ensuing parts. Meanwhile, Replica management reads information from the Event recording, and completes the ultimate file addition job. Thus, we just need to select the physical node address of the file in question, and record its original storage address together with its logical address and its physical address in the Event recording. 4.3 Replica Selection Module It provides access to media files, selects optimal node for media files, checks the need for redundant replicas, and reports to the Event recording related information. Globus Replica catalog service simply accesses object file, however, when there are multiple copies of the file in the system, the is not capable of selecting the most effective node for file storage. The Replica selection integrates MDS services with the access-selection heuristic, optimizing its service. Query file Obtain UC of the file return return Number of UC > 1? yes Select best node that stores the file Need copy? yes no Record file information Select destin ation node Record event Event record ing Record file information Replica managem ent end no MDS Fig. 5. Flowchart of Replica selection As shown in figure 5, when the Replica selection receives an access request, it locates the file s logical address firstly, and subsequently physical address via the mapping. To speed up service, a file might have one or even multiple copies in the system, so DMSS system switches between two conditions: When the file is stored in a single node, one uc value is returned, in this case, the system directly returns access results, and the Replica selection decides whether to make redundant copies. When the file is stored in multiple nodes, multiple uc values are returned, so the problem of how to select the node which can offer fastest service, is put to the Replica selection, then, as in the first case the decision of redundant copies.
7 4.4 Event Recording Module The essentiality of an event recorder for the DMSS system lies in the following points. 1) Either the file publication or redundancy copy (this is virtually file publication) needs to call the Replica management. 2) Also, to maintain redundancy rate of system files and optimize disk space, we set a limit to the number of system file copies--a file can have at most one copy on each node in the system. As shown in figure 6, two tables are maintained by Event management : 1) Event recording table: records information about files to be published. State description is shown in table 1. R e p l i c a g e n e r a t i o n m o d u l e R e p l i c a s e l e c t i o n m o d u l e E v e n t r e c o r d i n g t a b l e F i l e i n f o r m a t i o n t a b l e R e p l i c a m a n a g e m e n t m o d u l e Fig. 6. Flowchart of Event recording 2) File access information table: records file access information and provides information about the node storing the file, and the number of times each node is accessed in a period. Table 1. State description state State value Description 1 00 Event not completed 2 01 Event logically copied, but not physically submitted 3 10 Event physically copied, not logically configured 4 11 Event completed, can be deleted from record table 4.5 Replica Management Module It maintains media files in the Grid, periodically updates file redundancy rate, and optimizes disk space to achieve optimal file storage. Data file maintenance jobs are: The realistic file publication. When an event is in state 00, Replica management completes the file addition. File addition consists of two steps: Firstly, physical copy; the system modifies the event state to 01 or 10; secondly, logical configuration, event concludes and its state changes to 11. Maintaining redundancy rate of data. The reads internal information and periodically deletes redundant replica files in the system, avoiding too many identical replicas and reduces redundancy.
8 After system starts(timestamp=0), the Replica management s first redundancy maintenance is after T=T1+T2, during which the reads information from records of time slices T1 and T2, then maintenance is executed every other T. 5 Conclusion and Future Work In this paper, we discussed the functionalities and features of a Distributed Media Service System based on Globus data-management; we provided further explanation on the design of its components. The DMSS system applies the concept of data Grid, providing data files and services in a distributed manner (ubiquitous). In Media services, files are read-only, no consistency problem. Considering the latency brought about by security measures in Globus Grid environment (latency in mutual authentication can reach 7 seconds), we deploy an anonymous file access. However, latency is inevitable. In particular, the problem that the system needs file update as well as information pre-extraction of newly published files, is expected to be addressed in future work, by employing the up-to-date techniques---actively search and retrieve and then automatically publish files on the Internet. References 1. Ian Foster, Carl Kesselman: The Globus Project: A Status Report. In Proc. Heterogeneous Computing Workshop, pages IEEE Computer Society Press, MDS 2.1: Creating a Hierarchical GIIS, Available from 3. Henze Johner, Larry Brown: Understanding LDAP. Available from 4. Byoungdai Lee, Jon B.Weissman: Dynamic Replica Management in the Service Grid. Available from 5. W. Allcock, J. Bester, J. Bresnahan, A. Chervenak, I. Foster, C. Kesselman, S. Meder, V. Nefedova, D. Quesnel, and S. Tuecke: Data Management and Transfer in High-Performance Computational Grid Environments. Parallel Computing, Ian Foster, Carl Kesselman, Gene Tsudik: A Security Architecture for Computational Grids Electronic Edition( IEEE Computer Society DL), 2002.
Grid Computing Security: A Survey
Grid Computing Security: A Survey Basappa B. Kodada, Shiva Kumar K. M Dept. of CSE Canara Engineering College, Mangalore basappabk@gmail.com, shivakumarforu@rediffmail.com Abstract - This paper provides
More informationPerformance Analysis of Applying Replica Selection Technology for Data Grid Environments*
Performance Analysis of Applying Replica Selection Technology for Data Grid Environments* Chao-Tung Yang 1,, Chun-Hsiang Chen 1, Kuan-Ching Li 2, and Ching-Hsien Hsu 3 1 High-Performance Computing Laboratory,
More informationMulti-path based Algorithms for Data Transfer in the Grid Environment
New Generation Computing, 28(2010)129-136 Ohmsha, Ltd. and Springer Multi-path based Algorithms for Data Transfer in the Grid Environment Muzhou XIONG 1,2, Dan CHEN 2,3, Hai JIN 1 and Song WU 1 1 School
More informationGrid Architectural Models
Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationUNICORE Globus: Interoperability of Grid Infrastructures
UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057
More informationDay 1 : August (Thursday) An overview of Globus Toolkit 2.4
An Overview of Grid Computing Workshop Day 1 : August 05 2004 (Thursday) An overview of Globus Toolkit 2.4 By CDAC Experts Contact :vcvrao@cdacindia.com; betatest@cdacindia.com URL : http://www.cs.umn.edu/~vcvrao
More informationKnowledge Discovery Services and Tools on Grids
Knowledge Discovery Services and Tools on Grids DOMENICO TALIA DEIS University of Calabria ITALY talia@deis.unical.it Symposium ISMIS 2003, Maebashi City, Japan, Oct. 29, 2003 OUTLINE Introduction Grid
More informationGrid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management
More informationGlobus Toolkit Firewall Requirements. Abstract
Globus Toolkit Firewall Requirements v0.3 8/30/2002 Von Welch Software Architect, Globus Project welch@mcs.anl.gov Abstract This document provides requirements and guidance to firewall administrators at
More informationLayered Architecture
The Globus Toolkit : Introdution Dr Simon See Sun APSTC 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 2 Globus Toolkit TM An open source software toolkit addressing key technical problems
More informationArchitecture Proposal
Nordic Testbed for Wide Area Computing and Data Handling NORDUGRID-TECH-1 19/02/2002 Architecture Proposal M.Ellert, A.Konstantinov, B.Kónya, O.Smirnova, A.Wäänänen Introduction The document describes
More informationUNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus
UNIT IV PROGRAMMING MODEL Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus Globus: One of the most influential Grid middleware projects is the Globus
More informationA Survey Paper on Grid Information Systems
B 534 DISTRIBUTED SYSTEMS A Survey Paper on Grid Information Systems Anand Hegde 800 North Smith Road Bloomington Indiana 47408 aghegde@indiana.edu ABSTRACT Grid computing combines computers from various
More informationHigh Performance Computing Course Notes Grid Computing I
High Performance Computing Course Notes 2008-2009 2009 Grid Computing I Resource Demands Even as computer power, data storage, and communication continue to improve exponentially, resource capacities are
More informationGlobalStat: A Statistics Service for Diverse Data Collaboration. and Integration in Grid
GlobalStat: A Service for Diverse Data Collaboration and Integration in Grid Shaomei Wu, Zhihui Du Department of Computer Science and Technology Tsinghua University, Beijing, 100084, P. R. China {wusm@mails,
More informationWeb-based access to the grid using. the Grid Resource Broker Portal
Web-based access to the grid using the Grid Resource Broker Portal Giovanni Aloisio, Massimo Cafaro ISUFI High Performance Computing Center Department of Innovation Engineering University of Lecce, Italy
More informationTHE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid
THE GLOBUS PROJECT White Paper GridFTP Universal Data Transfer for the Grid WHITE PAPER GridFTP Universal Data Transfer for the Grid September 5, 2000 Copyright 2000, The University of Chicago and The
More informationReplica Selection in the Globus Data Grid
Replica Selection in the Globus Data Grid Sudharshan Vazhkudai 1, Steven Tuecke 2, and Ian Foster 2 1 Department of Computer and Information Science The University of Mississippi chucha@john.cs.olemiss.edu
More informationGrid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen
Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Concrete Example I have a source file Main.F on machine A, an
More informationGrid Computing Middleware. Definitions & functions Middleware components Globus glite
Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid
More informationA SEMANTIC MATCHMAKER SERVICE ON THE GRID
DERI DIGITAL ENTERPRISE RESEARCH INSTITUTE A SEMANTIC MATCHMAKER SERVICE ON THE GRID Andreas Harth Yu He Hongsuda Tangmunarunkit Stefan Decker Carl Kesselman DERI TECHNICAL REPORT 2004-05-18 MAY 2004 DERI
More informationglite Grid Services Overview
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,
More informationAn Adaptive Transfer Algorithm in GDSS
An Adaptive Transfer Algorithm in GDSS Hai Jin, Xiangshan Guan, Chao Xie and Qingchun Wang Key Laboratory for Cluster and Grid Computing, School of Computer Science and Technology, Huazhong University
More informationGrid Computing Systems: A Survey and Taxonomy
Grid Computing Systems: A Survey and Taxonomy Material for this lecture from: A Survey and Taxonomy of Resource Management Systems for Grid Computing Systems, K. Krauter, R. Buyya, M. Maheswaran, CS Technical
More informationGrid Technologies & Applications: Architecture & Achievements
Grid Technologies & Applications: Architecture & Achievements Ian Foster Mathematics & Computer Science Division, Argonne National Laboratory, Argonne, IL 60439, USA Department of Computer Science, The
More information30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
More informationA Replication and Cache based Distributed Metadata Management System for Data Grid
Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing A Replication and Cache based Distributed Metadata Management System
More informationScientific Computing with UNICORE
Scientific Computing with UNICORE Dirk Breuer, Dietmar Erwin Presented by Cristina Tugurlan Outline Introduction Grid Computing Concepts Unicore Arhitecture Unicore Capabilities Unicore Globus Interoperability
More informationGrid Middleware and Globus Toolkit Architecture
Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities
More informationAn Evaluation of Alternative Designs for a Grid Information Service
An Evaluation of Alternative Designs for a Grid Information Service Warren Smith, Abdul Waheed *, David Meyers, Jerry Yan Computer Sciences Corporation * MRJ Technology Solutions Directory Research L.L.C.
More informationDesign of Distributed Data Mining Applications on the KNOWLEDGE GRID
Design of Distributed Data Mining Applications on the KNOWLEDGE GRID Mario Cannataro ICAR-CNR cannataro@acm.org Domenico Talia DEIS University of Calabria talia@deis.unical.it Paolo Trunfio DEIS University
More informationSDS: A Scalable Data Services System in Data Grid
SDS: A Scalable Data s System in Data Grid Xiaoning Peng School of Information Science & Engineering, Central South University Changsha 410083, China Department of Computer Science and Technology, Huaihua
More informationResearch and Design Application Platform of Service Grid Based on WSRF
DOI: 10.7763/IPEDR. 2012. V49. 27 Research and Design Application Platform of Service Grid Based on WSRF Jianmei Ge a, Shying Zhang a College of Computer Science and Technology, Beihua University, No.1
More informationGrid Computing. Lectured by: Dr. Pham Tran Vu Faculty of Computer and Engineering HCMC University of Technology
Grid Computing Lectured by: Dr. Pham Tran Vu Email: ptvu@cse.hcmut.edu.vn 1 Grid Architecture 2 Outline Layer Architecture Open Grid Service Architecture 3 Grid Characteristics Large-scale Need for dynamic
More informationCredentials Management for Authentication in a Grid-Based E-Learning Platform
Credentials Management for Authentication in a Grid-Based E-Learning Platform Felicia Ionescu, Vlad Nae, Alexandru Gherega University Politehnica of Bucharest {fionescu, vnae, agherega}@tech.pub.ro Abstract
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationTHE VEGA PERSONAL GRID: A LIGHTWEIGHT GRID ARCHITECTURE
THE VEGA PERSONAL GRID: A LIGHTWEIGHT GRID ARCHITECTURE Wei Li, Zhiwei Xu, Bingchen Li, Yili Gong Institute of Computing Technology of Chinese Academy of Sciences Beijing China, 100080 {zxu, liwei, libingchen,
More informationBy Ian Foster. Zhifeng Yun
By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance
More informationGT-OGSA Grid Service Infrastructure
Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base s User-Defined s
More informationigrid: a Relational Information Service A novel resource & service discovery approach
igrid: a Relational Information Service A novel resource & service discovery approach Italo Epicoco, Ph.D. University of Lecce, Italy Italo.epicoco@unile.it Outline of the talk Requirements & features
More informationIntegrating Legacy Authorization Systems into the Grid: A Case Study Leveraging AzMan and ADAM
Integrating Legacy Authorization Systems into the Grid: A Case Study Leveraging AzMan and ADAM Weide Zhang, David Del Vecchio, Glenn Wasson and Marty Humphrey Department of Computer Science, University
More informationThe Community Authorization Service: Status and Future
The Authorization Service: Status and Future L. Pearlman, C. Kesselman USC Information Sciences Institute, Marina del Rey, CA V. Welch, I. Foster, S. Tuecke Argonne National Laboratory, Argonne, IL Virtual
More informationpyglobus: A Python interface to the Globus Toolkit
Abstract pyglobus: A Python interface to the Globus Toolkit Keith R. Jackson Lawrence Berkeley National Laboratory Developing high-performance problem solving environments/applications that allow scientists
More informationAn Engineering Computation Oriented Visual Grid Framework
An Engineering Computation Oriented Visual Grid Framework Guiyi Wei 1,2,3, Yao Zheng 1,2, Jifa Zhang 1,2, and Guanghua Song 1,2 1 College of Computer Science, Zhejiang University, Hangzhou, 310027, P.
More informationDesign and Implementation of unified Identity Authentication System Based on LDAP in Digital Campus
Advanced Materials Research Online: 2014-04-09 ISSN: 1662-8985, Vols. 912-914, pp 1213-1217 doi:10.4028/www.scientific.net/amr.912-914.1213 2014 Trans Tech Publications, Switzerland Design and Implementation
More informationUsage of LDAP in Globus
Usage of LDAP in Globus Gregor von Laszewski and Ian Foster Mathematics and Computer Science Division Argonne National Laboratory, Argonne, IL 60439 gregor@mcs.anl.gov Abstract: This short note describes
More informationA Guanxi Shibboleth based Security Infrastructure for e-social Science
A Guanxi Shibboleth based Security Infrastructure for e-social Science Wei Jie 1 Alistair Young 2 Junaid Arshad 3 June Finch 1 Rob Procter 1 Andy Turner 3 1 University of Manchester, UK 2 UHI Millennium
More informationResearch on the Key Technologies of Geospatial Information Grid Service Workflow System
Research on the Key Technologies of Geospatial Information Grid Service Workflow System Lin Wan *, Zhong Xie, Liang Wu Faculty of Information Engineering China University of Geosciences Wuhan, China *
More informationWebFlow - High-Level Programming Environment and Visual Authoring Toolkit for High Performance Distributed Computing
WebFlow - High-Level Programming Environment and Visual Authoring Toolkit for High Performance Distributed Computing Erol Akarsu Northeast Parallel Architectures Center at Syracuse University Syracuse,
More informationA AAAA Model to Support Science Gateways with Community Accounts
A AAAA Model to Support Science Gateways with Community Accounts Von Welch 1, Jim Barlow, James Basney, Doru Marcusiu NCSA 1 Introduction Science gateways have emerged as a concept for allowing large numbers
More informationDatabase Assessment for PDMS
Database Assessment for PDMS Abhishek Gaurav, Nayden Markatchev, Philip Rizk and Rob Simmonds Grid Research Centre, University of Calgary. http://grid.ucalgary.ca 1 Introduction This document describes
More informationChapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.
Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies
More informationThe Earth System Grid: A Visualisation Solution. Gary Strand
The Earth System Grid: A Visualisation Solution Gary Strand Introduction Acknowledgments PI s Ian Foster (ANL) Don Middleton (NCAR) Dean Williams (LLNL) ESG Development Team Veronika Nefedova (ANL) Ann
More informationInca as Monitoring. Kavin Kumar Palanisamy Indiana University Bloomington
Inca as Monitoring Kavin Kumar Palanisamy Indiana University Bloomington Abstract Grids are built with multiple complex and interdependent systems to provide better resources. It is necessary that the
More informationAn Application of Genetic Algorithm for Auto-body Panel Die-design Case Library Based on Grid
An Application of Genetic Algorithm for Auto-body Panel Die-design Case Library Based on Grid Demin Wang 2, Hong Zhu 1, and Xin Liu 2 1 College of Computer Science and Technology, Jilin University, Changchun
More informationROCI 2: A Programming Platform for Distributed Robots based on Microsoft s.net Framework
ROCI 2: A Programming Platform for Distributed Robots based on Microsoft s.net Framework Vito Sabella, Camillo J. Taylor, Scott Currie GRASP Laboratory University of Pennsylvania Philadelphia PA, 19104
More informationBoundary control : Access Controls: An access control mechanism processes users request for resources in three steps: Identification:
Application control : Boundary control : Access Controls: These controls restrict use of computer system resources to authorized users, limit the actions authorized users can taker with these resources,
More informationAn authorization Framework for Grid Security using GT4
www.ijcsi.org 310 An authorization Framework for Grid Security using GT4 Debabrata Singh 1, Bhupendra Gupta 2,B.M.Acharya 3 4, Sarbeswar Hota S O A University, Bhubaneswar Abstract A Grid system is a Virtual
More informationA Federated Grid Environment with Replication Services
A Federated Grid Environment with Replication Services Vivek Khurana, Max Berger & Michael Sobolewski SORCER Research Group, Texas Tech University Grids can be classified as computational grids, access
More informationGrid Data Management in Action: Experience in Running and Supporting Data Management Services in the EU DataGrid Project
Grid Data Management in Action: Experience in Running and Supporting Data Management Services in the EU DataGrid Project Heinz Stockinger, Flavia Donno, Erwin Laure, Shahzad Muzaffar, Peter Kunszt CERN,
More informationIntroduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project
Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.
More informationLessons learned producing an OGSI compliant Reliable File Transfer Service
Lessons learned producing an OGSI compliant Reliable File Transfer Service William E. Allcock, Argonne National Laboratory Ravi Madduri, Argonne National Laboratory Introduction While GridFTP 1 has become
More informationA Multipolicy Authorization Framework for Grid Security
A Multipolicy Authorization Framework for Grid Security Bo Lang,,2 Ian Foster,,3 Frank Siebenlist,,3 Rachana Ananthakrishnan, Tim Freeman,3 Mathematics and Computer Science Division, Argonne National Laboratory,
More informationJuliusz Pukacki OGF25 - Grid technologies in e-health Catania, 2-6 March 2009
Grid Technologies for Cancer Research in the ACGT Project Juliusz Pukacki (pukacki@man.poznan.pl) OGF25 - Grid technologies in e-health Catania, 2-6 March 2009 Outline ACGT project ACGT architecture Layers
More informationA CORBA Commodity Grid Kit
A CORBA Commodity Grid Kit Snigdha Verma 2, Jarek Gawor 1, Gregor von Laszewski 1, and Manish Parashar 2 1 Mathematics and Computer Science Division Argonne National Laboratory, 9700 S. Cass Ave, Argonne,
More informationA Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme
A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme Yue Zhang 1 and Yunxia Pei 2 1 Department of Math and Computer Science Center of Network, Henan Police College, Zhengzhou,
More informationA Simulation Model for Large Scale Distributed Systems
A Simulation Model for Large Scale Distributed Systems Ciprian M. Dobre and Valentin Cristea Politechnica University ofbucharest, Romania, e-mail. **Politechnica University ofbucharest, Romania, e-mail.
More informationGrid Computing: Status and Perspectives. Alexander Reinefeld Florian Schintke. Outline MOTIVATION TWO TYPICAL APPLICATION DOMAINS
Grid Computing: Status and Perspectives Alexander Reinefeld Florian Schintke Schwerpunkte der Informatik" Ringvorlesung am 05.06.2003 1 Outline MOTIVATION o What s a Grid? Why using Grids? TWO TYPICAL
More informationData Management 1. Grid data management. Different sources of data. Sensors Analytic equipment Measurement tools and devices
Data Management 1 Grid data management Different sources of data Sensors Analytic equipment Measurement tools and devices Need to discover patterns in data to create information Need mechanisms to deal
More informationTERAGRID 2007 CONFERENCE, MADISON, WI 1. GridFTP Pipelining
TERAGRID 2007 CONFERENCE, MADISON, WI 1 GridFTP Pipelining John Bresnahan, 1,2,3 Michael Link, 1,2 Rajkumar Kettimuthu, 1,2 Dan Fraser, 1,2 Ian Foster 1,2,3 1 Mathematics and Computer Science Division
More informationResearch on the Interoperability Architecture of the Digital Library Grid
Research on the Interoperability Architecture of the Digital Library Grid HaoPan Department of information management, Beijing Institute of Petrochemical Technology, China, 102600 bjpanhao@163.com Abstract.
More informationThe Research and Design of the Application Domain Building Based on GridGIS
Journal of Geographic Information System, 2010, 2, 32-39 doi:10.4236/jgis.2010.21007 Published Online January 2010 (http://www.scirp.org/journal/jgis) The Research and Design of the Application Domain
More informationA RESOURCE MANAGEMENT FRAMEWORK FOR INTERACTIVE GRIDS
A RESOURCE MANAGEMENT FRAMEWORK FOR INTERACTIVE GRIDS Raj Kumar, Vanish Talwar, Sujoy Basu Hewlett-Packard Labs 1501 Page Mill Road, MS 1181 Palo Alto, CA 94304 USA { raj.kumar,vanish.talwar,sujoy.basu}@hp.com
More informationText mining on a grid environment
Data Mining X 13 Text mining on a grid environment V. G. Roncero, M. C. A. Costa & N. F. F. Ebecken COPPE/Federal University of Rio de Janeiro, Brazil Abstract The enormous amount of information stored
More informationGrid-Based Data Mining and the KNOWLEDGE GRID Framework
Grid-Based Data Mining and the KNOWLEDGE GRID Framework DOMENICO TALIA (joint work with M. Cannataro, A. Congiusta, P. Trunfio) DEIS University of Calabria ITALY talia@deis.unical.it Minneapolis, September
More informationThe Grid Authentication System for Mobile Grid Environment
IJSRD - International Journal for Scientific Research & Development Vol. 2, Issue 02, 2014 ISSN (online): 2321-0613 The Grid Authentication System for Mobile Grid Environment A.Sudha 1 S.M.Karpagavalli
More informationPersonal Grid Running at the Edge of Internet *
Personal Grid Running at the Edge of Internet * Bingchen Li 1, Wei Li 1, Zhiwei Xu 1 1 Institute of Computing Technology, Chinese Academy of Sciences, Beijing, 100080, China Email: {libingchen, liwei,
More informationThe glite File Transfer Service
The glite File Transfer Service Peter Kunszt Paolo Badino Ricardo Brito da Rocha James Casey Ákos Frohner Gavin McCance CERN, IT Department 1211 Geneva 23, Switzerland Abstract Transferring data reliably
More informationProgress in building the International Lattice Data Grid
Progress in building the International Lattice Data Grid Jefferson Lab, Newport News, VA 23606, USA E-mail: bjoo@jlab.org C.M. Maynard EPCC, School of Physics, Univeristy of Edinburgh, Edinburgh EH9 3JZ,
More informationA Resource Discovery Algorithm in Mobile Grid Computing based on IP-paging Scheme
A Resource Discovery Algorithm in Mobile Grid Computing based on IP-paging Scheme Yue Zhang, Yunxia Pei To cite this version: Yue Zhang, Yunxia Pei. A Resource Discovery Algorithm in Mobile Grid Computing
More informationAN INTRODUCTION TO THE GLOBUS TOOLKIT
AN INTRODUCTION TO THE GLOBUS TOOLKIT Giovanni Aloisio UNIVERSITY OF LECCE, Lecce, Italy Massimo Cafaro UNIVERSITY OF LECCE, Lecce, Italy Abstract The Globus toolkit is a grid middleware being developed
More informationThe Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data
The Integration of Grid Technology with OGC Web Services (OWS) in NWGISS for NASA EOS Data Liping Di, Aijun Chen, Wenli Yang and Peisheng Zhao achen6@gmu.edu; achen@laits.gmu.edu Lab for Advanced Information
More informationA resource broker with an efficient network information model on grid environments
J Supercomput (2007) 40: 249 267 DOI 10.1007/s11227-006-0025-0 A resource broker with an efficient network information model on grid environments Chao-Tung Yang Po-Chi Shih Cheng-Fang Lin Sung-Yi Chen
More informationMONITORING OF GRID RESOURCES
MONITORING OF GRID RESOURCES Nikhil Khandelwal School of Computer Engineering Nanyang Technological University Nanyang Avenue, Singapore 639798 e-mail:a8156178@ntu.edu.sg Lee Bu Sung School of Computer
More informationIntroduction to SRM. Riccardo Zappi 1
Introduction to SRM Grid Storage Resource Manager Riccardo Zappi 1 1 INFN-CNAF, National Center of INFN (National Institute for Nuclear Physic) for Research and Development into the field of Information
More informationA Novel Adaptive Proxy Certificates Management Scheme in Military Grid Environment*
A Novel Adaptive Proxy Certificates Management Scheme in Military Grid Environment* Ying Liu, Jingbo Xia, and Jing Dai Telecommunication Engineering Institute, Air Force Engineering University, Xi an,
More informationGrid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationGRAIL Grid Access and Instrumentation Tool
2007 German e-science Available online at http://www.ges2007.de This document is under the terms of the CC-BY-NC-ND Creative Commons Attribution GRAIL Grid Access and Instrumentation Tool T. Jejkal 1,
More informationIMAGE: An approach to building standards-based enterprise Grids
IMAGE: An approach to building standards-based enterprise Grids Gabriel Mateescu 1 and Masha Sosonkina 2 1 Research Computing Support Group 2 Scalable Computing Laboratory National Research Council USDOE
More informationGrids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan
Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security
More informationA 3-tier Grid Architecture and Interactive Applications Framework for Community Grids
A 3-tier Grid Architecture and Interactive Applications Framework for Community Grids Oscar Ardaiz, Kana Sanjeevan, and Ramon Sanguesa Polytecnic University of Catalunya Campus Nord, Barcelona 08034 Spain
More informationGridARM: Askalon s Grid Resource Management System
GridARM: Askalon s Grid Resource Management System Mumtaz Siddiqui and Thomas Fahringer Institute for Computer Science, University of Innsbruck, Technikerstrasse 13, A-6020 Innsbruck, Austria {Mumtaz.Siddiqui,
More informationCustomized way of Resource Discovery in a Campus Grid
51 Customized way of Resource Discovery in a Campus Grid Damandeep Kaur Society for Promotion of IT in Chandigarh (SPIC), Chandigarh Email: daman_811@yahoo.com Lokesh Shandil Email: lokesh_tiet@yahoo.co.in
More informationDesign The way components fit together
Introduction to Grid Architecture What is Architecture? Design The way components fit together 12-Mar-14 MCC/MIERSI Grid Computing 1 Introduction to Grid Architecture Why Discuss Architecture? Descriptive
More informationA Gentle Introduction to Globus Otto Sievert May 26, 1999 Parallel Computation, CSE160/CSE260, Spring 1999 Abstract As computers become better connect
A Gentle Introduction to Globus Otto Sievert May 26, 1999 Parallel Computation, CSE160/CSE260, Spring 1999 Abstract As computers become better connected across the globe, opportunities to create new programs
More informationVMware View Upgrade Guide
View 4.0 View Manager 4.0 View Composer 2.0 This document supports the version of each product listed and supports all subsequent versions until the document is replaced by a new edition. To check for
More informationCommunity Software Development with the Astrophysics Simulation Collaboratory
CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. 2001; volume (number): 000 000 Community Software Development with the Astrophysics Simulation Collaboratory 5
More informationManaging MPICH-G2 Jobs with WebCom-G
Managing MPICH-G2 Jobs with WebCom-G Padraig J. O Dowd, Adarsh Patil and John P. Morrison Computer Science Dept., University College Cork, Ireland {p.odowd, adarsh, j.morrison}@cs.ucc.ie Abstract This
More informationDataMining with Grid Computing Concepts
American Journal of Engineering Research (AJER) e-issn: 2320-0847 p-issn : 2320-0936 Volume-4, Issue-7, pp-256-260 www.ajer.org Research Paper DataMining with Grid Computing Concepts Open Access Mohammad
More information