The GAT Adapter to use GT4 RFT
|
|
- Michael Tyler
- 6 years ago
- Views:
Transcription
1 The GAT Adapter to use GT4 RFT Mehmet Balman, Santiago Pena, Theresa Xu CCT, Johnston Hall Louisiana State University, Baton Rouge, LA December 14, 2005 Introduction We designed a GAT [1] external adaptor for the Globus Toolkit 4 (GT4) [2] Reliable File (RFT) [3] service. This latest version of Globus differs from its predecessor in that is a web services based environment. RFT is a service that allows bytes streams to be transferred in a reliable manner handling failures in a more efficient and transparent way [4]. In this context, the RFT adaptor will isolate the GAT user from the changes introduced by GT4. General Description The GAT (Grid Application Toolkit) is a toolkit providing higher-level interfaces and services for Grid programmers [5]. The main objective is to provide a single API simplifying the underlying complex grid resources and middleware. The Reliable File service is intended to transfer files between two GridFTP servers [3,4,6]. It is built on GridFTP client libraries, and the main contribution is the failure recovery mechanism. The RFT service communicates with external clients via SOAP/XML, and provides a standard interface [3,4]. The RFT adapter being developed will enable users to easily manage data operations in their applications through the use of the GAT functions. Thus, users will be able to utilize key RFT services without the need to know any details about the RFT API. Functional Requirements RFT depends on the following Globus Toolkit components [4,6,7]: Java WS Core WS Authentication and Authorization Delegation Service Service Groups MDS useful RP And, the following 3rd party software: PostgreSQL 7.1 or later.
2 The API of the GAT is categorized in several subsystems and each one handles different features of the program [8,9]. Those subsystems are implemented via adaptors using the CPIs (Capability Provider Interface). Functions in a CPI set can be provided by different adaptors [8]. Table 1 shows the relationship between CPIs and adaptor types. The RFT adaptor is a file adaptor which has basic operations such as copy, move, delete, etc. The adaptor will be formed by the implementations of an existing set of GAT CPIs for GT4. In this way, the transition to web service architecture will be transparent to the users, since the function calls in their applications will remain unchanged. Among the features supported by the RFT adaptor we can mention [8]: Copy files reliable using RFT services Decide about parameters for file transfer. Optimization of data movement. Failure recovery. Table 1: Adaptor types * From Interface Requirements File Adaptor has the following CPI functions [9]: Copy(Location dest, CopyMode mode) Copy the file to the specified destination Move(Location dest, MoveMode mode) Move the file to the specified destination Delete() Delete the file GetLength() only for local files
3 Return the current size of the file - only for local files IsReadable() - only for local files Return, whether the file is readable - only for local files IsWritable() - only for local files Return, whether the file is readable only - for local files LastWriteTime() - only for local files Return the time of the last write access - only for local files Every CPI function has a corresponding function call in the adaptor implementation. GAT engine selects an adaptor according to the matching preferences; users can define requirements to use appropriate CPI implementation provided by a specific adaptor [8]. The GridFTP adaptor, which has already been developed in the GAT using Globus libraries, provides same CPI functions that RFT adaptor is intended to implement [1,9,10]. In order to implement an RFT program, following steps should be applied [7]; Contact Delegation Factory Service to get credential Construct a Request type object Contact RFT factory and create an RFT resource Call RFT service to start the transfer System Requirements In order to utilize the RFT adaptor, the GAT engine and other primary file adaptors should be installed and configured. RFT service needs to be installed with other basic Globus services such as authentication, authorization, etc. The GAT adaptor using GT4 RFT depends on the following services and toolkits. Globus Toolkit RFT service GAT Engine The adaptor will use the underlying RFT services for file transfer operation; thus, RFT should be running properly and the database that it uses should be configured to enable service calls which are storing Restart Remarks. This adaptor will be used for data transfer, especially input/output files, in a GAT application. Programmer will simply make use of CPI functions and the RFT adaptor will handle the redundant file transfer operation. Therefore, subsequent processes in the GAT program can safely manage jobs and other facilities. Architectural Design The GAT library adjusts parameters and optimizes middleware dependent components according to the current running environment via GAT adapters [1]. It has been developed by
4 GridLab [11] project, and different programming languages such as C, C++, Java, and Python are supported. The application is linked against the GAT engine in order to behave as a proxy for all interface calls [9]. A related GAT adapter is selected to bind the engine with the actual middleware service [8,9]. The lightweight adapters are the main part of the design supporting modularity. Figure 1: The GAT adaptor integration A database is utilized in GT4 RFT to store Restart Markers which are generated by the server in every 5 seconds to keep track of the transfer [3,4,6]. Moreover, Performance Markers are archived using the Netlogger in order to analyze transfer and make proper decision [3]. Thus, recovery of failures can be accomplished and transfer operation can restart from the point where it failed before [3,12]. Therefore, the RFT service is an enhanced utility for file operation in Globus 4.
5 Control GUI Direct Controls GUI Perf. Graph GUI Request Kill Adjust Parallelism Status Perf. Data Reliable FTP Service fork/exec Status FTP Client Perf. Data Netlogger Request Info. Restart Markers Database Figure 2: The General Architecture of Reliable File Service * From Implementation Details The implementation of the RFT adaptor began with a simple implementation of the python_file adaptor. The python_file adaptor is the one that provides basic file manipulation routines, such as copy, move, delete, etc. Also to test the python file, we wrote a small set of python applications that would make use of the python_adaptor to emulate the linux commands cp, mv and rm, among others. Once the python_adaptor was working, we started with the development of the python_rft_cl. The name is due to the fact that this adaptor is implemented making use of the command line tool provided by RFT. A first version of the adaptor was developed to show the basic functionality. For this version no classes were implemented and we just wrote the code corresponding to the Copy CPI to verify that the adaptor was working properly. After the success of the first version of our adaptor we decided to add more functionality and implement the remaining CPI s. To do so, we created two extra files containing two classes (rft_op and rft_url) that are used within the adaptor to format the user s input, set preferences and run the rft command among others. A scheme of the implementation is provided in the Figure 3.
6 Figure 3: Implementation details These two classes allowed us to include more functionality and intelligence to our adaptor, while keeping implementation details outside the adaptor s code. In this way, we achieve a cleaner, more understandable code that helps not only with debugging but also to facilitate future upgrades. In the way that RFT works, the user is expected to provide a configuration file, in which the source, the destination and other parameters are specified. In our case and to add compatibility with other file CPIs, we just take as input source and destination, and we provide the user the possibility of modifying a file.rft that should be located in his home directory. If not such file exists the adaptor will used default values for the transfer. Although not optimal, this solution allowed us to add flexibility for the user interface within the time constraints of the project. In addition the adaptor will recognize the given URL for source and destination, and will transform it to the proper format for RFT. Future Work Our implementation of this adaptor using the RFT command line should be extended to include the RFT web service interface directly. The biggest challenge with this approach is the fact that there is not a python API (only Java API) for RFT.
7 Another important issue is the fact that GAT is synchronous but RFT is used for asynchronous operations. Therefore, we can not make use of all the features provided by RFT within GAT. We are planning on implementing the RFT adaptor for SAGA, which supports asynchronous operations. Currently the user may set preferences for the transfer using the.rft file. In the future, we would like to enable the adaptor to receive preferences from the command line. References [1] Grid Application Toolkit. [Online]. Available: [2] The Globus Alliance. [Online]. Available: [3] Reliable File. [Online]. Available: [4] GT 4.0 Reliable File (RFT) Service. [Online]. Available: [5] Kelly Davis. Grid Application Toolkit User s Guide. [Online]. Available: [6] Multi RFT API. [Online]. Available: [7] GT 4.0 Reliable File (RFT) Service: Developer's Guide. [Online]. Available: [8] Kelly Davis et al. GAT API Specification: Object Based. [Online]. Available: ObjectBasedAPISpecification.pdf [9] Kelly Davis. GAT Adaptor Writer's Guide. [Online]. Available: [10] Globus Reference Manual / FTP clients operations. [Online]. Available: unix.globus.org/api/c-globus- 3.9.x/globus_ftp_client/html/group globus ftp client operations.html [11] GridLab: A Grid Application Toolkit and Testbed. [Online]. Available : [12] GT 4.0 RFT Public Interface Guide. [Online]. Available: Interfaces-apis
Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationGlobus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009
Globus Toolkit 4 Execution Management Alexandra Jimborean International School of Informatics Hagenberg, 2009 2 Agenda of the day Introduction to Globus Toolkit and GRAM Zoom In WS GRAM Usage Guide Architecture
More informationBy Ian Foster. Zhifeng Yun
By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance
More informationCloud Computing. Up until now
Cloud Computing Lecture 4 and 5 Grid: 2012-2013 Introduction. Up until now Definition of Cloud Computing. Grid Computing: Schedulers: Condor SGE 1 Summary Core Grid: Toolkit Condor-G Grid: Conceptual Architecture
More informationUNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus
UNIT IV PROGRAMMING MODEL Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus Globus: One of the most influential Grid middleware projects is the Globus
More informationGrid Computing Middleware. Definitions & functions Middleware components Globus glite
Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid
More informationDeliverable D8.9 - First release of DM services
GridLab - A Grid Application Toolkit and Testbed Deliverable D8.9 - First release of DM services Author(s): Document Filename: Work package: Partner(s): Lead Partner: Config ID: Document classification:
More informationGatlet - a Grid Portal Framework
Gatlet - a Grid Portal Framework Stefan Bozic stefan.bozic@kit.edu STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association
More informationGlobus GTK and Grid Services
Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature
More informationData Management 1. Grid data management. Different sources of data. Sensors Analytic equipment Measurement tools and devices
Data Management 1 Grid data management Different sources of data Sensors Analytic equipment Measurement tools and devices Need to discover patterns in data to create information Need mechanisms to deal
More informationGrid Services and the Globus Toolkit
Grid Services and the Globus Toolkit Lisa Childers childers@mcs.anl.gov The Globus Alliance Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved. This
More informationGrid portal solutions: a comparison of GridPortlets and OGCE
CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Published online 7 June 2007 in Wiley InterScience (www.interscience.wiley.com)..1112 Grid portal solutions: a comparison of GridPortlets and OGCE Chongjie
More informationGT-OGSA Grid Service Infrastructure
Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base s User-Defined s
More informationGROWL Scripts and Web Services
GROWL Scripts and Web Services Grid Technology Group E-Science Centre r.j.allan@dl.ac.uk GROWL Collaborative project (JISC VRE I programme) between CCLRC Daresbury Laboratory and the Universities of Cambridge
More informationGrid Middleware and Globus Toolkit Architecture
Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities
More informationIntroduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project
Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.
More informationA Simple Mass Storage System for the SRB Data Grid
A Simple Mass Storage System for the SRB Data Grid Michael Wan, Arcot Rajasekar, Reagan Moore, Phil Andrews San Diego Supercomputer Center SDSC/UCSD/NPACI Outline Motivations for implementing a Mass Storage
More informationDataFinder A Scientific Data Management Solution ABSTRACT
DataFinder A Scientific Data Management Solution Tobias Schlauch (1), Andreas Schreiber (2) (1) German Aerospace Center (DLR) Simulation and Software Technology Lilienthalplatz 7, D-38108 Braunschweig,
More informationHow to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework
How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework Piotr Dziubecki, Piotr Grabowski, Michał Krysiński, Tomasz Kuczyński, Dawid Szejnfeld, Dominik Tarnawczyk, Gosia Wolniewicz
More informationDatabase Assessment for PDMS
Database Assessment for PDMS Abhishek Gaurav, Nayden Markatchev, Philip Rizk and Rob Simmonds Grid Research Centre, University of Calgary. http://grid.ucalgary.ca 1 Introduction This document describes
More informationGridbus Portlets -- USER GUIDE -- GRIDBUS PORTLETS 1 1. GETTING STARTED 2 2. AUTHENTICATION 3 3. WORKING WITH PROJECTS 4
Gridbus Portlets -- USER GUIDE -- www.gridbus.org/broker GRIDBUS PORTLETS 1 1. GETTING STARTED 2 1.1. PREREQUISITES: 2 1.2. INSTALLATION: 2 2. AUTHENTICATION 3 3. WORKING WITH PROJECTS 4 3.1. CREATING
More informationGridSphere s Grid Portlets
COMPUTATIONAL METHODS IN SCIENCE AND TECHNOLOGY 12(1), 89-97 (2006) GridSphere s Grid Portlets Michael Russell 1, Jason Novotny 2, Oliver Wehrens 3 1 Max-Planck-Institut für Gravitationsphysik, Albert-Einstein-Institut,
More informationglite Grid Services Overview
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,
More informationGlobus Toolkit Manoj Soni SENG, CDAC. 20 th & 21 th Nov 2008 GGOA Workshop 08 Bangalore
Globus Toolkit 4.0.7 Manoj Soni SENG, CDAC 1 What is Globus Toolkit? The Globus Toolkit is an open source software toolkit used for building Grid systems and applications. It is being developed by the
More informationLayered Architecture
The Globus Toolkit : Introdution Dr Simon See Sun APSTC 09 June 2003 Jie Song, Grid Computing Specialist, Sun APSTC 2 Globus Toolkit TM An open source software toolkit addressing key technical problems
More informationigrid: a Relational Information Service A novel resource & service discovery approach
igrid: a Relational Information Service A novel resource & service discovery approach Italo Epicoco, Ph.D. University of Lecce, Italy Italo.epicoco@unile.it Outline of the talk Requirements & features
More informationJAVA COURSES. Empowering Innovation. DN InfoTech Pvt. Ltd. H-151, Sector 63, Noida, UP
2013 Empowering Innovation DN InfoTech Pvt. Ltd. H-151, Sector 63, Noida, UP contact@dninfotech.com www.dninfotech.com 1 JAVA 500: Core JAVA Java Programming Overview Applications Compiler Class Libraries
More informationGT 4.2.0: Community Scheduler Framework (CSF) System Administrator's Guide
GT 4.2.0: Community Scheduler Framework (CSF) System Administrator's Guide GT 4.2.0: Community Scheduler Framework (CSF) System Administrator's Guide Introduction This guide contains advanced configuration
More informationGrid Data Management
Grid Data Management Data Management Distributed community of users need to access and analyze large amounts of data Fusion community s International ITER project Requirement arises in both simulation
More informationGrid Computing Fall 2005 Lecture 10 and 12: Globus V2. Gabrielle Allen
Grid Computing 7700 Fall 2005 Lecture 10 and 12: Globus V2 Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen/ Globus 4 Primer Required Reading Coursework Essay: 4 pages Describe the
More informationScientific Computing with UNICORE
Scientific Computing with UNICORE Dirk Breuer, Dietmar Erwin Presented by Cristina Tugurlan Outline Introduction Grid Computing Concepts Unicore Arhitecture Unicore Capabilities Unicore Globus Interoperability
More informationA Replica Location Grid Service Implementation
A Replica Location Grid Service Implementation Mary Manohar, Ann Chervenak, Ben Clifford, Carl Kesselman Information Sciences Institute, University of Southern California Marina Del Rey, CA 90292 {mmanohar,
More informationCommunication System Design Projects
Communication System Design Projects KUNGLIGA TEKNISKA HÖGSKOLAN PROFESSOR: DEJAN KOSTIC TEACHING ASSISTANT: GEORGIOS KATSIKAS Traditional Vs. Modern Network Management What is Network Management (NM)?
More informationGrid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen
Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Concrete Example I have a source file Main.F on machine A, an
More informationUsing the MyProxy Online Credential Repository
Using the MyProxy Online Credential Repository Jim Basney National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu What is MyProxy? Independent Globus Toolkit add-on
More informationInca as Monitoring. Kavin Kumar Palanisamy Indiana University Bloomington
Inca as Monitoring Kavin Kumar Palanisamy Indiana University Bloomington Abstract Grids are built with multiple complex and interdependent systems to provide better resources. It is necessary that the
More informationTHE GLOBUS PROJECT. White Paper. GridFTP. Universal Data Transfer for the Grid
THE GLOBUS PROJECT White Paper GridFTP Universal Data Transfer for the Grid WHITE PAPER GridFTP Universal Data Transfer for the Grid September 5, 2000 Copyright 2000, The University of Chicago and The
More informationRegular Forum of Lreis. Speechmaker: Gao Ang
Regular Forum of Lreis Speechmaker: Gao Ang Content: A. Overview of Eclipse Project B. Rich Client Platform C. The progress of ustudio Project D. The development of Grid technology and Grid GIS E. Future
More informationAdvanced Photon Source Data Management. S. Veseli, N. Schwarz, C. Schmitz (SDM/XSD) R. Sersted, D. Wallis (IT/AES)
Advanced Photon Source Data Management S. Veseli, N. Schwarz, C. Schmitz (SDM/XSD) R. Sersted, D. Wallis (IT/AES) APS Data Management - Globus World 2018 Growing Beamline Data Needs X-ray detector capabilities
More informationGRAIL Grid Access and Instrumentation Tool
2007 German e-science Available online at http://www.ges2007.de This document is under the terms of the CC-BY-NC-ND Creative Commons Attribution GRAIL Grid Access and Instrumentation Tool T. Jejkal 1,
More informationSwinDeW-G (Swinburne Decentralised Workflow for Grid) System Architecture. Authors: SwinDeW-G Team Contact: {yyang,
SwinDeW-G (Swinburne Decentralised Workflow for Grid) System Architecture Authors: SwinDeW-G Team Contact: {yyang, jchen}@swin.edu.au Date: 05/08/08 1. Introduction SwinDeW-G is a scientific workflow management
More informationInstallation and Administration
Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base Services User-Defined
More informationData Movement and Storage. 04/07/09 1
Data Movement and Storage 04/07/09 www.cac.cornell.edu 1 Data Location, Storage, Sharing and Movement Four of the seven main challenges of Data Intensive Computing, according to SC06. (Other three: viewing,
More informationA Federated Grid Environment with Replication Services
A Federated Grid Environment with Replication Services Vivek Khurana, Max Berger & Michael Sobolewski SORCER Research Group, Texas Tech University Grids can be classified as computational grids, access
More informationCloud FastPath: Highly Secure Data Transfer
Cloud FastPath: Highly Secure Data Transfer Tervela helps companies move large volumes of sensitive data safely and securely over network distances great and small. Tervela has been creating high performance
More informationThe EU DataGrid Fabric Management
The EU DataGrid Fabric Management The European DataGrid Project Team http://www.eudatagrid.org DataGrid is a project funded by the European Union Grid Tutorial 4/3/2004 n 1 EDG Tutorial Overview Workload
More informationA Distributed Media Service System Based on Globus Data-Management Technologies1
A Distributed Media Service System Based on Globus Data-Management Technologies1 Xiang Yu, Shoubao Yang, and Yu Hong Dept. of Computer Science, University of Science and Technology of China, Hefei 230026,
More informationThe Grid Application Toolkit: Toward Generic and Easy Application Programming Interfaces for the Grid
The Grid Application Toolkit: Toward Generic and Easy Application Programming Interfaces for the Grid GABRIELLE ALLEN, KELLY DAVIS, TOM GOODALE, ANDREI HUTANU, HARTMUT KAISER, THILO KIELMANN, ANDRÉ MERZKY,
More informationArchitecture Proposal
Nordic Testbed for Wide Area Computing and Data Handling NORDUGRID-TECH-1 19/02/2002 Architecture Proposal M.Ellert, A.Konstantinov, B.Kónya, O.Smirnova, A.Wäänänen Introduction The document describes
More informationCOMPUTE CANADA GLOBUS PORTAL
COMPUTE CANADA GLOBUS PORTAL Fast, user-friendly data transfer and sharing Jason Hlady University of Saskatchewan WestGrid / Compute Canada February 4, 2015 Why Globus? I need to easily, quickly, and reliably
More informationIbis as Master Key. Niels Drost. Computer Systems Group Department of Computer Science VU University, Amsterdam, The Netherlands
Ibis as Master Key Niels Drost Computer Systems Group Department of Computer Science VU University, Amsterdam, The Netherlands Today s Program 10.00: Introduction 11.00: Ibis as Master Key 12.00: Lunch
More informationCSE 4/521 Introduction to Operating Systems. Lecture 29 Windows 7 (History, Design Principles, System Components, Programmer Interface) Summer 2018
CSE 4/521 Introduction to Operating Systems Lecture 29 Windows 7 (History, Design Principles, System Components, Programmer Interface) Summer 2018 Overview Objective: To explore the principles upon which
More informationIntroduction to Grid Technology
Introduction to Grid Technology B.Ramamurthy 1 Arthur C Clarke s Laws (two of many) Any sufficiently advanced technology is indistinguishable from magic." "The only way of discovering the limits of the
More informationDay 1 : August (Thursday) An overview of Globus Toolkit 2.4
An Overview of Grid Computing Workshop Day 1 : August 05 2004 (Thursday) An overview of Globus Toolkit 2.4 By CDAC Experts Contact :vcvrao@cdacindia.com; betatest@cdacindia.com URL : http://www.cs.umn.edu/~vcvrao
More informationJava Development and Grid Computing with the Globus Toolkit Version 3
Java Development and Grid Computing with the Globus Toolkit Version 3 Michael Brown IBM Linux Integration Center Austin, Texas Page 1 Session Introduction Who am I? mwbrown@us.ibm.com Team Leader for Americas
More informationI. Overview. General User Interface Development Flow
I. Overview Intellics DAMDesigner is an end to end solution for designing and implementing HMI middleware. It provides an accomplished set of mechanisms for seamless integration of HMI stacks to underlying
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationWHITE PAPER Cloud FastPath: A Highly Secure Data Transfer Solution
WHITE PAPER Cloud FastPath: A Highly Secure Data Transfer Solution Tervela helps companies move large volumes of sensitive data safely and securely over network distances great and small. We have been
More informationCyber Infrastructure for Coastal Modeling
Cyber Infrastructure for Coastal Modeling Chirag Dekate Department of Computer Science Louisiana State University Report submitted to the Faculty of the Louisiana State University in partial fulfillment
More informationAgent Teamwork Research Assistant. Progress Report. Prepared by Solomon Lane
Agent Teamwork Research Assistant Progress Report Prepared by Solomon Lane December 2006 Introduction... 3 Environment Overview... 3 Globus Grid...3 PBS Clusters... 3 Grid/Cluster Integration... 4 MPICH-G2...
More informationKnowledge Discovery Services and Tools on Grids
Knowledge Discovery Services and Tools on Grids DOMENICO TALIA DEIS University of Calabria ITALY talia@deis.unical.it Symposium ISMIS 2003, Maebashi City, Japan, Oct. 29, 2003 OUTLINE Introduction Grid
More informationS.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing.
VALLIAMMAI ENGNIEERING COLLEGE SRM Nagar, Kattankulathur 603203. DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Year & Semester : IV & VII Section : CSE -1& 2 Subject Code : CS6703 Subject Name : Grid
More informationIntroduction. Kelly Davis. MPI-AEI. Author s name
Introduction Kelly Davis kdavis@aei.mpg.de MPI-AEI Table of Contents Introduction Why GAT? Installation Hello Cruel World GAT Object Model File Management FileStream Management LogicalFile Management Advert
More informationSHORT NOTES / INTEGRATION AND MESSAGING
SHORT NOTES / INTEGRATION AND MESSAGING 1. INTEGRATION and MESSAGING is related to HOW to SEND data to and receive from ANOTHER SYSTEM or APPLICATION 2. A WEB SERVICE is a piece of software designed to
More informationGrid Architectural Models
Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers
More informationScheduling Interactive Tasks in the Grid-based Systems
Scheduling Interactive Tasks in the Grid-based Systems Marcin Oko ń, Marcin Lawenda, Norbert Meyer, Dominik Stokłosa, Tomasz Rajtar, Damian Kaliszan, Maciej Stroi ń ski Pozna ń Supercomputing and Networking
More informationGrid-enabled Probabilistic Model Checking with PRISM
Grid-enabled Probabilistic Model Checking with PRISM Yi Zhang, David Parker, Marta Kwiatkowska University of Birmingham, Edgbaston, Birmingham, B15 2TT, UK Email: {yxz, dxp, mzk}@cs.bham.ac.uk Abstract
More informationTask Management Service
UMEÅ UNIVERSITY Department of Author:, Contents 1 Abstract 1 2 About this document 1 3 Introduction 2 4 Overview 2 5 Use cases 3 5.1 The TMS point of view....................... 3 5.2 The users / clients
More informationNAREGI Middleware Mediator
Administrator's Guide NAREGI Middleware Mediator October, 2008 National Institute of Informatics Documents List Administrator s Guide Group Administrator s Guide, NAREGI Middleware IS(Distributed Information
More informationLessons learned producing an OGSI compliant Reliable File Transfer Service
Lessons learned producing an OGSI compliant Reliable File Transfer Service William E. Allcock, Argonne National Laboratory Ravi Madduri, Argonne National Laboratory Introduction While GridFTP 1 has become
More informationIntroduction to GT3. Overview. Installation Pre-requisites GT3.2. Overview of Installing GT3
Introduction to GT3 Background The Grid Problem The Globus Approach OGSA & OGSI Globus Toolkit GT3 Architecture and Functionality: The Latest Refinement of the Globus Toolkit Core Base Services User-Defined
More informationEduardo
Eduardo Silva @edsiper eduardo@treasure-data.com About Me Eduardo Silva Github & Twitter Personal Blog @edsiper http://edsiper.linuxchile.cl Treasure Data Open Source Engineer Fluentd / Fluent Bit http://github.com/fluent
More informationBootstrapping a (New?) LHC Data Transfer Ecosystem
Bootstrapping a (New?) LHC Data Transfer Ecosystem Brian Paul Bockelman, Andy Hanushevsky, Oliver Keeble, Mario Lassnig, Paul Millar, Derek Weitzel, Wei Yang Why am I here? The announcement in mid-2017
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationGlobus Toolkit Firewall Requirements. Abstract
Globus Toolkit Firewall Requirements v0.3 8/30/2002 Von Welch Software Architect, Globus Project welch@mcs.anl.gov Abstract This document provides requirements and guidance to firewall administrators at
More informationHDFS Access Options, Applications
Hadoop Distributed File System (HDFS) access, APIs, applications HDFS Access Options, Applications Able to access/use HDFS via command line Know about available application programming interfaces Example
More informationChapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.
Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies
More informationIntegrating SGE and Globus in a Heterogeneous HPC Environment
Integrating SGE and Globus in a Heterogeneous HPC Environment David McBride London e-science Centre, Department of Computing, Imperial College Presentation Outline Overview of Centre
More informationOutline 18/12/2014. Accessing GROMACS on a Science Gateway. GROMACS in a nutshell. GROMACS users in India. GROMACS on GARUDA
Outline Co-ordination & Harmonisation of Advanced e-infrastructures for Research and Education Data Sharing Accessing GROMACS on a Dr. Giuseppe La Rocca, INFN Catania 6 th CHAIN-REDS Workshop, Guwahati
More informationData transfer at CINECA: how to enjoy it!
Data transfer at CINECA: how to enjoy it! Giacomo Mariani g.mariani@cineca.it Bologna 03/05/2011 www.cineca.it Table of contents Resources What we have Use Case What users need Tools How we support them
More informationDesign The way components fit together
Introduction to Grid Architecture What is Architecture? Design The way components fit together 12-Mar-14 MCC/MIERSI Grid Computing 1 Introduction to Grid Architecture Why Discuss Architecture? Descriptive
More informationOpal: Wrapping Scientific Applications as Web Services
Opal: Wrapping Scientific Applications as Web Services Sriram Krishnan*, Brent Stearn, Karan Bhatia, Kim Baldridge, Wilfred Li, Peter Arzberger *sriram@sdsc.edu Motivation Enable access to scientific applications
More informationMitigating Risk of Data Loss in Preservation Environments
Storage Resource Broker Mitigating Risk of Data Loss in Preservation Environments Reagan W. Moore San Diego Supercomputer Center Joseph JaJa University of Maryland Robert Chadduck National Archives and
More informationOne Platform Kit: The Power to Innovate
White Paper One Platform Kit: The Power to Innovate What Could You Do with the Power of the Network? What if you could: Reach into your network and extract the information you need, when you need it? Directly
More informationg-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.
g-eclipse A Framework for Accessing Grid Infrastructures Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.cy) EGEE Training the Trainers May 6 th, 2009 Outline Grid Reality The Problem g-eclipse
More informationWSRF Services for Composing Distributed Data Mining Applications on Grids: Functionality and Performance
WSRF Services for Composing Distributed Data Mining Applications on Grids: Functionality and Performance Domenico Talia, Paolo Trunfio, and Oreste Verta DEIS, University of Calabria Via P. Bucci 41c, 87036
More informationWindows 7 Overview. Windows 7. Objectives. The History of Windows. CS140M Fall Lake 1
Windows 7 Overview Windows 7 Overview By Al Lake History Design Principles System Components Environmental Subsystems File system Networking Programmer Interface Lake 2 Objectives To explore the principles
More informationUser Space Device Drivers Introduction and Implementation using VGAlib library
User Space Device Drivers Introduction and Implementation using VGAlib library Prabhat K. Saraswat Btech 6th Semester Information and Communication Technology Dhirubhai Ambani Institute of Information
More informationEnterpriseLink and LDAP
Case Requirement A client has an EnterpriseLink application and wishes to utilize their Linux LDAP server to validate Users against, then use the EnterpriseLink feature of pooled logons to the mainframe.
More informationGrid Scheduling Architectures with Globus
Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents
More informationMicro Focus Security ArcSight Connectors. SmartConnector for McAfee Gateway Syslog. Configuration Guide
Micro Focus Security ArcSight Connectors SmartConnector for McAfee Email Gateway Syslog Configuration Guide June, 2018 Configuration Guide SmartConnector for McAfee Email Gateway Syslog June, 2018 Copyright
More informationAn Experience in Accessing Grid Computing from Mobile Device with GridLab Mobile Services
An Experience in Accessing Grid Computing from Mobile Device with GridLab Mobile Services Riri Fitri Sari, Rene Paulus Department of Electrical Engineering, Faculty of Engineering University of Indonesia
More informationThe Slide does not contain all the information and cannot be treated as a study material for Operating System. Please refer the text book for exams.
The Slide does not contain all the information and cannot be treated as a study material for Operating System. Please refer the text book for exams. Operating System Services User Operating System Interface
More informationHortonworks Technical Preview for Apache Falcon
Architecting the Future of Big Data Hortonworks Technical Preview for Apache Falcon Released: 11/20/2013 Architecting the Future of Big Data 2013 Hortonworks Inc. All Rights Reserved. Welcome to Hortonworks
More informationAn Architecture For Computational Grids Based On Proxy Servers
An Architecture For Computational Grids Based On Proxy Servers P. V. C. Costa, S. D. Zorzo, H. C. Guardia {paulocosta,zorzo,helio}@dc.ufscar.br UFSCar Federal University of São Carlos, Brazil Abstract
More informationDesign of Distributed Data Mining Applications on the KNOWLEDGE GRID
Design of Distributed Data Mining Applications on the KNOWLEDGE GRID Mario Cannataro ICAR-CNR cannataro@acm.org Domenico Talia DEIS University of Calabria talia@deis.unical.it Paolo Trunfio DEIS University
More informationGridNEWS: A distributed Grid platform for efficient storage, annotating, indexing and searching of large audiovisual news content
1st HellasGrid User Forum 10-11/1/2008 GridNEWS: A distributed Grid platform for efficient storage, annotating, indexing and searching of large audiovisual news content Ioannis Konstantinou School of ECE
More informationDELL EMC DATA DOMAIN ENCRYPTION
WHITEPAPER DELL EMC DATA DOMAIN ENCRYPTION A Detailed Review ABSTRACT The proliferation of publicized data loss, coupled with new governance and compliance regulations, is driving the need for customers
More informationGrid Computing with Voyager
Grid Computing with Voyager By Saikumar Dubugunta Recursion Software, Inc. September 28, 2005 TABLE OF CONTENTS Introduction... 1 Using Voyager for Grid Computing... 2 Voyager Core Components... 3 Code
More informationModule 3: Operating-System Structures. Common System Components
Module 3: Operating-System Structures System Components Operating System Services System Calls System Programs System Structure Virtual Machines System Design and Implementation System Generation 3.1 Common
More information