Problems for Resource Brokering in Large and Dynamic Grid Environments
|
|
- Augustine Morgan
- 6 years ago
- Views:
Transcription
1 Problems for Resource Brokering in Large and Dynamic Grid Environments Cătălin L. Dumitrescu Computer Science Department The University of Chicago (currently at TU Delft) Kindly presented by Ana Lucia Varbanescu (TU Delft)
2 Introduction Grids provide a means for harnessing the computational and storage power of widely distributed collections of resources Resources are provided under agreements that appear and vanish with a high frequency due to the environment's scale We distinguish between two types of participating entities: Providers: want to express uslas about resource availabilities Consumers: want to interpret uslas published by providers Usage Service Level Agreements (uslas): sharing rules about how a resource is used after access was granted C. Dumitrescu, M. Wilde, I. Foster, A Model for Usage Policy based Resource Sharing in VOs, Policy Workshop 2005, Stockholm, Sweden
3 What Is Grid Brokering? Resources in Grids are characterized by: independence from global control support for attribute based search availability governed by various local uslas Grid Brokering: (a) the automated discovery and negotiation of usage agreements based on the resource attributes and local uslas (b) the identification of the extended execution environment based on a Grid scheduler Our focus: the identification of requirements to support usla expression, publication, discovery, interpretation, enforcement, and verification provisioning the design ingredients for building a scalable distributed brokering service
4 Presentation Overview Introduction / What is Grid Brokering? An Overview of the Brokering Key Requirements Environment Examples The Three Requirements Illustration in a Concrete Case Some Background DI GRUBER Framework Enhanced DI GRUBER Description Performance Results Metrics Accuracy with Brokering Network Mesh Connectivity DP Scheduling Comparison with a P2P solution Conclusions
5 Environment Examples Open Science Grid (OSG, previously known as Grid3): multi VO environment that sustains production level services comprises more than 30 sites and 4500 CPUs, over 1300 simultaneous jobs and more than 2 TB/day aggregate data traffic participating sites are the main resource providers under various uslas LHC Computing Project (LCG): data storage and analysis infrastructure for the entire high energy physics community that will use the LHC (Large Hadron Collider) >100,000 CPUs required for data processing >5000 scientists in approx 500 research institutes worldwide focuses on developing and deploying computing services based on a Grid model requires the management of acquisition, installation, and capacity planning for a large number of commodity hardware components
6 Identified Brokering Requirements Support for brokering of dynamic and numerous resources Adequate accuracy independent of the infrastructure Fault tolerance
7 Dynamic and numerous resources Communities, providers and VOs might join a Grid environment for short time intervals (days to weeks) to quickly solve problems When the environment is large (> 1k providers and 10k consumers), changes may occur every hour Thus, rapid propagation is required for information about available resources new administrative policies about how resources are available The brokering infrastructure must be: distributed and not rely on a single decision point (DP) scalable, due to the size of the environment
8 Adequate Accuracy For a distributed infrastructure, several operations have to be considered, such as propagation, reconciliation and removal These operations may occur whenever new decisions are performed and new resources join or leave the environment The entire brokering infrastructure must become aware of these changes in a timely fashion manner
9 Fault Tolerance A client expects to perform scheduling operations over the Grid even when some failures occur When many clients perform queries, the brokering infrastructure must be able to cope adequately with the increased request load The employment of an adequate fault tolerance strategy is important to the client
10 Presentation Overview Introduction / What is Grid Brokering? An Overview of the Brokering Key Requirements Environment Examples The Three Requirements Illustration in a Concrete Case Some Background DI GRUBER Framework Enhanced DI GRUBER Description Performance Results Metrics Accuracy with Brokering Network Mesh Connectivity DP Scheduling Comparison with a P2P solution Conclusions
11 Illustration Settings What brokers? GRUBER and DI GRUBER grid brokers Where? Planet Lab nodes What size? Brokering testing for a grid 10x bigger than today s OSG/Grid3
12 GRUBER A Bit of History Started in Grid3 context as a monitoring tool Evolved in a site recommendation engine Later got enhanced with capabilities for: Enforcement components (Queue Managers) Complex uslas and specification interfaces Distributed capabilities (the start of DI GRUBER)
13 GRUBER: A Grid Broker Implements the brokering functionalities required for steering workloads in a distributed environment based on uslas Implemented as a Grid Web Service using Globus technology Does not perform job submission by itself, but can be used in conjunction with various grid job submission infrastructures Interfaced with Euryale and Pegasus (largely used on OSG/Grid3) for job execution C. Dumitrescu, I. Foster, GRUBER: A Grid Resource usla-based Broker, Euro-Par 2005, Lisboa, Portugal
14 GRUBER in a Nutshell C. Dumitrescu, I. Foster, GRUBER: A Grid Resource usla-based Broker, Euro-Par 2005, Lisboa, Portugal
15 DI GRUBER Framework A single usla management decision point providing brokering decisions over hundreds/thousands of jobs and sites => bottleneck Distributed GRUBER (DI GRUBER): extends GRUBER with support for distributed brokering provides a scalable management service with the same functionalities as GRUBER but in a distributed approach allows multiple decision points to coexist and cooperate in real time implemented as a two layer resource brokering service C. Dumitrescu, I. Raicu, I. Foster, DI-GRUBER: A Distributed Brokering Infrastructure, Super-Computing 2006, Seattle, USA
16 DI GRUBER Operational Mode Decision points (DPs / PEPs) are responsible for executing uslas: gather monitoring metrics and other information relevant to their operations use this information to steer resource allocations as specified by the uslas Two types of PEPs: Site PEPs VO PEPs C. Dumitrescu, I. Raicu, I. Foster, DI-GRUBER: A Distributed Brokering Infrastructure, Super-Computing 2006, Seattle, USA
17 DI GRUBER Novelty Capable to handle: Sites with RMs & VOs Multiple submission hosts based on GTx technology Model usage allocations (uslas) at several levels Large grids with many resources and users Dynamic VO bootstrap Capacity to: Collect monitoring metrics from a grid Make various decisions based on this information Enforce complex uslas by various means
18 DI GRUBER Enhancements Transparent Decision Point (DP) Bootstrapping: DPs register with WS Index Service at startup and unregister when leave Transparent Client Scheduling: DPs and clients use the registry to discover the infrastructure clients are scheduled to DPs based on a least used (LU) strategy whenever a DP stops responding, its clients are re scheduled Failure Handling: based on a fault signaling mechanism: every time a client fails to communicate with a DP, it sends a request fault based on faults and a specific policy new DP are started (WS GRAM invocation)
19 Presentation Overview Introduction / What is Grid Brokering? An Overview of the Brokering Key Requirements Environment Examples The Three Requirements Illustration in a Concrete Case Some Background DI GRUBER Framework Enhanced DI GRUBER Description Performance Results Metrics Accuracy with Brokering Network Mesh Connectivity DP Scheduling Comparison with a P2P solution Conclusions
20 Metrics for Performance Analysis Response (RTi = individual response for job i; N = number of jobs): Response = Σ i=1..n RT i / N Throughput: defined as the number of requests completed successfully by the service per time unit (second) Accuracy (SAi = ratio of free resources at the selected site for the job i to total free resources in the grid): Accuracy = Σ i=1..n (SA i ) / N
21 Experimental Settings Emulated environment: 300 sites, approx 40,000 nodes (a grid 10 x today s OSG/Grid3) based on OSG/Grid3 configuration in terms of CPU counts and network connectivity 120 submission hosts Synthetic workloads in which jobs are: arriving with a rate of 1 job/s at each submission host submitted by a submission host to a site, but queued or held running at a site and completed Composite workloads that overlay work for 60VOs, 10 groups/vo A submission hosts maintains connection with a DP, selected w/ a given policy (LU / random) The experiment duration is 3600s (1 hour)
22 Accuracy vs. Mesh Connectivity DP connectivity: 100% connectivity 50% connectivity 25% connectivity Accuracy drops linearly with connectivity degree of each DP Utilization is low because jobs do not start all in the beginning Table. DI GRUBER Accuracy Performance with Mesh Connectivity Connectivity Util Accuracy All 35% 75% One half 27% 62% One fourth 20% 55% Requests Handled by GRUBER Total Request All 41% 68% One half 30% 60% One fourth 21% 50%
23 Throughput (random vs. LU) Throughput (run10) Throughput (run3) Throughput (queries / sec Throughput (10DP) Throughput (3DP) Throughput (1DP) Throughput (queries / sec) Load (# of concurent clients)
24 Response (random vs. LU) Response Time (sec) Response Time (1DP) Response Time (3DP) Response Time (10DP) Response Time (se Response Time (run3) Response Time (run10) Load (# of concurent clients)
25 DP Scheduling and Gains On average, we find: modest improvements for 3 decision points (19% higher throughput and 8% lower response time) significant improvements for 10 decision points (68% higher throughput and 70% lower response times).
26 Comparison with a P2P System PAST free distributed lookup service (based on PASTRY) Response: 90% smaller compared to the 3 DP DI GRUBER 50% smaller compared to the 10 DP DI GRUBER P2P has higher variance in the beginning (the stabilization of the P2P network) Throughput: 7 times higher compared to the 3 DP DI GRUBER Only 1.6 times higher compared to the 10 DP DI GRUBER The message lost rate for P2P network is much higher compared with the DI GRUBER's one
27 Conclusions What are the key requirements an already existing management infrastructure should meet in order to support large and dynamic Grid environments? Our experimental results show in a concrete case the importance of this question: the brokering accuracy decreases almost linearly with the loss of connectivity for a single decision point instance the performance of the system almost doubles in the 10 decision points case due to the better repartition of the clients
28 Summary We have identified three essential requirements a brokering infrastructure must meet when deployed in large and dynamic Grids We have analysed their feasibility and performance improvements in two novel metrics for DI GRUBER: brokering accuracy as a function of infrastructure components connectivity performance gains when using automated decision point scheduling for the clients We have compared the performance of this brokering solution with a P2P based system for file management
29 Acknowledgements Ian Foster Michael Wilde Jens S. Vöckler Yong Zhao Ioan Raicu Luiz Meyer ivdgl / GriPhyN Teams
30 The end Thank you for your attention! For more in depth details, I (the speaker) recommend: Read the paper (that s what I did ) Ask me I will try to answer I will FWD your questions to Mr. Dumitrescu Skip the speaker, send an e mail: c.l.dumitrescu@tudelft.nl
Problems for Resource Brokering in Large and Dynamic Grid Environments*
Problems for Resource Brokering in Large and Dynamic Grid Environments* Catalin L. Dumitrescu CoreGRID Institute on Resource Management and Scheduling Electrical Eng., Math. and Computer Science, Delft
More informationExtending a Distributed Usage SLA Resource Broker to Support Dynamic Grid Environments
Extending a Distributed Usage SLA Resource Broker to Support Dynamic Grid Environments Catalin L. Dumitrescu *, Ioan Raicu *, Ian Foster *+ *Computer Science Department +Mathematics and Computer Science
More informationDiPerF: automated DIstributed PERformance testing Framework
DiPerF: automated DIstributed PERformance testing Framework Catalin Dumitrescu, Ioan Raicu, Matei Ripeanu, Ian Foster Distributed Systems Laboratory Computer Science Department University of Chicago Introduction
More informationDiPerF: automated DIstributed PERformance testing Framework
DiPerF: automated DIstributed PERformance testing Framework Ioan Raicu, Catalin Dumitrescu, Matei Ripeanu, Ian Foster Distributed Systems Laboratory Computer Science Department University of Chicago Introduction
More informationVIRTUAL DOMAIN SHARING IN E-SCIENCE BASED ON USAGE SERVICE LEVEL AGREEMENTS
VIRTUAL DOMAIN SHARING IN E-SCIENCE BASED ON USAGE SERVICE LEVEL AGREEMENTS Cǎtǎlin L. Dumitrescu CoreGRID Institute on Programming Models Mathematics and Computer Science Department, The University of
More informationHigh Performance Computing Course Notes Grid Computing I
High Performance Computing Course Notes 2008-2009 2009 Grid Computing I Resource Demands Even as computer power, data storage, and communication continue to improve exponentially, resource capacities are
More informationThe Design, Usage, and Performance of GRUBER: A Grid Usage Service Level Agreement based BrokERing Infrastructure
J Grid Computing DOI 10.1007/s10723-006-9060-6 The Design, Usage, and Performance of GRUBER: A Grid Usage Service Level Agreement based BrokERing Infrastructure Catalin L. Dumitrescu Ioan Raicu Ian Foster
More information30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
More informationGrid Architectural Models
Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers
More informationA Data Diffusion Approach to Large Scale Scientific Exploration
A Data Diffusion Approach to Large Scale Scientific Exploration Ioan Raicu Distributed Systems Laboratory Computer Science Department University of Chicago Joint work with: Yong Zhao: Microsoft Ian Foster:
More informationAssignment 5. Georgia Koloniari
Assignment 5 Georgia Koloniari 2. "Peer-to-Peer Computing" 1. What is the definition of a p2p system given by the authors in sec 1? Compare it with at least one of the definitions surveyed in the last
More informationA Performance Evaluation of WS-MDS in the Globus Toolkit
A Performance Evaluation of WS-MDS in the Globus Toolkit Ioan Raicu * Catalin Dumitrescu * Ian Foster +* * Computer Science Department The University of Chicago {iraicu,cldumitr}@cs.uchicago.edu Abstract
More informationStorage and Compute Resource Management via DYRE, 3DcacheGrid, and CompuStore Ioan Raicu, Ian Foster
Storage and Compute Resource Management via DYRE, 3DcacheGrid, and CompuStore Ioan Raicu, Ian Foster. Overview Both the industry and academia have an increase demand for good policies and mechanisms to
More informationGrids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan
Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security
More informationThis research work is carried out under the FP6 Network of Excellence CoreGRID
TOWARDS SERVMARK AN ARCHITECTURE FOR TESTING GRIDS M. Andreica and N. Tǎpus Polytechnic University of Bucharest and A. Iosup and D.H.J. Epema Delft Technical University and C.L. Dumitrescu University of
More informationGrid Computing Systems: A Survey and Taxonomy
Grid Computing Systems: A Survey and Taxonomy Material for this lecture from: A Survey and Taxonomy of Resource Management Systems for Grid Computing Systems, K. Krauter, R. Buyya, M. Maheswaran, CS Technical
More informationMaking Gnutella-like P2P Systems Scalable
Making Gnutella-like P2P Systems Scalable Y. Chawathe, S. Ratnasamy, L. Breslau, N. Lanham, S. Shenker Presented by: Herman Li Mar 2, 2005 Outline What are peer-to-peer (P2P) systems? Early P2P systems
More informationBUILDING A SCALABLE MOBILE GAME BACKEND IN ELIXIR. Petri Kero CTO / Ministry of Games
BUILDING A SCALABLE MOBILE GAME BACKEND IN ELIXIR Petri Kero CTO / Ministry of Games MOBILE GAME BACKEND CHALLENGES Lots of concurrent users Complex interactions between players Persistent world with frequent
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationCoherence & WebLogic Server integration with Coherence (Active Cache)
WebLogic Innovation Seminar Coherence & WebLogic Server integration with Coherence (Active Cache) Duško Vukmanović FMW Principal Sales Consultant Agenda Coherence Overview WebLogic
More informationStorage and Compute Resource Management via DYRE, 3DcacheGrid, and CompuStore
Storage and Compute Resource Management via DYRE, 3DcacheGrid, and CompuStore Ioan Raicu Distributed Systems Laboratory Computer Science Department University of Chicago DSL Seminar November st, 006 Analysis
More informationAn agent-based peer-to-peer grid computing architecture
University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2005 An agent-based peer-to-peer grid computing architecture J. Tang University
More informationThe Problem of Grid Scheduling
Grid Scheduling The Problem of Grid Scheduling Decentralised ownership No one controls the grid Heterogeneous composition Difficult to guarantee execution environments Dynamic availability of resources
More informationManaging and Executing Loosely-Coupled Large-Scale Applications on Clusters, Grids, and Supercomputers
Managing and Executing Loosely-Coupled Large-Scale Applications on Clusters, Grids, and Supercomputers Ioan Raicu Distributed Systems Laboratory Computer Science Department University of Chicago Collaborators:
More informationMOHA: Many-Task Computing Framework on Hadoop
Apache: Big Data North America 2017 @ Miami MOHA: Many-Task Computing Framework on Hadoop Soonwook Hwang Korea Institute of Science and Technology Information May 18, 2017 Table of Contents Introduction
More informationCHAPTER 3 GRID MONITORING AND RESOURCE SELECTION
31 CHAPTER 3 GRID MONITORING AND RESOURCE SELECTION This chapter introduces the Grid monitoring with resource metrics and network metrics. This chapter also discusses various network monitoring tools and
More informationA LAYERED FRAMEWORK FOR CONNECTING CLIENT OBJECTIVES AND RESOURCE CAPABILITIES
A LAYERED FRAMEWORK FOR CONNECTING CLIENT OBJECTIVES AND RESOURCE CAPABILITIES ASIT DAN IBM T.J. Watson Research Center, 19 Skyline Drive, Hawthorne, NY 10532, US, asit@us.ibm.com CATALIN L. DUMITRESCU
More informationFunctional Requirements for Grid Oriented Optical Networks
Functional Requirements for Grid Oriented Optical s Luca Valcarenghi Internal Workshop 4 on Photonic s and Technologies Scuola Superiore Sant Anna Pisa June 3-4, 2003 1 Motivations Grid networking connection
More informationIEPSAS-Kosice: experiences in running LCG site
IEPSAS-Kosice: experiences in running LCG site Marian Babik 1, Dusan Bruncko 2, Tomas Daranyi 1, Ladislav Hluchy 1 and Pavol Strizenec 2 1 Department of Parallel and Distributed Computing, Institute of
More informationExecuting Evaluations over Semantic Technologies using the SEALS Platform
Executing Evaluations over Semantic Technologies using the SEALS Platform Miguel Esteban-Gutiérrez, Raúl García-Castro, Asunción Gómez-Pérez Ontology Engineering Group, Departamento de Inteligencia Artificial.
More informationGrid Middleware and Globus Toolkit Architecture
Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities
More informationIoan Raicu Distributed Systems Laboratory Computer Science Department University of Chicago
Running 1 Million Jobs in 10 Minutes via the Falkon Fast and Light-weight Ioan Raicu Distributed Systems Laboratory Computer Science Department University of Chicago In Collaboration with: Ian Foster,
More informationHarnessing Grid Resources to Enable the Dynamic Analysis of Large Astronomy Datasets
Page 1 of 5 1 Year 1 Proposal Harnessing Grid Resources to Enable the Dynamic Analysis of Large Astronomy Datasets Year 1 Progress Report & Year 2 Proposal In order to setup the context for this progress
More informationEarly Measurements of a Cluster-based Architecture for P2P Systems
Early Measurements of a Cluster-based Architecture for P2P Systems Balachander Krishnamurthy, Jia Wang, Yinglian Xie I. INTRODUCTION Peer-to-peer applications such as Napster [4], Freenet [1], and Gnutella
More informationQuality of Service Aspects and Metrics in Grid Computing
Quality of Service Aspects and Metrics in Grid Computing Daniel A. Menascé Dept. of Computer Science George Mason University Fairfax, VA menasce@cs.gmu.edu Emiliano Casalicchio Dipt. InformaticaSistemi
More informationISTITUTO NAZIONALE DI FISICA NUCLEARE
ISTITUTO NAZIONALE DI FISICA NUCLEARE Sezione di Perugia INFN/TC-05/10 July 4, 2005 DESIGN, IMPLEMENTATION AND CONFIGURATION OF A GRID SITE WITH A PRIVATE NETWORK ARCHITECTURE Leonello Servoli 1,2!, Mirko
More informationUNICORE Globus: Interoperability of Grid Infrastructures
UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057
More informationGrid Scheduling Architectures with Globus
Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents
More informationIntroduction to Grid Technology
Introduction to Grid Technology B.Ramamurthy 1 Arthur C Clarke s Laws (two of many) Any sufficiently advanced technology is indistinguishable from magic." "The only way of discovering the limits of the
More informationChapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.
Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies
More informationIntroduction to Grid Computing
Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able
More informationGrid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen
Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Concrete Example I have a source file Main.F on machine A, an
More informationA RESOURCE MANAGEMENT FRAMEWORK FOR INTERACTIVE GRIDS
A RESOURCE MANAGEMENT FRAMEWORK FOR INTERACTIVE GRIDS Raj Kumar, Vanish Talwar, Sujoy Basu Hewlett-Packard Labs 1501 Page Mill Road, MS 1181 Palo Alto, CA 94304 USA { raj.kumar,vanish.talwar,sujoy.basu}@hp.com
More informationAccommodating Bursts in Distributed Stream Processing Systems
Accommodating Bursts in Distributed Stream Processing Systems Distributed Real-time Systems Lab University of California, Riverside {drougas,vana}@cs.ucr.edu http://www.cs.ucr.edu/~{drougas,vana} Stream
More informationADAPTIVE AND DYNAMIC LOAD BALANCING METHODOLOGIES FOR DISTRIBUTED ENVIRONMENT
ADAPTIVE AND DYNAMIC LOAD BALANCING METHODOLOGIES FOR DISTRIBUTED ENVIRONMENT PhD Summary DOCTORATE OF PHILOSOPHY IN COMPUTER SCIENCE & ENGINEERING By Sandip Kumar Goyal (09-PhD-052) Under the Supervision
More informationAB Drives. T4 - Process Control: Virtualization for Manufacturing. Insert Photo Here Anthony Baker. PlantPAx Characterization & Lab Manager
T4 - Process Control: Virtualization for Manufacturing Insert Photo Here Anthony Baker PlantPAx Characterization & Lab Manager Rockwell Automation Rockwell Automation Process Solutions User Group (PSUG)
More informationData Modeling and Databases Ch 14: Data Replication. Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich
Data Modeling and Databases Ch 14: Data Replication Gustavo Alonso, Ce Zhang Systems Group Department of Computer Science ETH Zürich Database Replication What is database replication The advantages of
More informationGrid Computing Security hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1
Grid Computing Security 20.10.2006 hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1 What to expect from this talk Collection of bits about GC I thought you might find interesting Mixed bag:
More informationAn Evaluation of Alternative Designs for a Grid Information Service
An Evaluation of Alternative Designs for a Grid Information Service Warren Smith, Abdul Waheed *, David Meyers, Jerry Yan Computer Sciences Corporation * MRJ Technology Solutions Directory Research L.L.C.
More informationEvolution of the ATLAS PanDA Workload Management System for Exascale Computational Science
Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine,
More informationPROJECT FINAL REPORT
PROJECT FINAL REPORT Grant Agreement number: INFSO-ICT-224350 Project acronym: Project title: Funding Scheme: flexware Flexible Wireless Automation in Real-Time Environments STREP Period covered: from
More informationData Management for the World s Largest Machine
Data Management for the World s Largest Machine Sigve Haug 1, Farid Ould-Saada 2, Katarina Pajchel 2, and Alexander L. Read 2 1 Laboratory for High Energy Physics, University of Bern, Sidlerstrasse 5,
More informationInterconnect EGEE and CNGRID e-infrastructures
Interconnect EGEE and CNGRID e-infrastructures Giuseppe Andronico Interoperability and Interoperation between Europe, India and Asia Workshop Barcelona - Spain, June 2 2007 FP6 2004 Infrastructures 6-SSA-026634
More informationAndrea Sciabà CERN, Switzerland
Frascati Physics Series Vol. VVVVVV (xxxx), pp. 000-000 XX Conference Location, Date-start - Date-end, Year THE LHC COMPUTING GRID Andrea Sciabà CERN, Switzerland Abstract The LHC experiments will start
More informationA Capacity Planning Methodology for Distributed E-Commerce Applications
A Capacity Planning Methodology for Distributed E-Commerce Applications I. Introduction Most of today s e-commerce environments are based on distributed, multi-tiered, component-based architectures. The
More informationC-Meter: A Framework for Performance Analysis of Computing Clouds
9th IEEE/ACM International Symposium on Cluster Computing and the Grid C-Meter: A Framework for Performance Analysis of Computing Clouds Nezih Yigitbasi, Alexandru Iosup, and Dick Epema Delft University
More informationLoad Dynamix Enterprise 5.2
DATASHEET Load Dynamix Enterprise 5.2 Storage performance analytics for comprehensive workload insight Load DynamiX Enterprise software is the industry s only automated workload acquisition, workload analysis,
More informationGridFTP Scalability and Performance Results Ioan Raicu Catalin Dumitrescu -
GridFTP Scalability and Performance Results 2/12/25 Page 1 of 13 GridFTP Scalability and Performance Results Ioan Raicu iraicu@cs.uchicago.edu Catalin Dumitrescu - catalind@cs.uchicago.edu 1. Introduction
More informationRouting protocols in WSN
Routing protocols in WSN 1.1 WSN Routing Scheme Data collected by sensor nodes in a WSN is typically propagated toward a base station (gateway) that links the WSN with other networks where the data can
More informationCorral: A Glide-in Based Service for Resource Provisioning
: A Glide-in Based Service for Resource Provisioning Gideon Juve USC Information Sciences Institute juve@usc.edu Outline Throughput Applications Grid Computing Multi-level scheduling and Glideins Example:
More informationAdaptive Cluster Computing using JavaSpaces
Adaptive Cluster Computing using JavaSpaces Jyoti Batheja and Manish Parashar The Applied Software Systems Lab. ECE Department, Rutgers University Outline Background Introduction Related Work Summary of
More informationXSEDE High Throughput Computing Use Cases
XSEDE High Throughput Computing Use Cases 31 May 2013 Version 0.3 XSEDE HTC Use Cases Page 1 XSEDE HTC Use Cases Page 2 Table of Contents A. Document History B. Document Scope C. High Throughput Computing
More informationACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development
ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development Jeremy Fischer Indiana University 9 September 2014 Citation: Fischer, J.L. 2014. ACCI Recommendations on Long Term
More informationEmpowering the Service Economy with SLA-aware Infrastructures in the project
Empowering the Service Economy with SLA-aware Infrastructures in the project SLA@SOI ETSI Workshop Grids, Clouds & Service Infrastructures, Sophia Antipolis, Dec 2-3, 2009 Ramin Yahyapour Technische Universität
More informationDescription of a Lightweight Bartering Grid Architecture
Description of a Lightweight Bartering Grid Architecture Cyril Briquet and Pierre-Arnoul de Marneffe Department of Electrical Engineering & Computer Science, University of Liège, Montefiore Institute,
More informationEFFICIENT SCHEDULING TECHNIQUES AND SYSTEMS FOR GRID COMPUTING
EFFICIENT SCHEDULING TECHNIQUES AND SYSTEMS FOR GRID COMPUTING By JANG-UK IN A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN PARTIAL FULFILLMENT OF THE REQUIREMENTS FOR
More informationGrid Computing with Voyager
Grid Computing with Voyager By Saikumar Dubugunta Recursion Software, Inc. September 28, 2005 TABLE OF CONTENTS Introduction... 1 Using Voyager for Grid Computing... 2 Voyager Core Components... 3 Code
More informationpre-ws MDS and WS-MDS Performance Study Ioan Raicu 01/05/06 Page 1 of 17 pre-ws MDS and WS-MDS Performance Study Ioan Raicu 01/05/06
Ioan Raicu 0/05/06 Page of 7 pre-ws MDS and WS-MDS Performance Study Ioan Raicu 0/05/06 Table of Contents Table of Contents... Table of Figures... Abstract... 3 Contributing People... 3 2 Testbeds and
More informationLoad Balancing Algorithm over a Distributed Cloud Network
Load Balancing Algorithm over a Distributed Cloud Network Priyank Singhal Student, Computer Department Sumiran Shah Student, Computer Department Pranit Kalantri Student, Electronics Department Abstract
More informationDecentralized Grid Management Model Based on Broker Overlay
Decentralized Grid Management Model Based on Broker Overlay Abdulrahman Azab 1, Hein Meling 1 1 Dept. of Computer Science and Electrical Engineering, Faculty of Science and Technology, University of Stavanger,
More informationChapter 5. Minimization of Average Completion Time and Waiting Time in Cloud Computing Environment
Chapter 5 Minimization of Average Completion Time and Waiting Time in Cloud Computing Cloud computing is the use of the Internet for the tasks the users performing on their computer. Cloud computing, also
More informationChapter 3. Design of Grid Scheduler. 3.1 Introduction
Chapter 3 Design of Grid Scheduler The scheduler component of the grid is responsible to prepare the job ques for grid resources. The research in design of grid schedulers has given various topologies
More informationUniversität Stuttgart
Universität Stuttgart Fakultät Informatik, Elektrotechnik und Informationstechnik Processes for Human Integration in Automated Cloud Application Management David Schumm 1, Christoph Fehling 1, Dimka Karastoyanova
More informationThe National Fusion Collaboratory
The National Fusion Collaboratory A DOE National Collaboratory Pilot Project Presented by David P. Schissel at ICC 2004 Workshop May 27, 2004 Madison, WI PRESENTATION S KEY POINTS Collaborative technology
More informationPreservation Planning in the OAIS Model
Preservation Planning in the OAIS Model Stephan Strodl and Andreas Rauber Institute of Software Technology and Interactive Systems Vienna University of Technology {strodl, rauber}@ifs.tuwien.ac.at Abstract
More informationThe LHC Computing Grid
The LHC Computing Grid Visit of Finnish IT Centre for Science CSC Board Members Finland Tuesday 19 th May 2009 Frédéric Hemmer IT Department Head The LHC and Detectors Outline Computing Challenges Current
More informationSemantic SOA - Realization of the Adaptive Services Grid
Semantic SOA - Realization of the Adaptive Services Grid results of the final year bachelor project Outline review of midterm results engineering methodology service development build-up of ASG software
More informationPUB-2-SUB: A Content-Based Publish/Subscribe Framework for Cooperative P2P Networks
PUB-2-SUB: A Content-Based Publish/Subscribe Framework for Cooperative P2P Networks Duc A. Tran Cuong Pham Network Information Systems Lab (NISLab) Dept. of Computer Science University of Massachusetts,
More informationReal-time grid computing for financial applications
CNR-INFM Democritos and EGRID project E-mail: cozzini@democritos.it Riccardo di Meo, Ezio Corso EGRID project ICTP E-mail: {dimeo,ecorso}@egrid.it We describe the porting of a test case financial application
More informationCloudBATCH: A Batch Job Queuing System on Clouds with Hadoop and HBase. Chen Zhang Hans De Sterck University of Waterloo
CloudBATCH: A Batch Job Queuing System on Clouds with Hadoop and HBase Chen Zhang Hans De Sterck University of Waterloo Outline Introduction Motivation Related Work System Design Future Work Introduction
More informationAssessing performance in HP LeftHand SANs
Assessing performance in HP LeftHand SANs HP LeftHand Starter, Virtualization, and Multi-Site SANs deliver reliable, scalable, and predictable performance White paper Introduction... 2 The advantages of
More informationEGEE and Interoperation
EGEE and Interoperation Laurence Field CERN-IT-GD ISGC 2008 www.eu-egee.org EGEE and glite are registered trademarks Overview The grid problem definition GLite and EGEE The interoperability problem The
More informationA Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme
A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme Yue Zhang 1 and Yunxia Pei 2 1 Department of Math and Computer Science Center of Network, Henan Police College, Zhengzhou,
More informationOASIS: Self-tuning Storage for Applications
OASIS: Self-tuning Storage for Applications Kostas Magoutis IBM T. J. Watson magoutis@us.ibm.com Prasenjit Sarkar IBM Almaden psarkar@almaden.ibm.com Gauri Shah IBM Almaden gauris@us.ibm.com Abstract This
More informationI Tier-3 di CMS-Italia: stato e prospettive. Hassen Riahi Claudio Grandi Workshop CCR GRID 2011
I Tier-3 di CMS-Italia: stato e prospettive Claudio Grandi Workshop CCR GRID 2011 Outline INFN Perugia Tier-3 R&D Computing centre: activities, storage and batch system CMS services: bottlenecks and workarounds
More informationPerformance and Evaluation of Integrated Video Transmission and Quality of Service for internet and Satellite Communication Traffic of ATM Networks
Performance and Evaluation of Integrated Video Transmission and Quality of Service for internet and Satellite Communication Traffic of ATM Networks P. Rajan Dr. K.L.Shanmuganathan Research Scholar Prof.
More informationCMS Tier-2 Program for user Analysis Computing on the Open Science Grid Frank Würthwein UCSD Goals & Status
CMS Tier-2 Program for user Analysis Computing on the Open Science Grid Frank Würthwein UCSD Goals & Status High Level Requirements for user analysis computing Code Development Environment Compile, run,
More informationDecentralized Resource Discovery and Management for Future Manycore Systems
Decentralized Resource Discovery and Management for Future Manycore Systems Javad Zarrin 1 (jz461@cam.ac.uk), Rui L. Aguiar 2 (ruilaa@ua.pt), Joao Paulo Barraca 3 (jpbarraca@ua.pt) Abstract The next generation
More informationDistributed Systems INF Michael Welzl
Distributed Systems INF 3190 Michael Welzl What is a distributed system (DS)? Many defini8ons [Coulouris & Emmerich] A distributed system consists of hardware and sodware components located in a network
More informationSpecial Topics: CSci 8980 Edge History
Special Topics: CSci 8980 Edge History Jon B. Weissman (jon@cs.umn.edu) Department of Computer Science University of Minnesota P2P: What is it? No always-on server Nodes are at the network edge; come and
More informationTortoise vs. hare: a case for slow and steady retrieval of large files
Tortoise vs. hare: a case for slow and steady retrieval of large files Abstract Large file transfers impact system performance at all levels of a network along the data path from source to destination.
More informationAdvanced School in High Performance and GRID Computing November Introduction to Grid computing.
1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste
More informationThe coolest place on earth
The coolest place on earth Large Scale Messaging with ActiveMQ for Particle Accelerators at CERN 2 Overview Examples 30min Introduction to CERN Operation Usage of ActiveMQ 3 About the Speaker Member of
More informationEFFICIENT ALLOCATION OF DYNAMIC RESOURCES IN A CLOUD
EFFICIENT ALLOCATION OF DYNAMIC RESOURCES IN A CLOUD S.THIRUNAVUKKARASU 1, DR.K.P.KALIYAMURTHIE 2 Assistant Professor, Dept of IT, Bharath University, Chennai-73 1 Professor& Head, Dept of IT, Bharath
More informationAn Introduction to Virtualization and Cloud Technologies to Support Grid Computing
New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research
More informationBest of Breed Surveillance System SOLUTION WHITEPAPER
Best of Breed Surveillance System SOLUTION WHITEPAPER Document Version 1.0 August 2018 Introduction The effectiveness of your surveillance system relies on a solid foundation of best of breed technologies.
More informationResources and Services Virtualization without Boundaries (ReSerVoir)
Resources and Services Virtualization without Boundaries (ReSerVoir) Benny Rochwerger April 14, 2008 IBM Labs in Haifa The Evolution of the Power Grid The Burden Iron Works Water Wheel http://w w w.rootsw
More informationMicrosoft SQL Server Fix Pack 15. Reference IBM
Microsoft SQL Server 6.3.1 Fix Pack 15 Reference IBM Microsoft SQL Server 6.3.1 Fix Pack 15 Reference IBM Note Before using this information and the product it supports, read the information in Notices
More informationSynergetics-Standard-SQL Server 2012-DBA-7 day Contents
Workshop Name Duration Objective Participants Entry Profile Training Methodology Setup Requirements Hardware and Software Requirements Training Lab Requirements Synergetics-Standard-SQL Server 2012-DBA-7
More informationSOFT 437 Quiz #2 February 26, 2015
SOFT 437 Quiz #2 February 26, 2015 Do not turn this page until the quiz officially begins. STUDENT NUMBER Please do not write your name anywhere on this quiz. I recommend writing your student number at
More information