Cloud Computing with Nimbus

Size: px
Start display at page:

Download "Cloud Computing with Nimbus"

Transcription

1 Cloud Computing with Nimbus March 2009, OGF25 Thilo Kielmann (slides by Kate Keahey

2 Nimbus Nimbus goals Allow providers to build clouds Private clouds (privacy, expense considerations) E.g., Workspace Service: open source EC2 implementation Allow users to use cloud computing Do whatever it takes to enable scientists to use IaaS E.g.,Context Broker: creates turnkey virtual clusters Allow developers to experiment with Nimbus For research or usability/performance improvements Community extensions and contributions, e.g Ian Gable and his team (UVIC) contributed a monitoring component First released in September 2005

3 The Workspace Service VWS Service

4 The Workspace Service The workspace service publishes information about each workspace Users can find out information about their workspace (e.g. what IP the workspace was bound to) VWS Service Users can interact directly with their workspaces the same way the would with a physical machine.

5 Workspace Service: Interfaces and Clients Two kinds of interfaces: Web Service Resource Framework (WSRF) Web Services + state management (WS-Notification) Cloud client (similar commads to the EC2 client) Elastic Computing Cloud (EC2) Supported: ec2-describe-images, ec2-run-instances, ec2-describeinstances, ec2-terminate-instances, ec2-reboot-instances, ec2-addkeypair, ec2-delete-keypair Unsupported: availability zones, security groups, elastic IP assignment, REST Works with EC2 clients You can use one, or the other, or both

6 Workspace Service: Security Authenticating and authorizing requests WSRF interfaces: GSI Support for proxies, VOMS, Shibboleth (via GridShib), custom PDPs EC2 interfaces Vanilla PKI X509 support Secure access to VMs EC2 key generation or accessed from.ssh Towards protecting data from the provider Extensions from Vienna University of Technology: Paper: Descher et al., Retaining Data Control in Infrastructure Clouds, ARES (the International Dependability Conference), 2009.

7 Workspace Service: Networking Network configuration External: public IPs or private IPs (via VPN) Internal: private network via a local cluster network Each VM can specify multiple NICs mixing private and public networks (WSRF only) E.g., cluster worker s on a private network, head on both public and private network

8 Workspace Components EC2 WSRF workspace service workspace resource manager workspace pilot workspace control workspace client OpenNebula Project

9 Turnkey Virtual Clusters Turnkey, tightly-coupled cluster Shared trust/security context Shared configuration/context information Context Broker goals Every appliance Every cloud provider Multiple distributed cloud providers Used to contextualize 100s of virtual s for EC2 HEP STAR runs, Hadoop s, HEP Alice s Working with rpath on developing appliances, standardization

10 Science Clouds Goals: Enable scientific projects to experiment with IaaS clouds Evolve software in response to the needs of scientific projects A laboratory for exploration of cloud interoperability issues Participants University of Chicago (since 03/08, 16 s), University of Florida (05/08, s, access via VPN), Masaryk University, Brno, Czech Republic (08/08), Purdue (09/08) In progress: IU, Grid5K, Vrije, others Using EC2 for large runs

11 Who Runs on Nimbus? Hadoop AliEn GT-scalability STAR Montage workflows GridFTP testing workspace-team Testing OSG geofest bioinformatics Other Project diversity: Science, CS, education, build&test

12 STAR STAR: a high-energy physics experiment Need resources with the right configuration Complex environments Consistent environments A virtual OSG STAR cluster OSG cluster: OSG CE (head), gridmapfiles, host certificates, NSF, Torque, worker s: SL4 + STAR Requirements One-click virtual cluster deployment Moving virtual clusters: Science Clouds -> EC2 From proof-of-concept to productions runs Work by Jerome Lauret, Doug Olson, Leve Hajdu, Lidia Didenko at BNL Signinficant productions runs in progress now: results to be published at Quark Matter conference and CHEP

13 Alice HEP Experiment at CERN Collaboration with CERNVM project

14 Making a Hadoop Cloud U of Chicago U of Florida Hadoop cloud Purdue Papers: Sky Computing, by K. Keahey, A. Matsunaga, M. Tsugawa, J. Fortes. Submitted to IEEE Internet Computing. CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications by A. Matsunaga, M. Tsugawa and J. Fortes. escience 2008.

15 Thoughts Science-driven cloud computing How does IaaS fit into our world? Combine with what we have (grid computing) Explore new potential Interoperability Academic vs commercial resources Standards: rough consensus & working code Importance of open source Drive requirements into the infrastructure, customize Drive the development of standards

Cloud Computing with Nimbus

Cloud Computing with Nimbus Cloud Computing with Nimbus April 2010 Condor Week Kate Keahey keahey@mcs.anl.gov Nimbus Project University of Chicago Argonne National Laboratory Cloud Computing for Science Environment Complexity Consistency

More information

Cloud Computing for Science

Cloud Computing for Science Cloud Computing for Science August 2009 CoreGrid 2009 Workshop Kate Keahey keahey@mcs.anl.gov Nimbus project lead University of Chicago Argonne National Laboratory Cloud Computing is in the news is it

More information

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Chicago, October 2008 Kate Keahey, Renato Figueiredo, Jose Fortes, Tim Freeman, Mauricio Tsugawa University of Chicago University

More information

Contextualization: Providing One-Click Virtual Clusters

Contextualization: Providing One-Click Virtual Clusters Contextualization: Providing One-Click Virtual Clusters Kate Keahey Tim Freeman Argonne National Laboratory University of Chicago {keahey, tfreeman}@mcs.anl.gov Cloud Computing Infrastructure-as-a-Service

More information

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications

Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Science Clouds: Early Experiences in Cloud Computing for Scientific Applications K. Keahey 1, R. Figueiredo 2, J. Fortes 2, T. Freeman 1, M. Tsugawa 2 1 University of Chicago, 2 University of Florida Abstract

More information

Large Scale Sky Computing Applications with Nimbus

Large Scale Sky Computing Applications with Nimbus Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France Pierre.Riteau@irisa.fr INTRODUCTION TO SKY COMPUTING IaaS

More information

Sky Computing on FutureGrid and Grid 5000 with Nimbus. Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France

Sky Computing on FutureGrid and Grid 5000 with Nimbus. Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France Sky Computing on FutureGrid and Grid 5000 with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France Outline Introduction to Sky Computing The Nimbus Project

More information

Science Computing Clouds.

Science Computing Clouds. Science Computing Clouds. December 9, 2008 Chan-Hyun Youn School of Engineering/ Grid Middleware Research Center Information and Communications University COPYRIGHT@LANS Lab, Information and Communication

More information

Going Places with Distributed Computing

Going Places with Distributed Computing Going Places with Distributed Computing ESC Grid Workshop 2007 Kate Keahey University of Chicago Argonne National Laboratory keahey@mcs.anl.gov There is more to Grid applications than running simple batch

More information

Infrastructure Clouds for Science and Education: Platform Tools

Infrastructure Clouds for Science and Education: Platform Tools Infrastructure Clouds for Science and Education: Platform Tools Kate Keahey, John Bresnahan, Patrick Armstrong, Pierre Riteau Argonne National Laboratory University of Chicago 11/12/2012 1 The Power of

More information

Contextualization: Providing One-Click Virtual Clusters

Contextualization: Providing One-Click Virtual Clusters Contextualization: Providing One-Click Virtual Clusters Katarzyna Keahey University of Chicago keahey@mcs.anl.gov Abstract As virtual appliances become more prevalent, we encounter the need to stop manually

More information

Virtual Workspace Appliances

Virtual Workspace Appliances Virtual Workspace Appliances Tim Freeman, Kate Keahey Supercomputing 2006, Tampa, FL tfreeman@mcs.anl.gov Required Environments Diverse client environment requirements Library versions Application versions

More information

Scientific Workflows and Cloud Computing. Gideon Juve USC Information Sciences Institute

Scientific Workflows and Cloud Computing. Gideon Juve USC Information Sciences Institute Scientific Workflows and Cloud Computing Gideon Juve USC Information Sciences Institute gideon@isi.edu Scientific Workflows Loosely-coupled parallel applications Expressed as directed acyclic graphs (DAGs)

More information

José Fortes. Advanced Computing and Information Systems laboratory. and NSF Center for Autonomic Computing. HPC 2010 Cetraro

José Fortes. Advanced Computing and Information Systems laboratory. and NSF Center for Autonomic Computing. HPC 2010 Cetraro Crosscloud Computing José Fortes Advanced Computing and Information Systems Lab and HPC 2010 Cetraro Clouds Provider view Economies of scale Statistical ti ti multiplexing l i Avoid customer-specific complexities

More information

Clouds: An Opportunity for Scientific Applications?

Clouds: An Opportunity for Scientific Applications? Clouds: An Opportunity for Scientific Applications? Ewa Deelman USC Information Sciences Institute Acknowledgements Yang-Suk Ki (former PostDoc, USC) Gurmeet Singh (former Ph.D. student, USC) Gideon Juve

More information

Beyond the Clouds: Trends in Cloud Compu4ng for Science

Beyond the Clouds: Trends in Cloud Compu4ng for Science Beyond the Clouds: Trends in Cloud Compu4ng for Science Kate Keahey keahey@mcs.anl.gov Argonne National Laboratory Computation Institute, University of Chicago 7/1/13 NIMBUS 1 Cloud Compu4ng: Looking Back

More information

Application of Virtualization Technologies & CernVM. Benedikt Hegner CERN

Application of Virtualization Technologies & CernVM. Benedikt Hegner CERN Application of Virtualization Technologies & CernVM Benedikt Hegner CERN Virtualization Use Cases Worker Node Virtualization Software Testing Training Platform Software Deployment }Covered today Server

More information

ALICE Grid Activities in US

ALICE Grid Activities in US ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions

More information

Garuda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore.

Garuda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore. Garuda : The National Grid Computing Initiative Of India Natraj A.C, CDAC Knowledge Park, Bangalore. natraj@cdacb.ernet.in 1 Agenda About CDAC Garuda grid highlights Garuda Foundation Phase EU-India grid

More information

Topics of Discussion

Topics of Discussion CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture on NIST Cloud Computing Definition, Standards & Roadmap, Security & Privacy Guidelines Spring 2013 A Specialty Course for Purdue

More information

The OpenNebula Virtual Infrastructure Engine

The OpenNebula Virtual Infrastructure Engine EGEE 4th User Forum/OGF25 & OGF-Europe's 2nd International Event Catania, Italy Thursday 5 th, March 2009 The OpenNebula Virtual Infrastructure Engine Constantino Vázquez Blanco Distributed Systems Architecture

More information

CS6703 GRID AND CLOUD COMPUTING. Question Bank Unit-I. Introduction

CS6703 GRID AND CLOUD COMPUTING. Question Bank Unit-I. Introduction CS6703 GRID AND CLOUD COMPUTING Question Bank Unit-I Introduction Part A 1. Define Grid Computing. 2. Define Cloud Computing. 3. Analyze the working of GPUs. 4. List out the cluster design. 5. Differentiate

More information

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing

An Introduction to Virtualization and Cloud Technologies to Support Grid Computing New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research

More information

Grids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan

Grids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security

More information

13th International Workshop on Advanced Computing and Analysis Techniques in Physics Research ACAT 2010 Jaipur, India February

13th International Workshop on Advanced Computing and Analysis Techniques in Physics Research ACAT 2010 Jaipur, India February LHC Cloud Computing with CernVM Ben Segal 1 CERN 1211 Geneva 23, Switzerland E mail: b.segal@cern.ch Predrag Buncic CERN E mail: predrag.buncic@cern.ch 13th International Workshop on Advanced Computing

More information

Leveraging the InCommon Federation to access the NSF TeraGrid

Leveraging the InCommon Federation to access the NSF TeraGrid Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois at Urbana-Champaign jbasney@ncsa.uiuc.edu

More information

VMs at a Tier-1 site. EGEE 09, Sander Klous, Nikhef

VMs at a Tier-1 site. EGEE 09, Sander Klous, Nikhef VMs at a Tier-1 site EGEE 09, 21-09-2009 Sander Klous, Nikhef Contents Introduction Who are we? Motivation Why are we interested in VMs? What are we going to do with VMs? Status How do we approach this

More information

Virtualization. A very short summary by Owen Synge

Virtualization. A very short summary by Owen Synge Virtualization A very short summary by Owen Synge Outline What is Virtulization? What's virtulization good for? What's virtualisation bad for? We had a workshop. What was presented? What did we do with

More information

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007 Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software

More information

AUTOMATIC ENABLEMENT, COORDINATION AND RESOURCE USAGE PREDICTION OF UNMODIFIED APPLICATIONS ON CLOUDS

AUTOMATIC ENABLEMENT, COORDINATION AND RESOURCE USAGE PREDICTION OF UNMODIFIED APPLICATIONS ON CLOUDS AUTOMATIC ENABLEMENT, COORDINATION AND RESOURCE USAGE PREDICTION OF UNMODIFIED APPLICATIONS ON CLOUDS By ANDRÉA MATSUNAGA A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN

More information

StratusLab Cloud Distribution Installation. Charles Loomis (CNRS/LAL) 3 July 2014

StratusLab Cloud Distribution Installation. Charles Loomis (CNRS/LAL) 3 July 2014 StratusLab Cloud Distribution Installation Charles Loomis (CNRS/LAL) 3 July 2014 StratusLab What is it? Complete IaaS cloud distribution Open source (Apache 2 license) Works well for production private

More information

EGEE and Interoperation

EGEE and Interoperation EGEE and Interoperation Laurence Field CERN-IT-GD ISGC 2008 www.eu-egee.org EGEE and glite are registered trademarks Overview The grid problem definition GLite and EGEE The interoperability problem The

More information

Advanced School in High Performance and GRID Computing November Introduction to Grid computing.

Advanced School in High Performance and GRID Computing November Introduction to Grid computing. 1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste

More information

On the Use of Cloud Computing for Scientific Workflows

On the Use of Cloud Computing for Scientific Workflows On the Use of Cloud Computing for Scientific Workflows Christina Hoffa 1, Gaurang Mehta 2, Timothy Freeman 3, Ewa Deelman 2, Kate Keahey 3, Bruce Berriman 4, John Good 4 1 Indiana University, 2 University

More information

COP Cloud Computing. Presented by: Sanketh Beerabbi University of Central Florida

COP Cloud Computing. Presented by: Sanketh Beerabbi University of Central Florida COP6087 - Cloud Computing Presented by: Sanketh Beerabbi University of Central Florida A cloud is a collection of networked resources configured such that users can request scalable resources (VMs, platforms,

More information

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.

More information

A Multipolicy Authorization Framework for Grid Security

A Multipolicy Authorization Framework for Grid Security A Multipolicy Authorization Framework for Grid Security Bo Lang,,2 Ian Foster,,3 Frank Siebenlist,,3 Rachana Ananthakrishnan, Tim Freeman,3 Mathematics and Computer Science Division, Argonne National Laboratory,

More information

Cloud Computing and Service-Oriented Architectures

Cloud Computing and Service-Oriented Architectures Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 29 - Friday March 22 2013. Cloud precursors

More information

Agenda. Sill, Alan Texas Tech University Workshop Introduction 8:30 AM Recently Released OGF Standards; US Federal and Other Roadmap Efforts

Agenda. Sill, Alan Texas Tech University Workshop Introduction 8:30 AM Recently Released OGF Standards; US Federal and Other Roadmap Efforts Workshop on High Performance Applications of Cloud and Grid Tools Agenda Sill, Alan Texas Tech University Workshop Introduction 8:30 AM Sill, Alan Texas Tech University Recently Released OGF Standards;

More information

Grid Architectural Models

Grid Architectural Models Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers

More information

Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA.

Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. November 3th, 2005 Von Welch vwelch@ncsa.uiuc.edu Outline

More information

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of

More information

Running HEP Workloads on Distributed Clouds

Running HEP Workloads on Distributed Clouds Running HEP Workloads on Distributed Clouds R.Seuster, F. Berghaus, K. Casteels, C. Driemel M. Ebert, C. R. Leavett-Brown, M. Paterson, R.Sobie, T. Weiss-Gibson 2017 Fall HEPiX meeting, Tsukuba 16. - 20.

More information

Authorization Strategies for Virtualized Environments in Grid Computing Systems

Authorization Strategies for Virtualized Environments in Grid Computing Systems Authorization Strategies for Virtualized Environments in Grid Computing Systems Xinming Ou Anna Squicciarini Sebastien Goasguen Elisa Bertino Purdue University Abstract The development of adequate security

More information

Virtual Appliances and Education in FutureGrid. Dr. Renato Figueiredo ACIS Lab - University of Florida

Virtual Appliances and Education in FutureGrid. Dr. Renato Figueiredo ACIS Lab - University of Florida Virtual Appliances and Education in FutureGrid Dr. Renato Figueiredo ACIS Lab - University of Florida Background l Traditional ways of delivering hands-on training and education in parallel/distributed

More information

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem

More information

Introduction, History

Introduction, History Perspective on Campus Usage and Needs: TTU Experience with Grid Computing GGF Production Grid Services Research Group Workshop: Grids on Campus Oct 2-3, 2005 Harvard University Alan Sill Senior Scientist,

More information

Supporting Cloud Computing with the Virtual Block Store System

Supporting Cloud Computing with the Virtual Block Store System Supporting Cloud Computing with the Virtual Block Store System Xiaoming Gao, Mike Lowe, Yu Ma, and Marlon Pierce Indiana University Bloomington, Indiana, USA gao4@indiana.edu, jomlowe@iupui.edu, yuma@indiana.edu,

More information

Managing Appliance Launches in Infrastructure Clouds John Bresnahan Mathematics and Computer Science Division Argonne National Laboratory

Managing Appliance Launches in Infrastructure Clouds John Bresnahan Mathematics and Computer Science Division Argonne National Laboratory Managing Appliance Launches in Infrastructure Clouds John Bresnahan Mathematics and Computer Science Division Argonne National Laboratory bresnahan@mcs.anl.gov Tim Freeman Computation Institute University

More information

HPC Cloud at SURFsara

HPC Cloud at SURFsara HPC Cloud at SURFsara Offering cloud as a service SURF Research Boot Camp 21st April 2016 Ander Astudillo Markus van Dijk What is cloud computing?

More information

Grid, cloud, and science: Accelerating discovery. A View and Practice from University of Chicago

Grid, cloud, and science: Accelerating discovery. A View and Practice from University of Chicago Grid, cloud, and science: Accelerating discovery A View and Practice from University of Chicago Ian Foster Presented by Ioan Raicu Computation Institute Argonne National Lab & University of Chicago April

More information

Module Day Topic. 1 Definition of Cloud Computing and its Basics

Module Day Topic. 1 Definition of Cloud Computing and its Basics Module Day Topic 1 Definition of Cloud Computing and its Basics 1 2 3 1. How does cloud computing provides on-demand functionality? 2. What is the difference between scalability and elasticity? 3. What

More information

Shooting for the sky: Testing the limits of condor. HTCondor Week May 2015 Edgar Fajardo On behalf of OSG Software and Technology

Shooting for the sky: Testing the limits of condor. HTCondor Week May 2015 Edgar Fajardo On behalf of OSG Software and Technology Shooting for the sky: Testing the limits of condor 21 May 2015 Edgar Fajardo On behalf of OSG Software and Technology 1 Acknowledgement Although I am the one presenting. This work is a product of a collaborative

More information

The LHC Computing Grid

The LHC Computing Grid The LHC Computing Grid Gergely Debreczeni (CERN IT/Grid Deployment Group) The data factory of LHC 40 million collisions in each second After on-line triggers and selections, only 100 3-4 MB/event requires

More information

Distributed File System Support for Virtual Machines in Grid Computing

Distributed File System Support for Virtual Machines in Grid Computing Distributed File System Support for Virtual Machines in Grid Computing Ming Zhao, Jian Zhang, Renato Figueiredo Advanced Computing and Information Systems Electrical and Computer Engineering University

More information

Batch Services at CERN: Status and Future Evolution

Batch Services at CERN: Status and Future Evolution Batch Services at CERN: Status and Future Evolution Helge Meinhard, CERN-IT Platform and Engineering Services Group Leader HTCondor Week 20 May 2015 20-May-2015 CERN batch status and evolution - Helge

More information

Cloud Computing and Service-Oriented Architectures

Cloud Computing and Service-Oriented Architectures Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 20 - Tuesday November 23 2010. SOA Service-oriented

More information

European Globus Community Forum The Future of Globus in Europe

European Globus Community Forum The Future of Globus in Europe European Globus Community Forum The Future of Globus in Europe Michael Krieger, RISC Software GmbH Matthias Hofmann, TU Dortmund University Globus usage in Europe Do we need Globus in Europe??? Number

More information

Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science

Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine,

More information

By Ian Foster. Zhifeng Yun

By Ian Foster. Zhifeng Yun By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance

More information

Cloud Computing. UCD IT Services Experience

Cloud Computing. UCD IT Services Experience Cloud Computing UCD IT Services Experience Background - UCD IT Services Central IT provider for University College Dublin 23,000 Full Time Students 7,000 Researchers 5,000 Staff Background - UCD IT Services

More information

Hybrid Data Security Overview

Hybrid Data Security Overview From day one, data security has been the primary focus in designing Cisco Webex Teams. The cornerstone of this security is end-to-end content encryption, enabled by Webex Teams clients interacting with

More information

Workflow applications on EGI with WS-PGRADE. Peter Kacsuk and Zoltan Farkas MTA SZTAKI

Workflow applications on EGI with WS-PGRADE. Peter Kacsuk and Zoltan Farkas MTA SZTAKI applications on EGI with WS-PGRADE Peter Kacsuk and Zoltan Farkas MTA SZTAKI kacsuk@sztaki.hu 1 WS-PGRADE/gUSE Generic-purpose gateway framework Based on Liferay General purpose -oriented gateway framework

More information

Monitoring Grid Virtual Machine deployments

Monitoring Grid Virtual Machine deployments University of Victoria Faculty of Engineering Fall 2008 Work Term Report Monitoring Grid Virtual Machine deployments Department of Physics University of Victoria Victoria, BC Michael Paterson 0031209 Work

More information

ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development

ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development Jeremy Fischer Indiana University 9 September 2014 Citation: Fischer, J.L. 2014. ACCI Recommendations on Long Term

More information

Supporting Application- Tailored Grid File System Sessions with WSRF-Based Services

Supporting Application- Tailored Grid File System Sessions with WSRF-Based Services Supporting Application- Tailored Grid File System Sessions with WSRF-Based Services Ming Zhao, Vineet Chadha, Renato Figueiredo Advanced Computing and Information Systems Electrical and Computer Engineering

More information

Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine

Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine Journal of Physics: Conference Series OPEN ACCESS Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine To cite this article: Henrik Öhman et al 2014 J. Phys.: Conf.

More information

Presented by Wolfgang Ziegler, Open Grid Forum

Presented by Wolfgang Ziegler, Open Grid Forum ETSI SUMMIT ON STANDARDIZATION AND OPEN SOURCE STANDARDIZATION AND OPEN SOURCE Presented by Wolfgang Ziegler, Open Grid Forum About OGF Open global forum for advanced distributed computing OGF is an open

More information

RA-GRS, 130 replication support, ZRS, 130

RA-GRS, 130 replication support, ZRS, 130 Index A, B Agile approach advantages, 168 continuous software delivery, 167 definition, 167 disadvantages, 169 sprints, 167 168 Amazon Web Services (AWS) failure, 88 CloudTrail Service, 21 CloudWatch Service,

More information

THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap

THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap Arnie Miles Georgetown University adm35@georgetown.edu http://thebes.arc.georgetown.edu The Thebes middleware project was

More information

CernVM-FS. Catalin Condurache STFC RAL UK

CernVM-FS. Catalin Condurache STFC RAL UK CernVM-FS Catalin Condurache STFC RAL UK Outline Introduction Brief history EGI CernVM-FS infrastructure The users Recent developments Plans 2 Outline Introduction Brief history EGI CernVM-FS infrastructure

More information

On the Use of Cloud Computing for Scientific Workflows

On the Use of Cloud Computing for Scientific Workflows Fourth IEEE International Conference on escience On the Use of Cloud Computing for Scientific Workflows Christina Hoffa 1, Gaurang Mehta 2, Timothy Freeman 3, Ewa Deelman 2, Kate Keahey 3, Bruce Berriman

More information

Flying Low: Simple Leases with Workspace Pilot

Flying Low: Simple Leases with Workspace Pilot Flying Low: Simple Leases with Workspace Pilot Timothy Freeman, Katarzyna Keahey Computation Institute University of Chicago {tfreeman,keahey}@uchicago.edu Abstract. As virtual machines (VMs) are used

More information

Easy Access to Grid Infrastructures

Easy Access to Grid Infrastructures Easy Access to Grid Infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) On behalf of the g-eclipse consortium WP11 Grid Workshop Grenoble, France 09 th of December 2008 Background in astro particle

More information

Clouds in High Energy Physics

Clouds in High Energy Physics Clouds in High Energy Physics Randall Sobie University of Victoria Randall Sobie IPP/Victoria 1 Overview Clouds are integral part of our HEP computing infrastructure Primarily Infrastructure-as-a-Service

More information

Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment

Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment Marcus Ebert mebert@uvic.ca on behalf of the HEP-RC UVic group: Frank Berghaus, Kevin Casteels,

More information

Access the power of Grid with Eclipse

Access the power of Grid with Eclipse Access the power of Grid with Eclipse Harald Kornmayer (Forschungszentrum Karlsruhe GmbH) Markus Knauer (Innoopract GmbH) October 11th, 2006, Eclipse Summit, Esslingen 2006 by H. Kornmayer, M. Knauer;

More information

Some thoughts on the evolution of Grid and Cloud computing

Some thoughts on the evolution of Grid and Cloud computing Some thoughts on the evolution of Grid and Cloud computing D. Salomoni INFN Tier-1 Computing Manager Davide.Salomoni@cnaf.infn.it SuperB Computing R&D Workshop - Ferrara, 9-12 March, 2010 D. Salomoni (INFN-CNAF)

More information

Overview of ATLAS PanDA Workload Management

Overview of ATLAS PanDA Workload Management Overview of ATLAS PanDA Workload Management T. Maeno 1, K. De 2, T. Wenaus 1, P. Nilsson 2, G. A. Stewart 3, R. Walker 4, A. Stradling 2, J. Caballero 1, M. Potekhin 1, D. Smith 5, for The ATLAS Collaboration

More information

UAB IT Academic Computing

UAB IT Academic Computing UAB IT Academic Computing David L Shealy, Director Jill Gemmill, Asst. Director John-Paul Robinson, System Programmer Lead Mission Provide leadership for UAB research community while interfacing important

More information

Clouds at other sites T2-type computing

Clouds at other sites T2-type computing Clouds at other sites T2-type computing Randall Sobie University of Victoria Randall Sobie IPP/Victoria 1 Overview Clouds are used in a variety of ways for Tier-2 type computing MC simulation, production

More information

THE WIDE AREA GRID. Architecture

THE WIDE AREA GRID. Architecture THE WIDE AREA GRID Architecture Context The Wide Area Grid concept was discussed during several WGISS meetings The idea was to imagine and experiment an infrastructure that could be used by agencies to

More information

Report for the GGF 15 Community Activity: Leveraging Site Infrastructure for Multi-Site Grids

Report for the GGF 15 Community Activity: Leveraging Site Infrastructure for Multi-Site Grids GFD-I.089 Von Welch, NCSA (Editor) October 6, 2005 Report for the GGF 15 Community Activity: Leveraging Site Infrastructure for Multi-Site Grids Copyright Open Grid Forum (2006-2007). All Rights Reserved.

More information

Globus GTK and Grid Services

Globus GTK and Grid Services Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature

More information

PROOF as a Service on the Cloud: a Virtual Analysis Facility based on the CernVM ecosystem

PROOF as a Service on the Cloud: a Virtual Analysis Facility based on the CernVM ecosystem PROOF as a Service on the Cloud: a Virtual Analysis Facility based on the CernVM ecosystem D Berzano, J Blomer, P Buncic, I Charalampidis, G Ganis, G Lestaris, R Meusel CERN PH-SFT CERN, CH-1211 Geneva

More information

Using CernVM-FS to deploy Euclid processing S/W on Science Data Centres

Using CernVM-FS to deploy Euclid processing S/W on Science Data Centres Using CernVM-FS to deploy Euclid processing S/W on Science Data Centres M. Poncet (CNES) Q. Le Boulc h (IN2P3) M. Holliman (ROE) On behalf of Euclid EC SGS System Team ADASS 2016 1 Outline Euclid Project

More information

Research e-infrastructures in Czech Republic (e-infra CZ) for scientific computations, collaborative research & research support

Research e-infrastructures in Czech Republic (e-infra CZ) for scientific computations, collaborative research & research support Research e-infrastructures in Czech Republic (e-infra CZ) for scientific computations, collaborative research & research support Tomáš Rebok CERIT-SC, Institute of Computer Science MU MetaCentrum, CESNET

More information

arxiv: v1 [cs.dc] 7 Apr 2014

arxiv: v1 [cs.dc] 7 Apr 2014 arxiv:1404.1814v1 [cs.dc] 7 Apr 2014 CernVM Online and Cloud Gateway: a uniform interface for CernVM contextualization and deployment G Lestaris 1, I Charalampidis 2, D Berzano, J Blomer, P Buncic, G Ganis

More information

Grid Security: The Globus Perspective

Grid Security: The Globus Perspective Grid Security: The Globus Perspective GlobusWORLD 2005 Feb 7-11, Boston, MA Frank Siebenlist - ANL (franks@mcs.anl.gov) Von Welch - NCSA (welch@ncsa.uiuc.edu) http://www.globus.org/ Outline Part One: Von

More information

Open Grid Forum. OGF s Role in the Community

Open Grid Forum. OGF s Role in the Community Open Grid Forum OGF s Role in the Community Alan Sill Senior Scientist, High Performance Computing Center and Adjunct Professor of Physics, Texas Tech University Vice President of Standards, Open Grid

More information

Introduction to Cloud Computing. [thoughtsoncloud.com] 1

Introduction to Cloud Computing. [thoughtsoncloud.com] 1 Introduction to Cloud Computing [thoughtsoncloud.com] 1 Outline What is Cloud Computing? Characteristics of the Cloud Computing model Evolution of Cloud Computing Cloud Computing Architecture Cloud Services:

More information

S.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing.

S.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing. VALLIAMMAI ENGNIEERING COLLEGE SRM Nagar, Kattankulathur 603203. DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Year & Semester : IV & VII Section : CSE -1& 2 Subject Code : CS6703 Subject Name : Grid

More information

IaaS Framework Agreements Pan-European Cloud Services ready for adoption

IaaS Framework Agreements Pan-European Cloud Services ready for adoption IaaS Framework Agreements Pan-European Cloud Services ready for adoption Dr. Jakob Tendel GÉANT Cloud Service Delivery Team German Research Network DFN Belnet Networking Conference, Brussels 18 th Oct.

More information

Virtualization of the ATLAS Tier-2/3 environment on the HPC cluster NEMO

Virtualization of the ATLAS Tier-2/3 environment on the HPC cluster NEMO Virtualization of the ATLAS Tier-2/3 environment on the HPC cluster NEMO Ulrike Schnoor (CERN) Anton Gamel, Felix Bührer, Benjamin Rottler, Markus Schumacher (University of Freiburg) February 02, 2018

More information

Globus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009

Globus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009 Globus Toolkit 4 Execution Management Alexandra Jimborean International School of Informatics Hagenberg, 2009 2 Agenda of the day Introduction to Globus Toolkit and GRAM Zoom In WS GRAM Usage Guide Architecture

More information

Grid Services and the Globus Toolkit

Grid Services and the Globus Toolkit Grid Services and the Globus Toolkit Lisa Childers childers@mcs.anl.gov The Globus Alliance Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved. This

More information

VC3. Virtual Clusters for Community Computation. DOE NGNS PI Meeting September 27-28, 2017

VC3. Virtual Clusters for Community Computation. DOE NGNS PI Meeting September 27-28, 2017 VC3 Virtual Clusters for Community Computation DOE NGNS PI Meeting September 27-28, 2017 Douglas Thain, University of Notre Dame Rob Gardner, University of Chicago John Hover, Brookhaven National Lab A

More information

Troubleshooting Grid authentication from the client side

Troubleshooting Grid authentication from the client side Troubleshooting Grid authentication from the client side By Adriaan van der Zee RP1 presentation 2009-02-04 Contents The Grid @NIKHEF The project Grid components and interactions X.509 certificates, proxies

More information

ICN for Cloud Networking. Lotfi Benmohamed Advanced Network Technologies Division NIST Information Technology Laboratory

ICN for Cloud Networking. Lotfi Benmohamed Advanced Network Technologies Division NIST Information Technology Laboratory ICN for Cloud Networking Lotfi Benmohamed Advanced Network Technologies Division NIST Information Technology Laboratory Information-Access Dominates Today s Internet is focused on point-to-point communication

More information

CHAPTER 2 LITERATURE REVIEW AND BACKGROUND

CHAPTER 2 LITERATURE REVIEW AND BACKGROUND 8 CHAPTER 2 LITERATURE REVIEW AND BACKGROUND 2.1 LITERATURE REVIEW Several researches have been carried out in Grid Resource Management and some of the existing research works closely related to this thesis

More information