Cloud Computing with Nimbus
|
|
- Mary Stanley
- 5 years ago
- Views:
Transcription
1 Cloud Computing with Nimbus March 2009, OGF25 Thilo Kielmann (slides by Kate Keahey
2 Nimbus Nimbus goals Allow providers to build clouds Private clouds (privacy, expense considerations) E.g., Workspace Service: open source EC2 implementation Allow users to use cloud computing Do whatever it takes to enable scientists to use IaaS E.g.,Context Broker: creates turnkey virtual clusters Allow developers to experiment with Nimbus For research or usability/performance improvements Community extensions and contributions, e.g Ian Gable and his team (UVIC) contributed a monitoring component First released in September 2005
3 The Workspace Service VWS Service
4 The Workspace Service The workspace service publishes information about each workspace Users can find out information about their workspace (e.g. what IP the workspace was bound to) VWS Service Users can interact directly with their workspaces the same way the would with a physical machine.
5 Workspace Service: Interfaces and Clients Two kinds of interfaces: Web Service Resource Framework (WSRF) Web Services + state management (WS-Notification) Cloud client (similar commads to the EC2 client) Elastic Computing Cloud (EC2) Supported: ec2-describe-images, ec2-run-instances, ec2-describeinstances, ec2-terminate-instances, ec2-reboot-instances, ec2-addkeypair, ec2-delete-keypair Unsupported: availability zones, security groups, elastic IP assignment, REST Works with EC2 clients You can use one, or the other, or both
6 Workspace Service: Security Authenticating and authorizing requests WSRF interfaces: GSI Support for proxies, VOMS, Shibboleth (via GridShib), custom PDPs EC2 interfaces Vanilla PKI X509 support Secure access to VMs EC2 key generation or accessed from.ssh Towards protecting data from the provider Extensions from Vienna University of Technology: Paper: Descher et al., Retaining Data Control in Infrastructure Clouds, ARES (the International Dependability Conference), 2009.
7 Workspace Service: Networking Network configuration External: public IPs or private IPs (via VPN) Internal: private network via a local cluster network Each VM can specify multiple NICs mixing private and public networks (WSRF only) E.g., cluster worker s on a private network, head on both public and private network
8 Workspace Components EC2 WSRF workspace service workspace resource manager workspace pilot workspace control workspace client OpenNebula Project
9 Turnkey Virtual Clusters Turnkey, tightly-coupled cluster Shared trust/security context Shared configuration/context information Context Broker goals Every appliance Every cloud provider Multiple distributed cloud providers Used to contextualize 100s of virtual s for EC2 HEP STAR runs, Hadoop s, HEP Alice s Working with rpath on developing appliances, standardization
10 Science Clouds Goals: Enable scientific projects to experiment with IaaS clouds Evolve software in response to the needs of scientific projects A laboratory for exploration of cloud interoperability issues Participants University of Chicago (since 03/08, 16 s), University of Florida (05/08, s, access via VPN), Masaryk University, Brno, Czech Republic (08/08), Purdue (09/08) In progress: IU, Grid5K, Vrije, others Using EC2 for large runs
11 Who Runs on Nimbus? Hadoop AliEn GT-scalability STAR Montage workflows GridFTP testing workspace-team Testing OSG geofest bioinformatics Other Project diversity: Science, CS, education, build&test
12 STAR STAR: a high-energy physics experiment Need resources with the right configuration Complex environments Consistent environments A virtual OSG STAR cluster OSG cluster: OSG CE (head), gridmapfiles, host certificates, NSF, Torque, worker s: SL4 + STAR Requirements One-click virtual cluster deployment Moving virtual clusters: Science Clouds -> EC2 From proof-of-concept to productions runs Work by Jerome Lauret, Doug Olson, Leve Hajdu, Lidia Didenko at BNL Signinficant productions runs in progress now: results to be published at Quark Matter conference and CHEP
13 Alice HEP Experiment at CERN Collaboration with CERNVM project
14 Making a Hadoop Cloud U of Chicago U of Florida Hadoop cloud Purdue Papers: Sky Computing, by K. Keahey, A. Matsunaga, M. Tsugawa, J. Fortes. Submitted to IEEE Internet Computing. CloudBLAST: Combining MapReduce and Virtualization on Distributed Resources for Bioinformatics Applications by A. Matsunaga, M. Tsugawa and J. Fortes. escience 2008.
15 Thoughts Science-driven cloud computing How does IaaS fit into our world? Combine with what we have (grid computing) Explore new potential Interoperability Academic vs commercial resources Standards: rough consensus & working code Importance of open source Drive requirements into the infrastructure, customize Drive the development of standards
Cloud Computing with Nimbus
Cloud Computing with Nimbus April 2010 Condor Week Kate Keahey keahey@mcs.anl.gov Nimbus Project University of Chicago Argonne National Laboratory Cloud Computing for Science Environment Complexity Consistency
More informationCloud Computing for Science
Cloud Computing for Science August 2009 CoreGrid 2009 Workshop Kate Keahey keahey@mcs.anl.gov Nimbus project lead University of Chicago Argonne National Laboratory Cloud Computing is in the news is it
More informationScience Clouds: Early Experiences in Cloud Computing for Scientific Applications
Science Clouds: Early Experiences in Cloud Computing for Scientific Applications Chicago, October 2008 Kate Keahey, Renato Figueiredo, Jose Fortes, Tim Freeman, Mauricio Tsugawa University of Chicago University
More informationContextualization: Providing One-Click Virtual Clusters
Contextualization: Providing One-Click Virtual Clusters Kate Keahey Tim Freeman Argonne National Laboratory University of Chicago {keahey, tfreeman}@mcs.anl.gov Cloud Computing Infrastructure-as-a-Service
More informationScience Clouds: Early Experiences in Cloud Computing for Scientific Applications
Science Clouds: Early Experiences in Cloud Computing for Scientific Applications K. Keahey 1, R. Figueiredo 2, J. Fortes 2, T. Freeman 1, M. Tsugawa 2 1 University of Chicago, 2 University of Florida Abstract
More informationLarge Scale Sky Computing Applications with Nimbus
Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France Pierre.Riteau@irisa.fr INTRODUCTION TO SKY COMPUTING IaaS
More informationSky Computing on FutureGrid and Grid 5000 with Nimbus. Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France
Sky Computing on FutureGrid and Grid 5000 with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes Bretagne Atlantique Rennes, France Outline Introduction to Sky Computing The Nimbus Project
More informationScience Computing Clouds.
Science Computing Clouds. December 9, 2008 Chan-Hyun Youn School of Engineering/ Grid Middleware Research Center Information and Communications University COPYRIGHT@LANS Lab, Information and Communication
More informationGoing Places with Distributed Computing
Going Places with Distributed Computing ESC Grid Workshop 2007 Kate Keahey University of Chicago Argonne National Laboratory keahey@mcs.anl.gov There is more to Grid applications than running simple batch
More informationInfrastructure Clouds for Science and Education: Platform Tools
Infrastructure Clouds for Science and Education: Platform Tools Kate Keahey, John Bresnahan, Patrick Armstrong, Pierre Riteau Argonne National Laboratory University of Chicago 11/12/2012 1 The Power of
More informationContextualization: Providing One-Click Virtual Clusters
Contextualization: Providing One-Click Virtual Clusters Katarzyna Keahey University of Chicago keahey@mcs.anl.gov Abstract As virtual appliances become more prevalent, we encounter the need to stop manually
More informationVirtual Workspace Appliances
Virtual Workspace Appliances Tim Freeman, Kate Keahey Supercomputing 2006, Tampa, FL tfreeman@mcs.anl.gov Required Environments Diverse client environment requirements Library versions Application versions
More informationScientific Workflows and Cloud Computing. Gideon Juve USC Information Sciences Institute
Scientific Workflows and Cloud Computing Gideon Juve USC Information Sciences Institute gideon@isi.edu Scientific Workflows Loosely-coupled parallel applications Expressed as directed acyclic graphs (DAGs)
More informationJosé Fortes. Advanced Computing and Information Systems laboratory. and NSF Center for Autonomic Computing. HPC 2010 Cetraro
Crosscloud Computing José Fortes Advanced Computing and Information Systems Lab and HPC 2010 Cetraro Clouds Provider view Economies of scale Statistical ti ti multiplexing l i Avoid customer-specific complexities
More informationClouds: An Opportunity for Scientific Applications?
Clouds: An Opportunity for Scientific Applications? Ewa Deelman USC Information Sciences Institute Acknowledgements Yang-Suk Ki (former PostDoc, USC) Gurmeet Singh (former Ph.D. student, USC) Gideon Juve
More informationBeyond the Clouds: Trends in Cloud Compu4ng for Science
Beyond the Clouds: Trends in Cloud Compu4ng for Science Kate Keahey keahey@mcs.anl.gov Argonne National Laboratory Computation Institute, University of Chicago 7/1/13 NIMBUS 1 Cloud Compu4ng: Looking Back
More informationApplication of Virtualization Technologies & CernVM. Benedikt Hegner CERN
Application of Virtualization Technologies & CernVM Benedikt Hegner CERN Virtualization Use Cases Worker Node Virtualization Software Testing Training Platform Software Deployment }Covered today Server
More informationALICE Grid Activities in US
ALICE Grid Activities in US 1 ALICE-USA Computing Project ALICE-USA Collaboration formed to focus on the ALICE EMCal project Construction, installation, testing and integration participating institutions
More informationGaruda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore.
Garuda : The National Grid Computing Initiative Of India Natraj A.C, CDAC Knowledge Park, Bangalore. natraj@cdacb.ernet.in 1 Agenda About CDAC Garuda grid highlights Garuda Foundation Phase EU-India grid
More informationTopics of Discussion
CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture on NIST Cloud Computing Definition, Standards & Roadmap, Security & Privacy Guidelines Spring 2013 A Specialty Course for Purdue
More informationThe OpenNebula Virtual Infrastructure Engine
EGEE 4th User Forum/OGF25 & OGF-Europe's 2nd International Event Catania, Italy Thursday 5 th, March 2009 The OpenNebula Virtual Infrastructure Engine Constantino Vázquez Blanco Distributed Systems Architecture
More informationCS6703 GRID AND CLOUD COMPUTING. Question Bank Unit-I. Introduction
CS6703 GRID AND CLOUD COMPUTING Question Bank Unit-I Introduction Part A 1. Define Grid Computing. 2. Define Cloud Computing. 3. Analyze the working of GPUs. 4. List out the cluster design. 5. Differentiate
More informationAn Introduction to Virtualization and Cloud Technologies to Support Grid Computing
New Paradigms: Clouds, Virtualization and Co. EGEE08, Istanbul, September 25, 2008 An Introduction to Virtualization and Cloud Technologies to Support Grid Computing Distributed Systems Architecture Research
More informationGrids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan
Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security
More information13th International Workshop on Advanced Computing and Analysis Techniques in Physics Research ACAT 2010 Jaipur, India February
LHC Cloud Computing with CernVM Ben Segal 1 CERN 1211 Geneva 23, Switzerland E mail: b.segal@cern.ch Predrag Buncic CERN E mail: predrag.buncic@cern.ch 13th International Workshop on Advanced Computing
More informationLeveraging the InCommon Federation to access the NSF TeraGrid
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois at Urbana-Champaign jbasney@ncsa.uiuc.edu
More informationVMs at a Tier-1 site. EGEE 09, Sander Klous, Nikhef
VMs at a Tier-1 site EGEE 09, 21-09-2009 Sander Klous, Nikhef Contents Introduction Who are we? Motivation Why are we interested in VMs? What are we going to do with VMs? Status How do we approach this
More informationVirtualization. A very short summary by Owen Synge
Virtualization A very short summary by Owen Synge Outline What is Virtulization? What's virtulization good for? What's virtualisation bad for? We had a workshop. What was presented? What did we do with
More informationGrid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationAUTOMATIC ENABLEMENT, COORDINATION AND RESOURCE USAGE PREDICTION OF UNMODIFIED APPLICATIONS ON CLOUDS
AUTOMATIC ENABLEMENT, COORDINATION AND RESOURCE USAGE PREDICTION OF UNMODIFIED APPLICATIONS ON CLOUDS By ANDRÉA MATSUNAGA A DISSERTATION PRESENTED TO THE GRADUATE SCHOOL OF THE UNIVERSITY OF FLORIDA IN
More informationStratusLab Cloud Distribution Installation. Charles Loomis (CNRS/LAL) 3 July 2014
StratusLab Cloud Distribution Installation Charles Loomis (CNRS/LAL) 3 July 2014 StratusLab What is it? Complete IaaS cloud distribution Open source (Apache 2 license) Works well for production private
More informationEGEE and Interoperation
EGEE and Interoperation Laurence Field CERN-IT-GD ISGC 2008 www.eu-egee.org EGEE and glite are registered trademarks Overview The grid problem definition GLite and EGEE The interoperability problem The
More informationAdvanced School in High Performance and GRID Computing November Introduction to Grid computing.
1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste
More informationOn the Use of Cloud Computing for Scientific Workflows
On the Use of Cloud Computing for Scientific Workflows Christina Hoffa 1, Gaurang Mehta 2, Timothy Freeman 3, Ewa Deelman 2, Kate Keahey 3, Bruce Berriman 4, John Good 4 1 Indiana University, 2 University
More informationCOP Cloud Computing. Presented by: Sanketh Beerabbi University of Central Florida
COP6087 - Cloud Computing Presented by: Sanketh Beerabbi University of Central Florida A cloud is a collection of networked resources configured such that users can request scalable resources (VMs, platforms,
More informationIntroduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project
Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.
More informationA Multipolicy Authorization Framework for Grid Security
A Multipolicy Authorization Framework for Grid Security Bo Lang,,2 Ian Foster,,3 Frank Siebenlist,,3 Rachana Ananthakrishnan, Tim Freeman,3 Mathematics and Computer Science Division, Argonne National Laboratory,
More informationCloud Computing and Service-Oriented Architectures
Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 29 - Friday March 22 2013. Cloud precursors
More informationAgenda. Sill, Alan Texas Tech University Workshop Introduction 8:30 AM Recently Released OGF Standards; US Federal and Other Roadmap Efforts
Workshop on High Performance Applications of Cloud and Grid Tools Agenda Sill, Alan Texas Tech University Workshop Introduction 8:30 AM Sill, Alan Texas Tech University Recently Released OGF Standards;
More informationGrid Architectural Models
Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers
More informationAuthentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA.
Authentication for Virtual Organizations: From Passwords to X509, Identity Federation and GridShib BRIITE Meeting Salk Institute, La Jolla CA. November 3th, 2005 Von Welch vwelch@ncsa.uiuc.edu Outline
More information30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
More informationRunning HEP Workloads on Distributed Clouds
Running HEP Workloads on Distributed Clouds R.Seuster, F. Berghaus, K. Casteels, C. Driemel M. Ebert, C. R. Leavett-Brown, M. Paterson, R.Sobie, T. Weiss-Gibson 2017 Fall HEPiX meeting, Tsukuba 16. - 20.
More informationAuthorization Strategies for Virtualized Environments in Grid Computing Systems
Authorization Strategies for Virtualized Environments in Grid Computing Systems Xinming Ou Anna Squicciarini Sebastien Goasguen Elisa Bertino Purdue University Abstract The development of adequate security
More informationVirtual Appliances and Education in FutureGrid. Dr. Renato Figueiredo ACIS Lab - University of Florida
Virtual Appliances and Education in FutureGrid Dr. Renato Figueiredo ACIS Lab - University of Florida Background l Traditional ways of delivering hands-on training and education in parallel/distributed
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationIntroduction, History
Perspective on Campus Usage and Needs: TTU Experience with Grid Computing GGF Production Grid Services Research Group Workshop: Grids on Campus Oct 2-3, 2005 Harvard University Alan Sill Senior Scientist,
More informationSupporting Cloud Computing with the Virtual Block Store System
Supporting Cloud Computing with the Virtual Block Store System Xiaoming Gao, Mike Lowe, Yu Ma, and Marlon Pierce Indiana University Bloomington, Indiana, USA gao4@indiana.edu, jomlowe@iupui.edu, yuma@indiana.edu,
More informationManaging Appliance Launches in Infrastructure Clouds John Bresnahan Mathematics and Computer Science Division Argonne National Laboratory
Managing Appliance Launches in Infrastructure Clouds John Bresnahan Mathematics and Computer Science Division Argonne National Laboratory bresnahan@mcs.anl.gov Tim Freeman Computation Institute University
More informationHPC Cloud at SURFsara
HPC Cloud at SURFsara Offering cloud as a service SURF Research Boot Camp 21st April 2016 Ander Astudillo Markus van Dijk What is cloud computing?
More informationGrid, cloud, and science: Accelerating discovery. A View and Practice from University of Chicago
Grid, cloud, and science: Accelerating discovery A View and Practice from University of Chicago Ian Foster Presented by Ioan Raicu Computation Institute Argonne National Lab & University of Chicago April
More informationModule Day Topic. 1 Definition of Cloud Computing and its Basics
Module Day Topic 1 Definition of Cloud Computing and its Basics 1 2 3 1. How does cloud computing provides on-demand functionality? 2. What is the difference between scalability and elasticity? 3. What
More informationShooting for the sky: Testing the limits of condor. HTCondor Week May 2015 Edgar Fajardo On behalf of OSG Software and Technology
Shooting for the sky: Testing the limits of condor 21 May 2015 Edgar Fajardo On behalf of OSG Software and Technology 1 Acknowledgement Although I am the one presenting. This work is a product of a collaborative
More informationThe LHC Computing Grid
The LHC Computing Grid Gergely Debreczeni (CERN IT/Grid Deployment Group) The data factory of LHC 40 million collisions in each second After on-line triggers and selections, only 100 3-4 MB/event requires
More informationDistributed File System Support for Virtual Machines in Grid Computing
Distributed File System Support for Virtual Machines in Grid Computing Ming Zhao, Jian Zhang, Renato Figueiredo Advanced Computing and Information Systems Electrical and Computer Engineering University
More informationBatch Services at CERN: Status and Future Evolution
Batch Services at CERN: Status and Future Evolution Helge Meinhard, CERN-IT Platform and Engineering Services Group Leader HTCondor Week 20 May 2015 20-May-2015 CERN batch status and evolution - Helge
More informationCloud Computing and Service-Oriented Architectures
Material and some slide content from: - Atif Kahn SERVICES COMPONENTS OBJECTS MODULES Cloud Computing and Service-Oriented Architectures Reid Holmes Lecture 20 - Tuesday November 23 2010. SOA Service-oriented
More informationEuropean Globus Community Forum The Future of Globus in Europe
European Globus Community Forum The Future of Globus in Europe Michael Krieger, RISC Software GmbH Matthias Hofmann, TU Dortmund University Globus usage in Europe Do we need Globus in Europe??? Number
More informationEvolution of the ATLAS PanDA Workload Management System for Exascale Computational Science
Evolution of the ATLAS PanDA Workload Management System for Exascale Computational Science T. Maeno, K. De, A. Klimentov, P. Nilsson, D. Oleynik, S. Panitkin, A. Petrosyan, J. Schovancova, A. Vaniachine,
More informationBy Ian Foster. Zhifeng Yun
By Ian Foster Zhifeng Yun Outline Introduction Globus Architecture Globus Software Details Dev.Globus Community Summary Future Readings Introduction Globus Toolkit v4 is the work of many Globus Alliance
More informationCloud Computing. UCD IT Services Experience
Cloud Computing UCD IT Services Experience Background - UCD IT Services Central IT provider for University College Dublin 23,000 Full Time Students 7,000 Researchers 5,000 Staff Background - UCD IT Services
More informationHybrid Data Security Overview
From day one, data security has been the primary focus in designing Cisco Webex Teams. The cornerstone of this security is end-to-end content encryption, enabled by Webex Teams clients interacting with
More informationWorkflow applications on EGI with WS-PGRADE. Peter Kacsuk and Zoltan Farkas MTA SZTAKI
applications on EGI with WS-PGRADE Peter Kacsuk and Zoltan Farkas MTA SZTAKI kacsuk@sztaki.hu 1 WS-PGRADE/gUSE Generic-purpose gateway framework Based on Liferay General purpose -oriented gateway framework
More informationMonitoring Grid Virtual Machine deployments
University of Victoria Faculty of Engineering Fall 2008 Work Term Report Monitoring Grid Virtual Machine deployments Department of Physics University of Victoria Victoria, BC Michael Paterson 0031209 Work
More informationACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development
ACCI Recommendations on Long Term Cyberinfrastructure Issues: Building Future Development Jeremy Fischer Indiana University 9 September 2014 Citation: Fischer, J.L. 2014. ACCI Recommendations on Long Term
More informationSupporting Application- Tailored Grid File System Sessions with WSRF-Based Services
Supporting Application- Tailored Grid File System Sessions with WSRF-Based Services Ming Zhao, Vineet Chadha, Renato Figueiredo Advanced Computing and Information Systems Electrical and Computer Engineering
More informationUsing Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine
Journal of Physics: Conference Series OPEN ACCESS Using Puppet to contextualize computing resources for ATLAS analysis on Google Compute Engine To cite this article: Henrik Öhman et al 2014 J. Phys.: Conf.
More informationPresented by Wolfgang Ziegler, Open Grid Forum
ETSI SUMMIT ON STANDARDIZATION AND OPEN SOURCE STANDARDIZATION AND OPEN SOURCE Presented by Wolfgang Ziegler, Open Grid Forum About OGF Open global forum for advanced distributed computing OGF is an open
More informationRA-GRS, 130 replication support, ZRS, 130
Index A, B Agile approach advantages, 168 continuous software delivery, 167 definition, 167 disadvantages, 169 sprints, 167 168 Amazon Web Services (AWS) failure, 88 CloudTrail Service, 21 CloudWatch Service,
More informationTHEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap
THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap Arnie Miles Georgetown University adm35@georgetown.edu http://thebes.arc.georgetown.edu The Thebes middleware project was
More informationCernVM-FS. Catalin Condurache STFC RAL UK
CernVM-FS Catalin Condurache STFC RAL UK Outline Introduction Brief history EGI CernVM-FS infrastructure The users Recent developments Plans 2 Outline Introduction Brief history EGI CernVM-FS infrastructure
More informationOn the Use of Cloud Computing for Scientific Workflows
Fourth IEEE International Conference on escience On the Use of Cloud Computing for Scientific Workflows Christina Hoffa 1, Gaurang Mehta 2, Timothy Freeman 3, Ewa Deelman 2, Kate Keahey 3, Bruce Berriman
More informationFlying Low: Simple Leases with Workspace Pilot
Flying Low: Simple Leases with Workspace Pilot Timothy Freeman, Katarzyna Keahey Computation Institute University of Chicago {tfreeman,keahey}@uchicago.edu Abstract. As virtual machines (VMs) are used
More informationEasy Access to Grid Infrastructures
Easy Access to Grid Infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) On behalf of the g-eclipse consortium WP11 Grid Workshop Grenoble, France 09 th of December 2008 Background in astro particle
More informationClouds in High Energy Physics
Clouds in High Energy Physics Randall Sobie University of Victoria Randall Sobie IPP/Victoria 1 Overview Clouds are integral part of our HEP computing infrastructure Primarily Infrastructure-as-a-Service
More informationUsing a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment
Using a dynamic data federation for running Belle-II simulation applications in a distributed cloud environment Marcus Ebert mebert@uvic.ca on behalf of the HEP-RC UVic group: Frank Berghaus, Kevin Casteels,
More informationAccess the power of Grid with Eclipse
Access the power of Grid with Eclipse Harald Kornmayer (Forschungszentrum Karlsruhe GmbH) Markus Knauer (Innoopract GmbH) October 11th, 2006, Eclipse Summit, Esslingen 2006 by H. Kornmayer, M. Knauer;
More informationSome thoughts on the evolution of Grid and Cloud computing
Some thoughts on the evolution of Grid and Cloud computing D. Salomoni INFN Tier-1 Computing Manager Davide.Salomoni@cnaf.infn.it SuperB Computing R&D Workshop - Ferrara, 9-12 March, 2010 D. Salomoni (INFN-CNAF)
More informationOverview of ATLAS PanDA Workload Management
Overview of ATLAS PanDA Workload Management T. Maeno 1, K. De 2, T. Wenaus 1, P. Nilsson 2, G. A. Stewart 3, R. Walker 4, A. Stradling 2, J. Caballero 1, M. Potekhin 1, D. Smith 5, for The ATLAS Collaboration
More informationUAB IT Academic Computing
UAB IT Academic Computing David L Shealy, Director Jill Gemmill, Asst. Director John-Paul Robinson, System Programmer Lead Mission Provide leadership for UAB research community while interfacing important
More informationClouds at other sites T2-type computing
Clouds at other sites T2-type computing Randall Sobie University of Victoria Randall Sobie IPP/Victoria 1 Overview Clouds are used in a variety of ways for Tier-2 type computing MC simulation, production
More informationTHE WIDE AREA GRID. Architecture
THE WIDE AREA GRID Architecture Context The Wide Area Grid concept was discussed during several WGISS meetings The idea was to imagine and experiment an infrastructure that could be used by agencies to
More informationReport for the GGF 15 Community Activity: Leveraging Site Infrastructure for Multi-Site Grids
GFD-I.089 Von Welch, NCSA (Editor) October 6, 2005 Report for the GGF 15 Community Activity: Leveraging Site Infrastructure for Multi-Site Grids Copyright Open Grid Forum (2006-2007). All Rights Reserved.
More informationGlobus GTK and Grid Services
Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature
More informationPROOF as a Service on the Cloud: a Virtual Analysis Facility based on the CernVM ecosystem
PROOF as a Service on the Cloud: a Virtual Analysis Facility based on the CernVM ecosystem D Berzano, J Blomer, P Buncic, I Charalampidis, G Ganis, G Lestaris, R Meusel CERN PH-SFT CERN, CH-1211 Geneva
More informationUsing CernVM-FS to deploy Euclid processing S/W on Science Data Centres
Using CernVM-FS to deploy Euclid processing S/W on Science Data Centres M. Poncet (CNES) Q. Le Boulc h (IN2P3) M. Holliman (ROE) On behalf of Euclid EC SGS System Team ADASS 2016 1 Outline Euclid Project
More informationResearch e-infrastructures in Czech Republic (e-infra CZ) for scientific computations, collaborative research & research support
Research e-infrastructures in Czech Republic (e-infra CZ) for scientific computations, collaborative research & research support Tomáš Rebok CERIT-SC, Institute of Computer Science MU MetaCentrum, CESNET
More informationarxiv: v1 [cs.dc] 7 Apr 2014
arxiv:1404.1814v1 [cs.dc] 7 Apr 2014 CernVM Online and Cloud Gateway: a uniform interface for CernVM contextualization and deployment G Lestaris 1, I Charalampidis 2, D Berzano, J Blomer, P Buncic, G Ganis
More informationGrid Security: The Globus Perspective
Grid Security: The Globus Perspective GlobusWORLD 2005 Feb 7-11, Boston, MA Frank Siebenlist - ANL (franks@mcs.anl.gov) Von Welch - NCSA (welch@ncsa.uiuc.edu) http://www.globus.org/ Outline Part One: Von
More informationOpen Grid Forum. OGF s Role in the Community
Open Grid Forum OGF s Role in the Community Alan Sill Senior Scientist, High Performance Computing Center and Adjunct Professor of Physics, Texas Tech University Vice President of Standards, Open Grid
More informationIntroduction to Cloud Computing. [thoughtsoncloud.com] 1
Introduction to Cloud Computing [thoughtsoncloud.com] 1 Outline What is Cloud Computing? Characteristics of the Cloud Computing model Evolution of Cloud Computing Cloud Computing Architecture Cloud Services:
More informationS.No QUESTIONS COMPETENCE LEVEL UNIT -1 PART A 1. Illustrate the evolutionary trend towards parallel distributed and cloud computing.
VALLIAMMAI ENGNIEERING COLLEGE SRM Nagar, Kattankulathur 603203. DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING Year & Semester : IV & VII Section : CSE -1& 2 Subject Code : CS6703 Subject Name : Grid
More informationIaaS Framework Agreements Pan-European Cloud Services ready for adoption
IaaS Framework Agreements Pan-European Cloud Services ready for adoption Dr. Jakob Tendel GÉANT Cloud Service Delivery Team German Research Network DFN Belnet Networking Conference, Brussels 18 th Oct.
More informationVirtualization of the ATLAS Tier-2/3 environment on the HPC cluster NEMO
Virtualization of the ATLAS Tier-2/3 environment on the HPC cluster NEMO Ulrike Schnoor (CERN) Anton Gamel, Felix Bührer, Benjamin Rottler, Markus Schumacher (University of Freiburg) February 02, 2018
More informationGlobus Toolkit 4 Execution Management. Alexandra Jimborean International School of Informatics Hagenberg, 2009
Globus Toolkit 4 Execution Management Alexandra Jimborean International School of Informatics Hagenberg, 2009 2 Agenda of the day Introduction to Globus Toolkit and GRAM Zoom In WS GRAM Usage Guide Architecture
More informationGrid Services and the Globus Toolkit
Grid Services and the Globus Toolkit Lisa Childers childers@mcs.anl.gov The Globus Alliance Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved. This
More informationVC3. Virtual Clusters for Community Computation. DOE NGNS PI Meeting September 27-28, 2017
VC3 Virtual Clusters for Community Computation DOE NGNS PI Meeting September 27-28, 2017 Douglas Thain, University of Notre Dame Rob Gardner, University of Chicago John Hover, Brookhaven National Lab A
More informationTroubleshooting Grid authentication from the client side
Troubleshooting Grid authentication from the client side By Adriaan van der Zee RP1 presentation 2009-02-04 Contents The Grid @NIKHEF The project Grid components and interactions X.509 certificates, proxies
More informationICN for Cloud Networking. Lotfi Benmohamed Advanced Network Technologies Division NIST Information Technology Laboratory
ICN for Cloud Networking Lotfi Benmohamed Advanced Network Technologies Division NIST Information Technology Laboratory Information-Access Dominates Today s Internet is focused on point-to-point communication
More informationCHAPTER 2 LITERATURE REVIEW AND BACKGROUND
8 CHAPTER 2 LITERATURE REVIEW AND BACKGROUND 2.1 LITERATURE REVIEW Several researches have been carried out in Grid Resource Management and some of the existing research works closely related to this thesis
More information