[workshop welcome graphics]

Size: px
Start display at page:

Download "[workshop welcome graphics]"

Transcription

1 [workshop welcome graphics] 1

2 Hands-On-Globus Overview Agenda I. What is a grid? II. III. IV. Globus structure Use cases & Hands on! AIP: Status and Plans 2

3 Introduction I: What is a Grid? 3

4 Old and new networks 7

5 Next step: Resource sharing: information processing power out of the socket $ submit_job submitting job requisitioning 7.3 Exaflops job successful. $ publish_paper compiling & publishing review process 2006.nature.447.pp OK. 8

6 What Resources can be shared? Efficient use of: CPU-Power storage space special hardware (sensors, telescopes, robots) installed applications and licenses Advantages: load balancing, scaling redundancy increased reliability uniform protocol interface for arbitrary resources 9

7 Again: What is a Grid? a.k.a. meta computing, distributed [parallel] computing A buzz word? A grid distributes, manages and coordiates resource sharing and collaboration without centralised control. A grid uses standardised, open, general-purpose protocols and interfaces. It can be (very) inhomogenious It includes security mechanisms, even though being spread out over multiple diverse domains. It is used for professional work It is more than the sum of ist parts and non-trivial. A grid is computers plus the internet plus some more things 10

8 A grid or not a grid? Operating Systems + the internet?? - client-server architecture, no automated network-wide components Botnets (for spamming or DOS-Attacks)? - centrally organised Peer-to-peer networks? - function limited to data sharing Cluster? - too homogenius, specialised and centralised. Localised, different operating and security systems (but a good thing anyway) SETI project or BOINC ( CPUs!)? - limited function, no cooperation. A low-end grid? 11

9 Peak of inflated expectations WherePeak are we on the Hype Curve? Gardner Group (US IT consulting company) August 2005 Trough of disillusionment 12

10 Middleware can you see it? or: that s all very nice, but the devil is in the details Grid middleware is a set of programs: demons, shell scripts, servers, java servlets, etc. Middleware software is focused to perform specific tasks within the grid The middleware extends the operating system to allow: dedicated servers to perform automated management tasks a machine to become part of the grid and share resources a user to access and use the grid. 13

11 Introduction II: Globus Components 14

12 Globus history 1998: Globus V1.0; currently V4.03. Work in progress Communities: Globus Alliance, Open Grid Forum de-facto standard in science, core elements are stable written mostly in C, web service layers Java and Python uses XML for web service documents open source Globus is the plumbing standard of the grid, a set of blocks and tools. Remember that grid resources are not very homogenious. 15

13 Main Globus Elements User Execution Management Status Information Service Globus Security Infrastructure Data Management Job Management Job Monitoring Resource Hardware: computers, storage, sensors provide: operating system, network access allow: program execution, local user management Globus Toolkit Middleware 17

14 The Globus Toolkit: Component Overview About a dozen core commands for command line Many services are available in different versions: as command line service and additionally as web (augmented) service. Some are just grid-improved versions of unix a commands They often use batch scripts (RLS, XML), models exist Lots of acronyms see handout! 19

15 Does all that work together (at least in theory)? [Cern grid flash] 23

NUSGRID a computational grid at NUS

NUSGRID a computational grid at NUS NUSGRID a computational grid at NUS Grace Foo (SVU/Academic Computing, Computer Centre) SVU is leading an initiative to set up a campus wide computational grid prototype at NUS. The initiative arose out

More information

Cloud Computing. Up until now

Cloud Computing. Up until now Cloud Computing Lecture 4 and 5 Grid: 2012-2013 Introduction. Up until now Definition of Cloud Computing. Grid Computing: Schedulers: Condor SGE 1 Summary Core Grid: Toolkit Condor-G Grid: Conceptual Architecture

More information

Managing CAE Simulation Workloads in Cluster Environments

Managing CAE Simulation Workloads in Cluster Environments Managing CAE Simulation Workloads in Cluster Environments Michael Humphrey V.P. Enterprise Computing Altair Engineering humphrey@altair.com June 2003 Copyright 2003 Altair Engineering, Inc. All rights

More information

Grid Scheduling Architectures with Globus

Grid Scheduling Architectures with Globus Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents

More information

Database code in PL-SQL PL-SQL was used for the database code. It is ready to use on any Oracle platform, running under Linux, Windows or Solaris.

Database code in PL-SQL PL-SQL was used for the database code. It is ready to use on any Oracle platform, running under Linux, Windows or Solaris. Alkindi Software Technology Introduction Alkindi designed a state of the art collaborative filtering system to work well for both largeand small-scale systems. This document serves as an overview of how

More information

New trends in Identity Management

New trends in Identity Management New trends in Identity Management Peter Gietz, DAASI International GmbH peter.gietz@daasi.de Track on Research and Education Networking in South East Europe, Yu Info 2007, Kopaionik, Serbia 14 March 2007

More information

Volunteer Computing at CERN

Volunteer Computing at CERN Volunteer Computing at CERN BOINC workshop Sep 2014, Budapest Tomi Asp & Pete Jones, on behalf the LHC@Home team Agenda Overview Status of the LHC@Home projects Additional BOINC projects Service consolidation

More information

Grid Challenges and Experience

Grid Challenges and Experience Grid Challenges and Experience Heinz Stockinger Outreach & Education Manager EU DataGrid project CERN (European Organization for Nuclear Research) Grid Technology Workshop, Islamabad, Pakistan, 20 October

More information

Grid Compute Resources and Job Management

Grid Compute Resources and Job Management Grid Compute Resources and Job Management How do we access the grid? Command line with tools that you'll use Specialised applications Ex: Write a program to process images that sends data to run on the

More information

Advanced School in High Performance and GRID Computing November Introduction to Grid computing.

Advanced School in High Performance and GRID Computing November Introduction to Grid computing. 1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste

More information

Introduction to Grid Computing

Introduction to Grid Computing Milestone 2 Include the names of the papers You only have a page be selective about what you include Be specific; summarize the authors contributions, not just what the paper is about. You might be able

More information

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi

GRIDS INTRODUCTION TO GRID INFRASTRUCTURES. Fabrizio Gagliardi GRIDS INTRODUCTION TO GRID INFRASTRUCTURES Fabrizio Gagliardi Dr. Fabrizio Gagliardi is the leader of the EU DataGrid project and designated director of the proposed EGEE (Enabling Grids for E-science

More information

Easy Access to Grid Infrastructures

Easy Access to Grid Infrastructures Easy Access to Grid Infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) On behalf of the g-eclipse consortium WP11 Grid Workshop Grenoble, France 09 th of December 2008 Background in astro particle

More information

Grid Services and the Globus Toolkit

Grid Services and the Globus Toolkit Grid Services and the Globus Toolkit Lisa Childers childers@mcs.anl.gov The Globus Alliance Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved. This

More information

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms

Grid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem

More information

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007

Grid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007 Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software

More information

Grids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan

Grids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security

More information

Setting up DELTA in a heterogenous TELCO SDN Environment. Sebastian Dittrich, Telekom Security

Setting up DELTA in a heterogenous TELCO SDN Environment. Sebastian Dittrich, Telekom Security Setting up DELTA in a heterogenous TELCO SDN Environment Sebastian Dittrich, Telekom Security AGENDA 01 Introduction 02 Network Transformation @ DT 03 Setting up DELTA Used hard- and software DELTA architecture

More information

In this unit we are going to speak about how computers use the networks to work together. There are several models (that in some cases are called

In this unit we are going to speak about how computers use the networks to work together. There are several models (that in some cases are called In this unit we are going to speak about how computers use the networks to work together. There are several models (that in some cases are called architectures) that computers can follow when they collaborate

More information

Grid Computing: Status and Perspectives. Alexander Reinefeld Florian Schintke. Outline MOTIVATION TWO TYPICAL APPLICATION DOMAINS

Grid Computing: Status and Perspectives. Alexander Reinefeld Florian Schintke. Outline MOTIVATION TWO TYPICAL APPLICATION DOMAINS Grid Computing: Status and Perspectives Alexander Reinefeld Florian Schintke Schwerpunkte der Informatik" Ringvorlesung am 05.06.2003 1 Outline MOTIVATION o What s a Grid? Why using Grids? TWO TYPICAL

More information

Monitoring ARC services with GangliARC

Monitoring ARC services with GangliARC Journal of Physics: Conference Series Monitoring ARC services with GangliARC To cite this article: D Cameron and D Karpenko 2012 J. Phys.: Conf. Ser. 396 032018 View the article online for updates and

More information

Kenneth A. Hawick P. D. Coddington H. A. James

Kenneth A. Hawick P. D. Coddington H. A. James Student: Vidar Tulinius Email: vidarot@brandeis.edu Distributed frameworks and parallel algorithms for processing large-scale geographic data Kenneth A. Hawick P. D. Coddington H. A. James Overview Increasing

More information

SwinDeW-G (Swinburne Decentralised Workflow for Grid) System Architecture. Authors: SwinDeW-G Team Contact: {yyang,

SwinDeW-G (Swinburne Decentralised Workflow for Grid) System Architecture. Authors: SwinDeW-G Team Contact: {yyang, SwinDeW-G (Swinburne Decentralised Workflow for Grid) System Architecture Authors: SwinDeW-G Team Contact: {yyang, jchen}@swin.edu.au Date: 05/08/08 1. Introduction SwinDeW-G is a scientific workflow management

More information

REACH-IT Stakeholder Workshop. REACH-IT Architecture

REACH-IT Stakeholder Workshop. REACH-IT Architecture REACH-IT Stakeholder Workshop REACH-IT Architecture Aims of the presentation Introduce to the architecture of the REACH-IT application from different, complementary angles Functional [ Use Case and Logical

More information

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager

The University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or

More information

WLCG Lightweight Sites

WLCG Lightweight Sites WLCG Lightweight Sites Mayank Sharma (IT-DI-LCG) 3/7/18 Document reference 2 WLCG Sites Grid is a diverse environment (Various flavors of CE/Batch/WN/ +various preferred tools by admins for configuration/maintenance)

More information

Scientific data processing at global scale The LHC Computing Grid. fabio hernandez

Scientific data processing at global scale The LHC Computing Grid. fabio hernandez Scientific data processing at global scale The LHC Computing Grid Chengdu (China), July 5th 2011 Who I am 2 Computing science background Working in the field of computing for high-energy physics since

More information

Monitoring the Usage of the ZEUS Analysis Grid

Monitoring the Usage of the ZEUS Analysis Grid Monitoring the Usage of the ZEUS Analysis Grid Stefanos Leontsinis September 9, 2006 Summer Student Programme 2006 DESY Hamburg Supervisor Dr. Hartmut Stadie National Technical

More information

Index Introduction Setting up an account Searching and accessing Download Advanced features

Index Introduction Setting up an account Searching and accessing Download Advanced features ESGF Earth System Grid Federation Tutorial Index Introduction Setting up an account Searching and accessing Download Advanced features Index Introduction IT Challenges of Climate Change Research ESGF Introduction

More information

Report on the HEPiX Virtualisation Working Group

Report on the HEPiX Virtualisation Working Group Report on the HEPiX Virtualisation Working Group Thomas Finnern Owen Synge (DESY/IT) The Arts of Virtualization > Operating System Virtualization Core component of today s IT infrastructure > Application

More information

BeSTGRID. TEC IDF Fund. BeSTGRID planning began over 3 years ago. TEC Innovation and Development Fund. $2.5million: Sep 2006 March 2008

BeSTGRID. TEC IDF Fund. BeSTGRID planning began over 3 years ago. TEC Innovation and Development Fund. $2.5million: Sep 2006 March 2008 BeSTGRID www.bestgrid.org Nick Jones Project Manager, BeSTGRID Centre for Software Innovation, University of Auckland n.jones@auckland.ac.nz Sam Searle e Research Development Coordinator Victoria University

More information

Managing complex cluster architectures with Bright Cluster Manager

Managing complex cluster architectures with Bright Cluster Manager Managing complex cluster architectures with Bright Cluster Manager Christopher Huggins www.clustervision.com 1 About ClusterVision Specialists in Compute, Storage & Database Clusters (Tailor-Made, Turn-Key)

More information

OVERVIEW OF DIFFERENT APPLICATION SERVER MODELS

OVERVIEW OF DIFFERENT APPLICATION SERVER MODELS OVERVIEW OF DIFFERENT APPLICATION SERVER MODELS Before you start Objectives: learn what is application server, what is thin-client and what is fat-client, and about different types of application server

More information

The Virtual Observatory and the IVOA

The Virtual Observatory and the IVOA The Virtual Observatory and the IVOA The Virtual Observatory Emergence of the Virtual Observatory concept by 2000 Concerns about the data avalanche, with in mind in particular very large surveys such as

More information

CSinParallel Workshop. OnRamp: An Interactive Learning Portal for Parallel Computing Environments

CSinParallel Workshop. OnRamp: An Interactive Learning Portal for Parallel Computing Environments CSinParallel Workshop : An Interactive Learning for Parallel Computing Environments Samantha Foley ssfoley@cs.uwlax.edu http://cs.uwlax.edu/~ssfoley Josh Hursey jjhursey@cs.uwlax.edu http://cs.uwlax.edu/~jjhursey/

More information

OEM Provisioning An Introduction

OEM Provisioning An Introduction OEM Provisioning An Introduction Rob Zoeteweij 09-07-2009 1 Agenda Introduction Concepts Framework Break Out of the Box Q & A 09-07-2009 2 Agenda Introduction Concepts Framework Break Out of the Box Q

More information

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT.

Chapter 4:- Introduction to Grid and its Evolution. Prepared By:- NITIN PANDYA Assistant Professor SVBIT. Chapter 4:- Introduction to Grid and its Evolution Prepared By:- Assistant Professor SVBIT. Overview Background: What is the Grid? Related technologies Grid applications Communities Grid Tools Case Studies

More information

A DAQ system for CAMAC controller CC/NET using DAQ-Middleware

A DAQ system for CAMAC controller CC/NET using DAQ-Middleware Journal of Physics: Conference Series A DAQ system for CAMAC controller CC/NET using DAQ-Middleware To cite this article: E Inoue et al 2010 J. Phys.: Conf. Ser. 219 022036 Related content - Development

More information

Trivial And Non-Trivial Data Analysis for Geant4

Trivial And Non-Trivial Data Analysis for Geant4 Trivial And Non-Trivial Data Analysis for Geant4 Paul Guèye, HU Joseph Perl, SLAC 1 Simplest using text (ASCII) files Analysis Choices Geant4 does not attempt to provide its own data analysis tools, focusing

More information

JOB SUBMISSION ON GRID

JOB SUBMISSION ON GRID arxiv:physics/0701101v2 [physics.comp-ph] 12 Jan 2007 JOB SUBMISSION ON GRID An Users Introduction Rudra Banerjee ADVANCED COMPUTING LAB. Dept. of Physics, University of Pune March 13, 2018 Contents preface

More information

User Tools and Languages for Graph-based Grid Workflows

User Tools and Languages for Graph-based Grid Workflows User Tools and Languages for Graph-based Grid Workflows User Tools and Languages for Graph-based Grid Workflows Global Grid Forum 10 Berlin, Germany Grid Workflow Workshop Andreas Hoheisel (andreas.hoheisel@first.fraunhofer.de)

More information

N. Marusov, I. Semenov

N. Marusov, I. Semenov GRID TECHNOLOGY FOR CONTROLLED FUSION: CONCEPTION OF THE UNIFIED CYBERSPACE AND ITER DATA MANAGEMENT N. Marusov, I. Semenov Project Center ITER (ITER Russian Domestic Agency N.Marusov@ITERRF.RU) Challenges

More information

A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme

A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme A Resource Discovery Algorithm in Mobile Grid Computing Based on IP-Paging Scheme Yue Zhang 1 and Yunxia Pei 2 1 Department of Math and Computer Science Center of Network, Henan Police College, Zhengzhou,

More information

The PRISM infrastructure System Architecture and User Interface

The PRISM infrastructure System Architecture and User Interface The PRISM infrastructure System Architecture and User Interface Claes Larsson ECMWF UK PRISM Hamburg D&M presentation p.1/20 Architecture goals PRISM architecture to provide an efficient climate modelling

More information

dcache Introduction Course

dcache Introduction Course GRIDKA SCHOOL 2013 KARLSRUHER INSTITUT FÜR TECHNOLOGIE KARLSRUHE August 29, 2013 dcache Introduction Course Overview Chapters I, II and Ⅴ christoph.anton.mitterer@lmu.de I. Introduction To dcache Slide

More information

The Beauty and Joy of Computing

The Beauty and Joy of Computing The Beauty and Joy of Computing Lecture #19 Distributed Computing UC Berkeley Sr Lecturer SOE Dan By the end of the decade, we re going to see computers that can compute one exaflop (recall kilo, mega,

More information

ELECTRICAL NETWORK SUPERVISOR STATUS REPORT

ELECTRICAL NETWORK SUPERVISOR STATUS REPORT EUROPEAN ORGANIZATION FOR NUCLEAR RESEARCH ORGANISATION EUROPÉENNE POUR LA RECHERCHE NUCLÉAIRE CERN - ST Division CERN-ST-2001-018 30 January 2001 ELECTRICAL NETWORK SUPERVISOR STATUS REPORT S. Poulsen

More information

Redesigning CERT.at s incident handling capabilities cherrypicking and learning from AH and Megatron

Redesigning CERT.at s incident handling capabilities cherrypicking and learning from AH and Megatron Redesigning CERT.at s incident handling capabilities cherrypicking and learning from AH and Megatron L. Aaron Kaplan 2012/04/25 1 Disclaimer / Motivation I am not an AH expert I am not

More information

ARC-XWCH bridge: Running ARC jobs on the XtremWeb-CH volunteer

ARC-XWCH bridge: Running ARC jobs on the XtremWeb-CH volunteer ARC-XWCH bridge: Running ARC jobs on the XtremWeb-CH volunteer computing platform Internal report Marko Niinimaki, Mohamed BenBelgacem, Nabil Abdennadher HEPIA, January 2010 1. Background and motivation

More information

Trivial Data Analysis for Geant4 Geant4 v9.3p01

Trivial Data Analysis for Geant4 Geant4 v9.3p01 Trivial Data Analysis for Geant4 Geant4 v9.3p01 Joseph Perl, SLAC 1 Simple Analysis This Week Geant4 does not attempt to provide its own data analysis tools, focusing instead on its central mission as

More information

Attacking & Protecting Big Data Environments

Attacking & Protecting Big Data Environments Attacking & Protecting Big Data Environments Birk Kauer & Matthias Luft {bkauer, mluft}@ernw.de #WhoAreWe Birk Kauer - Security Researcher @ERNW - Mainly Exploit Developer Matthias Luft - Security Researcher

More information

ELFms industrialisation plans

ELFms industrialisation plans ELFms industrialisation plans CERN openlab workshop 13 June 2005 German Cancio CERN IT/FIO http://cern.ch/elfms ELFms industrialisation plans, 13/6/05 Outline Background What is ELFms Collaboration with

More information

In this third unit about jobs in the Information Technology field we will speak about software development

In this third unit about jobs in the Information Technology field we will speak about software development In this third unit about jobs in the Information Technology field we will speak about software development 1 The IT professionals involved in the development of software applications can be generically

More information

How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework

How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework Piotr Dziubecki, Piotr Grabowski, Michał Krysiński, Tomasz Kuczyński, Dawid Szejnfeld, Dominik Tarnawczyk, Gosia Wolniewicz

More information

ECE397A Operating Systems. Chapter 1: Introduction

ECE397A Operating Systems. Chapter 1: Introduction ECE397A Operating Systems Welcome! Instructor: Professor Csaba Andras Moritz Class webpage: http://www.ecs.umass.edu/ece/andras/courses/ece397 Instructors webpage: http://www.ecs.umass.edu/ece/andras 3

More information

Bluemin: A Suite for Management of PC Clusters

Bluemin: A Suite for Management of PC Clusters Bluemin: A Suite for Management of PC Clusters Hai Jin, Hao Zhang, Qincheng Zhang, Baoli Chen, Weizhong Qiang School of Computer Science and Engineering Huazhong University of Science and Technology Wuhan,

More information

UNICORE Globus: Interoperability of Grid Infrastructures

UNICORE Globus: Interoperability of Grid Infrastructures UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057

More information

Open-source library and tools to support the OVF.

Open-source library and tools to support the OVF. Open OVF Proposal Open-source library and tools to support the OVF http://xml.coverpages.org/ni2007-09-11-a.html IBM will be donating code and invites all to form an open community around OVF Eclipse Public

More information

The LGI Pilot job portal. EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers

The LGI Pilot job portal. EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers The LGI Pilot job portal EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers Outline What? Why? How? Pro's and Cons What's next? Credits 2 What is LGI? LGI Project Server

More information

Grid Computing. Grid Computing 2

Grid Computing. Grid Computing 2 Grid Computing Mahesh Joshi joshi031@d.umn.edu Presentation for Graduate Course in Advanced Computer Architecture 28 th April 2005 Objective Overview of the concept and related aspects Some practical implications

More information

Ivane Javakhishvili Tbilisi State University High Energy Physics Institute HEPI TSU

Ivane Javakhishvili Tbilisi State University High Energy Physics Institute HEPI TSU Ivane Javakhishvili Tbilisi State University High Energy Physics Institute HEPI TSU Grid cluster at the Institute of High Energy Physics of TSU Authors: Arnold Shakhbatyan Prof. Zurab Modebadze Co-authors:

More information

ATLAS NorduGrid related activities

ATLAS NorduGrid related activities Outline: NorduGrid Introduction ATLAS software preparation and distribution Interface between NorduGrid and Condor NGlogger graphical interface On behalf of: Ugur Erkarslan, Samir Ferrag, Morten Hanshaugen

More information

Case Studies in Storage Access by Loosely Coupled Petascale Applications

Case Studies in Storage Access by Loosely Coupled Petascale Applications Case Studies in Storage Access by Loosely Coupled Petascale Applications Justin M Wozniak and Michael Wilde Petascale Data Storage Workshop at SC 09 Portland, Oregon November 15, 2009 Outline Scripted

More information

Compact Muon Solenoid: Cyberinfrastructure Solutions. Ken Bloom UNL Cyberinfrastructure Workshop -- August 15, 2005

Compact Muon Solenoid: Cyberinfrastructure Solutions. Ken Bloom UNL Cyberinfrastructure Workshop -- August 15, 2005 Compact Muon Solenoid: Cyberinfrastructure Solutions Ken Bloom UNL Cyberinfrastructure Workshop -- August 15, 2005 Computing Demands CMS must provide computing to handle huge data rates and sizes, and

More information

Chapter-1: Exercise Solution

Chapter-1: Exercise Solution Chapter-1: Exercise Solution 1.1 In a multiprogramming and time-sharing environment, several users share the system simultaneously. This situation can result in various security problems. a. What are two

More information

The Beauty and Joy of Computing

The Beauty and Joy of Computing The Beauty and Joy of Computing Lecture #18 Distributed Computing UC Berkeley Sr Lecturer SOE Dan By the end of the decade, we re going to see computers that can compute one exaflop (recall kilo, mega,

More information

GAIA CU6 Bruxelles Meeting (12-13 october 2006)

GAIA CU6 Bruxelles Meeting (12-13 october 2006) GAIA CU6 Bruxelles Meeting (12-13 october 2006) Preparation of CNES DPC Infrastructure Technology studies prepared by F. Jocteur Monrozier Context: GAIA CNES Infrastructure: Functional blocks import /

More information

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE Aleksandar Belić Scientific Computing Laboratory Institute of Physics EGEE Introduction EGEE = Enabling Grids for

More information

UNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus

UNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus UNIT IV PROGRAMMING MODEL Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus Globus: One of the most influential Grid middleware projects is the Globus

More information

Advanced Grid Technologies, Services & Systems: Research Priorities and Objectives of WP

Advanced Grid Technologies, Services & Systems: Research Priorities and Objectives of WP Advanced Grid Technologies, Services & Systems: Research Priorities and Objectives of WP 2005-06 06 IST Call 5 Preparatory Workshop Brussels, 31 Jan 1 Feb 2005 Enabling application Max Lemke Deputy Head

More information

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project

Introduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.

More information

Meeting researchers needs in mining web archives: the experience of the National Library of France

Meeting researchers needs in mining web archives: the experience of the National Library of France Meeting researchers needs in mining web archives: the experience of the National Library of France Sara Aubry, IT Department Peter Stirling, Legal Deposit Department Bibliothèque nationale de France LIBER

More information

DataFinder A Scientific Data Management Solution ABSTRACT

DataFinder A Scientific Data Management Solution ABSTRACT DataFinder A Scientific Data Management Solution Tobias Schlauch (1), Andreas Schreiber (2) (1) German Aerospace Center (DLR) Simulation and Software Technology Lilienthalplatz 7, D-38108 Braunschweig,

More information

Screencast: What is [Open] MPI?

Screencast: What is [Open] MPI? Screencast: What is [Open] MPI? Jeff Squyres May 2008 May 2008 Screencast: What is [Open] MPI? 1 What is MPI? Message Passing Interface De facto standard Not an official standard (IEEE, IETF, ) Written

More information

Screencast: What is [Open] MPI? Jeff Squyres May May 2008 Screencast: What is [Open] MPI? 1. What is MPI? Message Passing Interface

Screencast: What is [Open] MPI? Jeff Squyres May May 2008 Screencast: What is [Open] MPI? 1. What is MPI? Message Passing Interface Screencast: What is [Open] MPI? Jeff Squyres May 2008 May 2008 Screencast: What is [Open] MPI? 1 What is MPI? Message Passing Interface De facto standard Not an official standard (IEEE, IETF, ) Written

More information

Web Engineering. Introduction. Husni

Web Engineering. Introduction. Husni Web Engineering Introduction Husni Husni@trunojoyo.ac.id Outline What is Web Engineering? Evolution of the Web Challenges of Web Engineering In the early days of the Web, we built systems using informality,

More information

JAMS 7.X Getting Started Guide

JAMS 7.X Getting Started Guide Table of Contents JAMS Overview 2 Working with Servers 3-4 The JAMS Client Interface 5 JAMS Scheduler Overview 6 Defining Folders and Jobs 7-10 1 2018 MVP Systems Software, Inc. All Rights Reserved. JAMS

More information

XRAY Grid TO BE OR NOT TO BE?

XRAY Grid TO BE OR NOT TO BE? XRAY Grid TO BE OR NOT TO BE? 1 I was not always a Grid sceptic! I started off as a grid enthusiast e.g. by insisting that Grid be part of the ESRF Upgrade Program outlined in the Purple Book : In this

More information

Exploiting peer group concept for adaptive and highly available services

Exploiting peer group concept for adaptive and highly available services Computing in High Energy and Nuclear Physics, 24-28 March 2003 La Jolla California 1 Exploiting peer group concept for adaptive and highly available services Muhammad Asif Jan Centre for European Nuclear

More information

Energy efficient mapping of virtual machines

Energy efficient mapping of virtual machines GreenDays@Lille Energy efficient mapping of virtual machines Violaine Villebonnet Thursday 28th November 2013 Supervisor : Georges DA COSTA 2 Current approaches for energy savings in cloud Several actions

More information

Grid Computing Security hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1

Grid Computing Security hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1 Grid Computing Security 20.10.2006 hack.lu 2006 :: Security in Grid Computing :: Lisa Thalheim 1 What to expect from this talk Collection of bits about GC I thought you might find interesting Mixed bag:

More information

A Short Course on Geant4 Simulation Toolkit. How to learn more?

A Short Course on Geant4 Simulation Toolkit. How to learn more? A Short Course on Geant4 Simulation Toolkit How to learn more? http://cern.ch/geant4 After the course How can you get more information about Geant4? Documentation User support Geant4 Web Home Page The

More information

The Design of a State Machine of Controlling the ALICE s Online-Offline Compute Platform. Sirapop Na Ranong

The Design of a State Machine of Controlling the ALICE s Online-Offline Compute Platform. Sirapop Na Ranong The Design of a State Machine of Controlling the ALICE s Online-Offline Compute Platform Sirapop Na Ranong Control, Configuration and Monitoring The Functional Requirement of Control System Responsible

More information

Introduction to HPC Resources and Linux

Introduction to HPC Resources and Linux Introduction to HPC Resources and Linux Burak Himmetoglu Enterprise Technology Services & Center for Scientific Computing e-mail: bhimmetoglu@ucsb.edu Paul Weakliem California Nanosystems Institute & Center

More information

Accessing the Jobs Fund Online Application Portal

Accessing the Jobs Fund Online Application Portal Accessing the Jobs Fund Online Application Portal Welcome to the Jobs Fund Online Application Portal. Please go through the instructions and screen shots, they will make the process of submitting your

More information

Non-Uniform Memory Access (NUMA) Architecture and Multicomputers

Non-Uniform Memory Access (NUMA) Architecture and Multicomputers Non-Uniform Memory Access (NUMA) Architecture and Multicomputers Parallel and Distributed Computing Department of Computer Science and Engineering (DEI) Instituto Superior Técnico February 29, 2016 CPD

More information

Day 9: Introduction to CHTC

Day 9: Introduction to CHTC Day 9: Introduction to CHTC Suggested reading: Condor 7.7 Manual: http://www.cs.wisc.edu/condor/manual/v7.7/ Chapter 1: Overview Chapter 2: Users Manual (at most, 2.1 2.7) 1 Turn In Homework 2 Homework

More information

Customized way of Resource Discovery in a Campus Grid

Customized way of Resource Discovery in a Campus Grid 51 Customized way of Resource Discovery in a Campus Grid Damandeep Kaur Society for Promotion of IT in Chandigarh (SPIC), Chandigarh Email: daman_811@yahoo.com Lokesh Shandil Email: lokesh_tiet@yahoo.co.in

More information

Web Interface to Materials Simulations

Web Interface to Materials Simulations Web Interface to Materials Simulations Web Interface Generator and Legacy Application Façade Portal Development Team Funding Akos J. Czikmantory (JPL - Wiglaf) DARPA-PROM Hook Hua (JPL - Wiglaf ) JPL SRRF

More information

Operating Systems. Overview. Dr Alun Moon. Computing, Engineering and Information Sciences. 27th September 2011

Operating Systems. Overview. Dr Alun Moon. Computing, Engineering and Information Sciences. 27th September 2011 Operating Systems Overview Dr Alun Moon Computing, Engineering and Information Sciences 27th September 2011 Dr Alun Moon (ceis:nu) Operating Systems 27th September 2011 1 / 16 Chapters 1 & 2 Galvin Silberschatz.

More information

Igniting QuantLib on a Zeppelin

Igniting QuantLib on a Zeppelin Igniting QuantLib on a Zeppelin Andreas Pfadler, d-fine GmbH QuantLib UserMeeting, Düsseldorf, 7.12.2016 d-fine d-fine All rights All rights reserved reserved 0 Welcome Back!» An early stage of this work

More information

Middleware Architecture for the Interconnection of Distributed and Parallel Systems

Middleware Architecture for the Interconnection of Distributed and Parallel Systems e-informatica Software Engineering Journal, Volume 6, Issue 1, 2012, pages: 39 45, DOI 10.5277/e-Inf120103 Middleware Architecture for the Interconnection of Distributed and Parallel Systems Ovidiu Gherman,

More information

University At Buffalo COURSE OUTLINE. A. Course Title: CSE 487/587 Information Structures

University At Buffalo COURSE OUTLINE. A. Course Title: CSE 487/587 Information Structures University At Buffalo COURSE OUTLINE A. Course Title: CSE 487/587 Information Structures B. Curriculum: Computer Science and Engineering Offering Program: BS, BA, MS and Ph.D C. Catalog Description: 4

More information

Grid Architectural Models

Grid Architectural Models Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers

More information

Improved ATLAS HammerCloud Monitoring for Local Site Administration

Improved ATLAS HammerCloud Monitoring for Local Site Administration Improved ATLAS HammerCloud Monitoring for Local Site Administration M Böhler 1, J Elmsheuser 2, F Hönig 2, F Legger 2, V Mancinelli 3, and G Sciacca 4 on behalf of the ATLAS collaboration 1 Albert-Ludwigs

More information

Chapter 1: Introduction

Chapter 1: Introduction Chapter 1: Introduction What is an Operating System? Mainframe Systems Desktop Systems Multiprocessor Systems Distributed Systems Clustered System Real -Time Systems Handheld Systems Computing Environments

More information

Stavros Nikolaou. 413 Gates Hall URL: Ithaca, NY, 14853, USA Date of Birth: December, 1987

Stavros Nikolaou. 413 Gates Hall URL:  Ithaca, NY, 14853, USA Date of Birth: December, 1987 413 Gates Hall +1 6073795409 Department of Computer Science Cornell University email: snikolaou@cs.cornell.edu URL: www.cs.cornell.edu/~snikolaou Ithaca, NY, 14853, USA Date of Birth: December, 1987 Education

More information

MONTE CARLO SIMULATION FOR RADIOTHERAPY IN A DISTRIBUTED COMPUTING ENVIRONMENT

MONTE CARLO SIMULATION FOR RADIOTHERAPY IN A DISTRIBUTED COMPUTING ENVIRONMENT The Monte Carlo Method: Versatility Unbounded in a Dynamic Computing World Chattanooga, Tennessee, April 17-21, 2005, on CD-ROM, American Nuclear Society, LaGrange Park, IL (2005) MONTE CARLO SIMULATION

More information

Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services

Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services Hong-Linh Truong, 2 nd IEEE E-Science Conference, 4 December 2006, Amsterdam. Towards a Framework for Monitoring and Analyzing QoS Metrics of Grid Services Hong-Linh Truong, Robert Samborski, Thomas Fahringer

More information

Non-Uniform Memory Access (NUMA) Architecture and Multicomputers

Non-Uniform Memory Access (NUMA) Architecture and Multicomputers Non-Uniform Memory Access (NUMA) Architecture and Multicomputers Parallel and Distributed Computing Department of Computer Science and Engineering (DEI) Instituto Superior Técnico September 26, 2011 CPD

More information