Forschungszentrum Jülich in der Helmholtz-Gesellschaft
|
|
- Lindsey Bishop
- 6 years ago
- Views:
Transcription
1 Grid Standards, Interoperability and Applications UNICORE Tutorial Morris Riedel Forschungszentrum Jülich in der Helmholtz-Gesellschaft
2 Outline Grid Standards Motivation Grid Islands, Cross-Grid Use Case Scenario, Interoperability Highway Overview of UNICORE 6 related and adopted Standards OASIS, W3C, OGF, IETF, DMTF Interoperability Grid Interoperation Now Community Group (GIN-CG) Open Middleware Infrastructure Institute (OMII) for Europe Lessons Learned from Interoperability Applications Applications of end-users Applications for administrators and developers Summary & References 2 Forschungszentrum Jülich
3 Grid Standards 3 Forschungszentrum Jülich
4 Motivation Grid Islands: Sending a job from one Grid to another is difficult Example: D-Grid Infrastructure, Job Submission Technologies Globus Toolkit 2, (3), 4 Specification of Jobs via Resource Description Language (RSL) Submission to Globus Resource Allocation Manager (GRAM) glite (aka lcg) 3.x Specification of Jobs via Job Definition Language (JDL) Submission to Workload Management Service (WMS) UNICORE 5 Specification of Jobs via Abstract Job Objects (AJOs) Submission to Network Job Supervisor (NJS) Example: DEISA and EGEE European e-infrastructures DEISA, massively parallel jobs: Access via UNICORE EGEE, embarrassingly parallel jobs: Access via glite Foster [1] Laure et al. [3] Streit et al. [2] DEISA [4] EGEE [5] 4 Forschungszentrum Jülich
5 Cross-Grid Use Case Scenario WISDOM (Wide In Silicio Docking on Malaria) WISDOM aims at developing new drugs for Malaria WISDOM uses EGEE for large scale in silicio docking A computational method for prediction of whether one molecule will bind to another using (using AutoDock and FlexX software) AutoDock and FlexX as software provided via glite in EGEE Output is a list of chemical compounds (potential drugs) Refine best compound list via molecular dynamics (MD) Fast MD computations use highly scalable AMBER in DEISA AMBER (Assisted Model Building with Energy Refinement) WISDOM [6] Goal: Accelerate drug discovery using EGEE and DEISA together Raises a demand for Interoperabilityof Grid Middleware Technologies 5 Forschungszentrum Jülich
6 Vision: Interoperability Highway End-users via clients & portals GOAL: Transparency of Grids for end-users Emerging Open Standards others Interoperability highway based on open standards Grid Middlewares others Grid Resources Open Standards areemergingfromvariousstandardizationbodies 6 Forschungszentrum Jülich
7 Overview of Important Standards Internet Engineering TaskForce (IETF) Transport Level Security (TLS) X.509 Public Key Infrastructure (PKI) Org. for the Advancement of Structured Inf. Standards (OASIS) Web Services Resource Framework (WS-RF) Used as WS-* infrastructure resource model in UNICORE 6 and GT4 Security Assertion Markup Language (SAML) Extensible Access Control Markup Language (XACML) Distributed Management TaskForce (DMTF) Common Information Model (CIM) Used in conjunction with UNICORE 6 Common Information Service (CIS) World Wide Web Consortium (W3C) Web Services Addressing (WS-A) 7 Forschungszentrum Jülich
8 Open Grid Forum (OGF) Overview of Important Standards Job Submission and Description Language (JSDL) Standardized Job definition for UNICORE 6, glite (soon) and GT4 (soon) OGSA Basic Execution Services (OGSA-BES) Standardized job submission interface to glite, GT4 & UNICORE 6 (soon) High Performance Computing Profile (HPC-P) Profile for joint usage of HPC-based JSDL extensions and OGSA-BES OGSA Resource Usage Service (OGSA-RUS) Emerging standard exposing OGF usage record formats (URFs) OGSA Byte Input/Output (OGSA-ByteIO) Streamable and Random byte transfers for file and data transfers Grid Laboratory Uniform Environment (GLUE) Used as information model in glite & GT and UNICORE 6 CIS (soon) 8 Forschungszentrum Jülich
9 Adoption ofjsdl, ByteIO, WS-A JSDL-based job submission via UNICORE Atomic Services File Transfer Service is using SbyteIO and/or RByteIO Available in UNICORE 6.0 (August 2007) UNICORE [7] 9 Forschungszentrum Jülich
10 Adoption of OGSA-BES & HPC-P HPC-P Compliant UNICORE 6 JSDL with extensions for HPC OGSA-BES interface (v.33, soon 1.0) Alternative standardized job submission interface to UNICORE 6 OGSA-BES covers functionality from Target System Factory (TSF) Target System Service (TSS) Job Management Service (JMS) UNICORE Atomic Services will remain GPE plans to adopt OGSA-BES very soon OGSA-BES support available in UNICORE 6.1 (end of this year) OMII - Europe [8] 10 Forschungszentrum Jülich
11 Adoption ofsaml & XACML Next generation VOMS server releases signed SAML assertions Role possession Group/Project Membership Venturi et al. [9] SAML assertions are checked using Extensible Access Control Markup Language (XACML)-based policies SAML is used as delegation mechanism in UNICORE 6 Proxies are not needed for this delegation mechanism SAML VOMS support available in UNICORE 6.1 (end of this year) 11 Forschungszentrum Jülich
12 Adoption ofcim & GLUE WS-based UNICORE Common Information Service Based on CIM, plans to adopt upcoming GLUE 2.x specification Extensions to CIM: UNICORE resource model JSDL& OGSA -BES according to OGSA Resource Management design XPATH/XQuery as query language, exist DB (native XML DB) Access right control using XACML Who is allowed to see what infos? Available at the end of this year 12 Forschungszentrum Jülich
13 Interoperability 13 Forschungszentrum Jülich
14 Vision: Interoperability Highway End-users via clients & portals GOAL: Transparency of Grids for end-users Emerging Open Standards others Interoperability highway based on open standards Grid Middlewares others Grid Resources Non-trivial : emerging standards are not directly interoperable Different adoptionplansandcompliancestatus, different securitypolicies, etc. 14 Forschungszentrum Jülich
15 Interoperation in Context Interoperation What needs to be done to get different Grids talking together Short-term achievements, using what is available today One specific technology works with one other specific technology Realized via hacks, adapters, workarounds, etc. E.g. work conducted in OGF Grid Interoperation Now (GIN) group Example: EGEE-II: glite and UNICORE 5 interoperation development Interoperation scenario for scientific job submissions glite UNICORE: using CONDOR-U + Trusted Agent Sustainability of these interoperations via future interoperability Interoperability: native ability to communicate via open standards 15 Forschungszentrum Jülich
16 Standard Compliance in Context Standard Compliance and interoperability are not the same Both are differenttargets, but towards same direction Standard Compliance is a prerequisite for interoperability Standard Compliance does not implies interoperability Interoperability is much more than standard compliance with one specification Grid Interoperability: use components together scenario e.g. job submission via information service based on information model Some Examples for Basic (job) Execution Services (BES) In real deployments is not the vanilla OGSA-BESinterface available Same exact client works not directly with glite & UNICORE UNICORE Gateway has another WS-Addressing EPR part Different security models: X.509 Proxies vs. full certificates Different infrastructures (WS-I & WS-RF) etc. 16 Forschungszentrum Jülich
17 Driving Grid Interoperability OMII-Europe Evaluation Repository Infrastructure OMII-Europe Components Developments: VOMS, OGSA-BES, OGSA-DAI, OGSA-RUS, GridSphere Quality Assurance & Compliance Testing of Grid middleware Interoperability Tests: Integrate and use OMII- Europe components with each other: e.g. VOMS & OGSA-BES & GridSphere building the interoperability highway e.g. Compliance with one specific specification: e.g. OGSA-BES USERS OMII - Europe [8] 17 Forschungszentrum Jülich
18 Multi-Platform Infrastructure JRA3-T2: Integration of all components of OMII Europe OGSA-BES, OGSA-RUS, OGSA-DAI, VOMS, GridSphere Middleware: UNICORE, glite, Globus Toolkits, and CROWN Goal: Test and establish interoperability of components OMII - Europe [8] 18 Forschungszentrum Jülich
19 Lessons Learned from Interop. (1) Missing components/functionality in Grid platforms UNICORE not relies on Info-Service, but is a requiment for glite Different standard specification versions are implemented in the Grid middleware platforms e.g. OGSA-BESv.26 (Supercomputing 2006) and v.33 public comment Different technologies for WS-* infrastructures adopted WS-RF, WS-I, WS-ResourceTransfer, what s next? UNICORE & Globus Toolkit are WS-RFcompliant, glite no plans E.g. GetResourceProperty operation of WS-I compliant fails Even if both maybe OGSA-BEScompliant (aka WS-RF rendering) Different versions of the WS-* infrastructures UNICORE is WS-RF 1.2 compliant, Globus uses WS-RF 1.0 (1.2 soon) 19 Forschungszentrum Jülich
20 Lessons Learned from Interop. (2) Challenges in security are major show stoppers Standards specification compliance is only a precondition Absence of a widely accepted common security profile OMII-Europe (JRA3T1: Common Security Profile) works on that Several specifications of OGF (Secure Channel etc.) used Only several specifications of OASIS (SAML etc.) are used Only several specifications of IETF (X.509 etc.) are used Different strategies and adoption status in Grid Middleware E.g. glite, Globus: Attribute Certificate VOMS, UNICORE SAML VOMS E.g. Delegation mechanisms are extremely different Proxies: Globus, glite Only optional support by UNICORE Explicit Trust Delegation and SAML Assertion Delegation: UNICORE Not by glite & Globus 20 Forschungszentrum Jülich
21 OMII-Europe Success Story (1) One Interoperability scenario within OMII Europe Attribute Authority (AA) VOMS (SAML-based) get central role VOMS becomes middleware independent VO service OMII - Europe [8] 21 Forschungszentrum Jülich
22 Applications 22 Forschungszentrum Jülich
23 Applications (end-users) Collaborative Online Visualization and Steering (COVS) Service One higher-level service within UNICORE 6 Riedel et al. [10] Goal: User does not have to deal with hostnames, usernames or passwords (single sign-on) 23 Forschungszentrum Jülich
24 Applications (end-users) COVS uses Intel s Grid Programming Environment (GPE) GridBeans COVS GridBean Plugin accessing COVS services in UNICORE 6 COVS Session Management: Create/Join COVS Sessions Add/Remove Participants Works together with scientific visualizations (e.g. Xnbody) Link to talk: Überblick und Programmierung von GridBeans 24 Forschungszentrum Jülich
25 Applications (end-users) COVS Use Case Scenarios (Grid driving HPC: massively parallel jobs) Xnbody: Light-weight 3D visualization application based on VTK Used in astro-physics (nbody6++), plasma-physics (PEPC), Spurzem et al. [16] Gibbon [17] 25 Forschungszentrum Jülich
26 Applications (end-users) European Chemomentum Project Workflows and job management based on UNICORE 6 Application: Quantitative Structure-Activity Relationship (QSAR) 2D-Structures experiment values 2D 3D Optimization Computed Values y=f(d1, d2,..., dn ) Properties Descriptors Chemomentum [12] 26 Forschungszentrum Jülich
27 Applications (end-users) Resource Reservation (Network+CPUs) for UNICORE 5 (move to 6) Site A UNICORE Client Site B MetaScheduling Request (WS-Agreement) Job submit to UNICORE UNICORE Gateway UNICORE Gateway NJS NJS Primary NJS MetaScheduler MetaScheduler Response (WS-Agreement) TSI TSI TSI Negotiations and Reservations Job Queue Job Queue Job Queue Link Usage Local Scheduler Local Scheduler Local Scheduler Network RMS ARGON Adapter Adapter Adapter Adapter All components will be started at the same pre-defined time, including cpu time and network reservations Cluster Cluster Cluster Eickermann et al. [13] 27 Forschungszentrum Jülich
28 Applications (administrators) OGSA-RUS services is one higher-level service within UNICORE 6 RUS exposes URFs compliant XML URFs are provided via RMS-specific generators Use case: LLview: User-level Resource Monitoring Frings et al. [11] 28 Forschungszentrum Jülich
29 Applications (administrators) Frings et al. [11] 29 Forschungszentrum Jülich
30 Applications (developers) A-WARE Service Bus (ASB) Goal: Normalised Runtime Environment A-WARE [14] Mediating over the UNICORE 6 Fabric layer (UNICORE Atomic Services) Hosting workflow services, bridge between the Client and the Grid Client currently based on EnginFrame Portals from NICE GridSphere Portals usable for UNICORE 6 (soon) GridSphere Application Portlets on top of UNICORE 6 OMII - Europe [8] Last but not least: GridSphere [15] You can easily develop a higher level service for UNICORE! Create new application services on top of the core of UNICORE 6 30 Forschungszentrum Jülich
31 Summary and References 31 Forschungszentrum Jülich
32 Summary UNICORE 6 integrates the most common Grid related standards WS-RF, JSDL, OGSA-ByteIO, OGSA-BES, OGSA-RUS, SAML, XACML, UNICORE 6 is used by numerous different application domains Chemical workflows in Chemomentum, COVS, Meta-Scheduling, Interoperation (work performed within the GIN-CG group) What needs to be done to get production Grids talking together Hacks, workarounds, short-term achievements Commonly found in production Grid interoperations Interoperability (work performed in OMII Europe) Many components work together to achieve a goal Native standard support from middlewares without hacks in future Continue work in the open standards working groups Interoperability highway to realize the true global Grid vision 32 Forschungszentrum Jülich
33 References (1) [1] Ian Foster: Globus Toolkit version 4: Software for Service-Oriented Science. In Proceedings of IFIP International Conference on Network and Parallel Computing, LNCS 3779, pages Springer- Verlag, [2] Streit et al.: UNICORE -From Project Results to Production Grids., L. Grandinetti (Edt.),Grid Computing: The New Frontiers of High Performance Processing, Advances in Parallel Computing 14, Elsevier, 2005, pages [3]Laure et al.: Programming the Grid with glite, Computational Methods In Science and Technology, Volume 12 (1), 2006, pages [4]Distributed European Infrastructure for Supercomputing Applications (DEISA): [5]Enabling Grids for EscienE (EGEE): [6]WISDOM Project: [7]UNICORE Website: [8] Open Middleware Infrastructure Institute (OMII) for Europe: [9]Venturi et al.: Using SAML-based VOMS for Authorization within Web Services-based UNICORE Grids, In Proc. of UNICORE Summit 2007, to appear [10]Riedel et al.: Design and Evaluation of a Collaborative Online Visualization and Steering Framework Implementation for Computational Grids, In Proc. of the 8th IEEE/ACM International Conference on Grid Computing (Grid 2007), Austin, Texas, to appear 33 Forschungszentrum Jülich
34 References (2) [11] Frings et al.: LLview: User-Level Monitoring in Computational Grids and e-science Infrastructures, In Proc. of German e-science Conference 2007, Baden-Baden, Germany, Online-Publication [12]Chemomentum project: [13]Th. Eickermann et al.: Co-allocation of MPI Jobs with the VIOLA Grid MetaScheduling Framework, In Proc. ofgerman e-science Conference 2007, Baden-Baden, Germany, Online-Publication [14]A-WARE Project: [15]GridSphere: [16]Spurzem et al.: Direct N-body Simulations, The Journal of Computational and Applied Mathematics Vol. 109, pp (1999) [17]Gibbon et al.:.short Pulse Laser Interactions with Matter: An Introduction,Imperial College Press/World Scientific, London/Singapore, ISBN Forschungszentrum Jülich
35 e-science 2007 International Grid Interoperability & Interoperation Workshop in conjunction with e-science 2007, Bangalore, India December 10-13, 2007 Call for Paper deadline: 29th of July (next Sunday) 35 Forschungszentrum Jülich
3rd UNICORE Summit, Rennes, Using SAML-based VOMS for Authorization within Web Services-based UNICORE Grids
3rd UNICORE Summit, Rennes, 28.08.2007 Using SAML-based VOMS for Authorization within Web Services-based UNICORE Grids Valerio Venturi, Morris Riedel, Shiraz Memon, Shahbaz Memon, Frederico Stagni, Bernd
More informationUNICORE Globus: Interoperability of Grid Infrastructures
UNICORE : Interoperability of Grid Infrastructures Michael Rambadt Philipp Wieder Central Institute for Applied Mathematics (ZAM) Research Centre Juelich D 52425 Juelich, Germany Phone: +49 2461 612057
More informationAbstract. 1. Introduction. M. Marzolla. L. Zangrando INFN Padova, Italy
Improvements of Common Open Grid Standards to Increase High Throughput and High Performance Computing Effectiveness on Large-scale Grid and e-science Infrastructures M. Riedel, M.S. Memon, A.S. Memon,
More informationInteroperation Scenarios of Production e-science Infrastructures
Interoperation Scenarios of Production e-science Infrastructures M. Riedel Forschungszentrum Juelich D-52425 Juelich, Germany m.riedel@fz-juelich.de C. Catlett, D. Skow, JP Navarro Argonne National Laboratory
More informationConcepts and Design of an Interoperability Reference Model for Scientific- and Grid Computing Infrastructures
Concepts and Design of an Interoperability Reference Model for Scientific- and Grid Computing Infrastructures Morris Riedel, Achim Streit, Thomas Lippert, Felix Wolf Juelich Supercomputing Centre Forschungszentrum
More informationHow to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework
How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework Piotr Dziubecki, Piotr Grabowski, Michał Krysiński, Tomasz Kuczyński, Dawid Szejnfeld, Dominik Tarnawczyk, Gosia Wolniewicz
More informationResearch Advances by Using Interoperable e-science Infrastructures
Cluster Computing manuscript No. (will be inserted by the editor) Research Advances by Using Interoperable e-science Infrastructures The Infrastructure Interoperability Reference Model Applied in e-science
More informationg-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.
g-eclipse A Framework for Accessing Grid Infrastructures Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.cy) EGEE Training the Trainers May 6 th, 2009 Outline Grid Reality The Problem g-eclipse
More informationIntroduction to GT3. Introduction to GT3. What is a Grid? A Story of Evolution. The Globus Project
Introduction to GT3 The Globus Project Argonne National Laboratory USC Information Sciences Institute Copyright (C) 2003 University of Chicago and The University of Southern California. All Rights Reserved.
More informationGrid Scheduling Architectures with Globus
Grid Scheduling Architectures with Workshop on Scheduling WS 07 Cetraro, Italy July 28, 2007 Ignacio Martin Llorente Distributed Systems Architecture Group Universidad Complutense de Madrid 1/38 Contents
More informationEGEE and Interoperation
EGEE and Interoperation Laurence Field CERN-IT-GD ISGC 2008 www.eu-egee.org EGEE and glite are registered trademarks Overview The grid problem definition GLite and EGEE The interoperability problem The
More informationGrid Computing Fall 2005 Lecture 5: Grid Architecture and Globus. Gabrielle Allen
Grid Computing 7700 Fall 2005 Lecture 5: Grid Architecture and Globus Gabrielle Allen allen@bit.csc.lsu.edu http://www.cct.lsu.edu/~gallen Concrete Example I have a source file Main.F on machine A, an
More informationInteroperable job submission and management with GridSAM, JMEA, and UNICORE
Available online at http://www.ges2007.de This document is under the terms of the CC-BY-NC-ND Creative Commons Attribution Interoperable job submission and management with GridSAM, JMEA, and UNICORE D.
More informationJuliusz Pukacki OGF25 - Grid technologies in e-health Catania, 2-6 March 2009
Grid Technologies for Cancer Research in the ACGT Project Juliusz Pukacki (pukacki@man.poznan.pl) OGF25 - Grid technologies in e-health Catania, 2-6 March 2009 Outline ACGT project ACGT architecture Layers
More informationCHAPTER 2 LITERATURE REVIEW AND BACKGROUND
8 CHAPTER 2 LITERATURE REVIEW AND BACKGROUND 2.1 LITERATURE REVIEW Several researches have been carried out in Grid Resource Management and some of the existing research works closely related to this thesis
More informationGrid Middleware and Globus Toolkit Architecture
Grid Middleware and Globus Toolkit Architecture Lisa Childers Argonne National Laboratory University of Chicago 2 Overview Grid Middleware The problem: supporting Virtual Organizations equirements Capabilities
More informationPoS(EGICF12-EMITC2)081
University of Oslo, P.b.1048 Blindern, N-0316 Oslo, Norway E-mail: aleksandr.konstantinov@fys.uio.no Martin Skou Andersen Niels Bohr Institute, Blegdamsvej 17, 2100 København Ø, Denmark E-mail: skou@nbi.ku.dk
More informationGrid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia
Grid services Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Sep. 19, 2008 www.eu-egee.org Set of basic Grid services Job submission/management
More informationGrid Computing Middleware. Definitions & functions Middleware components Globus glite
Seminar Review 1 Topics Grid Computing Middleware Grid Resource Management Grid Computing Security Applications of SOA and Web Services Semantic Grid Grid & E-Science Grid Economics Cloud Computing 2 Grid
More informationAccess the power of Grid with Eclipse
Access the power of Grid with Eclipse Harald Kornmayer (Forschungszentrum Karlsruhe GmbH) Markus Knauer (Innoopract GmbH) October 11th, 2006, Eclipse Summit, Esslingen 2006 by H. Kornmayer, M. Knauer;
More informationGrid Computing. MCSN - N. Tonellotto - Distributed Enabling Platforms
Grid Computing 1 Resource sharing Elements of Grid Computing - Computers, data, storage, sensors, networks, - Sharing always conditional: issues of trust, policy, negotiation, payment, Coordinated problem
More informationInterconnect EGEE and CNGRID e-infrastructures
Interconnect EGEE and CNGRID e-infrastructures Giuseppe Andronico Interoperability and Interoperation between Europe, India and Asia Workshop Barcelona - Spain, June 2 2007 FP6 2004 Infrastructures 6-SSA-026634
More informationEclipse Technology Project: g-eclipse
(Incubation) Document classification: Made available under the Eclipse Public License v1.0. Date: September 11, 2007 Abstract: This document contains the Release Review Documentation for the Eclipse Technology
More informationSZDG, ecom4com technology, EDGeS-EDGI in large P. Kacsuk MTA SZTAKI
SZDG, ecom4com technology, EDGeS-EDGI in large P. Kacsuk MTA SZTAKI The EDGI/EDGeS projects receive(d) Community research funding 1 Outline of the talk SZTAKI Desktop Grid (SZDG) SZDG technology: ecom4com
More informationMultiple Broker Support by Grid Portals* Extended Abstract
1. Introduction Multiple Broker Support by Grid Portals* Extended Abstract Attila Kertesz 1,3, Zoltan Farkas 1,4, Peter Kacsuk 1,4, Tamas Kiss 2,4 1 MTA SZTAKI Computer and Automation Research Institute
More informationIntroduction to Grid Infrastructures
Introduction to Grid Infrastructures Stefano Cozzini 1 and Alessandro Costantini 2 1 CNR-INFM DEMOCRITOS National Simulation Center, Trieste, Italy 2 Department of Chemistry, Università di Perugia, Perugia,
More informationeinfrastructures Concertation Event
einfrastructures Concertation Event Steve Crumb, Executive Director December 5, 2007 OGF Vision & Mission Our Vision: The Open Grid Forum accelerates grid adoption to enable scientific discovery and business
More informationThebes, WS SAML, and Federation
Thebes, WS SAML, and Federation Internet2 Fall Member Meeting November 3, 2010 Thebes Consortium Georgetown University Arnie Miles adm35@georgetown.edu http://code.google.com/p/thebes/ Back story I haven't
More informationTHE WIDE AREA GRID. Architecture
THE WIDE AREA GRID Architecture Context The Wide Area Grid concept was discussed during several WGISS meetings The idea was to imagine and experiment an infrastructure that could be used by agencies to
More informationTHEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap
THEBES: THE GRID MIDDLEWARE PROJECT Project Overview, Status Report and Roadmap Arnie Miles Georgetown University adm35@georgetown.edu http://thebes.arc.georgetown.edu The Thebes middleware project was
More informationFirst European Globus Community Forum Meeting
First European Globus Community Forum Meeting Florian Zrenner (zrenner@lrz.de) Slides from Dr. Helmut Heller (heller@lrz.de) Leibniz Supercomputing Centre (LRZ), Munich, Germany September 7 th, 2011 1
More information30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy
Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy Why the Grid? Science is becoming increasingly digital and needs to deal with increasing amounts of
More informationEasy Access to Grid Infrastructures
Easy Access to Grid Infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) On behalf of the g-eclipse consortium WP11 Grid Workshop Grenoble, France 09 th of December 2008 Background in astro particle
More informationEU Phosphorus Project Harmony. (on
EU Phosphorus Project Harmony Advance Reservation features for Grids (on behalf of UniBonn, SURFnet, UvA,, CRC, Nortel,, FHG, I2CAT) E2E Workshop Establishing Lightpaths Amsterdam, December 2008 Phosphorus
More informationGergely Sipos MTA SZTAKI
Application development on EGEE with P-GRADE Portal Gergely Sipos MTA SZTAKI sipos@sztaki.hu EGEE Training and Induction EGEE Application Porting Support www.lpds.sztaki.hu/gasuc www.portal.p-grade.hu
More informationDynamic Workflows for Grid Applications
Dynamic Workflows for Grid Applications Dynamic Workflows for Grid Applications Fraunhofer Resource Grid Fraunhofer Institute for Computer Architecture and Software Technology Berlin Germany Andreas Hoheisel
More informationUser Tools and Languages for Graph-based Grid Workflows
User Tools and Languages for Graph-based Grid Workflows User Tools and Languages for Graph-based Grid Workflows Global Grid Forum 10 Berlin, Germany Grid Workflow Workshop Andreas Hoheisel (andreas.hoheisel@first.fraunhofer.de)
More informationRapid Deployment of VS Workflows. Meta Scheduling Service
Rapid Deployment of VS Workflows on PHOSPHORUS using Meta Scheduling Service M. Shahid, Bjoern Hagemeier Fraunhofer Institute SCAI, Research Center Juelich. (TNC 2009) Outline Introduction and Motivation
More informationPoS(EGICF12-EMITC2)094
UNICORE EMI-Execution Service realization towards improved open standards 1 Forschungszentrum Juelich GmbH, Germany E-mail: m.memon@fz-juelich.de Morris Riedel Forschungszentrum Juelich GmbH, Germany E-mail:
More informationIndependent Software Vendors (ISV) Remote Computing Usage Primer
GFD-I.141 ISV Remote Computing Usage Primer Authors: Steven Newhouse, Microsoft Andrew Grimshaw, University of Virginia 7 October, 2008 Independent Software Vendors (ISV) Remote Computing Usage Primer
More informationOGF Production Grid Infrastructure. Glossary of Acronyms and Terms
GFD-I.181 OGF Production Grid Infrastructure Editor: E. Urbah, LAL, Univ Paris-Sud, IN2P3/CNRS http://forge.gridforum.org/sf/projects/pgi-wg 20 March, 2011 OGF Production Grid Infrastructure Glossary of
More informationGatlet - a Grid Portal Framework
Gatlet - a Grid Portal Framework Stefan Bozic stefan.bozic@kit.edu STEINBUCH CENTRE FOR COMPUTING - SCC KIT University of the State of Baden-Württemberg and National Laboratory of the Helmholtz Association
More informationAn Introduction to the Grid
1 An Introduction to the Grid 1.1 INTRODUCTION The Grid concepts and technologies are all very new, first expressed by Foster and Kesselman in 1998 [1]. Before this, efforts to orchestrate wide-area distributed
More informationChapter 2 Introduction to the WS-PGRADE/gUSE Science Gateway Framework
Chapter 2 Introduction to the WS-PGRADE/gUSE Science Gateway Framework Tibor Gottdank Abstract WS-PGRADE/gUSE is a gateway framework that offers a set of highlevel grid and cloud services by which interoperation
More informationMSF: A Workflow Service Infrastructure for Computational Grid Environments
MSF: A Workflow Service Infrastructure for Computational Grid Environments Seogchan Hwang 1 and Jaeyoung Choi 2 1 Supercomputing Center, Korea Institute of Science and Technology Information, 52 Eoeun-dong,
More informationAdvanced School in High Performance and GRID Computing November Introduction to Grid computing.
1967-14 Advanced School in High Performance and GRID Computing 3-14 November 2008 Introduction to Grid computing. TAFFONI Giuliano Osservatorio Astronomico di Trieste/INAF Via G.B. Tiepolo 11 34131 Trieste
More informationINITIATIVE FOR GLOBUS IN EUROPE. Dr. Helmut Heller Leibniz Supercomputing Centre (LRZ) Munich, Germany IGE Project Coordinator
Dr. Helmut Heller (heller@lrz.de) Leibniz Supercomputing Centre (LRZ) Munich, Germany IGE Project Coordinator Argonne, March 2 nd, 2010 Overview The European Grid Ecosystem Initiative for Globus in Europe
More informationBob Jones. EGEE and glite are registered trademarks. egee EGEE-III INFSO-RI
Bob Jones EGEE project director www.eu-egee.org egee EGEE-III INFSO-RI-222667 EGEE and glite are registered trademarks Quality: Enabling Grids for E-sciencE Monitoring via Nagios - distributed via official
More informationFORSCHUNGSZENTRUM JÜLICH GmbH Zentralinstitut für Angewandte Mathematik D Jülich, Tel. (02461) Core D-Grid Infrastructure
FORSCHUNGSZENTRUM JÜLICH GmbH Zentralinstitut für Angewandte Mathematik D-52425 Jülich, Tel. (02461) 61-6402 Technical Report Core D-Grid Infrastructure Thomas Fieseler, Wolfgang Gürich FZJ-ZAM-IB-2007-09
More informationResearch and Design Application Platform of Service Grid Based on WSRF
DOI: 10.7763/IPEDR. 2012. V49. 27 Research and Design Application Platform of Service Grid Based on WSRF Jianmei Ge a, Shying Zhang a College of Computer Science and Technology, Beihua University, No.1
More informationThe University of Oxford campus grid, expansion and integrating new partners. Dr. David Wallom Technical Manager
The University of Oxford campus grid, expansion and integrating new partners Dr. David Wallom Technical Manager Outline Overview of OxGrid Self designed components Users Resources, adding new local or
More informationHigh Performance Computing Course Notes Grid Computing I
High Performance Computing Course Notes 2008-2009 2009 Grid Computing I Resource Demands Even as computer power, data storage, and communication continue to improve exponentially, resource capacities are
More informationScientific Computing with UNICORE
Scientific Computing with UNICORE Dirk Breuer, Dietmar Erwin Presented by Cristina Tugurlan Outline Introduction Grid Computing Concepts Unicore Arhitecture Unicore Capabilities Unicore Globus Interoperability
More informationSLCS and VASH Service Interoperability of Shibboleth and glite
SLCS and VASH Service Interoperability of Shibboleth and glite Christoph Witzig, SWITCH (witzig@switch.ch) www.eu-egee.org NREN Grid Workshop Nov 30th, 2007 - Malaga EGEE and glite are registered trademarks
More informationIntegration of Cloud and Grid Middleware at DGRZR
D- of International Symposium on Computing 2010 Stefan Freitag Robotics Research Institute Dortmund University of Technology March 12, 2010 Overview D- 1 D- Resource Center Ruhr 2 Clouds in the German
More information- C3Grid Stephan Kindermann, DKRZ. Martina Stockhause, MPI-M C3-Team
A Collaborative Environment for Climate Data Handling - Stephan Kindermann, DKRZ Martina Stockhause, MPI-M C3-Team 10.06. 2008 Motivation Model Output Data + Observation Data + TeraByte Analysis Data Expected
More informationThe SweGrid Accounting System
The SweGrid Accounting System Enforcing Grid Resource Allocations Thomas Sandholm sandholm@pdc.kth.se 1 Outline Resource Sharing Dilemma Grid Research Trends Connecting National Computing Resources in
More informationPresented by Wolfgang Ziegler, Open Grid Forum
ETSI SUMMIT ON STANDARDIZATION AND OPEN SOURCE STANDARDIZATION AND OPEN SOURCE Presented by Wolfgang Ziegler, Open Grid Forum About OGF Open global forum for advanced distributed computing OGF is an open
More informationUNIT IV PROGRAMMING MODEL. Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus
UNIT IV PROGRAMMING MODEL Open source grid middleware packages - Globus Toolkit (GT4) Architecture, Configuration - Usage of Globus Globus: One of the most influential Grid middleware projects is the Globus
More informationOutline 18/12/2014. Accessing GROMACS on a Science Gateway. GROMACS in a nutshell. GROMACS users in India. GROMACS on GARUDA
Outline Co-ordination & Harmonisation of Advanced e-infrastructures for Research and Education Data Sharing Accessing GROMACS on a Dr. Giuseppe La Rocca, INFN Catania 6 th CHAIN-REDS Workshop, Guwahati
More informationGrid Programming: Concepts and Challenges. Michael Rokitka CSE510B 10/2007
Grid Programming: Concepts and Challenges Michael Rokitka SUNY@Buffalo CSE510B 10/2007 Issues Due to Heterogeneous Hardware level Environment Different architectures, chipsets, execution speeds Software
More informationUNICORE - From Project Results to Production Grids
UNICORE - From Project Results to Production Grids A. Streit, D. Erwin, Th. Lippert, D. Mallmann, R. Menday, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, and Ph. Wieder John von Neumann-Institute for
More informationIntroduction of NAREGI-PSE implementation of ACS and Replication feature
Introduction of NAREGI-PSE implementation of ACS and Replication feature January. 2007 NAREGI-PSE Group National Institute of Informatics Fujitsu Limited Utsunomiya University National Research Grid Initiative
More informationThe glite middleware. Ariel Garcia KIT
The glite middleware Ariel Garcia KIT Overview Background The glite subsystems overview Security Information system Job management Data management Some (my) answers to your questions and random rumblings
More informationGaruda : The National Grid Computing Initiative Of India. Natraj A.C, CDAC Knowledge Park, Bangalore.
Garuda : The National Grid Computing Initiative Of India Natraj A.C, CDAC Knowledge Park, Bangalore. natraj@cdacb.ernet.in 1 Agenda About CDAC Garuda grid highlights Garuda Foundation Phase EU-India grid
More informationglite Grid Services Overview
The EPIKH Project (Exchange Programme to advance e-infrastructure Know-How) glite Grid Services Overview Antonio Calanducci INFN Catania Joint GISELA/EPIKH School for Grid Site Administrators Valparaiso,
More informationQosCosGrid Middleware
Domain-oriented services and resources of Polish Infrastructure for Supporting Computational Science in the European Research Space PLGrid Plus QosCosGrid Middleware Domain-oriented services and resources
More informationDeploying the TeraGrid PKI
Deploying the TeraGrid PKI Grid Forum Korea Winter Workshop December 1, 2003 Jim Basney Senior Research Scientist National Center for Supercomputing Applications University of Illinois jbasney@ncsa.uiuc.edu
More informationGrids and Security. Ian Neilson Grid Deployment Group CERN. TF-CSIRT London 27 Jan
Grids and Security Ian Neilson Grid Deployment Group CERN TF-CSIRT London 27 Jan 2004-1 TOC Background Grids Grid Projects Some Technical Aspects The three or four A s Some Operational Aspects Security
More informationDEPLOYING MULTI-TIER APPLICATIONS ACROSS MULTIPLE SECURITY DOMAINS
DEPLOYING MULTI-TIER APPLICATIONS ACROSS MULTIPLE SECURITY DOMAINS Igor Balabine, Arne Koschel IONA Technologies, PLC 2350 Mission College Blvd #1200 Santa Clara, CA 95054 USA {igor.balabine, arne.koschel}
More informationAdopting GLUE 2.0 for an Interoperable Grid Monitoring System
Adopting GLUE 2.0 for an Interoperable Grid Monitoring System Timo Baur 1, Rebecca Breu 2, Tibor Kálmán 3, Tobias Lindinger 4, Anne Milbert 5, Gevorg Poghosyan 6, Mathilde Romberg 2 1 Leibniz Supercomputing
More informationGrid Architectural Models
Grid Architectural Models Computational Grids - A computational Grid aggregates the processing power from a distributed collection of systems - This type of Grid is primarily composed of low powered computers
More informationAAI in EGI Current status
AAI in EGI Current status Peter Solagna EGI.eu Operations Manager www.egi.eu EGI-Engage is co-funded by the Horizon 2020 Framework Programme of the European Union under grant number 654142 User authentication
More informationIntroduction to Grid Technology
Introduction to Grid Technology B.Ramamurthy 1 Arthur C Clarke s Laws (two of many) Any sufficiently advanced technology is indistinguishable from magic." "The only way of discovering the limits of the
More informationGrid technologies, solutions and concepts in the synchrotron Elettra
Grid technologies, solutions and concepts in the synchrotron Elettra Roberto Pugliese, George Kourousias, Alessio Curri, Milan Prica, Andrea Del Linz Scientific Computing Group, Elettra Sincrotrone, Trieste,
More informationGRAIL Grid Access and Instrumentation Tool
2007 German e-science Available online at http://www.ges2007.de This document is under the terms of the CC-BY-NC-ND Creative Commons Attribution GRAIL Grid Access and Instrumentation Tool T. Jejkal 1,
More informationTopics of Discussion
CPET 581 Cloud Computing: Technologies and Enterprise IT Strategies Lecture on NIST Cloud Computing Definition, Standards & Roadmap, Security & Privacy Guidelines Spring 2013 A Specialty Course for Purdue
More informationLCG-2 and glite Architecture and components
LCG-2 and glite Architecture and components Author E.Slabospitskaya www.eu-egee.org Outline Enabling Grids for E-sciencE What are LCG-2 and glite? glite Architecture Release 1.0 review What is glite?.
More informationFujitsu s Activities in Grid Computing
Fujitsu s Activities in Grid Computing V Andreas Savva V Takumi Ouchi V Hiro Kishimoto (Manuscript received August 27, 2004) Fujitsu has been actively involved in the research and development of Grid computing:
More informationImproving Grid User's Privacy with glite Pseudonymity Service
Improving Grid User's Privacy with glite Pseudonymity Service Henri Mikkonen, Joni Hahkala and John White 5 th EGEE User Forum 12-16 April 2010 Uppsala, Sweden www.eu-egee.org EGEE and glite are registered
More informationThe LHC Computing Grid
The LHC Computing Grid Gergely Debreczeni (CERN IT/Grid Deployment Group) The data factory of LHC 40 million collisions in each second After on-line triggers and selections, only 100 3-4 MB/event requires
More informationXSEDE s Campus Bridging Project Jim Ferguson National Institute for Computational Sciences
January 3, 2016 XSEDE s Campus Bridging Project Jim Ferguson National Institute for Computational Sciences jwf@utk.edu What is XSEDE? extreme Science and Engineering Discovery Environment $121M project
More informationA Concept for Attribute-Based Authorization on D-Grid Resources
A Concept for Attribute-Based Authorization on D-Grid Resources Ralf Groeper a, Christian Grimm a, Siegfried Makedanz b, Hans Pfeiffenberger b, Wolfgang Ziegler c, Peter Gietz d, Michael Schiffers e a
More informationPoS(ISGC 2011 & OGF 31)119
Enabling JChem application on grid Miklos Kozlovszky MTA SZTAKI H-1111 Kende str. 13-17, Budapest, Hungary E-mail: m.kozlovszky@sztaki.hu Akos Balasko MTA SZTAKI H-1111 Kende str. 13-17, Budapest, Hungary
More informationThe impact and adoption of GLUE 2.0 in the LCG/EGEE production Grid
The impact and adoption of GLUE 2.0 in the LCG/EGEE production Grid Stephen Burke, Sergio Andreozzi, Flavia Donno, Felix Ehm, Laurence Field, Maarten Litmaath and Paul Millar CHEP09, Prague www.eu-egee.org
More informationComputing grids, a tool for international collaboration and against digital divide Guy Wormser Director of CNRS Institut des Grilles (CNRS, France)
Computing grids, a tool for international collaboration and against digital divide Guy Wormser Director of CNRS Institut des Grilles (CNRS, France) www.eu-egee.org EGEE and glite are registered trademarks
More informationThe glite middleware. Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 Enabling Grids for E-sciencE
The glite middleware Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 John.White@cern.ch www.eu-egee.org EGEE and glite are registered trademarks Outline glite distributions Software
More informationg-eclipse - An Integrated Framework to Access and Maintain Grid Resources
g-eclipse - An Integrated Framework to Access and Maintain Grid Resources Harald Gjermundrød #1, Marios D. Dikaiakos #2, Mathias Stümpert *3, Paweł Wolniewicz^4, and Harald Kornmayer &5 # University of
More informationOn the employment of LCG GRID middleware
On the employment of LCG GRID middleware Luben Boyanov, Plamena Nenkova Abstract: This paper describes the functionalities and operation of the LCG GRID middleware. An overview of the development of GRID
More informationProvisioning of Grid Middleware for EGI in the framework of EGI InSPIRE
Ibergrid 2010 Provisioning of Grid Middleware for EGI in the framework of EGI InSPIRE M. David G. Borges, J. Gomes, I. Campos, A. Lopez, P. Orviz, J. López Cacheiro, C. Fernandez and A. Simon LIP, CSIC,
More informationGrid Infrastructure For Collaborative High Performance Scientific Computing
Computing For Nation Development, February 08 09, 2008 Bharati Vidyapeeth s Institute of Computer Applications and Management, New Delhi Grid Infrastructure For Collaborative High Performance Scientific
More informationGrid and Cloud Computing
Grid and Cloud Computing Interoperability and Standardization for the Telecommunications Industry Telecom World Congress 2009 Dr Ian Stokes-Rees Specialist Task Force, TC GRID ETSI 2009. All rights reserved
More informationAn authorization Framework for Grid Security using GT4
www.ijcsi.org 310 An authorization Framework for Grid Security using GT4 Debabrata Singh 1, Bhupendra Gupta 2,B.M.Acharya 3 4, Sarbeswar Hota S O A University, Bhubaneswar Abstract A Grid system is a Virtual
More informationDay 1 : August (Thursday) An overview of Globus Toolkit 2.4
An Overview of Grid Computing Workshop Day 1 : August 05 2004 (Thursday) An overview of Globus Toolkit 2.4 By CDAC Experts Contact :vcvrao@cdacindia.com; betatest@cdacindia.com URL : http://www.cs.umn.edu/~vcvrao
More informationHeterogeneous Grid Computing: Issues and Early Benchmarks
Heterogeneous Grid Computing: Issues and Early Benchmarks Eamonn Kenny 1, Brian Coghlan 1, George Tsouloupas 2, Marios Dikaiakos 2, John Walsh 1, Stephen Childs 1, David O Callaghan 1, and Geoff Quigley
More informationGlobus GTK and Grid Services
Globus GTK and Grid Services Michael Rokitka SUNY@Buffalo CSE510B 9/2007 OGSA The Open Grid Services Architecture What are some key requirements of Grid computing? Interoperability: Critical due to nature
More informationCloud Computing. Up until now
Cloud Computing Lecture 4 and 5 Grid: 2012-2013 Introduction. Up until now Definition of Cloud Computing. Grid Computing: Schedulers: Condor SGE 1 Summary Core Grid: Toolkit Condor-G Grid: Conceptual Architecture
More informationA Guanxi Shibboleth based Security Infrastructure for e-social Science
A Guanxi Shibboleth based Security Infrastructure for e-social Science Wei Jie 1 Alistair Young 2 Junaid Arshad 3 June Finch 1 Rob Procter 1 Andy Turner 3 1 University of Manchester, UK 2 UHI Millennium
More informationGrid Interoperation and Regional Collaboration
Grid Interoperation and Regional Collaboration Eric Yen ASGC Academia Sinica Taiwan 23 Jan. 2006 Dreams of Grid Computing Global collaboration across administrative domains by sharing of people, resources,
More informationNew trends in Identity Management
New trends in Identity Management Peter Gietz, DAASI International GmbH peter.gietz@daasi.de Track on Research and Education Networking in South East Europe, Yu Info 2007, Kopaionik, Serbia 14 March 2007
More information