glite Middleware Usage

Similar documents
How to use computing resources at Grid

Data Management. Enabling Grids for E-sciencE. Vladimir Slavnic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

Advanced Job Submission on the Grid

Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

glite Data Management System Hands-on

glite/egee in Practice

Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008

Problemi di schedulazione distribuita su Grid

glite Grid Services Overview

GRID COMPANION GUIDE

International Collaboration to Extend and Advance Grid Education. glite WMS Workload Management System

AGATA Analysis on the GRID

Gergely Sipos MTA SZTAKI

LCG-2 and glite Architecture and components

Grid Computing. Olivier Dadoun LAL, Orsay. Introduction & Parachute method. Socle 2006 Clermont-Ferrand Orsay)

Grid Computing. Olivier Dadoun LAL, Orsay Introduction & Parachute method. APC-Grid February 2007

A Login Shell interface for INFN-GRID

The glite middleware. Ariel Garcia KIT

Architecture of the WMS

Failover procedure for Grid core services

DataGrid. Document identifier: Date: 24/11/2003. Work package: Partner: Document status. Deliverable identifier:

FREE SCIENTIFIC COMPUTING

Service Availability Monitor tests for ATLAS

Consorzio COMETA - Progetto PI2S2. DMS API glite. Salvatore Scifo Consorzio Cometa (PI2S2) - Catania. Corso introduttivo al Grid Computing

Grid Infrastructure For Collaborative High Performance Scientific Computing

MyProxy Server Installation

DataGrid. Document identifier: Date: 16/06/2003. Work package: Partner: Document status. Deliverable identifier:

Parallel Computing in EGI

DataGrid EDG-BROKERINFO USER GUIDE. Document identifier: Date: 06/08/2003. Work package: Document status: Deliverable identifier:

g-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.

Grid Documentation Documentation

Parallel Job Support in the Spanish NGI! Enol Fernández del Cas/llo Ins/tuto de Física de Cantabria (IFCA) Spain

Programming the Grid with glite

DataGrid. Document identifier: Date: 28/10/2003. Work package: Partner: Document status. Deliverable identifier:

EGEE. Grid Middleware. Date: June 20, 2006

Future of Grid parallel exploitation

J O B D E S C R I P T I O N L A N G U A G E A T T R I B U T E S S P E C I F I C A T I O N

EGEE-II. Document identifier: Document link:

DIRAC Documentation. Release integration. DIRAC Project. 09:29 20/05/2016 UTC

CERN LCG. LCG Short Demo. Markus Schulz. FZK 30 September 2003

CE+WN+siteBDII Installation and configuration

Monitoring System for the GRID Monte Carlo Mass Production in the H1 Experiment at DESY

glite Advanced Job Management

ALICE Grid/Analysis Tutorial Exercise-Solutions

glite UI Installation

The ARC Information System

Pan-European Grid einfrastructure for LHC Experiments at CERN - SCL's Activities in EGEE

E UFORIA G RID I NFRASTRUCTURE S TATUS R EPORT

Programming the Grid with glite *

Monitoring tools in EGEE

Overview of WMS/LB API

Philippe Charpentier PH Department CERN, Geneva

On the employment of LCG GRID middleware

Architecture Proposal

Tutorial for CMS Users: Data Analysis on the Grid with CRAB

R-GMA (Relational Grid Monitoring Architecture) for monitoring applications

Working with Basic Linux. Daniel Balagué

How to use the Grid for my e-science

MPI SUPPORT ON THE GRID. Kiril Dichev, Sven Stork, Rainer Keller. Enol Fernández

DataGRID EDG TUTORIAL. Document identifier: EDMS id: Date: April 4, Work package: Partner(s): Lead Partner: Document status: Version 2.6.

Scientific data management

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

Job submission and management through web services: the experience with the CREAM service

Deploying virtualisation in a production grid

WMS overview and Proposal for Job Status

Status of KISTI Tier2 Center for ALICE

YAIM Overview. Bruce Becker Meraka Institute. Co-ordination & Harmonisation of Advanced e-infrastructures for Research and Education Data Sharing

The glite middleware. Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 Enabling Grids for E-sciencE

The LHC Computing Grid

Introduction. creating job-definition files into structured directories etc.

CREAM Computing Element Overview

AMGA tutorial. Enabling Grids for E-sciencE

Configuring a glideinwms factory

Improving Grid User's Privacy with glite Pseudonymity Service

Information and monitoring

SLCS and VASH Service Interoperability of Shibboleth and glite

Understanding StoRM: from introduction to internals

( PROPOSAL ) THE AGATA GRID COMPUTING MODEL FOR DATA MANAGEMENT AND DATA PROCESSING. version 0.6. July 2010 Revised January 2011

Beob Kyun KIM, Christophe BONNAUD {kyun, NSDC / KISTI

Edinburgh (ECDF) Update

Operating Systems. Engr. Abdul-Rahman Mahmood MS, PMP, MCP, QMR(ISO9001:2000) alphapeeler.sf.net/pubkeys/pkey.htm

Enabling Grids for E-sciencE. A centralized administration of the Grid infrastructure using Cfengine. Tomáš Kouba Varna, NEC2009.

Bookkeeping and submission tools prototype. L. Tomassetti on behalf of distributed computing group

Forschungszentrum Jülich in der Helmholtz-Gesellschaft

SPGrid Efforts in Italy

GRID COMPUTING APPLIED TO OFF-LINE AGATA DATA PROCESSING. 2nd EGAN School, December 2012, GSI Darmstadt, Germany

ARC integration for CMS

DIRAC data management: consistency, integrity and coherence of data

Experience with LCG-2 and Storage Resource Management Middleware

Setup Desktop Grids and Bridges. Tutorial. Robert Lovas, MTA SZTAKI

Modeling User Submission Strategies on Production Grids

Recent advances of MedIGrid PSE in an LCG/gLite environment

Multi-thread and Mpi usage in GRID Roberto Alfieri - Parma University & INFN, Gr.Coll. di Parma

A Practical Approach for a Workflow Management System

EGI-InSPIRE. ARC-CE IPv6 TESTBED. Barbara Krašovec, Jure Kranjc ARNES. EGI-InSPIRE RI

Dr. Giuliano Taffoni INAF - OATS

Overview of HEP software & LCG from the openlab perspective

Grid Computing Middleware. Definitions & functions Middleware components Globus glite

Installation of CMSSW in the Grid DESY Computing Seminar May 17th, 2010 Wolf Behrenhoff, Christoph Wissing

WMS Application Program Interface: How to integrate them in your code

Transcription:

glite Middleware Usage Dusan Vudragovic dusan@phy.bg.ac.yu Scientific Computing Laboratory Institute of Physics Belgrade, Serbia Nov. 18, 2008 www.eu-egee.org EGEE and glite are registered trademarks

Usage of Grid Computing Resource (1/4) MDS Information VO-specific information on existing Grid resources lcg-infosites --vo <vo> <option> -v <verbosity> -f <site> --is <bdii> Other information on existing Grid resources ldapsearch -x -h <hostname> -p 2170 -b "mds-vo-name=local, o=grid ldapsearch -x -H ldap://bdii.phy.bg.ac.yu:2170 -b mds-vo-name=aegis01-phy-scl,mds-vo-name=local,o=grid ldapsearch -x -H ldap://ce64.phy.bg.ac.yu:2170 -b mds-vo-name=aegis01-phy-scl,o=grid ldapsearch -x -H ldap://ce64.phy.bg.ac.yu:2170 -b mds-vo-name=resource,o=grid ldapsearch -x -H ldap://bdii.phy.bg.ac.yu:2170 -b mds-vo-name=local,o=grid -x "GlueSAAccessControlBaseRule=aegis" GlueChunkKey Introduction to Cluster and Grid Computing in Mechanical Engineering 2

Usage of Grid Computing Resource (2/4) RGMA Information service https://lcgmon01.gridpp.rl.ac.uk:8443/r-gma/index.html Command line interface rgma -c select Web from GlueSite where Job Description Language JDL file UniqueId= ce64.phy.bg.ac.yu attribute = expression; Simple example [ Type = "Job"; Executable = "/bin/hostname"; Arguments = ""; StdOutput = "message.txt"; StdError = "stderror"; OutputSandbox = {"message.txt","stderror"}; ] Introduction to Cluster and Grid Computing in Mechanical Engineering 3

Usage of Grid Computing Resource (3/4) Additional attributes InputSandbox = {"test.sh", "filea", "fileb",...} InputSandbox = { "gsiftp://lxb0707.cern.ch/cms/doe/data/filea,"fileb"}; VirtualOrganisation = "cms ; RetryCount = 0; MyProxyServer = "myproxy.phy.bg.ac.yu"; Requirements Requirements = RegExp("ce64.phy.bg.ac.yu*,other.GlueCEUniqueID); Requirements = Member("VO-cms-CMSSW_2_0_0", other.gluehostapplicationsoftwareruntimeenvironment); Requirements = (other.gluehostarchitectureplatformtype == "x86_64 ); Introduction to Cluster and Grid Computing in Mechanical Engineering 4

Usage of Grid Computing Resource (4/4) Single Job Submission glite-wms-job-list-match -a <jdl file> glite-wms-job-delegate-proxy -d <delegid> glite-wms-job-submit -a <jdl file> glite-wms-job-status <jobid> glite-wms-job-cancel <jobid> glite-wms-job-output <jobid> glite-wms-job-logging-info <jobid> Introduction to Cluster and Grid Computing in Mechanical Engineering 5

GUID Globally Unique Identifier LFN Logical File Name SURL - SiteURL Usage of Grid Storage Resource (1/3) Introduction to Cluster and Grid Computing in Mechanical Engineering 6

Usage of Grid Storage Resource (2/3) LCG Util lcg-aa - add an alias in the RMC or the LFC for a given GUID lcg-cp - copy a Grid file to a local destination lcg-cr - copy and register a file ( replicas lcg-del - delete one file (either one replica or all lcg-gt - get the TURL for a given SURL and transfer protocol lcg-la - list the aliases for a given LFN, GUID or SURL lcg-lg - get the GUID for a given LFN or SURL lcg-lr - list the replicas for a given LFN, GUID or SURL lcg-ra - remove an alias in the RMC or the LFC for a given GUID lcg-rep - copy a file from one SE to another SE and registers it in the LRC or the LFC lcg-rf - register in the LRC (and optionally in the RMC) or the LFC a file residing on an SE lcg-sd - set file status to "Done" for a given SURL in a specified request lcg-uf - unregister in the LRC or the LFC a file residing on an SE Introduction to Cluster and Grid Computing in Mechanical Engineering 7

Usage of Grid Storage Resource (3/3) LFC Util lfc-chmod - change access mode of a LFC directory/file in the name server lfc-chown - change owner and group of a LFC directory/file in the name server lfc-delcomment - delete the comment associated with a file/directory lfc-entergrpmap - define a new group entry in Virtual Id table lfc-enterusrmap - define a new user entry in Virtual Id table lfc-getacl - get LFC directory/file access control lists lfc-ln - make a symbolic link to a file or a directory in the LFC Name Server lfc-ls - list LFC name server directory/file entries lfc-mkdir - make LFC directory in the name server lfc-modifygrpmap - modify group entry corresponding to a given virtual gid lfc-modifyusrmap - modify user entry corresponding to a given virtual uid lfc-rename - rename a LFC file or directory in the name server lfc-rm - remove LFC files or directories in the name server lfc-rmgrpmap - suppress group entry corresponding to a given virtual gid or group name Introduction to Cluster and Grid Computing in Mechanical Engineering 8