Overview of WMS/LB API

Similar documents
MyProxy Server Installation

g-eclipse A Framework for Accessing Grid Infrastructures Nicholas Loulloudes Trainer, University of Cyprus (loulloudes.n_at_cs.ucy.ac.

A Practical Approach for a Workflow Management System

WMS Application Program Interface: How to integrate them in your code

Advanced Job Submission on the Grid

LCG-2 and glite Architecture and components

Grid services. Enabling Grids for E-sciencE. Dusan Vudragovic Scientific Computing Laboratory Institute of Physics Belgrade, Serbia

30 Nov Dec Advanced School in High Performance and GRID Computing Concepts and Applications, ICTP, Trieste, Italy

R-GMA (Relational Grid Monitoring Architecture) for monitoring applications

AMGA metadata catalogue system

glite Grid Services Overview

Tutorial for CMS Users: Data Analysis on the Grid with CRAB

glite Middleware Usage

Architecture of the WMS

Failover procedure for Grid core services

Network Administration/System Administration (NTU CSIE, Spring 2017) Homework #5. Homework #5

How to use computing resources at Grid

CREAM-WMS Integration

Utilizing Databases in Grid Engine 6.0

Parallel Computing in EGI

Eclipse Technology Project: g-eclipse

Heterogeneous Grid Computing: Issues and Early Benchmarks

Improving Grid User's Privacy with glite Pseudonymity Service

Comparative evaluation of software tools accessing relational databases from a (real) grid environments

C++ Code Structure. Cooperating with the Compiler

Caching Tile Cache Creation & Management

SLCS and VASH Service Interoperability of Shibboleth and glite

Deploying virtualisation in a production grid

The glite middleware. Presented by John White EGEE-II JRA1 Dep. Manager On behalf of JRA1 Enabling Grids for E-sciencE

EUROPEAN MIDDLEWARE INITIATIVE

Microsoft Azure Stream Analytics

CMPT 117: Tutorial 1. Craig Thompson. 12 January 2009

Implementation of Continuous Integration for Linux Images

The LGI Pilot job portal. EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers

Gergely Sipos MTA SZTAKI

엄현상 (Eom, Hyeonsang) School of Computer Science and Engineering Seoul National University COPYRIGHTS 2017 EOM, HYEONSANG ALL RIGHTS RESERVED

Grid Infrastructure For Collaborative High Performance Scientific Computing

Interconnect EGEE and CNGRID e-infrastructures

CS 326 Operating Systems C Programming. Greg Benson Department of Computer Science University of San Francisco

Improving Application Performance by Submitting Scripts to Batch using Zend Server for IBM i

A Simplified Access to Grid Resources for Virtual Research Communities

SSC - Web applications and development Introduction and Java Servlet (I)

A Cloud-based Dynamic Workflow for Mass Spectrometry Data Analysis

Programming by Delegation

Setup Desktop Grids and Bridges. Tutorial. Robert Lovas, MTA SZTAKI

Message Queueing. 20 March 2015

Testing with Soap UI. Tomaš Maconko

EGEE and Interoperation

Databricks, an Introduction

Programming the Grid with glite

Improved 3G Bridge scalability to support desktop grid executions

DataGrid. Document identifier: Date: 24/11/2003. Work package: Partner: Document status. Deliverable identifier:

WMS overview and Proposal for Job Status

Grid Experiment and Job Management

#jenkinsconf. Managing jenkins with multiple components project. Jenkins User Conference Israel. Presenter Name Ohad Basan

Integration of the guse/ws-pgrade and InSilicoLab portals with DIRAC

Pointer Analysis in the Presence of Dynamic Class Loading. Hind Presented by Brian Russell

Gatlet - a Grid Portal Framework

Problemi di schedulazione distribuita su Grid

Enabling Grids for E-sciencE. A centralized administration of the Grid infrastructure using Cfengine. Tomáš Kouba Varna, NEC2009.

Client-side Debugging. Gary Bettencourt

But before understanding the Selenium WebDriver concept, we need to know about the Selenium first.

Copyright 2016 Ramez Elmasri and Shamkant B. Navathe

EGI-InSPIRE. GridCertLib Shibboleth authentication for X.509 certificates and Grid proxies. Sergio Maffioletti

ALICE Grid/Analysis Tutorial Exercise-Solutions

Package Manager. RPM (Red Hat Package Manager)

CASTORFS - A filesystem to access CASTOR

High Performance Computing and Programming, Lecture 3

Co-ReSyF Hands-on sessions

PROCE55 Mobile: Web API App. Web API.

CS 370 The Pseudocode Programming Process D R. M I C H A E L J. R E A L E F A L L

CAAM 420 Daily Note. Scriber: Qijia Jiang. Date: Oct.16. Project 3 Due Wed 23.Oct. Two parts: debug code and library exercise.

EUROPEAN MIDDLEWARE INITIATIVE

GRID COMPUTING APPLIED TO OFF-LINE AGATA DATA PROCESSING. 2nd EGAN School, December 2012, GSI Darmstadt, Germany

How to build Scientific Gateways with Vine Toolkit and Liferay/GridSphere framework

Big Data Hadoop Stack

The Slide does not contain all the information and cannot be treated as a study material for Operating System. Please refer the text book for exams.

IEMS 5722 Mobile Network Programming and Distributed Server Architecture Semester 2

GitLab-CI for FPGA development at LHCb 21/11/2018 CERN ELECTRONICS USERS GROUP - GITLAB CI FOR FPGAS 1

Resource Allocation in computational Grids

Developing Solutions for Google Cloud Platform (CPD200) Course Agenda

Enabling Grids for E-sciencE ISSGC 05. XML documents. Richard Hopkins, National e-science Centre, Edinburgh June

CREAM Computing Element Overview

Call: JSP Spring Hibernate Webservice Course Content:35-40hours Course Outline

ISTITUTO NAZIONALE DI FISICA NUCLEARE Sezione di Padova

Linux Essentials. Smith, Roderick W. Table of Contents ISBN-13: Introduction xvii. Chapter 1 Selecting an Operating System 1

Cloud Computing. Summary

Dr. Giuliano Taffoni INAF - OATS

GIS Deployment Guide. Introducing GIS

Datacenter Simulation Methodologies: Spark

NAREGI PSE with ACS. S.Kawata 1, H.Usami 2, M.Yamada 3, Y.Miyahara 3, Y.Hayase 4, S.Hwang 2, K.Miura 2. Utsunomiya University 2

CS140 Operating Systems Midterm Review. Feb. 5 th, 2009 Derrick Isaacson

ECE 15B COMPUTER ORGANIZATION

H-Store Introduction. Andy Pavlo February 13, 2012

KERNEL C.I. USING LINARO S AUTOMATED VALIDATION ARCHITECTURE. Wednesday, September 11, 13

ArcGIS Runtime: Building Cross-Platform Apps. Rex Hansen Mark Baird Michael Tims Morten Nielsen

Igniting QuantLib on a Zeppelin

COMP 524 Spring 2018 Midterm Thursday, March 1

Today. Operating System Evolution. CSCI 4061 Introduction to Operating Systems. Gen 1: Mono-programming ( ) OS Evolution Unix Overview

Bob Jones. EGEE and glite are registered trademarks. egee EGEE-III INFSO-RI

Transcription:

Overview of WMS/LB API Emidio Giorgio www.eu-egee.org

Outline API vs. CLI Overview of WMProxy API Overview of Logging and Bookkeeping API Usage examples

API vs. CLI Users applications can be integrated on grid either using CLI users have to provide code invoking command line and handling outputs Pros faster deploy Cons tight dependency from command line behavior bad performance API calls to middleware services are embedded within applications Pros better perfomance real integration of application Cons slower deploy

CLI approach

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface

CLI approach Your application Command line User Interface Output

API approach API

API approach Your application API

API approach Your application API

API approach Your application API

API approach Your application API

API approach Your application API Output

API Rub-up API are usually provided as libraries libraries have to be included when compiling the application code $ gcc -o simple-job-stat -I/opt/glite/include -L/opt/glite/ lib -lglite_lb_client_gcc32dbgpthr myappl.c calls to functions provided are inserted inside the application code // get the filesystem path to jdl-file from CLI string jdlpath=argv[argc -1]; jdl::ad ad; // declare a new ClassAd // initialize the ClassAd with file content ad.fromfile (jdlpath); // convert AD to String and save it in jdlstring string jdlstring (ad.tostring()); /* call joblistmatch */ vector < pair < string,long > > matchingces = joblistmatch(jdlstring, delegationid, &cfg);

WMS API glite 3.1 $ rpm -qa grep -i glite-wms grep api glite-wms-wmproxy-api-python-3.1.8-4.slc4 glite-wms-wmproxy-api-java-3.1.3-1 glite-wms-wmproxy-api-cpp-3.1.10-5.slc4 $ rpm -ql glite-wms-wmproxy-api-cpp-3.1.10-5.slc4 /opt/glite/include/glite/wms/wmproxyapi /opt/glite/include/glite/wms/wmproxyapi/wmproxy_api.h /opt/glite/include/glite/wms/wmproxyapi/wmproxy_api_utilities.h /opt/glite/lib/libglite_wms_wmproxy_api_cpp.a /opt/glite/lib/libglite_wms_wmproxy_api_cpp.so /opt/glite/lib/libglite_wms_wmproxy_api_cpp.so.0 [cut...] Allow to list-match and submit a jdl file output retrieve more details during practicals JDL API are requested too Have a look to the included header files to check out how to improve functionalities and info provided

LB API Not directly deployed same libraries used by command lines are included Only in C For each query to LB, expressed through the job ID, a struct is returned, and filled with all the information about the queried job Users inspect the returned struct in order to get infomations about the job Challenge Improve the output provided from the example providing more info? Have a look to edg_wll_queryattr within /opt/glite/include/glite/lb/consumer.h to see what can be obtained from a query

Material Working examples http://grid.ct.infn.it/twiki/bin/view/gilda/apiusage http://grid.ct.infn.it/twiki/bin/view/gilda/wmproxycppapi http://grid.ct.infn.it/twiki/bin/view/gilda/apilbcpp http://grid.ct.infn.it/twiki/bin/view/gilda/apijavawmproxy References Google...