OGF 30 - Opening and Welcome Steven Newhouse, Chair OGF Board 2006 Open Grid Forum
A Special Thanks to our Organizational Members 2010 Open Grid Forum 2
Thank You Sponsors! Emerald Sponsors: 2006 Open Grid Forum 1
Welcome to Brussels! 2006 Open Grid Forum 4
Registrations Over 250 people from 26 countries 67% Europe 18% North America 14% Asia Pacific 2006 Open Grid Forum 5
Group Sessions New: DCI Federation WG Established OCCI, GIN, PGI GSM, GFS, DIAS GRAAP NSI SAGA GLUE 2.0 2006 Open Grid Forum 6
Workshops Energy Efficient Grids, Clouds and Clusters Component-based HPC Interoperability: EU & India Autonomic Computational Science Cloud & Grid Security SLAs in Grids 2006 Open Grid Forum 7
OGF Leadership Changes President Craig Lee Board Vice Presidents Alan Sill Standards David Wallom Community 2006 Open Grid Forum 8
Dr Craig Lee October 2007 October 2010 Our thanks to The Aerospace Corporation Overseen the growth of Cloud Standards Within OGF Relationships within other SDOs Tireless in raising the profile of OGF 2006 Open Grid Forum 9
Restructuring Position of President remains unfilled Will continue to search Duties delegated to the Board Constitutional duties to the OGF Board Chair Outreach duties shared by the OGF Board VPs join the Board as observers Integrate management and reporting 2006 Open Grid Forum 10
OGF31 Taipei, Taiwan Hosted by ASGC (Academia Sinica) Co-Located with: ISGC2011 TELDAP International Conference IGTF All-Hands 21-25 th March 2011 All welcome! 2006 Open Grid Forum 11
Report from NOMCOM Walter Stewart, Co-Chair 2006 Open Grid Forum
At-Large Board Members The OGF Board: Organisational members At-Large members (4 positions open) Nominated by the OGF Community Voted by the organisational members Duties: Active engagement in OGF or related activities Act as advocates & spokespersons for OGF Run through bi-weekly one-hour telecons Deadline: 5 th November 2010 2006 Open Grid Forum 13
Area Director - Applications Search begins now Groups: Distributed Resource Management Application API WG Grid Remote Procedure Call WG Simple API for Grid Applications (SAGA) WG Contact NOMCOM with nominations: http://www.ogf.org/nomcom 2006 Open Grid Forum 14
Remarks by Outgoing President Craig A. Lee, President, OGF 2006 Open Grid Forum
A Perspective on These Efforts and the last ten years These activities are indicative of the direction and evolution of distributed computing technology, and concomitantly of OGF More than ten years ago, we had a vision: Seamlessly federation of resources Access to data, machines, communication, specialized devices 2010 Open Grid Forum 5
OGF is Uniquely Positioned OGF is uniquely positioned to be the evolution in computer science and information technology that we want to see Dynamically provisioned resources (clouds) are hot, but the federation of resources is fundamental! Clouds are about provisioning, grids are about federation. What's next? (There will be something.) OGF is unique in the academic and scientific constituency it has had It is not (directly) driven by market economics In contrast to most other SDOs, it can more closely follow interesting technology and applications 2010 Open Grid Forum 9
Ian Bird at CHEP 2010 2010 Open Grid Forum 6
Running the WLCG Dashboard Compressed KML download for Google Earth http://dashb-earth.cern.ch/dashboard/ dashb-earth-all.kmz Or run it in your browser: http://dashb-earth.cern.ch http://dashb-earth.cern.ch/?vo=atlas, etc. 2010 Open Grid Forum 7
Other Key Bird Conclusions (and my reactions) Experiments had to work hard to (mostly) hide the grid details from users Traditional grid machinery has to be simplified! Pilot jobs are (almost) ubiquitous in all experiments This unanticipated usage model strongly indicates a needed change The current grid infrastructure can sit transparently over virtualised (cloud) services Quote: And provide a potential path for evolutionary change 2010 Open Grid Forum 8
Some Near-Future Efforts NIST Cloud Roadmapping meeting Alan Sill, OGF VP Standards, attending Gaithersburg, Maryland (DC area), USA, Nov.4-5 IEEE CloudCom OGF invited to participate cloud standards plenary panel, workshop, and IEEE CCSSG meeting Indianapolis, Indiana, USA, Nov. 30-Dec 3 Telecom Cloud Conference OGF invited to present on OCCI Santa Clara, California, USA, Dec. 6-7 Global Inter-Cloud Technology Forum, gictf.jp Use Cases and Interfaces for Inter-Cloud Technology NCOIC.org Geospatial Community Cloud effort 2010 Open Grid Forum 4
Some Concluding Remarks It s been fun! As the previous material indicates, I intend to remain involved Continued contact with OCCI Interactions with Board members Representation as requested Please contact me if you have any questions or comments! 2010 Open Grid Forum
Standards Highlights Alan Sill, VP Standards, and Area Directors 2006 Open Grid Forum
OGF Standards Function Responsible for development of architectures, specifications, roadmaps and glossaries and all technical standards. Eight areas defined by board and community. Overall goal: to promote the adoption of standardized and interoperable distributed computing software. Operates through OGF working groups and through the application of the OGF document process. Includes the management of technical liaisons with other Standards Development Organizations (SDOs). Special activity this OGF: SIENA roadmapping event. 2006 Open Grid Forum OGF30, Brussels, October 2010 24
Overview of Standards Areas Applications Compute Infrastructure Management Architecture Data Liaison Security 2006 Open Grid Forum OGF30, Brussels, October 2010 25
Applications Area Director: Dieter Kranzlmueller Presented by: Andre Merzky 2006 Open Grid Forum
Applications Area Overview Three active groups: DRMAA, GridRPC, SAGA Excellent cross communication All groups have created specs and experience documents (== implementations) 2006 Open Grid Forum OGF30, Brussels, October 2010
DRMAA Group has completed its goals ;-) DRMAA.v1: established standard DRMAA.v2: actively worked upon synchronize with SAGA, BES, JSDL, rethink programming models expand toward resource management, reservation Work mostly done in telcos no session at OGF30 2006 Open Grid Forum OGF30, Brussels, October 2010
GridRPC Group has completed its goals ;-) GridRPC.v1: established standard small community GridRPC.v2: actively worked upon expand RPC calls with remote data handles mostly backward compatible spec is after public comment out any time now No session at OGF30: Thu 5:00pm (Narvik) 2006 Open Grid Forum OGF30, Brussels, October 2010
SAGA-WG Umbrella API effort within OGF Core API + extensions + language bindings Different implementation groups 2006 Open Grid Forum OGF30, Brussels, October 2010
SAGA @ OGF30 GRAAP + SAGA: Mon 3:00pm (Skien) GIN + SAGA: Mon 5:00pm (Harald) SAGA WG I: Wed 11:00am (Stavanger) general session, document business SAGA WG II: Wed 1:30pm (Stavanger) interop demos! SAGA WG III: Wed 3:30pm (Stavanger) group discussion, ongoing work, outreach SAGA + GIN: Thu 9:30am (Skien) 2006 Open Grid Forum OGF30, Brussels, October 2010
Architecture Area Director: Andrew Grimshaw 2006 Open Grid Forum
Compute Area Director: Ramin Yahyapour 2006 Open Grid Forum
Compute Area (1) JSDL-WG (Job Submission Description Language) GFD.149 - JSDL Parameter Sweep Job Extension GFD.140 - Implementation and Interoperability Experiences with the Job Submission Description Language(JSDL) 1.0 GFD.136 - Job Submission Description Language (JSDL) Specification, Version 1.0 [Obsoletes GFD.56] GFD.115 - JSDL SPMD Application Extension, Version 1.0 GFD.111 - JSDL HPC Profile Application Extension, V. 1.0 Currently in public comment: Activity Instance Description Spec. Next: Requirements analysis for a Version 2.0 OGSA-BES-WG (OGSA Basic Execution Service) GFD.108 - OGSA Basic Execution Service Version 1.0 Next: Requirements analysis for a Version 1.1 2006 Open Grid Forum OGF30, Brussels, October 2010 34
Compute Area (2) OGSA-HPCP-WG (OGSA HPC Profile) GFD.151 - HPCBP Advanced Filter Extension GFD.135 - HPC File Staging Profile, Version 1.0 GFD.124 - Interoperability Experiences with the High Performance Computing Basic Profile (HPCBP), Version 1.0 GFD.114 - HPC Basic Profile, Version 1.0 GRAAP-WG (Grid Resource Allocation Agreement Protocol) GFD.167 - WS-Agreement Specification Version 1.0 - Experience Document GFD.107 - Web Services Agreement Specification (WS- Agreement) Current Work: Working on Advance Reservation micro spec Work on Negotiation spec comments Errata for WS-Agreement in public comment 3 sessions today #3 at 15:00 2006 Open Grid Forum OGF30, Brussels, October 2010 35
Data Area Director: David E Martin Area Director: Erwin Laure Presented by: Jens Jensen 2006 Open Grid Forum
Data Area Highlights Data Format Description Language (DFDL-WG) Specification Submitted as a Proposed Recommendation Comprehensive response to public comments Comments mostly from implementers NCSA has created an implementation called Daffodil To be released as open source later this year Parser only (not serializer) 90% of implementation Built using SCALA (compiles to java bytecode) IBM DFDL (internal only, at the moment) Resource question Will publish lots of test cases Tutorial Excellent time to experiment with DFDL and work on implementations 2 Data Area Highlights David E. Martin, dem@alcf.anl.gov
Data Area Highlights (2) Grid File System (GFS-WG) RNS Specification 1.1 Update to general naming spec OGSA WSRF Basic Profile Rendering 1.0 Specific rendering using Web Services Resource Framework Both Will be Published as Proposed Recommendations Soon Interested in Full Implementations Starting Work on File System Usage Profile Excellent Opportunity to Help Define File System Demands 3 Data Area Highlights David E. Martin, dem@alcf.anl.gov
Data Area Highlights (3) Grid Storage Management (GSM-WG) SRM Spec Widely Implemented and Used Converting to a Community Group Opportunity for the SRM User Community to Share Experiences Database Access and Integration Services (DAIS- WG) WS-DAI and WS-DAIR standard, pending final review Working on RDF Representation and Interface Potential links to Semantic Grid Work and other RDF groups Chance to Leverage RDF Work in a Grid Context 4 Data Area Highlights David E. Martin, dem@alcf.anl.gov
Gaps Based on OGSA-Data Work Information Model for Data Resources For Management, Resource Reservation, File Metadata Streaming Integration of Access and Transfer 3rd-Party Delivery Replication, Caching, Catalogues, etc. Consistency, Management OGF-Wide Issues Policy Naming and Registries Sessions Provisioning Security 5 Data Area Highlights David E. Martin, dem@alcf.anl.gov
Infrastructure Area Director: Richard Hughes-Jones 2006 Open Grid Forum
Infrastructure Area: The Groups Network Measurements NM-WG Network Mark-up Language NML-WG DICE Network-Network DNMR-BOF merge spawn Grid-Network Grid High Performance GNI-BOF Networking GHPN-RG Network Measurement & Control NMC-WG Network Service Interface NSI-WG Use Cases Best Practices Standards Firewall RG 2 Firewall Virtualisation WG Open Cloud Computing Interface OCCI-WG 2006 Open Grid Forum OGF30, Brussels, October 2010 On-demand Infrastructure Services Provisioning-RG BoF 42
Network Measurements WG Focused on defining Network Characteristics of interest to grid applications Developed standard mechanisms to describe and publish these characteristics to the Grid middleware, network operators etc. Created XML Schemata to publish and exchange the values of the observations of these characteristics along with attributes describing the measurement conditions. Several versions and trial implementations Monolithic Base + Extensions Created a recommendation: www.gridforum.org/documents/gwd-r/gfd-r.023.pdf 3 2006 Open Grid Forum OGF30, Brussels, October 2010 43
perfsonar Using NM-WG Schema Uptake & Deployment perfsonar is a joint effort: 4 ESnet GÉANT Internet2 RNP (Brazil) ESnet includes: ESnet/LBL staff Fermilab Internet2 includes: University of Delaware Georgia Tech SLAC Internet2 staff An OGF success story: >27 partners 2006 Open Grid Forum OGF30, Brussels, October 2010 GÉANT includes: Arnes Belnet Carnet Cesnet CYNet DANTE DFN FCCN GRNet GARR ISTF PSNC NORDUnet (Uninett) Renater RedIRIS Surfnet SWITCH Other contributions & installations: CLARA (Latin American Cooperation of Advanced Networks) LHC Network JANET 44
Network Measurements & Control WG Standardise the XML protocols currently in use To control the measurement infrastructure To share the results Define Extensible Protocol for Network Measurement and Control The base request messages The base response messages Metadata Message State Machine The extension framework Draft Recommendation is in progress 5 2006 Open Grid Forum OGF30, Brussels, October 2010 45
Firewall Virtualisation for Grid Applications WG Produce a virtualised interface to enable Grid-Middleware - Network to: implement a virtualized firewall service integrate with Grid-middleware security provide a dynamic firewall data-path traversal service to the Grid applications Firewall Traversal Protocol (FiTP) has been defined. Protocol forwarded to IETF for feedback Draft Recommendation doc is in progress 6 2006 Open Grid Forum OGF30, Brussels, October 2010 46
Network Service Interface NSI is designed to allow Grid, Cloud and other applications to mange network connectivity. Key function is creation and management of L1/L2 connectionoriented circuits. The output of the group is a protocol known as the Network Service Interface Also supports provider-to-provider circuit request Group participants ESnet, Internet2, GÉANT, I2CAT, G-Lambda, SURFnet and UvA and others. 7 2006 Open Grid Forum OGF30, Brussels, October 2010 47
NSI documents GFD 1: Network Services Framework The NSF is a framework to support of Network Services Support many NSI services initial service is Connection Service Possible future services, e.g.: Network Topology Exchange Service Status NSF v1.0 ready GFD 2: Connection Service Architecture Allows an application or network provider to request and automatically reserve and provision circuits from other network providers Designed to support circuits that transit multiple service providers Status draft GFD 3: NSI Protocol Normative definition of the NSI protocol. Status: protocol definition starting now 8 2006 Open Grid Forum OGF30, Brussels, October 2010 48
Delivering Network Services Network Service A Network Service B NSI Requester NSA NSA = Network Services Agent NRM = Network Resource Manager Network Services Interface (NSI) Service plane Network Service A NSI Provider NSI Provider NSA Network Service B NRM Transport plane NSI used to communication requests between Agents Provider Agent delivers circuit via Network Resource Manager 2006 Open Grid Forum OGF30, Brussels, October 2010 49
NSF: Network topology NSF describes method for aggregating topology into Networks 2006 Open Grid Forum OGF30, Brussels, October 2010 50
NML: Network Markup Language NML = Network Markup Language Goal Create a network description ontology and schema 1.Ontology (Terminology, Schema) 2. Syntax 11 2006 Open Grid Forum OGF30, Brussels, October 2010 51
Scope In Scope Logical Network Infrastructure Multi-layer networks Configuration Capability Out of Scope Physical Network Infrastructure Policy Authentication 12 2006 Open Grid Forum OGF30, Brussels, October 2010 52
Status Consensus on Terminology Ties with related work (ITU, TMForum, IETF) (Academic) discussion on data model: ( Can we model everything as an abstract relation? ) Need Implementers Need practical use cases 13 2006 Open Grid Forum OGF30, Brussels, October 2010 53
What? OCCI provides features to identify, link and operate on RESTful Resources via HTTP Cloud 15 2006 Open Grid Forum OGF30, Brussels, October 2010 54
OCCI: Done Released Use-case docs Successfully run through public comment phase once About to release next revision Active collaboration Many stuff going on behind the scenes Trademark etc 16 2006 Open Grid Forum OGF30, Brussels, October 2010 55
OCCI: To Do Update the TODO List Move up the stack Release next revision Update the charter 17 2006 Open Grid Forum OGF30, Brussels, October 2010 56
Management Area Director: Andre Merzky Presented by: Andre Merzky 2006 Open Grid Forum
Management Area UR: Usage record User Requirements UR for Storage AccountingUser Thu 1:00 pm (Skien) ARI first session! Welcome! :-) spawned by RISGE-RG Goals: information model + service interface for accessing remote instruments Mon 5:00 pm (Narvik) 2006 Open Grid Forum OGF30, Brussels, October 2010
Management Area - DCIFed DCIFederation first session! Welcome! :-) automatically negotiated, SLA-secured, dynamically provisioned federation of resources boot strapping, use cases, adoption Mon 9:00 am (Bergen) Mon 11:00 am (Bergen) 2006 Open Grid Forum OGF30, Brussels, October 2010
Management Area - GLUE GLUE abstract information model version 2 is specified renderings (XML, LDAP, SQL): WiP Thu 1:00 pm (Narvik) 2006 Open Grid Forum OGF30, Brussels, October 2010
Security Area Director: Jens Jensen 2006 Open Grid Forum
Recent(ish) Docs OGSA-Authz-WG VOMS attribute format being re-reviewed again one more time (3-5 reviewers) Rather technical CAOPS-WG GFD.169 CA Audit guidelines Version issues raised, discuss at OGF30 HLCA work getting there (going since 2006 or so) Document is complete when there is nothing left to remove 2006 Open Grid Forum OGF30, Brussels, October 2010
Recent(ish) Docs CAOPS cont d RPDNC completed at OGF29 Requirements for Relying Party Defined Namespace Constraints Slightly more freedom in choice of CA by filtering E.g. Globus signing_policy CAOPS: IGTF Usual PMA updates expected (quod videt) Private key protection updated and mostly agreed by PMAs 2006 Open Grid Forum OGF30, Brussels, October 2010
Other Activities Cloud security: industry and academia Industry activites, eg CSA, CloudAudit,... EU funded activities (lots) See presentations Tuesday morning Big Q: for which work is OGF the relevant SDO And the other one: what else is out there? 2006 Open Grid Forum OGF30, Brussels, October 2010
Concluding Remarks All areas of Standards development are very active with many opportunities for involvement by new members. Contact Alan Sill, VP Standards or any Area Director or Board member for more details. Enjoy OGF30! 2006 Open Grid Forum OGF30, Brussels, October 2010 65