HMA Standardisation Status GSCB Meeting, 18-19 June 2009, Frascati P.G. Marchetti, ESA Y. Coene, SPACEBEL GSCB Meeting, 18 June 2009 Slide 1
Overview Context and Objectives Evolution of specifications Test Environment Open Source (and COTS) implementations Conclusion GSCB Meeting, 18 June 2009 Slide 2
What is HMA A collaborative project started by the GSCB in 2005 with the objective To guarantee a seamless and harmonised access to heterogeneous earth observation (EO) datasets from multiple mission ground segments, including national missions and ESA missions. To standardise the ground segment interfaces of the satellite missions for easier access to EO data. To provide interoperability for coordinated data access enabling the interactions with services or Value Adders and EO Contributing Missions. GSCB Meeting, 18 June 2009
Why HMA Increased demand for EO data, of different missions All EO mission play a vital role in addressing global programmes like GMES and Climate Change The number of missions needed to establish the necessary observation capacity for critical services is ever growing, Interoperability is needed to reduce the burden to planners and operators! GSCB Meeting, 18 June 2009
HMA Partners Partner ASI with the support of Role Cosmo-Skymed Thales Alenia Space CNES with the support of Pleiades, Spot Spot Image CSA with the support of MDA Radarsat 2 DLR with the participation of Infoterra GmbH EUMETSAT ESA DMCii EUSC EMSA Terrasar Meteo Missions ERS,ENVISAT, Sentinels DMC User User GSCB Meeting, 18 June 2009
The Standards To current status have contributed the Agencies and users, and the work of 25 companies over 10 countries! Overview of the status to be given by Yves Coene EO collection metadata EO product metadata Collection and service discovery status by IGN and Conterra Catalogue Service status by ERDAS live presentation of Open Source Catalogue by CNR-IMAA Order Feasibility Analysis live presentation of Open Source implementation by DEIMOS and Spot Image Online Data Access: including WMS Identity (User) Management GSCB Meeting, 18 June 2009
How changes to the standards are managed The HMA Architecture Working Group - HAWG is in charge of the Configuration Management and the coordination of the HMA standards between several agencies. the HAWG performs two sets of activities: manage the changes / corrections to the current HMA standard documents (i.e manage the evolution of the standards baseline(s)) prepare the future evolutions and orientations of the HMA standards. GSCB Meeting, 18 June 2009
Context "HMA": harmonised interfaces to heterogeneous EO missions Being operationally implemented. Common interfaces for discovery, catalogue, ordering, programming, metadata GSCB Meeting, 18 June 2009
Context HMA based on two track approach: operational implementations and parallel "standardisation and support activities" Standardisation and support activities to: 1. Permit evolution and test of HMA interoperability standards in parallel with operational implementation of EODAIL and interfaces I/F with Partner G/S. 2. Support conformance testing of HMA adopted standards. 3. Support implementation of HMA defined standards by European Institutional Users and geospatial software product developers GSCB Meeting, 18 June 2009 Slide 9
Overview Context and Objectives Evolution of specifications Product Catalogue Collection Catalogue Programming Web Mapping Service Test Environment Open Source and COTS implementations Conclusion GSCB Meeting, 18 June 2009 Slide 10
Status of specifications Product Catalogue (OGC 06-131 v0.2.4) Now maintained by RWG at OGC Inclusion of Abstract Test Suite, alignment with latest ebrim AP. More examples and explanations (cardinality etc.) OGC Vote expected June/July 2009. Collection Catalogue (OGC 07-038 v0.1.10) Now maintained by RWG at OGC INSPIRE conformance class Relationships services with collections as per INSPIRE MD Guidance. Hook for keywords / thesaurus names Inclusion of Abstract Test Suite, alignment with latest ebrim AP. OGC Vote expected June/July 2009. GSCB Meeting, 18 June 2009 Slide 11
Status of specifications OGC 07-063 EO Extension of WMS (Infoterra-UK) Inclusion of Abstract Test Suite Development of the Abstract Test Suite highlighted a number of minor issues which were addressed. OGC TC Valencia OGC 06-126 Conformance Test Language Now includes support for testing synchronous and asynchronous SOAP interfaces. OGC TC Athens OGC 07-018 EO Profile for SPS (Spotimage) Preliminary alignment with upcoming SPS 2.0 was tested via implementation for optical and radar SPS. GSCB Meeting, 18 June 2009 Slide 12
Overview Context and Objectives Evolution of specifications Test Environment Collection Catalogue - OGC 07-038: CIM Extension Package Product Catalogue - OGC 06-131: EO Extension Package User Management - OGC 07-118: User Management for EO Open-source (and COTS) implementations Conclusion GSCB Meeting, 18 June 2009 Slide 13
Testing To support the test of HMA-compliant EO interfaces: Use SSE as persistent testbed Use same open-source conformance test engine as OGC (TEAM engine). Test scripts contributed to OGC CITE SC become open-source Host conformance tests at ESRIN, accessible via public Web pages. GSCB Meeting, 18 June 2009 Slide 14
Conformance Testing "Testing Policy" document produced by IGN-F. Mapping of OGC Test terminology to ECSS E40 terminology Acceptance Test Plan Test design (ATS) Test cases Test procedures Test scripts (ETS) Acceptance Test report ETS outputs GSCB Meeting, 18 June 2009 Slide 15
CITE Conformance Testing Conformance Testing (CITE) development for Product Catalogue Collection Catalogue User Management Cross testing of all available end-points by all test implementors Test scripts (CTL), list of endpoints, Web interface to run tests accessible from HMA Wiki. Expected completion July/August 2009. More information to use the environment on the Wiki GSCB Meeting, 18 June 2009 Slide 16
Overview Context and Objectives Evolution of specifications Test Environment Open source (and COTS) Implementations Conclusion GSCB Meeting, 18 June 2009 Slide 17
VITO Implementation Apply EO Profile of GML (OGC 06-080) on VITO Product collections Base products (VGT-P), Synthesis products (VGTS S-1, VGT-S10, VGT-D10) Derived Products (DMP, NPP, NEP, VPI,.) Focus on: Discovery Metadata : required metadata elements (queryables and returnables) for catalogue use Exploitation Metadata : all required information for correct interpretation of the product as mask (flag) values, band ranges, uom,... GSCB Meeting, 18 June 2009 Slide 18
Conclusion Metadata mapping: EO Profile of GML (with minor corrections/adaptations) is well suited for product discovery for all VITO EO Product collections =>Comments published on OGC EO EP SWG WIKI and ESA HMA WIKI For the exploitation metadata for derived products a specific application schema was developed that inherits from the eop schema VITO Implementation borrows some element names from ISO19115 (/2) namespace for VDP - Vegetation Derived Products HMA Product Catalogue implementation VGT4Africa Product collections Will use the derived schema ERDAS Apollo Catalogue with custom harvesters GSCB Meeting, 18 June 2009 Slide 19
G-POD Implementation User Management integration with ESA G-POD Grid Processing on Demand Objectives: Harmonization of authentication and authorisation between G- POD and HMA Assess the potential of HMA User Management (OGC 07-118) in a Grid infrastructure Promote the usage of HMA User Management specification Output: SOAP Gateway implementing HMA user management interfaces integrated in G-POD (on reference platform at Terradue) GSCB Meeting, 18 June 2009 Slide 20
Mapserver Implementation Consistent interpretation of the OpenGIS Web Map Server standard as a basis for interoperable WMS serving of EO products OGC 07-063 To enable and promote interoperability between CSW and WMS services: providing users with a mechanism to evaluate EO products before order / dissemination; providing users with a seamless process for discovery -> evaluation -> order / dissemination. GSCB Meeting, 18 June 2009 Slide 21
HMA Implementations Other implementations/deployments of HMA standards Product Catalogue OGC 06-131 EO Extension Package for ebrim for WS-Dali at Spot Image available. EO Proxy OGC Filter Decoder CS-W ebrim Decoder Encoder GML WS-DALI CONNECTOR WS- DALI Encoder Collection Catalogue OGC 07-038 CIM Extension Package for Spot Image collections Feasibility Analysis / Programming OGC 07-018 for optical (Spot) and radar instruments (Earth Explorer - Deimos). GSCB Meeting, 18 June 2009 Slide 22
HMA Implementations Other open-source implementations of HMA standards GI-Cat reference implementation of Product catalogue by CNR- IMAA (OGC 06-131). GI-Cat reference implementation of Collection catalogue by CNR- IMAA (OGC 07-038) SWE-Common Sensor Planning Service (OGC 07-018) Library by Spotimage EO Extension WMS (OGC 07-063 ) open-source implementation based on UMN Mapserver (Infoterra-UK) User Management Authorisation Service (OGC 07-118) - in opensource SSE toolbox (Intecs) ERGO reference implementation of Product and Collection catalogue. OGC TEAM Test engine code contributions (sourceforge) GSCB Meeting, 18 June 2009 Slide 23
Open Source Implementations Up-to-date list of open-source implementations on HMA Wiki pages GSCB Meeting, 18 June 2009
Conclusion Standards are available and have been implemented by various organisations either as open source or COTS (see next presentations) Documents and software available at wiki.services.eoportal.org Evolution is mainly in new areas: Comply with evolutions of OGC base standards Discovery alignment with INSPIRE requirements Lessons learned (e.g. enlarge the number of examples etc.) GSCB Meeting, 18 June 2009
Conclusion More information? HMA Wiki http://wiki.services.eoportal.org Email Pier.giorgio.marchetti@esa.int Yves.coene@spacebel.be GSCB Meeting, 18 June 2009 Slide 26