Federated Earth Observation (FedEO) OpenSearch Status

Size: px

Start display at page:

Download "Federated Earth Observation (FedEO) OpenSearch Status"

Kristian Simpson
6 years ago
Views:

1 Federated Earth Observation (FedEO) OpenSearch Status CEOS WGISS Meeting #38 29 September 3 October, 2014 Moscow, Russia Hosted by Roscosmos and JSC RSS M.Albani, P.Mougnaud, A.Della Vecchia (ESA) Yves Coene (Spacebel) Page 1

2 Outline OpenSearch Implementation Evolution since WGISS #37 Future Work Demo Page 2

3 FedEO Client Partner Guide General description of the FedEO environment and its relation to other systems Details about the FedEO query interface based on OpenSearch (e.g., principles, the search parameters, search response format, etc...) Description of two cases: one starting from a dataset series catalogue, and a second one accessing immediately the dataset catalogue Details on the catalogue connectors and how their corresponding dataset series and dataset metadata can be discovered Page 3

4 FedEO OpenSearch Implementation Currently OpenSearch access to: HMA Catalogs supporting OGC : Atom with EOP O&M (OGC ) metadata as foreign markup or atom:link. CWIC catalogs: Atom with DC or ISO metadata as foreign markup or atom:link OpenSearch catalogs e.g. Virtual Archive 4 and G-POD: Atom or RDF or Interface aligned with OASIS searchretrieve 1.0 conventions. Additional RESTful interface being prepared. Implemented: OGC r8 Geo and time Extension OGC r4 Extension for Earth Observation Page 4

5 FedEO Demo (*) (*) (*) include series metadata Draft GSC Operations Concept, PBEO Feb 2010 Page 5

6 FedEO OpenSearch Architecture Two step search approach: Step 1: search dataset series (parallel search in 4 catalogs - optional) Step 2: search datasets inside the selected dataset series (eo:parentidentifier).. Page 6

7 FedEO OpenSearch Architecture OpenSearch Collection-level search STEP-1 / STEP-2 via rel= search and <dc:identifier> Allows for same collection identifier in two catalogs: E.g. parentidentifier = EOP:ESA:GPOD-EO:ASA_IM 0P dct:haspart EOP:ESA:FEDEO EOP:ESA:FEDEO:COLLECTIONS dct:haspart EOP:ESA:GPOD-EO EOP:ESA:EO-VIRTUAL-ARCHIVE4 EOP:VITO:VGT_S10 EOP:ASF EOP:SPOT:ALL MSG_SEVIRI ATS_TOA_1P ASA_IM 0P Page 7

8 OpenSearch (Example Gazetteer) Parameters: Request: Collection: IKONOS Less than 10% cloud cover Area of interest: 1 km from Frascati Time frame: dentifier=eop%3aegeos%3aegeos%23ikonos&startdate= T00:00:00Z&cloudCover=10]&endDate= T00:00:00Z&name=frascati&radius=1000 Use as client. Page 8

9 OpenSearch (Example Gazetteer) Page 9

10 OpenSearch (Example Gazetteer) Same result visualised directly by Firefox Web Browser Page 10

11 Work Performed Interface changes: Return Simple GEORSS (CEOS Recommendation) Support for StartPage queryable Support for eo:platform and eo:instrument in Collection level search (EOP:ESA:FEDEO:COLLECTIONS). Preserve semantic annotations in ISO collection metadata in Atom response (as per OGC r2). Page 11

12 Work Performed Improved Atom response in case of ISO collection metadata with semantic annotations (OGC r2) Page 12

13 Work Performed Additional collections NASA ECHO on/atom%2bxml&parentidentifier=eop:nasa:echo&query=ve getation STD_FRAME_L0&bbox=-80.0,- 90.0,80.0,90.0&startPage=1&maximumRecords=10 Issue: discover list of parentidentifiers? Page 13

14 Work Performed Additional collections CNES SPIRIT, Disasters Charter catalogs :CNES:SPIRIT&query=Russia :CNES:CHARTER&query=Germany ESA DISSHARM Landsat 5 etc. ANDSAT_5_TM&startDate= T00:00:00Z&endDate= T00:00:00Z Page 14

15 Work Performed Additional Collections Page 15

16 Work Performed Additional Collections Collections accessible through FedEO (26/09/2014) Page 16

17 Compliance Tests (incl. OpenSearch) ETS available and being deployed on TEAM x Page 17

18 Compliance Tests Page 18

19 Compliance Tests Page 19

20 Open-source OpenSearch Software Open-Source Components available at: Documentation available on ESA HMA Wiki. Page 20

21 Outline OpenSearch Implementation Evolution since WGISS #37 Future Work Demo Page 21

22 Query Analyzer Integration Integration with CNES RESTo Query Analyzer. Simplied OSDD understood by Web Browser search I/F <?xml version="1.0" encoding="utf-8"?> <OpenSearchDescription xmlns=" xmlns:dc=" xmlns:eo=" xmlns:geo=" xmlns:semantic=" /opensearch/extensions/semantic/1.0/" xmlns:sru=" xmlns:time=" <ShortName>FEDEO</ShortName> <Url template=" ataset&query={searchterms?}&startrecord={startindex?}&maximumrecords={count? } &recordschema={sru:recordschema?}" type="application/atom+xml"/> </OpenSearchDescription> OBEOS KO Meeting 1 Sep 2014 Page 22

23 Query Analyzer Integration Integration with CNES RESTo Query Analyzer: type=dataset&query=images acquired today by Spot HRV acquired yesterday by radarsat sar Page 23

24 Query Analyzer Integration Gateway obtains platform, instrument and the other parameters from the CNES RESTo Query Analyzer Search Terms FedEO Gateway (P3) List of OpenSearch parameters RESTo Query Resolver (P7) Example: Search Terms: Images acquired today by Spot HRV List of OpenSearch parameters returned by RESTo Query Analyzer: "eo:platformshortname":"spot% "eo:instrument":"hrv%" "time:start":" t00:00:00 "time:end":" t23:59:59" Page 24

25 Future work Interface: Implement CEOS OpenSearch recommendations Improve compliance with INSPIRE Download Service Technical Guidance. Harmonise Atom response messages from different backends Have 2 nd -step OSDD link point to FEDEO in all cases. Start counting results from 1 in all cases. Support ISO and EOP O&M metadata format for more backends (GPOD, VA4 etc.) Page 26

26 Future work - Harmonisation Harmonisation Collection Metadata format (OGC r1) Harmonisation Product Metadata format (OGC r4) Page 27

27 Future work - Harmonisation Harmonise Collection Metadata Format ion/atom%2bxml&query=mer_frs_1p CURRENT NEW Page 28

28 Future work - Harmonisation Harmonise Product Metadata Format ntidentifier=mer_frs_1p&startdate= t00:00:00z&enddate= T00:00:00Z NEW CURRENT Page 29

Future work Collection Metadata Additional Collection Metadata in EOP:ESA:FEDEO:COLLECTIONS http://smaad.spacebel.be/opensearch/request/?

29 Future work Collection Metadata Additional Collection Metadata in EOP:ESA:FEDEO:COLLECTIONS R&parentIdentifier=EOP:ESA:FEDEO:COLLECTIONS&type=col lection Has positive effect on #collections that support 2-STEP search in FedEO. 511 Page 30

Future work Linked Data Open Linked Data:

30 Future work Linked Data Open Linked Data: Additional media types: HTML media type with schema.org annotations RDF media type for dataset series. Make available FedEO metadata to the Linked Open Data (LOD) community. W3C RDF, DCAT, LDP 1.0 ESA FedEO Page 31

31 Future work Linked Data CEOS? eo:instrument eo:platform URI isni.org? organisation URI GEMET keyword URI loc.gov Language URI ESA FedEO dataset series dataset URI NASA KMS Keyword Mgt System loc.gov Country URI ESA RARE Multidomain thesaurus Page 32

32 « «EOP:VITO:VGT_S10» rdf:about dc:identifier « T00:00:00» series1 dc:issued rdf:type dcat: Datasett dc:language language1 rdf:type skos: Conceptt dcat:theme rdf:about skos:preflabel « «land cover» concept1 rdf:type skos: Conceptt rdf:about « Page 33

33 Outline OpenSearch Implementation Evolution since WGISS #37 Future Work Demo Page 34

FedEO Demo http://services-test.eoportal.

34 FedEO Demo Page 35

FedEO Demo http://fedeo.esa.int/opensearch/readme.

35 FedEO Demo Examples of two-step approach: collections and granule search Page 36

Additional information http://fedeo.esa.int/opensearch/readme.html http://geo.spacebel.be/opensearch/readme.html Philippe.Mougnaud@esa.

36 Additional information Further reading: ESA_TM-21_Heterogeneous_Missions_Accessibility Page 37

HMA for Science - Evolution. Final Presentation

HMA for Science - Evolution. Final Presentation HMA for Science - Evolution Final Presentation Y. Coene, Spacebel s.a. Tri Tran Minh, Spacebel s.a. Minh Nguyen Quang, Spacebel s.a. 16 October 2014 ESRIN, Frascati Page 1 Outline Introduction Science