THE PLATFORM TOWARDS A BIG EO DATA SYSTEM LINKING GLOBAL USERS AND DATA PROVIDERS J. Van Bemmelen (1), P. De Salvo (2), M. Santoro (3), P. Mazzetti (3), G. Colangeli (1), S. Nativi (4) (1) European Space Agency (2) GEO Secretariat (3) Institute of Atmospheric Pollution Research, National Research Council of Italy (4) EC Joint Research Centre
Group on Earth Observation and Global Earth Observation system of systems GEO AND
The Group on Earth Observation (GEO) GEO is a partnership of more than 100 national governments and in excess of 100 Participating Organizations that envisions a future where decisions and actions for the benefit of humankind are informed by coordinated, comprehensive and sustained Earth observations. Ministers of the GEO member governments meet periodically to provide the political mandate and overall strategic direction for GEO. The Mexico City Ministerial Declaration from the GEO Ministerial Meeting in 2015 saw world leaders commit to support open Earth observation data for the next decade.
104 106 Participating Member States Organizations
Global Earth Observation System of Systems () Together, the GEO community is creating a Global Earth Observation System of Systems (). Earth observations from diverse sources, including satellite, airborne, insitu platforms, and citizen observatories, when integrated together, provide powerful tools for understanding the past and present conditions of Earth systems, as well as the interplay between them. aims to better integrate observing systems and share data by connecting existing infrastructures. There are more than 200 million open data resources in from more than 150 national and regional providers such as NASA and ESA; international organizations such as WMO and the commercial sector such as Digital Globe.
Platform (a.k.a. Common Infrastructure - GCI) IMPLEMENTING
DOWNSTREAM Application Developers (intermediate Users) end Users Applications Applications Applications MIDSTREAM Platform UPSTREAM Enterprise System 1 Enterprise System 2 System Enterprise 4 System 3. Enterprise System 3 Enterpris e System 1 Enterprise SBA 1 System j SBA 2 System 4. Enterprise System 2 Enterpris e System K. Enterprise System 1 Enterprise System System 3 Enterprise 4 System 2 SBA 8. Enterprise System Z Providers
The Platform A collaboration between Co-financed via Grant from DG-RTD Connecting Earth Observation Users x Resource Providers Following a user-centric approach based on three pillars: collaboration, customisation and re-use Coordination with international players via GEO, EC, ESA
The Platform Components Data Providers Mirror Societal Benefit Areas Widget > 400 million data resources spanning all SBAs Yellow Pages API Status Checker View
Some Platform Numbers Users presently links more than 178 open data catalogs and information systems, comprising over 414 million data and information resources., in the last two years, served about 15 thousand unique users finalizing about 150 thousand searches ~ 150 thousand searches > 178 Data Providers > 45 million Datasets > 400 million Granules 35 Languages Platform including APIs
Geolocation of unique IP addresses
Academic User Commercial User Governamental User Hosting User Private User Unknown User
ADDRESSING HETEROGENEITY
GEO DAB OGC CSW 2.0.2 AP ISO 1.0 INPE OGC CSW 2.0.2 ebrim EO CKAN OGC CSW 2.0.2 ebrim CIM ESRI GEOPORTAL 10 OAI PMH 2.0 ESRI GEOPORTAL 10 OpenSearch 1.1 OpenSearch 1.1 ESIP OpenSearch GENESI DR CKAN NetCDF CF 1.4 CUAHSI HIS Central ESRI REST API 10.3 OGC WCS OGC WMS Ecological Markup Language 2.1.1 OGC WFS 1.0.0, 1.1.0, 2.0.0 OGC WMTS OGC SOS 1.0.0, 2.0.0, 2.0.0 Hydro Profile HDF OGC WPS 1.0.0 IADC DB (MySQL) OGC CSW 2.0.0 Core GrADS DS OGC CSW 2.0.2 AP ISO 1.0 FedEO OGC CSW 2.0.2 ebrim/eo AP ARPA DB (based on Microsoft SQL) OGC CSW 2.0.2 ebrim/cim AP ESRI Map Server IRIS Station SHAPE files (FTP) IRIS Event KISTERS Web Environment of Canada HYRAX THREDDS SERVER 1.9 Environment Canada Hydrometric data (FTP) OAI PMH 2.0 Harvesting OpenSearch 1.1 GBIF Earth Engine DIF RASAQM HYDRO EGASKRO UNAVCO SITAD (Sistema Informativo Territoriale Ambientale Diffuso) CDI 1.04, 1.3, 1.4 File System ISO19115 2 GDACS THREDDS 1.0.1, 1.0.2 GeoRSS 2.0 THREDDS NCISO 1.0.1, 1.0.2 Degree catalog service 2.2 THREDDS NCISO PLUS 1.0.1, 1.0.2 OpenSearch GENESI DR Introduction of a brokering tier (GEO DAB) DCAT dedicated to mediation of GI cat service interfaces and metadata models harmonization in a transparent NCML OD way for both users and data providers. BCODMO NCML CF The GEO DAB maps the diverse models onto its own internal model, which is general enough to comprise all FTP the populated necessary with supported concepts. metadata types WAF Web Accessible Folders The key features of the GEO DAB internal GeoNetwork data (2.2.0 and or greater) metadata models are flexibility and extensibility allowingnerrs adding (National new Estuarine concepts Research Reserve and System) related HMA CSW 2.0.2 ebrim/cim attributes.
Portal User-centric, considering various user communities: GEO Flagships and Global initiatives ESA Thematic Exploitation Platforms SBA/Thematic Customization: Satellite: includes smart filters for imagery (Landsat, Sentinel 2) and SAR-type (Sentinel 1) satellite data; Disater Resilience SBA: Earthquake events filters
Platform Re-usable Components SUPPORTING USER COMMUNITIES
APIs DOWNSTREAM MIDSTREAM end Users A set of standard Web service interfaces: e.g. OGC service interfaces, OAI-PMH, FTP, etc. A set of APIs for software developers: Client side APIs: (high-level) JavaScript library. (Python) Server side APIs: REST/JSON APIs OpenSearch APIs. Applications Applications Applications Application Developers (intermediate Users) Common Infrastructure APIs Mediation modules Portal Advanced users who are experienced in the utilization of geospatial data Web developers with good knowledge of W3C technologies, including: HTML5, Javascript, and CSS Expert users in developing applications which communicate with remote servers over HTTP
View Definition: Subset of the whole resources defined by applying, via the DAB, a set of clauses Discovery clauses (e.g. spatial envelope, keywords, sources, etc.) Access clauses (e.g. data format, access protocol, CRS, etc.) Defined View exposed via the Portal/APIs/Widgets/Mirror Sites Consumer-defined View i.e. Client-side These views are available only for the client application which defined the view. Provider-defined View i.e. Server-side These views are available for all client applications.
Widget A freely-available instantiation of selected Portal widgets with various functionality made available for possible customization in various areas of application (e.g., a specific SBA, Initiatives, etc.). This is accomplished by publishing portal code parts (widgets) wrapped up in API Kernel at server side (continue maintenance, enhancements, etc., like a library)
Mirror Portal site customisation for SBAs, Flagships, Initiatives, Communities It is available at www.geoportal.org/community/geo_x_initiative The customisation will better serve the specific community interests by filtering: Catalogues and search results by a specific theme or view (e.g., cold regions, mountains, etc.) Location of interests Services/Processing/Tools (in the future )
Thank you