IMPROVING THE INFRASTRUCTURE FOR EARTH OBSERVATION, ACTIONS AND UPDATES FROM THE SENTINEL ALPINE OBSERVATORY AT EURAC RESEARCH

Size: px

Start display at page:

Download "IMPROVING THE INFRASTRUCTURE FOR EARTH OBSERVATION, ACTIONS AND UPDATES FROM THE SENTINEL ALPINE OBSERVATORY AT EURAC RESEARCH"

Noreen Parsons
5 years ago
Views:

, Monsorno, R., Ventura, B., Vianello, A., Costa, A., Zebisch, M.

1 IMPROVING THE INFRASTRUCTURE FOR EARTH OBSERVATION, ACTIONS AND UPDATES FROM THE SENTINEL ALPINE OBSERVATORY AT EURAC RESEARCH Jacob, A., Marin, C., Monsorno, R., Ventura, B., Vianello, A., Costa, A., Zebisch, M., Notarnicola, C. Institute for Earth Observation, Eurac Research, Bolzano Italy

Introduction The Big Picture What is the Sentinel Alpine Observatory? The Sentinel Alpine Observatory (SAO) is an initiative of the Institute for Earth Observation at Eurac Research.

2 Introduction The Big Picture What is the Sentinel Alpine Observatory? The Sentinel Alpine Observatory (SAO) is an initiative of the Institute for Earth Observation at Eurac Research. The aim is the development and provision of satellite products and services mainly based on data from the Copernicus Sentinel program (EC/ESA) for monitoring key environmental variables in South Tyrol and the European Alps Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 2

3 Introduction The Web Portal Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 3

4 Overview Organization of Sentinel Alpine Observatory Services and Infrastructure Catalogue Visualization Data Access Computing Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 4

5 Infrastructure Sentinel Alpine Observatory Applications Data Models & Data Bases e.g. pre - processing of S1 / S2 SOS WCPS WCS Cluster Orchestration & Virtual Environments File Systems CEPH_FS CEPH_RBD Hardware 336 Cores 3 TB RAM 2 x 40 Gb/s 1.4 PB ~50 Cores ~200 MB RAM Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 5

Eurac Research as official GEO Data provider http://www.geoportal.

6 Eurac Research as official GEO Data provider Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 6

7 Catalogue Information about data collections and products > Sentinel 1 > Sentinel 22 Eurac Sentinel Alpine Archive Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 7

8 Bash script + XSLT Cleaning up existing metadata GEOSS Interoperability test Are all eurac research metadata discoverable? YES Are all eurac research metadata accessible and viewable? YES NO NO Some thumbnails unreachable wcs and/or wms service not correctly defined Other various errors: missing mandatory metadata fields, old/wrong information A semi automatic process was necessary to correct these errors Check Metadata title Check Metadata UUID Check Metadata WMS/WCS url tag existence Check Metadata WMS/WCS url reliability NO Is the test fulfilled for all metadata YES Process Completed eurac metadata can be harvested by GEOSS catalogue service Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 8

9 Adopting and extending standards Metadata Standards adopted: The Institute for Earth Observation at EURAC implemented a custom extension of the ISO standard with some additional information tailored specifically for the satellite receiving station data. Basically the EURAC enhancement ( e) extends the packages MI AcquisitionInformation, MI ContentInformation, Innerebner, M., MI Costa, SpatialRepresentationInformation A., Chuprikova, E. et al., and Organizing MI ReferenceSystemInfo. earth observation For a clear data separation the inside new introduced a spatial classes data infrastructure, start with the prefix Earth MIE that Sci is Inform the short (2017) name for 10: Metadata 55. Imagery EURAC. For a comprehensive depiction of the dataset the package MI AcquisitionInformation was extended with the following classes and properties as shown in Fig. 5 The class MIE Instrument derived from MI Instrument was enhanced with two properties that describe the type of scanning system used by the sensor and the spatial resolution of the sensor. The scanning system defines the way of how the data was captured along or across the track. Meanwhile the resolution provides the information of the size of the ground objects distinguished by sensors. Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 9

Data Organization in the Data Cube ESA SInCohMap project hosted @ SAO Sentinel-1 insar Coherence data Bands: VV & VH Coherence

cube in Rasdaman Axes: Master date, Slave date, East, North, Ranges Ranges: VV & VH Any subset of the 5 dimensions can be queried

10 Data Organization in the Data Cube ESA SInCohMap project SAO Sentinel-1 insar Coherence data Bands: VV & VH Coherence Amplitude (3x11 & 4x19) geocoded Bands N E N E Slave date VV Time: VH Area: Donyana, West-Wielkopolska, Meran 5-D Data cube in Rasdaman Axes: Master date, Slave date, East, North, Ranges Ranges: VV & VH Any subset of the 5 dimensions can be queried with WC(P)S request sent from Python Master date Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 10

11 Utilizing the Data Cube ESA SEOM SInCohMap project Coherence amplitude for selected pixels Sentinel-1 Sentinel-2 Coherence NDVI July Shortest Baselines Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 11

12 Utilizing the Data Cube Combining ground and satellite data Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 12

13 Sentinel Alpine Observatory in a Big Data Context Applications Data Models & Data Bases e.g. pre - processing of S1 / S2 SOS WCPS WCS DIAS Cluster Orchestration & Virtual Environments File Systems CEPH_FS CEPH_RBD Hardware 336 Cores 3 TB RAM 2 x 40 Gb/s 1.4 PB ~50 Cores ~200 MB RAM Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 13

14 Conclusion Harmonization and refinement of metadata further extended with accreditation in GEOSS of GEO In the process of facilitating access to EO-data through development of new libraries and standards New web based services for development and computation right next to the data Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 14

15 Outlook Improve interconnection with other platforms/services Make more data openly available Continue development of access tools/api s to EO data Further contribute to definition of standards Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 15

16 Thank you for your attention! Sentinel Alpine Observatory The SAO portal The metadata portal The SAO WCS endpoint openeo project The openeo website The openeo code repository Public test serve SInCohMap project The SInCohMap website The SInCohMap code repository jump to 01:09:00 Jacob et al. Sentinel Alpine Observatory Services & Infrastructure 16

Your cloud solution for EO Data access and processing

powered by Your cloud solution for EO Data access and processing Stanisław Dałek VP - CloudFerro 2 About CREODIAS The platform In 2017 European Space Agency, acting on behalf of the European Commission,