Finnish Collaborative Ground Segment. Jyri Heilimo Finnish Meteorological Institute Finland NCP

Transcription

1 Finnish Collaborative Ground Segment Jyri Heilimo Finnish Meteorological Institute Finland NCP

2 Finnish Collaborative Ground Segment Local reception of Sentinel-1 Direct Broadcast Focus on NRT and Quasi-Real-Time products Baltic Sea Ice service Sentinels data local mirror site Safe long-term archive of scientific data Local mirroring of: S1, S2, S3, S5P Automated data processing lines for specific products Bulk processing Sentinels data dissemination: Data processing services Virtualization environment for operational product processing Hosted processing (IaaS, PaaS) Calvalus Processing Cluster for efficient Remote sensing data storage and processing FMI Arctic Space Centre

3 FinHUB Utilises the ESA developed DHuS system Allows easy migration from Open Access Hub AOI covers Baltic Sea Drainage basin and some more Operational and open for public since May 2015 Total 316 registered users ~60% increase of users annually Mostly Finnish research institutes: FMI, SYKE, VTT, But also other European users Nordic countries (SE, IS) Baltic countries (EE, LV) Switzerland, Italy, France, Germany Also from overseas: Canada, Tunis, Japan, China, Zimbabwe 316 ~90% 340 TB FMI Arctic Space Centre

4 Data access Focusing on Nordic and Arctic regions Most data is available online A single REST API to access Sentinels data HTTP(s) based, Open data protocol (Odata), Open Search (Solr) Programing language agnostic Easy migration from OpenHUB Safe long-term archive of scientific data Ceph storage offers well scalable storage capacity S3 object storage for efficient and fast data access Current capacity ~800TiB OGC services supported for satellite data products No self registration Statistics, audit trail of who access what FMI Arctic Space Centre

5 Tools and processing services Virtualization environment for operational product processing and hosted processing Based on existing mostly open source tools Libraries and CLI, Interactive GUIs A catalogue of pre-defined VM images Pre-installed with tools relevant for use cases Libraries, Desktop applications VM Images can contain direct data access via API clients VM Images can be specialized and can cater for different use cases Leverage big data technologies, like Hadoop Calvalus Processing Cluster Smartmet/brainstorm server FMI Arctic Space Centre

6 Why National satellite data centre? How does it work with DIAS? Flexibility, availability and response Provide reliable access to Sentinels data for Finnish users and partners Maintain local long-term archive of Sentinels data from Baltic sea region Scientific use, long-term change detection, data resilience Special needs special applications Provide fast access of S1 scenes for Baltic Sea ice monitoring and icebreaker support Process local and/or NRT products e.g. Baltic Sea water quality, Flood detection and impact assessment etc. Perform bulk processing of data for local use e.g. S2 L1b -> L1c with national DEM (TBC) Operational since 2015 DIAS enter into V0 in 2018 Interface to DIAS FINHUB will run SMARTMET/BRAINSTORM - and GEOServer for in-situ and satellite data DIAS is will be one data source of FINHUB FINHUB can use DIAS services FMI Arctic Space Centre

7 APPLICATIONS AND SERVICES FMI Arctic Space Centre

8 Baltic Sea Ice Monitoring Commercial and environmental needs FMI Sodankylä Finland is essentially an island ~90% of Finland s import and export via sea routes Gulf of Finland is one of the most busiest marine routes for oil transport Operative Service S1 CSK L0 processing Availability target 99.9% Quasi-real-time / NRT needs Daily products Customer: Finnish Transport Agency CMEMS RSAT2 CSK TSX L1 processing L2 processing Finnish, Swedish, Estonian Ice breakers CMEMS Operations: FMI Helsinki Ice Service 24/7 monitoring Ice analysts Fully automated processing lines at Sodankylä Operators and ice analysts in 2 shift 24/7 monitoring of the processing lines Data need: Sentinel-1 EW HH+HV pass-through Radarsat 2, Cosmo-Skymed, TerraSAR-X AOI: Baltic Sea Time: Nov May FMI Arctic Space Centre

9 Flood detection and monitoring Annual flooding of rivers in Bothnia Spring floods due snow melt Autumn floods due heavy rain Operational service for regional authorities Flood covered area, Flood depth Forest floods Terrain corrected SAR image Water detection Data needs SAR data: Cosmo-SkyMed and Sentinel-1 Polarisations: HH + HV Time: Apr-May Timeliness: NRT ~3hrs AoI: Finland Removal of natural waters and bogs Flood extent and depth maps Filtered flood areas FMI Arctic Space Centre

10 Copernicus Global Land Service Cryosphere products Snow Extent, Snow Water Equivalent, Lake Ice Extent (by FMI, ENVEO, SYKE) Northern-Hemisphere Snow Extent (SE) Pan-European Snow Extent (SE) Lake Ice Extent (LIE) for Baltic Sea area Northern Hemisphere SWE Pan-European SWE Finnish Meteorological Institute (FMI), ENVEO and Finnish Environment Institute (SYKE) are producing daily near-real time products on snow cover and lake ice for Pan-European domain and Northern Hemisphere. The products have a long-standing legacy from ESA GlobSnow and EC Cryoland projects. The cryosphere products have been developed in close collaboration between FMI, ENVEO and SYKE and will be produced jointly at the FMI production centre. 11

11 Issues, lessons learned and future plans Ceph object storage Not compatible with DHUS NFS mount of object storage is not as fast as local disc Hopefully swift API will be updated to support Ceph Sentinels data format Difficult to non-expert users New data dissemination methods under development Future plans Improve statistics collection Migration to Docker Ecflow to improve system monitoring FMI Arctic Space Centre

12 Contact info: Jyri Heilimo Arctic Space Center Finnish Meteorological Institute Erik Palménin aukio 1 P.O.Box 503 FIN Helsinki Finland Tel: jyri.heilimo@fmi.fi FMI Arctic Space Centre Kuva: Matias Takala