SDI Workshop ESDIN Best Practices 2011-06-28 INSPIRE conference, Edinburgh Arnulf Christl, Metaspatial Download this slide set as ODP or PDF at http://arnulf.us/publications
Arnulf Christl Geospatially aware software developer since 1991. Manager and Spatial Systems Architect. Current President of OSGeo OGC Architecture Board Member OpenStreetMap Advocate Founder of several companies and initiatives, talks and travels too much. INSPIRE 2011 SDI Workshop Edinburgh, UK 2 / 25
What? Consultation and Implementation of - Spatial Data Infrastructures - Metadata Why? To leverage your spatial data How: Open Source Software - Open Standards - Agile management INSPIRE 2011 SDI Workshop Edinburgh, UK 3 / 25
ESDIN Introduction ESDIN is an econtentplus Best Practice Network project Run time from September 2008 to March 2011 & ongoing coordinated by EuroGeographics Key goal: help member states, candidate countries and EFTA States prepare their data for INSPIRE Annex 1 spatial data themes and improve access: 1. Coordinate Reference Systems 2. Administrative Boundaries 3. Cadastral Parcels 4. Hydrography 5. Transport Networks 6. Geographical Names INSPIRE 2011 SDI Workshop Edinburgh, UK 4/25
Project partners EuroGeographics Bundesamt für Kartographie und Geodäsie (BKG), Germany IGN Belgium, IGN France, Statens Kartverk, Norway, The Finnish Geodetic Institute, Lantmäteriet, Sweden, Kort & Matrikelstyrelsen,Denmark, National Land Survey of Finland, interactive instruments, Bonn Bundesamt für Eich- und Vermessungswesen (BEV), Austria Beuth Hochschule für Technik, Berlin Geodan Software Development & Technology, Netherlands, 1Spatial, UK EDINA, University Edinburgh, UK National Agency for Cadastre and Real Estate Publicity, Romania National Technical University of Athens, Greece Institute of Geodesy, Cartography and Remote Sensing, Hungary Helsinki University of Technology, Finland INSPIRE 2011 SDI Workshop Edinburgh, UK 5/25
Specific Objectives: Implement Annex 1 INSPIRE compliant web based services which support the aggregation of harmonised data across borders and across themes Daily delivery fdsa OGC WFS Maintain Core Data Protected NMCA data Secure Environment INSPIRE 2011 SDI Workshop Edinburgh, UK 6/25
Automized processing to achieve: Highest quality products With near real time delivery Reference Data INSPPIRE Annex Themes Generalization Edge Matching Unique IDs Daily delivery Quality Evaluation INSPIRE 2011 SDI Workshop Edinburgh, UK 7/25
Specific Objectives: high delivery frequency EU Commission Real Estate, Industry Global Regional (OGC WFS) High Resolution INSPIRE (OGC WFS) Aggregate data through development of INSPIRE web services at different levels of detail. Citizens Banking and Insurances Public Administration Emergency Education Utilitiy Companies Traffic Control Environment Protection NATO Geology INSPIRE 2011 SDI Workshop Edinburgh, UK 8/25 subscription low delivery frequency
NMCA Local Data Schema & CRS Transformation Transform local schemas to common INSPIRE data specification framework. Data Integration & Conflation Integrate INSPIRE data into compatible collaborative dataset(s). Edge Matching Ensure cross-border consistency across neighbouring data. Test INSPIRE Implementation Rules and specifications in a live environment and recommend improvements. Geometric Generalisation Cartographic Enhancement Reduce data complexity, for effective use at alternate scales. Modify and enhance data for mapping purposes. INSPIRE 2011 SDI Workshop Edinburgh, UK 9/25
Outcomes: Greater understanding of the technical consequences of INSPIRE for key content stakeholders, eg, the European NMCAs Greater understanding of the business consequences of INSPIRE Wider access to geospatial digital content, eg, to the European academic sector Core components of the ESDI established Operational services covering 6 INSPIRE Annex 1 themes Test environment INSPIRE 2011 SDI Workshop Edinburgh, UK 10/25
Specifically the Project will (1): Provide data for INSPIRE Annex 1 themes at a range of scales. "Range of scales" are realized through "varying Level of Detail" Assess the suitability of this information as a basis for linking to other themes. The result are plans for a European Location Framework forming the foundation for LinkedData INSPIRE 2011 SDI Workshop Edinburgh, UK 11/25
Specifically the Project will (2): Put in place services capable of transforming and providing access to data. The project has successfully supported several (but not enough) NMCAs in setting up services Develop a quality model. Quality of originating data, processing steps, generalization as basis for fitness of use in different domains. INSPIRE 2011 SDI Workshop Edinburgh, UK 12/25
WP6: Migrate existing pan European small scale products to ExM: ExM Data Specification EuroGlobalMap EuroRegionalMap EuroBoundaryMap INSPIRE Data Specs INSPIRE Data Specifications as framework. Note overlap INSPIRE 2011 SDI Workshop Edinburgh, UK 13/25
WP7: Extend ExM to incorporate large scale data: ExM Data Specification European NMCAs large scale products: Cadastral parcels INSPIRE Data Specs INSPIRE is scale independent, but access to multiple scales is important for large numbers of users Transformation and generalisation services required! INSPIRE 2011 SDI Workshop Edinburgh, UK 14/25
WP10 ExM Transformation specifications ExM Implement transformation rules for participating NMCAs. Prepare for generalisation. INSPIRE Large scale Medium scale Small scale INSPIRE aware Location framework Transformation Large scale Medium scale NMCA 1 Small scale Large scale Medium scale NMCA N Small scale Multiple European NMCAs INSPIRE 2011 SDI Workshop Edinburgh, UK 15/25
WP9: NMCA Data maintenance and business processes Improve geospatial maintenance at the European level Edge-matching methodologies Stable Unique Identifiers Near real-time Change-only Updates for power users (subscription model) INSPIRE 2011 SDI Workshop Edinburgh, UK 16/25
Edge Matching INSPIRE 2011 SDI Workshop Edinburgh, UK 17/25
Initially planned Architecture ExM Large EBM ERM ExM EGM Medium ExM Small Datasets downloaded for user applications Euro- Geographics Download EBM Conformance testing EBM ERM EGM ERM Download EGM Download EBM, ERM and EGM are just specific download services from respective ExMs EG services are cascading to NMCA services EG GeoRM is a broker for NMCA GeoRM Quality evaluation Conformance testing Download EBM ERM Download EGM Download Download EGM Download ERM EBM Download Conformance testing Quality evaluation NMCA Master data Transformation ExM Large ExM Large Transformation NMCA Master data This NMCA derives both ExM Large and ExM Medium from its Master data Generalization Transformation Conformance testing Conformance testing ExM Medium Generalization ExM Small Edgematching Edgematching Metadata Additional data Generalization ExM Medium Generalization Conformance testing Conformance testing This NMCA derives ExM Large from its Master data, and generalize ExM Medium from ExM Large INSPIRE NMCA 1 2011 SDI Workshop Edinburgh, UK NMCA 18/25 2 ExM Small ExM Metadata Metadata
Initial Capability Scenario High frequency: Daily delivery OGC WFS Reference Data INSPPIRE Annex Themes Generalization Edge Matching!! Unique IDs Quality Evaluation Subscription / WebHooks EU Commission Real Estate, Industry Citizens & Administration Banking and Insurances Academia Low delivery frequency, yearly Protected NMCA data Protected Area Maintain Core Data asynchronous reporting Maintain Core Data Offline Protected NMCA data Protected INSPIRE 2011 SDI Workshop Edinburgh, UK 19/25
Reference Data EU Commission Production Scenario INSPPIRE Annex Themes Generalization Edge Matching subscription Real Estate, Industry Citizens & Administration Banking and Insurances Academia!! Unique IDs Schema Transformation Protected NMCA data Quality Evaluation Schema Transformation Frequeny of delivery Secure Env Schema Transformation Protected NMCA data Protected NMCA data Secure Environment Schema Transformation Secure Environment Protected NMCA data Schema Transformation Protected NMCA data Secure Environment Schema Transformation Protected NMCA data Secure Environment Schema Transformation Protected NMCA data Secure Environment Secure Env asynchronous reporting INSPIRE 2011 SDI Workshop Edinburgh, UK 20/25
Architecture Addressing Diversity Publication service integrated with production Service oriented production with semi automatic transformation process Production with manual transformation for publication service Lassi Lehto, FGI Finland Arnulf Christl, Metaspatial
Architecture Addressing Stability Publication data available through INSPIRE view and Download Services plus additional "mass market" formats and interfaces. Replication of publication data adapted to NMCAs processes. Central data cache allows for optimized scalability and availability of pan-european data Arnulf Christl, Metaspatial
Proposed Integrated Architecture EuroGeographics Architecture integrated with INSPIRE conceptual model
INSPIRE SDI Challenges Distributed Work Teams Availability of production quality WFS services (eg no GML 3.2.1) Licencing Policies Time and manpower constraints of participating NMCAs Involvement of stakeholders INSPIRE 2011 SDI Workshop Edinburgh, UK 24/25
Adopting new Project Methodology Introducing Scrum in WP 11 Development Clear definition of roles Product Manager: focus on maximising ROI Team: daily stand-up meetings improve focus Scrum Master: Removes impediments High acceptance by development teams and management (after some positive experience)! INSPIRE 2011 SDI Workshop Edinburgh, UK 25/25
Scrum Outline Create ad hoc focused distributed teams Maintain Product Backlog Define Sprint Goal Create Sprint Backlog Iterate Report Amend 24h 10 days INSPIRE 2011 SDI Workshop Edinburgh, UK 26/25
ESDIN: Practical Outcomes European Location Framework Ready to serve as reference for LinkedData ESDIN Architecture and Data Viewer (dev) Access Security using Shibboleth Best Practice: How to get things done the INSPIRE way Outreach through seminars, articles, etc. INSPIRE 2011 SDI Workshop Edinburgh, UK 27/25
Conclusion Prospects for the European Location Framework Using ESDIN best practice and tools will Improve process efficiencies Enable interoperability Support users processes with consistent, reliable reference data Coordination of INSPIRE data is needed An emergent community supports the ELF www.esdin.eu INSPIRE 2011 SDI Workshop Edinburgh, UK 28/25
Thank you for your attention! Time for Questions and Answers The international Open Source Conference for the Geospatial Domain http://2011.foss4g.org This Slide set can be used, reused and modified by anybody for any purpose. See also: Copystraight. Copyright: Arnulf Christl 2011 Download this slide set as ODP or PDF at http://arnulf.us/publications INSPIRE 2011 SDI Workshop Edinburgh, UK 29 / 25
Wait, what are these URLs? http://kademo.nl/gs2/inspire/wms?request=getcapabilities http://kademo.nl/gs2/inspire/wms? LAYERS=CP.CadastralParcel&FORMAT=image %2Fpng&TRANSPARENT=true&SERVICE=WMS&VERSIO N=1.1.1&REQUEST=GetMap&STYLES=&EXCEPTIONS=a pplication%2fvnd.ogc.se_inimage&srs=epsg %3A4258&BBOX=7.00152,52.26366,7.01570,52.27183&WI DTH=810&HEIGHT=466 INSPIRE 2011 SDI Workshop Edinburgh, UK 30 / 25