Application of the Catalogue and Validator tools in the context of Inspire Alberto Belussi, Jody Marca, Mauro Negri, Giuseppe Pelagatti

Transcription

1 Application of the Catalogue and Validator tools in the context of Inspire Alberto Belussi, Jody Marca, Mauro Negri, Giuseppe Pelagatti Politecnico di Milano spatialdbgroup.polimi.it INSPIRE Conference, Florence, June 25, 2013

2 Contents 1. Overview of the Catalogue and Validator Tools 2. Use of Catalogue and Validator in the context of Inspire 2

3 PART 1 Overview of the Catalogue and Validator Tools These tools have been developed in-house by Politecnico di Milano (a public University) with the financial support of CISIS (the association of Italian Regions for Informatics, Statistics and Geographic data) They are based on OpenSource technologies: Java based open libraries ireport OpenJump PostGIS 3

4 Main Goals: The Catalogue: a tool for managing a Spatial Data Specification to allow non UML experts to browse through a Data Specification to include in the Data Specification the definition of Spatial (Topological) constraints, in format usable for automatic checking the means for reaching the first goal has been a hypertext-like approach; for instance, if you open a class You can see the inherited properties (properties derived from superclasses) You can see the values of enumerations By clicking, you easily open the related structures: roles, enumerations, codelists, hierarchies, 4

5 Example Screenshot from Inspire Transport Network Application Schema

6 a fundamental component of the Catalogue are the Mapping Generators which bridge the gap between the Data Specification and the Structure of a Spatial Dataset A mapping generator produces the physical schema of a dataset which is conformant to the Data Specification Mapping Generators are available for different spatial technologies 6

7 Mapping Generator Catalogue (Data Specification) Mapping Generator for SQL PostGIS SQL Schema PostGIS Database 7

8 Available Mapping Generators GML: based on the standard encoding rules for GML (ISO/TC 211, 2007) SHAPE: maps classes into Shapefiles, easily usable with current GIS systems SQL: maps classes into SQL tables (without using nested structures) for Oracle and Postgis SQL (Monogeometry): a modification of the previous one, consisting in breaking those SQL tables that contain more than one geometry column created to support the use of GIS technologies which are not capable of dealing with multiple geometries in a table 8

9 The Validator Catalogue Mapping Generator SQL structure Data Specification Source Dataset Physical Model Reader Validator Diagnostic Information 9

10 Validator: main functions read a Source Dataset and check the expected physical structure and the conformance with a Data Specification; in particular: check the structure of the input datasets; e.g. existence of classes and attributes, domain values, referential integrity, etc check the validity of each geometry with respect to the properties of the geometrical types (notice that this implies checking also 3D properties, e.g. a 3D ring must be closed in 3D) check the spatial integrity constraints which are defined in the Data Specification The Validator produces an error diagnostics which is stored in a Derby database, from which it can be queried, specialized reports can be derived, metadata information can be extracted, acceptance measures can be evaluated, etc 10

11 A topological validation example Constraint: every Junction must be equal to the endpoint of some Link ERROR: this junction is isolated 11

12 Catalogue Application Experience First Release: September 2008 The most important application of the Catalogue has been the development of the Italian National Data Specification for Geodatabases (National Core) officially published February 2012 Most Italian Regions have produced or are producing their Regional Data Specifications by extending/adapting the National Core using the Catalogue Also some Municipalities have used the Catalogue for designing their Local Spatial Databases IGM (the Military Geographical Institute) is using the Catalogue for developing the Data Specification for their 1:25000 spatial database 12

13 Validator Application Experience First Release: November 2010 During 2011/2012 the following Regions have done an official experimentation of the use of the Validator in real production environments (of course, the use of the Validator has the use of the Catalogue as a prerequisite): Veneto, Piemonte (aerophotogrammetric production) Lazio (production from existing datasets) Currently several other Regions are using the Catalogue and Validator Lombardia is experimenting the use of the Validator in the regional SDI for checking the «update datasets» sent from the local authorities to the central regional database Trentino is building it s information system including the Validator as a service instead of a standalone application 13

14 PART 2 A scenario for applying the Tools to Inspire Based on an Inspire Database: an SQL database designed in order to support the WFS, since operational databases are not designed for this purpose

15 The big picture INSPIRE DATA MODEL BROWSER (Inspire Data Specifications) derived from Catalogue WFS Configuration SQL mapping generator Source Database SQL scripts SQL Schema INSPIRE DATABASE (e.g. PostGis) WFS VALIDATOR GML datasets 15

16 What has to be done at tool level? Create the Inspire Data Model Browser by extending/ modifying the Catalogue, because there are features of the Inspire Data Model which are not supported by the existing Catalogue there are features of the Catalogue which are not used by the Inspire Data Specifications Define a new SQL mapping, because: the Data Model is changed the existing mappings are not oriented to create a database for supporting the WFS and GML Define a WFS configuration taking care of the Inspire Data Model and of the SQL mapping 16

17 What has each Data Producer to do? The Data producer has to define and implement the SQL scripts which transfer the data from their Source Database to the Inspire Database Source Database SQL scripts INSPIRE DATABASE 17

18 Advanced topic: produce the scripts from a conceptual mapping definition Research on semantic mapping between the specifications from the semantic mapping it is possible to generate the scripts Source Specification define conceptual mapping Inspire Specification Script Generator Source Database SQL scripts INSPIRE DATABASE 18

19 Short term Plans Currently we are working on two items producing the Inspire Data Model Browser loading it with the Annex 1 data models The browser will be distributed freely Foreseen deadline: end of October 19

20 Further Plans We don t have a precise plan for the subsequent actions (mapping generator, WFS configuration) Depends from funding interest of potential users possible partners Any suggestions?? Thank you 20