Data quality control. Add value to Inspire services

Size: px

Start display at page:

Download "Data quality control. Add value to Inspire services"

Corey Willis
6 years ago
Views:

1 Data quality control Add value to Inspire services

2 Presentation Johan Esko Project manager ISO Inspire Data management

3 Presentation Anna Halvarsson Project manager SDI Inspire Data management

4 1 st May 2011

5 Agenda Introduction Standards Data quality Example Summary

6 Introduction

7 A year ago Inspire conference Krakow 2010 Inspire download service prototype OGC WFS Publishing Workflow Staging Database Distribution Workflow

8 Today Krakow Future development Integrate data quality control (QC) Integrate with OGC CSW Metadata OGC WFS Publishing Workflow Quality Control Staging Database Distribution Workflow Metadata

9 Standards

10 Why use standards? Cornerstone of a SDI Inspire specifications Legible information Own development is expensive

From product specification to metadata Data product

Recipe: 4 eggs 4 tsp water salt Data quality ISO

above) Analyse of the process: 3 eggs 6 tsp water salt

11 From product specification to metadata Data product specification ISO 19131, INSPIRE Data specifications Recipe: 4 eggs 4 tsp water salt Data quality ISO 19113/19114/19138 (ISO will replace the standards above) Analyse of the process: 3 eggs 6 tsp water salt Metadata ISO 19115/19119/19139 Declaration of contents: 3 eggs 6 tsp water salt

12 Data quality

13 Definition of quality The degree to which a set of inherent characteristics fulfills requirements ISO 9000:2000

14 Best quality?

15 Swedish Technology Journal Short wheelbase and minimal overhang at the front and rear, combined with high ground clearance makes it extremely well suited to continue the drive where the road ends. Indeed the Niva outperformthe Porsche Cayenne, which in comparison is clumsy as an elephant with a backpack in a supermarket. (Teknikens värld, 2006) Comment: If it is the terrain capabilities that is evaluated, the Niva fulfils the quality requirements better than the Porsche.

16 Best quality? Which one of these view services delivers data with the highest positional accuracy?

17 Geographic information -Data Quality Data quality can be described by: Data quality elements Completeness Topological consistency Positional accuracy Temporal consistency Thematic accuracy Non-quantitative overview statements (usage, purpose, lineage)

Geographic information -Data Quality ISO 19157 CD Some news Metaquality Usability element New data

18 Geographic information -Data Quality ISO CD Some news Metaquality Usability element New data quality measures etc Schedule ISO CD Text sent to ISO for DIS DIS FDIS IS

19 Quality of data used in Inspire services To evaluate if the data provided by an Inspire service is of sufficient quality Lack of quality information: can make data useless can cause misleading results Inspire data specifications specifies quality elements and data quality measures

20 Data management

management processes are important Input Processes Base

21 Metria -Data management Data Metria s data warehouse stores more than 2 Tb geographical data Automatic data management processes are important Input Processes Base layer Refining Processes Product layer Metadata Portal Web Services

22 Input and refining processes Product Specification Quality Control Metadata ISO INSPIRE Data specifications ISO 19113, 19114, (ISO 19157) ISO 19115, 19139

23 Example Data mangement INSPIRE Protected Sites

24 Data management Step 1 Product Specification Quality Control Metadata

25 Requirement Completeness commission Conformance level = 0

26 Requirement Completeness ommission Conformance level = 0

27 Overall Requirement - Data product specification passed Conformance level = True

28 Requirement -schema

29 Data management Step 2 Product Specification Quality Control Metadata

30 Quality control routines Automatic tests with FME Schema control Completeness Omission Comission Aggregation Data product specifikation passed (Check if all conformance levels passed) Quality results reported as XML in metadata (ISO 19115,19139)

31 Data management Step 3 Product Specification Quality Control Metadata

32 Quality result reported in metadata XML format ISO TS 19139

33 Update metadata in portal using FME and CSW

34 Summary

35 Summary Different users have different requirements Report data quality in metadata Automated quality control processes integrated with the data workflow

36 Questions Visit our booth in the exhibition area Anna Halvarsson Johan Esko

Metadata of geographic information

Metadata of geographic information Kai Koistinen Management of environmental data and information 4.10.2017 Topics Metadata of geographic information What is metadata? Metadata standards and recommendations