Validation in the Netherlands and European Location Framework

Transcription

1 Validation in the Netherlands and European Location Framework INSPIRE Workshop on validation and conformity testing May 2014 Thijs Brentjens

2 Contents Geonovum and ELF INSPIRE INSPIRE in the Netherlands Validation of metadata Validation of network services Experiences from data and service providers Ideal situation for data and service providers Demonstration of validation tooling

3 Geonovum and ELF, related to INSPIRE Role of Geonovum for INSPIRE in NL European Location Framework and validation testing Some backgrounds on ELF Work in progress

4 INSPIRE in the Netherlands How is INSPIRE implemented (overview)? Who is responsible for what? Technical Guidances: policy in NL to follow these (so avoid own implementations / interpretations of Implementing Rules) Some data providers are cooperating, in a service center, which also offers INSPIRE network services Adds extra complexity: validation to determine if the service center has met the criteria for the data providers

5 Validation of metadata Responsibilities Data providers are responsible for testing Procedure: Protocol for testing ( conformiteittoets ) Reporting Tooling: online tool of NL: Schema validation Schematron validation

6 Validation of network services Responsibilities Procedure Tooling: test on Technical guidances using ETF / desktop tool View: WMS, WMTS Download: Atom, WFS (predefined and direct access)

7 Experiences from data and service providers Test during development and in production is appreciated Mostly the same results, but some differences in national tooling and EC tooling -> hard to explain and to decide what to do. Which one tells us the truth? Currently: most common issues are detected by both validators. Less trivial issues might cause differences (this could mean we are on the right track) Most organizations just want to hear they offer compliant metadata and services.

8 Ideal situation for data and service providers Some thoughts on organizational aspects: Our opinion and most urgent need is that the European Commission certifies test/validation tool(s) per Inspire specification!

9 Ideal situation for data and service providers Some thoughts on organizational aspects: There is one truth / single point of validation / validation results are the same, regardless of the tooling used There is an official, certified organization that tells them they are complying to INSPIRE (or what they should do to become compliant)

10 Ideal situation for data and service providers Some thoughts on tooling: Testing required during development ( offline / local installation) and in production ( online / webbased testing) Easy to use tooling Detailed report of the results. Should be very precise / specific and ideally: tell exactly what to fix / improve (Some) open source validation tooling: see exactly what is tested and how Able to integrate tooling in several platforms, including national geoportal (and Discovery Service) and in automatic test process (e.g. Ant / Maven)

11 Ideal situation for data and service providers Some thoughts on support: Helpdesk is appreciated Know when what is / will be changed in validation tooling (public roadmap, issues etc) Ideally, the validator(s) is available on the implementation date of an INSPIRE specification Ideally, there is the ability to validate against previous TGs as well.

12 Validation in the Netherlands demo INSPIRE Workshop on validation and conformity testing May 2014 Thijs Brentjens

13 Validation of metadata: demo NL Online tooling XML schema validation Schematron validation For dataset (ISO 19115) and service (ISO19119) metadata conforming to INSPIRE TG Detailed error reporting

14 Validation of metadata: demo NL URLs nl/genericvalidator/content/standard/290 nl/genericvalidator/content/standard/292

15 Validation of metadata: demo NL Demo / video ( )

16 Validation of data: demo NL Online tooling, GML validation XML schema validation Schematron validation Geometry validation (ISO19107)Detailed error reporting e.g., nl/genericvalidator/content/standard/222

17 Validation of data: demo NL Screenshot

18 Validation of network services: demo NL European Location Framework (ELF) project: Launched in March 2013, the project will run for three years and deliver a pan European cloud platform and web services to build on the existing work of the INSPIRE Directive and enable access to harmonised data in cross border applications. See

19 Validation of network services: demo NL Test tooling based on ESDIN Test Framework (SoapUI) Expanded / changed for INSPIRE View and Download services Geonovum / Kadaster and Interactive Instruments Extending and improving in E.L.F. programme: Webbased interface Better error reporting

20 Validation of network services: demo NL Tests almost all requirements that can be tested automatically And some optional parts Local installation (offline tool) Desktop GUI Command line interface, e.g. for test integration Detailed error reporting, but sometimes very technical Suitable for developers, less suitable for non-technical staff Is being improved at the moment

21 Validation of network services: demo NL View Services: functional : WMS and WMTS implementations conforming to View Services TG 3.0 and 3.11 QoS (basic test): Capacity and performance tests of WMS services Download Services: functional : Atom feed implementations, WFS predefined and direct access

22 Validation of network services: demo NL Demo in GUI Video:

23 Validation of network services: demo NL Commandline, HTML report

24 Validation of network services: demo NL Demo commandline, HTML report

25 Validation of network services: demo NL Work in progress in E.L.F. context: Webbased interface, customizable test suites (select which parts to test on) Better error reporting, more specific and user friendly error messages QoS Discovery Services as an open source project in ELF: also other tests are being worked on, for example on edge matching, data etc

26 Validation of network services: demo NL Work in progress, easy to use webbased interface and reporting

27 Validation of network services: demo NL Questions?