Hands-on Training INSPIRE Network Services

Transcription

1 1 April 2014 Hands-on Training INSPIRE Network Services Jacxsens Paul SADL KU Leuven

2 2 Overview How will we work? Lots of demo s & exercises Quick recap on Web Mapping Service (if necessary) Introduction to OpenGeo Suite GeoServer concepts & settings Why do I need geo web services? Adding your map service to desktop applications Web Feature Services (WFS) What do I need to make a real online WMS / WFS? Styling INSPIRE (recap) Software solutions to implement INSPIRE GeoServer INSPIRE extension INSPIRE test suites (& performance test tools) INSPIRE conformant Metadata How to locate the geo web service when I see an online map?

3 3 Introduction This seminar aims at experts who already have some basic knowledge of INSPIRE Network Services. Therefore, we would like to recommend participants who do not have a basic knowledge of INSPIRE Network Services to have a look at the material of the seminar on Basics of INSPIRE Network Services : The presentation can be found here: as3_basics_of_inspire_network_services.pdf First part of the weblecture: c79bb7527&height=388&width=640&autostart=false Second part of the weblecture: de fe&height=388&width=640&autostart=false

4 4 How will we work? Exercises will be introduces by the lecturer (slide, demo ) Then it s your turn: Follow the printed hand-outs (instructions will get less detailed over time) You can ask help Do not: Go to the next unannounced exercise (even if you are fast / have finished). You can try-out other elements on the same webpage / alternatives of the same exercise. Try not to disturb your fellow participants

5 5 Software used OpenGeo Suite: GeoServer INSPIRE extension Quantum GIS (QGIS) Google Earth (click on Download Google Earth)

6 6 But let s start with a demo Use case: map of Unesco site in Leuven

7 7 Use case: map of Unesco site in Leuven First I ll go to because I know there is a good change to find a Flemish map there I type in the search criteria Unesco

8 Use case: map of Unesco site in Leuven 8 After a click on the second search result

9 Use case: map of Unesco site in Leuven 9 Now there are multiple possibilities: 1. I click on the link of the owner ( Agentschap Onroerend Erfgoed ) 2. I click on the Show on map button 3. I click on the metadata button 4. I download the data

10 After click on the Show on map button 10 Combine it with other maps (other themes) like archive maps

11 11 After I click on the link of the owner ( Agentschap Onroerend Erfgoed ) On the website of the data owner I see a link to his own geo-portal. There I see the same area (brown with yellow), but this map also shows other related layers from the same data producer.

12 12 Metadata Abstract, contact information (again with a link to the website / geo-portal of the data producer)

13 13 Use case: map of Unesco site in Leuven It is even possible to find the same layer in the geo-portal of Mercator (that was the first the search result of geopunt) You have seen 3 network services in action: Discovery Services, View Services & Download Services

14 14 Use case: map of Unesco site in Leuven Questions: So who has the data??? Is the data duplicated for each geo-portal? Who maintains the data and how is this data updated on all 3 geo-portals? Answer: With open standards as Web Viewing Service it is possible to keep the data in one place only, the logical choice would be with the data producer ( Agentschap Onroerend Erfgoed ) All the geo-portals link to the same Web Viewing Service The data itself (shapefile, geo-database ) is kept securely on a private network behind the Web Viewing Service Note: To have a geo-portal is not a INSPIRE obligation

15 15 OGC Standards Web Mapping Service (recap)

16 16 WMS Web Map Service As its name implies, is a service that provides maps. Data only leaves the server as an image Map is rendered on the server so styling and presentation are how the data provider chooses. Limited client interactivity with the map.

17 17 Web Map Service (WMS) Opengeo.org Note: source material (data) from which the image is generated need not be an image Can be a Shapefile, PostGIS database, Oracle Spatial,

18 Introduction to OpenGeo Suite 18

19 19 Introduction to OpenGeo Suite Full stack of software: GeoServer PostGIS GeoWebCache OpenLayers GeoExt Download: Easy installation: 6 x <Next>

20 20 What is OpenGeo Suite? A complete geospatial software stack in a single package. PostGIS - A spatially enabled object-relational database. GeoServer - A software server for loading and sharing geospatial data (creating WMS, WFS ). GeoWebCache - A tile cache server that accelerates the serving of maps (built into GeoServer). GeoExplorer - A web application for composing, styling, and publishing maps, based on: GeoExt - A library for building desktop-like mapping applications in a browser OpenLayers - A opensource web mapviewer / a library for putting maps in a browser.

21 21 Exercises Demo how to start OpenGeo Suite + where to find documentation on GeoServer: or click on About GeoServer Up to you: Exercises 1 & 2 1. Starting GeoServer & previewing a few layers 2. Importing your own data (a folder of shapefiles)

22 GeoServer concepts 22

23 GeoServer concepts 23

24 24 GeoServer concepts Workspaces A workspace / "namespace" is just a tag (or logical folder) to group similar data together. It is designed to be a separate, isolated space relating to a certain project. Workspaces are denoted by a prefix (example: "nyc") Technically, the name of a workspace is a URI = Uniform Resource Identifier, not the short prefix (ex: A URI is similar to a URL, but does not need to resolve to a web site. Stores, layers, and layer groups all must have an associated workspace. Using workspaces, it is possible to use identical layers in different places without naming conflicts. Stores Source data: a directory full of shape files or a database instance File directories are configured by providing a path. Databases are configured by providing connection information. Layers Each individual shape file, or spatial database table, is considered a Layer. Layer Groups Multiple Layers can be bound into groups, that can then be referenced by a single name. Useful for creating maps composed of multiple layers. Styles A style is applied to a Layer to create a cartographic output. Provides a way of viewing data for end-users.

25 25 Your turn Please complete exercise 3 Creating a layer group

26 26 Why do I need geo web services? What can I use it for?

27 27 Why? Web mapping is about more than google maps It's possible to: Share your own map data with everyone regardless of the software they use And choose how far you want to go: Only allow viewing = WMS Also allow downloading = WFS Also allow online editing = WFS-T (transactional WFS) Combine your map data with map data from others Create a web page / web application with your map data It s a INSPIRE requirement to set up services so your data can be found and accessed

28 28 Adding your Web Map Service to desktop applications

29 29 Adding your Web Map Service to Demo of: desktop applications Quantum GIS (QGIS) with copy//paste from layer preview Google Earth: to add a WMS layer in Google Earth: Manually: Click (in Google Earth) the menu item Add and choose Network Link Enter a name for the layer The link = the URL to the WMS server + /kml?layers=layer_name Example: Automatic: Go to Layer Preview (in GeoServer) Choose Google Earth as a viewing option Click Go, save and open the KML file (this is not possible for layer groups) (You can move your settings from tempory places to my places)

30 30 Your turn again Please complete exercise 4 Adding your Web Map Service to desktop applications (less detailed instructions)

31 GeoServer settings 31

32 32 GeoServer settings Settings of the Web Map Service Service metadata (= important): Field Enabled Description Specifies whether the respective services WCS, WFS or WMS should be enabled or disabled. When disabled, the respective service requests will not be processed. Strict CITE compliance Maintainer Online Resource Title Abstract Fees When selected, enforces strict OGC Compliance and Interoperability Testing Initiative (CITE) conformance. Recommended for use when running conformance tests. Name of the maintaining body Defines the top-level HTTP URL of the service. Typically the Online Resource is the URL of the service home page. (Required) A human-readable title to briefly identify this service in menus to clients (required) Provides a descriptive narrative with more information about the service Indicates any fees imposed by the service provider for usage of the service. The keyword NONE is reserved to mean no fees and fits most cases. Access Constraints Describes any constraints imposed by the service provider on the service. The keyword NONE is reserved to indicate no access constraints are imposed and fits most cases. Keywords List of short words associated with the service to aid in cataloging and searching

33 33 GeoServer settings Changing the admin password: Go to Security \ Click on the tab page Users/Groups Click on the user admin Edit and save the new password

34 34 One more Exercise number 5 GeoServer settings

35 35 Web Feature Services (WFS) (recap)

36 36 WFS Static interface model The static interface model for the OGC Web Service model appears in the figure below. WFS basic WFS-T The basic Web Feature Service supports feature query and retrieval. A Transactional Web Feature Service (called WFS-T) enables the creation, deletion, and updating of features.

37 How to enable WFS in GeoServer (+ demo) 37 A: it is already enabled by default Check out the settings & metadata: Change from Transactional to basic: More information on the settings:

38 38 GeoServer WFS Service levels Basic - Basic service levels provides facilities for searching and retrieving feature data with the GetCapabilities, DescribeFeatureType and GetFeature operations. It is compliant with the OGC basic Web Feature Service. This is considered a READ-ONLY web feature service. Transactional - In addition to all basic WFS operations, transactional service level supports transaction requests. A transaction request facilities the creation, deletion, and updating of geographic features in conformance with the OGC Transactional Web Feature Service (WFS-T). Complete - Includes the LockFeature support to the suite of transactional level operations. LockFeature operations help resolve links between related resources by processing lock requests on one or more instances of a feature type.

39 39 WFS output formats Format Syntax Notes GML2 outputformat=gml2 Default option for WFS GML3 outputformat=gml3 Default option for WFS and Shapefile outputformat=shapezip ZIP archive will be generated containing the shapefile JSON outputformat=applicati on/json Returns a GeoJSON or a JSON output. NoteoutputFormat=json is only supported for getfeature (for backward compatibility). JSONP outputformat=text/java script Returns a JSONP in the form:parseresponse(...json...). CSV outputformat=csv Returns a CSV (comma-separated values) file

40 40 A demo and then it s your turn again Demo: Adding a WFS to Quantum GIS Your turn again: please complete exercise 6 On Web Feature Services If you are not happy with the language interface of GeoServer you can complete extra exercise #1 (at the end)

41 41 WFS Filtering You can give the URL of your WMS or WFS in a filtered way: No Filter: Filtering by workspace: Filtering by layer

42 What do I need to make a real online WMS / WFS? Webserver Wiki: The term web server can refer to either the hardware (the computer) or the software that helps to deliver web content that can be accessed through the Internet. Important is having a permanent internet address also known as a fixed I.P. (Internet protocol) address. (If the I.P. address changes, the web site would not be found and will appear offline, the browser will display a cannot find web site error, example: x). Handy but not required is a domain name like kuleuven.be is easier than

43 43 What do I need to make a real online WMS / WFS? 2. Installation rights to the webserver (a part of) a webserver can be hired, but installation rights are not included by default Maybe you have a webserver running in your organisation You or the system administrator of the webserver should install a WMS/WFS server application (GeoServer, MapServer, Geomajas, DEEGREE, OpenGeo Suite see presentation of Friday slide 35) Firewall on the webserver should open the port of the WMS/WFS server application so you can use it (for OpenGeo Suite this is port 8080)

44 44 What do I need to make a real online WMS / WFS? 3. Get the data on your WMS/WFS File based data (shapefiles ): You need read & write access to a network location on the web server itself or on a network location that the web server can also access to be able to import the data in you WMS/WFS Geo database (POSTGIS ): You need access to a geo database that is also accessible by your web server Than you can finally browse to

45 Let s add some style 45

46 46 Web Map Service (WMS) Opengeo.org

47 47 Styled Layer Descriptor (SLD) Describes how a map will look like Instruct a Web Map Service (WMS) how to render a specific layer Open standard created by the Open Geospatial Consortium (OGC). XML-based format

48 Styled Layer Descriptor (SLD): example 48 Draws a simple 6-pixel red circle for each data point:

49 49 Where are my styles in GeoServer? In the web interface go to: On your harddrive go to the GeoServer data directory A setting you can find in the Server Status Default = C:\ProgramData\Boundless\OpenGeo\geoserver\styles It it strongly recommend to make a backup of your styles before making any changes.

50 50 Styles Creating SLD files by hand can be a difficult and timeconsuming process. The SLD Cookbook is available at There are tools to help you: QGIS (only recently since version 1.8) GeoExplorer (part of the OpenGeo Suite) With other GIS desktop applications like: udig, AtlasStyler, OpenJUMP

51 51 Creating SLD file in QGIS Demo: creating categorized geo data in QGIS and saving it as a SLD file Your turn again: please complete exercise 7 (4 parts in total)

52 52 GeoExplorer is a web application included in the OpenGeo Suite With GeoExplorer you can quickly assemble maps from GeoServer or any other Web Mapping Server (WMS) You can also: edit map styling embed the maps you compose in a web page GeoExplorer does not currently implement all of the features of the SLD specification. Layer groups cannot be styled with Styler.

53 53 Problems with GeoExlorer Open source bug free don't look a gift horse in the mouth Free software can (not necessary) mean extra effort on your part

54 54 GeoExplorer Demo: styling with GeoExplorer (styling with GeoExplorer is directly saved in GeoServer) Exercise 8

55 Web Coverage Service (WCS) 55

56 56 Web Coverage Service (WCS) Web Coverage Service (WCS) = Web Feature Service (WFS), but for raster data instead of vector data. WCS is a standard created by the Open Geospatial Consortium (OGC) Distinction between WCS and Web Map Service. Both return images, but the results of a WCS can be used for complex modeling and analysis. WCS has more export formats like geotiff.

57 Web Coverage Service (WCS) Operations 57 GetCapabilities DescribeCoverage Retrieves a list of the server s data, as well as valid WCS operations and parameters Example: Capabilities Retrieves an XML document that fully describes the request coverages. GetCoverage Returns a coverage in a well known format. Like a WMS GetMap request, but with several extensions to support the retrieval of coverages.

58 58 Web Coverage Service (WCS) Images: JPEG - (format=jpeg) GIF - (format=gif) PNG - (format=png) Tiff - (format=tif) BMP - (format=bmp) output formats Georeferenced formats: GeoTiff - (format=geotiff) GTopo30 - (format=gtopo30) ArcGrid - (format=arcgrid) GZipped ArcGrid - (format=arcgrid-gzip)

59 A demo and then it s your turn again 59 Demo of only the last part of the next exercise: Adding a WCS to Quantum GIS Your turn again: please complete extra exercise #3

60 60 INSPIRE (recap)

61 61 Infrastructure for Spatial Information in the European Community INSPIRE is "an EU initiative to establish an infrastructure for spatial information in Europe that will help to make spatial or geographical information more accessible and interoperable for a wide range of purposes supporting sustainable development" It aims at making available relevant, harmonized and quality geographic information Primary focus is on environment (34 data themes) Distributed infrastructure maintained by the Member States and made interoperable through common standards Implementing Rules (IR) and Technical Guidance (TG) set the standards and compliance requirements: IR are legally binding TG are not legally binding

62 62 INSPIRE INSPIRE does not require collection of new spatial data INSPIRE does not affect existing Intellectual Property Rights Advisory (common sense) documents: Technical Guidances for INSPIRE Network Services INSPIRE good practice in data and service sharing at

63 63 INSPIRE Spatial Data Scope Annex I 1. Coordinate reference systems 2. Geographical grid systems 3. Geographical names 4. Administrative units 5. Addresses 6. Cadastral parcels 7. Transport networks 8. Hydrography 9. Protected sites Annex II 1. Elevation 2. Land cover 3. Ortho-imagery 4. Geology Harmonised spatial data specifications more stringent for Annex I and II than for Annex III 63

64 64 INSPIRE Thematic Scope Annex III 1. Statistical units 2. Buildings 3. Soil 4. Land use 5. Human health and safety 6. Utility and governmental services 7. Environmental monitoring facilities 8. Production and industrial facilities 9. Agricultural and aquaculture facilities 10. Population distribution demography 11. Area management/restriction /regulation zones & reporting units 12. Natural risk zones 13. Atmospheric conditions 14. Meteorological geographical features 15. Oceanographic geographical features 16. Sea regions 17. Bio-geographical regions 18. Habitats and biotopes 19. Species distribution 20. Energy Resources 21. Mineral resources

65 65 INSPIRE Network Services Member States shall operate a network of the following services available to the public for data sets and services for which metadata has been created INSPIRE network service Discovery Services View Services Download Services Transformation Services Invoke Spatial Data Services Based on OGC standard Catalogue Service for the web (CSW) Web Map Services (WMS) Web Feature Services (WFS) Usually done offline with ETL (extract, transform, load) tools Web Processing Service (WPS) as basic building block

66 More software than only GeoServer 66 This is not a complete list and these software tools are not endorsed by the EU INSPIRE network service Discovery Services View Services Download Services Possible software tool GeoNetwork, MapServer, ArcGIS for INSPIRE, pycsw, GeoServer (in OpenGeoSuite), GeoServer (with INSPIRE extension), MapServer, ArcGIS for INSPIRE (sometimes Partial support, ex. for multilingualism) GeoServer, ArcGIS 10.1 for INSPIRE, GO Publisher (MapServer does not support WFS 2.0)

67 More software than only GeoServer 67 This is not a complete list and these software tools are not endorsed by the EU INSPIRE network service Transformation Services Invoke Spatial Data Services Possible software tool ETL tools: Commercial: FME, ArcGIS for INSPIRE, Intergraph GeoMedia, Snowflake software, Altova Mapforce Open Source: HALE (Humboldt alignment editor), GeoKetlle, Talend Open studio No full package software available Technical Papers recommends WPS as basic building block and Business Process Execution Language (BPEL) for Service Chaining and Workflow

68 68 Does GeoServer create INSPIRE compliant services?

69 Does GeoServer create INSPIRE compliant services? 69 Correct version? Service INSPIRE guidelines WMS (View Services) WFS (Download Services) GeoServer WMTS (Tile services) (through the integrated GeoWebCache) WPS (Web Processing Service, base for Invoke Spatial Data Services) ! service compliant data compliant (INSPIRE Data Specifications hands-on training)

70 Q: Is GeoServer completely INSPIRE compliant? A: No 70 View Services: Scenario 2 for = direct metadata in capabilities documents is not supported (only scenario 1 = a link to a catalog server or a online metadata document) No support for multilingual metadata on services or layers Support for Symbology Encoding 1.1 is present but still partial (GeoServer fully supports SLD 1.0) Transformation Service Only basic schema transformations Invoke Spatial Data Services Only basic process chaining is supported (WPS 1.0)

71 71 GeoServer INSPIRE extension The INSPIRE extension is a official extension Available since version (current = 2.5) Download page: To do: 1. download the inspire zip file 2. Extract the archive and copy the contents into the <GEOSERVER_ROOT>/WEB-INF/lib directory Standard root folder of GeoServer in a OpenGeo Suite installation = "C:\Program Files (x86)\boundless\opengeo\jetty\webapps\geoserver\web-inf\lib" 3. Restart GeoServer

72 72 GeoServer INSPIRE extension What does it do? Extends the WMS & WFS capabilities document with <inspire_vs:extendedcapabilities> block to include: MetadataURL: the link to the metadata associated with the WMS layers SupportedLanguages: for detailing the: Default Language Supported Language(s) Response Language(s) Spatial data identifiers (only for WFS)

73 GeoServer INSPIRE extension Extended WMS Capabilities 73 <inspire_vs:extendedcapabilities> <inspire_common:metadataurl xsi:type="inspire_common:resourcelocatortype"> <inspire_common:url/> <inspire_common:mediatype>application/vnd.iso xml</inspire_common:mediatype> </inspire_common:metadataurl> <inspire_common:supportedlanguages xsi:type="inspire_common:supportedlanguagestype"> <inspire_common:defaultlanguage> <inspire_common:language>eng</inspire_common:language> </inspire_common:defaultlanguage> <inspire_common:supportedlanguage> <inspire_common:language>eng</inspire_common:language> </inspire_common:supportedlanguage> </inspire_common:supportedlanguages> <inspire_common:responselanguage> <inspire_common:language>eng</inspire_common:language> </inspire_common:responselanguage> </inspire_vs:extendedcapabilities>

74 74 GeoServer INSPIRE extension What does it do? On the WMS & WFS configuration page: new INSPIRE block with settings for: Language combo box, for setting the Supported, Default, and Response languages (only one language!) ISO Service Metadata URL field, a URL containing the location of the metadata associated with the WMS Service Metadata Type, for detailing whether the metadata came from a CSW (Catalog Service) or a standalone metadata file Spatial dataset identifers table (for WFS only): specify a code (mandatory) and a namespace (optional) for each spatial data set the WFS server is offering

75 GeoServer INSPIRE extension What does it do? 75 WMS configuration page The metadata link should be a ISO compliant metadata document describing the WMS service as a whole. Normally this comes from a CSW service such as GeoNetwork, but it can also be a static file (demo on next slide). Problem: only one language setting for the supported, default, and response languages

76 GeoServer INSPIRE extension What does it do? 76 WFS configuration page

77 77 GeoServer INSPIRE extension Exercise 9

78 78 The metadata link Demo Go to Under free text type WMS Uncheck interactive only and download only Press the search button Click on Metadata to see all the metadata about the WMS service In order to build a request linking the WMS service with the catalog we are going to need the identifier of that metadata record The metadata link (in ISO 19139) = ba-4c5d e-d1780ec5124f

79 79 GeoServer INSPIRE extension Exercise 10

80 80 Linking layers In INSPIRE not only the service needs to be linked to proper ISO metadata, but also the layers published by the WMS should be described. How: Go to the layers panel, choose a layer and scroll down to the Metadata links section Press the Add link button, set the format to text/xml and the URL to identifier> (for example: )

81 81 View Services Reference System Support for European Terrestrial Reference System 1989 (ETRS89) is Mandatory (See Annex I or directive) Check with WMS GetCapabilities request, look for EPSG: GeoServer supports on-the-fly reprojection CS_NAME ETRS89 SRID 4258 AUTH_NAME Coordinate System Type Datum EPSG. See 3D CRS for original information source. Geographic European Terrestrial Reference System 1989 (EPSG ID 6258) Spheroid GRS 1980 (EPSG ID 7019) Semi-Major Axis Semi-Minor Axis Prime Meridian PM Units Greenwich Decimal Degree,

82 82 INSPIRE test suites There are no official tools that offer INSPIRE conformance testing. However various tools already exist at European and National levels Metadata: INSPIRE Geoportal Metadata Validator: GDI-DE (national SDI of Germany) Testsuite: validator of Geonovum (Netherlands), which can check metadata against 5 different metadata profiles accepted in the Netherlands (including INSPIRE profile) Discovery View GDI-DE Testsuite: View Services Tester: (demo, do not use the cache) GDI-DE Testsuite:

83 Performance Test Tools 83 Apache Jmeter ( The Grinder ( HP LoadRunner ( ( ) Firebug ( (Firefox Add-on, lite version compatible with all major browsers)

84 INSPIRE conformant Metadata 84

85 85 Metadata "data about data INSPIRE Metadata Editor: Guidelines based on EN ISO and EN ISO (version 1.2) Extra items on: Language Classification Conformity Constraints

86 From a local SDI to the European INSPIRE geo-portal 86

87 87 INSPIRE metadata with GeoNetwork GeoNetwork supports multilingual metadata but is not completely robust Not a complete INSPIRE service description in CSW GetCapabilities Activate INSPIRE option in the administration > System configuration the INSPIRE search options available in the advanced search form. Search criteria are: annex, source type, service type, themes A custom editor providing all INSPIRE required fields More info:

88 88 How to locate the geo web service when I see an online map?

89 89 How to locate the geo web service A: not easy! when I see an online map? (unless) If it is published on the web page / geoportal Firefox / Chrome add-on: Firebug, Live HTTP Headers Internet Explorer Developer Tools - Network tab Firefox add-on WMS Inspector (old) View web page source

90 90 Interesting links INSPIRE Homepage & Directive: 34 INSPIRE spatial data themes: INSPIRE Geoportal: INSPIRE Forum: INSPIRE Metadata Editor:

91 91 References OGC - Open Geospatial Consortium Osgeo.org (Open Source Geospatial Foundation) Opengeo.org Wikipedia Globus.org Arts-humanities.net Geoserver.org Geoext.org Camptocamp.com Qgis.org Esri.com GeoSolutions AGIS - University of the Bundeswehr Munich

92 92 Thank you for your attention and for your work!