DATA SHARING AND DISCOVERY WITH ARCGIS SERVER GEOPORTAL EXTENSION. Clive Reece, Ph.D. ESRI Geoportal/SDI Solutions Team

Transcription

1 DATA SHARING AND DISCOVERY WITH ARCGIS SERVER GEOPORTAL EXTENSION Clive Reece, Ph.D. ESRI Geoportal/SDI Solutions Team

2 Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources

3 Data Sharing Does it require an act of God?

4 Issues with Data Sharing in an SDI Departments, agencies, physical locations, and partner organizations have built-in boundaries Applica tions Barriers to free flow Applica tions Service s Service s Data Data Silo 1 Silo 2 Problems Hidden data Slow access Duplicate spending on data or infrastructure

5 Geoportal approach Build a bridge to data and services using SDI Design Principles and Implementation New Applications Applica tions Catalog Applica tions Service s Service s Data Data Silo 1 Silo 2 Benefits Enterprise awareness Enhanced access Reuse data Reuse services Reuse infrastructure Other benefits 1. Corporate governance 2. Authoritative and current 3. Maintain ownership and stewardship 4. Networking opportunities

6 ESRI Platform for Publishing, Serving, and Use Providers Consumers

7 Geoportal Completes the SDI Platform Providers Consumers

8 Metadata is like onions DONKEY: They stink? DONKEY: Oh, they make you cry? DONKEY:... You know, not everybody like onions. UC2008 Technical Workshop 8

9 Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources

10 ArcGIS Server Geoportal Extension Enabling discovery and use of geospatial resources Search and view geospatial resources Manage, publish, and store metadata View live map services Download data

11 What we will Discuss/Demo 11

12 End users: I want to find data Simple keyword search Advanced options for experts Smart matching and ranking Search results must be simple to understand yet contain detail for power-users Point and click access I want to download data I want to know when new data are available 12

13 Search Results

14 I want to make a map Solution: Preview services: ArcGIS Server Map Services ArcIMS Image Services OGC WMS GeoRSS KML Provide integration points for map viewer platforms JavaScript, Flex, Silverlight ArcGIS Desktop ArcMap ArcGIS Explorer

15 I want to know when new data is available Solution: User specifies search criteria Give user link to a GeoRSS feed User subscribes to GeoRSS feed geoportal

16 I want to download data Solution: Link to a file or Clip-Zip-Ship Provide an ordering page with simple choices Based on Geoprocessing Service Extensible in Python

17 DEMO

18 Service providers: I want to advertise my data Give user choices for publishing metadata: Create metadata online Upload metadata Register SDI catalog site for harvesting Just register the service endpoint! Support metadata standards ISO 19115/19, FGDC INSPIRE 18

19 Publish What? Live services E.g., ArcGIS Server, WMS, WFS, WCS, CS-W, ArcIMS Downloadable Data Feature Classes in Geodatabases Geospatial applications Documents Etc 19

20 DEMO

21 Security Restricting Access to Metadata 1. Unrestricted All (approved) documents are visible to all users 2. Public-Protected Public documents are visible to all users Only members of 1 specific group see the protected documents 3. Restricted Unrestricted documents are visible to all users Restricted documents are accessible only to groups that have been granted access to the documents All interfaces to Geoportal apply the same policy Public-only and authenticating endpoints for CS-W and REST Authentication and Authorization through LDAP/AD

22 Restrict Access to Metadata Anonymous user Only Sees Public metadata

23 Restrict Access to Metadata Control Access to Metadata at Document Level

24 Restrict Access to Metadata Authenticated User Also Sees Restricted Content

25 Service Oriented Architecture Map Previewer Geoportal Site Starter Content Management System (HTML) CSW REST API GeoRSS, ATOM, KML, JSON Catalog Service ArcMap ArcCatalog ArcGIS Explorer

26 Platforms Go Beyond Application Silos Service Oriented Architectures a Framework for Integration Web 1.0 Web Client Services Oriented Architecture (SOA) Desktop Client Web Client Mobile Client Interconnected Interoperable Integrative Dynamic Enterprise Service Bus Highest Point Service Point-to-Point Services Highest Point Service Terrain Service Loosely Coupled and Orchestrated Services

27 ESRI Geoportal Services Geoportal Provides: OGC CS-W Discovery Interface Supports interoperability with all OGC CSW standard services REST Discovery Interface Supports OpenSearch Supported Output Formats: GeoRSS, ATOM, HTML, KML, and JSON Supported Filters: Free Text, Spatial Extent, Content Type, Data Category, Update Date Search Widget Geoportal Consumes: OGC CS-W, Z39.50, ArcIMS, WAF, OAI for metadata OGC W*S, ArcGIS Server, ArcIMS, KML, GeoRSS for display

28 Example: Data.gov Data.gov new initiative to transparent government Data.gov looked at building yet another catalog for data Geodata.gov and Data.gov collaborated Geodata.gov now supplies Data.gov with 160,000+ downloadable datasets through an OGC Catalog Service

29 Geoportal Desktop Client Tools Search Client Add-in for ArcMap & ArcGIS Explorer Search CS-W Catalogs for metadata and services View Metadata Footprints Add to Map/Globe Common Architecture and User Experience Publish Client for ArcCatalog Functionality for batch uploading metadata records from ArcCatalog Scrapes metadata from single files, folders, feature classes and geodatabases Free downloads from esri.com! 29

30 Search Widgets HTML Widget Embed Geoportal search within another web site Flex Widget Uses Geoportal REST interface for Search functionalities Viewing metadata Visualizing OGC WMS, GeoRSS, 30

31 DEMO

32 Example: Web Flex Viewer with search widget Discover, View and combine shared data Discovered and use resources Processing functionalities Technology behind the scenes ESRI Flex Mapping API and the ESRI Flex Viewer for Visualizing OGC WMS, GeoRSS, ESRI Geoportal REST interface for Search ArcGIS Server for Map services Processing (calculate population, )

33 Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources

34 Design Goal: Unify Structured Content with Unstructured Resources Large User Community: General Users Brief Metadata is Sufficient Tagging, Dublin Core, Limited User Community: GIS Specialist Emergency Responder Verbose Metadata is Desired ISO 19139, FGDC Metadata Profiles

35 Geoportal Version 10 Discovery and Access of Unstructured Content Customizable Search Adapters Interoperability using OpenSearch YouTube Microsoft Sharepoint Flickr

36 Geoportal Version 10 Additional Search Providers and Federated Search CS-W ArcGIS Server Search Services Z39.50 Sources Image Catalogs Geodata Services WFS Services

37 Geoportal 10 Synchronize Catalogs Looking at synchronizing multiple catalogs Driven by enterprise needs Near real-time Multi-directional Sync Metadata for Services Generate Update Delete

38 Geoportal 10 Server-side Harvesting Re-harvesting servers and uploaded services Harvest (geoportal) sitemaps Harvest geodata services (sync) Harvest ArcGIS Servers (sync) Retire desktop harvesting tool Retire desktop harvesting service Supports pure Linux implementation Harvesting and Directed Searching closely related

39 Geoportal Version 10 Identity Management OpenID/Oauth Group-level administrators

40 Geoportal 10 Silverlight Widget

41 Geoportal 10 Index Statistics Browse by metadata facets: More like categories in retail store websites Not editable, based on catalog content Exposed through REST Use to build: Browsing capabilities Word clouds Content Channels Reports for Administrators

42 Geoportal 10 Expand on ArcGIS Online Integration

43 Geoportal 10 Recap Expand Directed Search Framework Federate searches to more than one site Server-side Harvesting Synchronize Catalogs Silverlight Search Widget Index Statistics Exploit Geoportal Usage Expand use of ontology service Identity Management Update Desktop Clients

44 Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources

45 Useful Links ESRI Geoportal: Public ESRI Geoportal : ESRI Webhelp : Geo Flex viewer with Search widget and some processing functionalities: ESRI mapping APIs (Flex, JavaScript, SilverLight):

46 Contacts SDI Solutions Team )

47 Platform Support Operating System: Windows XP Professional SP3 Windows 2003 Server 32-bit Windows 2003 Server 64-bit Windows 2008 Server 32-bit Redhat Linux 32-bit Database: Oracle 9i Oracle 10g Oracle 11g Microsoft SQL Server 2005 Microsoft SQL Server 2008 PostgreSQL 8.3 Servlet engine: Apache Tomcat 5.x Apache Tomcat 6.x Sun Glassfish Oracle WebLogic Application Server 10 ArcGIS Server Enterprise Standard 9.3.1