DATA SHARING AND DISCOVERY WITH ARCGIS SERVER GEOPORTAL EXTENSION Clive Reece, Ph.D. ESRI Geoportal/SDI Solutions Team
Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources
Data Sharing Does it require an act of God?
Issues with Data Sharing in an SDI Departments, agencies, physical locations, and partner organizations have built-in boundaries Applica tions Barriers to free flow Applica tions Service s Service s Data Data Silo 1 Silo 2 Problems Hidden data Slow access Duplicate spending on data or infrastructure
Geoportal approach Build a bridge to data and services using SDI Design Principles and Implementation New Applications Applica tions Catalog Applica tions Service s Service s Data Data Silo 1 Silo 2 Benefits Enterprise awareness Enhanced access Reuse data Reuse services Reuse infrastructure Other benefits 1. Corporate governance 2. Authoritative and current 3. Maintain ownership and stewardship 4. Networking opportunities
ESRI Platform for Publishing, Serving, and Use Providers Consumers
Geoportal Completes the SDI Platform Providers Consumers
Metadata is like onions DONKEY: They stink? DONKEY: Oh, they make you cry? DONKEY:... You know, not everybody like onions. UC2008 Technical Workshop 8
Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources
ArcGIS Server Geoportal Extension Enabling discovery and use of geospatial resources Search and view geospatial resources Manage, publish, and store metadata View live map services Download data
What we will Discuss/Demo 11
End users: I want to find data Simple keyword search Advanced options for experts Smart matching and ranking Search results must be simple to understand yet contain detail for power-users Point and click access I want to download data I want to know when new data are available http://gptogc.esri.com 12
Search Results
I want to make a map Solution: Preview services: ArcGIS Server Map Services ArcIMS Image Services OGC WMS GeoRSS KML Provide integration points for map viewer platforms JavaScript, Flex, Silverlight ArcGIS Desktop ArcMap ArcGIS Explorer
I want to know when new data is available Solution: User specifies search criteria Give user link to a GeoRSS feed User subscribes to GeoRSS feed geoportal
I want to download data Solution: Link to a file or Clip-Zip-Ship Provide an ordering page with simple choices Based on Geoprocessing Service Extensible in Python
DEMO
Service providers: I want to advertise my data Give user choices for publishing metadata: Create metadata online Upload metadata Register SDI catalog site for harvesting Just register the service endpoint! Support metadata standards ISO 19115/19, 19139 FGDC INSPIRE http://gptogc.esri.com/gpt931/catalog/identity/login.page 18
Publish What? Live services E.g., ArcGIS Server, WMS, WFS, WCS, CS-W, ArcIMS Downloadable Data Feature Classes in Geodatabases Geospatial applications Documents Etc 19
DEMO
Security Restricting Access to Metadata 1. Unrestricted All (approved) documents are visible to all users 2. Public-Protected Public documents are visible to all users Only members of 1 specific group see the protected documents 3. Restricted Unrestricted documents are visible to all users Restricted documents are accessible only to groups that have been granted access to the documents All interfaces to Geoportal apply the same policy Public-only and authenticating endpoints for CS-W and REST Authentication and Authorization through LDAP/AD
Restrict Access to Metadata Anonymous user Only Sees Public metadata
Restrict Access to Metadata Control Access to Metadata at Document Level
Restrict Access to Metadata Authenticated User Also Sees Restricted Content
Service Oriented Architecture Map Previewer Geoportal Site Starter Content Management System (HTML) CSW REST API GeoRSS, ATOM, KML, JSON Catalog Service ArcMap ArcCatalog ArcGIS Explorer
Platforms Go Beyond Application Silos Service Oriented Architectures a Framework for Integration Web 1.0 Web Client Services Oriented Architecture (SOA) Desktop Client Web Client Mobile Client Interconnected Interoperable Integrative Dynamic Enterprise Service Bus Highest Point Service Point-to-Point Services Highest Point Service Terrain Service Loosely Coupled and Orchestrated Services
ESRI Geoportal Services Geoportal Provides: OGC CS-W Discovery Interface Supports interoperability with all OGC CSW standard services REST Discovery Interface Supports OpenSearch Supported Output Formats: GeoRSS, ATOM, HTML, KML, and JSON Supported Filters: Free Text, Spatial Extent, Content Type, Data Category, Update Date Search Widget Geoportal Consumes: OGC CS-W, Z39.50, ArcIMS, WAF, OAI for metadata OGC W*S, ArcGIS Server, ArcIMS, KML, GeoRSS for display
Example: Data.gov Data.gov new initiative to transparent government Data.gov looked at building yet another catalog for data Geodata.gov and Data.gov collaborated Geodata.gov now supplies Data.gov with 160,000+ downloadable datasets through an OGC Catalog Service
Geoportal Desktop Client Tools Search Client Add-in for ArcMap & ArcGIS Explorer Search CS-W Catalogs for metadata and services View Metadata Footprints Add to Map/Globe Common Architecture and User Experience Publish Client for ArcCatalog Functionality for batch uploading metadata records from ArcCatalog Scrapes metadata from single files, folders, feature classes and geodatabases Free downloads from esri.com! 29
Search Widgets HTML Widget Embed Geoportal search within another web site Flex Widget Uses Geoportal REST interface for http://gptogc.esri.com/gpt931/widgets/example.jsp Search functionalities Viewing metadata Visualizing OGC WMS, GeoRSS, http://geoss.esri.com/geoviewer/index.html 30
DEMO
Example: Web Flex Viewer with search widget Discover, View and combine shared data Discovered and use resources Processing functionalities Technology behind the scenes ESRI Flex Mapping API and the ESRI Flex Viewer for Visualizing OGC WMS, GeoRSS, ESRI Geoportal REST interface for Search ArcGIS Server for Map services Processing (calculate population, ) http://webhelp.esri.com/geoportal_extension/9.3.1/index.htm#flex_widget.htm
Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources
Design Goal: Unify Structured Content with Unstructured Resources Large User Community: General Users Brief Metadata is Sufficient Tagging, Dublin Core, Limited User Community: GIS Specialist Emergency Responder Verbose Metadata is Desired ISO 19139, FGDC Metadata Profiles
Geoportal Version 10 Discovery and Access of Unstructured Content Customizable Search Adapters Interoperability using OpenSearch YouTube Microsoft Sharepoint Flickr
Geoportal Version 10 Additional Search Providers and Federated Search CS-W ArcGIS Server Search Services Z39.50 Sources Image Catalogs Geodata Services WFS Services
Geoportal 10 Synchronize Catalogs Looking at synchronizing multiple catalogs Driven by enterprise needs Near real-time Multi-directional Sync Metadata for Services Generate Update Delete
Geoportal 10 Server-side Harvesting Re-harvesting servers and uploaded services Harvest (geoportal) sitemaps Harvest geodata services (sync) Harvest ArcGIS Servers (sync) Retire desktop harvesting tool Retire desktop harvesting service Supports pure Linux implementation Harvesting and Directed Searching closely related
Geoportal Version 10 Identity Management OpenID/Oauth Group-level administrators
Geoportal 10 Silverlight Widget
Geoportal 10 Index Statistics Browse by metadata facets: More like categories in retail store websites Not editable, based on catalog content Exposed through REST Use to build: Browsing capabilities Word clouds Content Channels Reports for Administrators
Geoportal 10 Expand on ArcGIS Online Integration
Geoportal 10 Recap Expand Directed Search Framework Federate searches to more than one site Server-side Harvesting Synchronize Catalogs Silverlight Search Widget Index Statistics Exploit Geoportal Usage Expand use of ontology service Identity Management Update Desktop Clients
Geoportal Extension for ArcGIS Server Context within an Enterprise Spatial Data Infrastructure ESRI Geoportal What s coming at ArcGIS 10 Resources
Useful Links ESRI Geoportal: www.esri.com/geoportal Public ESRI Geoportal : http://gptogc.esri.com ESRI Webhelp : http://webhelp.esri.com/geoportal_extension/9.3.1/ Geo Flex viewer with Search widget and some processing functionalities: http://geoss.esri.com/geoviewer/index.html ESRI mapping APIs (Flex, JavaScript, SilverLight): www.esri.com/mappingapis
Contacts SDI Solutions Team (portal@esri.com )
Platform Support Operating System: Windows XP Professional SP3 Windows 2003 Server 32-bit Windows 2003 Server 64-bit Windows 2008 Server 32-bit Redhat Linux 32-bit Database: Oracle 9i Oracle 10g Oracle 11g Microsoft SQL Server 2005 Microsoft SQL Server 2008 PostgreSQL 8.3 Servlet engine: Apache Tomcat 5.x Apache Tomcat 6.x Sun Glassfish Oracle WebLogic Application Server 10 ArcGIS Server Enterprise Standard 9.3.1