Overview of ArcGIS Solutions in Service-Oriented Architectures. Dave Wrazien Michael Young

Transcription

1 Overview of ArcGIS Solutions in Service-Oriented Architectures Dave Wrazien Michael Young

2 Overview Introductions ArcGIS Architecture Implementation Options SOA Overview Web Services Overview ArcGIS SOA Components Relevant Standards Concluding Remarks Questions

3 ArcGIS Architecture ESRI Product Family

4 ArcGIS Architecture System Architecture

5 Implementation Options Organizational (SOA) Web Services & Messaging Roads Utilities Planning Desktop (Stand Alone, Point to Point) Departmental (Centralized data or applications) Environmental Business Applications Police File Server

6 Implementation Options Desktop - Standalone & Point-to to-point Embedded GIS ArcGIS Engine Desktop GIS ArcGIS Mobile GIS ArcPad Desktop GIS ArcGIS Desktop GIS ArcGIS File Server This is how many organizations get started with GIS, but quickly encounter challenges as GIS usage increases and matures

7 Implementation Options Department - Centralized Data Embedded GIS ArcGIS Engine Desktop GIS ArcGIS Desktop GIS ArcGIS Desktop GIS ArcMap Mobile GIS ArcPad Data Server Server GIS ArcSDE

8 Implementation Options Department - Centralized Data & Applications Browser (Thin) Desktop GIS ArcReader Embedded GIS ArcEngine Desktop GIS ArcMap Citrix Server ArcMap Desktop Application Server Server GIS ArcIMS ArcGIS Server Data Server Server GIS ArcSDE

9 Implementation Options Providing Flexibility There is NO Architecture Silver Bullet Options Provide Flexibility Integration Interoperability Efficiency Consistency... To best serve the work flows of the organization

10 SOA Overview Confusion Question by an IT Pro: Is your team building an SOA? Actual Answer: My architect thinks it s s service-oriented, my developers insist it s s object-oriented, oriented, and my analysts wish it would be more business-oriented. All I can tell you is that it isn t t what it was before we started building web services. (Erl 2005)

11 SOA Overview Definition A method of building business applications that utilize common services to support business functions Service Directory Find / Details Publish Service Consumer Bind / Invoke Service Provider

12 SOA Overview Benefits Top 3 Benefits* 1. Expose IT resources in an easily consumable fashion (Architecture Partitioning) 2. Incremental Deployment and Maintenance 3. Reuse of Services Additional Long-Term Benefits Faster time to market Reduced cost Risk mitigation Continuous business-process improvement * Latest SOA Trends, D. Stang, Gartner, 2005

13 SOA Overview Infrastructure Consumers Service Consumer Service Consumer Browser Service Web Services SOA Infrastructure Producers Service Provider Service Provider Enterprise GIS Enterprise CRM Connects Service Consumers with Service Providers May be used to communicate with Service Directories May be implemented using a variety of technologies

14 Web Services Overview What is a Service? Business Perspective IT assets that correspond to Real-world business activities Recognizable business functions Accessible according to service policies established for the services Technical Perspective Coarse grained, reusable IT assets Well-defined interfaces (service contracts) Clearly separating the services externally accessible interface from the services technical implementation Web Services typically based on SOAP & XML Note most OGC standard services are not SOAP based yet Web services standards are implemented in products from all the major software vendors making web services the most prevalent approach to implementing an SOA

15 Web Services Overview Core Components WSDL SOAP UDDI These 3 technology standards, coupled with service-oriented design principles, form a basic XML-driven SOA Service Description WSDL Web Services Description Language Defines all details about a service UDDI Service Protocol SOAP How to format XML documents for transmission between applications Enables discovery of Is accessed using Service Discovery UDDI Universal Description, Discovery, and Integration Not a requirement Well proven for single Enterprise systems WSDL Describes Binds to Enables Communication between SOAP Web Services

16 Web Services Overview Why Use? Different reasons for different people! Cost-centric - largest IT cost is labor Integration-centric Business-driven Reuse-centric The answer is always a mixture Web Services are not for everything! Web Services are not for everything! Remote Procedure Calls (RPCs) Missing Features (Compared to CORBA, COM, J2EE) Why? Handle messages efficiently Allow mapping to any distributed computing environment» RPC or asynchronous message-oriented

17 What Supports Web Services? Four Basic Frameworks Currently Support WS 2 nd Generation Web Services Enterprise Service Bus software Application Server Platforms Application Specific Service Managers

18 What Supports Web Services? 2nd Generation Web Services Many still being finalized or have competing standards WS-Security and BPEL are exceptions Ultimately incorporated into the other 3 solutions UDDI Provides a Protocol for Enables discovery of Is accessed using WSDL Binds to SOAP Describes the Service for Describes the Service for WS- Coordination Describes Manages Context Across uses Web Services Enables Communication between Provides End-to to-end Security for uses WS-Security Provides a Protocol for Manages Context for Provides a Protocol for Enables Distributed Transactions for Provides a Protocol for Provides Guaranteed Delivery for uses BPEL Provides a Protocol for WS- Transaction WS-Reliable Messaging uses WS-Policy orchestrates governs

19 What Supports Web Services? Enterprise Service Bus (ESB) Gartner definition Standards-based middleware that uses SOA and has Messaging Intelligent routing Transformation capabilities 2 nd generation web services type functionality Currently: Proprietary Goal: Replace proprietary components with standard components as they become available

20 What Supports Web Services? Application Server Platforms Vendors incorporating ESB functionality IBM WebSphere BEA Weblogic MS BizTalk

21 What Supports Web Services? Application Specific Service Managers Service queue management System load balancing May be bypassed in the future by systems utilizing more advanced management (e.g. ESB).

22 Enterprise SOA Framework Clients Multi-Channel Access Consumers Types of Applications Client Apps Web Applications Web Services Data Sources (Producers) Client Apps Web Applications Web Service Support Unifying Components Web Portals Common Viewing Interface ESB Common Messaging Framework Objects Common System Components Communication Path Options Direct Data Links Producers Web Services

23 How Does ESRI Fit into SOA? GIS Components Security Clients (Consumers) ArcMap Non-ESRI Clients Mobile Desktop ArcReader ArcExplorer Heavy ArcPad Light LBS Smart Client ADF JSP COP GOS2 (ArcWeb Explorer) GOS2 ArcIMS ACL s Maps Desktop (heavy) Desktop (light) Web Browser Java,.NET, VB, C++.NET, VB, C++ HTML, Javascript, CSS, Flash, Ajax, SVG, Applet Mobile Device Heavy - VBScript Light -.NET CF, MIDP, CLDC, Native Portlets Service Calling a Service JSR 168 Portlets MS WebParts Web Portals Geodatabase Client Apps Web Applications Application Development Frameworks (ADF) - Java Integration Tool Kit (JITK) - Portal Tool Kit (PTK) GOS2 COTS ArcView ArcInfo ArcEditor Metadata Web Service 1st Generation - Protocol (SOAP), Directory (UDDI), Description (WSDL) Direct Data Links Custom ArcEngine 2nd Generation - Business Process Def. & Exec. (BPEL) - Security (WS-Security) - Policies and Metadata (WS-Policy) Non-SOAP Based - XML over HTTP - Current OGC Services - ArcIMS ArcXML Routing (IMS) Reporting Tracking (TS) Catalog (GOS) Replication GeoCoding Placefinder (AW) Weather Data Translator Analysis 3-D Globe Gazetteer Geoprocessing - Line of Sight - Replication - Plume Modeling - Map on Demand Non-GIS Web Services - Workorder - Financial Info - Customer Service - Notify Field Personnel Enterprise Infrastructure (Producers) ArcIMS ArcGIS RDBMS Interfaces SQL (ODBC/JDBC) GeoDB ArcSDE Flat Files Image Server Google Search Metadata SQL Geo-Spatial One Stop The National Map ArcWeb Services Firewalls - XML Gateways Intrusion Detection - HIDS - NIDS OS Single-Sign-On - Netegrity (CA) - Active Directory (MS) - LDAP Objects Objects Data Models Network Encryption - SSL - IPSec Web Services Images (WMS) Features (WFS) Coverages (WCS) Metadata (Cat) Events Authentication - E-Auth - Tokens - Certificates + Self Hosted CA + Trusted CA Support Enterprise Service Bus ODBC JDBC RPC Workflow Models Application ArcObjects - Custom Control Ext. - Audit Trail ERP, CRM, DMIS, RMS, EOC RDBMS Feature Level - Restrict Row Access XML Doc GeoDB Restriction Internal Data GIS Servers Search Engines External Services Non-GIS Applications Data File Encryption

24 Where are SOA components installed? Web Server ArcSDE Data Sources Image Server Tracking Server File Server GeoDB Flat Files XML Doc

25 Where are SOA components installed? ESRI Web Server Choices JAVA HTTP Service Apache TomCat ServletExec AS IBM HTTP Service Sun Java System.NET HTTP Service Microsoft Internet Information Server (IIS)

26 Where are SOA components installed? ESRI Web Application Choices JAVA Portal Frameworks (Based on Portlets) IBM WebSphere Portal BEA WebLogic Portal J2EE Reference Implementations JBoss Portal, Apache Jetspeed.NET Portal Frameworks (Based on WebParts) Microsoft SharePoint Portal Server Connectors ArcIMS Servlet Connector ServletExec AS Tomcat Native Servlet Engine (All except Apache) Cold Fusion connector Java connector (Utilize with J2EE) Development Frameworks Java Application Development Framework (ADF for ArcGIS Server) Java Integration Toolkit (JITK for ArcIMS) Connectors ArcIMS Servlet Connector ServletExec AS Tomcat Active X Connector Development Frameworks.NET Application Development Framework (ADF for ArcGIS Server)

27 Where are SOA components installed? ESRI Web Service Support Choices JAVA.NET Application Server IBM WebSphere BEA WebLogic Macromedia JRun Sun Java System (Sun One) The J2EE Reference Implementation JBoss Application Server Apache Geronimo ESB Products Sonic, CAPEClear, IONA, MULE Adapters WebSphere Spatial Integration Adapter (ArcGIS Server) iway ArcSDE Adapter JBOSS SOAP Adapters (ArcIMS) ESRI Service Managers ArcIMS Application Server (AS) ArcGIS Server Object Manager (SOM) Application Server Microsoft BizTalk Windows Workflow Foundation (WWF) Windows Communication Framework (WCF) ESB Products Sonic, CAPEClear, IONA, MULE Adapters WebSphere Spatial Integration Adapter (ArcGIS Server) iway ArcSDE Adapter ESRI Service Managers ArcIMS Application Server (AS) ArcGIS Server Object Manager (SOM)

28 Where are SOA components installed? ESRI GIS Web Services Choices JAVA ArcGIS Server Object Containers (SOC) ArcIMS Spatial Server (SS) Tracking Server Portal Toolkit (PTK) Catalog Service (CS-W, Z39.50, OAI) Publish (FGDC & ISO Metadata) Harvest (CS-W, Z39.50, WAF,/XML, OAI-PMH).NET ArcGIS Server Object Containers (SOC) ArcIMS Spatial Server (SS) Tracking Server Portal Toolkit (PTK) Catalog Service (CS-W, Z39.50, OAI) Publish (FGDC & ISO Metadata) Harvest (CS-W, Z39.50, WAF,/XML, OAI-PMH) ESRI components both platform and programming language independent nt ArcIMS Spatial Server (SS) ArcGIS Server Objects (SOC) Portal Toolkit (PTK) ArcMap Server ArcObjects

29 Where are SOA components installed? ESRI Data Storage Choices JAVA GeoDataBase ArcSDE MS SQL Oracle IBM DB2 IBM Informix File Servers Tracking Server ESRI Image Server.NET GeoDatabase ArcSDE MS SQL Oracle IBM DB2 IBM Informix File Servers Tracking Server ESRI Image Server ESRI follows SOA model by avoiding single vendor lock in ArcSDE Image Server Tracking Server File Server GeoDB Flat Files XML Doc

30 Where are SOA components installed? WebSphere & ESRI Architecture IBM HTTP Server WebSphere Application Server JITK WebSphere Portal Custom Map Viewers WebSphere Servlet Engine J2EE ADF ArcObjects Proxy Web Service Support WebSphere ESB WebSphere ArcGIS Adapter ESRI Service Managers ArcIMS App Server (AS) ArcGIS Object Manager (SOM)

31 Relevant Standards Why do I care? Standards are still evolving quickly Not all standards have a clear winner - yet WS-ReliableMessaging vs. WS-Reliability Plan a more educated migration towards SOA

32 Relevant Standards Three Categories Information Technology Standards DBMS ODBC & SQL Web Services J2EE,.NET, XML/SOAP Computing Platforms Windows, Unix, Linux Development Languages C++, Java,.NET Domain Standards Industry, ISO, Military, OGC standards, FEA Data and Metadata formats Web Service APIs User Community/Organizational Standards IT System and Architectural Design Guidelines

33 Relevant Standards Who is making SOA happen? World Wide Web Consortium (W3C) SOAP WSDL HTML XML Web Service Interoperability Organization (WS-I) Basic Profile Basic Security Profile Organized for the Advancement of Structured Information Standards (OASIS) UDDI WS-BPEL SAML, XACML, WS-Security Security RM-SOA Vendor Alliances WS-ReliableMessaging

34 Relevant Standards New SOA Conformance Guidelines Full Conformance Guidelines Have entities that can be identified as services as defined by this Reference Model Be able to identify how visibility is established between service providers and consumers Be able to identify how interaction is mediated Be able to identify how the effect of using services is understood Have descriptions associated with services Be able to identify the execution context required to support interaction It will be possible to identify how policies are handled and how contracts may be modeled and enforced Simple Translation Loose coupling UDDI/ebRIM ebrim/cat/csw Java=ESB, MS=WCF Service Result WSDL Parameters/ New WS-Coordination Java=ESB, MS=BizTalk, new WS-Policy

35 Relevant Standards Current ESRI OGC Compliance Status Specification Provider Consumer Web Mapping Service 1.1 (WMS) Style Layer Descriptor 1.0 (SLD) ArcIMS WMS Connector SP2 ArcGIS Server 9.1 ArcIMS WMS Connector 9.1 (SLD) ArcGIS WMS Client SP2 ArcGIS WMS Client 9.1 Web Feature Service 1.0 (WFS) ArcIMS Connector Next update ArcGIS Server 9.2 Data Interop Extension ArcGIS 9.1 Web Coverage Service 1.0 (WCS) ArcEngine Implementation for 9.0 ArcGIS Server future ArcGIS Desktop Client Catalog Services 2.0 (Cat) ArcIMS Metadata Server 9.1 Portal Toolkit 2.0 ArcIMS Metadata Server 9.1 Portal Toolkit 2.0

36 Concluding Remarks Qualifying the SOA Promise Vendor & Analyst Idealized Assumptions Immediate Enterprise-wide SOA buy-in Services Reflect ideal business processes Reusable across business without revision Perfectly balance granularity, loose-coupling, and reuse Reality Check Strong positive results after years of hard work Simple SOAP point-to to-point systems Pros Cons Tactical cost savings Quick implementation Limited scalability Do not deliver the ultimate value of SOA Is There Hope? Strategic benefits easier to achieve today We get to learn from the pioneers mistakes

37 Concluding Remarks What next? A successful SOA requires balance of Top down and Bottom up approaches Governance Professional Services Technical Ownership Executive Business Ownership Professional Services Principles Patterns SDS Architecture Skills Funding Repository SDK SOA Design and Development Skills Technology Enablers EDN Proof of Concepts Out of Box Extensible Apps Simple Web Services ArcGIS Server Select SOA tools Adapters iway, iway, IBM J2EE &.NET Bottom up Measurement Management Rewards Architecture Top Down Business

38 Concluding Remarks What next as a Developer? ArcWeb Services is a great blueprint for starting an SOA Requires minimal to none, GIS-specific training Rich APIs for web application and web service development SOAP/XML, REST, OpenLS,, J2ME, etc Check out the services Utilize WSDL s available

39 Session Evaluations Reminder Session Attendees: Please turn in your session evaluations.... Thank you

40 References SOA Reference Model RM-ReferenceModel CD.pdf Basic Profile Version i.org/profiles/basicprofile html Erl,, Thomas. (2005). Service-Oriented Architecture Concepts, Technology, and Design.. Prentice Hall. Krafzig,, D., Banke,, K., Slama,, D. (2005). Enterprise SOA Service-Oriented Architecture Best Practices.. Prentice Hall. Manes, A.T. (2003) Web Services A Manager s s Guide. Pearson Education, Inc. Newcomer, E., Lomow,, G. (2005). Understanding SOA with Web Services.. Addison-Wesley.