DB2 Information Integrator Classic Federation (DB2IICF) Overview

Transcription

1 DB2 Information Integrator Classic Federation (DB2IICF) Overview Steve Hunn Director of Services Feb Brian Lee Senior Consultant L I G H T Y E A R Business Partner Lightyear Consulting Ltd. Palo Alto, Calgary, Scottsdale, Laguna Beach, Austin, Chicago Tel: Enterprise Environment The Typical Large IT Integration Environment Decades of heterogeneous technology investment 60% of data resides on mainframe and is growing 20% per year High performance and scalability is mandatory Legacy programming is becoming very costly How do you leverage your mainframe data assets? 2

2 Options for modernizing legacy data Manual rewriting and migration Disruptive, risky (high) Requires extensive investment Automatic (semi-automatic) conversion and migration Utilizing tools DL/2, ManTech, Risky (medium to low) Requires fair amount of investment Wrapper technology CICS Transaction Gateway, IMS Connector, Information Integrator, Non-disruptive, no risk Not an expensive solution Quick implementation, Quick return on investment 3 Positioning of Information Integrator Classic Federation z/os, OS/390 DB2 Crystal Report, MS Excel, WAS, Custom Appl. NT/UNIX Information Integrator NT/UNIX Oracle MS SQL Wrapper ODBC Wrapper NT/UNIX WAS WAS z/os IICF JDBC ODBC Crystal Report, MS Excel, IMS DATA COM IDMS ADABAS VSAM 4

3 Operational Processing Flow IICF IICF is is a thin thin layer layerof of software software that translates translates a query query into into the the native native language languageand and materializes materializes the the result result set set based based on on the the meta meta data data definition. definition. Native Dialect Management System Native Result IICF Client (ODBC, JDBC) SQL Query Result Rows DB2 II Classic Federation Server Meta Catalog 5 DB2 II CF Product Suite CF Server Common server infrastructure that supports all CF multi-threaded, multi-user, services. CF RDBMS Services Federated RDBMS whose data stores are non-relational database systems CF Transaction Services IMS and CICS Business Rules Reuse 6

4 CF Server Application hosting using named service architecture Memory Management Master Pool and Sub-Pools Dynamic Growth Task Management Pre-started, Dynamically started Managed termination and notification Communications Management Common API TCP/IP, APPC, Cross Memory, MQ-Series, Local Queues, etc. File Management Flat, btree, avl tree, etc. Platform specific Hiperspace, Space, etc. Common Miscellaneous support routines 7 Architecture DB2 IMS IDMS VSAM CICS IMS/TM Meta Catalog s s s s Transaction Transaction Query Processor CF Server Mapper JDBC,JCA,ODBC,CLI ApplicationsTCP/IP & Tools AIX USS Linux 0S/390, z/os HP-UX Solaris 2000/XP 95/98/NT 8

5 CF RDBMS Services (XDi) SQL 92 / DB2 Dialect Level-ized savants access legacy data sources Advanced Query Processor engine aggregates multiple data sources Read and Write support including 1PC and 2PC Standards-based clients, ODBC, JDBC, and CLI Metadata driven 9 SQL Support, Views & Joins SQL 92 support SELECT/INSERT/UPDATE/DELETE all supported Complex tables can span segments, records, etc. JOIN support for heterogeneous multi-table access Embedded JOIN optimization Multi-threaded s for maximum throughput Complexity in the Meta data simplifies development Legacy data types automatically translated Meta data defined "where" filtering through Views Multiple automated ways to normalize recurring data Full support for catalog queries Optional DB2-like security 10

6 Reporting, Auditing, Errors Standard SQL error handling SQL error and response codes returned as part of result Embedded SAF exit support SAF exit for charge-back and other accounting purposes Leverages existing mainframe accounting practices Embedded SMF accounting Type 99 records Tracing and Logging by level Remote and local monitoring Triggered tracing Post-Mortem tracing 11 Power Consistent SQL interface Instant integration Connects mainframe data with any ebusiness platform Insulates application from proprietary back-end data Non-intrusive NO impact on mainframe transactions Powerful data access non-relational & RDBMS Direct SELECT-INSERT-UPDATE-DELETE Distributed join, data normalization, view-driven filtering Ease-of-Use No mainframe programming Automated meta data configuration Integrates with your mainframe environment RACF - ACF2 - TopSecret Manage and monitor with existing mainframe utilities Security and accounting exits for site customization 12

7 Manage & Monitor Governors Limit resource utilization Set at Installation, Server and/or User levels Security Interface for RACF, ACF and TopSecret Optional embedded DB2-like security Operator Console Monitor usage Manage users 13 Components Connectors JDBC, JCA, ODBC and CLI (call level interface) Server Core mainframe-based SQL engine s base specific read/write access engines Mapper Configuration and administration 14

8 Mapper COBOL Copybooks DBD Source Non-Relational Mapper (Windows application) USE Grammar IDMS Schema/Subschema Mapper supports redefinitions and occurrences MS-Access Repository Catalog Types Com IDMS IMS Sequential VSAM Objects not supported by Mapper ADABAS Tables DB2 Tables Views Stored Procedure definitions Security 15 Mapper sample screenshot 16

9 VSAM access overview X Direct (a.k.a batch) access - limited function, slow, not scalable. - no configuration required - systems side folks usually not involved. CICS/VSAM - full-function, fast, scalable, recommended - configuration required - MVS, CICS & VTAM systems programmers needed. Import Copybook and generate the use of grammar syntax 17 CICS/VSAM access VSAM CUSTOMER File Query SQL Request Processor CICS CICSD APPL Local CACCICS1 APPL VSAM CICS EXV1 transaction EXC1/EXS1 18

10 IMS access overview II CF supports three methods to access/update IMS data: DBB/BMP Interface DRA Interface: Recommended ODBA Interface: Supports 2PC (RRS) access will be converted into the native DL/I call Supports all IMS database types except GSAM, PHDAM, PHIDAM, PSINDEX, MSDB Supports mapping of physical, logical and SIX IMS mapping Import DBD and copybook into the Mapper and generate the use of grammar syntax Starting from the root segment in the physical, logical or secondary data structure hierarchy. This root segment is referred to as the Index Root Segment Ending at a specified child segment which is referred to as the Leaf Segment IMS Logical Table can only map a single path in the physical, logical or SIX data structure hierarchy. For example, at least two IMS Logical Tables must be defined for database E4. One IMS Logical Table to map the Root->Child1 path and another to map the Root->Child2 path (See next chart for a diagram) 19 IMS mapping concepts IMS Logical Table1 Index Root=Root Leaf Segment-Child1 IMS Logical Table2 Index Root=Root Leaf Segment-Child2 Root Child1 E4 Example Root Child2 Root Child1 Child2 20

11 DB2 access Extract the table layout information by using sample utility Uses CAF interface to access DB2 ADABAS access If Predict is available Extract layout information by using sample utility Then generate the meta data grammar (USE grammar) from the extracted layout If Predict is not available Manual creation of the meta data grammar is required During the installation, it is needed to link a module with the Adabas module for the Adabas access 21 CA-DATACOM/DB access Get the COBOL copybook information by punching out the layout of the data Download the copybook into the Mapper and create the use of grammar syntax Upload onto the mainframe and generate the system catalog base connection will be made through the MUF (multi user facility) 22

12 CA-IDMS access Punch and get the Schema and Subschema Mapping the Schema and Subschema using Mapper Import the copybook into the Mapper IICF supplies batch access module (default central version mode) access will be converted into the native DML calls 23 Other objects VIEWS - Define manually and use the Meta Utility to load the definitions into the System Catalog. Stored Procedure definitions - Define manually and use the Meta Utility to load the definitions into the System Catalog. SQL Security - Define manually and use the Meta Utility to perform the grants/revokes against the System Catalog. 24

13 CF Configuration UNIX, Windows, z/os JVM Platforms Portal BI Tool Servlet Client Class Servlet SQL SQL EJB SQL SQL SQL DB2 II CF ODBC Connector DB2 II CF JDBC/JCA Connector SQL z/os OS/390 DB2 II CF Server Meta Adabas IDMS com IMS VSAM DB2 25 Architecture CA com DB2 IMS CA-IDMS VSAM Adabas Meta Catalog Mapper exadas s s SQL Engine s s Integration Server TCP/IP or MQ Series JDBC/JCA or ODBC Connector AIX USS Linux 0S/390, z/os Applications & Tools HP-UX Solaris 2000/XP 95/98/NT s s Default business mappings generated Imports existing physical definitions - Copybooks, IDMS schemas, IMS DBDs, Predict Generates logical relational table definitions Visual customization Many-to-Many Model Exports meta data to mainframe utilities Meta data driven features Automatic translation of legacy data types Meta- driven filtering Powerful SQL access - Performance of Native bases - Portability of industry standards 26

14 Benefits Simplifies Operational Environment Eliminates redundant copies of mainframe data Reduces stress on batch processing windows Simplifies Development Environment Single-platform development Empowers development using ubiquitous SQL skills Leverages scarce mainframe database skills Better Solution for the Business Eliminates data latency issues Reduces errors created by multiple copies of data Empowers rapid delivery of information rich solutions Saves Money Deliver more with fewer and less costly resources Reduces hardware and software for duplicate data 27 Speed, Scale & Footprint Architectural Features Hyperspace-enabled Multi-threaded at all levels Reentrant and reusable Access Features Leverages native access tools: indexes, keys (e.g. Calc Key) Embedded query optimizer Native IDMS support (online or batch) for functionality and speed Sample customer benchmark results Keyed queries from Java Milliseconds Two table Join Milliseconds Access through USS Milliseconds Transaction throughput ,000+ per second 28

15 Integration in Action Major US Airline Provide frequent flyers with up-to-the-minute information Dynamically connect Web site to IMS & VSAM flight data Eliminate copies of flight data reducing cost, data latency and errors Boarding Passes VSAM MVS Flight Operations IMS CF TCP/IP NT Frequent Flyer Web Site CF Up to second mileage credit Member Member 29 Integration in Action Major US Insurance Carrier Provide up-to-the-minute policy, claims and accounting information Dynamically connect interactive voice response system to IMS, VSAM & DB2 Connect agent, provider and insured self-service Web sites with live operational data MVS Claims Policy Management Billing Solaris Self Service Web Sites CF Agent Doctor DB2 VSAM IMS CF TCP/IP NT IVR CF Customer Agents 30

16 CF and DB2 Information Integrator CF extends reach of DB2 Information Integrator with reach to mainframe data sources Integrated SQLView DB2 Information Integrator SQL, SQL/XML Federation Engine Wrappers and functions DB2 Family Sybase Informix SQL Server Biological and Algorithms Text XML Excel WebSphere MQ IBM Extended Search WWW, , DB2 II CF ODBC Oracle Teradata 31 CF Transaction Services DB2 II CF Transaction Services CICS and IMS through same infrastructure as data access "Call" mechanism is GA Web Services mechanism on horizon 32

17 CF T.S. Architecture IMS/TM CICS Meta Catalog Transaction Transaction CF Server TCP/IP Query Processor Mapper JDBC/JCA or or ODBC Connector Applications & Tools AIX USS Linux 0S/390, z/os HP-UX Solaris 2000/XP 95/98/NT 33 Ordering information OTC (One time charge) product under the category of DB2 Tools Price based upon Value Unit (VU) Base product covers IBM data sources only DB2, IMS, VSAM Three optional features for the other data sources DB2 Information Integrator Connector for Software AG Adabas DB2 Information integrator Connector for CA-com DB2 Information Integrator Connector for CA-IDMS Minimum release level requirements Component Min. Rel. level Component Min. Rel. level Base System OS/390 V2R6 Adabas Adabas level 5.3 IMS IMS V3 com com V9 DB2 DB2 V4 IDMS IDMS V14 34

18 Summary Quick return on investment Easy to implement rapidly deliver information-rich business solutions Based on the wrapper technology utilizes existing infrastructure Minimizing dependence on legacy data skills Cost efficient solution Small footprint Can utilize mainframe spare MIPS Provide SQL interface to legacy data 35 Legacy data modernization services Business Partner Product Information Integrator & Information Integrator Classic Federation CTG, IMS Connector, DB2 Connector DL/2, VS/2 ManTech Services Classic Installation base migration, replication Tuning services Services Modern Java development Wireless connectivity to legacy system Rewrite legacy application L I G H T Y E A R Lightyear Consulting Ltd. Palo Alto, Calgary, Scottsdale, Laguna Beach, Austin, Chicago Tel: