ANY Data for ANY Application Exploring IBM Data Virtualization Manager for z/os in the era of API Economy

Transcription

1 ANY Data for ANY Application Exploring IBM for z/os in the era of API Economy Francesco Borrello IBM z Analytics

2 Traditional Data Integration Inadequate No longer Viable to Move Data (using extract, transform, load ETL) Risk to data security Data inconsistency Rigid, limits business agility High cost and latency

3 A New Approach is Needed Data Virtualization Unlike traditional data integration data virtualization creates virtualized and integrated views of disparate data in-memory for immediate read/write access rather than waiting on moving the data and holding the integrated views in an EDW a data services layer that integrates data and content on demand from disparate sources in real time provides a layer of abstraction that shields developers from unique data implementation provides a metadata catalog to keeps track of data, location, availability, and state supports transactions that write back to the original data sources regardless of location doesn t mandate a API or schema - supports many to many

4 What is expected of Data Virtualization?

5 What is expected of Data Virtualization? Analytics/Search Provide ANY data for ANY application ESB, ETL Cloud Mobile Data Virtualization Transactional Data

6 Data Virtualization on IBM Z

7 IBM for z/os Virtualize z/os data with other enterprise data sources in real-time without data movement to provide comprehensive information that is readily consumable by analytics, cloud and cognitive applications ensures data is secure and in-place with real-time data virtualization supports Hybrid architectures (on-premises, Cloud, Hadoop and MF) broad API support via SQL, NoSQL, SOAP, and REST via z/os Connect EE z/os resident optimization for improved performance and TCO abstraction layer for improved productivity and business agility Take action now! accelerate mainframe modernization initiatives involving Big Data gain real-time business insights across z/os and enterprise data eliminate coding of complex z/os apps via built-in APIs and interfaces The industry s only Z-resident data virtualization solution!

8 IBM for z/os

9 Runs Without A Processing Penalty WLM Enclave WLM Enclave Ability to integrate mainframe data in place with transformation running on ziip Network I/O Hybrid SRB/TCB SRB/TCB Mode Switch API Data I/O Hybrid SRB/TCB SRB/TCB Mode Switch API Ability to route up to 99% of data processing time to ziip ziip

10 Map/Reduce Implemented on z/os IBM DVM Address Space Data Consumer Request for Data Data Provider SQL ODBC/JDBC NoSQL (JSON) Web Services (SOAP/REST) Consumer I/O Hybrid SRB/TCB Write to Client Buffer Provider I/O Hybrid SRB/TCB Db2, MapReduce ADABAS, IMS LDU IDMS, VSAM MapReduce LDU MapReduce Physical LDU Sequential, SMF, Sys Logs, MQ MapReduce LDU Db2 MapReduce LUW, SQL LDU Server, Oracle MapReduce LDU ziip

11 More than just data access Access to all data from all applications without need to know which format the data it is in using the API of your choice MAINFRAME Adabas IMS DB Db2 for z/os IDMS SEQ files VSAM JDBC/ODBC IBM Data Virtualization Manager for z/os z/os Systems SMF records Log Streams NoSQL Virtual Tape zfs IBM z/os Connect EE Distributed Db2 Warehouse Db2 Warehouse on Cloud REST AP/SOAPI Db2 Informix

12 Selective direct Distributed Relational Database Architecture support Oracle Data Provider for DRDA (Linux) Oracle IBM Data Virtualization Manager for z/os DRDA Microsoft Service for DRDA SQL Server Apache Derby

13 Enabling APIs for Data on IBM Z z/os Connect Enterprise Edition CICS REST API Consumers Load balancer Intelligent Content routing Gateway / DataPower DMZ Security layer Trusted zone Outer APIs Discovery Services Inner APIs IMS WAS MQ REST Services DB2 Agile web, mobile, cloud access via REST to mainframe applications such as CICS, IMS, WAS

14 Enabling APIs for Data on IBM Z z/os Connect Enterprise Edition CICS Data Virtualization Manager for z/os Adabas REST API Consumers Load balancer Intelligent Content routing Gateway / DataPower DMZ Security layer Trusted zone Outer APIs Discovery Services Inner APIs IMS WAS MQ IMS DB IDMS SMF REST Services DB2 VSAM Agile web, mobile, cloud access via REST to mainframe data such as Adabas, IMS, VSAM DVM Non z/os

15 Automated generation of code to access data from Spark & Python Reduce coding of data access via automated generation of Scala code (Python in progress) Automatically optimized based on available parallelism to generate best performance results without manual coding

16 16