Change Data Capture - Migration Data Replication

Transcription

1 Georg Sehrt IBM InfoSphere Data Replication Change Data Capture CDC Change Data Capture - Migration Data Replication

2 Real-time integration requirements are everywhere: Retail Multi-channel sales Real-time inventory checking Gift registry updates Financial Services On-line banking Fraud detection Government Benefits eligibility verification Security threat detection Telecommunications First call resolution Cross-sell/up-sell Customer retention 2

3 IBM InfoSphere Data Replication Has > customers

4 IBM InfoSphere Data Replication Event-Driven SOA and Real Time Analytics Data Synchronization and Replication Detect and react to business events as they occur and adapt to change faster through real-time analytics Up-to-date information flowing between applications to ensure most current version is always available High Availability and Disaster Recovery Zero Downtime Server Migrations Provide continuous data protection and availability of systems during planned and unplanned downtime Perform system upgrades while testing new applications with real-time production data

5 IBM Enterprise Linux Server Saving Money and Reducing Complexity Consolidate more servers per core Run more applications/software at less expense Manage more virtual servers with fewer people Deploy new servers and applications faster Absorb workload spikes more easily Spend less on disaster recovery Occupy less floor space Save on energy Linux Servers Linux Servers Linux Servers z/vm z/vm z/vm Shared Everything Infrastructure (CPU, Memory, Network, Adapters, Crypto, Devices) Helping you Do More with Less A refrigerator size box versus vs. a full room of servers. The differences are quantum.

6 Case : A Large Telco Application Integration HP Server TIBCO ESB Oracle Re-Do Log Transaction 1 Transaction 2 Transaction 3 Customer Address XML Document Transaction 1 Transaction 8 Queue 1 Other Application Transaction 4 XML Document Transaction 5 Transaction 6 Transaction 7 Transaction 8 Transaction 9 Transaction 10 Scrape Billing InfoSphere CDC Transaction 1 Transaction 2 Transaction 3 Transaction 4 XML Document Transaction 1 Transaction 7 Queue 2 Other Application Customer, Address, Memo, Service, Billing etc Transaction 10 Queue 3 Amdocs Billing Oracle db size = 11 terabytes 40 million trans/day Redo generation peak at 1 GB/min InfoSphere CDC Oracle 11 BI ELS Siebel CRM TIBCO API Business / Technical Drives * Real time visibility of Customer Billing Information in CRM system (Service Requirement) * Minimal impact on operational system * Flexible to changing data requirements * Minimum Latency (1100 transactions per second with no latency) * Scalability Oracle 11

7 Use Case A Large Telco Challenge Introduce innovative concepts to win new business and retain customer base without overloading mission-critical systems Extremely large billing system, no extra bandwidth for additional processing Database already running queries per second Tables contain up to 500 million rows Monitor customer account data in real-time to enable proactive action, additional revenue opportunities and unique customer service Solution IBM InfoSphere Change Data Capture detects changes in the billing system in real-time and sends a message to their CRM system. Prepaid customers notified when running low on minutes Prevents customers from losing service Provide immediate service to new customers Newly activated phones can be used right away Can start billing new customers instantly Benefits Peak performance of billing system through real-time Change Data Capture By tying the CRM to the billing system and using Event Detection, this company improves its business agility and productivity Event detection to increase revenue opportunities, improve service, mitigate risk to enable prompt response to potential compliance and fraud issues Quick and easy activation of new customers to boost sales Increased customer satisfaction Better business awareness means better business decisions, better customer service and better sales. IBM InfoSphere Change Data Capture gives us real-time insight into our operations, helping us to attract new business and maintain our leadership position.

8 IBM InfoSphere Data Replication Low Impact Real-Time Trusted Data Delivery for the Enterprise Plattform / Database Migration

9 Smarter High performance/functionality No Programming Configuration via GUI Information from native log Non intrusive to applications and databases

10 Simpler Best of breed UI Built in monitoring Management easily integrated into existing IT operations Mobile ready

11 InfoSphere Change Data Capture Sources Oracle SQL Server Java-based GUI for admin & monitoring Targets Database (Oracle, DB2, SQL Server, Teradata, etc.) ETL (DataStage, others) DB2 TCP/IP JMS (MQ, others) Information Server Informix Journal Log Redo/Archive Logs Source Engine And Metadata Target Engine And Metadata (DataStage, QualityStage, etc.) Sybase Flat files Key Benefits: Low impact Flexible implementation Heterogeneous platform support Easy to use Additional opportunity to leverage existing ETL and Data Quality investments through InfoSphere DataStage and QualityStage Web Services

12 Implementation Topologies Uni-Directional Cascade Consolidation Distribution Bi-Directional Local 2-Way Multi-Thread Remote Capture InfoSphere CDC

13 DATABASES Source & Target TARGETS MESSAGE QUEUE OPERATING SYSTEMS HARDWARE PLATFORMS DB2 z/os Information Server MQ Series IBM i OS IBM i DB2 LUW Netezza JMS z/os IBM System z Oracle Teradata * TIBCO AIX IBM System p DB2 i Cognos Now! WebMethods HP-UX HP PA-RISC MS SQL Server Greenplum** BEA Solaris HP Itanium DB2 UDB Sybase MySQL** MS Windows Intel / AMD (x86/x64) Informix Red Hat, SUSE Linux Sun SPARC SolidDB Intel Itanium Classic z

14 Remote configuration with Oracle source 1. Scraper on source, Apply on target Source Server Target Server Metadata Source Tables Scraper Apply redolog Metadata Target Tables 2. Scraper and Apply on target * Source Server Target Server Metadata Source Tables Scraper redolog Apply Metadata Target Tables 3. Scraper and Apply on CDC server * Source Server CDC Server Target Server Metadata Source Tables Scraper redolog Apply Metadata Target Tables 4. Scraper and Apply on source Metadata Source Tables Source Server Scraper Apply redolog Target Server Metadata Target Tables * For configurations 2 & 3, optimal using shared SAN for logs

15 Oracle Configuration dmconfigurets interface supports advanced Oracle configuration settings Tool provides early detection of basic accessibility and connectivity problems Configuration of system parameters post instance creation not required

16 Monitoring - Refresh Status Summary view of the percentage of the tables that are refreshed and ability to drill down for detailed view of refresh status

17 Monitoring - Performance View Provides subscription and table-level monitoring Exposes a large collection of statistics grouped by component Provides graphical and table presentation Trend analysis Supports data export Provides busy table identification

18

19 IBM Enterprise Linux Server Saving Money and Reducing Complexity Consolidate more servers per core Run more applications/software at less expense Manage more virtual servers with fewer people Deploy new servers and applications faster Absorb workload spikes more easily Spend less on disaster recovery Occupy less floor space Save on energy Linux Servers Linux Servers Linux Servers z/vm z/vm z/vm Shared Everything Infrastructure (CPU, Memory, Network, Adapters, Crypto, Devices) Helping you Do More with Less A refrigerator size box versus vs. a full room of servers. The differences are quantum.

20 Examples of Oracle Solutions deployed on IBM zenterprise System ELS (zerodowntime HW ) Select IBM Blades Optimizers IBM DB2 V10 z/os z/tpf z/vse Oracle E-Business Suite Linux on System z z/vm Oracle DB 11g R2 and Fusion Middleware Linux on System z Certified Oracle Solutions Linux on System x Blade Virtualization AIX on POWER7 Blade Virtualization DataPower IBM Smart Analytics Optimizer Future Offering Future Offering System z PR/SM z HW Resources EC12/ z196 / z114 Blade HW Resources zbx / puresystem Oracle solution landscape on a single zenterprise System Run Oracle database and Oracle E-Business Suite on highly available and reliable zenterprise 196 (z196) or zenterprise z114 (z114) Run certified Oracle solutions including PeopleSoft and Siebel application and web tiers on AIX on zenterprise BladeCenter Extension (zbx) Fully benefit from zenterprise, the first hybrid system, and manage all your Oracle solution servers with the zenterprise Unified Resource Manager

21 1 All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represents goals and objectives only. zenterprise Linux Server hybrid ELS Smarter Solution für Ihr Anwendungsdesign System z Hardware Management Console (HMC) mit Unified Resource Manager HMC SuSE z/vm Enterprise Linux Server Red hat z/vm Debian auf ELS Linux auf ELS System z PR/SM z HW Resources Support Element Fedora auf ELS z/vm Select IBM Blades Linux auf Intel 1 Windows auf Intel Blade Virtualization AIX auf POWER7 Blade Virtualization Blade HW Resources zbx DataPower 1 Optimizers IBM Smart Analytics Optimizer Future Offering Future Offering Private data network (IEDN) 21 Customer Network Unified Resource Manager Private Management Network INMN Private High Speed Data Network IEDN Customer Network

22 Acknowledgements and Disclaimers Availability: References in this presentation to IBM products, programs, or services do not imply that they will be available in all countries in which IBM operates. The workshops, sessions and materials have been prepared by IBM or the session speakers and reflect their own views. They are provided for informational purposes only, and are neither intended to, nor shall have the effect of being, legal or other guidance or advice to any participant. While efforts were made to verify the completeness and accuracy of the information contained in this presentation, it is provided AS-IS without warranty of any kind, express or implied. IBM shall not be responsible for any damages arising out of the use of, or otherwise related to, this presentation or any other materials. Nothing contained in this presentation is intended to, nor shall have the effect of, creating any warranties or representations from IBM or its suppliers or licensors, or altering the terms and conditions of the applicable license agreement governing the use of IBM software. All customer examples described are presented as illustrations of how those customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics may vary by customer. Nothing contained in these materials is intended to, nor shall have the effect of, stating or implying that any activities undertaken by you will result in any specific sales, revenue growth or other results. Copyright IBM Corporation All rights reserved. U.S. Government Users Restricted Rights Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. IBM, the IBM logo, ibm.com, InfoSphere, InfoSphere Business Glossary, InfoSphere Data Architect, InfoSphere DataStage, InfoSphere FastTrack, InfoSphere Information Analyzer, InfoSphere Information Services Director, InfoSphere Metadata Workbench, and InfoSphere QualityStage are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol ( or ), these symbols indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at Copyright and trademark information at Other company, product, or service names may be trademarks or service marks of others. 22