Oracle Data Integration

Transcription

1 Oracle Data Integration The Essential Core of Data Governance with Oracle Enterprise Data Quality CON9539 Martin Boyd Senior Director Product Strategy, Oracle Brian Kleber Director Enterprise Data Management, Cummins Copyright 2015, Oracle and/or its affiliates. All rights reserved.

2 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Copyright 2015, Oracle and/or its affiliates. All rights reserved. 2

3 Copyright 2015, Oracle and/or its affiliates. All rights reserved.

4 Oracle Data Integration Core Business Use Cases 24 x 7 x 365 Analytics & Business Intelligence Big Data Integration & Governance Data Warehouse / Mart Integration IT Data Integration & Governance Enterprise Shared/Common Data Services Move, Migrate, Transform, Profile, Cleanse, Glossary and Metadata Management Business Continuity Active-Active for Maximum Availability Zero Downtime Migrations Cloud On Premise Copyright 2015, Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

5 NoETL Engine 100% Native Data Transformation Data Integrator Big Data Preparation Prepare, Secure, Enrich and Publish Unstructured Data Non-invasive CDC, Realtime streaming data delivery GoldenGate Metadata Management Catalog, Trace and View Models across the Enterprise Profile, Cleanse, Match, and Remediate Data Data Quality Data Service Integrator Federate Data Across DBs, Services and Applications Copyright 2015, Oracle and/or its affiliates. All rights reserved. 5

6 NoETL Engine 100% Native Data Transformation Data Integrator Big Data Preparation Prepare, Secure, Enrich and Publish Unstructured Data Non-invasive CDC, Realtime streaming data delivery GoldenGate Metadata Management Catalog, Trace and View Models across the Enterprise Profile, Cleanse, Match, and Remediate Data Data Quality Data Service Integrator Federate Data Across DBs, Services and Applications Copyright 2015, Oracle and/or its affiliates. All rights reserved. 6

7 Program Agenda Data Governance Enterprise Data Quality Customer Examples Data Governance at Cummins Copyright 2015, Oracle and/or its affiliates. All rights reserved. 7

8 Data Modernization Affects All Industries Financial Services Insurance Telecom Retail Risk & Compliance Analytics Auditing, Deep Data Storage Fraud Detection / Predictive Trading Risk Insight Deposit Spread Maximization Insurance Underwriting Customer Behavior Monitoring Next Best Product / Predictive Loan Processing w/new Data Litigation Propensity Subrogation Win Rates Call Detail Records (CDRs) Infrastructure Investment Next Product to Buy (NPTB) Real-time Bandwidth Allocation New Product Development 360 View of Customer Analyze Brand Sentiment Localized, Personalized Promotions Website Optimization Optimal Store Layout Manufacturing Utilities, Oil & Gas Healthcare Public Sector Monitor Recall Data Supplier Consolidation Supply Chain and Logistics Assembly Line Quality Predictive Maintenance Crowdsource Product Quality Smart Meter Stream Analysis Slow Oil Well Decline Curves Optimize Lease Bidding Compliance Reporting Proactive Equipment Repair Seismic Image Processing Genomic Data for Medical Trials Monitor Patient Vitals Reduce Re-admittance Rates Store Medical Research Data Recruit Cohorts for Pharmaceutical Trials Analyze Public Sentiment Protect Critical Networks Prevent Fraud and Waste Crowdsource Reporting for Repairs to Infrastructure Fulfill Open Records Requests Copyright 2015, Oracle and/or its affiliates. All rights reserved. 8

9 Data Governance Why? What? How? Why? What? How? Because we have to trust our data, or nothing else works Formulation of policy to align objectives, rules and execution across the organization Assign responsibility and agree rules Enforce rules Monitor and improve Wednesday, November 04, 2015 Copyright 2015, Oracle and/or its affiliates. All rights reserved. Information Asset 9

10 Governance is Not Just a Technology Problem people and process supported by tools and capabilities in partnership with the business Metadata Management OEMM Poor data quality is the primary reason for 40% of all business initiatives failing to achieve their targeted benefits PEOPLE Data Privacy Business Glossary Gartner, Measuring Business Value of Data Quality, 2011 PROCESS TECHNOLOGY Data Archiving Data Governance Data Cleansing Data Profiling EDQ, Big Data Preparation More than 50 percent of data warehouse projects will have limited acceptance, or will be outright failures, as a result of a lack of attention to data quality issues Gartner PR 2005 ( room/id/492112) Copyright 2015, Oracle and/or its affiliates. All rights reserved. Oracle Big Data Governance 10

11 Data Governance Practical Step-by-Step Approach 1. Profile current data to determine current data quality and fitness for purpose (EDQ) 2. Prioritize CDEs (Critical Data Elements) by business impact 3. Assign and record CDE ownership, business rules, glossary, reference data (OEMM) 4. Look at lineage to determine where data is it coming from (OEMM) 5. Build DQ processes to enforce business rules transform, standardize, validate, match, merge Deploy in data warehouse/hub Deploy at source 6. Case management to remediate data that does not fit (EDQ) 7. DQ dashboards to monitor effectiveness (EDQ) 8. Rinse and repeat (and improve ) Copyright 2015, Oracle and/or its affiliates. All rights reserved. 11

12 Oracle Enterprise Data Quality Common Access/UI Govern Monitor effectiveness & resolve problems Match Identify & merge duplicates Standardize Drive conformance to standards Profile Quickly understand data content Enterprise DQ Platform Market-leading usability for all types of data Unparalleled time-to-value High performance engine Out-of-the-box global knowledge-base Foundation for governance program Copyright 2015, Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

13 Architecture Platform ADP Excerpt from OOW 2014 Siebel UCM with Oracle Enterprise Data Quality is the technology platform that makes it happen ADP, LLC. Proprietary.

14 ADP Data Governance 1 Year On Added more business units and people (data stewards) Added more business rules, reference data, etc. EDQ has become source of truth rules repository EDQ used to review new rules and for what-if impact analysis prior to implementing new rules Better, broader reporting/dq metrics Adding end-user satisfaction feedback Greater use of ODI and OGG for data movement and application performance Improved customer service due to improved account information Can guarantee internal SLAs due to improved workflows Copyright 2015, Oracle and/or its affiliates. All rights reserved. 14

15 Program Agenda Data Governance Enterprise Data Quality Customer Examples Data Governance at Cummins Copyright 2015, Oracle and/or its affiliates. All rights reserved. 15

16 The Essential Core of Data Governance with Oracle Enterprise Data Quality Brian Kleber October 2015

17 1919 Diesel Engines

18 ,000

19

20 1M+ Products 3M+ Customers 70K+ Suppliers 20

21 Getting Started Pick a Critical Data Element that is important to the business Understand it s lineage and current quality Assign a responsible data steward for the CDE Develop business rules for CDE Develop plan for Remediation of current data Ongoing verification Build metrics to check ongoing process and rules effectiveness Make iterative course corrections 21

22 Gartner, Information Management Building Blocks

23 Data Governance Councils and Roles New Roles Data Governance Councils Sponsorship Exec Sponsors Executive Council Supply Chain Supply Chain Accountability Global Data Owners Strategic Council Definition Functional Data Owners Tactical Council Adherence Business Data Stewards Across Cummins 23

24 Organizational Structure and Alignment Where should Data Management/Governance align to? IT CIO Business CFO, COO, CDO, CXX Answer: Should exist anywhere appropriate for your organization Who you report to matters less than whom is on the Executive Council 24

25 Example: Define Rules Supplier Definition Tax Registration Number Completeness Metric 25

26 Example: Build Rules in EDQ 26

27 Example: Monitor Rules 27

28 Organization Change Management Building the Community 28

29 Data Standards Data Ownership Knowledge Center 29

30 Business Benefits and Outcomes Supplier Managing supply chain disruptions Supporting sourcing strategies Customer Managing global customer credit and risk Enabling global ease of doing business with Cummins Product Inventory management Product number creation and maintenance cost 30

31 Envision Cummins Customer Data Management Customer Example Increasing confidence in customer data Repeatable processes, tools and business ownership established for the first time to ensure we always have a common trusted view duplicate of our customers duplicate error Scalable, repeatable approach to continuously improve our customer data Only duplicate 20% of the records were correct 73% corrected, remaining require more information De-duplication of 1,158 different duplicate customer error numbers, resulted in only 72 unique customer numbers surviving 31

32 Governance Program Scope 80+ data stewards (all part-time) ~100 critical master data objects under governance ~300+ Supply Chain data objects under governance 400 business rules approved 20 new business rules under consideration (always dynamic) 32

33 Summary of Key Points Start small Define what Data Governance means to your organization Understand what your executives problems are Help solve their problems Start 33

34 Questions 34

35 Program Agenda Data Governance Enterprise Data Quality Customer Examples Data Governance at Cummins Copyright 2015, Oracle and/or its affiliates. All rights reserved. 35

36 Data Integration Solutions Program - tinyurl.com/disoow15 Presentations on: Oracle Data Integrator Oracle GoldenGate Oracle Enterprise Data Quality Oracle Enterprise Metadata Management Oracle Big Data Preparation Cloud Service Handson labs: Oracle Enterprise Data Quality HOL10464 Oracle GoldenGate Deep Dive HOL10460 Oracle GoldenGate For Big Data HOL10463 Oracle Data Integrator For Big Data HOL Oracle Data Integrator Deep Dive HOL10462 Demo Stations: Middleware Demoground - Moscone South Database Demoground - Moscone South Big Data Showcase - Moscone South Oracle Cloud Platform and Infrastructure Showcase - Moscone West Copyright 2015, Oracle and/or its affiliates. All rights reserved. 36

37 Data Integration Solutions Program - tinyurl.com/disoow15 Monday, Oct 26 Oracle Data Integration Solutions Platform Overview and Roadmap [CON9737] Oracle GoldenGate Product Update and Strategy [CON9720] How Oracle GoldenGate Helped Increase Data Availability for Financial Close by 600% at Humana [CON4398] Into the Cloud and Back with Oracle Data Integrator 12c [CON3506] Tuesday, Oct 27 Oracle Data Integrator Product Update and Strategy [CON9601] Oracle GoldenGate 12.2 New Features Deep Dive [CON8737] The Role of Data Governance in Data Integration [CON9736] Oracle Fusion Middleware: Meet This Year s Most Impressive Innovators [CON10374] The Oracle Enterprise Data Quality Platform Product Overview and Roadmap [CON9587] Enabling Real-Time Data Integration with Big Data [CON9724] Solving the Dirty Secret of Big Data with Oracle Big Data Preparation Cloud Service [CON9615] Wednesday, Oct 28 Oracle Data Integration Solutions: the Foundation for Cloud Integration [CON9614] Oracle Data Integration Product Family: a Cornerstone for Big Data [CON9609] The Essential Core of Data Governance with Oracle Enterprise Data Quality [CON9593] Accelerate Cloud Onboarding Using Oracle GoldenGate Cloud Service [CON9717] Introducing Oracle GoldenGate Studio for Faster Design and Deployment [CON9713] Thursday, Oct 29 Integrating Big Data: Balancing the Data Warehouse and the Data Reservoir [CON8768] Zero-Downtime Upgrading Using Oracle GoldenGate [CON7892] Best Practices for Migrating to Oracle Data Integrator [CON9604] Oracle GoldenGate Performance Tuning and Monitoring [CON8736] Cloud Data Quality: Lessons Learned from Oracle s Journey to the Sales Cloud [CON9595] Oracle Enterprise Metadata Management and the Cloud [CON9612] Developer Best Practices for Oracle Data Integrator Lifecycle Management [CON9611] Oracle Management Pack for Oracle GoldenGate Update [CON9716] Copyright 2015, Oracle and/or its affiliates. All rights reserved. 37

38 Connect with Oracle Data Integration Oracle Data Blogs.oracle.com/DataIntegration/ Oracle Data Integration Copyright 2015, Oracle and/or its affiliates. All rights reserved.

39 39