Oracle Data Integration Enterprise Metadata Management (OEMM) Overview

Transcription

1

2 Oracle Data Integration Enterprise Metadata Management (OEMM) Overview Dr. Holger Dresing Oracle Data Integration Solutions (DIS) EMEA Copyright 2014 Oracle and/or its affiliates. All rights reserved.

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Copyright 2015, Oracle and/or its affiliates. All rights reserved.

4 Agenda Datenintegration und Data Governance OEMM Grundlagen Schnittstellen/Connectoren Demo/Powerpoint Screenshots Q&A Copyright 2014 Oracle and/or its affiliates. All rights reserved. 4

5 Comprehensive Data Integration & Governance Capabilities Real-Time Data Movement Low impact capture, stage in Hadoop Continuous data availability Data Transformation Bulk data movement Pushdown data processing Data Federation Virtualized Data Services Data Quality & Verification Fix quality at the source Verify data consistency Metadata Management Lineage and Impact Analysis Business Glossary Semantics Oracle GoldenGate (Movement) Data Governance Foundation Oracle Data Integrator (Transformation) ELT Processing on Hadoop or SQL Continuous Availability Enterprise Data Quality (Profile, Cleanse, Match and De-duplicate) Fast Load Data Service Integrator (Federation) GoldenGate Veridata (Online Data Verification) Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance) Big Data Preparation Service Copyright 2014 Oracle and/or its affiliates. All rights reserved. 5

6 Differentiated Technical Approach Dynamic Data Movement Real-time CDC is by default, not ETL Least invasive on sources Proven best performance Integrated Oracle capture/apply No ETL Engines Take the processing to the data; don t move the data to the process Leverage your data engines for the workloads (Hadoop or SQL) Most Heterogeneous Leverage open source Hadoop, not proprietary distributions Hadoop is the Hub, not ETL tools Open metadata standards Oracle GoldenGate (Movement) Data Governance Foundation Oracle Data Integrator * (Transformation) ELT Processing on Hadoop or SQL Continuous Availability Enterprise Data Quality (Profile, Cleanse, Match and De-duplicate) Fast Load Data Service Integrator (Federation) GoldenGate Veridata (Online Data Verification) Enterprise Metadata Management & Business Glossary (Business Glossary, Data Lineage, Impact Analysis and Data Provenance) Big Data Preparation Service Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

7 Oracle Enterprise Metadata Management Trust your data BCBS 239 Executives Dashboards / Reports???!!!!= Dashboard does not match report? Where did this data come from? Can I trust my other dashboards and reports? Copyright 2014 Oracle and/or its affiliates. All rights reserved.

8 Oracle Enterprise Metadata Management Data Lineage Impact Analysis DBA s / ETL / BI Developers Data Mgmnt. / Development Env.??!!?? What impact on does my column change have? What impact does my ETL mapping have? I want to create new assets from my metadata!! Copyright 2014 Oracle and/or its affiliates. All rights reserved.

9 Value of Enterprise Metadata Management Solves a significant pain point for a wide variety of business consumers and technical staff Which reports use this customer data? What will happen if I change this table? ETL Developer Executive Application User App GG ETL CDC ETL BI Dashboards How was sales figure calculated? What reports use the mainframe data? Sys Admin ETL Can I trust the sources of this customer data? Data Steward Data Reservoir Data Scientist BI Developer I want to design an experiment to measure the success of a signup page. What data do I have? Where did this data come from? Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 9

10 Vertical Lineage Two Crucial Styles of Metadata Management AGG_TOTAL Customer NORTH BI Fields to Source Columns NE_SALES Biz Terms to IT SALES NAME ACCT_NAME FNAME LNAME Horizontal Lineage Vertical Lineage Links a business friendly set of terms to the IT metadata and operational assets Capture Business Glossary, Taxonomy, Ontology, Conceptual Models Horizontal Column Level Links the data fields from Business Intelligence Dashboards or Reports back to the Source Columns Schemas, BI View Layers, ETL Transformations, Calculations, etc. Copyright 2014 Oracle and/or its affiliates. All rights reserved. 10

11 Introducing: Oracle Enterprise Metadata Management Business/Metadata Catalog Report to Source Lineage Impact Analysis Audit, Versioning & Diff Reports Social/Collaboration Features Annotations and Tagging Automatic Stitching 1. Business Glossary simple tools to catalog, link and collaborate on business terms 2. Metadata Management horizontal and semantic data lineage for all big data sources Comprehensive Harvesting 3 rd Party BI Metadata 3 rd Party ETL Metadata 3 rd Party DB Metadata 3 rd Party Modeling Tools Hadoop & NoSQL Metadata Metadata Standards Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Open World

12 Impact Analysis Oracle Metadata Management Logical Architecture Metadata Management Data Discovery Actionable Information Analytics Data Lineage Business Glossary Semantic Linking ETL Data Quality Data Integration Replication Messaging Data Federation Metadata Repository File Based Cloud Data Sources Big Data Relational Applications Copyright 2014 Oracle and/or its affiliates. All rights reserved. 12

13 Impact Analysis Oracle Metadata Management Logical Architecture Actionable Information Data Discovery Analytics Data Lineage Business Glossary Semantic Linking ETL Data Quality Data Integration Replication Messaging Data Federation Data Sources Metadata Repository File Based Cloud Big Data Relational Applications Copyright 2014 Oracle and/or its affiliates. All rights reserved. 13

14 Impact Analysis Oracle Metadata Management Logical Architecture Actionable Information Data Discovery Analytics Data Lineage Business Glossary Semantic Linking ETL Data Quality Data Integration Replication Messaging Data Federation Data Sources Metadata Repository File Based Cloud Big Data Relational Applications Copyright 2014 Oracle and/or its affiliates. All rights reserved. 14

15 Comprehensive, Open & Heterogeneous Data Integration Operational Integration (Movement / Transformation) Hadoop HBase Hadoop Hive/Flume HP Enscribe HP NonStop HP Neoview Hypersonic SQL IBM DB2 i Series IBM DB2 UDB IBM DB2 z Series IBM Informix IBM Netezza JMS / MQ Microsoft Access Microsoft SQLServer MySQL Pivotal Greenplum PostgreSQL Salesforce.com SAP BW / BI SAP ERP / ECC SAS SQL/MP SQL/MX Sybase ASE Sybase IQ Teradata Oracle Database Oracle Exadata Oracle Big Data Appliance Oracle TimesTen Oracle OLAP Oracle Business Intelligence Oracle BI Applications Oracle E-Business Suite Oracle JD Edwards Enterprise One Oracle JD Edwards World Oracle Fusion Applications Oracle Governance Risk and Compliance Oracle Fusion AIA Oracle Retail Applications Oracle Agile BI / DW Oracle Agile PLM for Process Oracle iflex FlexCUBE Oracle iflex Mantas Oracle Hyperion Applications Oracle PeopleSoft Oracle Siebel CRM / OnDemand Oracle Communications Oracle WebLogic Server Oracle Coherence Data Grid Oracle SOA Suite Oracle Enterprise Service Bus Adaptive Altova Apache Hcatalog Apache Hive/HQL Borland CA ERwin Cloudera Impala COBOL Copybook DataStax Embarcadero EMC ProActivity GentleWare Google BigQuery Grandite Hadapt Hive Hortonworks Hive IBM Cognos IBM DB2 IBM DataStage IBM Discovery IBM Federation Server IBM Lotus Notes IBM Netezza IBM Rational Rose IBM Rational Architect Informatica Metadata Mgr. Informatica PowerCenter Metadata Harvesting (Glossary, Lineage & Impact Analysis) CoSORT ISO SQL Standard (DDL) MapR Hadoop Hive MicroFocus Microsoft Access Microsoft Office Excel Microsoft Visio Microsoft SQL Server Microsoft SSIS Microsoft Visual Studio Microstrategy Magic Draw OMG CWM Standard OMG UML Standard Oracle BI Answers Oracle BI Enterprise Edition Oracle BI Server Oracle DAC Oracle Data Integrator Oracle Data Modeler Oracle Database Oracle Designer Oracle Hyperion Applications Oracle Hyperion Essbase Oracle Warehouse Builder Pivotal Greenplum PostgreSQL QlikView SAP BO Crystal Reports SAP BO Designer SAP BO Desktop Intelligence SAP BO Repository SAP BO Data Integrator SAP BO Data Steward SAP Master Data Management SAP Sybase PowerDesigner SAP Sybase ASE Database SAS Data Integration Studio SAS BI Server SAS Information Map SAS Metadata Management SAS OLAP Server Select Sparx Architect Syncsort Tableau Talend Teradata Tigris Visible W3C DTD & XSD Schema + open APIs and standards based meta-model Copyright 2015, Oracle and/or its affiliates. All rights reserved.

16 Detailed Feature List Exploring Metadata Text Search and Metadata Browser, Model/Diagram Visualizers, Birds-eye View, Metadata Reporting Data Flow and Lineage Analyzer Sarbanes-Oxley Act (SOX) Compliance Versioning and Model Compare URI Based Call back from BI reports or Business applications Stewardship Collaboration Feedback Comments and Review Board Metadata Tagging with Labels Multimedia attachments (documents, videos, presentation, code) URL link references for , blogging, social networking Lifecycle Change Management Metadata Harvesting from any DM, DW, ETL/DI, BI Tooling and Big Data/Hadoop Enterprise Architecture Management (Metadata Configuration Management) Impact of Change Data Standardization & Data Governance Supports Variety of Metadata Standards Annotations and Tagging Business Glossary with Semantic Lineage Oracle Integrated Oracle Database Oracle Data Integrator, Oracle GoldenGate Oracle Business Intelligence Enterprise Edition Oracle Business Intelligence Applications (ODI and older Informatica based OBIA) Copyright 2014 Oracle and/or its affiliates. All rights reserved.

17 Metadata Harvesting from all Popular Platforms Copyright 2014 Oracle and/or its affiliates. All rights reserved.

18 Data Governance Lifecycle Tools Governance Cockpit for Data Stewards & Stakeholders Design Time Quality KPIs Case Management Exception Review Metadata Management Business Glossary Business Sources Operational Data Flows Copyright 2014 Oracle and/or its affiliates. All rights reserved. 18

19 Oracle Metadata Management Physical Architecture Any Web Browser Repository Manager Metadata Browser Search Data Source Data Stewardship Governance Lineage Impact Analyzer Business Glossary ETL Metadata Repository Enterprise Conceptual Model BI - Reporting Semantic Mapping Copyright 2014 Oracle and/or its affiliates. All rights reserved. 19

20 Copyright 2015, Oracle and/or its affiliates. All rights reserved.

21 DEMO Copyright 2015, Oracle and/or its affiliates. All rights reserved. 21

22 Friendly Views for Business & IT User Collaboration Havesting Metadaten Oracle Datenbank Oracle Data Integrator Informatica Powercenter Oracle Business Intelligence Excel-Datei Data Lineage Impact Analysis Manual Data Mapping Business Glossar Metadata Explorer Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Big Data Governance 22

23 Friendly Views for Business & IT User Collaboration Easy to Use, Search Driven Business Friendly Navigation Comprehensive Data Lineage Business & IT Collaboration Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Big Data Governance 23

24 End-to-End Data Flow Architecture Views See how systems are connected while visualizing annotations and system boundaries Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 24

25 Keyword Based Search on all Metadata Full index text search provides simple navigational access to very large metadata models Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 25

26 Graphical Browser for Data Model Diagrams Birds-eye-view metadata viewer enables zoom-in / zoom-out around complex metadata models Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 26

27 Versioning with Model Comparisons Easily group and compare data models from similar databases to determine crucial differences Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 27

28 Social Collaboration for Stewardship Teams Team-based approach is designed in from the start Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 28

29 Find Data Provenance from the Report Layers Visualize column and calculation level dependencies across systems, databases and reporting views Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 29

30 Business Glossary is Built In (not a separate add-on) Going beyond database dictionaries, link business terminology across metadata models and systems Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 30

31 Perform Semantic Analysis For a Business Term, find all the physical implementations where the term is used Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 31

32 Business Glossary workflow Workflow for the entire lifecycle from drafting to the final approval of business terms Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle Confidential, under Non-Disclosure 32

33 Connect with Oracle Data Integration Oracle Data Blogs.oracle.com/DataIntegration/ Oracle Data Integration Copyright 2014 Oracle and/or its affiliates. All rights reserved.

34 Questions & Answers Copyright 2014 Oracle and/or its affiliates. All rights reserved.

35 Copyright 2014 Oracle and/or its affiliates. All rights reserved. 35