Oracle Data Integrator 12c New Features

Transcription

1

2 Oracle Data Integrator 12c New Features Joachim Jaensch Principal Sales Consultant Copyright 2014 Oracle and/or its affiliates. All rights reserved.

3 Safe Harbor Statement The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle s products remains at the sole discretion of Oracle. Copyright 2014 Oracle and/or its affiliates. All rights reserved. 3

4 What s New In Oracle Data Integrator 12c? Declarative Flow-Based User Interface Reusable Mappings Multi-Threaded Target Load Step-by-Step Debugger Runtime Performance Enhancement Oracle GoldenGate Integration Improvements Standalone Agent Management with WebLogic Management Framework Integration with Oracle Platform Security Services (OPSS) Enterprise Roles JSON and XML Improvements Oracle Warehouse Builder (OWB) Integration OWB to ODI Migration Tool OEM Management Pack for Oracle Data Integrator New Mapping Components: PIVOT, UNPIVOT Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

5 Reusable Mappings Capture common logic (sources, targets, transformations) Reuse logic in mappings Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

6 Multi-Threaded Target Load Fast Load through parallel JDBC connections Configurable per Data Server Data Server settings: Parallel Load Threads JDBC Source ODI Agent Target Database Copyright 2014 Oracle and/or its affiliates. All rights reserved.

7 In-Session Parallelism ODI 11g Goal Allow the execution of tasks and steps in parallel rather than sequentially SrcSet1 SrcSet2 SrcSet3 Integration How Introduction of a new Runtime concept: Execution Units In loading of C$ tables can be executed in parallel Total Execution Time ODI SrcSet1 SrcSet2 Integration SrcSet3 Total Execution Time Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

8 Low Overhead Session Execution Goal Reduce status and session management overhead How Cache and reuse a Session Blueprint instead of accessing the ODI repositories Avoid writing logs in the repository when it is not necessary Benefits Better performance when executing scenarios multiple times, when restarting a session, when logging sessions activity Less fragmentation of repository tables Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

9 Concurrent Execution Control You can now limit concurrent executions in a scenario or load plan and force a concurrent execution to either wait or raise an execution error Copyright 2014 Oracle and/or its affiliates. All rights reserved.

10 Step by Step Debugger Give control to the user on the Execution Flow of a Session Pause, Resume, Run to next Step, etc. Define breakpoints on steps in packages Toggle breakpoints in Sessions Query data through agent (gives access to uncommitted data) Start a session with the option to wait for user inputs on Error Copyright 2014 Oracle and/or its affiliates. All rights reserved.

11 One-Step Model and Topology Creation One dialog to create all metadata objects: Data Server Physical and Logical Schema Context Model Simplifies and accelerates ODI development Copyright 2014 Oracle and/or its affiliates. All rights reserved.

12 Integration Between GoldenGate and ODI 12c Enable GoldenGate Journalizing on Interfaces without restructuring. Manage GoldenGate Capture/Delivery instances in ODI Topology Set common GoldenGate parameters graphically Bulk Load Scenario Real Time Scenario Deploy GoldenGate Processes via ODI Extract Replicat Support Real-Time and Bulk from the same Interface Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

13 Security Enhancements Product-wide standardization on AES encryption FIPS compliant (US) AES key 128bit by default, algorithm and key length can be configured: 128, 192 & 256. ODI import and export uses secure encryption for sensitive data Copyright 2014 Oracle and/or its affiliates. All rights reserved.

14 Improved JSON and XML Support Complex File Driver reads and writes JSON Conversion to tabular Datastore format XML support for advanced constructs: any, anytype, anyattribute Custom XML column mappings Datastore CUST PK_CUST first last 1 John Smith { } "first": "John", "last": "Smith", "phone": [ { "type": "home", "number": " " }, { "type": "work", "number": " " } ] PK_PHONE FK_CUST type number JSON Datastore PHONE 1 1 home work Copyright 2014 Oracle and/or its affiliates. All rights reserved.

15 Invoking OWB 11.2 Processes from ODI 12c New OWB Runtime Repository technology available in Topology OWB processes can be invoked using the OdiStartOwbJob tool in Packages OWB audit information is available in Operator, ODI Console and Enterprise Manager Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

16 Oracle Warehouse Builder Migration Support for incremental migration Objects already created by a previous migration will now be reused when MIGRATION_STRATEGY option is set to NODUP Support for migrating to ODI and from OWB and Bug fixes from the previous release Copyright 2014 Oracle and/or its affiliates. All rights reserved.

17 Management Pack for Oracle Data Integrator (1) New in the FMW Plugins release IBM DB2 support (repository and source/target) Microsoft SQL Server support (repository and source/target) Redesigned Load Plan Execution/Sessions page More information at Additional License needed Copyright 2014 Oracle and/or its affiliates. All rights reserved.

18 Management Pack for Oracle Data Integrator (2) Discovery of ODI components Agents: Standalone and JEE Repositories Source and Target databases Monitoring Availability Monitoring ODI homepage to quickly assess infrastructure status Performance Monitoring ODI components performance Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

19 ODI Big Data HBase and Hive Support HBase now supported as a Big Data source or target New Knowledge Modules for Hbase RKM HBase LKM HBase to Hive IKM Hive to HBase Incremental Update Support for Hive Append Existing KMs enhanced to support append Copyright 2014 Oracle and/or its affiliates. All rights reserved.

20 ODI Big Data SQOOP Load Fast Load between databases and Hadoop Database can be source or target HDFS, Hive, or HBase supported Parallelized load using a data partitioning scheme Parallel JDBC Queries Oracle Data Integrator SQOOP HDFS SQOOP HDFS Source Database SQOOP HDFS Copyright 2014 Oracle and/or its affiliates. All rights reserved.

21 Terminology Mappings was renamed to Interfaces Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

22 Useful Links ODI 12c New Features: PM Wiki: ODI Demo VM: ODI OTN VM: Blogs Data Integration: A-Team: Copyright 2014 Oracle and/or its affiliates. All rights reserved.

23 Resources Oracle Data Integrator Oracle GoldenGate Oracle Enterprise Data Quality Oracle Enterprise Metadata Management Oracle Data Services Integrator Oracle Data Integration Oracle Data Integration ORCL DataIntegration blogs.oracle.com/dataint OracleGoldenGate egration Data Integration Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

24 Questions and Answers Copyright 2014 Oracle and/or its affiliates. All rights reserved. Oracle OpenWorld

25 Copyright 2014 Oracle and/or its affiliates. All rights reserved. 25

26