An Introduction to Oracle Warehouse Builder 10gR2. Paul Narth, Ali El Kortobi Oracle Corporation OLSUG, 23 June 2004

Transcription

1

2 An Introduction to Oracle Warehouse Builder 10gR2 Paul Narth, Ali El Kortobi Oracle Corporation OLSUG, 23 June 2004

3 The Challenge?

4 Turning Data into Profit. Transformation Business Intelligence Action Data Information Knowledge

5 Similar Challenge? SwissProt

6 Similar transition Transformation Informatics Action Data Information Knowledge

7 The Data Information Transformation Data becomes useful information when: It s secure (unbreakable) You can access it in a timely manner (grid) You understand it s content and structure (metadata)

8 Data + Metadata = INFORMATION? Quality(Data + Metadata) = INFORMATION

9 The Data Information Transformation Data becomes useful information when: It s secure (unbreakable) You can access it in a timely manner (grid) You understand it s content and structure (metadata) You can trust it (quality)

10 What is Oracle Warehouse Builder? Enables the extraction, transformation, and loading of data to produce quality information in the Oracle database Protects and leverages customer investment in the Oracle technology stack through data and metadata integration

11 Enabling Quality Information Quality Monitoring Data Capture Metadata Quality Assessment Information Execute Profile Data* Deploy Metadata Management Data Rules* Quality Algorithms Process Flow Data Flow Quality Design

12 Sources & Targets Oracle Sources Tables, Views, MViews, Queues, External Tables, Table Functions*, Streams, PL/SQL API s*, Sqlloader DB2, Sybase, SQLServer, Informix, (Oracle Transparent Gateways) Any ODBC source Flat Files Applications Oracle Apps SAP Custom* Oracle Flat files Targets Tables, Streams, OLAP, Table Functions*, PL/SQL API s*

13 Mappings (Data flows) Graphical, declarative modeling of Data Flows Map from Source to Target Integrated Data Quality N&A standardization Match/Merge Generates SQL & PL/SQL Merge, transportable tablespaces, sqlloader, table functions*, streams, xml data types*, BLOBS/CLOBS* Leverage custom data transformations Nested maps for reusability of logic*

14 Process flows Graphical, declarative modeling of Process/work Flows Co-ordinate execution of Maps and other activities Send , FTP source/target files, call any external process, Notifications* Generates Oracle Workflow, Oracle Scheduler* & XPDL

15 Single Metadata Tool Metadata Services Dependency & Change Management Data Lineage Impact Analysis diff, merge and reconcile Extensibility APIs (Java, Scripting (Tcl), SQL, PL/SQL) User defined objects, associations, and properties Other Services Security (roles) Versioning/Snapshots Multi-language Support Exchange

16 Metadata Impact Analysis

17 Guided Change Management/Propagation*

18 D E M O N S T R A T I O N Oracle Warehouse Builder

19 Loading Gene Expression Data

20 Oracle Data Mining Integration* Design, deploy and use data mining models as part of ETL Mining operations appear as any other transform operation. Use other transform operators to help prepare mining data. Data in tables, queues, OLAP structures, flat files, etc. can all be mined. Enable batch and real-time usage of mining models

21 Data Profiling* Allow users to analyze data discover the structural content capture the semantics Identify anomalies and outliers Automatically derive business rules and maps to clean data Derive Quality Indicies (e.g. 6Σ) Auditors monitor quality on an ongoing basis Integrated as part of ETL Columns Pattern Format Format % Unique Compliant Fname A(30) First Name 95.20% Lname A(25) Last Name 93.45% Hdate YYYY-MM-DD Date 82% SSN 9(3)-9(2)-9(4) US Social Security Number 3% Phone 9(3)-9(3)-9(4) US Phone Number 16% Id 9(5) <Not Found> N/A Yes

22 Data Profiling*

23 Right-Time Data Warehousing* Trickle-feed Maps Maps as message listeners Oracle Streams, AQ s, etc. Change Data Capture Oracle and non-oracle sources Transportable Tablespaces Move large Data volumes quickly between warehouses/marts New Sources and Targets API s Table Functions

24 Enabling Business Intelligence Information Design Derivation BI Defs Preview Metadata Management Generation Deploy

25 Enabling Expertise Capture Data Expertise BI Defs Enabling Business Intelligence Information Enabling Quality Information

26 Expert Editor Re-use OWB Components to build your OWN application! Define best practises & Directed Guideance Run Standalone or within OWB Builder Declarative Definition & Guided execution E.g. Data-Mover Table-to-Table File-to-Table Stream-to-Table

27 D E M O N S T R A T I O N Prototype: Gene Expression Loader

28 More Information Take Warehouse Builder for a test drive! Hands-on workshop Thursday 24 June 08:45 Reston 2 - Oracle University Room 9

29 More Information Collateral Software Component Exchange Discussion forum SDK Customer Testimonials Partner Information

30 Q U E S T I O N S A N S W E R S

31