Oracle Warehouse Builder 10g: Administration Volume I Student Guide D44810GC10 Edition 1.0 January 2007 D49160
Authors Puja Singh Richard Green Technical Contributors and Reviewers David Allan Sharath Bhujani Linda Bittarelli Barry Cook Jean-Pierre Dijcks Christoph Figgener Yu Gong Marco Harroun Wendy Lo Harry Penberthy Adrian Scott Geoff Watters James Womack Editors Daniel Milne Atanu Raychaudhuri Richard Wallis Copyright 2007, Oracle. All rights reserved. Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California 94065 USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle, TimesTen, JD Edwards, PeopleSoft, and Siebel are registered trademarks of Oracle Corporation and/or its affiliates. Other names may be trademarks of their respective owners. Graphic Designer Samir Mozumdar Publisher Veena Narasimhan
Contents Preface I Introduction Lesson Objectives I-2 Course Objectives I-3 Agenda: Day 1 I-4 Agenda: Day 2 I-5 Agenda: Day 3 I-6 Appendices I-7 Questions About You I-8 Summary I-9 1 Installing and Setting Up the Warehouse Builder Environment Objectives 1-2 What Is Oracle Warehouse Builder? 1-3 Producing Quality Information 1-4 Managing the Full Life Cycle of Metadata and Data 1-5 New Packaging of OWB Functionality 1-6 BI Environment from an OWB Perspective 1-8 Typical Flow of Design and Deployment 1-9 Role of a Warehouse Builder Administrator 1-11 Tasks Involved in Warehouse Builder Administration 1-12 Steps for Setting Up the Warehouse Builder Environment 1-13 Before Installing OWB: Verify the Installation Requirements 1-14 Environment Configuration Scenarios 1-15 Example of Basic Implementation: Stand-Alone Configuration 1-16 Prepare the Server Infrastructure: Supported Operating Systems 1-17 Prepare the Server Infrastructure: Oracle Database Support 1-18 Installing Optional Components 1-20 Installing Warehouse Builder 1-22 OWB Product Components 1-23 Warehouse Builder 10g R2 Repository 1-24 Job Functions of Repository Owners and Users 1-25 Creating a Warehouse Builder Repository 1-26 Using the Advanced Setup Option 1-27 iii
Managing Repository Owners 1-29 Managing Repository Users 1-31 Summary 1-32 Practice 1-1 Overview: Creating a Repository Owner and a Repository User 1-33 2 Getting Started with Warehouse Builder Objectives 2-2 Logging In to OWB Design Center 2-3 Design Center 2-4 Projects 2-5 Objects in a Project 2-6 Objects Within a Project 2-7 Locations, Connectors, and Control Centers 2-8 Global Explorer Objects 2-10 Deleting a Project 2-11 Setting Project Preferences 2-12 Scripting in Design Center 2-14 Launching OMB Plus from the Command Line 2-15 Managing Deployment with the Control Center Manager 2-16 Summary 2-17 Practice 2-1: Logging in to Warehouse Builder Design Center and Examining a Project 2-18 Practice 2-2: Invoking the Basic Tasks of Design and Deployment in Warehouse Builder Viewlet 2-19 3 Understanding the Warehouse Builder Architecture Objectives 3-2 Architecture for Design, Deployment, Execution 3-3 Scenarios for Implementing a Remote Run-Time 3-8 Configurations, Control Centers, Locations 3-10 Locations 3-12 Automatically Created Locations 3-13 Metadata and Data Locations 3-14 Registering Locations 3-15 Unregistering Locations 3-16 Alternatives for Unregistering Locations 3-17 Connectors 3-18 Control Centers 3-20 Control Center and Locations 3-22 Configurations 3-23 Multiple Named Configurations 3-24 iv
Configurations and Control Centers 3-25 Setting the Active Configuration 3-26 Assigning a Control Center to a Configuration 3-27 Creating Target Schemas 3-28 Registering Target Schemas 3-30 Using the Security Node to Register a Target User 3-31 Target Schema Location 3-32 Viewing the Target Schema Location 3-33 Roles and Privileges of Warehouse Builder Users 3-34 Registering an Oracle Workflow User 3-35 Associating Target Modules with Locations 3-36 Associating Target Modules with Locations: Step 1 3-37 Associating Target Modules with Locations: Step 2 3-38 Summary 3-39 Practice 3-1 Overview: Setting Up a Pre-Populated Project 3-40 4 Introducing Multi-Configuration Management Objectives 4-2 Scenario Requiring Multiple Configurations 4-3 Loose Coupling of Metadata with Physical Implementations 4-4 Each Configuration Records the Physical Settings of Its Target Environment 4-5 Multiple Named Configurations: Why and How 4-6 Deploying a Selected Configuration 4-7 Configurations, Control Centers, and Locations 4-8 Creating Additional Configurations and Control Centers 4-9 Setting the Active Configuration 4-10 Cloning a Database to Create Identical Dev-QA-Prod Systems 4-11 Installing OWB Configuration Experts to Manage Multiple Configurations 4-13 Expert for Configuring a Single Object Across All Configurations 4-14 Configure All Instances of a Type for the Current Configuration 4-15 Configure Properties by Object Type Across All Configurations 4-16 Configure by Property Value Across All Configurations 4-17 Showing all Properties for All Locations 4-18 Multi-Configuration Scenario for Practice 4-1 4-19 Summary 4-20 Practice 4-1 Overview: Managing Dev-QA-Production Scenario Using Multiple Configurations 4-21 Practice 4-2 Overview: Using Multi-Configuration Experts 4-22 v
5 Managing Backups, Metadata Changes, and Versioning Objectives 5-2 Metadata Loader Utilities (MDL) 5-3 Uses of Metadata Loader Utilities 5-4 Exporting Objects 5-5 Importing Objects 5-7 Accessing the MDL Utilities 5-8 Metadata Loader Log File 5-9 Importing Metadata from a Database Schema 5-10 Importing Metadata from Previous Versions 5-11 Managing Metadata Changes by Using Snapshots 5-12 Using Change Manager 5-13 Exporting and Importing Snapshots 5-14 Using Multiple Versions of a Single Design Repository 5-15 Version Management of Design Objects 5-16 Version Management: Using Generation Code Comments 5-18 Version Management: Using Annotations in Export/Import 5-19 Version Management: Using Collections and Snapshots to Version-Control 5-20 Summary 5-22 Practice 5-1 Overview: Managing Metadata Changes and Versioning Code and MDL Files 5-23 6 Managing Security and Metadata Objectives 6-2 Warehouse Builder Users 6-3 Warehouse Builder User Considerations 6-4 Global Explorer Objects 6-5 Graphical UI for Security Management 6-6 Access Privilege Policies 6-7 Registering Database Users as Warehouse Builder Users 6-8 User Tabs 6-9 ADMINISTRATOR Role Tabs 6-10 EVERYONE Role Tabs 6-11 Security Access Privileges 6-12 Data Security 6-13 Setting Security Parameters 6-14 Password Security Behaves Differently When Using Oracle Database Standard Edition 6-16 Repository Browser 6-17 Common Repository Browser Tasks 6-18 Starting OWB Browser Listener 6-19 vi
Logging In to Repository Browser 6-20 Browsing Design Repository Reports 6-21 Browsing Control Center Reports 6-22 Types of Control Center Reports 6-23 Object Summary Report 6-24 Execution Summary Report 6-25 Start, Abort, and Monitor a Process or a Mapping 6-26 Summary 6-27 Practice 6-1: Managing Security and Metadata 6-28 7 Enhancing ETL Performance Objectives 7-2 Revisit: Tasks Involved in Warehouse Builder Administration 7-3 Devise a Performance Strategy Early 7-4 Performance Tuning at Various Levels 7-5 ETL Design: Mappings 7-6 Performance-Related Parameters in ETL Design 7-7 Pros and Cons of Operating Modes 7-8 Configuring Mappings for Operating Modes 7-9 Commit Control 7-11 Setting Default Audit Level 7-12 Additional Run-Time Parameters for Mappings 7-13 Partition Exchange Loading (PEL) 7-14 PEL: Example 7-15 Guidelines for Partition Exchange Loading (PEL) 7-16 Enable Partition Exchange Loading (PEL) for Targets 7-17 Using Transportable Modules for Data Extraction from Remote Sources 7-19 Benefits of Using Transportable Modules 7-20 Using Transportable Modules 7-21 Creating Transportable Modules in Warehouse Builder 7-22 Best Practices Tips: ETL Design Factors That Impact Performance 7-23 Performance-Related Parameters in Schema Design 7-25 Benefits of Using Schema Design Capabilities in Warehouse Builder Design Center 7-26 Indexing 7-27 Configuring Properties of Indexes 7-29 Index Performance Considerations: Use the Correct Type 7-30 Index Performance Considerations: Drop Indexes Before the Load Process 7-31 Index Performance Considerations: Drop Indexes Before the Load Process (Example Mapping) 7-32 Constraints Management 7-33 vii
Configuring Constraints Individually 7-34 Partitions 7-36 Defining Partitions in Warehouse Builder 7-37 Parallelism 7-38 Enable Parallel DML 7-39 Setting Tablespaces Properties 7-40 Compression 7-41 Storage Space Parameters 7-42 Minimum Error Logging 7-43 Gathering Statistics 7-44 Analyze Table Statements Property 7-45 Gathering Schema Statistics 7-46 Database-Side Tuning 7-47 Resources on Database Performance Tuning 7-48 Summary 7-49 Practice 7-1 Overview: Configuring Performance Parameters for Mappings and Tables 7-50 8 Managing the Run-Time Environment Objectives 8-2 Deployment 8-3 Direct Deployment 8-4 Asynchronous Deployment and Execution 8-5 Deploy Options and Preferences 8-6 Deployment Preferences 8-7 Deployment Preferences: Control Center Monitors 8-8 Deployment Preferences: Process 8-9 Deployment Preferences: Tools 8-11 Deployment Specification: Saving the Generated Code as XML 8-12 Deployment Specification: Saving the Generated Code as.ddl or.pls 8-13 Execution Options 8-14 Run-Time Views and Utilities 8-16 Public Run-Time Views 8-17 Public Run-Time Utilities 8-18 Summary 8-22 Practice 8-1 Overview: Setting the Deployment Preferences 8-23 Practice 8-2 Overview: Using the Run-Time Views and Utilities 8-24 9 Using Diagnosis and Debugging Techniques Objectives 9-2 Mandatory Reading 9-3 viii
Collecting Information Before Contacting Oracle Support 9-4 Running the owbcollect.sql Script 9-5 Collecting Information Before Contacting Oracle Support 9-6 Sequence Used by Oracle Support Representatives to Process Calls 9-7 Timing Your Service Request 9-8 Activating Debugging and Logging for Full Java Debug Trace 9-9 Creating an owbenv.bat File 9-10 Activating Debugging and Tracing 9-12 Activating Debugging and Logging 9-13 Activating Tracing 9-14 Using the service_doctor.sql Script 9-15 Using SQL*Plus Scripts to Test Availability of the Control Center Service 9-16 Killing a Job If a Mapping Hangs 9-17 Troubleshooting Heterogeneous Sources and Targets 9-18 Encouraging Designers to Use the Mapping Debugger 9-19 Setting Breakpoints and Watch Points 9-20 Stepping Through Rows of Test Data to Identify Mapping Problems 9-21 Online Warehouse Builder Resources 9-22 Summary 9-23 Practice 9-1 Overview: Diagnosing and Debugging 9-24 10 Migrating to Oracle Warehouse Builder 10g R2 Objectives 10-2 Migrating from Previous Versions to Warehouse Builder 10g Release 2 10-3 Migration Path to Warehouse Builder 10g R 2 10-4 Migrating from Warehouse Builder 10g R1 to Warehouse Builder 10g R2: Scenario 10-5 Upgrading the Database 10-6 Steps in the Migration Process 10-7 Migrating the Design Metadata 10-8 Importing Metadata from Previous Versions 10-9 Changes to Repository Objects After Upgrading 10-10 Migrating the Run-Time Metadata 10-11 Using the Control Center Upgrade Assistant 10-12 Post-Migration Tasks 10-13 Patching Warehouse Builder 10-14 Summary 10-15 Practice 10-1 Overview: Migrating to Warehouse Builder 10g R2 10-16 ix
11 Configuring Warehouse Builder in RAC Environments Objectives 11-2 Scope of RAC Discussed in This Lesson 11-3 Clusters 11-4 Oracle Real Application Clusters (RAC) 11-5 Benefits of RAC 11-6 OWB Certification on RAC 11-7 Typical Connect Failover Scenarios 11-8 Control Center Service Failover on RAC 11-9 Supported and Unsupported RAC Features 11-10 Lesson Progress Report 11-11 Single Shared Disk vs. Local Disk Per Node 11-12 Extra Tasks Required of Non-Shared Local Disk Environments 11-13 Lesson Progress Report 11-14 Installing OWB on Real Application Clusters 11-15 OWB Installation Decisions for RAC 11-16 Installing OWB with Oracle Universal Installer 11-17 Specifying Oracle Home for All Nodes 11-18 Selecting Cluster or Local Installation 11-19 Selecting Cluster Installation 11-20 Installing to the Same Path on All Nodes 11-21 Installation Includes Copying to Remote Nodes 11-22 Executing root.sh Configuration Script in Each Cluster Node 11-23 Lesson Progress Report 11-24 Installing the Repository to One Node and Registering It to Other Nodes 11-25 Installing the OWB Repository with the Repository Assistant 11-26 Connection Information for the Node 11-27 Finishing Installation of the Repository to a Node 11-28 Rerunning the Repository Assistant to Register the Repository on All Other Nodes 11-29 Finishing OWB Repository Registration 11-30 Only One Database Parameter Specifically Recommended for RAC 11-31 Need to Replicate rtrepos.properties to All Nodes 11-32 Moving a Copy of rtrepos.properties to Each Node 11-33 OWB RAC Locations Use Net Service Names 11-34 Sample TNSNAMES.ORA File 11-35 RAC Deployment 11-36 RAC Deployment: Alternate Node 11-37 Lesson Progress Report 11-38 Logging In to OWB Browser 11-39 x
Select the Service Node Report 11-40 Service Node Report Shows the Status of Nodes 11-41 Disabling a Node 11-42 Enabling a Node 11-43 Lesson Progress Report 11-44 Useful Diagnostics for OWB RAC Problems 11-45 Using SQL*Plus Scripts to Test Availability of Control Center Service 11-46 Result of Not Replicating rtrepos.properties to a Node 11-47 Using OWB With or Without a Control Center Service 11-48 Further Study of RAC 11-49 Summary 11-50 Appendix A: Practices Appendix B: Practice Solutions Appendix C: Introduction to Data Warehousing Fundamentals xi