Oracle GoldenGate 11g Fundamentals for Oracle

Transcription

1 Oracle GoldenGate 11g Fundamentals for Oracle Student Guide D66519GC10 Edition 1.0 February 2011 D72291

2 Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Author Karen Kehn Technical Contributors and Reviewers Glenn Goodrich, Eric Siglin, Sue Jang, Loren Penton, Randy Richeson, Heike Hundt, Viktor Tchemodanov, Joe Greenwald, Deirdre Matishak This book was published using: Oracle Tutor

3 Table of Contents Introduction to Oracle GoldenGate 11g: Fundamentals for Oracle Introduction to Oracle GoldenGate 11g: Fundamentals for Oracle Objectives Oracle GoldenGate 11g Key Capabilities and Technology Differentiators Value Propositions for Oracle GoldenGate Oracle GoldenGate Topologies Oracle Middleware for Business Intelligence Oracle Data Integrator EE and Oracle GoldenGate Oracle GoldenGate for Real-Time Data Warehousing Oracle GoldenGate Solutions for Oracle Database Oracle GoldenGate for Oracle Database Eliminate Downtime for Migrations and Application Upgrades Oracle GoldenGate for Oracle Database Eliminate Downtime During Oracle Database Upgrades Oracle GoldenGate for Oracle Database Eliminate Unplanned Downtime with Active Data Guard and Oracle GoldenGate Oracle GoldenGate for Oracle Database Improve Production System Performance and Lower Costs Oracle GoldenGate for Operational Reporting Oracle GoldenGate for Oracle Database Increase Return on Investment (ROI) on Existing Servers and Synchronize Global Data Quiz Summary Technology Overview Technology Overview Objectives Oracle GoldenGate: Modular Building Blocks Supported Databases and Operating Systems Oracle GoldenGate Product Line Oracle GoldenGate Veridata GoldenGate Director: Overview Adapter Integration Options for Oracle GoldenGate Oracle GoldenGate for Flat File Oracle GoldenGate Application Adapter for Java JMS Messaging Capture Quiz Summary Oracle GoldenGate Architecture Oracle GoldenGate Architecture Objectives Oracle GoldenGate Uses Oracle GoldenGate Components Oracle GoldenGate Logical Architecture Oracle GoldenGate Process Groups GGSCI Parameter Files Change Data Capture and Delivery Change Data Capture and Delivery Using a Data Pump Online Versus Batch Operation i

4 Running an Initial Load Initial Load Checkpoints Checkpointing Commit Sequence Number (CSN) Discussion Questions Quiz Summary Installing Oracle GoldenGate Installing Oracle GoldenGate Objectives System Requirements Operating System Requirements Downloading Oracle GoldenGate Installation on UNIX, Linux, or z/os Installation on Windows GoldenGate Directories Oracle GoldenGate Documentation GGSCI Command Interface GGSCI Commands GGSCI Examples OBEY Files New Oracle GoldenGate 11gR1 GGSCI Miscellaneous Commands Running GoldenGate from the OS Shell Discussion Questions Summary Practices Configuration Overview and Preparing the Environment Configuration Overview and Preparing the Environment Objectives Configuring Oracle GoldenGate Preparing the Environment: Oracle Database TRANDATA Command Preparing the Environment: Oracle Database Preparing the Environment: Manager Overview Preparing the Environment: Configuring Manager Preparing the Environment: Sample Manager Parameter File Preparing the Environment: Overview of Source Definitions Preparing the Environment: Running DEFGEN Quiz Summary Practices Configuring Change Capture Configuring Change Capture Objectives Step 2: Change Capture Extract Overview Data Pump Overview Data Pumps: One-to-Many Trails ii

5 Data Pumps: One-to-Many Target Systems Setting Up Change Capture ADD EXTRACT Command ADD EXTRACT Examples Editing Extract Parameters Overview of Trails Adding a Local or Remote Trail Starting the Extract Primary Extract Configuration for Oracle Data Pump Configuration for Oracle Automatic Storage Management (ASM) Ensuring ASM Connectivity Discussion Questions Summary Practice 6-1 Overview: Configuring Initial Load Configuring Initial Load Objectives Step 3. Initial Load Initial Load: Advantages of GoldenGate Methods Initial Load: Resource Limitations Prerequisites for Initial Load Initial Load: Oracle GoldenGate Methods Initial Load: File to Replicat Initial Load: File to Database Utility Initial Load: Direct Load Initial Load: Direct Bulk Load (to Oracle) Discussion Questions Summary Practices Configuring Change Delivery Configuring Change Delivery Objectives Step 4. Change Delivery Replicat Overview Change Delivery Tasks Sample Configuration Avoiding Collisions with Initial Load Handling Collisions with Initial Load Discussion Questions Summary Practices Extract Trail and Files Extract Trail and Files Objectives Overview of Extract Trails and Files Extract Trails and Files Distribution Extract Trails and Files Contents Extract Trails and Files Cleanup iii

6 Trail Format Record Header Area Record Data Area Setting the Compatibility Level Alternative Trail Formats FORMATASCII FORMATASCII Sample Output FORMATSQL FORMATSQL Sample Output FORMATXML FORMATXML Sample Output Logdump Utility Opening a Trail Setting up a View Viewing the Trail File Header Viewing Trail Records Counting Records in the Trail Filtering by a Filename Locating a Hex Data Value Saving Records to a New Trail Keeping a Log of Your Session Overview of the Reverse Utility Overall Process of the Reverse Utility Reverse: Overall Process Sample Parameter Files Discussion Questions Summary Practice Oracle GoldenGate Parameters Oracle GoldenGate Parameters Objectives Oracle GoldenGate Parameter Files Using Parameter Files GLOBALS Versus Process Parameters GLOBALS Parameters Manager Parameters: Overview Sample Manager Parameter File Manager Parameter Categories Extract Parameter Overview Extract Parameter Defaults Sample Extract Parameter File Extract Parameter Categories Extract Example: TABLE Parameter Extract Example: TRANLOGOPTIONS Parameter Replicat Parameter Overview Replicat Parameter Defaults Sample Replicat Parameter File Replicat Parameter Categories Replicat Example: MAP Parameter iv

7 Discussion Questions Summary Practices Data Selection and Filtering Data Selection and Filtering Objectives Overview of Data Mapping and Manipulation Types of Definition Files Data Selection: Overview Data Selection: WHERE Clause Data Selection: WHERE Clause Examples Data Selection: FILTER Clause Data Selection: FILTER Clause Examples Data Selection: RANGE Function Data Selection: RANGE Function Examples Column Mapping: Overview Column Mapping: Example Column Mapping: Building History Data Transformation Using Functions Functions: Overview Functions: Performing Tests on Column Function Functions: Working with Function Functions: Working with Strings and Function Other Function Overview of SQLEXEC SQLEXEC: Basic Functionality SQLEXEC: DBMS and Data Type Support SQLEXEC: Using with a LOOKUP Stored Procedure SQLEXEC: Using with a Lookup Stored Procedure SQLEXEC: Using with a SQL Query SQLEXEC: Using Within a TABLE or MAP Statement SQLEXEC: Using as a Stand-Alone Statement Quiz Summary Additional Transformation Topics Additional Transformation Topics Objectives Overview of Macros Creating Macros Invoking a Macro Reusing Parameter Sets Creating Macro Libraries Tracing Macro Expansion Overview of User Tokens v

8 Environmental Values Available User Tokens Display Using User Tokens Viewing User Exits in Logdump Overview of User Exits Uses for User Exits User Exits: High-Level Processing Logic Implementing User Exits User Exit Parameters Sample User Exits Calling User Exits Overview of Oracle Sequences Quiz Summary Practices Configuration Options Configuration Options Objectives Overview of BATCHSQL BATCHSQL Syntax BATCHSQL Results Compression Options Example of Compression Encryption Overview Message Encryption Options: Message Encryption Trail or Extract File Encryption Password Encryption: Method Password Encryption: Method Summary of Password Encryption Event Marker System Uses for Event Actions Event Actions Flowchart Implementing Event Actions Event Actions: Heartbeat Example Event Actions: Automated Switchover Example Event Actions: Automated Synchronization Example Quiz Summary Practices Bidirectional Replication Bidirectional Replication Objectives Bidirectional Flowchart Capabilities of a Bidirectional Configuration Issues to Consider for a Bidirectional Configuration Preventing Data Looping Loop Detection Techniques Conflict Avoidance and Detection vi

9 Conflict Detection by Filter Conflict Resolution Conflict Resolution: Example Conflict Resolution by Applying Net Differences Oracle Sequence Numbers Truncate Table Operations Quiz Summary Practices DDL Replication DDL Replication Objectives Overview of DDL Replication DDL Replication Requirements and Restrictions Characteristics for DDL Replication DDL Scopes Using Unqualified Object Names DDL Parameter DDL String Substitution Error Handling DDLOPTIONS for Oracle Mapping Schemas Supporting DDL in an Active-Active Bidirectional Configuration Activating Oracle DDL Capture Quiz Summary Practices Tuning and Troubleshooting Tuning and Troubleshooting Objectives Using Command Security Sample CMDSEC Statements Managing Trail Files Handling TCP/IP Errors TCPERRS File Troubleshooting Oracle GoldenGate Monitoring Oracle GoldenGate Processing Obtaining Process Information Through GGSCI Using the Error Log Process Reports Sample Extract Process Report Discard Files Sample Discard File Using the System Logs Quiz Summary vii

10