Oracle GoldenGate 11g Fundamentals for Oracle Student Guide D66519GC10 Edition 1.0 February 2011 D72291
Disclaimer This document contains proprietary information and is protected by copyright and other intellectual property laws. You may copy and print this document solely for your own use in an Oracle training course. The document may not be modified or altered in any way. Except where your use constitutes "fair use" under copyright law, you may not use, share, download, upload, copy, print, display, perform, reproduce, publish, license, post, transmit, or distribute this document in whole or in part without the express authorization of Oracle. The information contained in this document is subject to change without notice. If you find any problems in the document, please report them in writing to: Oracle University, 500 Oracle Parkway, Redwood Shores, California 94065 USA. This document is not warranted to be error-free. Restricted Rights Notice If this documentation is delivered to the United States Government or anyone using the documentation on behalf of the United States Government, the following notice is applicable: U.S. GOVERNMENT RIGHTS The U.S. Government s rights to use, modify, reproduce, release, perform, display, or disclose these training materials are restricted by the terms of the applicable Oracle license agreement and/or the applicable U.S. Government contract. Trademark Notice Oracle and Java are registered trademarks of Oracle and/or its affiliates. Other names may be trademarks of their respective owners. Author Karen Kehn Technical Contributors and Reviewers Glenn Goodrich, Eric Siglin, Sue Jang, Loren Penton, Randy Richeson, Heike Hundt, Viktor Tchemodanov, Joe Greenwald, Deirdre Matishak This book was published using: Oracle Tutor
Table of Contents Introduction to Oracle GoldenGate 11g: Fundamentals for Oracle...1-1 Introduction to Oracle GoldenGate 11g: Fundamentals for Oracle...1-2 Objectives...1-3 Oracle GoldenGate 11g...1-4 Key Capabilities and Technology Differentiators...1-5 Value Propositions for Oracle GoldenGate...1-6 Oracle GoldenGate Topologies...1-7 Oracle Middleware for Business Intelligence...1-8 Oracle Data Integrator EE and Oracle GoldenGate...1-9 Oracle GoldenGate for Real-Time Data Warehousing...1-10 Oracle GoldenGate Solutions for Oracle Database...1-11 Oracle GoldenGate for Oracle Database Eliminate Downtime for Migrations and Application Upgrades...1-12 Oracle GoldenGate for Oracle Database Eliminate Downtime During Oracle Database Upgrades...1-13 Oracle GoldenGate for Oracle Database Eliminate Unplanned Downtime with Active Data Guard and Oracle GoldenGate...1-14 Oracle GoldenGate for Oracle Database Improve Production System Performance and Lower Costs...1-15 Oracle GoldenGate for Operational Reporting...1-16 Oracle GoldenGate for Oracle Database Increase Return on Investment (ROI) on Existing Servers and Synchronize Global Data...1-17 Quiz...1-18 Summary...1-20 Technology Overview...2-1 Technology Overview...2-2 Objectives...2-3 Oracle GoldenGate: Modular Building Blocks...2-4 Supported Databases and Operating Systems...2-10 Oracle GoldenGate Product Line...2-11 Oracle GoldenGate Veridata...2-12 GoldenGate Director: Overview...2-13 Adapter Integration Options for Oracle GoldenGate...2-14 Oracle GoldenGate for Flat File...2-15 Oracle GoldenGate Application Adapter for Java...2-16 JMS Messaging Capture...2-17 Quiz...2-18 Summary...2-20 Oracle GoldenGate Architecture...3-1 Oracle GoldenGate Architecture...3-2 Objectives...3-3 Oracle GoldenGate Uses...3-4 Oracle GoldenGate Components...3-5 Oracle GoldenGate Logical Architecture...3-6 Oracle GoldenGate Process Groups...3-7 GGSCI...3-8 Parameter Files...3-9 Change Data Capture and Delivery...3-10 Change Data Capture and Delivery Using a Data Pump...3-11 Online Versus Batch Operation...3-12 i
Running an Initial Load...3-13 Initial Load...3-14 Checkpoints...3-15 Checkpointing...3-17 Commit Sequence Number (CSN)...3-18 Discussion Questions...3-19 Quiz...3-20 Summary...3-21 Installing Oracle GoldenGate...4-1 Installing Oracle GoldenGate...4-2 Objectives...4-3 System Requirements...4-4 Operating System Requirements...4-5 Downloading Oracle GoldenGate...4-8 Installation on UNIX, Linux, or z/os...4-9 Installation on Windows...4-10 GoldenGate Directories...4-11 Oracle GoldenGate Documentation...4-13 GGSCI Command Interface...4-14 GGSCI Commands...4-15 GGSCI Examples...4-19 OBEY Files...4-20 New Oracle GoldenGate 11gR1 GGSCI Miscellaneous Commands...4-21 Running GoldenGate from the OS Shell...4-22 Discussion Questions...4-23 Summary...4-24 Practices...4-25 Configuration Overview and Preparing the Environment...5-1 Configuration Overview and Preparing the Environment...5-2 Objectives...5-3 Configuring Oracle GoldenGate...5-4 Preparing the Environment: Oracle Database...5-6 TRANDATA Command...5-7 Preparing the Environment: Oracle Database...5-8 Preparing the Environment: Manager Overview...5-9 Preparing the Environment: Configuring Manager...5-10 Preparing the Environment: Sample Manager Parameter File...5-11 Preparing the Environment: Overview of Source Definitions...5-12 Preparing the Environment: Running DEFGEN...5-13 Quiz...5-14 Summary...5-16 Practices...5-17 Configuring Change Capture...6-1 Configuring Change Capture...6-2 Objectives...6-3 Step 2: Change Capture...6-4 Extract Overview...6-5 Data Pump Overview...6-6 Data Pumps: One-to-Many Trails...6-8 ii
Data Pumps: One-to-Many Target Systems...6-9 Setting Up Change Capture...6-10 ADD EXTRACT Command...6-11 ADD EXTRACT Examples...6-12 Editing Extract Parameters...6-13 Overview of Trails...6-14 Adding a Local or Remote Trail...6-15 Starting the Extract...6-16 Primary Extract Configuration for Oracle...6-17 Data Pump Configuration for Oracle...6-18 Automatic Storage Management (ASM)...6-19 Ensuring ASM Connectivity...6-20 Discussion Questions...6-21 Summary...6-23 Practice 6-1 Overview:...6-24 Configuring Initial Load...7-1 Configuring Initial Load...7-2 Objectives...7-3 Step 3. Initial Load...7-4 Initial Load: Advantages of GoldenGate Methods...7-5 Initial Load: Resource Limitations...7-6 Prerequisites for Initial Load...7-7 Initial Load: Oracle GoldenGate Methods...7-8 Initial Load: File to Replicat...7-9 Initial Load: File to Database Utility...7-10 Initial Load: Direct Load...7-11 Initial Load: Direct Bulk Load (to Oracle)...7-13 Discussion Questions...7-14 Summary...7-15 Practices...7-16 Configuring Change Delivery...8-1 Configuring Change Delivery...8-2 Objectives...8-3 Step 4. Change Delivery...8-4 Replicat Overview...8-5 Change Delivery Tasks...8-6 Sample Configuration...8-7 Avoiding Collisions with Initial Load...8-8 Handling Collisions with Initial Load...8-9 Discussion Questions...8-10 Summary...8-11 Practices...8-12 Extract Trail and Files...9-1 Extract Trail and Files...9-2 Objectives...9-3 Overview of Extract Trails and Files...9-4 Extract Trails and Files Distribution...9-5 Extract Trails and Files Contents...9-6 Extract Trails and Files Cleanup...9-7 iii
Trail Format...9-8 Record Header Area...9-9 Record Data Area...9-10 Setting the Compatibility Level...9-11 Alternative Trail Formats...9-12 FORMATASCII...9-13 FORMATASCII Sample Output...9-14 FORMATSQL...9-15 FORMATSQL Sample Output...9-16 FORMATXML...9-17 FORMATXML Sample Output...9-18 Logdump Utility...9-19 Opening a Trail...9-20 Setting up a View...9-21 Viewing the Trail File Header...9-22 Viewing Trail Records...9-23 Counting Records in the Trail...9-25 Filtering by a Filename...9-27 Locating a Hex Data Value...9-28 Saving Records to a New Trail...9-30 Keeping a Log of Your Session...9-31 Overview of the Reverse Utility...9-32 Overall Process of the Reverse Utility...9-33 Reverse: Overall Process...9-34 Sample Parameter Files...9-35 Discussion Questions...9-36 Summary...9-37 Practice...9-38 Oracle GoldenGate Parameters...10-1 Oracle GoldenGate Parameters...10-2 Objectives...10-3 Oracle GoldenGate Parameter Files...10-4 Using Parameter Files...10-5 GLOBALS Versus Process Parameters...10-6 GLOBALS Parameters...10-7 Manager Parameters: Overview...10-8 Sample Manager Parameter File...10-9 Manager Parameter Categories...10-10 Extract Parameter Overview...10-11 Extract Parameter Defaults...10-12 Sample Extract Parameter File...10-13 Extract Parameter Categories...10-14 Extract Example: TABLE Parameter...10-16 Extract Example: TRANLOGOPTIONS Parameter...10-17 Replicat Parameter Overview...10-19 Replicat Parameter Defaults...10-20 Sample Replicat Parameter File...10-21 Replicat Parameter Categories...10-22 Replicat Example: MAP Parameter...10-24 iv
Discussion Questions...10-26 Summary...10-27 Practices...10-28 Data Selection and Filtering...11-1 Data Selection and Filtering...11-2 Objectives...11-3 Overview of Data Mapping and Manipulation...11-4 Types of Definition Files...11-5 Data Selection: Overview...11-6 Data Selection: WHERE Clause...11-8 Data Selection: WHERE Clause Examples...11-10 Data Selection: FILTER Clause...11-11 Data Selection: FILTER Clause Examples...11-12 Data Selection: RANGE Function...11-13 Data Selection: RANGE Function Examples...11-14 Column Mapping: Overview...11-16 Column Mapping: Example...11-17 Column Mapping: Building History...11-18 Data Transformation Using Functions...11-19 Functions: Overview...11-20 Functions: Performing Tests on Column Values...11-21 @IF Function...11-22 Functions: Working with Dates...11-23 @DATE Function...11-24 Functions: Working with Strings and Numbers...11-25 @STRCAT Function...11-27 @STREXT Function...11-28 Other Functions...11-29 @RANGE Function...11-30 Overview of SQLEXEC...11-31 SQLEXEC: Basic Functionality...11-33 SQLEXEC: DBMS and Data Type Support...11-34 SQLEXEC: Using with a LOOKUP Stored Procedure...11-36 SQLEXEC: Using with a Lookup Stored Procedure...11-37 SQLEXEC: Using with a SQL Query...11-38 SQLEXEC: Using Within a TABLE or MAP Statement...11-39 SQLEXEC: Using as a Stand-Alone Statement...11-40 Quiz...11-41 Summary...11-43 Additional Transformation Topics...12-1 Additional Transformation Topics...12-2 Objectives...12-3 Overview of Macros...12-4 Creating Macros...12-5 Invoking a Macro...12-6 Reusing Parameter Sets...12-7 Creating Macro Libraries...12-9 Tracing Macro Expansion...12-10 Overview of User Tokens...12-11 v
Environmental Values Available to @GETENV...12-12 User Tokens Display...12-13 Using User Tokens...12-14 Viewing User Exits in Logdump...12-15 Overview of User Exits...12-16 Uses for User Exits...12-17 User Exits: High-Level Processing Logic...12-18 Implementing User Exits...12-19 User Exit Parameters...12-20 Sample User Exits...12-21 Calling User Exits...12-22 Overview of Oracle Sequences...12-23 Quiz...12-25 Summary...12-27 Practices...12-28 Configuration Options...13-1 Configuration Options...13-2 Objectives...13-3 Overview of BATCHSQL...13-4 BATCHSQL Syntax...13-5 BATCHSQL Results...13-7 Compression Options...13-8 Example of Compression...13-9 Encryption Overview...13-10 Message Encryption...13-12 Options: Message Encryption...13-14 Trail or Extract File Encryption...13-15 Password Encryption: Method 1...13-16 Password Encryption: Method 2...13-17 Summary of Password Encryption...13-18 Event Marker System...13-19 Uses for Event Actions...13-20 Event Actions Flowchart...13-21 Implementing Event Actions...13-22 Event Actions: Heartbeat Example...13-23 Event Actions: Automated Switchover Example...13-24 Event Actions: Automated Synchronization Example...13-25 Quiz...13-26 Summary...13-28 Practices...13-29 Bidirectional Replication...14-1 Bidirectional Replication...14-2 Objectives...14-3 Bidirectional Flowchart...14-4 Capabilities of a Bidirectional Configuration...14-5 Issues to Consider for a Bidirectional Configuration...14-6 Preventing Data Looping...14-7 Loop Detection Techniques...14-9 Conflict Avoidance and Detection...14-11 vi
Conflict Detection by Filter...14-12 Conflict Resolution...14-13 Conflict Resolution: Example...14-14 Conflict Resolution by Applying Net Differences...14-15 Oracle Sequence Numbers...14-16 Truncate Table Operations...14-17 Quiz...14-18 Summary...14-20 Practices...14-21 DDL Replication...15-1 DDL Replication...15-2 Objectives...15-3 Overview of DDL Replication...15-4 DDL Replication Requirements and Restrictions...15-5 Characteristics for DDL Replication...15-9 DDL Scopes...15-10 Using Unqualified Object Names...15-11 DDL Parameter...15-12 DDL String Substitution...15-14 Error Handling...15-15 DDLOPTIONS for Oracle...15-16 Mapping Schemas...15-18 Supporting DDL in an Active-Active Bidirectional Configuration...15-19 Activating Oracle DDL Capture...15-20 Quiz...15-22 Summary...15-24 Practices...15-25 Tuning and Troubleshooting...16-1 Tuning and Troubleshooting...16-2 Objectives...16-3 Using Command Security...16-4 Sample CMDSEC Statements...16-5 Managing Trail Files...16-6 Handling TCP/IP Errors...16-7 TCPERRS File...16-8 Troubleshooting Oracle GoldenGate...16-9 Monitoring Oracle GoldenGate Processing...16-10 Obtaining Process Information Through GGSCI...16-11 Using the Error Log...16-13 Process Reports...16-14 Sample Extract Process Report...16-15 Discard Files...16-16 Sample Discard File...16-17 Using the System Logs...16-18 Quiz...16-19 Summary...16-21 vii