Deploy Oracle GoldenGate Veridata Version 3.0 for comparison between Oracle RDBMS databases replicated using OGG 11gR2

Transcription

1 Deploy Oracle GoldenGate Veridata Version 3.0 for comparison between Oracle RDBMS databases replicated using OGG 11gR2 In the article you will have a look at the steps to install, configure and deploy OGG Veridata 3.0 for data comparison between two Oracle 11gR2 databases configured with OGG 11gR2 for data replication. The OGG 11gR2 setup that will be used for replication and subsequent verification with Veridata comparison is described here. The article will briefly cover the following topics 1. Brief overview of OGG Veridata concepts and architecture 2. OGG Veridata Server and OGG Veridata Web installation and management 3. OGG Veridata Agent for Oracle installation 4. Example of using OGG Veridata for comparison between running Oracle databases in active-active OGG 11gR2 configuration 5. Using OGG vericom For OGG Veridata deployment the following software will be used in addition to the OGG 11gR2 replication already running. 1. OGG Veridata server download V zip, present at the time the article is posted, from edeliver.oracle.com 2. OGG Veridata Oracle agent download V zip, present at the time the article is posted, from edelivery.oracle.com OGG Veridata is a data comparison tool part of the OGG product family that takes into account data that is replicated by OGG 11gR2 and provides very accurate results while the following activities occur simultaneously Application access database OGG 11gR2 synchronization is working For the GUI to launch successfully as root execute xhost + 1. Overview of OGG Veridata concepts and architecture OGG Veridata consists of the following components and uses a highly accurate two pass algorithm for performing data comparisons.

2 The OGG Veridata Server installs everything except the agents which are installed separately. In the article RACD database will be used for a repository database. An agent should be installed for each Oracle database in the OGG 11gR2 configuration. Each component should be installed in a separate directory not overlapping the other installations. 2. OGG Veridata Server and OGG Veridata Web installation and management Download, unzip OGG Veridata Server and start the installer. [oracle@raclinux1 ogg_veridata]$ ls -l total rwxrwxrwx 1 root root Nov 17 14:45 Veridata_agent_for_ora11g_V zip -rwxrwxrwx 1 root root Nov 17 14:45 Veridata_doc_V zip -rwxrwxrwx 1 root root Nov 17 14:45 Veridata_server_V zip [oracle@raclinux1 ogg_veridata]$ [oracle@raclinux1 ogg_veridata]$ unzip -o Veridata_server_V zip Archive: Veridata_server_V zip inflating: GoldenGate_Veridata_redhatAS40_x64.sh inflating: OGG_Veridata_Rel_Notes_ pdf inflating: README.txt [oracle@raclinux1 ogg_veridata]$ [oracle@raclinux1 ogg_veridata]$./goldengate_veridata_redhatas40_x64.sh Unpacking JRE... Preparing JRE... Starting Installer... Click Next to start the installation.

3 Specify the OGG Veridata directory

4 Specify location for the data. Specify ports.

5 Specify OGG Veridata Web Admin user credentials.

6 Specify repository type. Confirm Oracle home.

7 Specify database connection information.

8 Specify Create a new user ID. Enter a privileged user

9 Enter user credentials for the repository owner.

10 Provide the tablespace details for the repository owner. Specify OGG Veridata listening port.

11 You can select the option to start OGG Veridata Server and OGG Veridata Web. If you do not specify it you can start it later on.

12 Examine the summary and start the installation. Wait for the installation to complete.

13 Upon successful installation exit the installer. This concludes the OGG Veridata installation. Managing OGG Veridata Server, starting and stopping, is done using the veridata_server.sh in the following location $OGG_VER/server/bin where $OGG_VER is the install location specified earlier. In my case it is shown below. /u02/ogg_veridata/oracle_goldengate_veridata/server/bin bin]$ ls ggmessage.dat libicudata.so.38 libnnz10.so libstd4112d.so mysql.txt libbigsort.so libicui18n.so.38 libnsort.so libsync2412d.so vericom libclntsh.so.10.1 libicuuc.so.38 libocci.so.10.1 libthread2412d.so veridata libdbt6312d.so libitc2312d.so liboci6312d.so libthrexcept2312d.so veridata.loc libfunctor2312d.so libmys6312d.so libociei.so libtls71012d.so veridata.log libfunctor_list2312d.so libmysql.so.16 libpointer2512d.so libtrace2312d.so veridata_server.sh bin]$./veridata_server.sh Usage: veridata_server.sh start run stop cli [options] bin]$./veridata_server.sh start bin]$

14 Managing OGG Veridata Web, starting and stopping, is done using the veridata_web.sh in the following location $OGG_VER/web/bin where $OGG_VER is the install location specified earlier. In my case it is shown below. bin]$ pwd /u02/ogg_veridata/oracle_goldengate_veridata/web/bin bin]$ ls *.sh catalina.sh digest.sh setclasspath.sh shutdown.sh startup.sh tool-wrapper.sh veridata_web.sh version.sh bin]$./veridata_web.sh Usage: veridata_web.sh start run stop bin]$./veridata_web.sh start CATALINA_HOME: /u02/ogg_veridata/oracle_goldengate_veridata/web JRE_HOME: /u02/ogg_veridata/oracle_goldengate_veridata/jre JAVA_OPTS: -Xmx512m -Djava.awt.headless=true - Dveridata.log.dir=/u02/ogg_veridata/Oracle_GoldenGate_Veridata/shared/logs Using CATALINA_BASE: /u02/ogg_veridata/oracle_goldengate_veridata/web Using CATALINA_HOME: /u02/ogg_veridata/oracle_goldengate_veridata/web Using CATALINA_TMPDIR: /u02/ogg_veridata/oracle_goldengate_veridata/web/temp Using JRE_HOME: /u02/ogg_veridata/oracle_goldengate_veridata/jre Using CLASSPATH: /u02/ogg_veridata/oracle_goldengate_veridata/web/bin/bootstrap.jar [oracle@raclinux1 bin]$ pwd /u02/ogg_veridata/oracle_goldengate_veridata/web/bin [oracle@raclinux1 bin]$ Verifying OGG Veridata Server and OGG Veridata Web Verify tomcat at

15 Verify OGG Veridata Web at

16

17 3. OGG Veridata Agent for Oracle installation Download and unzip the agent into a separate directory from the existing OGG installation. Install one agent per Oracle database. I am showing one installation, but for the RACD and RACDB databases there should be two agents installed, configured and running. After installing the agent software configure a manager parameter file and start the manager. [oracle@raclinux1 ogg_veridata]$ unzip -o Veridata_agent_for_ora11g_V zip Archive: Veridata_agent_for_ora11g_V zip inflating: ggs_veridataagent_redhatas40_x64_ora11g_64bit.tar inflating: OGG_Veridata_Rel_Notes_ pdf inflating: README.txt [oracle@raclinux1 ogg_veridata]$ tar -xvf ggs_veridataagent_redhatas40_x64_ora11g_64bit.tar veridata/ veridata/agent/ veridata/agent/veriagt veridata/agent/ggmessage.dat veridata/agent/notices.txt veridata/agent/help.txt veridata/agent/ggsci veridata/agent/libicudata.so.38 veridata/agent/libicuuc.so.38 veridata/agent/mgr veridata/agent/libicui18n.so.38 veridata/agent/bcrypt.txt veridata/agent/zlib.txt veridata/agent/tcperrs veridata/agent/libxml2.txt veridata/agent/freebsd.txt [oracle@raclinux1 ogg_veridata]$ [oracle@raclinux1 agent]$./ggsci Oracle GoldenGate Command Interpreter for Oracle Version _ OGGVDT_ _PLATFORMS_ Linux, x64, 64bit (optimized), Oracle 11g on Jun :30:24 Copyright (C) 1995, 2012, Oracle and/or its affiliates. All rights reserved. GGSCI (raclinux1.gj.com) 1> CREATE SUBDIRS Creating subdirectories under current directory /u02/ogg_veridata/veridata/agent Parameter files /u02/ogg_veridata/veridata/agent/dirprm: created Report files /u02/ogg_veridata/veridata/agent/dirrpt: created Checkpoint files /u02/ogg_veridata/veridata/agent/dirchk: created Process status files /u02/ogg_veridata/veridata/agent/dirpcs: created SQL script files /u02/ogg_veridata/veridata/agent/dirsql: created Database definitions files /u02/ogg_veridata/veridata/agent/dirdef: created Extract data files /u02/ogg_veridata/veridata/agent/dirdat: created Temporary files /u02/ogg_veridata/veridata/agent/dirtmp: created Veridata files /u02/ogg_veridata/veridata/agent/dirver: created Veridata Lock files /u02/ogg_veridata/veridata/agent/dirver/lock: created Veridata Out-Of-Sync files /u02/ogg_veridata/veridata/agent/dirver/oos: created Veridata Out-Of-Sync XML files /u02/ogg_veridata/veridata/agent/dirver/oosxml: created Veridata Parameter files /u02/ogg_veridata/veridata/agent/dirver/params: created Veridata Report files /u02/ogg_veridata/veridata/agent/dirver/report: created Veridata Status files /u02/ogg_veridata/veridata/agent/dirver/status: created Veridata Trace files /u02/ogg_veridata/veridata/agent/dirver/trace: created

18 Stdout files /u02/ogg_veridata/veridata/agent/dirout: created GGSCI (raclinux1.gj.com) 2> :54:41 GGS ERROR 150 Address already in use. GGSCI (raclinux1.gj.com) 9> edit param mgr GGSCI (raclinux1.gj.com) 10> start mgr Manager started. GGSCI (raclinux1.gj.com) 11> info mgr Manager is running (IP port raclinux1.gj.com.7500). GGSCI (raclinux1.gj.com) 12> view param mgr port 7500 GGSCI (raclinux1.gj.com) 13> 4. Using OGG Veridata for comparison between running Oracle databases in active-actve OGG 11gR2 configuration After the OGG Veridata Server and OGG Veridata WEB are running the following objects need to be configured from the OGG Veridata Web 1. Connection specify how OGG Veridata Server connects to an agent that connects to an Oracle database. 2. Group a logical container of object to be compared from a source and target database along with connections to the databases 3. Compare pairs - set of corresponding source and target tables 4. Profiles Sets of run time parameters. Profiles are optional as there is a default profile 5. Job contains Groups. Job is associated with a comparison. After a job is run the result of the comparison become available. I am going to use OGG Veridata to compare the test5 schema from RACD with test5 schema RACDB in the active-active bidirectional configuration described here. The following tables will be compared in order to verify data replication. RACD RACDB Pair1 test5.seat_assignment test5.seat_assignment Pair2 test5.account test5.account

19 Configuring connections I configured connection RACD as follows I configured connection RACDB as follows. Note that you should create two agents. I am sharing the same agent as source and target are on the same host.

20 Configuring Groups Start by clicking New

21 Specify a Group Name

22 Specify Connections and press Finish.

23 The group will be created as follows. Create Compare pairs

24 Specify Compare pairs by going into the Manual Mapping tab of the Compare Pairs section of the Group link. Associate the compare pair with a group. The group will be as follows.

25 Create a Job Navigate starting from Job Configuration and press New.

26 Enter Name and press Next. Link compare groups.

27 Add connections

28 Let the system pick up the default profile.

29 Press OK.

30 A job will be created.

31 The job is ready to be run. Navigate from Run Execute Job and select the Job name. Press the run button

32 Wait for the comparison to complete. Look at the finished Jobs for a pie chart reporting the possible findings from the execution of the job. Here all records are In-Sync.

33 Clicking the Report under the report header will give you a detail report. Look at the Appendix for more detail description. You can get detail information by drilling into the compare pair details as follows. 6. OGG Veridata vericom You can use OGG Veridata vericom utility. It has limited functionality such as start a job or shutdown the server.

34 bin]$ /u02/ogg_veridata/oracle_goldengate_veridata/server/bin/vericom - help Usage: vericom -shutdown { -job -j } <job> Where: -shutdown -help { -version -v} -helprun run_flags [ [ { -url -u } <url> ] [ { -password -p } <password> ] ] Shutdown the server { -job -j } <job> -help Run job <job> Print usage. -version, -v Print version. { -url -u } <url> Required if veridata.loc, or veridata.cfg are not in the current working directory, or if you do not have read permission on them. { -password -p } <password> -helprun run_flags Required if password.txt or veridata.loc, or veridata.cfg are not in the current working directory, or if you do not have read permission on them. Print usage of run_flags Flags for running a job or compare pair [oracle@raclinux1 bin]$ For example to run the same job execute the following command

35 bin]$./vericom -job test5 Connecting to: localhost:4150 Run ID: (1009, 0, 0) bin]$ Summary In the article you looked at the steps to install and configure OGG Veridata components. You performed data comparisons using the OGG Veridata. Appendix Detail Reports === *********************************************************************** Oracle GoldenGate Veridata Server Version OGGVDT_ _PLATFORMS_ Copyright (C) 2004, 2012, Oracle and/or its affiliates. All rights reserved. Starting at :32:11 *********************************************************************** Cannot determine the OS version. Process id: 26895, Thread id : Run ID: (runid=(1005, 1, 1)) Compare Parameters:

36 Source connection: RACD Source host: raclinux1 (oracle) Target connection: RACDB Target host: raclinux1 (oracle) Source table: TEST5.ACCOUNT Target table: TEST5.ACCOUNT Profile: $default General: *********************************************************************** Out-Of-Sync Output Format: binary Maximum Size of Each Out-Of-Sync XML Chunk (Rows): 500 Output in-sync rows to OOS file: false Output in-sync after in-flight rows to OOS file: true Report in-sync rows to report file: false Report in-sync after in-flight rows to report file: false Sorting Method: Sort Data Using: database Maximum Memory Usage (MB): 50 Number Of Concurrent Threads: 4 Temporary Storage Directory

37 for Source Data: Temporary Storage Directory for Target Data: NSort Memory Retry Limit: 0 NSort Memory Retry Wait Interval: 0 Initial Compare (General): *********************************************************************** Max Concurrent Comparison Threads: 4 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every Threads: 0 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every (records): 0 Limit Number of Input Rows: 0 Delta processsing enabled: false Initial Compare (Event Reporting): *********************************************************************** Generate Messages: none

38 Generate Warning Messages For Out-Of-Sync Rows After (differences): 50 Initial Compare (Agent): *********************************************************************** Use Static Listening Port For For Agent During Row Hash On Source: 0 Use Static Listening Port For For Agent During Row Hash On Target: 0 Initial Compare (NonStop Process): *********************************************************************** Source Process Name Starting With: Source Process CPU Number: -1 Source Process Priority: 0 Target Process Name Starting With: Target Process CPU Number: -1 Target Process Priority: 0 Confirm-Out-Of-Sync (General): *********************************************************************** Perform Confirm Out-Of-Sync Step: true Run Concurrently With Initial Compare: true Delay Confirm-Out-Of-Sync By (seconds): 0

39 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every (records): 0 Confirm-Out-Of-Sync (Event Reporting): *********************************************************************** Generate Messages: none Generate Warning Messages For For Out-Of-Sync Rows After (differences): 50 Confirm-Out-Of-Sync (Agent): *********************************************************************** Use Static Listening Port For Agent During Row Hash On Source: 0 Use Static Listening Port For Agent During Row Hash On Target: 0 Confirm-Out-Of-Sync (NonStop Process): *********************************************************************** Source Process Name Starting With: Source Process CPU Number: -1 Source Process Priority: 0 Target Process Name Starting

40 With: Target Process CPU Number: -1 Target Process Priority: 0 Starting Veriagt session for source rowhash at :32:11. Initial Compare Source Agent Information: NLS_LANG (from environment) : ORACLE_HOME : /u01/app/oracle/product/11.2.0/db_3 ORA_SDTZ : NLS_LANG (from DBMS) : AMERICAN_AMERICA.AL32UTF8 NLS_LENGTH_SEMANTICS : BYTE SESSIONTIMEZONE : +02:00 Process ID : Operating System : Linux Architecture : x86_64 Report File : /u02/ogg_veridata/veridata/agent/dirver/report/raclinux1_gj_com_4150_ source_rh.rpt Trace File : /u02/ogg_veridata/veridata/agent/dirver/trace/raclinux1_gj_com_4150_ source_rh.trc Starting Veriagt session for target rowhash at :32:13. Initial Compare Target Agent Information: ORACLE_HOME : /u01/app/oracle/product/11.2.0/db_3 NLS_LANG (from environment) : ORA_SDTZ : NLS_LANG (from DBMS) : AMERICAN_AMERICA.AL32UTF8 NLS_LENGTH_SEMANTICS : BYTE SESSIONTIMEZONE : +02:00 Process ID : 28717

41 Operating System : Linux Architecture : x86_64 Report File : /u02/ogg_veridata/veridata/agent/dirver/report/raclinux1_gj_com_4150_ target_rh.rpt Trace File : /u02/ogg_veridata/veridata/agent/dirver/trace/raclinux1_gj_com_4150_ target_rh.trc Processing first rowhash block from target at :32:42. Processing first rowhash block from source at :32:42. Comparing first row at :32:42. *** Summarizing Initial Row Comparison Step *** Time: :32:42. Elapsed Time: 00:00:00 Comparisons performed: 2 Rows per second: 1000 Rows out-of-sync: 0 inserts: 0 updates: 0 deletes: 0 Performance Statistics for source Rowhash at :32:42. rows: 2 duration (secs): 00:00:31 rows/sec: 0.06 row bytes: 130

42 row bytes/sec: 4 bytes/row: 65 rh bytes/row: 19 rows skipped: 0 blocks skipped: 0 hash comp rate: 0.29 total comp rate: 0.12 pct time fetching: 0.00 pct time waiting: 0.19 time until first row: 00:00:00 ipc msgs: 7 ipc bytes: 2769 bytes/msg: 395 compressed bytes/msg: 162 bytes/sec: 89 compressed bytes/sec: 36 msg compression ratio: 0.41 *** Summarizing Confirm Out-of-Sync Step *** Time: :32:42. Elapsed Time: 00:00:00 Rows confirmed: 0 Rows per second: 0 *** Summarizing Persistently Out-of-Sync Rows *** Rows out-of-sync: 0 inserts: 0

43 updates: 0 deletes: 0 *** Summarizing In-Sync-after-In-Flight Rows *** Rows in-sync-after-in-flight: 0 inserts: 0 updates: 0 deletes: 0 *** Summarizing Still-Changing Rows *** Rows in-flight: 0 inserts: 0 updates: 0 deletes: 0 Performance Statistics for target Rowhash at :32:42. rows: 2 duration (secs): 00:00:27 rows/sec: 0.07 row bytes: 130 row bytes/sec: 4 bytes/row: 65 rh bytes/row: 19 rows skipped: 0 blocks skipped: 0

44 hash comp rate: 0.29 total comp rate: 0.12 pct time fetching: 0.00 pct time waiting: 0.22 time until first row: 00:00:00 ipc msgs: 7 ipc bytes: 2769 bytes/msg: 395 compressed bytes/msg: 162 bytes/sec: 102 compressed bytes/sec: 42 msg compression ratio: 0.41 Comparison terminated normally == ********************************************************************** Oracle GoldenGate Veridata Server Version OGGVDT_ _PLATFORMS_ Copyright (C) 2004, 2012, Oracle and/or its affiliates. All rights reserved. Starting at :32:11 *********************************************************************** Cannot determine the OS version. Process id: 26895, Thread id :

45 Run ID: (runid=(1005, 1, 2)) Compare Parameters: Source connection: RACD Source host: raclinux1 (oracle) Target connection: RACDB Target host: raclinux1 (oracle) Source table: TEST5.SEAT_ASSIGNMENT Target table: TEST5.SEAT_ASSIGNMENT Profile: $default General: *********************************************************************** Out-Of-Sync Output Format: binary Maximum Size of Each Out-Of-Sync XML Chunk (Rows): 500 Output in-sync rows to OOS file: false Output in-sync after in-flight rows to OOS file: true Report in-sync rows to report file: false Report in-sync after in-flight rows to report file: false Sorting Method: Sort Data Using: database

46 Maximum Memory Usage (MB): 50 Number Of Concurrent Threads: 4 Temporary Storage Directory for Source Data: Temporary Storage Directory for Target Data: NSort Memory Retry Limit: 0 NSort Memory Retry Wait Interval: 0 Initial Compare (General): *********************************************************************** Max Concurrent Comparison Threads: 4 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every Threads: 0 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every (records): 0 Limit Number of Input Rows: 0 Delta processsing enabled: false

47 Initial Compare (Event Reporting): *********************************************************************** Generate Messages: none Generate Warning Messages For Out-Of-Sync Rows After (differences): 50 Initial Compare (Agent): *********************************************************************** Use Static Listening Port For For Agent During Row Hash On Source: 0 Use Static Listening Port For For Agent During Row Hash On Target: 0 Initial Compare (NonStop Process): *********************************************************************** Source Process Name Starting With: Source Process CPU Number: -1 Source Process Priority: 0 Target Process Name Starting With: Target Process CPU Number: -1 Target Process Priority: 0 Confirm-Out-Of-Sync (General): *********************************************************************** Perform Confirm Out-Of-Sync Step: true Run Concurrently With

48 Initial Compare: true Delay Confirm-Out-Of-Sync By (seconds): 0 Terminate when Maximum Records Out-Of-Sync: Output Out-Of-Sync Record Details to Report File: false Update Report file Every (seconds): 0 Update Report file Every (records): 0 Confirm-Out-Of-Sync (Event Reporting): *********************************************************************** Generate Messages: none Generate Warning Messages For For Out-Of-Sync Rows After (differences): 50 Confirm-Out-Of-Sync (Agent): *********************************************************************** Use Static Listening Port For Agent During Row Hash On Source: 0 Use Static Listening Port For Agent During Row Hash On Target: 0 Confirm-Out-Of-Sync (NonStop Process): *********************************************************************** Source Process Name Starting With:

49 Source Process CPU Number: -1 Source Process Priority: 0 Target Process Name Starting With: Target Process CPU Number: -1 Target Process Priority: 0 Starting Veriagt session for source rowhash at :32:11. Initial Compare Source Agent Information: NLS_LANG (from environment) : ORACLE_HOME : /u01/app/oracle/product/11.2.0/db_3 ORA_SDTZ : NLS_LANG (from DBMS) : AMERICAN_AMERICA.AL32UTF8 NLS_LENGTH_SEMANTICS : BYTE SESSIONTIMEZONE : +02:00 Process ID : Operating System : Linux Architecture : x86_64 Report File : /u02/ogg_veridata/veridata/agent/dirver/report/raclinux1_gj_com_4150_ source_rh.rpt Trace File : /u02/ogg_veridata/veridata/agent/dirver/trace/raclinux1_gj_com_ 4150_ source_rh.trc Starting Veriagt session for target rowhash at :32:16. Initial Compare Target Agent Information: ORACLE_HOME : /u01/app/oracle/product/11.2.0/db_3 NLS_LANG (from environment) : ORA_SDTZ : NLS_LANG (from DBMS) : AMERICAN_AMERICA.AL32UTF8

50 NLS_LENGTH_SEMANTICS : BYTE SESSIONTIMEZONE : +02:00 Process ID : Operating System : Linux Architecture : x86_64 Report File : /u02/ogg_veridata/veridata/agent/dirver/report/raclinux1_gj_com_4150_ target_rh.rpt Trace File : /u02/ogg_veridata/veridata/agent/dirver/trace/raclinux1_gj_com_4150_ target_rh.trc Processing first rowhash block from source at :32:42. Processing first rowhash block from target at :32:42. Performance Statistics for source Rowhash at :32:42. rows: 12 duration (secs): 00:00:29 rows/sec: 0.41 row bytes: 937 row bytes/sec: 32 bytes/row: 78 rh bytes/row: 19 rows skipped: 0 blocks skipped: 0 hash comp rate: 0.25 total comp rate: 0.10 pct time fetching: 0.00 pct time waiting: 0.20 time until first row: 00:00:00 ipc msgs: 7 ipc bytes: 3228

51 bytes/msg: 461 compressed bytes/msg: 195 bytes/sec: 111 compressed bytes/sec: 47 msg compression ratio: 0.42 Comparing first row at :32:42. Performance Statistics for target Rowhash at :32:42. rows: 12 duration (secs): 00:00:25 rows/sec: 0.48 row bytes: 937 row bytes/sec: 37 bytes/row: 78 rh bytes/row: 19 rows skipped: 0 blocks skipped: 0 hash comp rate: 0.25 total comp rate: 0.10 pct time fetching: 0.00 pct time waiting: 0.24 time until first row: 00:00:00 ipc msgs: 7 ipc bytes: 3228 bytes/msg: 461 compressed bytes/msg: 196 bytes/sec: 129 compressed bytes/sec: 54

52 msg compression ratio: 0.43 *** Summarizing Confirm Out-of-Sync Step *** Time: :32:42. Elapsed Time: 00:00:00 Rows confirmed: 0 Rows per second: 0 *** Summarizing Persistently Out-of-Sync Rows *** Rows out-of-sync: 0 inserts: 0 updates: 0 deletes: 0 *** Summarizing In-Sync-after-In-Flight Rows *** Rows in-sync-after-in-flight: 0 inserts: 0 updates: 0 deletes: 0 *** Summarizing Still-Changing Rows *** Rows in-flight: 0 inserts: 0 updates: 0

53 deletes: 0 *** Summarizing Initial Row Comparison Step *** Time: :32:42. Elapsed Time: 00:00:00 Comparisons performed: 12 Rows per second: 375 Rows out-of-sync: 0 inserts: 0 updates: 0 deletes: 0 Comparison terminated normally.