Performing a Post-Upgrade Data Validation Check

Transcription

1 Performing a Post-Upgrade Data Validation Check 2013 Informatica Corporation. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica Corporation. All other company and product names may be trade names or trademarks of their respective owners and/or copyrighted materials of such owners.

2 Abstract You can perform a post-upgrade data validation check with the data validation tool. The data validation tool is a script that you can run to identify and resolve data issues in MDM Multidomain version and up after an upgrade from a pre-9.5 version of MDM Multidomain Edition. This article describes how to use the data validation tool to generate a report of post-upgrade data issues. This article also describes how to use the data validation tool to resolve data issues in MDM Multidomain version and up. Warning: Do not use the data validation tool to fix issues in versions of MDM Multidomain Edition prior to version If you use the data validation tool on versions of MDM Multidomain Edition prior to version 9.5.0, you will get incorrect results and you will corrupt your data. Supported Versions MDM Multidomain Edition for Oracle version and higher only Table of Contents Post-Upgrade Data Validation Overview About the Data Validation Tool Report Unzip the Data Validation Tool Scripts Run the Data Validation Tool to Generate the Initial Results Fixing Data Issues Rerun the Data Validation Tool to Confirm Issues are Resolved Remove the Data Validation Tool Regenerating the Data Validation Tool Report from the Latest Data Check (Optional) Post-Upgrade Data Validation Overview When you upgrade MDM Multidomain Edition from a version earlier than to or higher, the upgrade process migrates the existing database to a new data model architecture of version or higher. Informatica provides a data validation tool that you can run after the upgrade. Use the data validation tool to identify and resolve content metadata issues. The data validation tool generates a report in a CSV file and a log in a DVT.log file. The CSV file and log file are saved in the location that is specified by the Operations Reference Store c_repos_db_release.debug_file_path parameter. About the Data Validation Tool Report The data validation tool report identifies the data issues that you must resolve after you upgrade the schema to the new database structure. Run the script to perform a data check and create the DVT_REPORT<report ID>.CSV file. The report ID consists of the date and time the report was created in the format DVT_REPORT<YYMMDDHHMMSS>. The report ID follows a 24-hour clock format. For example, a DVT report with a file name of DVT_REPORT CSV was created on July 23, 2013 at 4:35 p.m. The data validation tool report contains the following sections of data: Detailed Temporary Data Tables Summary 2

3 Detailed Report by Table Detailed Temporary Data Tables The detailed temporary data tables contain a copy of the records with data issues. The data validation tool uses these tables to track and resolve content metadata issues. Summary Lists all issues found during the data check. The following table describes the information in the summary: Column Ref. # Check Code The row number. A code that identifies a specific data issue. Provides a brief description of the issue that causes the error for that particular check code. Fix Type - Auto: Data issues that can be fixed automatically by the data validation tool. - Info: Data issues that you might not need to fix. Original Count Current Count Displays the number of data issues that the initial data check found. Displays the number of data issues that the most recent data check found. Detailed Report by Table The following table describes the information provided in the columns of the detailed report by table: Column Ref. # Check Code The row number. A code that identifies a specific data issue. Provides a brief description of the issue that causes the error for that particular check code. Fix Type - Auto: Data issues that can be fixed automatically by the data validation tool. - Info: Data issues that you might not need to fix. Foreign Key Name Original Count Current Count <base object name> The name of the foreign key in the schema that has data issues. Displays the number of data issues that the initial data check found. Displays the number of data issues that the most recent data check found. Displays the number of data issues for a particular base object for each foreign key with issues. Each base object with a data issue has a column in the details of the auto mandatory fix issues. Two rows that identify the base object table record count and the cross-reference (XREF) table record count appear in the report below the details of the auto mandatory fix issue. These rows display the total number of base object and XREF tables in the schema to provide some perspective on the percentage of records that have data issues. 3

4 Unzip the Data Validation Tool Scripts Before you can run the data validation tool script, you must unzip the files. Contact Informatica Global Customer Support to get the zip file. Unzip the file to an empty directory. The file contains the following files: dvt_body.plb dvt_pack.plb dvt_start.sql Do not run the dvt_body.plb or dvt_pack.plb scripts that are contained in the zip file. These files are used by the dvt_start.sql script. Run the Data Validation Tool to Generate the Initial Results To generate the initial data validation results, run the dvt_start.sql script. 1. Start SQL*Plus and connect to the Operational Reference Store for which you want to generate data validation tool results. 3. Select the appropriate option to get the initial data validation results: a. Enter y for the first option, Check data and generate DVT report (y/n) [n]. b. Enter n for the second option, Fix data using generated DVT report(y/n) [n]. c. Enter n for the third option, Regenerate DVT report (y/n) [n]. 4. Open the data validation tool report in a program that can open CSV files, such as Excel, to review the data issues identified for your schema. Fixing Data Issues To fix the issues identified by a validation tool that have a fix type of 'Auto', run the dvt_start.sql script. You must have checked the data and generated a report. 1. Connect to the ORS schema for which you want to fix data issues. 3. Select the appropriate option to fix data issues: a. Enter n for the first option, Check data and generate DVT report (y/n) [n]. b. Enter y for the second option, Fix data using generated DVT report(y/n) [n]. c. Enter n for the third option, Regenerate DVT report (y/n) [n]. The data issues with a fix type of 'Auto' are resolved. 4

5 Rerun the Data Validation Tool to Confirm Issues are Resolved When non-zero counts have been addressed, run the data validation tool report again. When you rerun the data validation tool to create another report, the report contains the previous results beside the recent results. 1. Start SQL*Plus and connect to the Operational Reference Store for which you want to generate data validation tool results. 3. Select the appropriate option to get the initial data validation results: a. Enter y for the first option, Check data and generate DVT report (y/n) [n]. b. Enter n for the second option, Fix data using generated DVT report(y/n) [n]. c. Enter n for the third option, Regenerate DVT report (y/n) [n]. 4. Open the data validation tool report in a program that can open CSV files, such as Excel, to review the data issues identified for your schema. Remove the Data Validation Tool After you have resolved all the issues identified by the data validation tool, remove the data validation tool and any temporary files. 1. Start SQL*Plus. 2. In SQL*Plus, run the the dvt_start_detect.sql script. 3. Select the appropriate option to remove the data validation tool: a. Enter n for the first option, Check data and generate DVT report (y/n) [n]. b. Enter n for the second option, Fix data using generated DVD report (y/n) [n]. c. Enter n for the third option, Regenerate DVT report (y/n) [n] d. Enter y for the fourth option, Drop temporary DVT tables in schema (y/n) [n]. Regenerating the Data Validation Tool Report from the Latest Data Check (Optional) You can regenerate the data validation tool report CSV file from data created when you last ran a check. You must have performed a data check to regenerate a report. The report appears in the location where you unzipped the data validation tool files. 1. Start SQL*Plus and connect to the Operation Reference Store for which you want to generate data validation tool results. 3. Select the appropriate option to regenerate the data validation tool report: a. Enter n for the first option, Check data and generate DVT report (y/n) [n]. b. Enter n for the second option, Fix data using generated DVT report(y/n) [n]. 5

6 c. Enter y for the third option, Regenerate DVT report (y/n) [n]. 4. Open the data validation tool report in a program that can open CSV files, such as Excel, to review the data issues identified for your schema. Authors Rich Perkin Principal Technical Support Engineer Faisal Bahomed Customer Success Architect Scott Garlick Senior Technical Writer 6