Data Quality : Profile Analysis On Join Condition

Transcription

1 Name of Solution: Data Quality : Profile Analysis On Join Condition Business Requirement: The purpose of this solution is to explain what is Join profile analysis and how it can be used. Solution URL: Supported Versions: PowerCenter 9.1 and above. Description: The purpose of this solution is to explain join profiling analysis and how it can be used. Join profiling is a form of cross table analysis that is used to determine data overlap between two data sources. It is used primarily to test the referential integrity between the two data sources. Join profiling can be used to test a single column or multiple columns across the data sources. Some common examples of where join profiling would be applicable would be the validation of foreign keys or the validation of values against reference data. Note: This feature is only available through the Data Quality Developer user interface. Download file contents: 1. Workflow 2. Source File 3. Script Steps to implement the solution: 1. In the Object Explorer, select the data objects that you want to profile by holding down the Control key and highlighting the data objects.

2 2. After the data objects have been highlighted, right-click and select Profile. 3. The Profiling Wizard will appear in a new window. 4. Select Profile Model and click Next.

3 5. Enter the profile name. Then click Finish.

4 6. The profile will appear in the list of Profiles in the Object Explorer Window. 7. The necessary data objects have been created. The repository needs to be refreshed. Click OK, then disconnect and re-connect to the model repository. 8. Right-click on the Model Repository name and select Disconnect. Then right-click on the Model Repository name again and select Connect. 9. Check the check boxes for each of the data sources in the Outline window. 10. Select the data sources in the Default View of the profile window by holding down the Control key and highlighting the data objects. Then right-click inside one of the data objects and select Join Profile. 11. The New Join Profile wizard will appear in a new window. The data source names will be displayed in the list of Data Objects. Click Next to continue.

5 12. The list of columns that will be profiled will appear. To eliminate columns from the profile, uncheck the box next to the column name. Normally, it is not necessary to uncheck any of the columns. For large files, unchecking unneeded columns can be used to improve performance. 13. Define the conditions for the Join Analysis. Click on Add and a window will open where the condition can be configured. More than one condition is allowable. Take note of the data object names in the drop-down boxes at the top of the window. 14. Select the columns that will be used for the Join Analysis. One or more columns can be selected for each data source.

6 15. After the Join Condition has been configured. Click Finish. 16. The profile model has been updated, the changes have to be saved. Click Yes to save the changes and run the profile. 17. The profile will run. When it has completed, the progress bar will disappear from the lower corner of the screen. 18. When the profile has completed, click on the Results tab to view the profile results. Then select Join Profile from the Results Summary. Also highlight the profile name beneath tasks. The matched and unmatched row counts for each of the data sources will be provided.

7 19. To view the graphical display, click on the tab that indicates the profile name, then select Join Result beneath Overview. Also highlight the column names that were used for the Join Profile. 20. To view the exception records, double click on the area of the graphical display that represents the exception records. 21. The exception records can be exported to a flat file by right-clicking on the records and selecting Export Data.

8 22. Name the file and select the location where it should be saved. The export file will be a TAB delimited flat file. YouTube Video on Importing and Configuring Workflows: Other Usefull Bundels: Mapping Bundles Workflow Bundles Informatica Tools Bundles Informatica for Social Media Bundles Debugging Tools Bundles Visio Templates Bundles B2B Templates and Projects Bundles Data Quality Packs and Plans Bundles Script Bundle