Informatica Data Director for Data Quality (Version HotFix 4) User Guide

Transcription

1 Informatica Data Director for Data Quality (Version HotFix 4) User Guide

2 Informatica Data Director for Data Quality User Guide Version HotFix 4 February 2014 Copyright (c) Informatica Corporation. All rights reserved. This software and documentation contain proprietary information of Informatica Corporation and are provided under a license agreement containing restrictions on use and disclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica Corporation. This Software may be protected by U.S. and/or international Patents and other Patents Pending. Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as provided in DFARS (a) and (a) (1995), DFARS (1)(ii) (OCT 1988), FAR (a) (1995), FAR , or FAR (ALT III), as applicable. The information in this product or documentation is subject to change without notice. If you find any problems in this product or documentation, please report them to us in writing. Informatica, Informatica Platform, Informatica Data Services, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerExchange, PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica B2B Data Exchange Informatica On Demand, Informatica Identity Resolution, Informatica Application Information Lifecycle Management, Informatica Complex Event Processing, Ultra Messaging and Informatica Master Data Management are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other company and product names may be trade names or trademarks of their respective owners. Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies. All rights reserved. Copyright Sun Microsystems. All rights reserved. Copyright RSA Security Inc. All Rights Reserved. Copyright Ordinal Technology Corp. All rights reserved.copyright Aandacht c.v. All rights reserved. Copyright Genivia, Inc. All rights reserved. Copyright Isomorphic Software. All rights reserved. Copyright Meta Integration Technology, Inc. All rights reserved. Copyright Intalio. All rights reserved. Copyright Oracle. All rights reserved. Copyright Adobe Systems Incorporated. All rights reserved. Copyright DataArt, Inc. All rights reserved. Copyright ComponentSource. All rights reserved. Copyright Microsoft Corporation. All rights reserved. Copyright Rogue Wave Software, Inc. All rights reserved. Copyright Teradata Corporation. All rights reserved. Copyright Yahoo! Inc. All rights reserved. Copyright Glyph & Cog, LLC. All rights reserved. Copyright Thinkmap, Inc. All rights reserved. Copyright Clearpace Software Limited. All rights reserved. Copyright Information Builders, Inc. All rights reserved. Copyright OSS Nokalva, Inc. All rights reserved. Copyright Edifecs, Inc. All rights reserved. Copyright Cleo Communications, Inc. All rights reserved. Copyright International Organization for Standardization All rights reserved. Copyright ejtechnologies GmbH. All rights reserved. Copyright Jaspersoft Corporation. All rights reserved. Copyright is International Business Machines Corporation. All rights reserved. Copyright yworks GmbH. All rights reserved. Copyright Lucent Technologies. All rights reserved. Copyright (c) University of Toronto. All rights reserved. Copyright Daniel Veillard. All rights reserved. Copyright Unicode, Inc. Copyright IBM Corp. All rights reserved. Copyright MicroQuill Software Publishing, Inc. All rights reserved. Copyright PassMark Software Pty Ltd. All rights reserved. Copyright LogiXML, Inc. All rights reserved. Copyright Lorenzi Davide, All rights reserved. Copyright Red Hat, Inc. All rights reserved. Copyright The Board of Trustees of the Leland Stanford Junior University. All rights reserved. Copyright EMC Corporation. All rights reserved. Copyright Flexera Software. All rights reserved. Copyright Jinfonet Software. All rights reserved. Copyright Apple Inc. All rights reserved. Copyright Telerik Inc. All rights reserved. Copyright BEA Systems. All rights reserved. Copyright PDFlib GmbH. All rights reserved. Copyright Orientation in Objects GmbH. All rights reserved. Copyright Tanuki Software, Ltd. All rights reserved. Copyright Ricebridge. All rights reserved. Copyright Sencha, Inc. All rights reserved. This product includes software developed by the Apache Software Foundation ( and/or other software which is licensed under various versions of the Apache License (the "License"). You may obtain a copy of these Licenses at Unless required by applicable law or agreed to in writing, software distributed under these Licenses is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the Licenses for the specific language governing permissions and limitations under the Licenses. This product includes software which was developed by Mozilla ( software copyright The JBoss Group, LLC, all rights reserved; software copyright by Bruno Lowagie and Paulo Soares and other software which is licensed under various versions of the GNU Lesser General Public License Agreement, which may be found at The materials are provided free of charge by Informatica, "as-is", without warranty of any kind, either express or implied, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. The product includes ACE(TM) and TAO(TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University, University of California, Irvine, and Vanderbilt University, Copyright ( ) , all rights reserved. This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit (copyright The OpenSSL Project. All Rights Reserved) and redistribution of this software is subject to terms available at and This product includes Curl software which is Copyright , Daniel Stenberg, <daniel@haxx.se>. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at Permission to use, copy, modify, and distribute this software for any purpose with or without fee is hereby granted, provided that the above copyright notice and this permission notice appear in all copies. The product includes software copyright ( ) MetaStuff, Ltd. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at license.html. The product includes software copyright , The Dojo Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at This product includes ICU software which is copyright International Business Machines Corporation and others. All rights reserved. Permissions and limitations regarding this software are subject to terms available at This product includes software copyright Per Bothner. All rights reserved. Your right to use such materials is set forth in the license which may be found at kawa/software-license.html. This product includes OSSP UUID software which is Copyright 2002 Ralf S. Engelschall, Copyright 2002 The OSSP Project Copyright 2002 Cable & Wireless Deutschland. Permissions and limitations regarding this software are subject to terms available at This product includes software developed by Boost ( or under the Boost software license. Permissions and limitations regarding this software are subject to terms available at / This product includes software copyright University of Cambridge. Permissions and limitations regarding this software are subject to terms available at This product includes software copyright 2007 The Eclipse Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to terms available at and at This product includes software licensed under the terms at license.html, asm.ow2.org/license.html, httpunit.sourceforge.net/doc/ license.html,

3 license.html, license-agreement; /copyright-software ; forge.ow2.org/projects/javaservice/, license.html; protobuf.googlecode.com/svn/trunk/src/google/protobuf/descriptor.proto; current/doc/mitk5license.html. and This product includes software licensed under the Academic Free License ( the Common Development and Distribution License ( the Common Public License ( the Sun Binary Code License Agreement Supplemental License Terms, the BSD License ( the new BSD License ( licenses/bsd-3-clause), the MIT License ( the Artistic License ( and the Initial Developer s Public License Version 1.0 ( This product includes software copyright Joe WaInes, XStream Committers. All rights reserved. Permissions and limitations regarding this software are subject to terms available at This product includes software developed by the Indiana University Extreme! Lab. For further information please visit This product includes software Copyright (c) 2013 Frank Balluffi and Markus Moeller. All rights reserved. Permissions and limitations regarding this software are subject to terms of the MIT license. This Software is protected by U.S. Patent Numbers 5,794,246; 6,014,670; 6,016,501; 6,029,178; 6,032,158; 6,035,307; 6,044,374; 6,092,086; 6,208,990; 6,339,775; 6,640,226; 6,789,096; 6,823,373; 6,850,947; 6,895,471; 7,117,215; 7,162,643; 7,243,110; 7,254,590; 7,281,001; 7,421,458; 7,496,588; 7,523,121; 7,584,422; 7,676,516; 7,720,842; 7,721,270; 7,774,791; 8,065,266; 8,150,803; 8,166,048; 8,166,071; 8,200,622; 8,224,873; 8,271,477; 8,327,419; 8,386,435; 8,392,460; 8,453,159; 8,458,230; and RE44,478, International Patents and other Patents Pending. DISCLAIMER: Informatica Corporation provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the implied warranties of noninfringement, merchantability, or use for a particular purpose. Informatica Corporation does not warrant that this software or documentation is error free. The information provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation is subject to change at any time without notice. NOTICES This Informatica product (the "Software") includes certain drivers (the "DataDirect Drivers") from DataDirect Technologies, an operating company of Progress Software Corporation ("DataDirect") which are subject to the following terms and conditions: 1. THE DATADIRECT DRIVERS ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT. 2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT INFORMED OF THE POSSIBILITIES OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT LIMITATION, BREACH OF CONTRACT, BREACH OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS. Part Number: DQ-IDD-USG HF4-0001

4 Table of Contents Preface.... iii Informatica Resources.... iii Informatica My Support Portal.... iii Informatica Documentation.... iii Informatica Web Site.... iii Informatica How-To Library.... iii Informatica Knowledge Base.... iv Informatica Support YouTube Channel.... iv Informatica Marketplace.... iv Informatica Velocity.... iv Informatica Global Customer Support.... iv Chapter 1: Introduction to Informatica Data Director for Data Quality Informatica Data Director for Data Quality Overview Tasks and Workflows Informatica Data Director for Data Quality User Interface... 2 Logging In to Informatica Data Director for Data Quality Tasks and Dashboard Views Task Administration Options Chapter 2: Tasks Tasks Overview Human Tasks and Task Instances Task Types Task Status Task Ownership Task Data Export Exception Task Data Duplicate Task Data Task Administration Multiple Task Completion Exporting Task Data Assigning a Task to a User Viewing Tasks Assigned to Other Users Viewing a List of Tasks in a Human Task Completing Multiple Tasks Chapter 3: Exception Records Exception Records Overview Data View for Exception Records Table of Contents i

5 Exception Task Filters Exception Record Correction Exception Record Review Exception Record Actions and Status Exception Record Example Editing Exception Records Filtering Exception Tasks in the Data View Setting the Status of an Exception Record Reviewing Exception Records Chapter 4: Duplicate Records Duplicate Records Overview Data View for Duplicate Records Duplicate Task Filters Duplicate Record Correction Duplicate Record Review Duplicate Record Actions and Status Duplicate Record Example Filtering Duplicate Tasks in the Data View Editing a Cluster in a Duplicate Task Creating a Cluster Finding Duplicate Records in Multiple Clusters Setting the Status of a Cluster Reviewing Duplicate Records Chapter 5: Audit Trail Operations Audit Trail Operations Overview Audit Trail Data Audit View Filters Status Filter Options Audit View Opening an Audit Trail from the Data View Opening an Audit Trail from the Inbox Filtering Records in the Audit View Index ii Table of Contents

6 Preface The Informatica Data Director for Data Quality User Guide describes the features and functionality of Informatica Data Director for Data Quality. Informatica Data Director for Data Quality is a web-based application that data analysts use to perform tasks on database tables. Use this guide if you are assigned a task in Informatica Data Director for Data Quality. Informatica Resources Informatica My Support Portal As an Informatica customer, you can access the Informatica My Support Portal at The site contains product information, user group information, newsletters, access to the Informatica customer support case management system (ATLAS), the Informatica How-To Library, the Informatica Knowledge Base, Informatica Product Documentation, and access to the Informatica user community. Informatica Documentation The Informatica Documentation team takes every effort to create accurate, usable documentation. If you have questions, comments, or ideas about this documentation, contact the Informatica Documentation team through at infa_documentation@informatica.com. We will use your feedback to improve our documentation. Let us know if we can contact you regarding your comments. The Documentation team updates documentation as needed. To get the latest documentation for your product, navigate to Product Documentation from Informatica Web Site You can access the Informatica corporate web site at The site contains information about Informatica, its background, upcoming events, and sales offices. You will also find product and partner information. The services area of the site includes important information about technical support, training and education, and implementation services. Informatica How-To Library As an Informatica customer, you can access the Informatica How-To Library at The How-To Library is a collection of resources to help you learn more about Informatica products and features. It includes articles and interactive demonstrations that provide iii

7 solutions to common problems, compare features and behaviors, and guide you through performing specific real-world tasks. Informatica Knowledge Base As an Informatica customer, you can access the Informatica Knowledge Base at Use the Knowledge Base to search for documented solutions to known technical issues about Informatica products. You can also find answers to frequently asked questions, technical white papers, and technical tips. If you have questions, comments, or ideas about the Knowledge Base, contact the Informatica Knowledge Base team through at Informatica Support YouTube Channel You can access the Informatica Support YouTube channel at The Informatica Support YouTube channel includes videos about solutions that guide you through performing specific tasks. If you have questions, comments, or ideas about the Informatica Support YouTube channel, contact the Support YouTube team through at or send a tweet Informatica Marketplace The Informatica Marketplace is a forum where developers and partners can share solutions that augment, extend, or enhance data integration implementations. By leveraging any of the hundreds of solutions available on the Marketplace, you can improve your productivity and speed up time to implementation on your projects. You can access Informatica Marketplace at Informatica Velocity You can access Informatica Velocity at Developed from the real-world experience of hundreds of data management projects, Informatica Velocity represents the collective knowledge of our consultants who have worked with organizations from around the world to plan, develop, deploy, and maintain successful data management solutions. If you have questions, comments, or ideas about Informatica Velocity, contact Informatica Professional Services at ips@informatica.com. Informatica Global Customer Support You can contact a Customer Support Center by telephone or through the Online Support. Online Support requires a user name and password. You can request a user name and password at The telephone numbers for Informatica Global Customer Support are available from the Informatica web site at iv Preface

8 C H A P T E R 1 Introduction to Informatica Data Director for Data Quality This chapter includes the following topics: Informatica Data Director for Data Quality Overview, 1 Tasks and Workflows, 1 Informatica Data Director for Data Quality User Interface, 2 Informatica Data Director for Data Quality Overview Informatica Data Director for Data Quality is a web-based application that you can use to view and update records in a database table. You use Informatica Data Director for Data Quality to view and update records that were processed in other Informatica applications. The records may contain errors, or they may contain duplicate information. Informatica Data Director for Data Quality organizes the records into units of work called tasks. A task identifies a set of records and specifies the operations you can perform to resolve data quality issues in the records. When you log in to Informatica Data Director for Data Quality, you view the list of tasks that you are assigned in the Inbox for your account. You select a task, and you work on the data records that it contains. After you view or edit a record in a task, you update the status of the record to indicate if it is fit for storage in the database. When you complete work on a task, Informatica Data Director for Data Quality removes the task from your Inbox. Tasks and Workflows A workflow is a set of events, tasks, and decisions that Informatica users define for a data set. Informatica users create workflows in the Informatica Developer application. Informatica stores a workflow as an object in a database called the Model repository. When a workflow runs, it creates the tasks you perform in Informatica Data Director for Data Quality. 1

9 A workflow can contain different types of task. At the workflow level, the type of tasks that you perform in Informatica Data Director for Data Quality are called Human tasks, because each task needs human interaction to complete. A workflow that contains a Human task must also contain a Mapping task. A Mapping task runs an Informatica data process called a mapping. A mapping applies data quality algorithms to data records and corrects data errors where possible. When a workflow runs with a Mapping task, the mapping writes the corrected records to a specified database table. The mapping writes records that contain unresolved data quality issues to another table. The Human task reads the table of unresolved records and assigns the records to Informatica Data Director for Data Quality users for manual review. Informatica Data Director for Data Quality User Interface The Informatica Data Director for Data Quality web interface contains views to display Inbox and task data. The interface has the following views: Dashboard. Displays the list of tasks assigned to you and tasks that you completed. Data. Displays any currently open task. Tasks. Displays the Inbox. The Inbox lists the list assigned to you. If the Human task identifies you as a business administrator for task instances, the Tasks view displays the tasks that you administer in the Task Administration view. Audit. Displays an audit trail for changes you made in a task. Logging In to Informatica Data Director for Data Quality Use a web browser to log in to Informatica Data Director for Data Quality. You need the Informatica Data Director for Data Quality URL and a user name and password. An administrator defines the URL and user credentials in the Informatica Administrator application. Ask an administrator for a user name, password, and URL. 1. Open a web browser. 2. Enter the URL for Informatica Data Director for Data Quality. The URL has the following structure: 3. Enter the user name and password for your account. After you log in, select the Tasks view and open the Inbox and view the list of tasks assigned to you. Tasks and Dashboard Views The Tasks and Dashboard views display the tasks that are assigned to you. The views display the tasks in a table. When you select the Tasks view, select the Inbox tab to view the table of tasks. The Tasks view also displays a Task Administration tab. The Task Administration tab displays the Tasks view options and also displays options that allow you to release tasks and assign tasks to other users. 2 Chapter 1: Introduction to Informatica Data Director for Data Quality

10 Use the Tasks and Dashboard views to perform the following operations: Select the Tasks view or Dashboard views to view the list of tasks you need to complete. On the Tasks view, you view tasks in the Inbox. If you are a business administrator, select the Tasks view and then select the Task Administration tab to view the list of tasks that you administer. You can open a task, you can release a task from a user, and you can assign a task to a user. Inbox The Inbox stores the list of tasks that are assigned to you. Use the Inbox to view and open the tasks that you need to complete. When you are assigned a task, the task appears in the Inbox. Open a task from the Inbox and use the Data view to verify or update the records in the task. When you complete the task, Informatica Data Director removes the task from your Inbox. Note: The Dashboard view and the Inbox tab show the same task list. Inbox and Dashboard Options The Inbox and Dashboard views share a common set of options. You can use both views to manage the tasks assigned to you. The following table describes the options on the Inbox and Dashboard Views: Option Filter On, Off Refresh Task Details Open Task Release Task View Audit Trail Description Shows or hides the filter fields for the Inbox and Dashboard columns. Use the filters to search for tasks with common values in a column, such as task name or task owner. You can also use the filters to search for unique values, such as the task ID. Updates the list of tasks. Displays information for a task in a single dialog box. The information includes the task name, type, creation date, due date, and status. Opens the task so you can edit records. Releases the task for assignment to another user. Opens an audit trail that describes changes made to the records in the task. Inbox and Dashboard Columns The Inbox and Dashboard views list the task assigned to you and provide metadata about each task. The views organize the task data and metadata in a series of columns. Informatica Data Director for Data Quality User Interface 3

11 The following table describes the columns on the Inbox and Dashboard views: Column Name Task ID Task Title Task Type Owner Due Date Status Created Description Unique identifier for the task in the workflow. At the workflow level, the Task ID identifies the task instance in the Human task. The workflow stores the task ID value so that the ID is unique across multiple runs of the workflow. Task title. Task Type. The types are correct exceptions, correct duplicates, review exceptions, and review duplicates. Name of the user currently assigned to the task. Scheduled date for completion of the task. Status of the task. If the task has not reached the due date, the status indicates the task is on time. If the task in incomplete on the due date, the status indicates the task is overdue. Date the task was created. Task Administration Options If you are a business administrator, you can use the Tasks view to view the tasks that you administer. You can perform any action from the Task Administration tab that other users can perform from the Inbox or Dashboard. Use the Task Administration tab under the Tasks view to open the list of tasks. The Task Administration tab displays additional options for business administrators. The following table describes the additional options on the Task Administration tab: Option Reassign Task Complete Linked Tasks View Task Description Changes the owner of a task. Completes all task instances that are linked to the current task instance. Opens a task to view the work performed. 4 Chapter 1: Introduction to Informatica Data Director for Data Quality

12 C H A P T E R 2 Tasks This chapter includes the following topics: Tasks Overview, 5 Human Tasks and Task Instances, 6 Task Types, 6 Task Status, 7 Task Data Export, 7 Task Administration, 9 Multiple Task Completion, 10 Exporting Task Data, 10 Assigning a Task to a User, 10 Viewing Tasks Assigned to Other Users, 11 Viewing a List of Tasks in a Human Task, 11 Completing Multiple Tasks, 11 Tasks Overview The objective of a task is to verify that a set of data records is ready to move to the next stage in a workflow. The steps you take to complete a task depend on the type of task and the condition of the records in the task. You can perform the following steps in a task: Correct exceptions. Consolidate clusters of duplicate records to a single preferred record. Update the status of a record or cluster. Review the work done by another user, if the task reads data from an earlier task. If you are a business administrator, you can manage the tasks that the Human task assigned to you for administration. 5

13 Human Tasks and Task Instances When a workflow runs, it creates multiple tasks based on the configuration of the Human task in the workflow. The tasks that the workflow creates are called task instances. The workflow creates task instances so that Informatica Data Director for Data Quality users can collaborate on the analysis of large data sets. The workflow assigns one or more task instances to different Informatica Data Director for Data Quality users. The workflow assigns a subset of the data records to each task instance. Each task that you view in the Inbox or Dashboard is an instance of a Human task. Note: A Human task can contain multiple steps, and data records can pass from one task instance to another within the framework of the Human task. When you work on a task in Informatica Data Director for Data Quality, you work on the data issues specified for a step in the Human task. When you complete work on a task, the records can pass to another task for additional correction or for review. Task Types A task defines a set of actions that you perform on a set of data records. Each type of task performs a different role in a data project. You can perform the following types of tasks in Data Director for Data Quality: Correct exceptions You find and fix exception records in a correct exceptions task. An exception is a record that may contain one or more errors or empty cells. You can update the data in an exception record, and you can update the record status. When a record does not contain an error or an empty cell, you update the status to indicate that the record is valid. Correct duplicates You build a single preferred record from a group of duplicate records in a correct duplicates task. The group of duplicate records is called a cluster. The task displays the clusters one at a time. If a record is not a genuine duplicate of another record in the cluster, you can move the record to another cluster. You can create a cluster that contains a single record. The Human task identifies the preferred record as suitable for storage in the database table. Any other record in the cluster is considered a duplicate of the preferred record and can be deleted from the table. Review exceptions You review the work done by another user to correct exceptions. You can undo and redo the record actions performed by other users. Review duplicates You review the work done by another user to consolidate clusters of duplicate records into preferred records. You can undo and redo the cluster actions performed by other users. Note: Records cannot pass from a task that corrects or reviews exceptions to a task that corrects or reviews duplicates. The database tables that contain exception records and cluster records have different structures. 6 Chapter 2: Tasks

14 Task Status The task status defines the next stage in the workflow for the records in the task. For example, when you complete a task to correct exception records, the records may pass to another task that reviews the records. When you complete work on a task, you use the Task Actions menu to set the task status. Note: A task that corrects data is not always followed by a task that reviews the data. A workflow developer can specify correction and review tasks in any order. Consider the following guidelines when you set the task status: You cannot undo the task status. When you set the task status, the task disappears from your Inbox. The Task Actions menu can have one or more options. When the menu contains multiple options, you select the option that represents the status of the records in the task. The options on the Task Actions menu are defined in the workflow that contains the task. You cannot add or edit options on the Task Actions menu. Task Ownership A workflow can assign a task to more than one user. For example, the workflow may identify a group of users to work on a Human task. When you open a task, you become the owner of the task. If the workflow assigned the task to multiple users, Informatica Data Director removes the task from the Inbox of the other users when you take ownership of the task. Task Data Export You can export task data to a delimited file. Export data when you want to share the current state of the data with others in applications such as Microsoft Excel. You can share the data with colleagues who work on the same data project. Export data when you want to verify that the updates you make in a task conform to the business rules defined for the project. You export all data associated with the task instance, including the record or cluster data and the status data saved for the task. The data includes any additional column data created by the Mapping task or Human task that ran in the workflow. Exception Task Data When you export data from an exception task, you export all record data and status data from the database. The export process includes any additional columns created by the Mapping task or Human task that ran in the workflow. Task Status 7

15 The following table describes the metadata columns that export by default with exception data: Column Name ROW_IDENTIFIER REVIEW_STATUS WORKFLOW_ID USER_COMMENT UPDATED_STATUS RECORD_STATUS Description Identifies the record row in the database table. The status assigned to the record in Informatica Data Director for Data Quality. The status can be one of the following values: - REVIEWED. You marked the record as reviewed. - NULL. You did not mark the record as reviewed. Identifies the workflow that contains the Human task associated with the task. Any comment added to the record in Informatica Data Director for Data Quality. The update status of the record in the task. The status can be one of the following values: - UPDATED. You added a comment to the record, or you marked the record as reviewed. - ACCEPTED. You accepted the record for storage in the database table that contains valid data. - REJECTED. You rejected the record as unsuitable for storage in the database table that contains valid data. - REPROCESS. You indicated that the record needs further processing in another application. - NULL. You did not update the record The record status set by the workflow. The workflow sets the status value when it writes the record to an exception table for analysis in a Human task. The default value is INVALID. An INVALID value indicates that the current record cannot be stored in the database that contains valid data. Duplicate Task Data When you export data from a duplicate task, you export all cluster data and status data from the database. The export process includes any additional columns created by the Mapping task or Human task that ran in the workflow. The following table describes the metadata columns that export by default with exception data: Column Name ROW_IDENTIFIER SEQUENTIAL_CLUSTER_ID CLUSTER_ID MATCH_SCORE Description Identifies the record row in the database table. Unique identifier for the cluster in the database table. Identifies the cluster that the record belongs to. The Mapping task assigns a cluster ID value to each record in the table. Decimal value between 0 and 1. Identifies the degree of similarity between two records in the cluster. 8 Chapter 2: Tasks

16 Column Name IS_MASTER UPDATED_STATUS USER_COMMENT REVIEW_STATUS WORKFLOW_ID Description Indicates if the record is the preferred record in the cluster. The possible values are Y and N. The update status of the record. The status can be one of the following values: - UPDATED. You updated a value in the record. - NULL. You did not update the record. - EXTRACTED. You removed the record from a cluster. Any comment added to the cluster in Informatica Data Director for Data Quality. The status assigned to the cluster in Informatica Data Director for Data Quality. The status can be one of the following values: - REVIEWED. You confirmed the record as reviewed. - NULL. You did not mark the record as reviewed. Identifies the workflow that contains the Human task associated with the task. Task Administration If you are a business administrator, you manage the status of a set of task instances. For example, if a user is unable to complete a task instance on schedule, you can reassign the task to another user. The Task Administration tab displays the tasks that you manage in addition to any task that is assigned to you. Use Task Administration tab options to perform the following operations: Open tasks assigned to you. If you are assigned a task to complete, you can use the Task Administration tab in the same way as the Inbox. Assign tasks to users. For example, you can assign a task to a new user if the current user did not complete the task. View the work performed by a user on a task. For example, you can review the rate of user progress in a task and verify that the user is performing the task correctly. View the list of tasks that share a common Human task in a workflow. Complete multiple tasks. You can move a set of tasks to a completed state when the tasks represent a common Human task in a workflow. When you complete the tasks, the records in the tasks move from the Human task to the next stage in the workflow. Task Administration 9

17 Multiple Task Completion You can complete multiple tasks in a single operation. Complete multiple tasks in the following cases: The workflow process failed, and you want to run the workflow again. Users did not complete the task instances by the scheduled date, and you want to delete the tasks from the user Inbox views. Use the Complete Linked Tasks option on the Task Administration view to compete multiple tasks. The Complete Linked Tasks option identifies the current task as an instance of a Human task, and it completes all task instances that share the Human task as a parent. Informatica Data Director for Data Quality removes the tasks from the Inbox views of the users who worked on the tasks. When you complete all tasks instances for a Human task, the Human task releases the record data to the next stage in the workflow. The record data includes all updates and status changes made by the users who worked on the tasks in Informatica Data Director for Data Quality. Exporting Task Data Export task data to a delimited file. 1. Open the task in the Data view. 2. Open the Record Actions menu and select Export Data. The Export Data dialog box appears. 3. Verify or edit the file name. By default, the Export Data dialog box uses the task name as the file name. 4. Select or clear the option to export field names as the first row of the file. 5. Click OK. 6. Select an option to open or save the file. Assigning a Task to a User Assign tasks to users on the Task Administration tab. Assign a task when a task has no assigned user, or when a user cannot complete a task on time. 1. On the Tasks view, select the Task Administration tab. 2. Select a task from the task list. 3. Click Reassign Task. 4. Select a user to perform the task. 10 Chapter 2: Tasks

18 Viewing Tasks Assigned to Other Users Use the Task Administration options to open a task and view the progress made by a user in the task. 1. On the Tasks view, select the Task Administration tab. 2. Select a task from the task list. 3. Click View Task. The task opens in the Data view. Viewing a List of Tasks in a Human Task To view the tasks that a workflow generated from a single Human task, use the Complete Linked Tasks option. 1. On the Tasks view, select the Task Administration tab. 2. Select a task from the task list. 3. Click Complete Linked Tasks. 4. Review the information for each task. The task list displays the following information for each task: Task ID Name of the task Task type Task owner Due date Status Do not click OK in the task list. If you click OK, you advance all tasks to the next stage in the workflow and remove all tasks from the Inbox of each owner. Completing Multiple Tasks To complete all tasks that have a common Human task as a parent, use the Complete Linked Tasks option. When you complete a set of tasks, you end all work on the Human task and you advance the task records to the next stage in the workflow. Note: The action to complete the tasks does not update any record or status data. 1. On the Tasks view, select the Task Administration tab. 2. Select a task from the task list. 3. Click Complete Linked Tasks. The list of tasks opens. 4. Verify that the list contains the tasks you want to complete. 5. Click OK. Viewing Tasks Assigned to Other Users 11

19 12 Chapter 2: Tasks If you open the Inbox or Dashboard after you complete the tasks, the Inbox or Dashboard may not display any change to the task list. To view the current list of tasks in the Inbox or Dashboard, refresh the browser window.

20 C H A P T E R 3 Exception Records This chapter includes the following topics: Exception Records Overview, 13 Data View for Exception Records, 14 Exception Record Correction, 15 Exception Record Review, 16 Exception Record Actions and Status, 16 Exception Record Example, 17 Editing Exception Records, 18 Filtering Exception Tasks in the Data View, 18 Setting the Status of an Exception Record, 19 Reviewing Exception Records, 19 Exception Records Overview An exception is a record that may contain one or more data errors. A workflow adds a record to a correct exceptions task when other users or software processes cannot determine that the record data is correct. When you correct exception records, you examine the records in the task for errors that you can fix. When you review exception records, you verify the work done in an earlier task. After you edit or review a record, you update the record status. You set the task status to indicate the overall status of the records in the task. The workflow adds metadata columns to the records in the task. You use the metadata columns to update the status of each record. You can perform the following actions to correct exceptions: Edit a record. When you open a task, the Data view displays the records in the task and indicates the cells that contain data quality issues. You can select a cell and correct the error that it contains. Accept a record for storage in the database. You can mark a record as acceptable for permanent storage in the database. You can edit the record, or you can accept the current data in the record. Reject a record from the database. You can decide that a record does not belong in the database table. You mark the record for deletion from the table. 13

21 Note: The task does not remove records from the table. The records are removed in a later task in the workflow or by a user in another application. Return a record for further processing. You can decide that a record cannot be fixed in manual review. For example, you cannot determine the correct state of the data in the record. You mark the record for additional processing in another application. Clear the status of a record. You can undo the status that you set for a record. For example, if you mark a record for rejection from the database, but later you change your mind, you can clear the status and select a different status. You can update or clear a record status at any time before you complete the task. Complete the task. You use the Task Actions menu to indicate that you have completed work on the task. The menu options define the next step for the task data. The options are determined by the previous task in the workflow. Data View for Exception Records The Data view shows the records in a task. When you open an exception task, the Data view lists the records in the task and provides a set of options you can use to complete the task. Use the Customize Table option to organize the data columns in the Data view. Use the Filter option to filter the records that appear in the Data view. The following table describes the options on the Data view: Option Filter Exceptions Customize Table Edit Undo Redo Find Description Filters the list of records based on criteria you specify. You can filter records by issue type, priority, and status. Selects the table columns to display. Enables edit features for a record. You must click Edit before you make changes to a row. Reverses the last change you made in a record. Makes the change to a record that you previously reversed. Finds records that match the criteria you enter in the filter field for a column. The filter fields and the Filter Exceptions options work independently of each other. 14 Chapter 3: Exception Records

22 Option Task Actions Record Actions Description Sets the status of the task. The workflow uses the Task Actions setting to determine the next step for the task data when you complete the task. Sets the status of a record. You set the record status when you are finished work on the record. You can also undo or redo any edit to the record you select. Exception Task Filters You can filter the records by the types of issue they contain, the priority assigned to them, and the current status of the records. The following table describes the filter options: Option Type of issue Priority Status Review Description Indicates the type of data quality issue that the workflow identified in the record data. The data quality issue indicates that the record is an exception in the database. Hold the cursor over the red icon in a table cell to view the issue name. Indicates the priority that the workflow assigned to the data quality issue in the record. Indicates the status of the record in the current task, based on the data quality of the record. You can choose from the following status options: - Accepted. Records accepted for storage in the database. - Rejected. Records rejected as unsuitable for storage in the database. - Reprocessed. Records that need further analysis in another application. - Empty. Records with no current status. Indicates the review status of the record in the current task. You can choose from the following review options: - Reviewed. Records that are marked as reviewed. - Empty. Records that are not marked as reviewed. Exception Record Correction The records in a correct exceptions task contain data quality issues that an earlier data process has identified. The data quality issues may or may not indicate an error in the data. Exception Record Correction 15

23 When you work in a correct exceptions task, you complete one or more of the following steps: Verify that the records contain an error. If the record does not contain an error, you can accept the record for storage in the table. Update the records with correct data. If you can update a record with correct data, you can accept the record for storage in the table. Identify records that cannot be used by the business. If you cannot update a record to a usable form, you can reject the record. Update the status of a record. The status you set determines how the workflow processes the record when the task completes. Set the task status. You select the status that best represents the current state of the record data. Set the task status when you finish work on the task data. Exception Record Review When you perform a task to review exception record data, you validate the work done by another user in an earlier task. The steps to complete the review task are similar to the steps to correct the data. In a review task, you can verify or undo the work performed in the earlier task. You can find both types of task in your Inbox. When you review exception records, you examine the changes made by the previous user and the status assigned to each record. Consider the following questions: Are the data updates correct in each record? Does the record status reflect the current state of the record? The level of data accuracy and completeness in the record must match the record status. For example, if a record contains errors in a review task, the record status may indicate that the record requires additional processing, or that the record is unfit for storage in the database. When you fix update data in a record, you must also verify that the record status is accurate. Exception Record Actions and Status You use the Record Actions menu options to update record data and to set the status of a record. When you set the record status, you update a metadata field that other users or processes can use after the task completes. The Record Actions menu displays the following options: Menu Option Edit Undo Description Enables edit features for a record. You must click Edit before you make changes to a row. Reverses the last change you made in a record. 16 Chapter 3: Exception Records