Lab 3: Create the Error Message Data Stream

Transcription

1 Lab 3: Create the Error Message Data Stream Overview In this lab you will continue to develop your process by creating an error stream that you will later send to a match processor. At the end of this lab your process will look like this: Before discussing how to achieve this, let s first consider our design aims. The pertinent design aims are: For each alert, we want a single field in Case Management to display the error message. We want to create an alert in Case Management for each error found for a data record. So what does this entail? 1. At the moment, each of the checks generates an error message, but these are held in different attributes. We will need to put each of the error messages in the same attribute, so that we can pass the contents of this single attribute through to a single Case Management field. 2. Currently we have one error record per incoming data record, even for data records that have multiple errors. We ll need to find a way of splitting these out into multiple error records. Let s think about how we can do these things two things. Fortunately, solving the first problem will help us to solve the second problem. Here s the outline of a solution: We can put the two error messages into a delimited list within the same attribute using the Concatenate processor. This will create the single error message attribute that we need. We then need to create one error record per error message. We can get there in two further steps: o The first step is to create an array from our delimited list using the Make Array from String processor. o Once we have the error messages in an array, the second step is to use the Split Records from Array processor to create one error record for each error message. Finally, we are going to use the Merge Data Streams processor. Since we only have one data stream, we re not actually going to do a merge. We re simply going to use it to rename the data stream as Error. Page 34 of 96

2 Put the Error Messages in a Delimited List 1. In the Tool Palette, on the right-side of the screen, click to select the Transformation family of processors, and then drag the Concatenate processor onto the Canvas. 2. Wire up the output port from the Add Error Message for UMCODE - Invalid Value (Add String Attribute) processor to the Concatenate processor s input port. 3. The Concatenate dialog will open. Close it for now, and also wire up the output port from the Add Error Message for PARTID - Invalid Format (Add String Attribute) processor to the Concatenate processor s input port. Both error message processors should now be connected to the Concatenate processor. 4. The Concatenate dialog will open. Select the Error Message:UMCODE and Error Message:PARTID attributes and click. Page 35 of 96

3 5. Double click the Added Outpu Attribute, Concat, and rename it Error. 6. Navigate to the Options tab and enter a Separator string of (a pipe symbol). Ensure that the existing separator string (a whitespace) is deleted. 7. Click OK to close the dialog. Page 36 of 96

4 8. On the canvas, double click the words Concatenate,, and rename the processor Put the error messages into a delimited list (Concatenate). Make an Error Message Array 1. In the Tool Palette, on the right-side of the screen, click to select the Transformation family of processors, and then drag the Make Array from String processor onto the Canvas. 2. Wire up the output port from the Concatenate processor that you renamed Put the error messages into a delimitedd list (Concatenate) to the Make Array from String processor s input port. Page 37 of 96

5 3. The Make Array from String dialog will open. Select Error as the Input String. 4. Rename the Added Output Attribute from ArrayFromString to ErrorArray. 5. Navigate to the Options tab. Click to remove the Delimiters reference data, and then enter (a pipe symbol) in the Delimiters field (again, ensure that you delete the default delimiter, which is a whitespace). 6. Click OK to close the dialog. Page 38 of 96

6 7. On the canvas, double click the words Make Array from String,, and rename the processor Create an array from the delimited list (Make Array from String). Create One Error Record for Each Error 1. In the Tool Palette, on the right-side of the screen, click to select the Transformation family of processors, and then drag the Split Records from Array processor onto the Canvas. 2. Wire up the output port from the Make Array from String processor that you renamed Create an array from the delimited list (Make Array from String) to the Split Records from Array processor s input port. Page 39 of 96

7 3. The Split Records from Array dialog will open. Make ErrorArray the Selected Attribute. 4. Click OK to close the dialog without making any further changes. 5. On the canvas, double click the words Split Records from Array,, and rename the processor Create one error r record per error (Split Records from Array). Rename the Data Stream 1. In the Tool Palette, on the right-side of the screen, click to select the Read and Write family of processors, and then drag the Merge Data Streams processor onto the Canvas. 2. Wire up the All port from the Split Records from Array processor that you renamed Create one error record per errorr (Split Records from Array) to the Merge Data Stream processor s input port. Page 40 of 96

8 The Merge Data Streams dialog will open. In the Available Attributes list, select the UNIQUEID and ErrorArray.Split attributes, and then click to make Output Attributes for them. Our Error Stream will only consist of the UNIQUEID (which is the PARTS table s primary key), plus the Error Message, so we will only pass these two attributes through the Merge Data Streams processor. 3. Rename the ErrorArray.Split Output Attribute to Error Message. 4. Rename the Data Stream Name to Error. 5. Click OK to close the dialog. Page 41 of 96

9 6. On the canvas, double click the words Merge Data Stream,, and rename the processor Rename Data Stream to 'Error' (Merge Data Streams). Run Your Process and Examine the Results 1. In the toolbar at the top of the canvas, click to run your process. 2. In the canvas, single-click the Merge Data Streams processor that you renamed Rename Data Stream to 'Error' (Merge Data Streams) and then, in the Results Browser s toolbar, click to load all of the data. 3. Examine its results in the Results Browser. You should find that there are 122 error records. This is the sum of the 112 invalid PARTID formats and the 10 invalid UMCODEs that were found by the two Audit processors. Each error record consists of a UNIQUEID (the primary key of the PARTS table) and an Error Message. Page 42 of 96