Conduent Legal and Compliance Solutions Viewpoint ediscovery Platform. Viewpoint Processing Manual

Transcription

1 Conduent Legal and Compliance Solutions Viewpoint ediscovery Platform Viewpoint Processing Manual Application Version: 6.1 July 24, 2017

2 2017 Conduent Business Services, LLC. All rights reserved. Conduent and Conduent Agile Star are trademarks of Conduent Business Services, LLC in the United States and/or other countries. Document Version: 1.0 (April 2017).

3 Contents 1. Getting Started Navigation Processing Tabs Modifying Displayed Fields Resizing Fields Reordering Fields Adding Fields Ordering Fields Group Documents by a Specific Field Removing Fields Filters Selector Filters Field Filters Filter Documents by Text Search Fields Filter Documents by Exact Contents Advanced Filters Calculate Field Data Hide and Remove Field Filters Panels and Viewers Dashboard Resize a Panel/Viewer The Docking Function Move a Panel/Viewer Options for Displaying Multiple Panels/Viewers Individual Docked or Floating Panels/Viewers Stacked in a Single Docked or Floating Panel/Viewer with Multiple Layers Adjacent Panels/Viewers Sharing the Same Docked Area Display Adjacent Panels/Viewers Stack Panels/Viewers Auto-hide Function Saving and Loading Layouts Viewpoint Processing Manual i

4 To Save, Load, or Reset Panel/Viewer Placement Settings To Save, Load, or Reset Grid Field Settings Project Creation and Settings Creating a New Project Project Tab Custodian Info Data Locations Media Sources Project Settings Configuration Settings Auto Slipsheet Settings and Auto Ignore Settings To Apply Auto Slipsheet Settings Recommended Auto Slipsheet Settings To Apply Auto Ignore Settings Recommended Auto Ignore Settings Slipsheet Template Modification Custom Field Management Other Project Phase Options Copy Settings/Layout From Existing Project or Create Project Template Update/Change Project Information To Create a Review Database Launch Processing Catalog Tab Select Data to Stage and Process Process Data To Catalog Data Locally To Process Data on a Specified Worker(s) Monitoring Processing Workflow Tab Workflow Glossary Worker Selector Worker Color Coding To Start a Worker Machine To Stop a Worker Machine To Assign/Unassign Workers Monitoring Worker Status Flagging Supported Features Assigning Workers to Applications Viewpoint Processing Manual ii

5 Workflow Lifecycle Jobs Panel To Cancel a Job Workflow Filtering Status Panel Clearing Workflows Cleaning Data Process Tab Processing Task Grid To View Files by Status Processing Task Descriptions Stage Task Extract Task FileID Task Hash Task Create Text Task Create HTML Task Create TIFF Task Metadata Task Slipsheet Task DocIDs and Family Relationships To Isolate All Parent or Children Files To Find a File s Parent or Children Searching by DocID User Interface Scripts To Run a User interface Scripts To Create a New User Interface Script Project Notes Create a New Project Note Create a New Project Note from DocIDs Deleting a Project Note Processing Grid Functionality Reprocess a Document Set Task Status View a File Media Player Import or Replace a File Rendering Viewpoint Processing Manual iii

6 Export Grid Results to a Spreadsheet Export Documents Export All Documents in a Media Slipsheet a File Un-Slipsheet a File Ignore or Delete a File Search Fields Copy as URL FileID Manipulation View or Modify FileID Details Set a FileID Create New FileID Create TIFF Settings Early Filter Dedupe Tab Create a Global Deduplication Set Create Custodian Deduplication Sets Copy Dedupe Set Dedupe Viewers Index Tab Index a Media Index Tab Highlighted Colors Update File Counts Troubleshooting Index Errors Keyword Searching Index Validation Validate an Index Posting Data to Review Post Data Update Post TIFF Creation Tiff Settings Tiff Delivery Steps Scope and Media Modifications Viewpoint Processing Manual iv

7 Create a Scope Update a Scope Delete a Scope Change a Media s Stage Status Import a Media Update a Media Delete a Media Import Tab Import Glossary Import Walkthrough Field Mapping System Field Mapping System Field Parameters Date/Time Field Mapping Combining Fields Custom Field Mapping Conditions Mapping Mappings Tab Template Management Supported Load Files Maintenance Scripts To Run a Maintenance Script To Customize a Maintenance Script Connectors Choosing Collectors for Processing Google Drive Connector IMAP Connector SharePoint Connector Twitter Connector Viewpoint Glossary Appendix A Custom Field Guidelines Format Strings for Numeric Values Format Strings for Date/Time Values Specific Format Strings for Date/Time Values Viewpoint Processing Manual v

8 Format Strings for Fuzzy Dates Viewpoint Processing Manual vi

9 1. Getting Started The processing application is the starting point for all data within the Viewpoint environment. Users can process native files and forensic images directly into Viewpoint or load scanned and previously processed data for use with the review application. Once data has gone through all necessary processing and data handling it will be made ready for distribution to document reviewers through the review application. To begin, follow the steps below: 1. Open the Viewpoint Processing application on your workstation. 2. Input the name of the SQL server that stores the processing databases in your environment. 3. Hit the tab key. 4. If your Viewpoint login is synched to the Active Directory system of your environment, the User and Password fields should auto populate. If Active Directory is not being used the User and Password fields should be filled manually. 5. When all three fields are populated, hit the OK button. Viewpoint Processing Manual 1-1

10 2. Navigation Processing Tabs Fully processing data within the Viewpoint environment requires multiple distinct phases to be completed. These phases are organized into different tabs located on the upper edge of the application window. You can use the left mouse button to navigate between these tabs. Each tab has unique buttons that are utilized for that particular phase of processing. The screenshot above illustrates the buttons available for the Project tab. The screenshot below illustrates the buttons available for the Index tab. Although some buttons are used for multiple phases, the buttons and layout for each tab changes to match the process being performed. Modifying Displayed Fields During each phase of processing, Viewpoint collects specific information about each document. This information is commonly referred to as metadata. Metadata within Viewpoint comes from a number of sources. Some of this information is system file information such as the Created Date and Last Modified Date of a document. Others are application specific, such as the author of a Microsoft Word document or the sender of an . Viewpoint also stores its own information about how a particular document was processed within the system and general system settings. The combination of document metadata and Viewpoint system information are referred to as fields. Resizing Fields On each grid, users can fully customize the display to their preference. Each field header is surrounded by a thick line called a splitter which acts as a boundary between unique fields. Users can click these splitters and drag them to either reduce or enlarge the size of a field. An example of this functionality can be seen in the below screenshots from the project tab. Viewpoint Processing Manual 2-2

11 Both the Id and DB Name fields were expanded using this functionality. Reordering Fields Field order can be manipulated by clicking on the field header, dragging the field to a different portion of the field header row, and releasing the mouse button. In the below example the Id field has been selected and about to be moved behind the DB Name field. Two arrow buttons appear clearly indicating where the field will be positioned when the mouse button is released. The Id field now exists immediately after the DB Name field. Adding Fields Most grids have more fields available then are shown within the default settings. To gain access to these additional fields, right-click within the display and click on Field Selector. Viewpoint Processing Manual 2-3

12 The screenshot to the right above shows options that are available for this particular grid. Each grid will have different options based on its intended functionality. Adding fields from the Field Selector can be done in two ways. 1. Double click on the name of the field you wish to add to the display. This will add the field to the end of your displayed fields. 2. Click and hold the name of the field you wish to add to the display, hover the field between the two fields you would like it to be placed and release the mouse button. This functionality can be seen below. The File Server field was moved from the Field Selector list to the designated location between the Id and Project Name fields. Fields can be quickly found using the filter bar at the top of the Field Selector list. Applied filters will search the entire field name, as seen below. Note: To add more than one field at once, check the box next to the desired fields and then drag to the desired location or double click on one to add them all to the end of the grid. Ordering Fields Each field in a grid can be ordered by either ascending or descending order. Click the field header you wish to sort by. An arrow will appear on the right side of the header. An up arrow indicates the Viewpoint Processing Manual 2-4

13 documents are in ascending order. A down arrow indicates the documents are in descending order. Multiple fields can be sorted on by holding the shift key and then clicking each field in the desired sort order. In the above example, documents originally ordered by DocID are now ordered by Title. Group Documents by a Specific Field Documents can be grouped together based on a shared field value. To enable grouping on a grid right-click within the grid, hover over Filters and Groups and select Groups Panel. Performing these steps will place a new blue area at the top of the grid. You will now be able to click on a field, drag the field over the blue area, and release. Doing so will automatically group all documents sharing the same grouped field value together. In the below Viewpoint Processing Manual 2-5

14 example, documents have been grouped by the field BaseDocID. The BaseDocID field will group documents together based on family relationships. Each distinct grouping will have a separator bar providing the basis for the grouping and the number of documents found within this group. To the left of this information is a +/- button that can be used for collapsing the group. To quickly collapse or expand all groups, right-click in the blue area above the grid and select the appropriate option. Documents can also be organized by more than one group simultaneously. To add an additional grouping, click on an additional field; drag the field over the blue area, and release. Now documents will be grouped using both fields. Viewpoint Processing Manual 2-6

15 Documents in the above screenshot were grouped first by the author (DFORSTER) and then by extension (doc and xls). Removing Fields Fields can be removed from the grid. To do this, click and hold the field header you wish to remove. Then drag this field outside of the header area and release the mouse button. A black X symbol will appear over the field name to indicate the field will be removed. This functionality can be seen below. The DB Name field has been removed from the grid. Filters A single project within Viewpoint can contain millions of documents. Navigating to a single document or subset of documents can be difficult when having to consider the entire project at once. To ease navigation, Viewpoint uses filters to help users concentrate on smaller sets of data. Selector Filters Selector filters allow users to filter documents on a broad scale. Each filter and its contents are defined below. Filter Description The source selector combines filtering for custodians, scopes, and medias. A custodian is a descriptor of who a processed set of data belongs to. A scope is a single piece of evidence that is attributed to a single custodian. It is made up of one or more medias and is named after the Custodian and Data Location options selected during cataloging. A media is a subset of a scope. Each container (PST,OST,NSF, ect) within a scope becomes its own media. All documents within a scope not originating from an container create a single media. Viewpoint Processing Manual 2-7

16 A FileID is a file type recognized by Viewpoint. During processing the file type of each document is determined via file OLE or file signature. The document s actual extension is only considered if the file OLE or file signature is not detected. A file category organizes sets of FileIDs into broad groupings of file types. These groupings are based on the relevant functionality of the FileIDs. For example, users can filter on all multimedia files at once instead of selecting each document ID one-by-one in the FileID filter. A View is a subsection of data created in the review application. This filter allows users to select subsets of documents that have been isolated for review. This function is used most frequently to select all documents requiring tiffing. A Dedupe set is an organizational grouping of files checked for duplicates against one another. The Dedupe set filter is unique in that it is the only filter that will not filter documents from the processing grid. Instead, a field called Is Duplicate can be used to determine whether a particular document is considered a duplicate within the selected Dedupe set. Note: To clear all filters at once, hit the small button located in the bottom right hand corner of the Entity section. Field Filters Filter Documents by Text 1. Type the desired filter text in the blank cell located between the column header and the document list. 2. If desired, use the * symbol to apply a wildcard at the beginning of a filter. Viewpoint Processing Manual 2-8

17 In the above example from the Process tab, filters were added to show only documents that had an extension of doc and a title containing Search Fields All fields currently displayed on a panel can be searched simultaneously. Use Ctrl + F to open a search box. Any alphanumeric string inputted in this box will highlight in the panel no matter the field. To search for a phrase input the alphanumeric string with double quotes on each side (Ex. Samuel Chan ). To search for multiple strings at once apply a space between each (Ex. Samuel Chan MSG). Filter Documents by Exact Contents 1. Hover over the field header requiring a filter. 2. Click on the key symbol that appears in the top right corner of the field header. A list will appear that displays each unique variation that currently exists in that field. 3. Click on the desired values to filter that field. Note: For date field filtering we recommend using the Advanced Filter functionality described below. Advanced Filters Once a field filter has been applied, an option in the lower right corner of the grid will appear called Edit Filter. Clicking on this filter provides additional settings for creating filters. This window is also available by selecting Custom from the Filter and Groups section of the right-click menu. Viewpoint Processing Manual 2-9

18 Current filtering options are shown in the display. Users can add additional filters with the following steps: 1. Click the red text at the top of the filter to choose the type of Boolean operator to apply to this filter. 2. Click the plus sign next to the operator chosen in step 1. A new filter will appear prepopulated with filter options. 3. Click on the left blue text of the newly created filter. A list will appear with all available fields available in this grid. Click the field you wish to add a filter to. 4. Click on the green text of the newly created filter. A list will appear with all available operators. Click the operator that provides the scope of the desired filter. 5. Click on the right blue text of the newly created filter. Type in the value of the filter you wish to apply to the field. 6. Repeat steps 1-5 as necessary to create additional filters. 7. Click OK to exit the advanced filter window. The field grid will now reflect the results of all applied filters. Calculate Field Data 1. Right-click on the light blue area beneath the field you desire to calculate information from in a grid. 2. From the list of options that appear, click on the appropriate calculation to apply to the field. Viewpoint Processing Manual 2-10

19 Note: Some fields, such as DocID, have default calculations. Hide and Remove Field Filters Once a filter has been applied to a grid, a summary of the filter will appear in the lower left hand corner of the grid. Click the check box to temporarily hide the filter and display an unfiltered grid. The filter can be reapplied by clicking the check box once again. To completely remove all filters, click the X button to the left of the check box. Panels and Viewers Each tab of the processing application has a number of panels that can be customized to your viewing preference. Any window within the application that you can close by clicking an X button in the upper right hand corner is considered a panel. These panels display information pertinent to each processing phase. A viewer is almost identical to a panel except that it displays a document rendering rather than information. Viewers exist only on the Process tab and will render individual documents selected from a processing grid. Each viewer corresponds to a rendering of the document either found or created by Viewpoint. Viewpoint Processing Manual 2-11

20 Dashboard The buttons on the Dashboard section control which panels are visible on the Project tab. The positioning of these panels can be changed by using the Customize button in the lower-right corner of the Dashboard section of the toolbar. This will open a Customization window that allows the user to make changes to the panels. Rightclicking on an item from this window displays the customization options. Projects The Projects panel displays information about a selected project. Jobs The Jobs panel displays the number of workflows for the selected Group By option. This graph can be grouped by Project, User, or Task. Viewpoint Processing Manual 2-12

21 Worker Statuses The Worker Statuses panel the current state of workers. The outside circle displays the total number of workers, while the inside circle displays the total number of workflows. Disk Space The Disk Space panel displays the file server locations used by Viewpoint projects. Hovering over a section of the graph shows the used vs. free space of that location. Disk space is measured in Gigabytes. Worker Types The Worker Types panel displays the total number of workers on the outside circle. The data inside the circle shows how many workers are set to perform each type of task. Viewpoint Processing Manual 2-13

22 SQL server The SQL Server panel displays the percentage of CPU usage of the SQL Server. Resize a Panel/Viewer You can resize docked or floating panels/viewers. Docked panels/viewers display a thick border, called a splitter, between the panel/viewer and the rest of the work area. Dragging the splitter allows you to increase or decrease the size of the panel/viewer. For floating panels/viewer, drag any border or corner to resize its length and/or width. The Docking Function You can dock a panel/viewer vertically or horizontally on the right, left, top or bottom edge of the work area or float it anywhere on top of the Viewpoint window. To move a floating or docked panel/viewer, drag it by its title bar. When you drag a panel/viewer, two sets of icons appear to help you select a position for docking the panel or positioning multiple panels. One set displays icons around the perimeter of the work area and docks the panel/viewer at the corresponding edge. The other set, which initially appears in the center of the work area, helps you layer multiple panels/viewers in a single stack or position them adjacent to one other. To dock a panel/viewer, drag its title bar to an icon corresponding to the desired docking position. To float the panel/viewer, drop it anywhere on the work area except on an icon. The following table describes the function of each icon: Viewpoint Processing Manual 2-14

23 Icon Function Docks the panel/viewer at the top of the work area. If this icon appears within another panel/viewer then it will be positioned above the existent panel/viewer. Docks the panel/viewer at the bottom of the work area. If this icon appears within another panel/viewer then it will be positioned below the existent panel/viewer. Docks the panel/viewer on the left side of the work area. If this icon appears within another panel/viewer then it will be positioned to the left of the existent panel/viewer. Docks the panel/viewer on the right side of the work area. If this icon appears within another panel/viewer then it will be positioned to the right of the existent panel/viewer. Stacks panels/viewers on top of one another in layers. Tabs appear at the bottom of the panel/viewer area for displaying a panel/viewer in the stack. Move a Panel/Viewer 1. To dock a panel/viewer, drag it by its title bar and drop it on an arrow icon corresponding to the desired docked position. Release the mouse button when the shaded image of the panel/viewer appears in the desired position 2. To float a panel/viewer, drag it by its title bar and drop it anywhere in the work area, except on an arrow icon. Options for Displaying Multiple Panels/Viewers When you open multiple panels/viewers, you can display them in any of the following positions Individual Docked or Floating Panels/Viewers If you dock one panel/viewer in a vertical dock (left or right side) and another panel/viewer in a horizontal dock (top or bottom), the first panel/viewer you dock sizes to the full docking space, while the other panel/viewer resizes to fit the remaining docking space. Stacked in a Single Docked or Floating Panel/Viewer with Multiple Layers Stacked panels/viewers layer one on top of another, with the most recently opened panel/viewer on top. The name of each panel/viewer in the stack appears in a tab at the bottom of the panel/viewer area. Clicking a tab moves that panel/viewer to the top of the stack so that you can view it. Both floating and docked panels/viewers support stacking. When you move the stack, all of the panels/viewers move at the same time. Adjacent Panels/Viewers Sharing the Same Docked Area Panels/viewers can share the same docked or floating area. You can position panels/viewers adjacent to one another in any direction, above, below, left, or right. Viewpoint Processing Manual 2-15

24 Display Adjacent Panels/Viewers 1. Drag one panel/viewer on top of the other until a set of icons appear on top of the dragged panel/viewer. The icons that appear on top of the dragged panel/viewer correspond to adjacent positions rather than the perimeter of the work area. For example, the up icon places the dragged panel/viewer above the panel/viewer under it. 2. Drop the panel/viewer on the arrow icon corresponding to the desired adjacent position. Release the mouse button when the shaded image of the panel/viewer appears in the desired position. Stack Panels/Viewers 1. Drag one panel/viewer on top of the other until a set of icons appears. 2. Drop the panel/viewer on the stack icon in the center of the icons. 3. To display a panel/viewer in the stack, click the tab of the panel/viewer. 4. To separate stacked panels/viewers, drag the tab of the panel/viewer you want to move to another location in the work area. Auto-hide Function There are two behaviors for a docked panel/viewer; to always appear on top of the work area, or to hide automatically when not in use. This behavior is controlled by the Pushpin icon, which appears in the right corner of the title bar for docked panels/viewers. The pushpin points down when enabled and points left when disabled. By default, the pushpin is enabled and the panel/viewer always appears on top of the work area, sticking the panel/viewer to the window. Clicking the Pushpin icon unpins the panel/viewer. Three things happen when you unpin a panel/viewer: 1. The direction of the pushpin changes. 2. A tab for the panel/viewer appears. 3. The panel/viewer disappears into the border of the work area as soon as you move the mouse pointer off the panel/viewer. You can auto-hide multiple docked panels/viewers. To display a panel/viewer, either point to, or click the tab you want to view, or click the Pushpin icon to disable the auto-hide behavior. For stacked panels/viewers, the pushpin controls the pinning actions for all panels/viewers in the stack and creates a tab for each stacked panel/viewer. Saving and Loading Layouts After all settings have been customized to a user s preference, they should be saved to the database for future log-ins. All saved layouts within Viewpoint are saved to the SQL server and not the local machine. This means that after a profile has been saved, it will remain with the user regardless of what machine they log on from. Please note that only one layout can exist per user. To Save, Load, or Reset Panel/Viewer Placement Settings 1. Click on the Viewpoint logo in the top left corner of the application window. 2. Click on the appropriate layout option. a. Save Layout Saves current display layout to the user s profile. b. Reset Layout Changes the display to the last saved user layout. Viewpoint Processing Manual 2-16

25 To Save, Load, or Reset Grid Field Settings 1. Right-click on the grid with the settings you want to save or reset. 2. Hover over the option labeled Layout. 3. Click on the appropriate layout option. a. Save Layout Saves current display layout to the user s profile. b. Reset Layout Changes the display to the last saved user layout. Note: Each grid has its own unique layout and must be saved for the settings to be saved. Choosing to save a layout will not universally save all current grid settings. Viewpoint Processing Manual 2-17

26 3. Project Creation and Settings Creating a New Project Project Tab 1. To create a new project, click the Project tab. Then, place the cursor over the Project list grid, right-click and select New. 2. Select the appropriate Company from the drop down list, type in the Project name, select Active as the Status and specify the Time Zone. It is recommended that the Daylight Savings option is also checked. If a new company name is necessary, it can be added through the Security Management button. Note: The Initial Identity Value is for advanced troubleshooting and should remain at 1 unless you are directed to change it by CLCS staff. 3. Select the appropriate Process Server and File Server share or directory where all data will be copied to during data processing. There are options to specify individual directories for HTML, Text, TIFF, and Index files. When left blank, these options will default to the path specified in the File Server field. Before data processing begins, confirm that all processing and reviewer users have read/write permissions to the File Server location listed. Note: The Company and Process Server cannot be changed once data has been staged into the Project. However, any of the file server fields can be changed by right-clicking on the Project and selecting Update. 4. Click Save and the project will be created. You will see the Project defaults as shown below in the main PMC screen. Note: The DB Name/Project ID is how the database is identified on the SQL server and will auto increment by 1 as new projects are created. End users select Projects by the contents of the Name field in the review application. Custodian Info 5. Click on the Custodian button in the toolbar and the Custodian panel will appear. 6. This information answers the question: Who does the data belong to? Type the First and Last Name of a custodian in the last row on the list. Hit Enter to save and move on to the next entry. Last Name is a required field, the First Name is optional. To reduce the likelihood of spelling errors, it is recommended to copy and paste the names of custodians when possible. Viewpoint Processing Manual 3-18

27 a. To bulk insert multiple Custodians at once, simply copy corresponding columns from an MS Excel file. b. To insert Custodians directly from Active Directory, right-click in the Custodians grid and select Import from Active Directory. Data Locations 7. Click on the Data Locations button in the toolbar and the Data Location panel will appear. 8. This information answers the question: How did you physically receive the data? Typical examples include FTP, CD, DVD Hard Drive or Thumb Drive. Type the first applicable Data Locations in the last row on the list and hit Enter to save and move on to the next entry. Media Sources 9. Click on the Media Source button in the toolbar and the Media Source panel will appear. 10. This information answers the question: What kind of data is this? Typical examples include Active , Forensic Image or project specific data types. Type in the first appropriate Media Sources and hit Enter to save and move on to the next entry. Project Settings 11. Click on the Project Settings button on the Project Toolbar to display the Project Settings menu shown below. Viewpoint Processing Manual 3-19

28 Note: All options apply to the entire Project. Settings that show True and False can have no other entries. Standard Processing Settings By default, the only settings shown are those most commonly configured on a given project. To see all project settings, checkbox the Show Advanced Settings button on the lower left hand corner of the window. Descriptions of all processing settings can be found below. Catalog Standard Settings Setting Description Recommended Setting Automatically Slipsheet Corrupt Files A true selection means any document detected as corrupted by Viewpoint will be given a placeholder file information sheet during processing. False Documents may be described as corrupt due to insignificant user permissions, network storage space, or other configuration issues. To avoid documents being slipsheeted as a result of human error, CLCS recommends this setting remain false. Create HTML Standard Settings Setting Description Recommended Setting Remove Owner from Message Header of s A true selection will have E- mail HTMLs created using the LDHTML and LMHT methods omit the message owner. False Typically the message owner information corresponds to the custodian name and provides a clean looking representation of an . However, in certain circumstances when is collected from a repository the rendering will contain irrelevant information. In those situations, this option should be set to true. Create Text Standard Settings Setting Description Recommended Setting Identify Foreign Languages OCR Images Source A true selection means documents with successful text extraction will be checked for 64 distinct languages. Any detected languages will be found in the Languages field. Any selection other than false indicates that documents with no text extraction will attempt to have text generated through the OCR tool selected. Determines the source to be used for creating searchable text of a document. False Detecting languages in documents will slow down data processing and should not be turned on if it is unnecessary for the project. However, if languages need to be detected at a later point in the case, new text will need to be created for every document. None OCR is a slow process and is not recommend to be turned on for initial data loading. Depending on the nature of the case, users may isolate common text image file types (pdf, tiff) and OCR this subset. Other file types that typically contain only graphics (jpg, png, ect) may not require OCR text. Each project should be evaluated independently to determine pertinent OCR needs. FileID Settings The FileID Settings option means the system will create text based on the settings of the detected FileID (not the file s extension). For documents with redacted text the Viewpoint Processing Manual 3-20

29 TIFFs settings should be used to create new OCR text. The TIFFs feature can also extract text from other file types that don t contain native text (psd,eps,ps) by tiffing and then running OCR on the generated tiffs. Create TIFF Standard Settings Setting Description Recommended Setting Color Settings for Efiles Color Settings for s Tiffing Method Users indicate if edocs will be printed in black and white, grayscale, or full color or b&w. Users indicate if s will be printed in black and white, grayscale, or full color or b&w. Determines the source to be used for creating tiffs of a file. Black and White for Better Images Black and white is the required setting for the majority of electronic discovery agreements. It is also the fastest setting and will provide the smallest available file size per tiff. The setting Black and White for Better Images provides half-toning tiffs, creating grayscale quality images that still meet black and white production requirements. Black and White for Better Text Black and white is the required setting for the majority of electronic discovery agreements. It is also the fastest setting and will provide the smallest available file size per tiff. The setting Black and White for Better Text performs no half-toning. The resulting tiffs print with clean fonts and crisp edges. FileID Settings The FileID Settings option means the system will create tiffs based on the settings of the detected file ID (not the file s extension). For problematic documents, users can attempt to tiff with Quick View Plus or Microsoft Word. Extract Standard Settings Setting Description Recommended Setting Extract Embedded Images from MS Office Documents as Separate Documents A true selection means any image found in a Microsoft Office file will become an individual record in the processing and review databases. False Embedded images will be visible in the review Doc viewer and any tiffs created for production. Unless these images require separate tagging from the MS Office document, they do not typically necessitate their own record. Extract Icon Embedded Objects from MS Office Documents as Separate Documents A true selection means any icon embedded object found in a Microsoft Office file will become an individual record in the processing and review databases. True An icon embedded object comes from a file that has an icon link to another distinct encased file. A common example of this is a word document with an icon link to a Microsoft Excel or PowerPoint file. These documents are not rendered in the Doc viewer and are recommended to be their own distinct documents. This also avoids confusion during Viewpoint Processing Manual 3-21

30 Extract Inline Embedded Objects from MS Office Documents as Separate Documents A true selection means any inline embedded object found in a Microsoft Office file will become an individual record in the processing and review databases. production as embedded icons will be visible in any created tiff images. False An inline embedded object comes from a file that has either another complete document or subsection of a document encased within. A common example of this is a Microsoft PowerPoint document with an Excel chart or table inserted. These inline embedded objects are still fully searchable within Viewpoint and do not typically require their own record. Index Standard Settings Setting Description Recommended Setting Index Slipsheeted Documents A true selection means DTSearch will attempt to index slipsheeted documents. False Typically slipsheeted documents such as system files or application specific files will be difficult to index through DTSearch. By changing this option to false, DTSearch will not attempt to index these problematic files. Changing this setting to true will have DTSearch attempt to index all non-ignored files, but risks sticking on each problematic files. Maximum Number of Documents per Index This setting tweaks the maximum number of files that can exist within a DTSearch index. 20,000 Each media within Viewpoint receives at least one index. Once the maximum files setting is reached, an additional index is created for the media. 20,000 files has been found by CLCS to be a number that typically allows for optimal balance between the size of the indexes and number of indexes to search. Metadata Standard Settings Setting Description Recommended Setting Expose all Excel Content A true selection means all hidden content in Microsoft Excel files will be revealed during the metadata process and visible during Viewpoint Review. False If this setting is set to true, processing throughput will diminish significantly. There is no chance of accidently missing content as hidden text will be searchable through the review interface s Text viewer. Hidden content will also be revealed during tiffing and present on all produced tiffs. For documents where this functionality during review is necessary, the process can be run only on the relevant subset. Advanced Processing Settings Note: The below settings are items that typically do not need to be configured per project. They should only be changed by experienced users that have a specific non-standard requirement to address. Viewpoint Processing Manual 3-22

31 Catalog Advanced Settings Setting Description Recommended Setting Automatically Ignore NIST Files A setting of true means any standalone files found to belong on the National Institute of Standards and Technology (NIST) system files list will be ignored during processing. True Keeping this setting as true will prevent any files known to be system created from being posted to review. This list is maintained by the Department of Justice and used for filtering as standard practice of e-discovery requests. Automatically Slipsheet NIST Files A setting of true means any files found to belong on the National Institute of Standards and Technology (NIST) system files list will be slipsheeted as system files during processing. True Keeping this setting turned to true will prevent any files known to be system created from being posted to review. This list is maintained by the Department of Justice and used for filtering as standard practice of e-discovery requests. Do Not Stage Ignored Files Send when Media Extraction / Indexing Complete Skip Already Staged Files SMTP Server Address Users can select this option to skip staging of ignored files due to them being system files or having specific file extensions. A setting of true means that when a job is completed in the workflows tab, an notification will be sent to the user who started the process. A setting of true means that a previously staged document will not be processed again as a separate record in the same media. Used with the Send when Media Extraction/Indexing Complete option. Fill in with the name of the SMTP Server to receive s for completed processing. True A setting of True will speed up processing time without risk of skipping staging of needed files. False This setting should be defaulted to false if a team is continuously monitoring processing status. The setting should be defaulted to true for users who have a small number of processes to run and will not be continuously monitoring the status. Users must also fill in the SMTPServerAddress option for s to be sent. True This setting is useful when processing data from a location where cataloging failed due to a file server failure. Keeping the option to true ensures that a folder can be re-catalogued without having two copies of a file be processed. Leave Blank Used only if users wish to receive processing complete s. Please see Send WhenMediaDone setting. Example (smtp.lateraldata.com) Common Advanced Settings Setting Description Recommended Setting Custom Job Description When utilized, the Workflow tab will display the provided name rather than a generic name describing the submitted tasks. Leave Blank Typically individual jobs do not need to be tracked after they have successfully completed processing. This option should be used in situations where you are submitting similar jobs that are otherwise indistinguishable, or you want to Viewpoint Processing Manual 3-23

32 Force Language Encoding for EMLs and MSGs Use Detected File ID for Processing For EML and MSG files where the language encoding has been saved incorrectly, users can indicate the actual encoding. A setting of true means that where needed, the system will temporarily change the file extension to match the file id while processing. This is only required when files with an incorrect extension cannot be opened with the native application pertaining to the file id. tie it to a non-viewpoint tracking system, such as a work request number. Leave Blank This setting is only used for advanced exception handling and should not be used without direction from CLCS. True A true setting means the system will temporarily change the file extension to match the file id. There is no negative outcome of the process. It is assumed that where needed, the user will want this to occur automatically. Create HTML Advanced Settings Setting Description Recommended Setting Create HTML for s HTML Type Remove External References from s A true selection means all document types will have an HTML rendering created upon staging. The HTML type generated links to the HTML Type setting. Determines the type of HTML to be generated for s. A true selection means any processed will be stripped of any non-text content. True All s must have HTML files generated for Viewpoint review and tiffing. Only turn this option off if a very small number of s will need to be reviewed or produced and you would like to run this process on the data subset. LDMHT The LDMHT setting will provide the best formatted version of an with all embedded images present. The LDHTML setting will provide a formatted version of the without images present. The DTSearchHTML will provide an alternative formatted version of the document in instances where the LDMHT/LDHTML version throws an exception. False This setting is only used for advanced exception handling. It should not be used without direction from CLCS. Create Text Advanced Settings Setting Description Recommended Setting Expervision OCR: Language This option is used to force Expervision to look for and prioritize a specific language when creating OCR text. Default Users will typically not know the language of an image document without a human review. Forcing Expervision to a specific language should only be done after a user confirms what language to look for. Viewpoint Processing Manual 3-24

33 Tiff and OCR Documents with Text Errors Use DTSearch for MS Office Documents A setting of true will cause any document with a Create Text error to be tiffed and OCRed. The tiffs used to generate the OCR will be deleted. A setting of true means that Microsoft Office documents will be indexed and searchable through DTSearch. False This option should only be used in situations where all image file types (jpg, png, ect.) require OCR text. To disable this option for a certain File ID, open the File Identity Details window and select the Ignore Auto Tiff/OCR Setting checkbox. True This setting should only be turned to false in cases where DTSearch cannot index a non-corrupt Microsoft Office document. Changing the setting to false forces the system to attempt to copy out any visible text from the document. Create TIFF Advanced Settings Setting Description Recommended Setting Complete Printing Timeout (min) Override Redacted TIFFs Users can toggle the maximum number of minutes allowed for a document to finish tiffing. If a document does not finish tiffing in this time period, an error is generated. A setting of Allow redacted TIFFs to be overwritten will allow users to override existing redacted tiffs with new un-redacted tiffs. 20 The default setting of 20 minutes gives ample time for the majority of documents to tiff completely. This setting should only be moved up to complete tiffing of files with very large page counts. Do not allow redacted tiffs to be overwritten Users should never replace redacted tiffs unless they are certain they will no longer be used again. Once tiffs are replaced, they cannot be regenerated. Any redacted files needing new tiffs should be fixed in isolation. Start Printing Timeout (min) Users can toggle the maximum number of minutes allowed for a document to begin tiffing. If at least one tiff image is not created in this time period, an error is generated. 2 The default setting of 2 minutes gives ample time for the majority of documents to begin tiffing. This setting should only be moved up to complete tiffing of files that either take a very long time to load prior to tiffing or documents that spool printed pages. Tiff Orientation Users can choose whether all generated tiffs should be portrait or a possible mix of landscape and portrait orientation. Force Portrait Having all documents in portrait format leads to a uniform review and production process. Documents should be printed in original format if the parties involved would like to have all images printed in a way more true to the original content. Extract Advanced Settings Setting Description Recommended Setting Bloomberg: GMT Date Offset When processing Bloomberg s, this option can be used to adjust the time zone of the s 0 This option should only be used when processing Bloomberg s that were not collected in standard GMT format. Viewpoint Processing Manual 3-25

34 positively or negatively to correspond to GMT time. Bloomberg: Regular Match Expression for Attachment Archives Bloomberg: Regular Replacement Expression for Attachment Archives This option can be used to indicate what character should be used to indicate an attachment in a custom Bloomberg XML formatted . This option can be used to indicate what character should be replaced to indicate an attachment in a custom Bloomberg XML formatted . Leave Blank This setting is only used for advanced data handling and should not be used without direction from CLCS. Leave Blank This setting is only used for advanced data handling and should not be used without direction from CLCS. Skip Extraction of Errored Items from Archives A setting of true means that Viewpoint will skip over problem e- mail archives during extraction without stopping at error files. False This setting should be set to true for error handling only. Certain containers (pst, nsf, etc.) may have extraction errors occur during processing. For these documents, attempt to resolve the extraction issues on an individual basis. Any containers that cannot be resolved through manual exception handling should be reprocessed with this setting turned to true. Hash Advanced Settings Setting Description Recommended Setting Deduplication Hash Type Determines whether documents will be hashed using the MD5 or SHA1 method. MD5 There is no difference in functionality when choosing the two hash methods. This selection should be made based on user preference or project specifications. Index Advanced Settings Setting Description Recommended Setting Alphabet File (ABC) for DTSearch Indexing Create Accent Sensitive Index Users can link to the UNC path of an.abc file that contains indexing rules for all documents to be indexed with DTSearch. A setting of true means that Viewpoint will consider accented characters as distinct from unaccented characters during keyword searches. Leave Blank Users can use a custom alphabet file to index characters such as % and + that are not normally searchable within DTSearch. Making special characters searchable will slow down indexing and potentially alter search strategies and results. Therefore, this option should only be used in cases where indexing these characters is paramount. False There are a variety of words that are often represented in either accented or unaccented form interchangeably. A good example of this is the word résumé which is more commonly written as resume. This option should be set to true only in Viewpoint Processing Manual 3-26

35 Create Case Sensitive Index File Type File (XML) for DTSearch Indexing Hyphen Treatment Maximum Word Length (32-128) Noise File (DAT) for DTSearch Indexing Only Index Non-Indexed Documents A setting of true means that Viewpoint will consider the case of letters within a word during keyword searches. Users can link to the UNC path of a XML file that contains all file types to be indexed with DTSearch. Users can decide if they want to treat hyphens as spaces, treat them as searchable, ignore them, or all of the above. Users can increase the maximum character count per string allowed for indexing. Users can provide a full UNC path to a text file of words that should be ignored during searching. A setting of True means that only those documents which have not been indexed will be indexed for the selected media. instances where considering an accent has a notable impact on search results. False In most instances, case sensitivity should be turned off to prevent a word from not being searched if it is capitalized at the start of a sentence. This option should be set to true only in instances where a commonly used word is also used as a proper noun or acronym in your data set. Leave Blank This setting is only used for advanced exception handling and should not be used without direction from CLCS. Enable all options Enabling all options will help ensure that keyword searches bring back all expected results. When enabling all options, a hyphened word is added to the index multiple times, once for each option formatting. The word firstclass for instance would be indexed as first-class, first, class and firstclass. 32 This setting should be left as is unless adjustment is specifically required. Deviating from the default value will decrease index speed. Leave Blank By default, Viewpoint does not using a Noise File and therefore all words are indexed. Use a custom file here to skip indexing of certain words such as the, if or any others. False This setting should only be used when indexing large medias in order to speed up the index process by only indexing those documents which have not been indexed yet instead of re-indexing the entire media. Specify Metadata or Custom Fields to Index User can input any desired ex field to index by inputting table name followed by field name with a period in between (e.g. EDocFileSystem.OrifileFolder). Custom Fields and addresses may also be indexed by inputting EDocCustomFields or EDoc Addressee. This will index all custom fields or addresses respectively. Leave Blank User can specify metadata that needs to be indexed. Those metadata values will be added to the text file indexes and available as part of the normal search functionality. Viewpoint Processing Manual 3-27

36 Specify Phrases to Exclude from Indexing Users can select one or more phrases to be excluded from the index during keyword searching. This setting can be used to help remove phrases that obfuscate keyword search results. When using this option, each line represents an individual phrase. We recommend that you copy the text directly from a documents text file, rather than from one of the Viewpoint viewers, for the best possible results. Metadata Advanced Settings Setting Description Recommended Setting Collect Non- Standard Metadata A setting of true will collect metadata not available in standard Viewpoint fields and place them in a single field called Metadata, available for viewing in the Raw Data viewer under the EDoc heading. False The metadata information should only be collected only in situations where this information needs to be searched or made visible in some way. Collecting this information unnecessarily will result in much larger than typical databases. Miscellaneous Advanced Settings Setting Description Recommended Setting Lotus Notes ID File Path Passwords Dictionary File Path Remove Restrictions from PDF Documents Users can set the ID file to be used for extracting the contents of an NSF file. Users can link to the UNC path of a text file that contains a list of passwords. Each password on this list will be attempted on all password protected containers, PDFs, Microsoft Office documents, and archive containers. A setting of True means that Viewpoint will attempt to remove restrictions on a PDF document for printing, content copying, and so on. Leave Blank Typically, the same id file will not work for all NSF files in a project. It is therefore recommended to use this option on a job basis rather than a project-wide basis. Any passwords required for opening the NSF should be utilized with the Password File Path option. Leave Blank This option should be used with a commonly found dictionary file or one generated by the user. False This option should be used on PDFs that can t be tiffed or processed correctly and can be used in conjunction with the Password Dictionary File Path option. Removing restrictions will affect the format in which the document is ultimately delivered, so it is recommended only to do so when necessary. Viewpoint Processing Manual 3-28

37 Configuration Settings Application administrators have the ability to make changes to many of the global configuration settings without needing to use the Viewpoint Installer package. Please pay close attention to any changes made here, as they can have serious effects on the functionality of the application. Please contact support if there are any questions prior to making any changes. Auto Slipsheet Settings and Auto Ignore Settings The Auto Slipsheet and Auto Ignore settings are settings that automatically handle file types that are known to be non-reviewable or not visible without an application specific viewer. A file s type is determined during the FileID task where the signature and header of a document is read. The extension of a document is not used to determine file type unless a valid file header or signature cannot be detected. A slipsheet is an information sheet that is visible during review and production in lieu of a document that cannot be rendered within a near-native viewer. An example of this is an AVI document that needs to be reviewed in a video application. The ignore function of Viewpoint prevents a document from being copied from the processing to the review database. Ignoring documents will not remove them from any reporting, but will hide them from unintentionally attorney review. An example of this would be a PST file. Once the PST file is extracted, all of the found s and attachments are copied to the review database for potential attorney review. The PST file itself should not be reviewed and is automatically ignored by Viewpoint after extraction is complete. Viewpoint Processing Manual 3-29

38 To Apply Auto Slipsheet Settings 1. In the toolbar of the Project tab, click the Auto Slipsheet Settings button. 2. Checking a box on the left side, which contains categories of file types, will automatically check all the boxes for the applicable FileIDs on the right side. Conversely, unchecking a file category box will uncheck all of the individual FileIDs on the right side. 3. Individual FileIDs can be slipsheeted by checking the box for that specific FileID from the right side. 4. Click OK to confirm. Recommended Auto Slipsheet Settings To Apply Auto Ignore Settings 1. In the toolbar of the Project tab, click the Auto Ignore Settings button. 2. Checking a box on the left side, which contains categories of file types, will automatically check all the boxes for the applicable FileIDs on the right side. Conversely, unchecking a file category box will uncheck all of the individual FileIDs on the right side. 3. Individual FileIDs can be ignored by checking the box for that specific FileID from the right side. 4. Click OK to confirm. Viewpoint Processing Manual 3-30

39 Recommended Auto Ignore Settings Slipsheet Template Modification 1. Click on the Project tab and click on the Slipsheet Template button. 2. In the Slipsheet Template window that appears make any desired changes to the HTML code. 3. Once any desired changes have been inserted, insert a value into the DocID field and click test. This will allow you to generate a sample slipsheet based off any changes that have been made. 4. Once changes have been verified, click on the Ok button to finalize the alterations. All new slipsheets created for the selected project will be based on this code. Custom Field Management Click the Custom Fields button on the Project tab to display the Custom Fields Manager seen below. Custom fields are used for reviewer coding and document metadata not mapped to a Viewpoint Processing Manual 3-31

40 Viewpoint system field. For information on loading information in bulk to a custom field, see the Import section of this manual. 1. Type a caption for the desired custom field. 2. Select the type of field. You can choose between text, single value pick list and multi value pick list. 3. If a pick list is chosen for either the single select or multi select type, enter in the list of available selections. The first entry should be a blank space followed by a comma so end users are able to remove a selection. Each entry should be comma separated without a space between. 4. Choose from among the available format types. If pick list was chosen for type, string must be selected. 5. The format string is used to specify the formatting of the values inputted. This will most commonly be used for dates. In the screen shot above you can see the most common example, dd/mm/yyyy. Note: Please see Appendix A - Custom Field Guideline for additional format syntax. Other Project Phase Options Extensions Opens the Extensions panel where you can view a report of all extensions that currently exist in a project. System Status Opens the System Status panel where you can view all active processing across the SQL server. The Clear and Clear for Completed Jobs button removes workflows from this panel. Security Management Opens the Security Management window where user permissions are managed. This is also the window where new company names must be added. Viewpoint Processing Manual 3-32

41 Copy Settings/Layout From Existing Project or Create Project Template Right-click over an existing project in Projects window and select Duplicate Project Structure. This will create a new project based on the settings from the current project. You can save this as a template or use it as a new project. If you want to save as a template, make sure to change the name and the status to Template. Update/Change Project Information 1. Click on the Project tab and locate the Projects window. 2. Right-Click over the project and select Update from the drop down menu to display the Create Project window. 3. Make the desired changes and click OK to save. To Create a Review Database 1. In the Project tab, right-click over the appropriate project and select Create Review Database to display the Create Review Database wizard shown below. 2. Choose the SQL server that will house your data review and click Next. Viewpoint Processing Manual 3-33

42 3. Input your user name and password and click Next. 4. Select the company to associate with this database and click Next. If the company name required is not present, it must be created in the review application. If you have permissions to modify security within the review application, click on the Security Management button to quickly move to the review Security Management module. 5. On the Load From Template window you can select a currently existing database to use as the basis for your new review database. Choosing an existing database will copy all folders, tags, and automation levels from that database to your new project. Viewpoint Processing Manual 3-34

43 6. Click Finish to complete the wizard. Viewpoint Processing Manual 3-35

44 4. Launch Processing Catalog Tab The toolbar above is used to dictate which processes will run when you launch data for processing. The processes and options are described below. Click on each button for the particular process you want run. The recommended selections for processing are highlighted in the above screenshot. FileID Captures the type of file being processed by reading the file OLE or signature information rather than the extension. File extension is used if no matching OLE or signature is found. Hash Calculates the MD5 or SHA1 Hash Code values for each document. Extract Will extract all attachments from files, compressed archives and loose electronic files. Microsoft Office embedded content extraction is based on the project settings. Metadata Collects the metadata from each document. This includes file system data as well as the document s application specific metadata properties. Text Extracts text from and e-files. Runs OCR for image files. Recursive Enables the system to continually process the complete contents of an archived file. The system will continue to drill down until all archived files have been extracted and processed. This option only applies to jobs utilizing the extract task. Local Allows for processing of a small number of jobs on the local machine versus launching to the worker machines. Required when staging from a local drive. Process After all appropriate settings have been assigned this button is used to begin data processing. Select Data to Stage and Process 1. Enter in the file path to the folder containing the data that is to be staged, either by typing the path directly into the Path text box, clicking the ellipsis button to the right and browsing to the folder location, or clicking the + to the right of the ellipsis to open the Catalog Source Wizard. Once a path has been selected, click the green + icon to display the folder and its contents in the catalog window. To remove a folder from the catalog window, right-click on the folder and select Remove. 2. If the data is located in folders named by custodian, check the Use folder name as default custodian option for the custodian info to propagate to all the folders automatically. If this option is checked, do not fill in a value for Custodian as described in step 5 below. Viewpoint Processing Manual 4-36

45 3. Verify that the Efile Path, Text Path, Html Path, PDF path, TIFF path, XML path and Slipsheet path are all mapped to the appropriate file servers. By default they will map to the path set in the initial Project settings under File Server. If any of the paths are incorrect, go back to the Project tab and update the paths by right-clicking on the project and selecting the Update option. 4. Click the + to the left of a folder icon to expand the contained files and folders. To recursively expand a folder tree to display everything contained within, right-click on the folder and select Expand. Users can also browse to the directory storing a file or folder by right-clicking and selecting Navigate to 5. Click the check box to the left of any data to be processed. Selecting a folder will also select any contained items within the folder. Fill in the Description (if applicable), the Data Location, Custodian, and Media Source fields for each checked item. Everything but the description field will be available as drop downs from the names and categories that were input during project setup. You can add new values at any time by going back to the Project tab, selecting the appropriate category, and inputting new values. To load the same information to multiple folders at once, check all pertinent folders, right-click, and select Fill Checked Fields. In the window that appears, fill in all details pertinent to all selected items. Once everything is confirmed the data will be ready to launch for processing. Note: The scopes created from cataloging will be named [Custodian] [Media Source] [Data Location] (YYYYMMDD). To load multiple sets of data from one custodian into multiple scopes, right-click on the column header row and click the Column Chooser option, and bring in the Media Creation column. Then select the Force New Scope option from the dropdown options in the Media Creation field. If this option is not selected, multiple selections for the same custodian may combine into one scope. Process Data 1. Once all of the data has been designated with the appropriate Custodian, Data Location, and Media Source for each data source and the FileID, Hash, Extract, Metadata, Text, and Recursive buttons have been selected, click the Process button. 2. On the command wizard window, confirm that the tasks selected match the five tasks selected in step 1. There is no need to utilize the CreateTiff or CreateHtml tasks at this time. After confirming the settings, click Next. 3. Confirm that the recursive option is selected and that the priority is set to 0. Click Next. Note: The Priority setting is used to determine the urgency of a submitted process. All submissions should have a priority of 0 unless they need to occur before previously submitted process. 4. The project settings pane will appear. Confirm that all settings match the project specifications. Once all settings have been confirmed, click Next. 5. Select a specific error handling maintenance script if desired. User can customize scripts to handle and clean all errors in desired way after processing has been completed. Full Error Viewpoint Processing Manual 4-37

46 Cleanup and Partial Error Cleanup scripts are built into the wizard for exact use or as templates for unique scripts. 6. A summary of all settings selected will appear. Click Process to begin loading the data into Viewpoint. A notification will appear in the lower right hand corner of your monitor when processing is complete. Note: The Process button is located on each page of the process wizard. Select this button at any point to skip the sub-sequent wizard pages. To Catalog Data Locally 1. Once all of the data has been designated with the appropriate Custodian, Data Location, and Media Source for each data source be sure that the FileID, Hash, Extract, Metadata, Text, and Recursive buttons are all deselected. 2. Click the Process button. 3. On the command wizard window, confirm that no tasks are selected. After confirming the settings, click Next. 4. Confirm that the recursive option is selected and that the priority is set to 0. Click Next. Note: The Priority setting is used to determine the urgency of a submitted process. All submissions should have a priority of 0 unless they need to occur before previously submitted process. 5. The project settings pane will appear. Confirm that all settings match the project specifications. Once all settings have been confirmed, click Next. 6. A summary of all settings selected will appear. Click Process to begin loading the data into Viewpoint. A window will appear in the lower right hand corner of your monitor when processing is complete. To Process Data on a Specified Worker(s) 1. Once all of the data has been designated with the appropriate Custodian, Data Location, and Media Source for each data source and the FileID, Hash, Extract, Metadata, Text, and Recursive buttons have been selected, click the Process button. 2. On the command wizard window, confirm that the tasks selected match the five tasks selected in step 1. There is no need to utilize the CreateTiff or CreateHtml tasks at this time. After confirming the settings, click Next. 3. Confirm that the recursive option is selected and that the priority is set to 0. Click on the Batch button. On the Worker Selector window that appears, check the worker(s) to be used for processing data and then click Ok. Note: The Priority setting is used to determine the urgency of a submitted process. All submissions should have a priority of 0 unless they need to occur before previously submitted process. 4. The project settings panel will appear. Confirm that all settings match the project specifications. Once all settings have been confirmed, click Next. 5. A summary of all settings selected will appear. Click Process to begin loading the data into Viewpoint. A notification will appear in the lower right hand corner of your monitor when processing is complete. Viewpoint Processing Manual 4-38

47 5. Monitoring Processing Workflow Tab The Workflow tab is used to monitor any ongoing and completed processing. The tab is also used to clear historical information about data processing. This tab requires frequent maintenance to ensure Viewpoint runs efficiently. Workflow Glossary Processing The general term for the act of submitting one or more tasks (such as Create Text or Create Tiff) for completion. Job Once data is submitting for processing, all tasks within that process are considered a single job. The status of any submitted job can be tracked with the Jobs panel. Workflow Each job is made up of workflows. Each file gets one workflow per task. In addition, one workflow is created to handle distributing the files among workers. For example, if a user submits 10,000 files for both the Create Text and Create Tiff tasks within Viewpoint they are submitting a total of 20,001 workflows. 10,000 workflows for the Create Text task, 10,000 workflows for the Create Tiff task, and 1 workflow to distribute the tasks among workers. Event Events describe what actions have occurred to a particular workflow. A typical example would be when and on what worker machine a task was completed. Worker Selector The Worker Selector controls the status and properties of all Viewpoint worker machines. Worker Color Coding Dark green Indicates the worker is actively processing. Light green Indicates the worker is idle. Red Indicates the worker has stopped processing or is stalled. White Indicates the worker is not running. To Start a Worker Machine 1. Clicking the Worker Selector button in the Workflow tab displays the Worker Selector window shown below. Viewpoint Processing Manual 5-39

48 2. Select workers with a Host Status of NotRunning by highlighting them or clicking the check boxes to the left of their name. 3. Once the workers are selected, right-click and select Start Workflow Host. The window below will appear. 4. Confirm the Log In, Executable, Remote Internet Explorer and Install Url information is correct and click OK to start the workers. Once they are started and available they will each have a light green background upon refresh. To Stop a Worker Machine 1. Select workers by highlighting them or clicking the check boxes to the left of their name. 2. Right-click and select the Shutdown Workflow Host option. To Assign/Unassign Workers 1. Select workers by highlighting them or clicking the check boxes to the left of their name. 2. Right-click and select the Assign Project or Assign Project Exclusively option. Workers can be assigned to multiple projects at once by using the Assign Project selection. Workers are assigned to only one project if the Assign Project Exclusively option is selected. Processing jobs submitted from other projects will not be picked up by these workers. 3. To unassign workers from a project, right-click and select Clear. Viewpoint Processing Manual 5-40

49 Monitoring Worker Status The worker selector screen can be auto refreshed by selecting the appropriate option in the rightclick menu. Users can also refresh manually by selecting Refresh on the right-click menu. For any workers found to have a red background, users can log directly into the machine to investigate. To look at a remote desktop rendering of a worker, click on the Remote Desktop button on the ribbon and then select a worker from the Worker Selector. This will allow the user access to the machine through the credentials saved in the Start Workflow Host option. Once logged in, users can check the status of the machine and perform troubleshooting. Flagging Supported Features Some software within Viewpoint is considered optional and can be installed on a subset of workers in your environment. To let Viewpoint know which workers have this software the Supported Features field is used. When processing occurs that require these software, only workers with the appropriate designations in the Supported Features field will be used. A listing of all software supported is below. The entries for this field are case sensitive and must be entered exactly as shown. MountImagePro Indicates that Mount Image Pro is installed on a worker. This software is used to extract the contents of forensic images. WebserviceOCR Indicates that ExperVision OCR engine is installed on a worker. Assigning Workers to Applications Viewpoint allows for workers to be utilized in both the processing and review applications. In most situations, it is recommended to limit the number of workers available for both applications. This will allow end users to perform all requested tasks without interfering with any ongoing data processing. Using the Use Worker For field, users can indicate a worker to be used exclusively for actions from the processing application, exclusively for actions from the review application (including Build Views, Delivery, Advanced Tools and TIFF On The Fly), or available for both applications. Use the drop down menu in the Use Worker For field to designate the appropriate option for each worker. Workflow Lifecycle When a job is submitted, a number of actions occur before it is completed. To begin, Viewpoint determines if the workflows will be executed on the local machine, on a single worker, or distributed to all available/assigned workers. If the job is not being completed locally, the first workflow will be sent out to the selected or first available worker to act as a distributor. This workflow will then distribute the workflows across all available machines. Once a worker has been loaded with the number of workflows set in the Max Simultaneous Workflows field of the Worker Selector panel, other workers will be assigned remaining workflows. It is recommended that the Max Simultaneous Workflows setting is set to 10 for each worker to ensure even workflow distribution. If the Max Simultaneous Workflows setting is kept too high, workers may sit idle unnecessarily. Once workflows have been assigned, the worker will complete each workflow in order. While workflows are being completed, the distributor workflow will automatically assign out any remaining workflows. This continues until all workflows are processed and the job is complete. Multiple jobs can be run simultaneously so there is no need to wait for one job to finish before the next is submitted. Viewpoint Processing Manual 5-41

50 Jobs Panel The Jobs panel is accessed by clicking the Jobs button on the taskbar. A description of the current project s jobs, the current status of those jobs, and the number of associated workflows are displayed. The Id of each job is assigned in the order it was submitted. A completed job will have a status of Done. Any ongoing job will have a status of InProgress. For most tasks, users can determine the progress of a given job by looking at the difference between the contents of the # Workflows and Completed Workflows fields as seen below. For jobs where extraction or cataloging is occurring, the # Workflows field will continually rise as new documents are discovered for processing. In these circumstances, the difference between # Workflows and Completed Workflows may not provide an accurate assessment of current progress. To Cancel a Job 1. Open the Jobs panel by clicking the Jobs button in the taskbar. 2. Select the job(s) you wish to cancel by either highlighting or clicking the relevant checkbox. 3. Right-click in the Jobs panel and click the Cancel Job option. 4. The panel will refresh and the status of the cancelled jobs will change to Aborted. Note: For cataloging and extracting it is recommended that after a job is cancelled, any worker that was handling the cancelled processes should have the workflow host shutdown and restarted. This will ensure that no further extraction or cataloging occurs. After a job is cancelled, the distributor workflow will cease to hand out more work, but all workflows already assigned will continue unless the workflow host is shutdown. Workflow Filtering To determine details about a workflow, users can use the filtering options in the toolbar of the Workflow tab. Viewpoint Processing Manual 5-42

51 Status Indicates the stage of workflow being searched. If searching for errors, change this filter to Terminated. Workflow Indicates the kind of task the workflows utilized. # Workflows Indicates the number of workflow results to return. Max = 1,000 DocID(s) Users can provide a comma separated list of specific DocIDs to search. Process Indicates the type of application used to process the workflows. Worker Selector Users can use the checkbox functionality to filter to workflows that were completed on specific workers. Jobs Users can use the checkbox functionality to filter to workflows that were performed as part of specific jobs. Once all applicable filters have been applied, click the Apply button to see the applicable workflows. All pertinent information for the filtered items can be seen in the workflow window as shown above. To see detailed information about a particular workflow, users can highlight a workflow and then click the Events button. The Events panel will show specific details about when and where a specific workflow was executed. It will also show any errors that occurred during completion of the workflow. This information is typically used to troubleshoot a broad problem, such as a particular worker not having correct configuration settings. In instances where specific information about the worker name or time of completion is not necessary, users can simply troubleshoot from the Process tab. Viewpoint Processing Manual 5-43

52 Status Panel The Status panel provides information about all workflows across all projects. Its primary purpose is to give users a summary of how much data has recently been submitted and completed in the processing application. TotalCount The total number of workflows submitted or completed across all projects. FinishedWorkflows The total number of workflows that have completed across all projects. LiveInstances The total number of unfinished workflows. AvailableInstances The total number of workflows created, but not yet assigned to a worker machine for completion. Terminated The total number of workflows that completed with errors. RunningTime The time elapsed since the first reflect workflow was submitted. Clearing Workflows All of the workflow information described above is written to the processing SQL database. Although this information is valuable for troubleshooting, it should be cleared out periodically. If the information is not cleared, the tables hosting this information become very large and begin affecting the speed of data processing. To keep Viewpoint running smoothly, we recommend clearing out the workflow information at least once a week, after all outstanding errors have been resolved. Although error information will still be stored in the LDControl database s Log table even after clearing workflows, all other information about completed items will be lost. To begin clearing workflows, click on the Clear button on the taskbar. Using the Clear Completed Jobs option will clear workflow information from jobs that have a status of Done. Click the Clear for Current Project checkbox to only clear for jobs currently selected project. Using the Clear All Jobs option will clear all workflows in the database, including workflows from jobs that are in progress. This option should only be used when no Jobs are currently running and want to completely clear out the workflow information. After selecting an option, click the Next button. This window will show the number of jobs and workflows that will be cleared if the user continues by clicking the Clear button. Once the process completes a summary of all cleared Jobs data and the total amount of time it took to complete will be displayed. Viewpoint Processing Manual 5-44

53 6. Cleaning Data Process Tab Once all data finishes initial processing, it is ready to be cleaned. Cleaning refers to the act of ensuring that all data has been processed completely and all errors have been addressed. Processing Task Grid Each document cataloged in Viewpoint must undergo a number of tasks before it can be considered completely processed. In the processing grid each task is represented as a column. The processing tasks occur in order, from left to right, as seen in the screenshot below. Documents are given a status for each task of processing. All columns labeled as Filtered display the number of documents in each category as they relate to any applied filters. The second column, Stage, displays the number of documents in each category for the entire database, regardless of filtering. Additional fields are available by utilizing the Field Selector available on the right-click menu. The definition for each processing status is listed below. New Indicates files that have not yet received a designation for processing in this task. Typically these are files that have been cataloged, but have not yet had their FileID identified. Once the FileID is identified, files will be moved to their appropriate status category. Need to process Indicates files that require this task to be run, but have not yet been completed. Submitted Indicates the total number of files submitted to jobs for processing. Please note, any job that is cancelled will still have the files submitted stored in this category. Those files will not be redistributed to their original status. Error Indicates files that have not successfully completed the task. Done Indicates files that have successfully completed the task. Not Required Indicates files that do not require this task to be run. An example of this is an image file such as a JPG, will have a status of Not Required for the Extract task as image files do not conventionally store additional files. Bad This is a user created status. For any errors that cannot be corrected, users can change the task status to Bad rather than keep them stored in the Error category. Viewpoint Processing Manual 6-45

54 To View Files by Status 1. To see all documents for a specific status and a specific processing task (such as all documents with an extract error), double click on the cell containing the desired information. 2. To see all documents for a specific status across all processing tasks, double-click the name of the processing status. 3. To see all documents from across multiple statuses across all processing tasks, select each category with the checkbox functionality. Then, right-click within the status window and choose Show Results. 4. To see all documents in the project right-click and choose Show Results with no status chosen via checkbox. Processing Task Descriptions Stage Task This task involves finding a document, extracting system file metadata (created date, last modified date, file size, etc.), and creating a copy of the file saved in the standard Viewpoint structure with a unique DocID. Troubleshooting All categories except Done and Slipsheeted should display a zero. A staging error indicates that a document was found, but could not be copied to the network. This error may indicate an incorrectly configured permissions setting, such as the processing account does not have access to the file share where the files are being written. Other times, Viewpoint may be unable to extract an attachment to a file. In the Stage panel, right-click in the grid and then click Stage to attempt to restage any error files. If the file is an attachment, rerun the Extract task on the file s parent. If restaging is unsuccessful, errors should be slipsheeted as Unable to Extract. Extract Task This task involves finding documents within documents. The most common types of documents with extracted content are containers (PST, NSF, ect.) and compressed archives (ZIP, RAR, ect.). Other documents, such as Microsoft Office documents, may have embedded content which is extracted based on project settings. Troubleshooting All categories except Not Required, Done and Slipsheeted should display a zero. An extract error means the container is corrupt or that Viewpoint was able to find data within the container, but not extract it. Any time an extract error occurs, users should attempt to re-extract the data a second time. If the second attempt is unsuccessful, browse to the network location storing the container and attempt to open it. If it is corrupt, the container should be slipsheeted as such. Password protected containers should attempt to be cracked with the Passwords Dictionary File Path option. For more details on password cracking, please refer to the Viewpoint Password Removal document on our support site. FileID Task This task involves determining the true extension and function of a document. The file s signature and header is read to determine if the file s extension matches the file type. For example, a Microsoft PowerPoint document saved as File1.xls would have an extension of xls, but a FileID of Viewpoint Processing Manual 6-46

55 PowerPoint. If Viewpoint is unable to determine the documents FileID through signature or header analysis, the extension will be used. All documents in the FileID task should be viewed to search for extension and ID mismatches. To locate mismatches, open the FileID window. In the grid, bring in the field column Extension Match. Filter on this column to any documents that do not have a checkbox. These documents should be checked individually to make sure they have been identified correctly. In the above screenshot, five documents with an extension of dat have been detected as Microsoft Excel documents. To see if these documents are Excels, the user would double click on that document in the grid. If the document opens successfully in the detected FileID application, no further action is necessary. If the detected FileID is incorrect, users can bypass the FileID task and assign the document s true ID. Please see the section titled Setting a FileID to learn how to perform this action. Troubleshooting All categories except Done and Slipsheeted should display a zero. FileID errors are extremely uncommon. If an error is found, rerun the FileID process. Note: By default this task is not represented in the processing grid as errors for this task are rare. Hash Task This task involves determining the MD5 or SHA1 hash for a document. Every file, regardless of size or content, will have a unique hash code as determined by the MD5 or SHA1 algorithm. These codes are compared against a list of system files to find items with no user generated content. Files found to be on that list can be auto-ignored based on your project settings. The hash code for a document is also used for deduplication. Files where the hash codes of entire families are identical can be located and removed from attorney review. Troubleshooting All categories except Done and Slipsheeted should display a zero. Hash errors are extremely uncommon. If an error is found, rerun the Hash process. Note: By default this task is not represented in the processing grid as errors for this task are rare. Create Text Task This task involves creating a text extraction of processed documents. For documents that have a text layer (where text can be copied and pasted from), DTSearch will extract all contained text to individual files. For documents with no text layer (image files), a selected OCR engine can be used to create text. Viewpoint Processing Manual 6-47

56 Troubleshooting All categories except Done and Slipsheeted should display a zero. Text extraction errors are very common as most data populations contain image files. For files with an error message indicating that OCR was not turned off, these files can be reprocessed with OCR turned on. For files that have text, but have errors during text extraction, users can attempt to OCR the tiff images. To do this, create tiffs of the files in question. After the tiffs have been generated, run OCR over the files with the setting ForceTiffs in the Create Text Source setting. Create HTML Task This task involves creating HTML/MHT rendering for certain file types. Typically, the only file type that requires a HTML rendering is an . s without HTML renderings cannot be indexed or posted for review. When tiff images are created, the HTML rendering of the document rather than the original MSG/DXL file will be used as the source. Troubleshooting All categories except Not Required, Done and Slipsheeted should display a zero. Errors only need to be corrected if they pertain to file types. Occasionally Viewpoint is not able to create a LDHTML or LDMHT rendering of an file. If this is occurs, attempt to recreate the HTML using the DTSearchHTML method. Create TIFF Task This task involves creating single-page tiff images for redaction or delivery. Please note that any color settings (black and white, grayscale, or full color) that are applied at this time cannot be altered without recreating the tiffs. In the delivery module users have the option to export generated tiffs in single-page tiff, multi-page tiff or PDF formats. Troubleshooting All documents are found in the New or Slipsheet category until they are requested to be tiffed. For tiff errors, first check to make sure the FileID is correct. If incorrect, set the revised FileID and resubmit. If the FileID is correct, users should attempt to change the setting of the Tiffing Method option to ForceQVP. This will try to force the document to be printed in Quick View Plus. If a document cannot be printed, slipsheet it as Untiffable by following the below steps. 1. Right-click on the document in the Create Tiff panel, hover over Slipsheet, and select Slipsheet 2. Select Untiffable as the slipsheet reason and click OK. Metadata Task This task involves extracting application specific metadata. This includes header information (from, to, cc, etc.) as well as Microsoft office information (author, company, etc.). In addition, the Expand Excel function occurs during the metadata extraction. Viewpoint Processing Manual 6-48

57 Troubleshooting All categories except Not Required, Done and Slipsheeted should display a zero. For any errors, rerun the metadata task. Note: By default this task is not represented in the processing grid as errors for this task are rare. Slipsheet Task This task indicates files have been slipsheeted. All necessary tasks will be performed on a file before it is placed in this category. For example, a PST will have a status of Need to process for extract. If it does not finish successfully, it will be placed into the Error category. If the PST does successfully extract, it will then be placed into this Slipsheeted section. Documents categorized as Slipsheeted will not appear in the status column for any other task. DocIDs and Family Relationships Each document processed within Viewpoint is given a unique identification number. This number is called the DocID and is used for tracking documents throughout Viewpoint. A document that has been extracted will have an additional value called ParentDocID. The ParentDocID field shows the DocID of the document this item was extracted from. Files that were not extracted will have a value of 0 in the ParentDocID field. The term Family refers to documents that have direct association. The relationship between an message and its attachments is considered a family. The same is true for documents with extracted embedded content. However, items extracted from a container are not considered part of a single family. s extracted from a PST, for example, will all have the same ParentDocID, but are not considered part of the same family as they are not directly related. In a family, the source document (where the extracted files originate from) is considered the Parent. Any extracted files are considered Children of that parent. Some families have documents acting as both a parent and a child. If an has a ZIP file attachment the is considered the parent and the ZIP file is considered the child. However, when the contents of that ZIP are extracted, the ZIP now becomes the parent to any contained files. It is possible to have many families all originating from a single message. All families, regardless of complexity, will share the same BaseDocID. The BaseDocID is the DocID of the first parent document in the family. This field can be used to quickly show all documents from a given family. To Isolate All Parent or Children Files 1. In any processing task panel, click on the key symbol that appears in the top right corner of the DocID field header. 2. Select Custom from the filter list. 3. To display only parent files, use the filter DocID equals BaseDocID as shown below. Viewpoint Processing Manual 6-49

58 4. To display only children files, use the filter DocID does not equal BaseDocID as shown below. To Find a File s Parent or Children 1. Select the documents in any Process results panel. 2. Right-click, hover over Find, and select either All Parent Documents or All Child Documents. 3. The results will appear in the Search Results panel. Searching by DocID In the Process tab toolbar the Search button can be used to look-up a single DocID. Input a single DocID and click search to see the document in the Search Results panel as shown below. To input a list of DocIDs, click on Advanced Search button on the Process toolbar to display the window shown below. Viewpoint Processing Manual 6-50

59 One DocID should be input per line. A list of DocIDs can loaded from a text file by using the Import button. User Interface Scripts User Interface scripts can be used within Viewpoint to run pre-configured or custom C# scripts over processed data in order to search for documents based on specific elements. This open-ended approach allows users to have a large amount of flexibility when needing to display specific documents. The following scripts come pre-configured with Viewpoint: All s with Tiff Warnings All Errors Documents from Last Media Errors and Errored Slipsheets Latest Job Results To Run a User interface Scripts 1. Select the desired script from the drop down menu located in the Process tab ribbon 2. Hit the Execute UI Script button 3. The results will populate in the documents grid To Create a New User Interface Script 1. Hit the ellipses located to the right of the script drop down. 2. Right-click in the Maintenance Wizard and select New. 3. Replace the New Script text with that of your choosing. Viewpoint Processing Manual 6-51

60 4. Hit Next. 5. Input the custom c# and use the Verify button to confirm the correct syntax. It is recommended to base your code on one of the defaults scripts. 6. Hit Finish when complete. Project Notes Project Notes can be used to store historic information about particular documents or a particular notable occurrence. For example, if some documents required special handling users may choose to leave a note about how and why documents were processed a particular way. Users may also choose to leave notes about important events in the project life cycle such as the date a delivery was produced or the date of a deposition. Project Notes are meant to easily allow users to look up and review this information after a project has been inactive for some time. Create a New Project Note 1. Click the Notes button on the Process tab task bar. 2. Right-click and click New. 3. In the description box type in your full note. 4. In the documents box, you can click the ellipses button to open a dialogue to paste in a large number of DocIDs. This list is for situations where you may want to quickly reference specific documents in the future. 5. By default each note is private. To make this note available to all users with access to this project, click the Is Public check box. 6. Click Update to finish. Create a New Project Note from DocIDs 1. In any processing grid with a list of DocIDs, select one or more documents which require a note. 2. Right-click and click Create Note. 3. In the description box type in your full note. 4. In the documents box, you can click the ellipses button to open a dialogue to append any relevant additional DocIDs. Viewpoint Processing Manual 6-52

61 5. By default each note is private. To make this note available to all users with access to this project, click the Is Public check box. 6. Click Update to finish. Deleting a Project Note Once a note is created, it cannot be edited. To permanently delete a note, right-click a note from the grid and click Delete. Processing Grid Functionality Reprocess a Document Reprocessing a document is necessary to adjust task settings for a specific group of files without affecting the general settings for the entire database. It is also necessary to resubmit files for tasks that have not yet been completed, such as Create Tiff. 1. Select all documents to reprocess. 2. Right-click on the documents and click Process to display the Command Wizard shown below. 3. Select the tasks to be submitted and click next to show the menu below. Note: Double click specific task in process wizard to check that individual task and un-check all others. To skip subsequent options and skip directly to the last page of the wizard, click the Process button. Viewpoint Processing Manual 6-53

62 4. Select Local to reprocess locally or Batch if you want the job processed on a specific worker(s). 5. Click Next. 6. This window will appear with the default project settings related to the tasks submitted for completion. Change any settings as necessary and when finished, click Next 7. Review the information and click Process to complete the wizard and begin processing the job. Viewpoint Processing Manual 6-54

63 Set Task Status This process allows a user to manually change the task status of selected documents. It is not necessary to change the status of a document to re-process, but the functionality is useful for keeping any troubleshooting organized. For example, if there were multiple issues affecting a large amount of files, users may change the status of these error files to Need to Process, and then begin submitting them from this status. If additional errors occur, they would be clearly separated from data that has not yet been submitted for reprocessing. 1. Select the a document or documents with that particular FileID 2. Right-click and select Set Task Status from the menu to display the window below. 3. Modify the appropriate status on the right and click Update Status to save changes. Viewpoint Processing Manual 6-55

64 View a File Files can be viewed in a number of ways. Utilize the Viewers to see the corresponding rendering of a selected file during grid navigation. Double-click on a file to open it in its native application. Users can also browse to the network location of where a document is stored by right-clicking a selected document, hovering over Browse to, and then selecting the appropriate document rendering. Lastly, the user can use the below shortcuts to open a specific rendering of the file. Double clicking will open the Native file. Holding down CTRL and double clicking will open the Text file. Holding down ALT and double clicking will open the HTML file. If a rendering for a document does not exist, it will be greyed out, as seen above. If there is a file that is corrupt and you have obtained a replacement for it, you would use this command to place it in the correct location on the server. Media Player Using the Doc and Native Viewers, many multimedia files can be played directly in the application without the need to open the file outside of Viewpoint. If the file is compatible with the player and the Doc or Native Viewer is visible, it will automatically begin playing when the file is selected from the document panel. Viewpoint s media player makes use of Windows Media Player in the background. Note: Not all media files types will be compatible with the media player. If the file is unable to play directly in Windows Media Player outside of Viewpoint, it also will not be able to be played inside of Viewpoint. Users can, however, find and install 3 rd party codec packs for Windows Media Player, which will increase the number of supported file types that the Viewpoint Media Player will be able to play. Import or Replace a File Rendering For some error files, it may be necessary to take a file outside of Viewpoint for error handling. The most common example of this is password protected files. If a file is exported and has the password cracked, users can import the non-password protected version into Viewpoint for reprocessing. The version previously found on the network will be replaced with the newly imported version. 1. Select the document you wish to have a rendering replaced for. 2. Right-click over the document, select Import/Replace and select the appropriate rendering as shown below. Viewpoint Processing Manual 6-56

65 3. Map to the replacement file and click Open to execute the replacement. Export Grid Results to a Spreadsheet 1. Configure the grid to your specifications. Column width and field order in this view will be reflected in the resulting Excel spreadsheet. 2. Highlight everything in the grid by pressing CTRL + A. Then right-click and select Export Selected Rows to Excel. 3. Select the name and network location for the spreadsheet. Export Documents 1. Highlight everything in the grid by pressing CTRL + A. Then right-click and select Export. 2. Use the checkbox functionality to select whether you want to export the associated Native, Text, or HTML versions of the files. Select if you want to export by original file names. If that box is left unchecked, exported files will be named after their Viewpoint DocIDs. 3. Check the bottom option if you want to open the folder of the exported files upon export completion and click OK to complete the menu. Export All Documents in a Media 1. Select the media containing the files requiring export. 2. Right-click on the media and select Export to display the Browse For Folder dialogue box. 3. Select the folder to export and then click OK. All top level (non-extracted) documents from that media will be exported to the selected folder, maintaining the original folder hierarchy. Slipsheet a File 1. Right-click on the file, hover over Slipsheet and select Slipsheet. to display the window below. Viewpoint Processing Manual 6-57

66 2. Select the appropriate reason for the slipsheet. 3. Type an optional message to provide additional information as necessary. 4. Click OK to create the slipsheet. Un-Slipsheet a File Right-click on the document, hover over Slipsheet and select Un-slipsheet. Ignore or Delete a File Users can ignore or delete documents from your filtered list by right-clicking and selecting Ignore or Delete and then choosing the task to perform. Delete Removes the file from the database. The database record and the file on the network will be deleted. Delete Only Children Removes all of the children for the selected file from the database recursively. This process deletes the records from the database and the files from the network. Performing this task will enable the files to have the children re-extracted if necessary. Execute Auto Ignore Ignores all files based on the settings from the Auto Ignore Settings window. Ignore Marks a file as Ignored. The file is kept in the processing database, but it is prevented from being posted to the Review. Ignore with Children Marks a file and its immediate children as Ignored. The files are kept in the processing database, but are prevented from being posted to the Review. Mark as Process Removes the Ignore status from a file. Mark as Process with Children Removes the Ignore status from a file and its children. Note: Files with a status of Ignore will have a grey background in all processing grids. They will also have a status of Ignored in the Document Filter field. Documents that have been either locked or delivered in the Review application cannot be deleted. Viewpoint Processing Manual 6-58

67 Search Fields Use Ctrl + F to open a search box. Any alphanumeric string inputted in this box will highlight in the panel no matter the field. To search for a phrase input the alphanumeric string with double quotes on each side (Ex. Samuel Chan ). To search for multiple strings at once apply a space between each (Ex. Samuel Chan MSG). Note: This search functionality can be used in any Viewpoint interface grid. Copy as URL Users can create a link to a specific file to be sent to other users for quick reference. If the link is opened outside of Viewpoint, users will be prompted to log-in and the link will then automatically take them to the appropriate project and DocIDs. If a user already has Viewpoint open, they will need to confirm that they are in the appropriate project and then paste the link into the search or advanced search options in the Process tab. This will open up the DocIDs from the URL for the currently open project. To create a URL select one or more DocIDs, right-click and click Copy as URL. FileID Manipulation During the FileID task, each document has its extension determined. It is sometimes necessary to reassign a document to a different FileID or create a FileID for a new file type. The FileID tells Viewpoint how to interact with a document during each task of data processing. Note: Any FileID manipulation that occurs will affect the entire Viewpoint environment, not just the project you are working on. View or Modify FileID Details 1. Right-click on the document, hover over FileID and select FileID Details to display the File Identity Details window shown below. Viewpoint Processing Manual 6-59

68 2. The listed settings detail all relevant information on how this file will be handled within Viewpoint. a. FileID The number associated with this FileID. b. Default Ext The expected extension associated with this FileID. c. Name The application name and description for this FileID. d. Identity File Indicates the file used by TrID to determine the document s extension. e. Description The application name, description, and extension for this FileID. f. Category Indicates the category a document can be found under in the File Category filter. g. Slipsheet Indicates the slipsheet the FileID will receive by default if it is checked in the Auto Slipsheet Settings of a project. The Not Applicable setting should be used for files that don t receive slipsheets by default. h. Ignore Auto Tiff/OCR Setting If this box is checked, documents will not be tiffed and OCRed when utilizing the Tiff and OCR Documents with Text Errors setting. i. MIME type The Multipurpose Internet Mail Extension identification for this FileID. j. Processor Indicates the processor that will be used to perform any data processing tasks. k. Extensions Lists extensions to never associate with this FileID. This is used to prevent certain file types from being improperly processed. l. Default Task Settings Indicates the default status for each processing task. m. Default Source Settings Indicates which rendering of the document will be used as the source for a task. n. Create TIFF If a file needs to be tiffed with a specific application, users can input that application s file path and command line for printing. Viewpoint Processing Manual 6-60

69 3. Make any adjustments to the settings (if necessary) and hit Save to finish. Set a FileID 1. Right-click on the document, hover over FileID and select Set File ID to display the FileID Selector window below. 2. Select the appropriate FileID from the File Identities list on the right and click Set FileID. Create New FileID 1. Click the FileID button from the Process tab to open the FileID panel. 2. Right-click and select New to display the File Identity Details window shown below. Viewpoint Processing Manual 6-61

70 3. The following fields should be filled out for new FileIDs: a. Default Ext b. Name (required) c. Description (required) d. Category e. Adapter (If no adapter in the list pertains to this FileID, the LateralData.Libraries.Processing.BaseProcessor, LateralData.Libraries.Processing.Common processor should be used) f. Default Task Settings g. Default Source Settings 4. Standard Default Task Settings for a new FileID: a. Hash Need to process b. Create Text Need to process c. Create HTML Not required d. Create TIFF New e. Metadata Need to process f. Extract Not required 5. Standard Default Source Settings for a new FileID. a. Create TIFF Native b. Indexing Native c. Doc Viewer Native 6. Click Save to complete the wizard. Create TIFF Settings Viewpoint can be used to create tiffs from almost any viewer application that has a print command. Viewpoint can be taught to use these systems with the Create Tiff option in the File Identity Details window. There are two ways of creating tiffs with this functionality: Command Line Print Some applications are already preprogrammed to accept command line statements. Using a command line allows a user to utilize a function of the application without having to first open the program and select the option from an interface. Check the documentation of the application you are attempting to tiff with to see if command lint printing is supported. Below is an example of a command line print from the image viewer IrfanView. "C:\Program Files\IrfanView\i_view32.exe" "{0}" /print In this situation there are two parameters needed for command line printing in IrfanView. Each parameter is separated with the character. The first parameter C:\Program File\IrfanView\i_view32.exe points directly at the executable file being used for tiffing. This complete file path should be surrounded by quotes and be found in the same location on every worker. In the second parameter {0} represents the file path and name of the file to be printed. This will always be constant and should not be changed by an end user. The /print switch is the command line option for printing within IrfanView. The above describe guidelines can be used as the basis for printing from any application utilizing a command line print. Keystrokes Keystrokes are used when a viewer application can be used to print a document, but does not have a command line print option. Viewpoint can be given a series of keystrokes to perform in order to Viewpoint Processing Manual 6-62

71 send a print command for a particular application. Below is an example of printing with keystrokes for DWGSeePro (an AutoCAD viewer). "C:\Program Files\AutoDWG\DWGSee\DWGSeePro.exe" "{0}" ^(p){enter} In this situation there are three parameters needed for printing using key strokes with DWGSeePro. The first parameter "C:\Program Files\AutoDWG\DWGSee\DWGSeePro.exe" points directly at the executable file being used for tiffing. This complete file path should be surrounded by quotes and be found in the same location on every worker. The second parameter {0} represents the file path and name of the file to be printed. This will always be constant and should not be changed by an end user. The third parameter indicates the key strokes to be used. ^(p) represents the Ctrl+p key stroke on your computer. In the case of DWGSeePro Ctrl+p will bring up a print dialogue box. The next keystroke {ENTER} represents hitting the enter key on the keyboard. This submits the files for printing in DWGSeePro. For a full list of all key stroke commands please see the following Microsoft website: Early Filter The Early Filter tool can be used to filter select Media by file type, date range, address or keywords and visualize the resulting data reduction. To run the Early Filter tool, select the Early Filter button from the navigation bar of the Process Tab. 1. In the window that displays, select the media or Medias you would like to filter. Upon selection, the bar graph in the bottom window will populate with the applicable aggregate count of the selected Medias. At this stage, each bar will be the same height as no filtering has occurred. Note: In each window of the Early Filter, only the information about parent documents is displayed and the bar chart displays the count of families. If: a parent is filtered out, its entire family will be filtered out too. 2. Check the Include Filtered Documents box if you wish to include previously filtered out documents. If filtered documents are checked upon running the filter, they will be unfiltered. 3. Check the Include Slipsheets box if you wish to include slipsheeted documents in your filter. Viewpoint Processing Manual 6-63

72 4. Move to the File Types tab to filter by select file types. By default, all available file types for the selected media will be checked. Any file types which are unchecked will be filtered out of your document set. The bar graphs will display the resulting counts at the stage that filter would be applied. 5. Move to the Date Ranges tab to filter by specific date ranges for s and efiles. Set your desired operator and date range for both s and efiles. Hit Override on either to uncheck dates not matching the filter. Any dates which are unchecked will be filtered out of your document set. The bar graphs will display the resulting counts at the stage that filter would be applied. 6. Move to the Accounts tab to filter by specific addresses. Uncheck any addresses you wish to be filtered out of the document set. You can also load a specific list of keywords to include or a specific list to exclude. The bar graphs will display the resulting counts at the stage that filter would be applied. Viewpoint Processing Manual 6-64

73 7. Move to the Keyword Search tab to filter by a specific set of keywords. Input in a list of keywords you wish to include or exclude matching hits of from your document set. If you wish to include the hits, go ahead and hit Apply. If you wish to exclude the hits, check the Exclude Search Term Hits box before hitting Apply. The bar graphs will display the resulting counts at the stage that filter would be applied. Check the Include Unindexed Documents box to add those to the count. 8. Once all criteria have been set, hit OK to apply the specified filters to your document set. Note: In each window of the Early Filter, only the information about parent documents is displayed and the bar chart displays the count of families. If: a parent is filtered out, its entire family will be filtered out too. Viewpoint Processing Manual 6-65

74 7. Dedupe Tab Deduplication is the process of identifying sets of completely identical stand-alone documents and document families. In Viewpoint, either the MD5 hash or SHA-1 hash (depending on project settings) is used for determining duplicate families of data. If an exact match is found, all instances uncovered after the first are considered a duplicate and added to the assigned Dedupe Set. Multiple Dedupe Sets can exist within a single project database, but are not necessary. Typically, one set is created that contains all files for the project. Making a single global Dedupe Set will help ensure that any distinct families will only be made available once in review. Note: Placing a file into a Dedupe Set will not prevent it from being made available for review. In the Review application, users will indicate if they want to remove files found in a particular Dedupe Set. Create a Global Deduplication Set 1. Click on the Dedupe Set button to bring the panel into the display. 2. Right-click over the Dedupe Set Panel and select New to display the window below. Type Global in to the description box and click OK to create the group. 3. Select all medias in the project in the Unselected Entities window and click the right arrow to move them to the Selected Entities window. 4. Items are checked for duplicates from top to bottom. Medias can be moved up and down with the green arrows below the Selected Entities window. 5. Once the media deduplication order has been set, click the Process button on the Dedupe toolbar. 6. Once the Dedupe process completes, the status of the medias will change from Need to Process (orange) to Processed (yellow). 7. In the Dedupe Set panel, right-click on the global set and select Post. On the next screen click Yes to confirm. The status of the medias and Dedupe Set will change from Processed (yellow) to Posted (Green). Note: The review database must be created for Post to be an available option. If the review database has been created, you will be auto prompted to post the Dedupe Set. The Dedupe Set must be posted to review before duplicates can be excluded from review. Create Custodian Deduplication Sets Viewpoint Processing Manual 7-66

75 1. Click on the Custodian button to bring the panel into the display. 2. Select each custodian requiring a new deduplication set. 3. Right-click in the panel and select Create Dedupe Set. 4. A new Dedupe Set will be created and named after each custodian selected. All of the custodian s medias will be automatically moved to the Selected Entities window. 5. Items are checked for duplicates from top to bottom. Medias can be moved up and down with the green arrows below the Selected Entities window. 6. Once the media deduplication order has been set, click the Process button on the Dedupe toolbar. 7. Once the Dedupe process completes, the status of the medias will change from Need to Process (orange) to Processed (yellow). 8. In the Dedupe Set panel, right-click on the first Dedupe Set and select Post. 9. In the window that displays, select the specific (or all) media dedupe information which you desire to be posted. Click Next. 10. On the next screen click Post. The status of the medias and Dedupe Set will change from Processed (yellow) to Posted (Green). Note: The review database must be created for Post to be an available option. The Dedupe Sets must be posted to review before duplicates can be excluded from review. Copy Dedupe Set 1. Right-click on the Dedupe Set to be copied and select the Copy Dedupe Set option. The copy will appear at the bottom of the Dedupe Set list. 2. Rename the Dedupe set, if desired, by right-clicking on the new Dedupe Set and select the Update option. Enter in a new name and click OK. 3. Though copied, changes can be made to the make-up and order of the Medias in the Dedupe Set. Dedupe Viewers These panels are intended to allow the user to verify and report on the status of the deduplication for any document in the database. It is not typically necessary to consult these viewers for most projects. Not Duplicated Docs This panel will provide metadata for any document that was not added to the Dedupe Set selected. These files can be looked at in the Process tab by rightclicking on selected files and selecting Go To Document(s). This will automatically display the selected files in a Search Results panel in the Process tab. DeDupe Docs This panel provides metadata showing the DocIDs and matching MD5 Hash for duplicative files from the selected Dedupe Set. These files can be looked at in the Process tab by right-clicking on selected files and selecting Go To Document(s). This will automatically display the selected files in a Search Results panel in the Process tab. Viewpoint Processing Manual 7-67

76 8. Index Tab Viewpoint utilizes the application DTSearch for indexing data. The Index process allows documents to be keyword searched. Before processing is complete for a scope, all contained medias must be indexed. Index a Media 1. Select one or more scopes from the Scopes panel. All medias from the selected scopes will appear in the Index window. 2. Any medias with an Index Status of New or Need to Process should be submitted for indexing. Select the required medias to index. 3. Click the Process button in the toolbar. 4. In the Command Wizard choose to Index locally if necessary and choose a priority. Then click Next. 5. Confirm all project indexing settings and then click Next. 6. Click Process to begin indexing the selected medias. Index Tab Highlighted Colors Orange Indicates indexing has been submitted for this media Green Indicates indexing is complete for this media Red Indicates indexing has failed for this media White Indicates indexing has not yet been performed or is In Progress for this media Pink Indicates files that were not indexed for this media Update File Counts During error-handling/ cleaning of files, the number of files attributed to a media is not automatically updated. If any new files are found via extraction or other processes, the database needs to be updated to reflect those changes. It is recommended that users always update file counts for all medias. The method for performing this updating is below: 1. Select the medias to update in the Index window. 2. Right-click in the window and select Update Number of Files. 3. The number of files will update for all fields in the display. Viewpoint Processing Manual 8-68

77 Troubleshooting Index Errors Files that have not been indexed can be identified from the Index window. The Unindexed Files fields will provide the number of files that have not been indexed. If the project settings are set to not index slipsheets, cells with a value greater than 0 will be red within the Wrongly Unindexed Files field. If the project settings are set to index slipsheets, cells with a value greater than 0 will be red within the Wrongly Unindexed Files (including slipsheeted) field. To quickly find the unindexed items, select the media with errors and click the Unindexed Files button in the toolbar to show the UnindexedFiles panel. The first thing to check is the IndexFileSourceFormat field to see which file rendering is being used for indexing. If, for example, the IndexFileSourceFormat shows the rendering of Text, but this file does not have a text rendering, users may attempt to change the indexing rendering to Native. To do this, select the files and right-click in the window. From the list, hover over Change Index file source format and then choose the appropriate source. If the source is selected to None, DTSearch will not attempt to index this file again. This file will now appear in both the Unindexed Files and Error Files list. This can be helpful if you have a file that you cannot generate text for, but want to accommodate for it appropriately. In this case, upon reindexing, the number of files in the Slipsheeted Files field plus the number of files in the Error Files field should equal the number of files in the Unindexed Files field. Users can also review any error files in the Process tab for potential resubmission by right-clicking on selected files and clicking the Go To Document(s) option. This will automatically display the list of files in a Search Results panel in the Process tab. The Ignored and Erroneous Files panel is also helpful for troubleshooting. By default, Viewpoint will not attempt to index any file that has been ignored as those files will not be posted to review for keyword search culling. The Doc Status field can be used to filter to documents with a status of Error. These are all files that could not be indexed. These files should be viewed to determine if they should be slipsheeted or go through alternative text extraction. The most common method of alternative text extraction is to tiff the file and then attempt to generate OCR from the tiffs. Keyword Searching Keyword searching in the processing application is available for obtaining an overview of search results. No advanced reporting, keyword highlighting, or advanced search options are available in this interface. Viewpoint Processing Manual 8-69

78 1. To search a single term, enter it into the Enter Keywords box in toolbar and then click the Search button. 2. To search for multiple terms, click the Advanced Search button in the toolbar. In the Enter Keywords window, enter one term per line and then click Search. 3. All documents that contain the entered search terms will appear in the Search Results panel. Index Validation Viewpoint offers the ability validate the integrity of DTSearch indexes. The validation process should be run if users are receiving errors during keyword searches in the review module. It is not necessary to run this process on normally functioning indexes. Validate an Index 1. Select the medias containing index errors. 2. Right-click in the grid and select Validate Indexes. Viewpoint Processing Manual 8-70

79 9. Posting Data to Review Once all phases of data processing have been complete, all data information must be copied from the processing SQL server to the review SQL server. There are three stages of posting: 1. Creation of the Review database. (This stage only needs to occur once per project.) 2. Posting all applicable Dedupe Sets. 3. Posting processed data to Review. Post Data 1. In the Index tab, check all scopes you want to post in the Scope panel, or check individual medias from the main Index panel. Right-click and select Post to display the menu below. a. Add New files will be added to Review. New data that has finished processing. Files that have been un-ignored. New attachments that have been extracted from previously posted files. b. Delete Deleted files will be removed from Review. Files have been deleted from the database. Files that have been ignored that were previously posted. c. Update Existing files will be updated in Review. Files that have been tiffed at a later date. Files that were either slipsheeted or un-slipsheeted. Files that have had text re-extracted or new OCR generated. Files that were previously password protected that have been replaced. These would also need to be reprocessed and un-slipsheeted. Viewpoint Processing Manual 9-71

80 If a media has been re-indexed, all files in the media should be updated to reflect the location of the new media. 2. Click Next after selecting the appropriate options for this post. Note: When re-indexing documents that already been posted to Review you do not need to re-post the data to update index information. 3. On this screen, select the breadth of the data you wish to Post. a. All - Performs posting tasks for all DocIDs of all selected Scopes. b. Selected Media(s) Performs posting tasks for selectively chosen Medias from the selected Scopes. c. Selected Document(s) Performs posting tasks for selectively input DocIDs from the selected Scopes. Each DocID must on a single line. 4. Once you have selected the appropriate option, click Next. 5. Update existing documents a. Clear calculated data for advanced tools A setting of true will remove all information related to the Near Duplicate Analysis and Thread Analysis tools. It is highly recommended that this option is set to False unless specifically requested by the user in charge of the review environment. b. Sync Custom Fields A setting of true will synchronize the custom field information between the processing and review databases. This should be set to false in situations where data is being updated rather than added to the review database to speed up posting times. c. Sync addresses A setting of Insert Only will add newly discovered addresses to the review database for searching. A setting of Full will delete all existing records and add all addresses found across servers. A setting of None will ignore synchronizing addresses altogether. Viewpoint Processing Manual 9-72

81 6. Confirm all settings and click Post to complete the wizard. 7. A window will appear providing a progress of the posting process. When posting is complete, the text box on the right side of the window will provide full details on the number of documents added, deleted, and updated. 8. After the Post process is complete, click Close to exit the window. Viewpoint Processing Manual 9-73

82 Update Post The Update Post function can be used to quickly update information in Review about a subset of files you have been working with. This function cannot be used to add or remove documents to the review database. It is most commonly used to update tiff information for files within the review database. 1. Open the Processing tab and navigate to any panel containing the DocIDs of the files you wish to update. 2. Select all DocIDs that require updating. 3. Right-click in the grid and select Update Post. 4. Confirm the Post settings for the project and then click Next. 5. Click Post to update information on all selected documents. 6. After the Post process is complete, click Cancel to exit the window. Viewpoint Processing Manual 9-74

83 10. TIFF Creation Creating tiffs is a necessary task for several functions within Viewpoint. In the review database, documents must be tiffed before they can be redacted by a reviewer. If tiffs are not created prior to review, users can create tiffs themselves, but will have to wait for processing to complete. In the Delivery functionality of the Viewpoint Review application, tiffs must be created prior to an export of single-page tiffs, multi-page tiffs, color jpgs or PDFs. Tiffs are created from the Process tab under the Create Tiff task. Not all documents in a project require tiffing so it is recommended that users work with filters to tiff only the required items. The View filter is most commonly selected for users wanting to tiff data intended for Delivery. Generated tiffs can be reviewed for clarity and accuracy in the Viewpoint Quality Control application. Once all tiffs have been verified, they must be re-posted to have their records updated in the review application. The posted tiffs are now available in the review application for Delivery or redaction. Tiff Settings MS Excel Setting Description Default Setting Adjust Formatting Auto Fit Automatically Hide Empty Columns/Rows Automatically Unhide Hidden Columns/Rows Change Margins Bottom Margin This setting must be set to true for any of the Excel settings to be used. If set to false, the document will print as is. All cells will be Auto Fit to match the size of all contained text. Hides entire columns containing no text content. Un-hides all sheets, columns, and rows hidden within the document. Changes the margins of a document to the options selected in the Bottom Margin, Left Margin, Right Margin, and Top Margin settings. Forces the bottom margin to this size (in inches). Change Margins option must also be set to true. True True True True False 0.5 Custom Macro File Insert a full UNC path to any user created macro files to be used during Excel tiffing. Leave Blank Left Margin Maximum Number of Pages (0 Tiff All Pages) Forces the left margin to this size (in inches). Change Margins option must also be set to true. A value of greater than 0 indicates the maximum number of tiff pages to be created. After this number is reached, an Viewpoint Processing Manual 10-75

84 Page Orientation Print AutoFields Print Column Headers additional placeholder tiff with the text Following pages truncated by user will be appended. Users can choose to print pages in landscape, portrait, as is, or to be automatically optimally formatted. The keyword function allows users to use phrases such as Date or File Name and when the document is opened, the current date/filename will appear. If this setting is changed to True, instead of printing the date the document was opened the tiff will show the keyword names such as <date> or <filename>. Prints the column header on each page of the document. Landscape False True Print Comments Shows and prints comments found on the Excel document. True Print Grid Lines Print Order Remove Empty Pages Prints an outline around every cell on each page of the document. Users can choose to print either horizontally or vertically first. Empty pages within an Excel will not be printed. True Horizontal First False Remove Images Embedded images will be removed from the document. False Reset Colors Right Margin Set Print Area To Last Cell Top Margin Background colors in cells will be reset to white. Useful for black and white tiffs that have dark colored backgrounds. Forces the right margin to this size (in inches). Change Margins option must also be set to true. The document will not be printed beyond the last cell with content regardless of print area. Forces the top margin to this size (in inches). Change Margins option must also be set to true. False 0.5 True 0.5 Zoom Percentage Sets the zoom of the document. 80 MS PowerPoint Setting Description Recommended Setting Change Margins Bottom Margin Left Margin Changes the margins of a document to the options selected in the Bottom Margin, Left Margin, Right Margin, and Top Margin settings. Forces the bottom margin to this size (in inches). Change Margins option must also be set to true. Forces the left margin to this size (in inches). Change Margins option must also be set to true. False Viewpoint Processing Manual 10-76

85 Output Type Page Orientation Print Comments Print Date AutoFields Print Order Right Margin Slide Orientation Top Margin MS Visio Users can choose to print in either the Notes Page or Slides format. Notes Page must be selected for comments to be printed. Users can choose to print pages in landscape, portrait, as is, or to be automatically optimally formatted. Slide comments will be printed on the notes page (if selected) The AutoField function allows users to use phrases such as Date or FileName and when the document is opened, the current date/filename will appear. If this setting is changed to True, instead of printing the date the document was opened the tiff will show the keyword names such as <date> or <filename>. Users can choose to print either horizontally or vertically first. Forces the right margin to this size (in inches). Change Margins option must also be set to true. Users can choose to print slides in landscape, portrait, as is, or to be automatically optimally formatted. Forces the top margin to this size (in inches). Change Margins option must also be set to true. Notes Page As Is True False Horizontal First 0.5 Landscape 0.5 Setting Description Recommended Setting Change Margins Bottom Margin Left Margin Page Orientation Print Background Changes the margins of a document to the options selected in the Bottom Margin, Left Margin, Right Margin, and Top Margin settings. Forces the bottom margin to this size (in inches). Change Margins option must also be set to true. Forces the left margin to this size (in inches). Change Margins option must also be set to true. Users can choose to print pages in landscape, portrait, as is, or to be automatically optimally formatted. Users can choose to print the background layer of the Visio. False As Is False Print Comments Print user comments. True Right Margin Top Margin Forces the right margin to this size (in inches). Change Margins option must also be set to true. Forces the top margin to this size (in inches). Change Margins option must also be set to true Viewpoint Processing Manual 10-77

86 MS Word Setting Description Recommended Setting AutoFit Tables to Content Change Margins Bottom Margin Clear Paragraph Formatting Left Margin Page Orientation Print AutoFields Force tables to fit to page. Changes the margins of a document to the options selected in the Bottom Margin, Left Margin, Right Margin, and Top Margin settings. Forces the bottom margin to this size (in inches). Change Margins option must also be set to true. Clears any paragraph formatting when tiffing. Forces the left margin to this size (in inches). Change Margins option must also be set to true. Users can choose to print pages in landscape, portrait, as is, or to be automatically optimally formatted. The AutoField function allows users to use phrases such as Date or File Name. A setting of Unlinked Values will print the values as the document was originally saved. A setting of Linked Values will print the settings as they would appear the date of tiffing. If this setting is changed to Macro Names, instead of printing the date the document was opened the tiff will show the keyword names such as <date> or <filename>. True False 0.5 False 0.5 As Is Unlinked Values Print Comments Prints document comments. True Print Hidden Text Prints any hidden text. True Ret-Tiff s with Side Margins Warning Right Margin Set Page Size To Letter Top Margin When tiffing HTML representations of s where there are left/right side margin warnings, Viewpoint will automatically rescale the image to attempt to fit content clipped by the side margins. Forces the right margin to this size (in inches). Change Margins option must also be set to true. Forces the size of the document to letter prior to printing. Forces the top margin to this size (in inches). Change Margins option must also be set to true. False 0.5 False 0.5 Track Changes Prints any track changes On Viewpoint Processing Manual 10-78

87 Tiff Delivery Steps 1. In the Review application create a single View containing all documents that are required for delivery. 2. In the Processing application use the View filter on the Process tab to isolate the view created in step Submit all documents without tiffs in this View for tiffing using appropriate project settings. 4. Quality control resulting tiffs and exceptions. 5. When all required documents have been tiffed, open up the documents in this View from the process tab. 6. Select all documents, right-click, hover over the Maintenance Scripts option, and then click Update Tiff Page Count. 7. Select all documents, right-click, and then click Update Post. 8. Change any post settings if necessary and then click Next. 9. Click Post to transfer all relevant tiff information from these documents to the Review database. Viewpoint Processing Manual 10-79

88 11. Scope and Media Modifications Create a Scope Scopes can be manually created for receiving medias. The first method of receiving media is through the Import tab where previously processed data can be loaded into Viewpoint. The second method of receiving media is through the Import Media process on the Project tab. 1. Open the Scopes panel on the Project tab. 2. Right-click in the panel and select New. 3. In the window that appears fill-in the appropriate information for the Scope Description, Custodian, and Data Location fields. Both the Custodian and Data location must be selected from previously input items. 4. Click OK to complete the wizard. Update a Scope 1. Select the scope on the Project tab. 2. Right-click and select Update. 3. Update the information in the Scope Description, Custodian, or Data location fields. 4. Click OK to complete the wizard. Delete a Scope 1. All medias within a scope must be deleted before it can be deleted. 2. On the Project tab, right-click on the empty scope and select Delete. 3. The scope will be removed from the database. Change a Media s Stage Status 1. Select the Media in either the Project, Process or Index tabs. 2. Right-click and select Set Status. 3. Select the new status from the window that appears and click OK. Viewpoint Processing Manual 11-80

89 Import a Media Importing Medias is a process where all files within a media are copied to another scope in any project on the same SQL server. A new DocID will be assigned to all imported files, and the files will be copied the file share. If files are imported to a new project, reviewers must have permissions to the file location storing them. 1. On the Project tab, select the scope that will be receiving the files via import. 2. Right-click in the panel and select Import Media 3. Enter your credentials and click Next. 4. Select the company that contains the media you wish to import and click Next. Viewpoint Processing Manual 11-81

90 5. Select the project that contains the media that you wish to import and click Next. 6. Select the scope that contains the media you wish to import and click Next. Viewpoint Processing Manual 11-82

91 7. Select the media you wish to import and click Next. 8. Click Finish to complete the wizard and begin the import process. 9. After the import completes, the receiving scope will have a new media created containing all of the media s files. Update a Media 1. Select the media on the Project tab. 2. Right-click and select Update. 3. Update the information in the Description field. 4. Click OK to complete the wizard. Viewpoint Processing Manual 11-83

92 Delete a Media 1. Select the media in the Project or Process tab. 2. Right-click and select Delete Media. 3. Confirm that you wish to delete the media by clicking OK in the window that appears. 4. If any files are found within that media, a second pop-up will appear indicating the number of files that will be deleted. Click OK to delete these files from the Viewpoint database and the file share. Note: A media cannot be deleted from the processing application if any documents for that media are currently posted within the review application. Viewpoint Processing Manual 11-84

93 12. Import Tab Viewpoint s Import feature allows users to bring in files or file information generated from outside the Viewpoint environment. The most common use of this feature is to import native or tiff files generated from scanned documents or documents previously processed in another system. It can also be used to include new renderings of documents that have been exported from Viewpoint for translation, password cracking and other purposes. Importing can also be used for overlaying new metadata for existing documents. Please note that this section of the manual covers how to use the importing feature, but many aspects of data processing overlap with information already covered. Read all the sections on the Viewpoint Processing application tabs for use in conjunction with the information below. Import Glossary Import The process of loading into Viewpoint file renderings and metadata information for documents that have been previously processed. Overlay The process of adding new data or overwriting existing data for documents that are already present in a Viewpoint project. Load File A file that contains metadata and file path information for data to be imported into Viewpoint. Reference Key Also known as the Primary Key. This refers to the unique identifier (control number) assigned to documents during import. For documents processed through the Catalog tab, this will be the DocID. For files loaded through the Import tab it will be user defined, but typically set to BegDoc. Import Walkthrough 1. Click on the Import tab within the Viewpoint Processing application. 2. Click the radio button next to the custodian that this data will be attributed to. 3. Click the radio button next to the scope that this data should be associated with. Note: If this data should not be associated with an existing scope, a new one should be made following the steps provided in the section of this manual labeled Create a Scope. Viewpoint Processing Manual 12-85

94 4. For new data, it will not be necessary to choose a media or change any media options. If you are performing a data overlay, click on the pre-existing media that requires new data. To overlay data into multiple medias, select the option File contains data from several medias and then click Select Medias. On this screen hold down the ctrl button of your keyboard and click all medias that will be receiving overlay information. When complete, click the Next button to proceed to the next screen. 5. If no medias were selected in the previous step, a Pop-Up will appear indicating that a new media will be created for these documents. If one or more medias were selected in the previous step, a pop-up will appear indicating that all documents in this import will be placed into one or more existing medias. Click OK. Note: Regardless of the number of medias selected, this pop-up will only display the ID of the primary media selected on the media section of the screen. Even when importing to multiple medias, make sure that one of them is selected in the Select Custodian, Scope and Media screen. 6. A new set of options will appear. The first option to configure is the Data source root directory. In this window, click on the ellipses button on the right side of the option to browse to the location holding the data in your load file. To find the data that requires importing, Viewpoint must understand the entire path of where these documents are located. The Data source root directory will contain the first half of this path. An example of how to determine what should be placed in this field is below: a. Data exists in the following structure: \\ViewpointData\Share1\Staging\VOL001\EFile\001\ABC0001.msg b. Load file contains a link to a native file in this structure: EFile\001\ABC001.msg c. The path for the Data source root directory should be: \\ViewpointData\Share1\Staging\VOL001 In this example, the combination of the Data source root directory path combined with the path to the individual files in the provided load file provides the full path to the files being loaded. 7. Next, click on the ellipses on the right side of the X-Ref file path field to select the location of the load file that will be used for this load. Then select the appropriate options for the delimiter and header row options. Please see the topic Supported Load Files in this section of the manual for more detailed information on supported load files. 8. Once the load file is selected and configured, click on the button in the ribbon labeled X- Ref Content Viewer. This will provide a preview of the load file as Viewpoint currently interprets it. If the option Has Headers is not selected, the columns will be named in the format of Column0, Column1, etc. If Has Headers is selected, the first entry for every column will appear as the name for every column for mapping purposes. If everything has been confirmed as working appropriately, click Next. Viewpoint Processing Manual 12-86

95 9. On the next screen, you have the ability to either create a new template, or select an existing one. For more details on configuring a template, see the topic titled Template Management in this section of the manual. 10. After the template has been selected, additional options will appear. After selection, all fields found in your load file will map accordingly. If a new template is being selected, all options will be blank. 11. In the Primary Key field option, use the drop down list to choose the field in your load file that corresponds to the unique document identifier (typically the beginning bates number or a control number generated in another system). 12. In the Parent doc reference option, use the drop down list to choose the field in your load file that corresponds to a value that is shared by all documents that should be considered a document family within Viewpoint (typically the beginning attachment bates number or a family id control number generated in another system). 13. Use the middle panel to map out the fields of your load file to the appropriate fields in the standard Viewpoint table structure. Please see the topic titled Field Mapping in this section for additional details. Once all of the fields from your load file have been mapped, click the Next button in the lower right corner of the window. 14. On the next window that appears there is an option called Execute Trial Run. Checking this option allows you to verify the mappings of a portion of your load file to ensure no exceptions exist. 15. If the data has been processed in a time zone other than GMT, click the option labeled Offset Date/Times by the following number of hours: and adjust the time accordingly. Note: All imported times should be reflected as GMT. The time displayed to end users will adjust to the time zone of the project in the Viewpoint Review application. 16. The option Automatically create missing Parent Documents should only be checked if you are working with a load file that has references to parent documents (usually an original e- mail container) that is not present. If this option is selected, Viewpoint will simply make an empty record for the missing parent and ignore errors for missing parents during processing. Viewpoint Processing Manual 12-87

96 17. The EDoc Lookup option is used for data overlays. The Reference Key refers to the unique identifier (Primary Key) chosen for documents that were previously loaded into the system. Viewpoint DocID refers to documents that were natively processed through Viewpoint from the Catalog tab. This option is only pertinent in instances where an overlay is being performed. 18. The Creation Options is another setting that should be tweaked for data overlays. The Create and edit is the default option and should be used whenever new data is being loaded or when importing a load file that combines a mix or old and new data. Selecting this option means that Viewpoint will overlay information to an existing document and create a new document record for any unfound documents. The Edit only option means that Viewpoint will only overlay new information to existing documents. New documents will not be created. Once this option has been finalized, click Next. 19. The Apply Slipsheet rules to Native Files option applies to documents where native files are imported. If this option is selected, any document with a FileID that matches the Auto Slipsheet rules for the project will be slipsheeted during imported. It is recommended that this option is checked unless slipsheets were already provided for non-standard file types. 20. If the Execute Trial Run was selected, Viewpoint will pre-load the designated number of records and show in a grid how the data will be look for each record. The left side of the screen provides a summary of what is being loaded. In the Media summary, red lettering means that a new media is being created. Blue lettering means that data is being appended or overlaid to an existing media. The Process summary shows the total number of documents found in the load file. Directly underneath the Process setting, summaries for Native, Tiff, Text, and HTML show the status of whether document renderings are being processed with this load file. If any of these renderings are being provided, blue lettering is used to indicate the mapping. If a rendering is not being provided, red lettering is used. Finally a box in the lower left hand corner will show any errors that have been found during the pre-load. To resolve any errors or any incorrect mappings, use the Back button to change any previously configured settings. If no errors are found, all fields are mapped correctly, and the summary tab matches the expected outcome of your load file, click Next. Viewpoint Processing Manual 12-88

97 21. The final screen will reiterate the trial run summary seen on the previous page. To finish the import process, click the Import button. If any errors are found, click the back button to resolve them. 22. After the import begins, your screen will move to the beginning of the Import Wizard and all files are sent to the workers for data processing. After this point, please follow the instructions laid out in this manual for the Process, Index, and Workflow tab to finish data processing. Field Mapping When importing metadata from a load file, users have two options. The first is to import metadata from a load file to an existing Viewpoint field (such as the CC line or whether a document is an e- mail or the created time of an electronic file). Whenever possible, it is recommended to map metadata to Viewpoint fields. This will make for the best possible user experience and allow for full use of Viewpoint s advanced analytics. Please refer to the Viewpoint Advanced Tools Requirements document for more information on field mappings used for advanced analytics. The second option for importing metadata is to load fields as custom fields. This typically is used for fields that don t have a default mapping in Viewpoint (such as a box number for scanned documents or pre-existing coding). For most load files, both kinds of field mappings are used. Viewpoint Processing Manual 12-89

98 Note: Each field can be mapped multiple times. For example, the beginning control number field can be mapped once to the system DocTitle field and again as a custom field. System Field Mapping System fields correspond to the first six tabs of the import field wizard. To map to a system field, click to the right of the field name and then select the appropriate field from the drop-down list that appears. For long lists of fields, users can type the first characters of the name for ease of filtering. The list below defines what the contents of each system field should be mapped to. Please note that the field shown as DocDateUTC for processing files will be automatically populated during import as MainDate. The rules for generation of this field are based on the Viewpoint Date Hierarchy document. EDoc Setting DocAuthor DocTitle Description Aggregate author information from electronic file (MS Office or PDF) or the Sender name from an . Aggregate title information from electronic file (MS Office or PDF) or the subject of an . If the document does not have a title or subject, the filename is used. Note: The beginning control number data is often mapped to this field. HashCode MD5 or SHA1 Hash code generated. Attribute Setting IsEFileArchive Description Indicates if a document is an archive (pst, ost, nsf, ect). IsEFileArchiveAttachment Indicates if a document was extracted from an electronic file container (zip, rar, etc.). IsEFileEmbedded Indicates if a document was an embedded object. Viewpoint Processing Manual 12-90

99 Is Is Archive IsSystemFile Indicates if a document is an . Indicates if a document is an archive (pst, ost, nsf, ect). Indicates if a document's hash was found on the NIST list. Setting CreateDateUTC DisplayBCC DisplayCC DisplayTo Class Subject Importance MessageID RecievedDateUTC SendDateUTC SenderName SenderSMTP ThreadID ThreadTopic Description creation date and time. BCC information from . CC information from . Recipient information from . Type of (message, calendar, contact, etc.). Subject information from . flag of low or high importance (0 = Low Importance, 1 = No Designation, 2 = High Importance). Documents that are not s should receive a 0. Message ID from . Received date of . Sent date of . Sender information from . Sender tracking protocol for the s transmission across the internet. Thread ID information from . Thread topic information from . FileSystem Setting OriAttributes OriCreationTimeUtc Description Attribute information from the document. Date and time of document creation. Viewpoint Processing Manual 12-91

100 OriFileExtension OriFileFolder OriFileName OriFileSize OriIsReadOnly OriLastAccessTimeUtc OriLastWriteTimeUtc Extension of document. Path to original file location. Document filename. Document file size (bytes). Indicates if a document was labeled as read-only. Last access date and time of the file. Last write date and time of the file. Path Setting EFileRelativePath HTMLRelativePath TextRelativePath TIFFRelativePath Description Relative path to native file rendering. Relative path to HTML file rendering. Relative path to text file rendering. Relative path to TIFF file rendering. Summary Setting Author BeginBates CLSID Comments Company EndBates Keywords LastAuthor Manager Description Microsoft Office/PDF author metadata. Beginning control number for an imported document. Identifier for COM class objects. Microsoft Office/PDF comments metadata. Microsoft Office/PDF company metadata. Ending control number for an imported document. Microsoft Office/PDF keywords metadata. Microsoft Office/PDF last author metadata. Microsoft Office/PDF manager metadata. Viewpoint Processing Manual 12-92

101 NbrPages Microsoft Office/PDF number of pages metadata. ProdModifications Microsoft Office/PDF subject metadata. RevNbr Microsoft Office/PDF revision number metadata. SummCreateTimeUTC Microsoft Office/PDF creation time metadata. SummLastPrintTimeUTC Microsoft Office/PDF creation time metadata. SummLastSaveTimeUTC Microsoft Office/PDF creation time metadata. Title Microsoft Office/PDF title metadata. System Field Parameters When mapping system fields, additional parameters can be selected to provide additional detail on how to handle information in a field. After selecting a system field map, a panel on the right hand side of the screen will appear to provide additional options for each field. Below is a definition of what each parameter is and in what circumstances it can be used in: Boolean-False Available for fields containing only a yes/no or true/false value. This option indicates what option is mapped as False in this field. Boolean-True Available for fields containing only a yes/no or true/false value. This option indicates what option is mapped as True in this field. ConversionMask Available for fields containing date/time information. This option allows any exported date format to be integrated into the Viewpoint standard (ex: 1/1/ :13:00 AM). PrefixString Available for fields containing words and numbers. This option allows for predefined characters to be inserted before the contents of each field upon import. SuffixString Available for fields containing words and numbers. This option allows for predefined characters to be inserted after the contents of each field upon import. Replace file extension Available for fields containing file paths. This option is typically used in instances where two renderings of a file exist in a single location. With this option, one field can be mapped twice, but have the extension replaced during the second mapping. An example is reusing an e-file path for the text path. In this instance, users could insert txt into this field. Viewpoint would then know to look for text files with the same file naming structure as the native. Viewpoint Processing Manual 12-93

102 Note: For Boolean value fields, it is permissible to only have one value populated. For example, to populate the field Is , the field could have a parameter of Boolean-True = and no false value. You can add additional columns to set up multiple parameters. Ex. True = MSG and True = EML. Date/Time Field Mapping There are many different ways for date and time information to be displayed. When loading any sort of date and time information into Viewpoint, users must indicate to Viewpoint which format is being used. This information will then be translated to a format compatible with Viewpoint. 1. After mapping the date/time field, click on the ellipsis button in the parameters field named ConversionMask. 2. In the Date/Time Mask window that appears, enter a sample of the data from the field in your load file. This information can easily be obtained from the X-Ref Content Viewer. 3. In the Mask field, enter the format of the date and time. If this is not known, click on the Mask Guide to review the format syntaxes. Viewpoint Processing Manual 12-94

103 4. If the Mask has been entered correctly, the result page will show the valid format as it will be presented within Viewpoint. If an invalid format is indicated, an error message will appear. Viewpoint Processing Manual 12-95

104 5. Click OK. If the mask is the same for multiple fields, the mask can be entered in the ConversionMask field without the need for testing a sample. Note: If date and time information are stored in separate fields, users will need to map the fields one at a time using the steps outlined in the Combining Fields header. Combining Fields The contents of two or more fields can be combined into a single field during import. This is typically done for instances where date and time information are stored in separate fields, but can be used in other circumstances (such as combining custodian first and last name into a single field). 1. Map the first field to any system field. 2. Click Add Column in the section beneath the parameters pane. Viewpoint Processing Manual 12-96

105 3. In the Add Column window that appears, select the next field to add. Then, click OK. 4. Follow steps 2 and 3 above if additional fields should be combined. 5. Test the outcome of your combination using the Trial Run feature. Note: Separating characters such as commas and spaces can be placed in the PrefixString parameter. If no prefix is added, the contents of the combined fields will be placed directly together. Custom Field Mapping Any field that does not map to a Viewpoint system field should be mapped as a custom field. This is done on the CustomFields tab of the field mapping screen. By default, all fields in the load file that are not already mapped to a system field are visible on this tab. The left hand column, Xref Field Name, displays the name of the field as it is shown within the X-Ref File. The right hand column, Custom Field Display Name, shows the name of the field as it will be displayed in Viewpoint. Place a checkmark next to each field that should be imported as a custom field. Once a field has been selected, additional options appear on the right hand panel for further specifying the contents of the field. Viewpoint Processing Manual 12-97

106 All details regarding custom field mapping are outlined in the header of this document named Custom Field Management. Each field to be loaded as a custom field will undergo this process. The example screenshot below shows three custom fields have been selected for import. All 3 fields were renamed to match client specifications. To see all fields that are present in the load file rather than just the unmapped fields, change the setting in the dropdown box at the bottom of the grid from Hide columns already mapped to stock fields to Display all columns in x-ref file as seen below. Viewpoint Processing Manual 12-98

107 Conditions Mapping The Conditions tab is used primarily for tiff load files and should only be configured or modified by experienced Viewpoint users. This tab allows for users to indicate the start of a new document and parent/child relationships within a tiff load file such as an LFP or OPT. The above screenshot shows the pre-configured mapping for the loading of an OPT file. The Default Action dropdown indicates how each row of the load file should be handled after considering the parameters in the grid. The Process option means the row will be treated as a new document. The Skip option means that no action will be taken for the row. The Append options means that the contents of the row should be appended to the row directly above it. Append is most often used to indicate that this is an additional page of the document and should not be considered a unique record. The final option, ProcessAsChild, means that the row should be treated as a new record and a child of the last top level document found. Except in rare circumstances, the Default Action should always be configured to Process. Within the grid, users can provide rules on how to handle changes within the load file. The first column, Field Name, indicates which field is being considered for this rule. The second column, Condition, is used to indicate what contents this field should be checked for. The options allowed are Equal, NotEqual, IsEmpty, and IsNotEmpty. If either the Equal or NotEqual option is selected, the Value column must be completed. The last column, Action, is used to determine what should happen if the criteria indicated is met. The options here match those for the Default Action dropdown described above. Once the conditions have been set, they can be re-ordered if needed using the Move Up and Move Down buttons. For the OPT file shown above, the default action for each row is to Process the data as a new record. However, the rule in place states that all documents without a value of Y in Column3 should be appended to the previous record. In an OPT, rows that represent a new document are given a Y value while each additional page of the document is given no value in that column. In this example the row is first checked to see if a Y is present in Column3. If no Y is present, it will append that row to the document preceding it. If a Y is found, the next parameter in place would be considered. In this case, no additional parameters are present so the Default Action of Process is completed, creating a new record for this row. Mappings Tab The Mappings tab is used to provide a summary of all fields that have been mapped from your load file. Mapped fields will be shown as linked to either a stock system field or a custom field. Fields will have an amber background if they are mapped multiple times or if a field that is part of the Viewpoint Processing Manual 12-99

108 selected template is not present in your load file. The right pane will provide details on the warning provided in the Summary field. If one or more fields have a potential conflict the Mappings tab will be named Warnings, change to an orange color, and display the number of current warnings. Warnings will not prevent data from loading into Viewpoint, but should be validated to insure accuracy of the database file. If no warnings are found, the Mappings tab will be green as seen below. Template Management Templates allow users to load the same types of data repeatedly without having to start their efforts from scratch. Some templates come pre-configured with Viewpoint (see the Load File header of this section). Other templates can be created for mapping complex load files for a specific project or from a specific client. Templates are used specifically for declaring the reference keys, field mappings, and conditions of a load file. The options below describe the function of each option: Create New Creates a new template from scratch. Users can choose the name of this new template. Save Saves any changes made to the currently selected template. Save As Creates a new template using the current selected mappings. Users can choose the name of this new template. Rename Brings up a dialog box where the current selected template can be renamed. Delete Deletes the currently selected template from the template list. Load from XML Used to import a template saved from another Viewpoint system. Save to XML Exports out the settings for the selected template in an XML format. Viewpoint Processing Manual

109 Supported Load Files Although Viewpoint can be modified to handle a large number of load files, there are certain file types that are recommended for use whenever possible. For image files (TIFF, JPG) we recommend an OPT file as they can be loaded in with no load file alterations necessary. LFP files are also supported, but require the editing of certain delimiters. For database load files we recommend CSV, Concordance, or pipe( )/carrot(^) delimiters be used. Whenever possible, it is recommended that both the text and native (efile) relative paths be placed into the database load files. Extracted Text fields in load files are not supported and cannot be mapped as the Text path, these documents will need to be ran through the Create Text Task. Viewpoint comes preconfigured with a number of templates of load files we support. Each of these templates and a description of their use are below: LFP_IMG_TXT Used to load the tiffs and text of a modified LFP file. Attach_Range Used to update parent/child relationships by completing the Primary Key Field and Parent Doc Reference fields. LST Used to update the searchable text renderings of files. [Format: BegDoc,Path to text rendering] Child_Docs Used to load a LFP containing parent/child relationships (C/D). Inbound Production Used to load a standard Concordance OPT file. Viewpoint Processing Manual

110 13. Maintenance Scripts Maintenance Scripts can be used within Viewpoint to run pre-configured or custom C# scripts over processed data. This open-ended approach allows users to have a large amount of flexibility in how Viewpoint operates within their environment. The following scripts come pre-configured with Viewpoint: Rebuild Indexes If your database has high fragmentation or you are getting time out errors, this script will force your processing and review project SQL databases to have their indexes rebuilt. Note: This process should happen nightly in pre-planned maintenance scripts and only be necessary in certain circumstances where a high volume of data processing has occurred in a single day. Create Placeholder Text Files If a production requires a text file for every document, but certain documents don t have text files (slipsheeted files, files with no OCR text found, ect), this process will create a text file that says No text extracted for every selected document. Search for Errors (last 10) Allows a user to run a search to find the 10 most recent errors for this project with a given string of text. Exceptions for Documents from Log for last 7 days Allows a user to see all exceptions for the selected documents for the last week. Create Native PDFs from Tiffs This script is designed for projects where tiff images have been imported, but no native file is available. This script will create PDF files and place them in the EFile directory (used for the stage task) for all selected documents. Re-stage errored efiles This script will attempt to re-stage all selected files. Should only be used in circumstances where a staging error exists. Clear Generated Tiffs This script will delete all tiffs currently generated for the selected files. Once the tiffs are deleted, the Create Tiff status for these documents will be reset to New. Clear Created Text Files This script will delete all text files currently generated for the selected files. Once the text files are deleted, the Create Text status for these documents will be reset to New. Update Tiff Page Count This script will check the number of files found in the tiff directory for all selected documents. The TiffPageCount metadata field will then be updated to reflect this file count. This process should always be run prior to creating a delivery. Check and Fix Index Source Format This script will validate the current Index Source Format of each document. If a document is currently pointed at a non-existent rendering (such as a document with no text, but with an Index Source Format of Text) this script will change the Index Source Format to a valid rendering. Change Index Source to SlipSheet This script will change the Index Source Format for all documents to Slipsheet. Change Index Source to Text This script will change the Index Source Format for all documents to Text. Change Index Source to Native This script will change the Index Source Format for all documents to Native. Change Index Source to None This script will change the Index Source Format for all documents to None. Viewpoint Processing Manual

111 To Run a Maintenance Script 1. Open up a processing task grid in the Process tab. 2. Right-click, hover over Maintenance Scripts. 3. Click on the Maintenance Script you would like to run. 4. Follow any prompts as directed for the selected script. Note: Additional maintenance scripts can be found in the media panel of the Project tab. To Customize a Maintenance Script 1. Open up a processing task grid in the Process tab. 2. Right-click and hover over Maintenance Scripts. 3. Click on Maintenance Scripts Wizard. 4. In the Maintenance Wizard window, select the script that you wish to modify. The Description field can be used to rename the script. The Include in Menu option can be used to remove unwanted scripts from the Maintenance Scripts right-click menu. The Bitmap field will show the icon currently displayed for that item, but is not currently configurable. When finished, click Next. Viewpoint Processing Manual

112 5. The next window is grayed out and currently not configurable. Click Next. 6. This window shows all of the default processing settings for your project. This screen allows you to modify any project settings for any script you are running on a one-time basis. Typically nothing on this screen requires configuration. When finished, click Next. 7. The final window will show you the C# script that is being run within Viewpoint to currently complete the selected task. If any tweaks or changes to this script are required, simply make them in the provided area. Once your changes have been complete, click the Verify button to ensure that the code changes are still operating normally. Click the Execute button to attempt to run the verified code over your data set. To finalize and save the changes to your Maintenance Scripts, click Finish. To cancel the modifications, click Cancel. Viewpoint Processing Manual

113 14. Connectors Viewpoint Connectors allow for the collection of data from specific web based data repositories. Using this functionality, data can be collected and processed directly from the web and into Viewpoint. Choosing Collectors for Processing The workflow for processing data through connectors is nearly identical to the workflow for processing native files. The only difference is the steps needed to choose your data source. To load files using any Connector you will need to be on the Catalog tab. From there, click on the + button on the far right of the Path field as shown in the screenshot below. Note: Connectors must be turned on by the CLCS team before they can be used for data processing. If the + sign is not present in your environment, please send a request to CLCS to have Connectors turned on. On the Catalog Source Wizard window that appears, you will be able to select one of the Connectors for data processing. Click the appropriate collector and then click Next. Viewpoint Processing Manual

114 The next page will be used to input information for loading data for the specified connector. After inputting the appropriate information click Finish. The data for the selected source will now be present in the catalog window. From this point on, documents are processed using the same procedures used for native file cataloging. Google Drive Connector To collect a Google Drive account, choose the Google Drive Connector on the Catalog Source Wizard. On the next screen that appears, type in the Username and Password for the account to be collected. Then click Finish. To collect multiple accounts, create a comma delimited text file containing the User Name and Password for all accounts to be collected. Use the Browse button to navigate to the relevant text file to open it. Then click Finish. An example of a comma delimited file for this functionality is below: Username1,Password1 Username2,Password2 Etc. The account s information is now loaded in the Catalog window. Place checkboxes next to the information you would like to collect. To collect the entire account checkbox the line named Google Docs of [Account Name]. Alternatively, you can collect one or more folders or individual documents. After selecting the appropriate data, assign Custodian, Data Location, and Media Source metadata to the selections prior to processing. Viewpoint Processing Manual

115 Viewpoint can collect Documents, Presentations, Spreadsheets, Forms and Drawings created from Google Drive. After processing with Viewpoint, users will be able to open the documents with Microsoft Office products. The screenshot below provides an example of the collected metadata for Google Drive after collection is finished. IMAP Connector The IMAP Connector can be used to collect web based accounts which support IMAP. The two account types most commonly collected with this method are Yahoo and Gmail. s collected with this connector are fully compatible with the Relationship Analyzer and Thread Analyzer advanced review tools. To collect an IMAP account, choose the IMAP Connector on the Catalog Source Wizard. On the next screen that appears, type in the server, port, user name and password for the account to be collected. For Gmail accounts, the server is: imap.gmail.com For Yahoo accounts the server is: imap.mail.yahoo.com For both of these account types and the majority of IMAP accounts, the Port is 993 After typing in all of the pertinent information, click Finish. To collect multiple accounts, create a comma delimited text file containing the User Name and Password for all accounts to be collected. Type in the server and port containing the Use the Browse button to navigate to the relevant text file to open it. Then click Finish. An example of a comma delimited file for this functionality is below: Username1,Password1 Username2,Password2 Etc. Viewpoint Processing Manual

116 The account s information is now loaded in the Catalog window. Place checkboxes next to the information you would like to collect. To collect the entire account checkbox the line named [IMAP Server] [Account Name]. Alternatively, you can collect one or more folders or specific s (collected in EML format). Gmail documents can also be collected in formats such as All Mail or Starred to prevent collecting s that appear in multiple folders. After selecting the appropriate data, assign Custodian, Data Location, and Media Source metadata to the selections prior to processing. Viewpoint Processing Manual

117 The screenshot below shows an example of Gmail metadata post collection. SharePoint Connector To collect a SharePoint account, choose the SharePoint Connector on the Catalog Source Wizard. On the next screen that appears, type in the URL of the site to be collected and the username and password of the user whose credentials will be utilized. The Test Connection button can be used to verify that the selected user has access to that site. If no error message occurs, the selected user can access this site. If an error message occurs, that means the current user does not have access to that SharePoint site. Click Finish after the connection has been confirmed. All information the current user has access to on the SharePoint site is now loaded in the Catalog window. Place checkboxes next to the information you would like to collect. To collect the entire account checkbox the line containing the SharePoint address. Alternatively, you can collect one or more folders or specific files. After selecting the appropriate data, assign Custodian, Data Location, and Media Source metadata to the selections prior to processing. Viewpoint Processing Manual

118 The screenshot below shows an example of SharePoint document metadata post collection. Twitter Connector To collect a Twitter account, choose the Twitter Connector on the Catalog Source Wizard. On the next screen that appears, type in the Username and Password for the account to be collected. Then click Finish. To collect multiple accounts, create a comma delimited text file containing the User Name and Password for all accounts to be collected. Use the Browse button to navigate to the relevant text file to open it. Then click Finish. An example of a comma delimited file for this functionality is below: Username1,Password1 Username2,Password2 Etc. Viewpoint Processing Manual

119 All tweets sent from this user account are now loaded in the Catalog window. Place checkboxes next to the information you would like to collect. To collect the entire account checkbox the line named Twitter Timeline of [Account]. Alternatively, you can collect one or more folders or specific files. After selecting the appropriate data, assign Custodian, Data Location, and Media Source metadata to the selections prior to processing. The screenshots below show examples of Tweet metadata post collection and a Viewpoint rendering of a Tweet. Viewpoint Processing Manual