Version 1.3 April 4 th, 2016

Transcription

1 Version 1.3 April 4 th, 2016 a product Milyli Inc. 415 N Sangamon St. Chicago, IL support@milyli.com (312) milyli.com/blackout

2 1. Installing, Upgrading, and Uninstalling Blackout System Requirements Before Installing Blackout Installing Blackout Installing Blackout to a Workspace Installing Blackout to Multiple Workspaces Configuring Agents Upgrading Blackout Uninstalling Blackout Configuration, Usage, and Licensing Configuration Usage & Licensing Automatically Send Licensing Data Manually Send Licensing Data Creating and Running Blackout Jobs Navigating Blackout Job List Job List Job List Actions Creating and Editing a Blackout Job Job Fields - Job Name Job Fields - Saved Search Job Fields - Markup Set Blackout Rule Groups Rule Group Fields Markup SubType Rule Group Fields Markup Text Rule Group Fields Markup Scope Rule Group Fields Expand Markup to Full Width of Page Rule Group Fields Blackout Rules a Blackout Rules Word/Phrase b Blackout Rules Regex Name & Expression c Blackout Rules Regular Expression Capture Groups Create Blackout Job Edit Blackout Job Delete Blackout Job Delete Markups Copy Blackout Job Import Rules Viewing and Running Blackout Jobs Run Job Stop Running Job Total Documents Run Total Documents Marked Rules - Terms Marked Run Log Blackout 1.3 User Guide Page 2 of 40

3 3.3.7 Errors & Warnings Document Mismatches Hypertext OCR Results Pre-OCR Blackout Jobs Blackout Redaction Log Reviewing Blackout Markups Viewing the Blackout Markup Navigator Markups in the Blackout Markup Navigator Accepting / Rejecting Markups Has Unresolved Markups Field For Reviewers The Blackout Review Workflow Reviewing Document Mismatches Creating a Production Blackout 1.3 User Guide Page 3 of 40

4 1. Installing, Upgrading, and Uninstalling Blackout 1.1 System Requirements - Relativity web and agent servers must have Microsoft Visual C++ Redistributable for Visual Studio 2015 (x64) installed. o Available for download here: - Browser Requirements: o Relativity versions 8.0, 8.1, 8.2 Internet Explorer 11 (Internet Explorer 9 & 10 for Create & Run Job only) o Relativity versions 9.0, 9.1, 9.2 Internet Explorer 11 (Internet Explorer 9 & 10 for Create & Run Job only) Most recent version of Google Chrome 1.2 Before Installing Blackout 1. Blackout installation file (.rap) must be acquired. 2. Blackout is installed at the workspace level or via the Relativity Application Library. Prepare a workspace where you will install the application. 1.3 Installing Blackout Installing Blackout to a Workspace 1. Navigate to the workspace where you want to install Blackout. 2. Click the Application Admin tab. 3. Click New Relativity Application at the top left. 4. In the Application Type section, select Import From File. Blackout 1.3 User Guide Page 4 of 40

5 5. Click Choose File. 6. In the dialog box, navigate to the folder where you ve saved the Blackout.rap file, select the.rap file, and click Open. Note: You cannot have different versions of Blackout installed on different workspaces. Blackout versions must be the same across all workspaces. 7. When the file is uploaded, the Application Information section will become available. 8. Click Import. 9. When the Installation Alert confirmation dialog pops up, click OK. 10. When the import process is finished, refresh the page in order to see the installed Blackout tab Installing Blackout to Multiple Workspaces 1. Navigate to the Relativity Application Library through the Applications & Scripts tab. 2. Click Upload Application at the top left. 3. In the Application File section, click Choose File. Blackout 1.3 User Guide Page 5 of 40

6 4. In the dialog box, select the Blackout.rap file to be uploaded. Once it is uploaded, click Save. Note: You cannot have different versions of Blackout installed on different workspaces. Blackout versions must be the same across all workspaces. 5. To install Blackout to specific workspaces, click Install in the Workspaces Installed section. 6. On the next screen, click the ellipsis in the Workspaces section to choose the workspaces where you want to install Blackout. Check the workspaces and click OK to install Blackout. 1.4 Configuring Agents Blackout requires four agent types to run: Blackout Redaction Job Agent, Blackout OCR Agent, Blackout Redaction Agent, and Blackout Usage Agent. 1. Click on the Relativity logo to return to the Relativity Admin View. 2. Click the Server & Agent Management tab. 3. Select Agents. 4. Click the New Agent button. 5. Select the Agent Type: Blackout Redaction Job Agent. 6. Select 1 for the Number of Agents. Note: The agents are multithreaded, so no performance increase is gained by creating duplicate agents on a single Agent Server. 7. Select the Agent Server you would like to use. Blackout 1.3 User Guide Page 6 of 40

7 8. Set any further settings you would like to customize. 9. Click Save and New. 10. Repeat Steps 5-9 for the remaining three agent types (Blackout OCR Agent, Blackout Redaction Agent, and Blackout Usage Agent). Note: On Relativity environments running with multiple Agent Servers, you will see a significant performance increase by adding Blackout OCR Agents and Blackout Redaction Agents to additional Agent Servers. You should not have more than one Blackout OCR Agent or Blackout Redaction Agent on each individual Agent Server. The Blackout Redaction Job Agent should only be on a single Agent Server. 11. Click Save to confirm and exit. 1.5 Upgrading Blackout 1. Navigate to the Relativity Application Library through the Applications & Scripts tab. 2. Click Upload Application at the top left. Blackout 1.3 User Guide Page 7 of 40

8 3. In the Application File section, click Choose File. 4. In the dialog box, select the Blackout.rap file to be uploaded. Once it is uploaded, click Save. Note: You cannot have different versions of Blackout installed on different workspaces. Blackout versions must be the same across all workspaces. 5. To upgrade Blackout to specific workspaces, click Install in the Workspaces Installed section. Note: You cannot have different versions of Blackout installed on different workspaces. Blackout versions must be the same across all workspaces. 6. On the next screen, click the ellipsis in the Workspaces section to choose the workspaces where you want to install Blackout. Check the workspaces and click OK to install Blackout. 1.6 Uninstalling Blackout 1. Navigate to the workspace where Blackout is installed. 2. Click the Workspace Admin tab. 3. Within Workspace Admin, click Relativity Applications on the header menu. Select Blackout from the application list. Blackout 1.3 User Guide Page 8 of 40

9 4. Click Unlock Application on the right side of the page. 5. When the application is unlocked, click Uninstall Application. 6. Click Validate Components to Uninstall on the right side of the page. 7. Then click Uninstall Application and Yes to confirm. Wait to verify that the uninstall process finishes without error. Blackout 1.3 User Guide Page 9 of 40

10 2. Configuration, Usage, and Licensing 2.1 Configuration The Blackout Configuration page is where you establish the connection and settings for the Blackout application. Click on the Relativity logo to access the Relativity Admin view. Navigate to the Blackout tab, which has two child tabs: Configuration and Usage. Click on the Configuration tab, where you will find the following fields that need to be configured for licensing and usage of Blackout: WebAPI URL: Blackout automatically detects the URL of the WebAPI for the Relativity instance. If this is incorrect, you can correct the URL here or contact if you are unsure of the correct URL. (Note: The following fields are all related to how you would like to send usage information for Blackout to Milyli for licensing purposes. Please see section 2.2 to learn more about properly configuring these fields.) SMTP Server Username Password Port Secured/Encrypted Connection Automatically send usage data via SMTP 2.2 Usage & Licensing Blackout collects information on the number of active Blackout users via the Blackout Usage Agent for usage and billing purposes. It is contractually required that licensing data be provided to the Blackout 1.3 User Guide Page 10 of 40

11 Milyli Blackout team in the form of two.csv files, Usage Log and Usage Stats, which can be sent either automatically or manually. The Usage Log contains a summary of statistics for each workspace where Blackout is installed, where each row is a different workspace. The Usage Stats.csv contains more detailed statistics on each workspace. Note: The licensing data collected does not include any personally indentifiable information, case information, or workspace names Automatically Send Licensing Data In order to automatically send licensing information via the Blackout tab, you must first set up SMTP. 1. Click on the Relativity logo to navigate to the Relativity Admin view, navigate to the Blackout tab, which has two child tabs: Configuration and Usage. Navigate to the Blackout::Configuration tab. The Blackout Configuration page is where you establish the connection and settings for the Blackout application. 2. Verify that the URL shown in the WebAPI URL field is correct. (Blackout automatically detects the WebAPI URL, so contact support@milyli.com if there are any issues with the URL shown here.) 3. In the SMTP Server field, type in the address to your SMTP server. 4. Fill in the Username and Password fields with the login information for the SMTP server, and enter in the SMTP port number in the Port field. Blackout 1.3 User Guide Page 11 of 40

12 5. Check the Secured/Encrypted Connection box if the connection to the SMTP server should be encrypted. 6. Check the Automatically send usage data via SMTP box if you want Blackout to automatically send licensing information to Milyli. Unchecking this box means that you agree to manually send the licensing files to Milyli each month Manually Send Licensing Data If you would prefer not to automatically send licensing information to Milyli, go to Relativity Admin, then navigate to the Blackout::Configuration child tab and uncheck the Automatically send usage data via SMTP box. By unchecking this box, you agree to manually send the Usage Log and Usage Stats.csv files to Milyli each month. These files can be downloaded from the Blackout::Usage child tab and ed to Usage tab is where the data for each month s usage can be found. Click on either the Usage Log or Usage Stats.csv files to download them. Blackout 1.3 User Guide Page 12 of 40

13 3. Creating and Running Blackout Jobs 3.1 Navigating Blackout Job List Job List The Blackout Job List shows all of the Blackout jobs for the workspace Job List Actions There are three actions available within the Blackout Job List: 1. New Blackout Job: Opens the Create Job page, where you can create a new Blackout job. 2. View: Opens the View Job page, where you can view the details of a particular Blackout job. 3. Copy: Opens the Create Job page with fields prepopulated to match the settings and criteria from an existing job. Blackout 1.3 User Guide Page 13 of 40

14 3.2 Creating and Editing a Blackout Job Figure 3.2-1: Create / Edit Page Job Fields - Job Name Figure 3.2-1: Create / Edit Page: Bullet 1 The Job Name field is a required field where you enter a unique, descriptive name to identify the Blackout job and keep your jobs organized Job Fields - Saved Search Figure 3.2-1: Create / Edit Page: Bullet 2 The Saved Search field is a required field where you specify the saved search that contains the documents Blackout will review. The dropdown will be populated with all existing saved searches within your workspace, both public and private. If you do not have an existing saved search for the documents you want Blackout to review, you must create a new saved search. Blackout 1.3 User Guide Page 14 of 40

15 Note: The Saved Search dropdown includes all saved searches in the workspace, including private saved searches created by other workspace users. You can create a Blackout job with saved searches that belong to other users, but you will not be able to access those saved searches from the Documents tab. For more information on saved searches, review the following Relativity documentation: Job Fields - Markup Set Figure 3.2-1: Create / Edit Page: Bullet 3 The Markup Set field is a required field where you can choose a markup set for where the redactions will be created. The dropdown will be populated with the existing markup sets for the workspace. To learn more about markup sets, review the following Relativity documentation: Blackout Rule Groups Figure 3.2-1: Create / Edit Page: Bullet 4 A Blackout Rule Group is a Blackout Markup Configuration that contains one or more Blackout Rules. Blackout Rules define the criteria Blackout will use to search documents and determine where to apply markups. A Blackout Markup Configuration consists of Markup Type (redaction or highlight), Markup SubType (redaction type or highlight color), Markup Text (if applicable), and Markup Scope (word, line, paragraph, block, page, or document). The single Blackout Markup Configuration will be applied to all Blackout Rules contained in the corresponding Blackout Rule Group. To delete a Rule Group at any time, click the red x ( ) to the left of the Rule Group. A warning message will appear to prompt you to click OK if you are sure you want to delete the selected Rule Group. Blackout 1.3 User Guide Page 15 of 40

16 To create a Blackout Rule Group, first select the markup type, either redaction or highlight, based on the type of Blackout Rule you d like to establish either to redact sensitive words, phrases, or numbers before producing documents or to call attention to them for later review. The next field Markup SubType - will change based on which type or markup redaction or highlight has been set Rule Group Fields Markup SubType Figure 3.2-1: Create / Edit Page: Bullet 5 Once a markup type has been selected, you can select the markup subtype to decide the style of that markup. If you are applying redactions, the Markup SubType dropdown will contain the following options for the type of redactions applied: Black Text Cross White Inverse If you are applying highlights to call attention to certain words, phrases, or numbers, the Markup SubType will include the following options for the color of the highlights applied: Yellow Green Blue Orange Pink Purple To learn more about each of these markup types, review the following Relativity documentation: Rule Group Fields Markup Text Figure Create / Edit Page: Bullet 6 The Markup Text field will only appear if the Markup SubType field is set to Text. Fill out this text box with the text you would like to appear in the redactions. The text will be sized to fit into the redaction box, so it s suggested that you keep the text short in order for it to be legible within the box. Blackout 1.3 User Guide Page 16 of 40

17 3.2.7 Rule Group Fields Markup Scope Figure 3.2-1: Create / Edit Page: Bullet 7 There are multiple options for specifying where exactly you want the Blackout markup to be applied, which you can specify in the Markup Scope field. The Markup Scope dropdown contains the following options for where the redaction will be applied: Word: Redacts or highlights beginning with the first character and ending with the last character that matches the Blackout Rule Line: Redacts or highlights the entire line where the Blackout Rule match appears Note: If the Blackout Rule match wraps onto multiple lines, Blackout will apply the markup on all lines where the match appears. If the Blackout Rule match appears on multiple pages, Blackout will apply the markup on the applicable lines on both pages. Paragraph: Redacts or highlights the entire paragraph where the Blackout Rule match appears Block: Redacts or highlights the entire block of text where the Blackout Rule match appears. Blocks are parent groupings of paragraphs, equivalent to the relationship between parent <div> tags and child <p> tags in HTML. An example of a block of text would be an entire column that contains multiple paragraphs. Page: Redacts or highlights the entire page where the Blackout Rule match appears Note: If the Blackout Rule match wraps onto multiple pages, Blackout will apply the markup on all applicable pages. Document: Redacts or highlights the entire document where the Blackout Rule match appears Rule Group Fields Expand Markup to Full Width of Page Figure 3.2-1: Create / Edit Page: Bullet 8 Blackout has an advanced setting that will expand the markup selected in a particular Rule Group to the full width of the page. Click the gear icon Expand Markup to Full Width of Page checkbox. next to the Markup Scope field and check the Rule Group Fields Blackout Rules Figure 3.2-1: Create / Edit Page: Bullet 9 There are two types of Blackout Rules: Word/Phrase and Regex (Regular Expression, i.e. patternmatching). Word/Phrase Rules: Blackout will search documents extracted text for exact matches to the text in the box (which is not case-sensitive). Regex Rules: Blackout will search the documents extracted text for pattern matches to the criteria defined by the regular expression. Blackout 1.3 User Guide Page 17 of 40

18 For each of these Rules, you can select the markup type you want placed onto the redacted text. Use the Markup Type, Markup SubType, and Markup Text fields for each Rule to specify how you want the redactions to appear a Blackout Rules Word/Phrase Figure 3.2-1: Create / Edit Page: Bullet 9A In this field, enter the exact term you would like Blackout to redact or highlight. The Word/Phrase field accepts a word, phrase, or multiple lines of text, and it is not case-sensitive. When the Blackout job runs, it will scan the documents for words and phrases matching this Rule, then redact or highlight any matches using the markup set defined in the Markup Set fields. Enter multiple Word/Phrase Rules by typing the words and phrases in separate text fields. (A new text field will be automatically created once you begin typing in the first field.) Notes: dtsearch syntax and wildcards are NOT supported in Word/Phrase Rules Word/Phrase Rules will not redact or highlight matches that appear within words. For example, the Word/Phase Rule a will not match the word cat. Additionally, all white space is treated similarly for Word/Phrase Rule matches i.e., words separated by multiple spaces, tabs, line breaks, and page breaks will be treated as if they are separated by a single space and marked accordingly b Blackout Rules Regex Name & Expression Figure 3.2-1: Create / Edit Page: Bullet 9B In the Name dropdown, you can select an existing pattern-matching Regex Rule (from another Blackout job in the workspace) or create a new Regex Rule with a new name. When you select an existing Rule, the field will automatically be filled with the existing regular expression details. To create a new Rule, enter a unique, descriptive name so that you can identify the Regex Rule and reuse it when creating other Blackout jobs. Learn more about regular expressions here: Notes: If you need help writing a particular regular expression, contact support@milyli.com. Milyli can usually provide a regular expression within one business day. Blackout supports the.net flavor of regular expressions. Blackout regular expressions should NOT be surrounded with quotes or ## as in dtsearch. See the link above for correct Blackout systax. o Correct Example: \b[0-9]{3}\-[0-9]{2}\-[0-9]{4}\b o Incorrect Example ##\b[0-9]{3}\-[0-9]{2}\-[0-9]{4}\b Blackout 1.3 User Guide Page 18 of 40

19 3.2.9c Blackout Rules Regular Expression Capture Groups Starting with version 1.3, Blackout supports the use of regular expression capture groups. Regular expression capture groups allow you to redact parts of a regex match, rather than the entire match. If there is at least one capture group with a name that begins with REDACT then only those capture groups will be redacted for that rule. Example: Original Text SSN: DOB: 12/09/1980 Regular Expressions with Capture Group \bssn:(?<redact>.*)$ \bdob:(?<redact>.*)$ Redacted Result SSN: DOB: If you have more questions about capture groups, contact Milyli support at support@milyli.com. Note: As of Blackout 1.3, Blackout cannot partially redact words. For example, it is not possible to only redact the first five digits of an eight-digit number Create Blackout Job Figure 3.2-1: Create / Edit Page: Bullet 10 When you have filled out the Blackout job details and added all of the Rule Groups for what you would like to redact or highlight, click Create at the top of the page, which will take you to the View Job page. You will be able to edit the Blackout job until the job runs; once the job starts running, you will no longer be able to make changes (unless you delete the markups and re-run the Blackout job). To run the Blackout job immediately, click Create & Run in the Blackout Job console on the right side of the page Edit Blackout Job When a job has been created, but has not yet run, you can click Edit to navigate to the Edit Job page where you can change the details of the job Delete Blackout Job A user can only delete a Blackout Job if it has not yet run. If that is the case, click the Delete button on the View Job page to delete the job. Blackout 1.3 User Guide Page 19 of 40

20 Delete Markups To delete all redactions or highlights applied during previous runs of a Blackout job, click the Delete Markups button in the Blackout Job console. You can then edit and re-run Blackout jobs as needed. Note: All markups previously created by the current Blackout Job will be deleted including markups that have been manually edited or accepted Copy Blackout Job You can copy a Blackout job from the View Job and Jobs List pages. If you click Copy from either of these pages, Blackout will open a new Create Job page and the fields will be prepopulated with the settings from the existing job. You can then change any of the fields and click Create or Create & Run to create the new job. (Give the new job a unique, descriptive name so you can identify it later.) Note: The Run Log from the original job will not be copied since the new job is a completely independent Blackout job. Blackout 1.3 User Guide Page 20 of 40

21 Import Rules You can import Blackout Rule Groups and Rules from a.csv file. By default, Blackout supports the import of up to 500 rules. If you need to import more rules, contact for assistance. Download the.csv template from the Blackout support website at Populate the.csv using Microsoft Excel and save the file in.csv format. The following columns are required for each row to be imported: o Word/Phrase OR RegEx Name & RegEx o Markup Type Valid values: Redaction (default) Highlight Markup Subtype Valid values for Redaction: o Black (default) o White o Text o Cross o Inverse Valid values for Highlight: o Yellow (default) o Green o Blue o Orange o Pink o Purple Markup Text is ONLY required if Markup Subtype is set to Text. Blackout 1.3 User Guide Page 21 of 40

22 o Required Import.csv columns continued Markup Scope Valid values: o Word (default) o Line o Paragraph o Block o Page o Document Expand Markup to Full Width of Page Valid values: o TRUE o FALSE (default) IMPORTANT: To use Import Rules in Relativity 8.x, the Create or Edit Job view needs to be opened in a separate browswer tab. o To use Import Rules in Relativity 8.x For new jobs: Right-click on the New Blackout Job button on the Blackout Job List page. For existing jobs: Right-click on the Edit button on the Job View page. Choose Open in new tab from the context menu. The Import Rules button will display in the right-hand console on the Create / Edit Blackout Job screen. On the Create or Edit Blackout Job screen: o Make sure that Job Name, Saved Search, and Markup Set are populated. o Click Import Rules. o Select the completed.csv to import. If the.csv is valid, the rules will import and the job will automatically save. Blackout 1.3 User Guide Page 22 of 40

23 3.3 Viewing and Running Blackout Jobs Figure 3.3-1: View Job Page Run Job Figure 3.3-1: View Job Page: Bullet 1 A Blackout job is run by either clicking Run on the View Job page or by clicking Create & Run on the Create Job page. Blackout jobs can be run multiple times for example, in the event that documents have been added to the saved search after the original run. Blackout will only process the new documents. Blackout 1.3 User Guide Page 23 of 40

24 When a job runs, Blackout goes through multiple steps to generate markups on the documents in the selected Relativity saved search. When you run a job, it will either show a status of Queued or Running: Queued : The job will be queued until it is picked up by a Blackout Redaction Job Agent. Running : The job has been picked up and is being processed. Blackout performs the following operations while it is running: 1. Run the Relativity saved search. Blackout will run the Relativity saved search to find all of the documents that fit the search criteria. (The number of documents returned by the saved search will be in the Run Log under Saved Search. ) 2. Determine which documents need to be processed. Blackout will only process documents that haven t previously been processed by an earlier run of this particular job or documents that have changed since the last time this Blackout job ran. (The number of documents that need to be processed will be listed under This Run in the Run Log.) 3. Search extracted text for Blackout Matches. Blackout will search each document s extracted text for Blackout Matches that is, text that matches the Word/Phrase or Regex Rules. (The number of documents containing Blackout Matches will be listed under Qualified for Markup in the Run Log.) 4. OCR documents. Blackout will now use OCR (optical character recognition) on the images of the documents qualified for redaction to locate the coordinates of the Blackout Matches. 5. Apply markups. Blackout will use the coordinates obtained by OCR to create markups using the Word/Phrase or Regex Rules established on the Create Job page. (The number of documents marked successfully will appear in the Run Log under Redacted. ) Complete: When all markups have been applied, the job is complete Stop Running Job You can stop a job that is running or queued at any time by clicking Stop on the View Job page, or by clicking Stop next to the job on the Job List page. When a job is stopped, the markups that have already been made will remain. If a job is restarted, Blackout will pick up the job where it left off, only processing documents that have not been previously processed by the job. Note: Each agent will complete its current batch of work after Stop is clicked. This could range from a few seconds to several minutes depending on the size of the documents being processed, and the current step in the Blackout process. Blackout 1.3 User Guide Page 24 of 40

25 3.3.3 Total Documents Run Figure 3.3-1: View Job Page: Bullet 2 The Total Documents Run field on the View Job page shows the total number of unique documents that have been processed by this Blackout job. This includes documents that have been redacted and/or highlighted by Blackout, as well as documents that have been processed but did not have any markups generated by Blackout Total Documents Marked Figure 3.3-1: View Job Page: Bullet 3 The Total Documents Marked field shows a running total of all documents on which the current Blackout Job has applied redactions. Click the number shown to navigate to a saved search containing all redacted and highlighted documents in the designated document set Rules - Terms Marked Figure 3.3-1: View Job Page: Bullet 4 For each Rule that was applied to the particular Blackout job, you can find the number of times that word, phrase, or regular expression was highlighted or redacted in the Terms Marked column Run Log Figure 3.3-1: View Job Page: Bullet 5 The Run Log on the View Job page displays all of the runs for a Blackout job. For each run in the Run Log, you can see: Status: The status of an individual run of the Blackout job Start: The time an individual run of the Blackout job was started Elapsed Time: The amount of time elapsed in the run (including how long the current job has been running) Saved Search: The number of documents returned by the saved search for this run This Run: The number of documents in the saved search that have not been previously processed by Blackout or have changed since the last run Qualified: The number of documents where a Blackout Match was found in the extracted text Marked: The number of documents that have had markups applied to them during this job run Note: The Run Log also provides a link to the set of documents with Blackout markups. Click the number in the Total Documents Marked field to navigate to a list of documents to review. (This feature is only supported in Relativity 8.1 and higher.) Blackout 1.3 User Guide Page 25 of 40

26 3.3.7 Errors & Warnings If there is an issue preventing the job from completing its run, an error message will appear at the top of the View Job page. If there is an issue that prevents Blackout from accurately redacting or highlighting the document, a warning will appear at the top of the View Job page. Blackout will attempt to process these documents on future runs, so if you resolve the issue, the document will be processed and the warning will be resolved. Possible warnings include: ## Documents did not have images. This warning indicates a certain number of documents within the saved search were not imaged. Blackout can only apply markups on images of documents, so these documents must be imaged. To find the documents that need to be imaged, create a new saved search that combines the saved search from the Blackout job with the additional search criteria: HasImages Is No. ## Documents did not have extracted text. This warning indicates a certain number of documents within the saved search did not have extracted text. Blackout Rules are compared to documents extracted text to determine documents qualified for markup, so all documents processed by Blackout must have extracted text. To find the documents that need extracted text, create a new saved search that combines the saved search from the Blackout job with the additional search criteria: Extracted Text Is Unset. The last run contained ## documents which qualified for markup but contained mismatch(es) with results from the extracted text. This warning indicates a certain number of documents in which text within the extracted text matched the Rule criteria, but that matching text was not found in the images, or the reverse - that is, text matching the criteria is found in the image, but not in the extracted text. View a table with information on the mismatches for the particular job and associated documents by clicking the link in the warning. Clicking on the linked title of any document will take you to that document where you can view and resolve the issue. (See section Document Mismatches for more information on how to view document mismatches and make it easy for reviewers to resolve them.) Blackout 1.3 User Guide Page 26 of 40

27 3.3.8 Document Mismatches In addition to viewing document mismatches in the mismatch table from the View Job page, reviewers can view document mismatches in the Relativity viewer, so they can resolve issues without interrupting their review workflow. But in order to do this, you must build out a review layout that will provide information on mismatches. Blackout automatically creates a persistent list of the documents with mismatches, which you can access through the Persistent Lists::Lists tab. (The list of mismatches will be indicated by the name of the particular Blackout job.) Then create a Relativity saved search based on that list by following the steps below: 1. Click the Saved Searches icon. 2. Select New Search. 3. Under Conditions, select Lists from the Field dropdown. Blackout 1.3 User Guide Page 27 of 40

28 4. Leave Operator set to these conditions. 5. Click the ellipsis, next to the Value field. 6. On the pop-up window, select Lists from the Field dropdown, and click the ellipsis next to the Value field. 7. Select the list search that you want to use (the list of mismatches will be indicated by the name of the particular Blackout job), and click Add. Then click Set. Blackout 1.3 User Guide Page 28 of 40

29 8. In the Fields (Required) section, select Lists, and move it to the right. 11. Click Save. This will make it easy for reviewers to view only the documents with mismatches in order to resolve issues. For more information on Relativity lists, review the following relevant Relativity documentation: search from list To add document mismatches to a review layout, click the pencil icon to edit the layout. Blackout 1.3 User Guide Page 29 of 40

30 Click the Add Text option in any new category. (Note: Document Mismatch Reports will not display correctly in a Category with other Fields.) Choose whichever row and order you d like, click the Custom Text ellipsis. Then change the text view to HTML using the Toggle Source HTML brackets icon. In the text box, enter one or both of the following tokens to show the mismatches caused by Blackout Rule matches that are either missing from the OCR text or the extracted text: <div id="blackout_missing_from_ocr_text"></div> <div id="blackout_missing_from_extracted_text"></div> Blackout 1.3 User Guide Page 30 of 40

31 Click OK, then Save (or Save and New) to finish adding the document mismatch information to the layout. To learn more about editing Relativity layouts, review the following Relativity documentation: Hypertext OCR Results When Blackout reads a document s image using optical character recognition (OCR), Blackout generates a Hypertext OCR (HOCR) version of the document with additional markup that contains all the text and formatting of the document along with coordinates of each of the document s words. HOCR is a standard for representing data obtained by the OCR process in which text, style, layout information, and other information are encoded in the form of HTML. This HOCR can be extremely helpful in troubleshooting any mistakes Blackout might have made. For example, if Blackout was run in order to redact all instances of the word Enron, but you find an instance that has not been redacted, you could review the HOCR to see how Blackout processed this word the HOCR could show Enr0n instead of Enron. To add links to the HOCR to a review layout, follow the same steps you followed in order to add the Document Mismatch Results to the review layout (see section for more information), except instead of entering the HTML provided in that section, paste in the following: <a href="#" onclick="window.open('../../custompages/5a4d89fc-7ec9-4a37-99ca- 2a4d94ba4f02/ExtendedDocument/HOCR/'+location.search.split('ArtifactID=')[1].split('&')[0], 'HOCR','height=800,width=800');">View HOCR</a> <a href="#" onclick="window.open('../../custompages/5a4d89fc-7ec9-4a37-99ca- 2a4d94ba4f02/ExtendedDocument/Text/'+location.search.split('ArtifactID=')[1].split('&')[0], 'HOCR','height=800,width=800');">View Text</a> Blackout 1.3 User Guide Page 31 of 40

32 Pre-OCR Blackout Jobs The OCR portion of the Blackout job is the most resource-intensive part of the Blackout process. However, once a document has been OCR d by Blackout, it will not need to be OCR d again on subsequent Blackout jobs unless the document is re-imaged. Those additional jobs will run faster and utilize fewer resources than the initial job when Blackout OCR d the document. Depending on your workflow and resource management, you may wish to pre-ocr a document set with Blackout before actually applying any markup rules. For example, you may want to run a pre- OCR job with additional agent servers during off-hours, and then run your auto-redaction jobs with fewer resources during regular business hours. To pre-ocr a document set, run a Blackout job with the single regular expression below: \A This will cause Blackout to qualify all documents, but not create any markups. By qualifying all documents, Blackout will OCR each of them. Subsequent Blackout jobs that run against any of those documents will be able to skip the OCR step of the Blackout process. 3.4 Blackout Redaction Log To view and export log files for redacted documents, click the Redaction Log tab within the Blackout application. From here, you can specify a saved search to define the set of documents for which you would like to view redaction logs. Click Download to export a.csv Redaction Log containing the following information for redactions on that document set: Markup ID Blackout 1.3 User Guide Page 32 of 40

33 Control Number Page Number Markup Type Markup SubType Markup Text Full Page (with a TRUE or FALSE value) Markup Set Note: The Blackout Redaction Log contains data on all Blackout-generated and manually applied redactions and highlights on all markup sets. Blackout 1.3 User Guide Page 33 of 40

34 4. Reviewing Blackout Markups Once Blackout processes a set of documents, the reviewer can then use the Blackout Markup Navigator to review the applied redactions and highlights from within the Relativity viewer. Note: The Blackout Markup Navigator is only displayed in Google Chrome and Internet Explorer 11 (and higher). Older versions of Internet Explorer will revert to the native Relativity Markup Navigator. 4.1 Viewing the Blackout Markup Navigator Markups are applied only to the image of a document, so to review redactions and highlights, open the document and select the Image view: Once the document viewer is in Image view, a document navigation bar will appear below the viewer with a Blackout button. The Blackout button will appear in one of two states. If there are Blackout markups that have not been reviewed, the button will be highlighted orange and indicate the number of markups that are unresolved, i.e. have not been reviewed. When there are no markups to review or all markups have already been reviewed, the button will not be highlighted and will not display any number of unresolved markups. In either state, clicking the Blackout button will expand the Blackout Markup Navigator, which is where you can accept and reject markups. Blackout 1.3 User Guide Page 34 of 40

35 4.2 Markups in the Blackout Markup Navigator The Blackout Markup Navigator will show all markups on this document, including those created both by Blackout or manually. Markups from all markup sets will appear in the Blackout Markup Navigator. Choose which markup set you would like to review from the dropdown in the Blackout Markup Navigator. The columns in the Blackout Markup Navigator will show the following information about each markup. Origin: This column shows how the markup was created and its history. There are three possible icons that can appear in this column: o o o This icon indicates that the markup was generated by a Blackout job. This icon indicates that the markup was originally generated by a Blackout job, but has since been manually edited. This icon means that the markup was created manually (not using Blackout). Accept / Reject: For all markups created by Blackout, there will be an Accept button ( ) and a Reject button ( ). (See section 4.3 for more information on accepting and rejecting markups.) Page: This column indicates on which page the markup appears. Redacted/Highlighted Text: This column shows the text that is hidden by the markup. Reason: This column indicates the reason for the Blackout markup. Markups that were generated by Word/Phrase Rules will default to a truncated version of the word or phrase. Markups that were generated by RegEx Rules will default to the regex name. Markup Type: This column indicates the type of markup applied - redaction or highlight. Markup SubType: This column indicates the subtype such as black box, cross, text, or the highlight color. Markup Text: If the Markup SubType was set to Text, this column will show the text within the markup. Markup Set: This column indicates the markup set to which the redaction or highlight belongs. Job: This column indicates the name of Blackout job that generated this redaction. 4.3 Accepting / Rejecting Markups After a Blackout job processes the document set, all of the generated markups will appear within the document as unresolved markups, that is, markups requiring action from the reviewer to accept or reject them. Accepting and rejecting markups is done within the Blackout Markup Navigator, using the accept or reject buttons. If the reviewer accepts a markup, that markup is kept within the document. If the reviewer rejects the markup, the markup is removed from the document. Either way, the markup will no longer be Blackout 1.3 User Guide Page 35 of 40

36 considered unresolved, and the markup will remain in the Blackout Markup Navigator where the reviewer can change the resolution as needed. Note: If a Blackout markup is manually edited before it is rejected or deleted, and is subsequently accepted, the markup will return to the state it was in before it was manually edited Has Unresolved Markups Field Blackout creates a Has Unresolved Markups document field upon install of the application. Any document that has been processed by Blackout will have a Yes or No value for this field. Documents that have not been processed by Blackout will have a value of Unset. This field can be very useful in determining which documents have been processed by Blackout, as well as which documents have unresolved redactions or highlights. Blackout 1.3 User Guide Page 36 of 40

37 5. For Reviewers 5.1 The Blackout Review Workflow Note: The screenshots below are from Relativity 9.1. The user interface appears slightly differently in Relativity 8.x, but all functionality detailed below is identical. As a reviewer using Blackout to streamline markups in Relativity, Blackout gives you a simple workflow for reviewing Blackout markups. 1. In the Relativity viewer, select Image mode. 2. When viewing in Image mode, there will be a bar at the bottom of the document with a Blackout icon. The button will either appear like this, indicating that there are no Blackout markups needing review: Or, the Blackout icon will appear like this, indicating that there is a number of Blackout markups ready for review: 3. Click the Blackout icon to open the Blackout Markup Navigator. 4. To review a specific markup in the Navigator, choose the corresponding markup set from the dropdown. If you click on the markup type, it will navigate the document to that markup and highlight the markup. (Note: In Relativity versions 8.2 and lower, clicking the markup type will navigate to the page of the markup in the Relativity viewer, but will not highlight the corresponding markup.) Note: If you set the Relativity viewer to transluscent mode, you will be able to see markups as well as the text beneath the markups. Blackout 1.3 User Guide Page 37 of 40

38 5. You can now diagnose whether the Blackout markup should be accepted or rejected. Once you ve decided, click the relevant button to accept ( ) or reject ( ). 6. Review the next markup. Continue until all the markups in the document are resolved. 7. Once all markups within a document have been reviewed and there are no longer any unresolved markups, you can move on to the next document. 8. If you are confident that all of the markups on the document are either correct or incorrect, you can choose to accept all markups within that document ( markups within the document ( ) by clicking the relevant buttons. ) or reject all Note: To determine if there are more documents with unresolved markups, create a saved search where the document field Has Unresolved Markups equals Yes. 5.2 Reviewing Document Mismatches If you are reviewing documents that have mismatches (i.e., a Blackout Rule match has been found, but is not present in either the OCR or the extracted text), the mismatch information should appear in the review layout. (Contact your Relativity administrator or Case Manager if this information is not available in your layout.) The columns in the Missing from OCR Text or Missing from Extracted Text tables indicate the following: Job ID: This column provides the ID for the Blackout job. Rule: This column indicates the word, phrase, or friendly name of the pattern-matching regular expression specified for markup during Blackout job creation. Match This column indicates the text that matched the Blackout Rule. Location This column gives the approximate page and line number where the mismatch occurred. If the mismatch occurs because the Rule match is missing from the OCR, this column will give the approximate location of where Blackout expected to find the match. If the mismatch occurs because the Rule match is missing from the extracted text, this column will show where the redaction was applied, so you can choose to accept or reject it. Blackout 1.3 User Guide Page 38 of 40

39 5.3 Creating a Production Once you are satisfied that all markups have been reviewed, you are ready to produce the document set. For more information on creating a production, read the relevant Relativity documentation: When you create a production, you will create it using a specific markup set, so any markups using that markup set will appear in the production. Highlights will not appear in the production. If there are Blackout redactions in the markup set, they will appear in the production only if they have been accepted or are unresolved. Rejected Blackout redactions will not appear in the production. Blackout 1.3 User Guide Page 39 of 40

40 a product About Milyli Milyli is an e-discovery software development firm with a broad range of experience developing products from the ground up, as well as creating custom solutions for kcura s Relativity platform. Other Products We ve worked with a wide range of organizations to solve their unique business problems over the years, which gave us insight into common issues faced by different industries. We ve used that expertise to develop products to address those business painpoints and streamline your workflows right out of the box. Broadcast is a dashboard reporting tool for Relativity that gives users client- and workspace-level dashboards to render the information they need right within Relativity or on mobile devices. Relay is a Relativity application that cuts out the middleman when you need to import files into Relativity. Support Sales support@milyli.com sales@milyli.com (312) (312) Blackout 1.3 User Guide Page 40 of Milyli, Inc. All Rights Reserved