Equivio Performance with Relativity. Technical Brief Equivio v2.3.7

Size: px

Start display at page:

Download "Equivio Performance with Relativity. Technical Brief Equivio v2.3.7"

Kory Wheeler
6 years ago
Views:

1 Equivio Performance with Relativity Technical Brief Equivio v2.3.7

2 SUMMARY This document presents performance data for Equivio software, run in conjunction with Relativity, on a large actual case in the UK. The case comprised a total of approximately 12.5 million documents and s. The case was stored in Relativity, and processed using the Equivio Relativity plug-in. Equivio>NearDuplicates and Equivio> Threads were deployed in the customer's production environment using standard hardware and software equipment (see Appendix 1 for details). The Equivio software processed 12.5 million files in a total of less than 24 hours. Internal processing speed remained linear at over 532,857 files per hour. The results demonstrate Equivio's efficiency and scalability in handling very large document sets via the Relativity integration. EQUIVIO PROCESSING PERFORMANCE CASE DATA AND SETUP The customer's case consisted of more than 12.5 million documents and s which were input to Equivio as text files. The data was input to the Equivio software in two loads: Load 1: 4,979,581 files Load 2: 7,542,566 files In total, the case encompassed 5,564,346 documents and 6,957,801 s. Once the Equivio application had processed and calculated the near-duplicates and threads, the extract utility was run to update the Relativity database with the nearduplicate and thread grouping data. EQUIVIO SOFTWARE SETTINGS AND PARAMETERS The documents were processed by Equivio>NearDuplicates v2.3.7 [ ] (Jul :50:27) software, using the following settings and parameters: Number of processing threads 20 EquiLevel 70% Maximum number of levels 135 2

3 RESULTS The performance results are presented in the tables below. OVERALL PROCESSING PERFORMANCE (THROUGHPUT) Performance of the near-duplicate and thread processing is detailed in the following table: Phase Number of Time (H:M:S) Average Speed documents (documents/hour) Phase 1 4,979,581 09:15:00 538,333 Phase 2 7,542,566 14:15:00 529,303 Total 12,522,147 23:30:00 532,857 System scalability is illustrated in the figure below, which plots the total number of files processed over time against linear performance. Note that the internal processing speed remains virtually linear. The average rate of throughput is approximately 532,857 documents per hour. NEAR-DUPLICATE GROUPINGS The Equivio analysis discovered that 54.8% of the documents could be grouped into near-duplicate sets, as detailed in the following tables. The near-duplicate documents are in addition to 12.7% of the documents which were identified as exact duplicates. % of Unique % of Duplicates % of Nearduplicates Equisets 32.5% 12.7% 54.8% 1,787,025 3

4 THREADS The Equivio analysis of s was able to reduce review volumes by 34%, as detailed in the following table: Number of s Inclusives % of condensation 6,957,801 4,563, % EXTRACT UTILITY The extract run, which creates the load file for Relativity, took 28 hours and consisted of the following activities: Create and populate family tables Create and populate extract tables Update similarities Create and populate threads tables Upload results back to Relativity (Skipped in this run) Total processing time for the Extract process was 28:00:00. CONCLUSION The Equivio software exhibited outstanding processing performance in analyzing and grouping near-duplicates and threads in a very large case. Running on standard software and hardware in the customer's production environment, the Equivio nearduplicates and threads application processed 12.5 million files in less than 24 hours. Internal processing speed remained linear at over 532,857 files per hour, demonstrating Equivio's scalability in handling very large document sets via integration with the Relativity review platform. 4

5 APPENDIX: HARDWARE CONFIGURATION This section provides details regarding the configuration of hardware used in the customer's production environment. Please note that the Equivio v2.3.7 application runs on standard hardware and software platforms commonly deployed in enterprise environments. EQUIVIO PROCESSING MACHINE Operating system Processor Memory (RAM) System Type Windows Server 2008 R2 Enterprise SP1 Intel Xeon CPU (2 processors) 24 GB 64 bit SQL SERVER MACHINE Operating system Processor Memory (RAM) System Type Windows Server 2008 R2 Enterprise SP1 Intel Xeon (4 processors) 1.00 TB 64 bit Database Microsoft SQL Server 2008 R2 (SP1)

6 ABOUT EQUIVIO Equivio develops text analysis software for e-discovery. Users include the DoJ, the FTC, KPMG, Deloitte, plus hundreds of law firms and corporations. Equivio offers Zoom, an integrated web platform for analytics and predictive coding. Zoom organizes collections of documents in meaningful ways. So you can zoom right in and find out what s interesting, notable and unique. Request a demo at info@equivio.com or visit us at Zoom in. Find out. Equivio, Equivio Zoom, Equivio>NearDuplicates, Equivio> Threads, Equivio>Compare, Equivio>Relevance are trademarks of Equivio. Other product names mentioned in this document may be trademarks or registered trademarks of their respective owners. All specifications in this document are subject to change without prior notice. Copyright 2012 Equivio 6

Near-Duplicates and Threads in Equivio Zoom. Eliminating Redundant Data in Document Review

Near-Duplicates and Threads in Equivio Zoom. Eliminating Redundant Data in Document Review Near-Duplicates and Email Threads in Equivio Zoom Eliminating Redundant Data in Document Review BOOSTING REVIEW PRODUCTIVITY AND REDUCING LITIGATION COSTS Near-Duplicates and Email Threads are fully integrated