High-Performance Lustre with Maximum Data Assurance
|
|
- Jennifer Porter
- 5 years ago
- Views:
Transcription
1 High-Performance Lustre with Maximum Data Assurance Silicon Graphics International Corp. 900 North McCarthy Blvd. Milpitas, CA Disclaimer and Copyright Notice The information presented here is meant to be general discussion material only. SGI does not represent or warrant that its products, solutions, or services as set forth in this document will ensure that the reader is in compliance with any laws or regulations Silicon Graphics International All rights reserved.
2 TABLE OF CONTENTS 1.0 Introduction The Lustre File System Metadata Management Scale-Out Object Storage Data Assurance Through Integrated T10 PI Validation Simple and Standard Client Access to Data T10 PI End-to-End Assurance A Building Block Approach Benchmark Process and Results IOR POSIX Buffered Sequential I/O Results IOR POSIX Buffered Random I/O Results IOR POSIX Direct I/O Sequential Results IOR POSIX DIO Random Results Conclusion 9 SGI Lustre
3 1.0 Introduction In High-Performance Computing (HPC), there is a strong correlation between the compute power of the solution and the ability of the underlying data storage system to deliver the needed data for processing. As processor power increases, the goal of system architects is to design systems with an appropriate balance of data storage, data movement and data computing power and to do so in a manner that optimizes the overall processing output of the system at a given price point. Lustre storage solutions based on an optimized combination of SGI servers and NetApp storage arrays provide an excellent storage foundation that can be leveraged by HPC researchers, universities, and enterprises that need to deploy a high-throughput, scale-out, commercially-supported and cost-effective parallel file system storage solution. These SGI-delivered storage solutions use Intel Enterprise Edition for Lustre software, a commercially hardened and supported version of Lustre - the leading HPC open source parallel file system. Additionally, by leveraging industry leading data assurance protocols such as T10 PI the SGI-NetApp Lustre storage solutions are able to deliver the highest levels of data assurance and protection throughout the end-to-end data path as storage volumes grow and the potential for undetected bit errors increases. The result is a scale-out HPC storage solution capable of providing reliability and performance and that is based on an architecture that allows for the easy future scaling of both capacity and performance. This white paper provides a brief overview of the Lustre File System and configuration information on a scale-out SGI Lustre solution architecture that leverages NetApp-based block storage. The solution overview is followed by performance analysis and conclusions that were obtained through structured benchmark tests. 2.0 The Lustre File System Lustre is a parallel file system that delivers high performance through a scale-out approach that divides the workload among numerous scale-out processing nodes. While the processing power of numerous data storage servers is available, the system presents a traditional file system namespace that can be leveraged by hundreds or thousands of compute nodes using traditional file-based data access methods. A Lustre installation is made up of three key elements: the metadata management system, the object storage subsystem which takes care of actual file/data storage, and the compute nodes from which the data/file access is performed. 2.1 Metadata Management The metadata management system is made-up of a Metadata Target (MDT) and a corresponding Metadata Server (MDS). The MDT stores the actual metadata for the file system that includes elements like file names, file time stamps, access permissions, and information regarding the actual storage location of data objects for any given file within the object storage system. Within Lustre, the MDS is the server that services requests for file system operations and performs management of the MDT. More recent versions of Lustre include a scalable metadata capability that allow for request loads to be spread across multiple servers and in most deployments, the MDS is configured within a high-availability (HA) environment to ensure ongoing availability of the file system in the event of a server/component failure. SGI Lustre 1
4 2.2 Scale-Out Object Storage The object storage system for Lustre is where the scale out attribute of the solution occurs. The object storage system is made up of some number of Object Storage Servers (OSS) which manage the storage and retrieval of data and some number of Object Storage Targets (OST) which are the locations on which the actual data is placed/read by the OSS. Lustre deployments typically include numerous OSS nodes and multiple OST storage destinations and this scale-out attribute of Lustre creates an opportunity for the creation of object storage building blocks to be defined such that additional capacity and/or throughput may be added to the system through the addition of incremental building block system elements. In general, administrators will increase the number of OSS nodes in order to increase the data transfer bandwidth on the network that the storage system will support. OST storage configurations will be configured in order to meet both the capacity requirements for the overall system as well as the data throughput/performance requirements of the OSS nodes. Within scale-out file systems (often referred to as parallel file systems ) like Lustre, high-performance is achieved by having the system stripe data across multiple storage location (OSTs) such that file read/write operations are able to benefit from the ability to leverage the throughput of many storage devices in parallel. The result is a system that can deliver throughput at levels that far exceed the capabilities of any single device or node. 2.3 Data Assurance Through Integrated T10 PI Validation The data presented in this white paper looks at the performance of a single pair of highly available OSS nodes within the storage cluster. Additionally, the performance data presented is based on an SGI-and-NetApp Lustre configuration that leverages the T10 PI data assurance protocol in order to deliver extremely high levels of data validation/assurance. Later sections of this document will provide further information on T10 PI and the value that it delivers in highly-scalable storage solutions. 2.4 Simple and Standard Client Access to Data The Lustre storage solution includes client software that enables access to the scale-out Lustre storage solution using a standard file system interface. This standard presentation allows client applications and tools to instantly leverage Lustre-based data storage with no additional work or testing being required. SGI Lustre 2
5 3.0 T10 PI End-to-End Assurance T10 Protection Information (T10 PI), is an important standard that reflects the storage and data management industry s commitment to end-to-end data integrity validation. By validating data at numerous points within the I/O flow, T10 PI prevents silent data corruption, ensuring that invalid, incomplete or incorrect data will never overwrite good data. Without T10 PI, data corruption events may slip through the cracks and result in numerous negative outcomes that can include system downtime, lost revenue, or lack of compliance with regulatory standards. Protection Information (PI) adds an extra eight bytes of information to the 512-byte sectors typical of enterprise hard drives. Increasing sector size to 520 bytes, these eight bytes of metadata consist of guard (GRD), application (APP) and reference (REF) tags that are used to verify the 512 bytes of data in the sector. Complementing PI, DIX is a technology that specifies how I/O controllers can exchange metadata with a host operating system. The combination of DIX (data integrity between application and I/O controller) and PI (data integrity between I/O controller and disk drive) delivers end-to-end protection against silent corruption of data in flight between a sender and a receiver. SGI Lustre solutions are able to implement end-to-end T10 PI in order to deliver an integrated data protection capability. With the SGI IS5600i using T10 PI End to End, organizations are assured that their data is protected from the time it leaves the server until the time it is next read and accessed. After the 8 byte PI field is set by the HBA during the data write process, that PI field is rechecked by the array twice as it crosses through the Controller before being verified yet another time by the disk drive as it is written to storage media. During a Read Operation the disk drive re-verifies the PI data before returning it to the Controller which implements two additional checks - on the way to final verification SGI understands the importance of data and the integrity of that data within high-performance computing (HPC) environments, and has therefore focused on the implementation, validation and promotion of Protection Information (PI) technology to provide customers with end-to-end data confidence. SGI Lustre 3
6 4.0 A Building Block Approach While the deployment of Lustre solutions involves a variety of solution components and servers, the achievement of predictable high-performance results can be achieved by leveraging configurations that have been pre-validated, documented and benchmarked. This document presents configuration details and associated performance results based on extensive SGI and NetApp configuration validation work that may be leveraged by customers to deploy solutions with excellent performance and the highest levels of data assurance based on the integrated T10 PI features that are built-in to the solution. For this document, SGI is introducing the concept of a Scalable Storage Unit (SSU) that is comprised of two Lustre OSS nodes connected to an SGI IS5600i storage array (based on technology from NetApp). The purpose of this SSU-based approach is to create a Lustre scale-out building block that can be replicated as needed to scale throughput and capacity. The overall test configuration and dual-oss SSU is shown in the following diagram. SGI Lustre 4
7 Server Function Hostname Lustre MDS Server MDS01 Lustre OSS Server OSS 1-2 Lustre Clients SGI Platform SGI CH-C1104-GP2 Highland Server SGI CH-C1104-GP2 Highland Server SGI ICE X Cluster Processors Type Intel Xeon E v3 2.60GHz 30MB Cache Intel Xeon E v3 2.60GHz 30MB Cache Intel Xeon E v3 2.60GHz 30MB Cache Number of Nodes I/O Benchmark Lustre Clients Total Cores per Node Memory & Memory Speed 128 GB 2133MHz 128 GB 2133MHz 128 GB 2133MHz Local Storage 1 SATA 1TB 7.2 RPM 3Gb/s Drive 1 SATA 1TB 7.2 RPM 3Gb/s Drive Diskless Blades Network Interconnect IB FDR 4x Bandwidth 56Gb/s Latency < 1usec IB FDR 4x Bandwidth 56Gb/s Latency < 1usec IB FDR 4x Bandwidth 56Gb/s Latency < 1usec OS RHEL v6.5 Mellanox OFED v2.3 RHEL v6.5 Mellanox OFED v2.3 SLES11 SP3 Mellanox OFED v2.3 Lustre Software Intel Enterprise Edition for Lustre 2.2 (Lustre 2.5.X) Intel Enterprise Edition for Lustre 2.2 (Lustre 2.5.X) Intel Enterprise Edition for Lustre 2.2 (Lustre 2.5.X) SGI Storage Platform SGI IS5600 (16G FC Interface) SGI IS5600i w/ 6GB SAS T10 PI Data Assurance Enabled Storage Enclosure 24-Bay Enclosure (12 drives only used) 1x60-Bay Storage Ctrl + 1x60-Bay Expansion - - Drive Details Drive Type 4x 200GB 6Gb/s SAS Enterprise SSD 120x 6TB 7.2K RPM 6Gb/s NL-SAS - RAID Protection RAID10 Write Cache Mirror Enabled RAID6 (8+2) 128K Segment Size & WCM Enabled, DA Enabled Benchmark Process & Results This report summarizes the results of the IOR I/O benchmarks. Included in this report are the details of the benchmark environment, commands, and the results achieved while performing the I/O benchmarks on an SGI IS5600i Storage Array with two OSS servers based on Intel Enterprise Edition for Lustre software. IOR is an industry standard I/O benchmark used for benchmarking parallel file systems. The IOR application characteristics are 96% of the runtime in I/O, 1% in CPU & Memory Bandwidth, and 3% in MPI communications. The I/O performance is determined by the performance of the proposed storage and interconnects rather than processor speed or memory bandwidth of the Lustre client. To capture the end to end data protection using T10 PI, the SGI Lustre OSS servers had two Emulex LightPulse 16Gb Fibre Channel (T10 PI) HBAs installed and the IS5600i Storage Array was configured with Data Assurance enabled to prevent silent data corruption. The Emulex BlockGuard TM Data Integrity (offload) feature was enabled in the kernel module lpfc.conf. All testing completed successfully and the results shown reflect the fact that no performance impact was introduced through the enablement of the T10 PI assurance elements. SGI Lustre 5
8 5.1 IOR POSIX Buffered Sequential I/O Results Figure 1 chart shows the throughput results of a scaling benchmark from a single Lustre client up to 64 Lustre clients with 24 I/O threads per node. The aggregate file size (block size) was 192GB/client, which represents 1.5x the Lustre client physical memory to mitigate the influence of buffer cache. Figure 1: IOR Buffered Sequential I/O Results SGI Lustre 6
9 5.2 IOR POSIX Buffered Random I/O Results Figure 2 chart shows the throughput results of the Buffered Random I/O throughput. As discussed previously an aggregate file size (block size) was 192GB/client, which represents 1.5x the Lustre client physical memory to mitigate the influence of buffer cache. Figure 2: IOR Buffered Random I/O Results SGI Lustre 7
10 5.3 IOR POSIX Direct I/O Sequential Results Figure 3 chart shows the throughput results of Direct I/O using Sequential file access. Scaling is from a single Lustre client to 64 Lustre clients. With the direct I/O benchmarks the aggregate file size was reduced to 96GB/ client since direct I/O system requests bypass the Linux Kernel buffer cache. Figure 3: IOR Direct I/O Sequential Results SGI Lustre 8
11 5.4 IOR POSIX DIO Random Results Figure 4 chart shows the throughput results of Direct I/O using Random file access. Scaling is from a single lustre client to 64 lustre clients. With the direct I/O benchmarks the aggregate file size was reduced to 96GB/ client since direct I/O system requests bypass the Linux Kernel buffer cache. Figure 4: IOR Direct I/O Sequential I/O Results 5.0 Conclusion Based on the benchmarks performed characterizing the I/O performance for IOR, SGI concludes that the Lustre parallel file system is workload dependent but is an excellent parallel file system to support light to heavy I/O application workloads. For data protection SGI uses industry standard T10 PI data assurance technology to provide end to end data integrity with the SGI Lustre storage solution based on Intel Enterprise Edition for Lustre software. A Dual OSS configuration combined with an SGI IS5600i storage array with 120 drives supports up to 6GB/ sec; SGI defines this storage building block as a Scalable Storage Unit (SSU). A configuration of two SSU increases throughput to 12GB/sec, and throughput above 100GB sequential and 60/50 GB/sec random write/ read respectively, can be achieved with the straight-forward addition of the Scalable Storage Units as defined in this white paper. Global Sales and Support: sgi.com 2015 Silicon Graphics International Corp. All rights reserved. SGI, SGI ICE, SGI UV, Rackable, NUMAlink, Performance Suite, Accelerate, ProPack, OpenMP and the SGI logo are registered trademarks of Silicon Graphics International Corp. or its subsidiaries in the United States and/or other countries. Intel, the Intel logo, Xeon, and Xeon Inside are trademarks or registered trademarks of Intel Corporation in the U.S. and/or other countries. Linux is a registered trademark of Linus Torvalds in several countries. All other trademarks mentioned herein are the property of their respective owners SGI Lustre 9
Architecting Storage for Semiconductor Design: Manufacturing Preparation
White Paper Architecting Storage for Semiconductor Design: Manufacturing Preparation March 2012 WP-7157 EXECUTIVE SUMMARY The manufacturing preparation phase of semiconductor design especially mask data
More informationNetApp High-Performance Storage Solution for Lustre
Technical Report NetApp High-Performance Storage Solution for Lustre Solution Design Narjit Chadha, NetApp October 2014 TR-4345-DESIGN Abstract The NetApp High-Performance Storage Solution (HPSS) for Lustre,
More informationDell EMC Ready Bundle for HPC Digital Manufacturing Dassault Systѐmes Simulia Abaqus Performance
Dell EMC Ready Bundle for HPC Digital Manufacturing Dassault Systѐmes Simulia Abaqus Performance This Dell EMC technical white paper discusses performance benchmarking results and analysis for Simulia
More informationSun Lustre Storage System Simplifying and Accelerating Lustre Deployments
Sun Lustre Storage System Simplifying and Accelerating Lustre Deployments Torben Kling-Petersen, PhD Presenter s Name Principle Field Title andengineer Division HPC &Cloud LoB SunComputing Microsystems
More informationIntel Enterprise Edition Lustre (IEEL-2.3) [DNE-1 enabled] on Dell MD Storage
Intel Enterprise Edition Lustre (IEEL-2.3) [DNE-1 enabled] on Dell MD Storage Evaluation of Lustre File System software enhancements for improved Metadata performance Wojciech Turek, Paul Calleja,John
More informationDell PowerEdge R720xd with PERC H710P: A Balanced Configuration for Microsoft Exchange 2010 Solutions
Dell PowerEdge R720xd with PERC H710P: A Balanced Configuration for Microsoft Exchange 2010 Solutions A comparative analysis with PowerEdge R510 and PERC H700 Global Solutions Engineering Dell Product
More informationEmulex LPe16000B 16Gb Fibre Channel HBA Evaluation
Demartek Emulex LPe16000B 16Gb Fibre Channel HBA Evaluation Evaluation report prepared under contract with Emulex Executive Summary The computing industry is experiencing an increasing demand for storage
More informationThe current status of the adoption of ZFS* as backend file system for Lustre*: an early evaluation
The current status of the adoption of ZFS as backend file system for Lustre: an early evaluation Gabriele Paciucci EMEA Solution Architect Outline The goal of this presentation is to update the current
More informationW H I T E P A P E R. Comparison of Storage Protocol Performance in VMware vsphere 4
W H I T E P A P E R Comparison of Storage Protocol Performance in VMware vsphere 4 Table of Contents Introduction................................................................... 3 Executive Summary............................................................
More informationMicrosoft Exchange Server 2010 workload optimization on the new IBM PureFlex System
Microsoft Exchange Server 2010 workload optimization on the new IBM PureFlex System Best practices Roland Mueller IBM Systems and Technology Group ISV Enablement April 2012 Copyright IBM Corporation, 2012
More informationLS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance
11 th International LS-DYNA Users Conference Computing Technology LS-DYNA Best-Practices: Networking, MPI and Parallel File System Effect on LS-DYNA Performance Gilad Shainer 1, Tong Liu 2, Jeff Layton
More informationA Comparative Study of Microsoft Exchange 2010 on Dell PowerEdge R720xd with Exchange 2007 on Dell PowerEdge R510
A Comparative Study of Microsoft Exchange 2010 on Dell PowerEdge R720xd with Exchange 2007 on Dell PowerEdge R510 Incentives for migrating to Exchange 2010 on Dell PowerEdge R720xd Global Solutions Engineering
More informationHP SAS benchmark performance tests
HP SAS benchmark performance tests technology brief Abstract... 2 Introduction... 2 Test hardware... 2 HP ProLiant DL585 server... 2 HP ProLiant DL380 G4 and G4 SAS servers... 3 HP Smart Array P600 SAS
More informationEMC SYMMETRIX VMAX 40K STORAGE SYSTEM
EMC SYMMETRIX VMAX 40K STORAGE SYSTEM The EMC Symmetrix VMAX 40K storage system delivers unmatched scalability and high availability for the enterprise while providing market-leading functionality to accelerate
More informationAssessing performance in HP LeftHand SANs
Assessing performance in HP LeftHand SANs HP LeftHand Starter, Virtualization, and Multi-Site SANs deliver reliable, scalable, and predictable performance White paper Introduction... 2 The advantages of
More informationFeedback on BeeGFS. A Parallel File System for High Performance Computing
Feedback on BeeGFS A Parallel File System for High Performance Computing Philippe Dos Santos et Georges Raseev FR 2764 Fédération de Recherche LUmière MATière December 13 2016 LOGO CNRS LOGO IO December
More informationLustre on ZFS. At The University of Wisconsin Space Science and Engineering Center. Scott Nolin September 17, 2013
Lustre on ZFS At The University of Wisconsin Space Science and Engineering Center Scott Nolin September 17, 2013 Why use ZFS for Lustre? The University of Wisconsin Space Science and Engineering Center
More informationA ClusterStor update. Torben Kling Petersen, PhD. Principal Architect, HPC
A ClusterStor update Torben Kling Petersen, PhD Principal Architect, HPC Sonexion (ClusterStor) STILL the fastest file system on the planet!!!! Total system throughput in excess on 1.1 TB/s!! 2 Software
More informationAccelerating Microsoft SQL Server 2016 Performance With Dell EMC PowerEdge R740
Accelerating Microsoft SQL Server 2016 Performance With Dell EMC PowerEdge R740 A performance study of 14 th generation Dell EMC PowerEdge servers for Microsoft SQL Server Dell EMC Engineering September
More informationEMC SYMMETRIX VMAX 40K SYSTEM
EMC SYMMETRIX VMAX 40K SYSTEM The EMC Symmetrix VMAX 40K storage system delivers unmatched scalability and high availability for the enterprise while providing market-leading functionality to accelerate
More informationDell EMC Ready Bundle for HPC Digital Manufacturing ANSYS Performance
Dell EMC Ready Bundle for HPC Digital Manufacturing ANSYS Performance This Dell EMC technical white paper discusses performance benchmarking results and analysis for ANSYS Mechanical, ANSYS Fluent, and
More informationTHE SUMMARY. CLUSTER SERIES - pg. 3. ULTRA SERIES - pg. 5. EXTREME SERIES - pg. 9
PRODUCT CATALOG THE SUMMARY CLUSTER SERIES - pg. 3 ULTRA SERIES - pg. 5 EXTREME SERIES - pg. 9 CLUSTER SERIES THE HIGH DENSITY STORAGE FOR ARCHIVE AND BACKUP When downtime is not an option Downtime is
More informationDELL Terascala HPC Storage Solution (DT-HSS2)
DELL Terascala HPC Storage Solution (DT-HSS2) A Dell Technical White Paper Dell Li Ou, Scott Collier Terascala Rick Friedman Dell HPC Solutions Engineering THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES
More informationEMC CLARiiON Backup Storage Solutions
Engineering White Paper Backup-to-Disk Guide with Computer Associates BrightStor ARCserve Backup Abstract This white paper describes how to configure EMC CLARiiON CX series storage systems with Computer
More informationAn Oracle Technical White Paper October Sizing Guide for Single Click Configurations of Oracle s MySQL on Sun Fire x86 Servers
An Oracle Technical White Paper October 2011 Sizing Guide for Single Click Configurations of Oracle s MySQL on Sun Fire x86 Servers Introduction... 1 Foundation for an Enterprise Infrastructure... 2 Sun
More informationSAP SD Benchmark with DB2 and Red Hat Enterprise Linux 5 on IBM System x3850 M2
SAP SD Benchmark using DB2 and Red Hat Enterprise Linux 5 on IBM System x3850 M2 Version 1.0 November 2008 SAP SD Benchmark with DB2 and Red Hat Enterprise Linux 5 on IBM System x3850 M2 1801 Varsity Drive
More information2 to 4 Intel Xeon Processor E v3 Family CPUs. Up to 12 SFF Disk Drives for Appliance Model. Up to 6 TB of Main Memory (with GB LRDIMMs)
Based on Cisco UCS C460 M4 Rack Servers Solution Brief May 2015 With Intelligent Intel Xeon Processors Highlights Integrate with Your Existing Data Center Our SAP HANA appliances help you get up and running
More informationComparison of Storage Protocol Performance ESX Server 3.5
Performance Study Comparison of Storage Protocol Performance ESX Server 3.5 This study provides performance comparisons of various storage connection options available to VMware ESX Server. We used the
More informationSGI UV 300RL for Oracle Database In-Memory
SGI UV 300RL for Oracle Database In- Single-system Architecture Enables Real-time Business at Near Limitless Scale with Mission-critical Reliability TABLE OF CONTENTS 1.0 Introduction 1 2.0 SGI In- Computing
More informationFast and Easy Persistent Storage for Docker* Containers with Storidge and Intel
Solution brief Intel Storage Builders Storidge ContainerIO TM Intel Xeon Processor Scalable Family Intel SSD DC Family for PCIe*/NVMe Fast and Easy Persistent Storage for Docker* Containers with Storidge
More informationIBM Power Systems HPC Cluster
IBM Power Systems HPC Cluster Highlights Complete and fully Integrated HPC cluster for demanding workloads Modular and Extensible: match components & configurations to meet demands Integrated: racked &
More informationStorage Consolidation with the Dell PowerVault MD3000i iscsi Storage
Storage Consolidation with the Dell PowerVault MD3000i iscsi Storage By Dave Jaffe Dell Enterprise Technology Center and Kendra Matthews Dell Storage Marketing Group Dell Enterprise Technology Center delltechcenter.com
More informationIBM Emulex 16Gb Fibre Channel HBA Evaluation
IBM Emulex 16Gb Fibre Channel HBA Evaluation Evaluation report prepared under contract with Emulex Executive Summary The computing industry is experiencing an increasing demand for storage performance
More informationDELL EMC ISILON F800 AND H600 I/O PERFORMANCE
DELL EMC ISILON F800 AND H600 I/O PERFORMANCE ABSTRACT This white paper provides F800 and H600 performance data. It is intended for performance-minded administrators of large compute clusters that access
More informationComputer Science Section. Computational and Information Systems Laboratory National Center for Atmospheric Research
Computer Science Section Computational and Information Systems Laboratory National Center for Atmospheric Research My work in the context of TDD/CSS/ReSET Polynya new research computing environment Polynya
More informationTechnical White paper Certification of ETERNUS DX in Milestone video surveillance environment
Technical White paper Certification of ETERNUS DX in Milestone video surveillance environment This white paper describes the certification tasks for Milestone video surveillance solutions with ETERNUS
More informationAccelerate Database Performance and Reduce Response Times in MongoDB Humongous Environments with the LSI Nytro MegaRAID Flash Accelerator Card
Accelerate Database Performance and Reduce Response Times in MongoDB Humongous Environments with the LSI Nytro MegaRAID Flash Accelerator Card The Rise of MongoDB Summary One of today s growing database
More informationJMR ELECTRONICS INC. WHITE PAPER
THE NEED FOR SPEED: USING PCI EXPRESS ATTACHED STORAGE FOREWORD The highest performance, expandable, directly attached storage can be achieved at low cost by moving the server or work station s PCI bus
More informationHIGH-PERFORMANCE STORAGE FOR DISCOVERY THAT SOARS
HIGH-PERFORMANCE STORAGE FOR DISCOVERY THAT SOARS OVERVIEW When storage demands and budget constraints collide, discovery suffers. And it s a growing problem. Driven by ever-increasing performance and
More informationDell TM Terascala HPC Storage Solution
Dell TM Terascala HPC Storage Solution A Dell Technical White Paper Li Ou, Scott Collier Dell Massively Scale-Out Systems Team Rick Friedman Terascala THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES ONLY,
More informationHow Smarter Systems Deliver Smarter Economics and Optimized Business Continuity
9-November-2010 Singapore How Smarter Systems Deliver Smarter Economics and Optimized Business Continuity Shiva Anand Neiker Storage Sales Leader STG ASEAN How Smarter Systems Deliver Smarter Economics
More informationEMC Backup and Recovery for Microsoft SQL Server
EMC Backup and Recovery for Microsoft SQL Server Enabled by Microsoft SQL Native Backup Reference Copyright 2010 EMC Corporation. All rights reserved. Published February, 2010 EMC believes the information
More informationAn Introduction to GPFS
IBM High Performance Computing July 2006 An Introduction to GPFS gpfsintro072506.doc Page 2 Contents Overview 2 What is GPFS? 3 The file system 3 Application interfaces 4 Performance and scalability 4
More informationVertical Scaling of Oracle 10g Performance on Red Hat
Vertical Scaling of Oracle 10g Performance on Red Hat Enterprise Linux 5 on Intel Xeon-Based Servers Oracle 10g Red Hat Enterprise Linux 5 Intel Xeon-based servers 3 1. Introduction and executive summary
More information8Gb Fibre Channel Adapter of Choice in Microsoft Hyper-V Environments
8Gb Fibre Channel Adapter of Choice in QLogic 8Gb Adapter from Cavium Outperforms Emulex QLogic Offers Best Performance and Scalability in Hyper-V Environments Cavium s QLogic and the Emulex 8Gb Fibre
More informationPerformance Optimizations via Connect-IB and Dynamically Connected Transport Service for Maximum Performance on LS-DYNA
Performance Optimizations via Connect-IB and Dynamically Connected Transport Service for Maximum Performance on LS-DYNA Pak Lui, Gilad Shainer, Brian Klaff Mellanox Technologies Abstract From concept to
More informationCreate a Flexible, Scalable High-Performance Storage Cluster with WekaIO Matrix
Solution brief Intel Storage Builders WekaIO Matrix Intel eon Processor E5-2600 Product Family Intel Ethernet Converged Network Adapter 520 Intel SSD Data Center Family Data Plane Development Kit Create
More informationLow Latency Evaluation of Fibre Channel, iscsi and SAS Host Interfaces
Low Latency Evaluation of Fibre Channel, iscsi and SAS Host Interfaces Evaluation report prepared under contract with LSI Corporation Introduction IT professionals see Solid State Disk (SSD) products as
More informationRefining and redefining HPC storage
Refining and redefining HPC storage High-Performance Computing Demands a New Approach to HPC Storage Stick with the storage status quo and your story has only one ending more and more dollars funneling
More informationArchitecting a High Performance Storage System
WHITE PAPER Intel Enterprise Edition for Lustre* Software High Performance Data Division Architecting a High Performance Storage System January 2014 Contents Introduction... 1 A Systematic Approach to
More informationTechnical Note P/N REV A01 March 29, 2007
EMC Symmetrix DMX-3 Best Practices Technical Note P/N 300-004-800 REV A01 March 29, 2007 This technical note contains information on these topics: Executive summary... 2 Introduction... 2 Tiered storage...
More informationSAS workload performance improvements with IBM XIV Storage System Gen3
SAS workload performance improvements with IBM XIV Storage System Gen3 Including performance comparison with XIV second-generation model Narayana Pattipati IBM Systems and Technology Group ISV Enablement
More informationT10PI End-to-End Data Integrity Protection for Lustre
1! T10PI End-to-End Data Integrity Protection for Lustre 2018/04/25 Shuichi Ihara, Li Xi DataDirect Networks, Inc. 2! Why is data Integrity important? Data corruptions is painful Frequency is low, but
More informationSFA12KX and Lustre Update
Sep 2014 SFA12KX and Lustre Update Maria Perez Gutierrez HPC Specialist HPC Advisory Council Agenda SFA12KX Features update Partial Rebuilds QoS on reads Lustre metadata performance update 2 SFA12KX Features
More informationdesigned. engineered. results. Parallel DMF
designed. engineered. results. Parallel DMF Agenda Monolithic DMF Parallel DMF Parallel configuration considerations Monolithic DMF Monolithic DMF DMF Databases DMF Central Server DMF Data File server
More informationIBM System Storage DS8870 Release R7.3 Performance Update
IBM System Storage DS8870 Release R7.3 Performance Update Enterprise Storage Performance Yan Xu Agenda Summary of DS8870 Hardware Changes I/O Performance of High Performance Flash Enclosure (HPFE) Easy
More informationvstart 50 VMware vsphere Solution Specification
vstart 50 VMware vsphere Solution Specification Release 1.3 for 12 th Generation Servers Dell Virtualization Solutions Engineering Revision: A00 March 2012 THIS WHITE PAPER IS FOR INFORMATIONAL PURPOSES
More informationEvaluation Report: Improving SQL Server Database Performance with Dot Hill AssuredSAN 4824 Flash Upgrades
Evaluation Report: Improving SQL Server Database Performance with Dot Hill AssuredSAN 4824 Flash Upgrades Evaluation report prepared under contract with Dot Hill August 2015 Executive Summary Solid state
More informationCESM (Community Earth System Model) Performance Benchmark and Profiling. August 2011
CESM (Community Earth System Model) Performance Benchmark and Profiling August 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Intel, Dell,
More informationOptimizing Fusion iomemory on Red Hat Enterprise Linux 6 for Database Performance Acceleration. Sanjay Rao, Principal Software Engineer
Optimizing Fusion iomemory on Red Hat Enterprise Linux 6 for Database Performance Acceleration Sanjay Rao, Principal Software Engineer Version 1.0 August 2011 1801 Varsity Drive Raleigh NC 27606-2072 USA
More informationZEST Snapshot Service. A Highly Parallel Production File System by the PSC Advanced Systems Group Pittsburgh Supercomputing Center 1
ZEST Snapshot Service A Highly Parallel Production File System by the PSC Advanced Systems Group Pittsburgh Supercomputing Center 1 Design Motivation To optimize science utilization of the machine Maximize
More informationDELL Reference Configuration Microsoft SQL Server 2008 Fast Track Data Warehouse
DELL Reference Configuration Microsoft SQL Server 2008 Fast Track Warehouse A Dell Technical Configuration Guide base Solutions Engineering Dell Product Group Anthony Fernandez Jisha J Executive Summary
More informationStorage Optimization with Oracle Database 11g
Storage Optimization with Oracle Database 11g Terabytes of Data Reduce Storage Costs by Factor of 10x Data Growth Continues to Outpace Budget Growth Rate of Database Growth 1000 800 600 400 200 1998 2000
More informationSGI UV for SAP HANA. Scale-up, Single-node Architecture Enables Real-time Operations at Extreme Scale and Lower TCO
W h i t e P a p e r SGI UV for SAP HANA Scale-up, Single-node Architecture Enables Real-time Operations at Extreme Scale and Lower TCO Table of Contents Introduction 1 SGI UV for SAP HANA 1 Architectural
More informationNEMO Performance Benchmark and Profiling. May 2011
NEMO Performance Benchmark and Profiling May 2011 Note The following research was performed under the HPC Advisory Council HPC works working group activities Participating vendors: HP, Intel, Mellanox
More informationWhite Paper Features and Benefits of Fujitsu All-Flash Arrays for Virtualization and Consolidation ETERNUS AF S2 series
White Paper Features and Benefits of Fujitsu All-Flash Arrays for Virtualization and Consolidation Fujitsu All-Flash Arrays are extremely effective tools when virtualization is used for server consolidation.
More informationAccelerating Enterprise Search with Fusion iomemory PCIe Application Accelerators
WHITE PAPER Accelerating Enterprise Search with Fusion iomemory PCIe Application Accelerators Western Digital Technologies, Inc. 951 SanDisk Drive, Milpitas, CA 95035 www.sandisk.com Table of Contents
More informationEMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE
White Paper EMC XTREMCACHE ACCELERATES VIRTUALIZED ORACLE EMC XtremSF, EMC XtremCache, EMC Symmetrix VMAX and Symmetrix VMAX 10K, XtremSF and XtremCache dramatically improve Oracle performance Symmetrix
More informationMSC Nastran Explicit Nonlinear (SOL 700) on Advanced SGI Architectures
MSC Nastran Explicit Nonlinear (SOL 700) on Advanced SGI Architectures Presented By: Dr. Olivier Schreiber, Application Engineering, SGI Walter Schrauwen, Senior Engineer, Finite Element Development, MSC
More informationAccelerating Microsoft SQL Server Performance With NVDIMM-N on Dell EMC PowerEdge R740
Accelerating Microsoft SQL Server Performance With NVDIMM-N on Dell EMC PowerEdge R740 A performance study with NVDIMM-N Dell EMC Engineering September 2017 A Dell EMC document category Revisions Date
More informationIBM System Storage DS6800
Enterprise-class storage in a small, scalable package IBM System Storage DS6800 Highlights Designed to deliver Designed to provide over enterprise-class functionality, 1600 MBps performance for with open
More informationLenovo Database Configuration Guide
Lenovo Database Configuration Guide for Microsoft SQL Server OLTP on ThinkAgile SXM Reduce time to value with validated hardware configurations up to 2 million TPM in a DS14v2 VM SQL Server in an Infrastructure
More informationEntry-level Intel RAID RS3 Controller Family
PRODUCT Brief Entry-Level Intel RAID RS3 Controller Portfolio Entry-level Intel RAID RS3 Controller Family 12Gb/s connectivity and basic data protection RAID matters. Rely on Intel RAID. Cost-effective
More informationExchange Server 2007 Performance Comparison of the Dell PowerEdge 2950 and HP Proliant DL385 G2 Servers
Exchange Server 2007 Performance Comparison of the Dell PowerEdge 2950 and HP Proliant DL385 G2 Servers By Todd Muirhead Dell Enterprise Technology Center Dell Enterprise Technology Center dell.com/techcenter
More informationXyratex ClusterStor6000 & OneStor
Xyratex ClusterStor6000 & OneStor Proseminar Ein-/Ausgabe Stand der Wissenschaft von Tim Reimer Structure OneStor OneStorSP OneStorAP ''Green'' Advancements ClusterStor6000 About Scale-Out Storage Architecture
More informationRIGHTNOW A C E
RIGHTNOW A C E 2 0 1 4 2014 Aras 1 A C E 2 0 1 4 Scalability Test Projects Understanding the results 2014 Aras Overview Original Use Case Scalability vs Performance Scale to? Scaling the Database Server
More informationRed Hat Ceph Storage and Samsung NVMe SSDs for intensive workloads
Red Hat Ceph Storage and Samsung NVMe SSDs for intensive workloads Power emerging OpenStack use cases with high-performance Samsung/ Red Hat Ceph reference architecture Optimize storage cluster performance
More informationEMC CLARiiON CX3-40. Reference Architecture. Enterprise Solutions for Microsoft Exchange Enabled by MirrorView/S
Enterprise Solutions for Microsoft Exchange 2007 EMC CLARiiON CX3-40 Metropolitan Exchange Recovery (MER) for Exchange in a VMware Environment Enabled by MirrorView/S Reference Architecture EMC Global
More informationAll-Flash High-Performance SAN/NAS Solutions for Virtualization & OLTP
All-Flash High-Performance SAN/NAS Solutions for Virtualization & OLTP All-flash configurations are designed to deliver maximum IOPS and throughput numbers for mission critical workloads and applicati
More informationSNAP Performance Benchmark and Profiling. April 2014
SNAP Performance Benchmark and Profiling April 2014 Note The following research was performed under the HPC Advisory Council activities Participating vendors: HP, Mellanox For more information on the supporting
More informationDell Reference Configuration for Large Oracle Database Deployments on Dell EqualLogic Storage
Dell Reference Configuration for Large Oracle Database Deployments on Dell EqualLogic Storage Database Solutions Engineering By Raghunatha M, Ravi Ramappa Dell Product Group October 2009 Executive Summary
More informationSGI Overview. HPC User Forum Dearborn, Michigan September 17 th, 2012
SGI Overview HPC User Forum Dearborn, Michigan September 17 th, 2012 SGI Market Strategy HPC Commercial Scientific Modeling & Simulation Big Data Hadoop In-memory Analytics Archive Cloud Public Private
More informationABySS Performance Benchmark and Profiling. May 2010
ABySS Performance Benchmark and Profiling May 2010 Note The following research was performed under the HPC Advisory Council activities Participating vendors: AMD, Dell, Mellanox Compute resource - HPC
More informationDell Compellent Storage Center and Windows Server 2012/R2 ODX
Dell Compellent Storage Center and Windows Server 2012/R2 ODX A Dell Technical Overview Kris Piepho, Microsoft Product Specialist October, 2013 Revisions Date July 2013 October 2013 Description Initial
More informationLenovo Database Configuration
Lenovo Database Configuration for Microsoft SQL Server OLTP on Flex System with DS6200 Reduce time to value with pretested hardware configurations - 20TB Database and 3 Million TPM OLTP problem and a solution
More informationJVM Performance Study Comparing Java HotSpot to Azul Zing Using Red Hat JBoss Data Grid
JVM Performance Study Comparing Java HotSpot to Azul Zing Using Red Hat JBoss Data Grid Legal Notices JBoss, Red Hat and their respective logos are trademarks or registered trademarks of Red Hat, Inc.
More informationVideo Surveillance Storage and Verint Nextiva NetApp Video Surveillance Storage Solution
Technical Report Video Surveillance Storage and Verint Nextiva NetApp Video Surveillance Storage Solution Joel W. King, NetApp September 2012 TR-4110 TABLE OF CONTENTS 1 Executive Summary... 3 1.1 Overview...
More informationPerformance Comparisons of Dell PowerEdge Servers with SQL Server 2000 Service Pack 4 Enterprise Product Group (EPG)
Performance Comparisons of Dell PowerEdge Servers with SQL Server 2000 Service Pack 4 Enterprise Product Group (EPG) Dell White Paper By Neelima Chinthamani (Enterprise OS Releases) Ravikanth Chaganti
More informationMicrosoft SQL Server 2012 Fast Track Reference Configuration Using PowerEdge R720 and EqualLogic PS6110XV Arrays
Microsoft SQL Server 2012 Fast Track Reference Configuration Using PowerEdge R720 and EqualLogic PS6110XV Arrays This whitepaper describes Dell Microsoft SQL Server Fast Track reference architecture configurations
More informationAn Exploration of New Hardware Features for Lustre. Nathan Rutman
An Exploration of New Hardware Features for Lustre Nathan Rutman Motivation Open-source Hardware-agnostic Linux Least-common-denominator hardware 2 Contents Hardware CRC MDRAID T10 DIF End-to-end data
More informationARISTA: Improving Application Performance While Reducing Complexity
ARISTA: Improving Application Performance While Reducing Complexity October 2008 1.0 Problem Statement #1... 1 1.1 Problem Statement #2... 1 1.2 Previous Options: More Servers and I/O Adapters... 1 1.3
More informationAcuSolve Performance Benchmark and Profiling. October 2011
AcuSolve Performance Benchmark and Profiling October 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Intel, Dell, Mellanox, Altair Compute
More informationTHESUMMARY. ARKSERIES - pg. 3. ULTRASERIES - pg. 5. EXTREMESERIES - pg. 9
PRODUCT CATALOG THESUMMARY ARKSERIES - pg. 3 ULTRASERIES - pg. 5 EXTREMESERIES - pg. 9 ARKSERIES THE HIGH DENSITY STORAGE FOR ARCHIVE AND BACKUP Unlimited scalability Painless Disaster Recovery The ARK
More informationLenovo Database Configuration
Lenovo Database Configuration for Microsoft SQL Server Standard Edition DWFT 9TB Reduce time to value with pretested hardware configurations Data Warehouse problem and a solution The rapid growth of technology
More informationIBM InfoSphere Streams v4.0 Performance Best Practices
Henry May IBM InfoSphere Streams v4.0 Performance Best Practices Abstract Streams v4.0 introduces powerful high availability features. Leveraging these requires careful consideration of performance related
More informationIBM Power Systems solution for SugarCRM
IBM Power Systems solution for SugarCRM Performance and scaling overview of Sugar on IBM Power Systems running Linux featuring the new IBM POWER8 technology Steve Pratt, Mark Nellen IBM Systems and Technology
More informationDell EMC SCv3020 7,000 Mailbox Exchange 2016 Resiliency Storage Solution using 7.2K drives
Dell EMC SCv3020 7,000 Mailbox Exchange 2016 Resiliency Storage Solution using 7.2K drives Microsoft ESRP 4.0 Abstract This document describes the Dell EMC SCv3020 storage solution for Microsoft Exchange
More informationInfiniBand Networked Flash Storage
InfiniBand Networked Flash Storage Superior Performance, Efficiency and Scalability Motti Beck Director Enterprise Market Development, Mellanox Technologies Flash Memory Summit 2016 Santa Clara, CA 1 17PB
More informationGROMACS Performance Benchmark and Profiling. August 2011
GROMACS Performance Benchmark and Profiling August 2011 Note The following research was performed under the HPC Advisory Council activities Participating vendors: Intel, Dell, Mellanox Compute resource
More informationExperiences with HP SFS / Lustre in HPC Production
Experiences with HP SFS / Lustre in HPC Production Computing Centre (SSCK) University of Karlsruhe Laifer@rz.uni-karlsruhe.de page 1 Outline» What is HP StorageWorks Scalable File Share (HP SFS)? A Lustre
More information