High Performance Parallel File Access via Standard NFS v3

Transcription

1 High Performance Parallel File Access via Standard NFS v Kent Ritchie Senior Systems Engineer AVERE SYSTEMS, INC 90 River Ave Pittsburgh PA averesystems.com

2 Why NFS v? NFS was made for sharing Isn t pnfs already available? NFS v is mature NFS v is ubiquitous NFS v is efficient NFS v can be high performance

3 Avere Edge-Core Architecture Clients & Servers Avere Edge Filer LAN Network / WAN Core Filer(s) Add performance NetApp Isilon Low latency read, write & metadata Low latency opsread, write & metadata ops BlueArc Edge Filer Performance optimized Low latency access from fast media (RAM, SSD, SAS) Accelerate read, write & metadata operations via coherent global cache Linear performance scaling through clustering Parallel file access via a token manager for cluster wide file locking Core Filer Capacity optimized SATA disks provide lowest cost and greatest density Any rd -party NFS v Server (e.g. NetApp, Isilon, BlueArc, Nexenta, Solaris, Linux, etc.) Heterogeneous vendors in the same cluster Responsible for data protection & compliance functions

4 Coherent Global Cache Block-level caching Efficiently uses cache resources RAM SSD Read () Write () Read caching Promote on access HA mirror Demote Demote based on LRU/LFU Write caching NVRAM for performance Demote Demote Mirroring provides N+ HA SAS for aggregated writes SAS Promote Performance algorithms Pre-fetch for sequential IO Node Node Node Node N Async write-back DNLC for large directories Negative caching accelerates lookups of non-existent file SATA Op forwarding Core Filer Example with three files, each composed of multiple KB blocks. Asynchronous write back Scheduled to maintain a copy on Core filer

5 Parallel File Access Read () Read () Read () Read () Clustering Coherent, distributed cache Global access to data Load balanced across nodes RAM Cache--cache Globally shared media Cache--cache transactions minimizes Core filer traffic SSD SAS Promote Cache size scales linearly with FXTs Port Affinity Blocks migrate to node with most frequent access Minimizes inter-node traffic Node Node Node Node N Striping Parallel storage of large files SATA Replication Parallel access to hot blocks Core Filer Example with three files, each composed of multiple KB blocks.

6 Parallel File Access Read () Read () Read () Read () Read () Read () Read () Read (N) Read () Read () Read () Read () Clustering Coherent, distributed cache Global access to data Load balanced across nodes RAM SSD SAS Cache--cache Replicate Replicate Replicate Promote N Globally shared media Cache--cache transactions minimizes Core filer traffic Cache size scales linearly with FXTs Port Affinity Blocks migrate to node with most frequent access Minimizes inter-node traffic Node Node Node Node N Striping N Parallel storage of large files SATA N Replication Parallel access to hot blocks Core Filer Example with three files, each composed of multiple KB blocks.

7 Scale Perfomance not Capacity

8 Comparing,000,000 IOPS Solutions* Avere $. / IOPS EMC Isilon $0. / IOPS 0ms NetApp $. / IOPS Throughput (IOPS) Latency/ORT (ms) List Price $/IOPS Disk Quantity Rack Units Cabinets Product Config Avere FXT 00,9,. $,,00 $. 9. -node cluster, cloud storage config NetApp FAS 0,,. $,,000 $. -node cluster EMC Isilon S00,,0. $,90,0 $ node cluster *Comparing the top SPEC SFS results for a single NFS file system/namespace (as of 0Apr0). See for more information.

9 Additional Benefits Clients Data Center (Core Filer:/export) /fy0 Remote Site (Core Filer:/export) Avere FXT Edge Filer NetApp: /cust /mech X /src FlashMirror WAN Isilon: /pipe /cust BlueArc: FlashMove / on Avere Single mount point Global Namespace / /sales /finance /eng /support /pipe /staff /fy0 /hw /sw /cust /mech Logical path unchanged /src AWS S Object /src /staff Global Namespace Simplify namespace mgmt *and* accelerate, scale perf FlashMove TM Non-disruptively move exports (e.g. /src) between Core Filers FlashMirror TM AWS Glacier Mirror write data to two locations for disaster recovery FlashCloud TM Enable Parallel File Access on top of Object Stores Support for AWS Glacier 9

10 Avere GUI Powerful Analytics Visibility into entire NAS environment Current and historical IOPS, GB/s, and latency Drill down on specific op types, clients, FXT nodes, and Core filers Hot client and hot file listing Figure : Consistent low latency delivered to clients, hiding latency spikes on Core filer Figure : Hot clients sorted by activity (total ops) or rate (ops/sec over last 0 seconds) 0

11 Thank You! AVERE SYSTEMS, INC 000 McKnight Road, Suite 0 Pittsburgh, PA () -0 averesystems.com