Introducing Panasas ActiveStor 14 SUPERIOR PERFORMANCE FOR MIXED FILE SIZE ENVIRONMENTS DEREK BURKE, PANASAS EUROPE
INTRODUCTION TO PANASAS Storage that accelerates the world s highest performance and most data-intensive applications Tightly integrated parallel file-system & storage hardware solution Global shared file-system that accelerates applications performance Founded 1999, shipping solutions since 2003 Highly experienced, technically-renowned team Software innovation, packaged with industry-standard hardware European region ~150 active customers Strong revenue growth(180% in last 3 years) Example customers: World s largest offshore oil & gas supplier Five formula one teams Europe s largest genomic database Europe s largest hedge fund Government customers including RAL (6.6PBs single file system) Research customers including ETH (Switzerland), EPFL (Switzerland), Oxford Uni (UK), Genouest (France), Max Planck Institute(Germany) and Moscow State University (Russia) Example partners: Dalco (Switzerland), E4 (Italy), Transtec (Germany), Megware (Germany), ClusterVision (Europe), HP (EMEA), Dell (EMEA) & SGI (EMEA) 2
PRODUCT OVERVIEW 3
ACTIVESTOR BLADE ARCHITECTURE Director Blade Storage Blade ActiveStor Appliance CPU, cache, network Orchestrates system activity Scalable Metadata services NFS & CIFS access Full Rack CPU, cache, HDDs & SSDs Enables parallel reads/writes Advanced caching algorithms Blade Switch 800TB & 15GB/s per 40U rack 80TB per 4U shelf Up to 1.5GB/sec aggregate bandwidth per shelf Dual Power Supplies & Battery Dual 10GigE Uplinks Scales to 100 chassis in a single file system Over 8 petabytes 150GB/sec 1.4M IOPS 10GbE networking InfiniBand Router 2 option for IB connectivity 4
OBJECT STORAGE ARCHITECTURE Client Nodes DirectFlow/pNFS Switched Network File Object Request Map Parallel Data Path 1.5 GB/sec per Shelf Unix and Windows Clients NFS and CIFS HPC Advisory Council Switzerland, Director Lugano 2013 Blades Storage Blades 5
SIMPLE INSTALLATION AND ONLINE SCALING Simple Installation Assign IP address, netmask and default route to primary DirectorBlade Automatic Online Provisioning Configuration is read from primary blades Automatic Software version matching Immediately serving data DHCP on Private port - Automatic Capacity Balancing Target New Writes Migrate Component Objects in the background 6
PANASAS PARALLEL DATA PATH Data path by-passes RAID controllers and metadata servers Application writes data DirectFlow/pNFS client layer generates redundant data for each stripe Everything is written directly to storage All blades work together on RAID rebuild Client Client Client Client Client Client Ethernet or IB Network Storage Blades Storage Blades Storage Blades Storage Blades Director Blades Director Blades Director Blades Director Blades 7
PANASAS ACTIVESTOR FEATURE SET Performance Dual 10GbE delivering 1,500+ MB/s per chassis Up to 14,000 IOPS per Director Blade Streaming and IOPS performance scales linearly as more chassis are added Intelligent utilization of SSDs improves small file & metadata performance Scalability Within a Single Namespace Up to 12,000 clients Over 8PBs single file system 150GB/sec aggregate system bandwidth Up to 1.4M NFSv3 IOPS Manageability Snapshots User & Group Quotas Single Management Console MyPanasas for updates and patches Single Global Namespace Automatic Provisioning of New Storage Capacity Automatic RAID Configuration Dynamic Load Balancing NDMP for backup 1 Touch Reports for Capacity Trends, Asset ID Disk Migration Utility Tiered Storage Drives, SSDs, DRAM ActiveStor Product Family Interoperability DirectFlow, pnfs, NFS & CIFS Connectivity Connectivity 2 x 10GbE (or 4 x 1GbE for legacy networks) QDR InfiniBand (with Panasas IB Router 2) Reliability Panasas Tiered Parity Object RAID NFS Failover Full Storage Network Failover Director Blade Metadata Failover Parallel Reconstructions 8
POST SALES SUPPORT Customer Your local Panasas Partner Level 1-2 Technical Support Staff & Parts Replacement Local Language 5 x9 or 24 x 7 Solution Knowledge Panasas Knowledge Base Extensive Database of Proven Solutions Panasas Level 3- Escalations Support Engineers 9
INTRODUCING ACTIVESTOR 14 10
CHALLENGE WITH HPC DATA Mixed workloads require bandwidth performance and IOPS performance from a single storage system Even data sets for large file, throughput workloads are actually mixed workloads consisting predominantly of small files Many critical file system tasks mean heavy metadata workloads File system directory listings, data replication / backup, file system consistency checking, object RAID rebuild File size distributions back up this approach - fsstats: http://www.pdsi-scidac.org/fsstats/index.html Source: Panasas analysis of file system data sets from customers and prospects (Jan-Aug 2012) 11
INTRODUCING ACTIVESTOR 14 Intelligent, unified, and cost-effective SSD/SATA tier Storage blade contains 2 x enterprise-class SATA drives, SSD & DRAM cache SSD s accelerate metadata and small file performance 2 or 4TB hard drives deliver high streaming throughput performance Optimized for real-world, mixed file size workloads Intelligent use of SSD to balance performance and cost Store all metadata and <60KB files on SSD First 12KB of file stored with metadata Speeds small file performance, directory listings, file system responsiveness, data reconstructions AS14 is strong at throughput and IOPS Ideal for mixed file workloads Up to 1.5GB/s throughput per AS14 shelf Up to 14,000 NFS v3 IOPS per AS 14 shelf Easy to use appliance Online in minutes Modular scalability with zero downtime ActiveStor 14 Storage Blade 120-480GB SSD CPU 8-16GB Cache 2-4TB HDD x2 12
ACTIVESTOR 14 PERFORMANCE ActiveStor 14 delivers consistent performance improvements across all small file & metadata-related workloads ActiveStor 14 vs. ActiveStor 12 9x faster small-file reads/s 6x faster directory listings 5x faster metadata (stats) 4x faster deletes >2x faster NFS ops/s >30% faster RAID reconstruction rate High large file throughput capability maintained Two different ActiveStor 14 models ActiveStor 14: 4TB-drive with small SSDs optimize for large-file workloads that are particularly $/TB sensitive ActiveStor 14T: 2TB-drive configuration optimizes for $/IOP performance 13
ACTIVESTOR PRODUCT FAMILY ActiveStor 14 ActiveStor 12 ActiveStor 11 ActiveStor 14 ActiveStor Generation Fifth Fourth Fourth Product Focus Highest Throughput and High IOPS Very High Throughput High Throughput Capacity (TB) 83 / 81 / 45 60 / 40 60 / 40 SSD Acceleration Yes No No Throughput, Write/Read (MB/sec) 1,600 / 1,500 1,600 / 1,500 950 / 1,150 4KB File Reads/s 14,150 1,350 1,300 Metadata Performance (Stats/s) 14,150 2,750 2,650 Highest throughput and IOPS Intelligent Use of SATA + SSD Great for mixed workloads Best $/TB and price/performance ActiveStor 11 & 12 Cache (GB) 92 / 172 92 48 High Availability Network Failover Standard Standard Optional Link Aggregation Yes Yes No Note: A single 1+10 shelf configuration is assumed throughout except that the ActiveStor 14 4KB file reads/s and metadata performance numbers are based on a single 2+9 shelf of ActiveStor 14T (a 1+10 shelf of ActiveStor 14 would be lower than shown but still much higher than AS11 or 12). Volume fail-over was on for all configurations. High throughput ActiveStor 11 ideal for entry configurations Scale out existing ActiveStor 11 & 12 systems 14
SUMMARY Panasas is a high-performance storage appliance Modular architecture with linear capacity and performance scalability Great performance for mixed file workloads Scale metadata and file system services with multiple director blades Panasas is designed for stability as well as performance Easy to install, manage & scale Novel/unique ObjectRAID with enhanced data protection capabilities Components are hot-swappable with built-in redundancy Failover as standard Online scalability 24x7 support team Panasas knowledgebase Panasas is unique amongst parallel storage Intelligent use of SSD s Protection against URE s Highly parallel data reconstruction Active/active metadata failover Scalable metadata and much more 15
THANK YOU For more information: emeainfo[at]panasas.com www.panasas.com Panasas, Inc. 7200 The Quorum Oxford Business Park North OX4 2JZ United Kingdom 16