Voltaire Making Applications Run Faster

Transcription

1 Voltaire Making Applications Run Faster Asaf Somekh Director, Marketing Voltaire, Inc.

2 Agenda HPC Trends InfiniBand Voltaire Grid Backbone Deployment examples About Voltaire

3 HPC Trends Clusters are the dominant architecture and are getting larger s are getting stronger Multi-core 64 Bit architecture are now mainstream Larger memory space available to apps Scalable High Performance Interconnects Scalable File Systems Industry Standard Technologies

4 InfiniBand First Standard High Speed Interconnect Highest Speed Standard Interconnect Adapters: 10/20 Gb/s (4X SDR/DDR) Switches: 10/20 Gb/s and 30/60 Gb/s (12X SDR/DDR) Future: up to 120 Gb/s defined in spec (12X QDR) Support both copper and optical connectivity Lowest Latency 140ns latency per switch hop 1.2 us application to application latency Predictable results due to fabric and stack architecture Hardware Based Protocol Offload and RDMA Enabling low %, Zero copy and OS Bypass

5 Building a high-end solution with InfiniBand RDMA Memory Memory HCA Memory HCA Memory InfiniBand Switch Switch Memory HCA HCA RDMA Operations allow fast access of s to remote memory Expensive SMP Server with Proprietary Interconnect InfiniBand Cluster based on 2-way Servers Similar shared memory model at much lower costs

6 Voltaire Top500 Leadership Largest number of Top500 InfiniBand sites Top InfiniBand Site: NASA Ames #4 Most network-efficient InfiniBand site (91%) Number of InfiniBand sites doubled from previous list, tripled in a year Proprietary interconnects keep going down GbE pushed lower on the list Interconnect InfiniBand GbE Quadrics Myrinet Change from Nov % +38% -19% -23%

7 Voltaire InfiniBand = Network Efficiency = $$$ Example: Assumptions: Cluster Size: 256 Nodes 2P Opteron Server Price: $3,000 InfiniBand Price/Node: $900 80% Network Efficiency Myrinet Price/Node $800 65% Network Efficiency GbE Price/Node: $100 55% Network Efficiency Actual Performance TFlops Cost Per TFlop $600K $500K 507 $400K Myr GbE Myr GbE

8 Ansys Scalability Benchmark Parallel Speedup Source: HP, Fall 2005 Parallel Speedup for 2- Itanium2 Clusters # Cores Linear Scaling GbE InfiniBand 75% Efficiency 51% Efficiency Give Ansys the cycles that GbE is wasting

9 InfiniBand The Leading High- Performance Fabric InfiniBand 10GbE Now In 2007 Now In 2007 Max bandwidth 60Gb/s 120Gb/s 10Gb/s 40Gb/s?? 6X End to end Latency 1.2us <1us 50us 30us 40X Switch latency 140ns 50ns 10us 2us 60X RDMA Built in Built in Optional (immature) Optional Virtualization Built in Built in No Proprietary Largest Switch 12 Tb/s 32 Tb/s 1.44 Tb/s 5 Tb/s 6X Price per Gb/s $1000 <$300 $5000 $1000 5X InfiniBand - unmatched cost/performance

10 Scaling Beyond NFS: Parallel File Systems Before Voltaire With Voltaire Server Utilization Software Network Low storage performance High storage overhead on Limits application processing No scalability Severe locking problems in big clusters updating shared files High performance available for application processing Scalability to thousands of nodes Unified name space with no locking problems

11 Voltaire Products Summary Multi-Service Directors ISR X (DDR or SDR) or 32 12X ports ISR X (DDR or SDR) or 96 12X ports Copper and optical support Integrated GbE and/or FC ports (up to 144) Full redundancy (PS, FAN, Fabric, Management,..) Voltaire ISR 9288 Voltaire ISR 9096

12 Voltaire Products Summary Entry level (1U) switches ISR Multi-Protocol (IP / FC / IB) ISR port IB (SDR and DDR) Management & Virtualization Embedded in switches Highly scalable Grid management Host software Unique High-Performance offerings for HPC, Financials, and Storage ISR 6000 ISR 9024 GridVision (Management)

13 Deploying Grids Globally Across Industries Manufacturing Government Education & Research Oil & Gas Entertainment Financial Srv.

14 Oil & Gas: SINOPEC China, 150 Nodes Voltaire ISR 9288 Multi Panel Displays Visualization Nodes Compute Nodes Storage Nodes

15 MFG: Airbus, Germany 64 Nodes Voltaire ISR 9096 Voltaire ISR 9096 IBM GPFS Application: Finite Element Analysis

16 GOV : D.O.D USA, 1,100-Node Cluster with Lustre Voltaire ISR 9288 Users, and Remote Lustre clients HP SFS OSS FS Performance 900 MB/s Client Performance 350MB/s Voltaire Grid Compute Nodes Lustre Clients DOD TI-05 Storage Nodes Lustre Servers (OST, MDS)

17 EDU Example: Titech Japan, 1,400 16Core Servers Servers Edge Core LAN Storage 100 TFlops Integrated GbE connectivity Internal & External Storage Lustre File System Redundant configuration

18 Voltaire: The Company 2005 Sales: 4x over 2004, 15x over 2003 Over 50,000 Ports to ship in 2005 Solid Financing Recent Round: $17M, Summer 2005 Raised $65M in total Global Locations Business HQ: Boston Sales Offices: California, UK, Japan R&D: Hertzliya Israel Headcount : 100+

19 Thank You