Mellanox Technologies Maximize Cluster Performance and Productivity. Gilad Shainer, October, 2007

Transcription

1 Mellanox Technologies Maximize Cluster Performance and Productivity Gilad Shainer, October, 27

2 Mellanox Technologies Hardware OEMs Servers And Blades Applications End-Users Enterprise Data Centers Switches High-Performance Computing InfiniBand and Ethernet Storage Embedded Embedded Interconnect: A Competitive Advantage 2 Mellanox Technologies

3 Connecting The Most Powerful Clusters 13 server nodes 96 server nodes 45 server nodes 128 server nodes 23 server nodes 14 server nodes 3 Mellanox Technologies

4 But Not Only The Most Powerful Clusters Personal supercomputing (4-5 nodes) Wolfram Air Pollution Simulation Maximum utilization and efficiency Sikorsky CH-53K program 24 nodes, dual core CPUs Reducing simulations duration from 4 days to several hours Seconds 5 Time to Compute 1 Time Steps Cores 16 Cores 32 Cores HP TYAN 4 Mellanox Technologies

5 InfiniBand For Clustering Commodity Servers Off-the-Shelf Storage Industry Megatrend Mellanox InfiniBand Proprietary Systems Expensive Not flexible Clusters Commodity Very flexible InfiniBand Clusters Maximum performance Scalability, large-scale clusters Multiple I/O traffics Flexible and easy to manage 5 Mellanox Technologies

6 InfiniBand For I/O Growth Demands Multi Core CPUs More applications per server and I/O Latency Race SAN Adoption More applications demand real-time response More traffic per I/O with server I/O consolidation 1Gb/s+ connectivity for each server Shared Resources I/O capacity per server dictated by the most demanding apps Multi-core CPUs mandating 1Gb/s+ connectivity 6 Mellanox Technologies

7 InfiniBand For Virtualization Hardware-based I/O virtualization Multiple VMs, multiple traffic types per VM Supports current and future servers AMD and Intel IOV, PCI-SIG IOV Better resource utilization Frees up CPU through hypervisor offload Enable significantly more VMs per CPU Native OS performance VMs enjoy native InfiniBand performance Virtual Machine 1 HCA Driver VMM Offload Functions Virtual Machine 1 HCA Driver Virtual Machine 1 HCA Driver DMA Remapping Virtual Machine Monitor Memory ConnectX InfiniBand HCA Physical Server 7 Mellanox Technologies

8 TOP5 Interconnect Trends Number of Clusters Top5 Interconnect Trends 132 Growth Rate: InfiniBand: +23% GigE: -19% 47 InfiniBand Myrinet GigE Jun-5 Nov-5 Jun-6 Nov-6 Jun InfiniBand adoption is faster then Ethernet Top5 Interconnect Penetration LANL SANDIA Number of Clusters InfiniBand In The Top5 June 5 Nov 5 June 6 Nov 6 June 7 IB SDR IB DDR Explosive growth of InfiniBand 2Gb/s 55 clusters = 42% of the InfiniBand clusters 8 Mellanox Technologies # of Clusters Year 1 Year 2 Year 3 Year 4 Year 5 Year 6 Year of Introduction InfiniBand Year 7 Ethernet Ethernet year 1 June 1996 InfiniBand year 1 June 23 Year 8 AERONAUTICAL SYSTEMS CENTER

9 InfiniBand Value Proposition Automotive Oil and Gas Fluid Dynamics Oil 3X simulation efficiency increase Car crash simulations eliminates the need for physical testing Reduce reservoir modeling simulation runtime up to 55% Improves interpretation and modeling accuracy 3X performance improvement and near linear scaling Intensive simulation for computer-aided engineering Digital Media Electronic Design Automation Computational Science 5X the bandwidth for real-time color grading High-resolution commercials and feature films * Partial List 4X improvement for photomask manufacturing - CATS 9 Mellanox Technologies Monte Carlo simulation, astronomy, bioinformatics, chemistry and drug research Accelerate parallel execution of matrix operations

10 Mellanox Product Roadmap 4 th Generation Two 1/2/4 Gb/s InfiniBand or Two 1/1Gb/s Ethernet 2. Adapter 3 rd Generation One 1/2Gb/s Adapter Two 1/2Gb/s IB Adapter 48, 96Gb/s Total Switch 2 nd Generation Two 1Gb/s Adapter 16Gb/s Total Switch 1 st Gen. 4Gb/s Total Adapter + Switch Mellanox Technologies *Adapter Card Products Based on Adapter Silicon Not Shown

11 Leading InfiniBand and 1GigE Adapters Single-chip server and storage adapters Optimized cost, power, footprint, reliability Highest performing InfiniBand adapters 2Gb/s (4Gb/s in 28), 1us application latency Highest performing 1GigE NICs 17.6Gb/s throughput, < 7us application latency Supports OpenFabrics RDMA software stacks Multi-core CPU optimized Virtualization acceleration Combination IB/Ethernet 4Q7 First adapters to support PCI Express 2. ConnectX IB InfiniBand HCA ConnectX EN Ethernet MAC/NIC ConnectX MP Multi-Protocol Adapter 1 & 2Gb/s InfiniBand 1 Gigabit Ethernet (Copper) 11 Mellanox Technologies

12 ConnectX Multi Core Performance ConnectX MPI Latency - Multi-core Scaling 6 Latency (usec) # of CPU cores MPI (message passing) 2 Sockets (TCP) IPoIB-CM ConnectX IB - SDR, DDR PCIe Gen1, DDR PCIe Gen Mellanox Technologies Bandwidth (MB/s) Bytes *Optimizations on going IB SDR PCIe Gen1 IB DDR PCIe Gen1 IB DDR PCIe Gen2

13 Superior Application Productivity PAM-CRASH 25 FLUENT 6.3Beta - FL5L3 case Elapsed Time (sec) CPUs 32 CPUs 64 CPUs Fluent Perfomance Rating Number of Cores GigE InfiniBand Mellanox InfiniBand Gigabit Ethernet HP C-Class Blade System with Mellanox 2Gb/s InfiniBand I/O InfiniBand scalability - car2car Performance Number of nodes 13 Mellanox Technologies

14 Superior Application Performance Normalized Runtime 1% 9% 8% 7% 6% 5% Mellanox InfiniBand versus QLogic InfiniPath - neon_refined_revised 2 nodes 4 nodes 8 nodes QLogic InfiniPath Mellanox InfiniBand Lower is better Mellanox InfiniBand full CPU offload Transport offload RDMA Robustness Scalability Efficiency CPU runs application, not network Systems: Intel Woodcrest 3.GHz Interconnects: Mellanox InfiniBand SDR, QLogic InfiniPath Vector Distribution Benchmark Time to Compute 1 Time Steps Lower is better Time (sec) GigE InfiniBand 57% Cores 16 Cores 32 Cores 14 Mellanox Technologies

15 Mellanox Cluster Center Neptune cluster 32 nodes Dual core AMD Opteron CPUs Helios cluster 32 nodes Quad core Intel Clovertown CPUs Vulcan cluster coming soon 32 nodes Quad core AMD Barcelona CPUs Utilizing Fat Tree network architecture (CBB) Non-blocking switch topology Non-blocking bandwidth ConnectX InfiniBand 2Gb/s InfiniBand based storage InfiniBand storage NFS over RDMA, SRP 15 Mellanox Technologies

16 Summary Market-wide adoption of InfiniBand Servers/blades, storage and switch systems Data Centers, High-Performance Computing, Embedded Performance, Price, Power, Reliable, Efficient, Scalable 4 th Generation adapter - connectivity to InfiniBand and Ethernet Market leading performance, capabilities and flexibility Driving key trends in the market Clustering/blades, low-latency, I/O consolidation, multi-core, virtualization Converged Architecture with ConnectX I/O Consolidation iscsi Storage InfiniBand or Ethernet InfiniBand or Ethernet Low Cost Bridge InfiniBand Storage 16 Mellanox Technologies Fibre Channel Storage

17 Thank You 17