Birds of a Feather Presentation

Transcription

1 Mellanox InfiniBand QDR 4Gb/s The Fabric of Choice for High Performance Computing Gilad Shainer, June 28 Birds of a Feather Presentation

2 InfiniBand Technology Leadership Industry Standard Hardware, software, cabling, management Design for clustering and storage interconnect Price and Performance 4Gb/s node-to-node 12Gb/s switch-to-switch 1us application latency Most aggressive roadmap in the industry Reliable with congestion management Efficient RDMA and Transport Offload Kernel bypass CPU focuses on application processing Scalable for Petascale computing & beyond End-to-end quality of service Virtualization acceleration I/O consolidation Including storage Performance Roadmap Gigabits per second InfiniBand Delivers Ultra Low Latency 2 Mellanox Technologies

3 InfiniBand in the TOP5 Number of Clusters Top5 Interconnect Placement Top5 Placement InfiniBand All Proprietary High Speed GigE Performace (Gflops) InfiniBand Clusters - Performance 36% CAGR Nov 5 June 6 Nov 6 June 7 Nov 7 June 8 InfiniBand Performance InfiniBand makes the most powerful clusters 5 of the top 1 (#1,#4, #7, #8, #1) and 49 of the Top1 The leading interconnect for the Top2 InfiniBand clusters responsible for ~4% of the total Top5 performance InfiniBand enables the most power efficient clusters InfiniBand QDR expected Nov 28 No 1GigE clusters exist on the list 3 Mellanox Technologies

4 Mellanox InfiniBand End-to-End Products Software Adapter ICs & Cards Switch ICs End-to-End Validation ADAPTER SWITCH ADAPTER Cables Blade/Rack Servers Switch Storage High Throughput - 4Gb/s Kernel bypass Low latency - 1us Remote DMA (RDMA) Low CPU overhead Reliability Maximum Productivity 4 Mellanox Technologies

5 ConnectX - Fastest InfiniBand Technology Performance driven architecture MPI latency 1us, ~6.5GB/s with 4Gb/s InfiniBand (bi-directional) MPI message rate of >4 Million/sec Superior real application performance Engineering Automotive, oil & gas, financial analysis, etc. 5 ConnectX IB MPI Latency 7 ConnectX IB QDR 4Gb/s MPI Bandwidth PCIe Gen2 usec us MB/s GB/s Bytes Bytes PCIe Gen2 IB QDR Latency 5 Mellanox Technologies IB QDR Uni-dir IB QDR Bi-dir

6 ConnectX Multi-core MPI Scalability Mellanox ConnectX MPI Latency - Multi-core Scaling Mellanox ConnectX MPI Latency - Multi-core Scaling 6 9 Latency (usec) 4 2 Latency (usec) # of CPU cores (# of processes) # of CPU cores (# of processes) Scalability to 64+ cores per node, to 2K+ nodes per subnet Guarantees same low latency regardless of the number of cores Guarantees linear scalability for real applications 6 Mellanox Technologies

7 InfiniScale IV Switch: Unprecedented Scalability 36 4Gb/s or 12 12Gb/s InfiniBand Ports Adaptive routing and congestion control Virtual Subnet Partitioning 6X switching and data capacity Vs. using 24-port 1GigE Ethernet switch devices 4X storage I/O throughput Critical for backup, snapshot and quickly loading large datasets Vs. deploying 8Gb/s Fibre Channel SANs 1X lower end-to-end latency performance Vs. using 1GigE/DCE switches and iwarp-based adapters 3X the server and storage node cluster scalability when building a 3-tier CLOS fabric Vs. using 24-port 1GigE Ethernet switch devices 7 Mellanox Technologies

8 Addressing the Needs for Petascale Computing Faster network streaming propagation Network speed capabilities Solution: InfiniBand QDR Large clusters Scaling to many nodes, many cores per node Solution: High density InfiniBand switch Balanced random network streaming One to One random streaming Solution: Adaptive routing Balanced known network streaming One to One known streaming Solution: Static routing Un-balanced network streaming Many to one streaming Solution: Congestion control Designed to handle all communications in HW 8 Mellanox Technologies

9 HPC Applications Demand Highest Throughput LS-DYNA Profiling Fluent Message Size Profiling 1.E+1 1.E+9 1.E+8 1.E+7 1.E+6 Total data send (Byte) Total data transferred (Byte) The need for bandwidth [..64] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ ] [ infinity] The need for bandwidth MPI message size (Byte) 16 cores 32 cores [..256] [ ] [ ] [ ] [ ] [ ] [ ] Scalability Mandates Highest Bandwidth Lowest Latency The need for bandwidth The need for latency Message size (Byte) 2 Servers 7 Servers 9 Mellanox Technologies

10 HPC Council Advisory Distinguished HPC alliance (OEMs, IHVs, ISVs, end-users) Members activities Qualify and optimize HPC solutions Early access to new technology, and mutual development of future solutions Explore new opportunities within the HPC market HPC targeted joint marketing programs A community effort support center for HPC end-users Mellanox Cluster Center Latest InfiniBand and the HPC Advisory Council member technology Development, testing, benchmarking and optimization environment End- user support center - HPCHelp@mellanox.com For details HPC@mellanox.com 1 Mellanox Technologies

11 Providing advanced, powerful, and stable high performance computing solutions 11 Mellanox Technologies