Interconnect Your Future

Size: px

Start display at page:

Download "Interconnect Your Future"

Emmeline Wilkins
5 years ago
Views:

1 Interconnect Your Future Paving the Path to Exascale November 2017

2 Mellanox Accelerates Leading HPC and AI Systems Summit CORAL System Sierra CORAL System Fastest Supercomputer in Japan Fastest Supercomputer in Canada InfiniBand Dragonfly+ Topology Highest Performance with InfiniBand 2017 Mellanox Technologies 2

3 Performance enabled via co-design architecture Software Hardware Hardware Hardware Software Software Industry Users Academia Standard, open source, eco-system programmable, configurable, innovation 2017 Mellanox Technologies 3 3

4 OpenPOWER is driving industry innovation with co-design Open development OpenPOWER enables greater innovation through both open software and open hardware Collaboration across multiple thought leaders Collaborative development model drives collective thought leadership, simultaneously across multiple disciplines Performance of POWER architecture Broadens the capabilities of the POWER platform The OpenPOWER Foundation creates an open ecosystem to serve the evolving needs of customers Mellanox Technologies 4 4

5 Exponential Data Growth Everywhere Cloud HPC Big Data Security Internet of Things Enterprise Storage Machine Learning Business Intelligence 2017 Mellanox Technologies 5

Data is Growing Faster Than Ever Autonomous vehicle generates 4000GByte per day CAMERA ~20-40MB Per/sec SONAR ~10-100KB Per/Sec GPS ~50KB Per/Sec RADAR ~10-100KB Per/Sec Light Detection & Ranging

6 Data is Growing Faster Than Ever Autonomous vehicle generates 4000GByte per day CAMERA ~20-40MB Per/sec SONAR ~10-100KB Per/Sec GPS ~50KB Per/Sec RADAR ~10-100KB Per/Sec Light Detection & Ranging ~10-70MB Per/Sec Data will grow by a factor of 10 over the next decade to 163 Zeta Bytes in 2025 (source: IDC) Faster Data processing requires faster Interconnect speeds 2017 Mellanox Technologies 6

Artificial Intelligence: Sparking The Next Industrial Revolution Finance, Fraud & Insurance Cloud, Web, Mobile, Retail Automotive & Transportation Medicine & Genomics Security & Safety Oil & Gas

7 Artificial Intelligence: Sparking The Next Industrial Revolution Finance, Fraud & Insurance Cloud, Web, Mobile, Retail Automotive & Transportation Medicine & Genomics Security & Safety Oil & Gas Fraud Detection Credit/Risk Analysis High Frequency Trading Image Tagging Speech Recognition Sentiment Analysis Self Driving Image / Facial Recognition Logistics & Mapping Drug Discovery Diagnostic Assistance Cancer Cell Detection Surveillance Image Analysis Facial Recognition and Detection Seismic Imaging Reservoir Characterization Subsurface Fault Detection 2017 Mellanox Technologies 7

8 Artificial Intelligence Needs the Most Intelligent Interconnect Higher Data Speeds SmartNIC System on a Chip Faster Data Processing Better Data Security Adapters Switches Cables & Transceivers 2017 Mellanox Technologies 8

Exponential Data Growth The Need for Intelligent

9 Exponential Data Growth The Need for Intelligent and Faster Interconnect CPU-Centric (Onload) Data-Centric (Offload) Must Wait for the Data Creates Performance Bottlenecks Analyze Data as it Moves! Faster Data Speeds and In-Network Computing Enable Higher Performance and Scale 2017 Mellanox Technologies 9

Communications Latencies of 30-40us HPC / Machine Learning Communications Latencies

10 Data Centric Architecture to Overcome Latency Bottlenecks CPU-Centric (Onload) Data-Centric (Offload) Network In-Network Computing HPC / Machine Learning Communications Latencies of 30-40us HPC / Machine Learning Communications Latencies of 3-4us Intelligent Interconnect Paves the Road to Exascale Performance 2017 Mellanox Technologies 10

Acceleration Critical for HPC and Machine

Performance Acceleration Delivers Highest

5000X Faster Network Recovery Unbreakable Data

11 In-Network Computing Delivers Highest Perfomance In-Network Computing 10X Performance Acceleration Critical for HPC and Machine Learning Applications In-Network Computing 35X Performance Acceleration Delivers Highest Application Performance Self-Healing Technology 5000X Faster Network Recovery Unbreakable Data Centers GPUDirect RDMA GPU Acceleration Technology 10X Performance Acceleration Critical for HPC and Machine Learning Applications 2017 Mellanox Technologies 11

12 InfiniBand Delivers Best Return on Investment 30%-250% Higher Return on Investment Up to 50% Saving on Capital and Operation Expenses Highest Applications Performance, Scalability and Productivity Weather Automotive Chemistry Molecular Dynamics Genomics 1.3X Better 2X Better 1.4X Better 2.5X Better 1.3X Better 2017 Mellanox Technologies 12

13 InfiniBand Enables Highest Applications Efficiency Relative applications efficiency per cluster size OmniPath efficiency relative to InfiniBand, various applications (GROMCS, NAMD, Fluent, LS-DYNA, VASP) 2017 Mellanox Technologies 13

14 Application Performance Comparison LS-DYNA A structural and fluid analysis software, used for automotive, aerospace, manufacturing simulations and more Higher is better 109% Higher performance 16 nodes InfiniBand cluster delivers 75% Higher Performance versus 32 nodes Omni-Path cluster InfiniBand Delivers 109% Higher Performance and Superior Scaling 16-Nodes InfiniBand Cluster Outperforms 32-Nodes Omni-Path Cluster 2017 Mellanox Technologies 14

System Cost OmniPath $491,280 With Free Network InfiniBand $278,238

15 Automotive Design - LSTC LS-DYNA Application InfiniBand Always Wins: $213,042 Best Performance. Best R.O.I. System Cost OmniPath $491,280 With Free Network InfiniBand $278,238 $213,042 Cost 43% Savings Lower TCO Based on 32-node Scalable Unit Performance 2017 Mellanox Technologies 15

16 Application Performance Comparison Fluent (Aircraft_Wing_2M) Intel Claims OPA 19% Better Reality EDR 114% Better Intel Claims OPA 19% Better Reality EDR 140% Better Mellanox InfiniBand performance versus Intel published results for OmniPath and InfiniBand InfiniBand with 32-cores Broadwell CPU outperforms OmniPath with 36-cores CPUs InfiniBand Delivers 140% Higher Performance and Superior Scaling 16-Nodes InfiniBand Cluster Outperforms 32-Nodes Omni-Path Cluster EDR (Mellanox) Mellanox test results, including the usage of Mellanox In-Network Computing and other acceleration engines. OmniPath (Intel) Intel published test results for OmniPath. EDR (Intel) Intel published test results for EDR InfiniBand. Mellanox testing done with 32-cores Broadwell CPUs, Intel testing were done with 36-cores Broadwell CPUs. A normalized chart estimates performance comparison if all would have been done on 36-cores Broadwell CPUs Mellanox Technologies 16

17 Computational Fluid Dynamic ANSYS Fluent Application InfiniBand Always Wins: $441,690 Best Performance. Best R.O.I. System Cost OmniPath $982,560 With Free Network InfiniBand $540,870 $441,690 Cost 45% Savings Lower TCO Based on 64-node Scalable Unit Performance 2017 Mellanox Technologies 17

Application Performance Comparison VASP (HEZB), Skylake CPUs Higher is better 17% Higher performance 51% Higher performance 58% Higher performance 71% Higher performance 8 nodes InfiniBand cluster

18 Application Performance Comparison VASP (HEZB), Skylake CPUs Higher is better 17% Higher performance 51% Higher performance 58% Higher performance 71% Higher performance 8 nodes InfiniBand cluster delivers 24% Higher Performance versus 16 nodes Omni-Path cluster InfiniBand Delivers 48% Higher Performance and Superior Scaling 8-Nodes InfiniBand Skylake Cluster Outperforms 16-Nodes Omni-Path Skylake Cluster 2017 Mellanox Technologies 18

Network InfiniBand $146,922 $98,718 Cost

19 Chemistry VASP Application InfiniBand Always Wins: $98,718 Best Performance. Best R.O.I. System Cost OmniPath $245,640 With Free Network InfiniBand $146,922 $98,718 Cost 40% Savings Lower TCO Based on 16-node Scalable Unit Performance 2017 Mellanox Technologies 19

02 Billion msg/sec (195M msg/sec/port) 32 100GbE Ports, 64 25/50GbE Ports (10 / 25 / 40 / 50 / 100GbE) Throughput of 3.

20 Highest-Performance 100Gb/s Interconnect Solutions 100Gb/s Adapter, 0.6us latency million messages per second (10 / 25 / 40 / 50 / 56 / 100Gb/s) 36 EDR (100Gb/s) Ports, <90ns Latency Throughput of 7.2Tb/s 7.02 Billion msg/sec (195M msg/sec/port) GbE Ports, 64 25/50GbE Ports (10 / 25 / 40 / 50 / 100GbE) Throughput of 3.2Tb/s Transceivers Active Optical and Copper Cables (10 / 25 / 40 / 50 / 56 / 100Gb/s) VCSELs, Silicon Photonics and Copper MPI, SHMEM/PGAS, UPC For Commercial and Open Source Applications Leverages Hardware Accelerations 2017 Mellanox Technologies 20

Throughput of 16Tb/s, <90ns Latency 16 400GbE, 32 200GbE, 128 25/50GbE Ports (10 / 25 / 40 / 50 / 100 / 200 GbE) Throughput of 6.

21 Highest-Performance 200Gb/s Interconnect Solutions 200Gb/s Adapter, 0.6us latency 200 million messages per second (10 / 25 / 40 / 50 / 56 / 100 / 200Gb/s) 40 HDR (200Gb/s) InfiniBand Ports 80 HDR100 InfiniBand Ports Throughput of 16Tb/s, <90ns Latency GbE, GbE, /50GbE Ports (10 / 25 / 40 / 50 / 100 / 200 GbE) Throughput of 6.4Tb/s Transceivers Active Optical and Copper Cables (10 / 25 / 40 / 50 / 56 / 100 / 200Gb/s) VCSELs, Silicon Photonics and Copper MPI, SHMEM/PGAS, UPC For Commercial and Open Source Applications Leverages Hardware Accelerations 2017 Mellanox Technologies 21

22 Upcoming HDR InfiniBand Increases Mellanox Leadership HDR InfiniBand the Most Scalable Switch 1.7X Better 2.8X Better 4.6X Better 80-Ports Top of Rack Switch 3200 Nodes with Only 2-Teir Switch Network 128K Nodes with Only 3-Tier Switch Network 400-Nodes 1.6X Switch Saving, 2X Cable Saving InfiniBand: 15 ToR Switches; OmniPath: 24 ToR Switches 1600-Nodes 4X Cable Saving, 2X Power Saving InfiniBand: 1 Modular Switch; OmniPath: 64 ToR + 2 Modular Switches 2017 Mellanox Technologies 22

23 Summary The OpenPOWER Foundation creates an open ecosystem to serve the evolving needs of customers. To overcome the performance limitations of today s HPC and enterprise systems, we need an intelligent interconnect paired with a powerful POWER-based processor. The interconnect becomes a co-processor, offloading the CPU, increasing data center efficiency. Mellanox 100Gb/s, and 200 Gb/s InfiniBand and Ethernet solutions are robust and deliver unprecedented scalable performance for OpenPOWER-based platforms. Protect Your Future with Mellanox and OpenPOWER! 2017 Mellanox Technologies 23 23

24 Thank You

Interconnect Your Future Enabling the Best Datacenter Return on Investment. TOP500 Supercomputers, November 2017

Interconnect Your Future Enabling the Best Datacenter Return on Investment TOP500 Supercomputers, November 2017 InfiniBand Accelerates Majority of New Systems on TOP500 InfiniBand connects 77% of new HPC