AI-accelerated HPC Hardware Infrastructure. Francis Lam Huawei Technologies

Transcription

1 AI-accelerated HPC Hardware Infrastructure Francis Lam Huawei Technologies

2 Contents Huawei HPC Momentum Boundless Computing AI accelerating HPC HPC accelerating AI Huawei Confidential 2

3 A Rapidly Growing Challenger in Server Market Ranks No.3 Globally by Server Shipment in 2016Q4-Q No.3 No.1 Dell EMC HPE Huawei Lenovo Inspur Cisco Ranks No.1 in China by Server Market Share in 2016Q4-Q Challenger Huawei Inspur Dell EMCLenovo HPE Sugon IBM Source: Worldwide Server Market Report in 2016Q4~Q3 2017, Gartner Gartner's Magic Quadrant for Servers Huawei Confidential 3

4 A Leader in Storage Market No.1 No. 1 Market Share in China 2017 Huawei Dell EMC HPE IBM Hitachi NetApp : No.1 among all challengers No.1 No. 1 Revenue Growth Rate Globally 2014: positioned as a challenger 2010: niche player Huawei IBM HPE Hitachi Oracle Dell EMC Source: External Storage Market Share Report in 2Q17, Gartner Gartner's Magic Quadrant for Storage Huawei Confidential 4

5 Growing HPC Influence Data source: https: // Huawei Confidential 5

6 PSNC Builds an Energy-efficient Data Center with Huawei HPC Solution 1040 nodes, with compute performance of 1.37 PFlops Energy consumption down by 90%, saving electricity costs by 38% Liquid-cooled cluster, with cooling PUE of Huawei Confidential 6

7 3.1PB Storage 320 GPU 2.6 PFlops Cores 1040 nodes Huawei Helps Compute Canada Build Supercomputing Platform to Propel Science Research Green 500 Rank#45 1.2P HPL 2.6 PFlops compute scale CPU & GPU acceleration hybrid HPC cluster Huawei Confidential 7

8 Huawei Servers Empower Daimler-Benz with an Automobile Fluid Simulation HPC System HPC cluster application performance up by 30% Compute density doubled Huawei Confidential 8

9 Huawei Helps Volkswagen Group Build a Car Collision Simulation Design Platform Collision test cycle slashed by 10% Huawei Confidential 9

10 Huawei Helps CERN Build a Science Cloud the "Helix Nebula" Compute power up by 30% O&M costs down by 67% Huawei Confidential 10

11 Huawei Confidential 11

12 Trusted Partner in Deploying HPC Infrastructure Universities Manufacturing/ Automobile Enterprises Oil & Gas, Media, Meteorology Supercomputing Centers & Scientific Institutions Huawei Confidential 12

13 Contents Boundless Computing HPC accelerating AI Huawei HPC Momentum AI accelerating HPC Huawei Confidential 13

14 A New Starting Point in Computing 10x heterogeneous vs universal computing 100x dedicated vs universal computing 1M+ nodes 1000x data processing capabilities (TB PB) 100bn connections (by 2025) 50% data processed on the edge AI Universal Heterogeneous Cloud Computing Single server Resource pool Smart Edge Centralized Distributed Huawei Confidential 14

15 Boundless Computing Strategy Re-imagine computing for a fully connected world. Unlock Computing Potential Push Beyond Server Boundary Push Beyond DC Boundary CPU evolution Data volume Workload Awareness Internet of Everything Intelligent Compute Generalpurpose CPU Optimized for Applications Next-Gen distributed Smart Access Server Hardware Platform DC Data source Huawei Confidential 15

16 Performance Push Beyond the Boundary Enable cloud usage with ultimate accessibility and convenience for DCs. Universal computing resource pool Heterogeneous computing resource pool 100/200/400GE RDMA Fabric for XOD Coherence Link XOD Manager Hardware resource pool architecture Network Protocol Heterogeneous computing 10x efficiency compared w/ traditional architecture Storage resource pool Network I/O resource pool Hardware resource pooling enables provisioning on demand. Memory resource pool Silo architecture Traditional virtualization architecture Hardware resource pool architecture Years Hardware resource pooling combines with chip capabilities to boost overall efficiency by 10x. Huawei Confidential 16

17 Contents Boundless Computing HPC accelerating AI Huawei HPC Momentum AI accelerating HPC Huawei Confidential 17

18 Strategic partnership with selected Tier 1 international carriers in public cloud development Global DCs & Network Nodes 5000+Salesman 10k+Engineers 4 + Yrs Public Cloud Operation Experience 10k+ Public Cloud Customers from Top500 to SMB Huawei Confidential 18

19 HPC Cloud:True High Performance Computing Infrastructure Access layer Workspace Bare metal service VMs with high specifications Network & Security VPC CES Computing layer Service node Login Portal node Bare metal + SDI Shared storage 128vCPU+4TB RAM License node Job Schedule node DB node Working node HPC ECS Pool IB network ECS ECS ECS- CPU ECS ECS ECS- CPU ECS ECS ECS- CPU 100G IB Service Network 2μs,Low Latency Storage Layer EVS Local disk AS(Auto Scaling) EVS Local disk GPU acceleration FPGA data preprocessing EVS block Storage EVS based parallel file system Object Storage SFS file system Cloud Platform(OpenStack API) Nvidia P100 GPU Acceleration Optimal cloud acceleration and data pre-processing Huawei Confidential 19

20 Huawei Enterprise Cloud Services Huawei Confidential 20

21 Huawei Enterprise Cloud DLaaS Huawei Confidential 21

22 Huawei Enterprise Cloud GPUaaS Huawei Confidential 22

23 New Huawei Cloud Services Accelerating AI and HPC P1 GPU Calculate Accelerated Cloud Server PI1 GPU Inference Accelerated Cloud Server FP1 FPGA Accelerated Cloud Server 8*P100 GPU 16*P4 (2017Q4) GPU 8*VU9P Ultra SCALE 200G MESH NvLink Upcoming Bandwidth 32G 160G 16*22T INT8 computing power 30+ Partners 30+ Accelerate IP FusionServer G5500 (8 x P100) FusionServer G5500 (32 x P4) FusionServer G5500 (8 x FPGA-VU9P) Huawei Confidential 23

24 ATLAS Heterogeneous Computing Platform CPU1 CPU2 CPU1 CPU2 IO IO IO SW SW SW SW Heterogeneous resource pool One-click topology switching Flexible Modular Design GPU GPU GPU GPU GPU GPU GPU GPU Topo1: Single RC-AI Training GPU GPU GPU GPU GPU GPU GPU GPU Topo2: Balanced HPC, Cloud IO CPU1 CPU2 IO IO SW SW SW IO SW GPU GPU GPU GPU GPU GPU GPU GPU Topo3: High BW-HPC FusionServer G Huawei Confidential 24

25 Integrating HPC and AI Hardware Perspective Resource over-provisioning CFD WRF Hadoop DL Hardware Resource Management and Job Scheduling Physical servers X86 X86 HDD HDD Server SKU A X86 FPGA HDD SSD Server SKU B SoC GPU HDD SCM Server SKU X Built world class HPC and AI hardware platform enabling higher degree of workload optimization Built ecosystem of solutions providers to facilitate advanced HPC deployment in both academic and industry Leverage diversified set of technology to advance HPC 12U with 32 x 2S compute nodes Integrated 100G InfiniBand & OPA 2U 4 nodes All-flash computing platform Flexible Programmable Heterogenous Compute Full-range Xeon SP processors Huawei Confidential 25

26 Integrating HPC and AI Software Perspective Management Portal / GUI AI/DL Application HPC Application Cluster Manager Workload Management Software DL Framework, Library, Tools MPI, Math Library, Compiler Container VM Bare Metal HPC Compute Resources Accelerator Resources HPC Storage Resources Huawei Confidential 26

27 Contents Boundless Computing HPC Accelerating AI Huawei HPC Momentum AI accelerating HPC Huawei Confidential 27

28 Diversified Workloads Demand Hardware Optimization 800 Tensorflow benchmark + imagenet 60 High Host CPU Consumption Host CPU Switch GPU GPU GPU GPU Image/sec Host CPU Core 0 Accelerator hardwired to Host CPU Huawei Confidential 28

29 Different algorithms Required Varying GPU Resources Fix GPU Configuration Actual Workloads Wasted 2 GPU CPU1 CPU2 Algorithms Ideal CPU:GPU License Plate Recognition 1:2 SW Vehicle/Cyclist/Pedestrian Detection 1:4 Vehicle Structural Inspection 1:6 GPU GPU GPU GPU Example: Safe City Applications Short 2 GPU Huawei Confidential 29

30 Maximize Utilization with GPU Resource Pool Time Share Multiple Nodes share 1 GPU SLA based QOS Time Sharing 1 Node with multiple GPUs CPU:GPU = 1:2 /1:3 /1:4/ / 1:N Dynamic On Demand Compute Node GPU card Compute Node GPU card Compute Node GPU card Compute Node GPU card GPU card Compute Node GPU card GPU card Compute Node GPU card GPU card Elastic GPU card GPU card GPU card HPC Fabric GPU Resource Pools GPU card GPU card GPU card GPU card GPU card GPU card GPU card GPU card GPU card GPU card Heterogeneous Servers HPC Nodes Huawei Confidential 30

31 GPU Resource Pool Improves Resource Utilization More effectively sharing GPU resources among tasks Reduce compute resource consumption for intensive workload Huawei Confidential 31

32 Adapting to Workloads with Accelerator Resource Pool CPU Core Consumption with GPU Resource Pool With vs. Without GPU Resource Pool Reduced Host CPU 40 Consumption Image/sec Front End CPU Core Back End CPU Core Image/sec 0 Combined CPU Core with Resource Pool Host CPU Core without Resource Pool Back End CPU SW Front End CPU GPU GPU GPU GPU Accelerator hardwired to Host CPU Huawei Confidential 32

33 Unified HPC and AI architecture Management Portal / GUI AI/DL Application HPC Application Cluster Manager Workload Management Software DL Framework, Library, Tools MPI, Math Library, Compiler Huawei ATLAS Resource Management Software Platform Container VM Bare Metal HPC Compute Resources Accelerator Resources Pools HPC Storage Resources Huawei Confidential 33

34 ATLAS Programmable Hardware Architecture Universal hardware HPC/Cloud - scale programmable hardware CFD WRF Hadoop DL CFD WRF Hadoop DL Resource over-provisioning HPC Resource Management and Job Scheduling Provision on demand HPC Resource Management OR Private Cloud Stack Logical nodes Physical servers X86 HDD HDD X86 Server SKU A X86 FPGA HDD SSD Server SKU B SoC GPU HDD SCM Server SKU X Hardware composer Resource pools X86 X86 SoC GPU SCM X86 FPGA SoC GPU NPU SSD HDD Flexibly programmable, low-latency converged network Everything On Demand (XOD) protocol enables on-demand smart converged resource pool Smart converged resource pool management, automatic composition: provision servers of any types flexibly according to service requirements Huawei Confidential 34

35 AI From Core To Edge Data Center AI Training/Inference/HPC Data set training Image, voice, video structured query Cluster size, large throughput Edge Computing Branch Inference Identify, reason, solve problems Unstructured data processing Real-time accurate response Terminal FusionServer G5500 Data Center Heterogeneous Server FusionServer G2500 Intelligent Edge Server Upcoming Thin Intelligent Edge Server Huawei Confidential 35

36 Huawei HPC Advantages End-to-end Efficiency Workload Optimized Adaptive to Changes Graph Cloud SDS Big Data AI Big Data Smaller footprint, lower power, Higher performance Application-optimized Unrivaled performance Future-ready HPC converged architecture E2E energy-saving design Efficient and reliable liquid-cooling technology Integrated delivery and installation Flexible modular architecture Diversified innovations In-depth application-optimized hardware acceleration Rapid adoption of emerging technologies Versatile HPC system HPC and cloud perfect synergy Huawei Confidential 36

37 Thank You Copyright 2017 Huawei Technologies Co., Ltd. All Rights Reserved. All logos and images displayed in this document are the sole property of their respective copyright holders. No endorsement, partnership, or affiliation is suggested or implied. The information in this document may contain predictive statements including, without limitation, statements regarding the future financial and operating results, future product portfolio, new technology, etc. There are a number of factors that could cause actual results and developments to differ materially from those expressed or implied in the predictive statements. Therefore, such information is provided for reference purpose only and constitutes neither an offer nor an acceptance. Huawei may change the information at any time without notice.