IBM Leading High Performance Computing and Deep Learning Technologies

Transcription

1 IBM Leading High Performance Computing and Deep Learning Technologies Yubo Li ( 李玉博 ) Chief Architect, on Cloud IBM Research -- China liyubobj@cn.ibm.com QQ: GTC China 2016 Sept. 13, 2016

2 New Generation in IBM s Eyes Accelerator on Cloud Speed Up DL and Cognitive APIs on Cloud s available on data center Optimized accelerator performance: NVLink Accelerator Virtualization Virtualization to Eligible on Cloud passthrough Hardware virtualization Containers sharing PCI passthrough NVIDIA GRID nvidia-docker Accelerator Management and Monitoring Optimize Throughput and Operation Accelerator management Optimized scheduling Metric collection Monitor and alarm Software enhancement 2

3 POWER8 with NVLink 822LC Power System for HPC First Custom-Built Accelerator Server with NVLink 2.5x Faster CPU- Data Communication via NVLink P8 P8 POWER8 NVLink Server Custom-built Accelerator Server High-Speed NVLink Connections between CPUs & s and among s Features novel NVIDIA P100 Pascal accelerator NVLink 80 GB/s No NVLink between CPU & for x86 Servers: PCIe Bottleneck x86 NVIDIA P100 Pascal x86 x86 Servers with PCIe PCIe 32 GB/s 3

4 More Compelling for CPU and Integration Barriers to Entry Removed Too complicate d to move data Requires page faulting support Moves too much data Too Large a Memory Space Required Software UVM feature too limiting Too much custom coding for data movement Far easier to create new applications on Tesla P100 + POWER8 with NVLink NVIDIA Page Migration Engine ensures unified memory space Unified memory: address space spans CPU and, 1TB+ Hardware managed transfers: eliminates explicit data transfers Close code-base to parallel CPU code POWER8 with NVLink ensures speedy data throughput 1TB memory space requires faster CPU: data movement Bus masks transfer times 4

5 SuperVessel: OpenStack Based Cognitive Cloud SuperVessel provides multiple layers services. Super Marketplace (Accelerators, Images, Applications) Platform layer service Cognitive Computing Service VisionBrain: Deep Learning as a Service Big Data Service Cloud Data Service IoT Development Service Accelerator DevOps Service Infrastructure as Service Computing service Accelerator service Data store service Network service with NVIDIA 5 Try SuperVessel :

6 SuperVessel Cloud Infrastructure Horizon Glance OpenStack controller (HA) HEAT Cinder Nova Neutron Senlin Ironic Keystone Swift Services layer Auto Provision scheduler System maintenance Resource metering Distributed file system / shared file system Services for cloud administration System monitoring System analysis Image management Baremetal management Platform Management System User dashboard Admin dashboard User account & authentication manage KVM/ Passthrough Docker/ Sharing LxC/ Docker KVM LxC/ Docker Virtual point management Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder Nova Neutron Cinder Statistic and analysis KVM pool for POWER8 LE/BE Container pool for POWER8 LE/BE Container pool for POWER7 LPAR KVM pool for x86 Container pool for x86 IBM POWER server X86 server 6

7 Heterogeneous Computing for Cognitive Cloud Training (development) Stage Recognition (deployment) Stage Train Data Set DNN Net File Application Data from User Data Cleansing Feature Engineering Modeling Trained model Recognition, classification Application Model pool Data Management Big data platform (Hadoop, Spark) Deep Learning platform (caffe, Torch, Theano, TensorFlow, etc.) Deep Learning platform Application ser vers, DB service, messaging, etc. CPU + cluster CPU + cluster 7

8 Cognitive Computing on SuperVessel Try it on : Cognitive Infrastructure Service Cognitive Computing Service Cognitive Solution and Demo Service 8

9 Service and Accelerated Deep Learning SuperVessel provides the sharing service by extending OpenStack and Docker capability. It is the first sharing service in the public cloud. Users could apply the docker instance on SuperVessel Users could apply the deep learning development environment on SuperVessel, e.g. Caffe, Torch, Theano, and TensorFlow. All the DL environment will assign the resource for acceleration automatically. 9

10 Cognitive Innovation Services Exposed to Bluemix China SuperVessel team built a new cloud site in 21Vianet All the highlighted services are running on cloud with Supervessel technology is used to accelerate deep learning service 10

11 Enhancement on Container Cloud support on Mesos/Marathon/Kubernetes scheduler exposition/isolation with container auto-discovery driver volume injection metrics collection Community activities Main contributor for enablement on Mesos/Marathon Demos/Presentations on several conferences 11

12 Container based Cognitive Service Infrastructure Management/Interface Data/Task Management Deep Learning Application User UI Inference API User Authentication Data Persistence Data pre-processing DL Training DL Inference Task Status Monitoring Resource Management/Orchestration Mesos Infrastructure SuperVessel IaaS Marathon Docker Container Cluster Monitoring Shared FS Hardware Resources Storage Compute Memory Disk CPU Memory 12

13 Accelerated Spark Components (Current and Future) Logistic Regression ADMM Recommendation/ALS Elastic Net NNMF and PCA SVM Random Forest Analytics Word2Vec Nearest Neighbor/LSH Tensor Gradient Descent/EAGD BFS/DFS Link Prediction Machine Learning Spark SQL OLAP Deep Learning GraphX Spark SQL Spark Infrastructure (1.6.1+), DataFrames Interface Compute Node Compute Node Compute Node Compute Node Compute Node Compute Node 13

14 Questions? Contact me at WeChat: 14