Enabling FPGAs in Hyperscale Data Centers

Transcription

1 J. Weerasinghe; IEEE CBDCom 215, Beijing; 13 th August 215 Enabling s in Hyperscale Data Centers J. Weerasinghe 1, F. Abel 1, C. Hagleitner 1, A. Herkersdorf 2 1 IBM Research Zurich Laboratory 2 Technical University of Munich 215 IBM Corporation

2 Outline Background Motivation Hyperscale Data Center Network-attached s OpenStack Integration Conclusion IBM Corporation

3 Background Heterogeneous workloads are moving into the cloud. How do we accelerate them? Cloud(Public/Private) IBM Corporation

4 Motivation Accelerate Workload Processing in the Cloud Research Educational Testing accelerated APIs Improved user experience (e.g. BING) s as a Service Acceleration as a Service IaaS PaaS SaaS Cloud(Public/Private) IBM Corporation

5 Deployment Challenges Scalability Optimal Utilization Fail-in- Place Workload Migration IBM Corporation

6 Scalability, Efficiency Server/Cloud Data Center Trends Software-defined Servers [2] (disaggregated resources) Hyperscale Servers [1] Virtualized Servers 6 Traditional Servers (not virtualized) Time [1] Cray and X-ES Microserver [2] Network support for resource disaggregation in next-generation datacenters (UC Berkeley & Huawei, 213) 215 IBM Corporation

7 Hyperscale Data Center (e.g. IBM DOME userver) 133 mm Compute module with up to 48GB DRAM 55 mm 128 Compute modules in a 2U chassis 8K Compute modules & 4TB DRAM in 4 racks IBM Corporation

8 -CPU Attachment Options CPU CPU CPU CPU Node CPU Node Node CPU Node Node PCIe DC Network as a co-processor as a peer-processor IBM Corporation

9 Network-attached Module Memory Management Layer (ML) User Logic (v) Memory Management Layer (ML) Memory Manager v1 Memory Memory Controller Memory Virtualizer Memory Access Module v2 Memory Management Stack (On-/Off-) Network Service Layer (NSL) User Logic (v1) User Logic (v2) Network Service Layer (NSL) Data Center Network Buffer Buffer Buffer Buffer Buffer Application Interface PRR: Partially Reconfigurable Region, FDB: Forwarding DB, OVN: Overlay Virtual Network, TEP: Tunnel Endpoint L3-L4 Protocol Data Plane OVN TEP Network and Transport Stack Ethernet Media Access Controller (MAC) FDB IBM Corporation

10 Hyperscale Data Center w/ Network-attached s Chassis Chassis-1 Chassis-1 Chassis-1 Rack-1 Rack-1 Rack-1 Rack Chassis Chassis-16 Chassis-16 Chassis Compute Module Storage Module Module Other Modules 1 Networking Module Top-of-Rack Switch 215 IBM Corporation

11 OpenStack Integration User OpenStack Horizon (dashboard) Accelerator Service API Swift (object storage) Glance (Image Service) queue scheduler DB Nova (compute) Cinder (block storage) Neutron (network) worker resource pool (OS images, VM images, bitstreams)) volume storage (iscsi etc) SDN plug-in plug-in GPU plug-in API Centralized Network Management Apps Apps Virtualization SDN Controller Network Manager 11 HW SDN-enabled Network Switch SDN-enabled Network Switch SDN-enabled Module SDN-enabled Module 215 IBM Corporation

12 v: Rent Your in the Cloud IP Address: Memory Capacity: 8GB CPU Cores: 4 VM CPU vfgpa 12 IP Address: Memory Capacity: 8GB Resources: CLB: 1 DSP: 8 BRAM: 4 Cloud(Public/Private) 215 IBM Corporation

13 Fabrics: Create Your Own Topology Streaming? Resource Pool MapReduce? Neural Networks? IBM Corporation

14 Fabric Deployment Fabric Description OpenStack Accelerator Service Network Manager SDN-enabled DC Network IBM Corporation

15 Programming Model (1)init() (1)-a-connect (4)-a-disconnect (2)send() (3)receive() (1)-b-connect (4)close() (4)-b-disconnect Compute Module SW Application.. Fabric Handle Library Fabric IBM Corporation

16 Outlook Per Rack Compute Performance Per Rack Hyperscale Server [1] Hyperscale [2] Modules Cores CLBs(1^6) - 71 Memory(TB) 1 1 TFLOPS(32 bit) [1] FreeScale T424 SoC-based [2] Xilinx Zynq 71 SoC-based IBM Corporation

17 Conclusion s must be deployed in data centers s must be made available to the cloud users Large-scale deployment requirements A scalable infrastructure A change in the CPU- interface A management framework We propose Network-attached s in hyperscale data centers OpenStack accelerator service to provision s in the cloud Make the Free from CPU and Go Large Scale IBM Corporation

18 THANKS IBM Corporation