Net-Centric 2017 Data-center network (DCN) architectures with Reduced Power Consumption

Size: px

Start display at page:

Download "Net-Centric 2017 Data-center network (DCN) architectures with Reduced Power Consumption"

Adam Harris
5 years ago
Views:

1 Data-center network (DCN) architectures with Reduced Power Consumption Flow/Application triggered SDN controlled electrical/optical hybrid switching data-center network: HOLST Satoru Okamoto, Keio University

2 Co-Authors and Acknowledgement Co-Authors Yukihiro Imakiire, Masayuki Hirono, and Naoaki Yamanaka (Keio University) Acknowledgement This work is partly supported by by HOLST (Highspeed Optical Layer 1 Switch system for Time slot switching based optical data center networks) Project funded by New Energy and Industrial Technology Development Organization (NEDO) of Japan. 2/22

3 Outline Data-center Electricity Consumption Data-center network architecture Leaf-Spine Electrical Switching Optical data-center network Optical Circuit Switching Optical Slow Switching HOLST data-center network Summary 3/22

4 Data-Center (DC) Electricity Consumption 70 (2 % of US) 4 % increase Per 5 years 4/22

5 Breakdown of the Power Consumption in DC Cooling Equipment Converter Loss Server + Storage 33 % Network 17 % (DC/DC) 5/22

6 Basic Data-Center Network (DCN) Architecture Leaf-Spine Architecture (Layer 2 or Layer 3) DCN capacity can be adjustable by changing # of Spine Switches. Spine Leaf Servers Storage Internet 6/22

7 Power consumption : Optical vs. Electrical 1/500 (1000 kw 2 kw) MEMS-based Optical Circuit Switching!! Source: S. Aleksic, IEEE/OSA Journal of Optical Communications and Networking, Vol. 1, No. 3, pp , /22

1 st Generation: Helios (2010 UC San Diego) MEMS-based Optical Circuit Switching (OCS) is introduced to the Leaf-Spine architecture Spine MEMS # of ports ~ 300

8 1 st Generation: Helios (2010 UC San Diego) MEMS-based Optical Circuit Switching (OCS) is introduced to the Leaf-Spine architecture Spine MEMS # of ports ~ ms Switching speed Leaf Source: N. Farrington, et al, Helios: a hybrid electrical/optical switch architecture for modular data centers, Proc. in SIGCOM /22

9 How to accommodate big flows into Optical Circuit Switching Network First, all flows are accommodated into Electrical Switching Network. If Elephant Flow is observed, then the flow is rearranged to Optical Circuit Switching Network. On-line Flow Classification Elephant Trap Observation-based flow assignment Maximum weight matching problem Yi Lu, et al, ElephantTrap: A low cost device for identifying large flows, 15 th IEEE Symposium on High-Performance Interconnects, /22

10 2 nd Generation: Optical Slot Switching (OSS) Fixed Length µs-order Slot Switching + SDN control ICTON 2017 Mo.B3.4 NEPHELE (National Technical Univ. of Athens) High-speed (10 ns) 2x2 Optical Switch All Optical, Ring Topology ECOC 2017 We.2.A.3 Cloud BOSS (Nokia Bell Labs) High-speed (100 ns) tunable Tx for making a slot All Optical, Ring Topology ECOC 2017 We.2.A.4 COSIGN (Univ. of Bristol) High-speed (25 ns) 4x4 Optical Switch OCS (MEMS) + OSS 10/22

hybrid switching network High-speed (10 ns) 8x8 and 16x16 Optical Switch is developing Application triggered SDN-based DCN control

11 HOLST HOLST: High-speed optical layer 1 switch system for time slot switching based optical data center networks Slot Switching-based DCN developing project Keio University, OA Laboratory, and Epi Photonics Electrical and Optical (Circuit and Slot) hybrid switching network High-speed (10 ns) 8x8 and 16x16 Optical Switch is developing Application triggered SDN-based DCN control ECOC 2017 We.2.A.2 Hadoop-based Application Triggered Automatic Flow Switching in Electrical/Optical Hybrid Data- Center Network (Keio Univ.) 11/22

HOLST System Architecture 12/22 45 41 36 44 43 42 40 39 38 37 35 34 33 45 41 36 44 43 42 40 39 38 37 35 34 33 45 41 36 44 43 42 40 39 38 37 35 34 33 45 41 36 44 43 42 40 39 38 37 35 34 33 TOR_Switch

12 HOLST System Architecture 12/ TOR_Switch Servers Spine_Switch Ultra_High_Speed_Optic al_l1_switch MEMS_Switch PLZT_Switch Mice Flow SDN Controller OSS network OCS network

Power Reduction by OSS + OCS # of ToRs = 256 30 servers/rack, NIC 10 GE, mixed traffic (Web search and Data mining) Mice : < 1 Gbps, Doggy : 1 6 Gbps, Elephant: 6 10 Gbps Detailed simulation

13 Power Reduction by OSS + OCS # of ToRs = servers/rack, NIC 10 GE, mixed traffic (Web search and Data mining) Mice : < 1 Gbps, Doggy : 1 6 Gbps, Elephant: 6 10 Gbps Detailed simulation parameters are shown in M. Hirono, et al, HOLST: Architecture design of energy-efficient datacenter network based on ultra high-speed optical switch IEEE LANMAN2017, June HOLST: 256 ToR Helios: 256 ToR Electrical: 256 ToR Electrical: 128 ToR 45 % reduction 13/22 Power consumption of SPINE part (kw)

14 How to accommodate Elephant and Doggy flows into OCS and OSS Network in HOLST First, all flows are accommodated into Electrical Switching Network. If Elephant Flow is observed, then the flow is rearranged to OCS Network. If Doggy Flow is observed, then the flow is rearranged to OSS Network. Observation-based flow assignment On-line Flow Classification Application (Hadoop) triggered flow assignment 14/22

found in 256 ToRs Traffic Matrix Optimum Grouping problem is

15 Observation-based Doggy Flow assignment 8x8 Optical Switch is assumed 1 ToR can connect to 7 other ToRs ToR Groups should be found in 256 ToRs Traffic Matrix Optimum Grouping problem is NP-hard. Heuristic grouping algorithm is developed. 4 OSS planes 15/22

16 On-line Flow Classification Flow-ID management queue will be set in ToR Hierarchical Least Recently Used (LRU) queue Flow-ID and reference # of the Flow-ID (counter) are stored. If counter exceeds the threshold, the Flow-ID is moved into higher queue Thresholds and queue size are adaptively changed. MF: Mice Flow DF: Doggy Flow EF: Elephant Flow 16/22

17 Hadoop Triggered Flow Assignment Hadoop Cluster is monitored. Newly defined Shuffle Ratio is used for classification. Electrical Switch Optical Switch SDN Controller Cluster Manager detects job start Instruct flow monitoring to Traffic Monitor Traffic Monitor Calculate Shuffle-Ratio from traffic monitor and job information ToR Switch Server a Hadoop Cluster Cluster Manager 17/22 Set circuit through the SDN Controller Shuffle-Ratio is large Optical Shuffle-Ratio is small Electrical

18 HOLST PoC experiment Small HOLST PoC is constructed. 10 GE L2/L3 Switches, 16x16 MEMS Switch, 4x4 PLZT Switch Software-based OSS adapter, Software-based On-line Flow Classifier Throughput is limited due to the software-based 4x4 PLZT 16x16 MEMS OSS OSS OSS OSS フロー判定フロー判定フロー判定フロー判定 18/22

19 Optical Slot Switching in HOLST PoC Slot Size 200 ms (software) µs order (developing FPGA) Sender #1 Receiver #2,3,4 19/22

20 On-line Flow Classification in HOLST PoC ~ 100 Mbps throughput is realized by software emulation. 20/22

21 Hadoop triggered Flow Assignment in HOLST PoC In the shuffle phase, the flow is rearranged to OCS 21/22

22 Summary Optical Slot Switching becomes the hot topic technology in the optical data-center network. In case of the Hybrid DCN, flow classification is required to efficiently utilize the optical network. In the HOLST project, three flow classification methods are developing. 22/22

Optical switching for scalable and programmable data center networks

Optical switching for scalable and programmable data center networks Paraskevas Bakopoulos National Technical University of Athens Photonics Communications Research Laboratory @ pbakop@mail.ntua.gr Please