Enabling innovation in the Internet: Main Achievements of the CHANGE Project. Felipe Huici, NEC Europe

Transcription

1 Enabling innovation in the Internet: Main Achievements of the CHANGE Project Felipe Huici, NEC Europe

2 EU FP7 CHANGE Project Info: Start in Oct. 2010, will end in December 2013 Partner Eurescom (Prime Contractor) NEC Europe Ltd. (Technical Coordinator) Deutsche Telekom University College London Lancaster University Université catholique de Louvain Technische Universität Berlin Universitatea Politehnica Bucuresti Dreamlab Technologies Nextworks Universita` di Pisa Country Germany UK Germany UK UK Belgium Germany Romania Switzerland Italy Italy 2

3 Architecture Overview Platform A Platform B flow A flow B Platform C Platform D 3

4 Talk Outline Platform requirements Platform technologies Netmap Fast framework for packet I/O VALE Fast software switch built on the netmap framework ClickOS Virtualized flow processing platform leveraging netmap/vale Other CHANGE achievements 4

5 Building a Platform - Requirements Isolation High throughput, low delay High consolidation Fast instantiation Scalability Flexibility, Ease of Development 5

6 NETMAP work by Luigi Rizzo and colleagues at Pisa University 6

7 Overview Direct access to NIC from user-level Secure Can t overwrite other memory Can t crash kernel No reliance on HW features Efficient Batching to amortize costs (syscall) Remove unnecessary work (copies,frees) Open source Application netmap kernel HW 7

8 A 10Gb/s Packet Generator 8

9 Performance 64-byte Packets Tx Rate (Mpps) cores 1 core pktgen netsend Clock speed (GHz) 9

10 VALE work by Luigi Rizzo and colleagues at Pisa University 10

11 Overview process guest vmm netmap API VALE bridge host Open source 11

12 Performance Forwarding rate (Mpps) VALE, 60 bytes NIC, 60 bytes VALE, 1514 bytes NIC, 1514 bytes TAP, 60 bytes Receive ports 12

13 CLICKOS 13

14 The Idealized Network Application Application Transport Transport Network Network Network Datalink Datalink Datalink Datalink Physical Physical Physical Physical 14

15 A Middlebox World ad insertion WAN accelerator BRAS carrier-grade NAT transcoder session border controller IDS DDoS protection load balancer firewall QoE monitor DPI 15

16 Hardware Middleboxes - Drawbacks Middleboxes are useful, but l Expensive l Difficult to add new features, lock-in l Difficult to manage l Cannot be scaled with demand l Cannot share a device among different tenants l Hard for new players to enter market Clearly shifting middlebox processing to a software-based, multitenant platform would address these issues l But can it be built using commodity hardware while still achieving high performance? ClickOS: tiny Xen-based virtual machine that runs Click 16

17 Xen Background - Overview dom0 domu domu domu domu apps apps apps apps apps guest OS guest OS guest OS guest OS guest OS paravirt paravirt paravirt paravirt paravirt dom0 interface hypervisor hardware 17

18 Xen Background Split Driver Model 18

19 ClickOS - Contributions domu apps ClickOS Click guest OS mini OS paravirt paravirt Work consisted of l Build system to create ClickOS images (5 MB in size) l Emulating a Click control plane over MiniOS/Xen l Optimizations to reduce boot times (30 miliseconds) l Optimizations to the data plane (10 Gb/s and higher) 19

20 Xen I/O Subsystem and Bottlenecks pkt size (bytes) 10Gb rate Mp/s Mp/s Mp/s Mp/s Mp/s Kp/s Driver Domain (e.g., dom0) ClickOS Domain NW driver Linux/OVS bridge netback Xen bus/store netfront Click vif Event channel FromNetfront ToNetfront Xen ring API (data) 300 Kp/s 350 Kp/s 225 Kp/s 20

21 Optimized Xen I/O Driver Domain (e.g., dom0) ClickOS Domain NW driver Linux/OVS VALE bridge netback vif Xen bus/store Xen bus/store Event Event channel channel Netmap Xen ring API API (data) (data) netfront Click FromNetfront ToNetfront 21

22 ClickOS Performance Single Core Rx Tx 22

23 Scaling Out Multiple VMs Tx 23

24 Chaining 24

25 Scaling out Multiple NICs/VMs 25

26 ClickOS VM and middlebox Boot time 220 milliseconds 30 milliseconds 26

27 ClickOS Delay vs. Other Systems 27

28 ClickOS (virtualized) Middlebox Performance 28

29 A Few Other CHANGE Technologies PLATFORM Optimization of KVM/QEMU FlowOS, a system for optimized, stream-based network processing ARCHITECTURE Symnet: static checking for stateful networks OTHER Work on CDN-ISP collaboration to optimize content delivery Work on eliminating routing loops Multipath-TCP 29

30 This work was partly funded by the EU FP7 CHANGE (257422) project 30