Server virtualization

Transcription

1 Server virtualization Ankit Singla ETH Zürich P. Brighten Godfrey UIUC

2 The cloud depends on it, virtually

3 The cloud depends on it, virtually Sharing of physical infrastructure

4 The cloud depends on it, virtually Sharing of physical infrastructure Spin-up a virtual machine in seconds

5 The cloud depends on it, virtually Sharing of physical infrastructure Spin-up a virtual machine in seconds Live VM migration

6 Server virtualization VM1 VM2 VMN Hypervisor

7 Server virtualization virtual NIC VM1 VM2 VMN Hypervisor pnic Physical NIC

8 Server virtualization virtual NIC VM1 VM2 VMN Hypervisor pnic Physical NIC Physical switch pswitch

9 Networking VMs VM1 VM2 VMN virtual switch Hypervisor vsw pnic pswitch

10 Networking VMs VM1 VM2 VMN virtual switch Hypervisor vsw pnic pswitch

11 Sidenote: Docker VM1 VM2 VMN Hypervisor pnic pswitch

12 Sidenote: Docker Application VM1 OS VM2 VMN Hypervisor pnic pswitch

13 Sidenote: Docker Application Linux Container Docker pnic pswitch

14 Sidenote: Docker Application IBM Research Report, 2014 Linux pnic pswitch Container An Updated Performance Comparison of Virtual Machines and Linux Containers Wes Felter, Alexandre Ferreira, Ram Rajamony, Juan Rubio IBM Research, Austin, TX {wmf, apferrei, rajamony, Docker Within the last two years, Docker [45] has ormat, and build sys

15 Sidenote: Docker Application Linux Container Docker pnic pswitch

16 Improving networking performance VM1 VM2 VMN Hypervisor vsw pnic pswitch

17 Improving networking performance VM1 VM2 VMN CPU does the work! Hypervisor vsw pnic pswitch

18 Packet processing on CPUs Flexible

19 Packet processing on CPUs Flexible slow, CPU-expensive

20 Packet processing on CPUs Flexible slow, CPU-expensive 10Gbps, 84 Byte packets 67ns time budget

21 Packet processing on CPUs Flexible slow, CPU-expensive 10Gbps, 84 Byte packets 67ns time budget Context: CPU-memory takes tens of ns

22 Packet processing on CPUs Flexible slow, CPU-expensive

23 Packet processing on CPUs Flexible slow, CPU-expensive Packet I/O

24 Packet processing on CPUs Flexible slow, CPU-expensive Packet I/O Userspace overheads

25 Packet processing on CPUs Flexible slow, CPU-expensive Packet I/O Userspace overheads Packet classification

26 Packet processing on CPUs Flexible slow, CPU-expensive Packet I/O Userspace overheads Packet classification Progress is being made!

27 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw

28 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic

29 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic physical function

30 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic virtual function physical function

31 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic virtual function physical function

32 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic virtual function L2 sorter (switch) physical function

33 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN vsw pnic virtual function L2 sorter (switch) physical function

34 SR-IOV: Single-root I/O Virtualization VM1 VM2 VMN DMA to bypass the hypervisor! vsw pnic virtual function L2 sorter (switch) physical function

35 Open vswitch The Design and Implementation of Open vswitch Ben Pfaff, Justin Pettit, Teemu Koponen, Ethan J. Jackson, Andy Zhou, Jarno Rajahalme, Jesse Gross, Alex Wang, Jonathan Stringer, Pravin Shelar, Keith Amidon, Martín Casado VMware Awake Networks ational Systems Track USENIX NSDI, 2015

36 Open vswitch VM1 VM2 VMN Hypervisor vsw pnic pswitch

37 Open vswitch VM1 VM2 VMN user space kernel Hypervisor vsw pnic pswitch

38 Open vswitch VM1 VM2 VMN decision-making smarts user space kernel Hypervisor vsw pnic pswitch

39 Open vswitch VM1 VM2 VMN decision-making smarts user space kernel simple, fast forwarding Hypervisor vsw pnic pswitch

40 Inside Open vswitch userspace kernel

41 Inside Open vswitch userspace kernel

42 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace kernel

43 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace kernel

44 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace kernel srcmac dstmac dstip dsttcpport action

45 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace kernel srcmac dstmac dstip dsttcpport action

46 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace kernel srcmac dstmac dstip dsttcpport action

47 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace cache hash-key flow-table-entry kernel srcmac dstmac dstip dsttcpport action

48 Inside Open vswitch srcmac dstmac action dstip dsttcpport action userspace cache hash-key flow-table-entry kernel srcmac dstmac dstip dsttcpport action hash-key = hash (srcmac, dstmac, dstip, dsttcpport)

49 Inside Open vswitch CPU Load (%) Kernel misses / second [The Design and Implementation of Open vswitch. Pfaff et. al, USENIX NSDI 2015]