Open vswitch - architecture

Transcription

1 Ashok Emani

2

3 Open vswitch - architecture Netlink User Space vswitchd Kernel Space OVS Kernel Space Forwarding Plane Available at Main forwarding plane runs in kernel space Exception packets are sent to vswitchd in userspace using Netlink Standard Linux network interfaces to communicate with physical network

4 DPDK 2.0 INtegration Netlink PMD Driver Native OVS User Space vswitchd Kernel Space OVS Kernel Space Forwarding Plane DPDK User Space DPDK PMD Driver Kernel Space PMD Driver OVS with DPDK PMD Driver User Space vswitchd OVS User Space Forwarding Plane ace PMD Driver Kernel Space PMD Driver Integrate DPDK library into OVS Main forwarding plane runs in userspace as separate threads of vswitchd DPDK PMD to communicate with physical network Achieve near native performance when using shared memory Available as a compile time option for standard OVS

5 Open vswitch with DPDK 5

6 Manual Build, Installation and Configuration

7 Building the DPDK Target curl -O tar -xvzf dpdk tar.gz cd dpdk export DPDK_DIR=`pwd` make install T=x86_64-native-linuxapp-gcc CONFIG_RTE_BUILD_COMBINE_LIBS=y 7

8 Building OVS with DPDK git clone cd ovs export OVS_DIR=`pwd`./boot.sh./configure --with-dpdk="$dpdk_dir/x86_64-native-linuxapp-gcc/" CFLAGS="-g -Ofast" make 'CFLAGS=-g -Ofast -march=native' -j10 8

9 Configuring the Host and s for OVS DPDK Usage Configure hugepages and kernel options default_hugepagesz=1g hugepagesz=1g hugepages=16 hugepagesz=2m hugepages=2048 iommu=pt intel_iommu=on isolcpus=1-13,15-27 grub2-mkconfig -o /boot/grub2/grub.cfg reboot 9

10 mkdir -p /mnt/huge mkdir -p /mnt/huge_2mb mount -t hugetlbfs hugetlbfs /mnt/huge mount -t hugetlbfs none /mnt/huge_2mb -o pagesize=2mb Bind to DPDK (vfio) modprobe vfio-pci cp $DPDK_DIR/tools/dpdk_nic_bind.py /usr/bin/. dpdk_nic_bind.py --status dpdk_nic_bind.py --bind=vfio-pci 05:

11 Check DPDK s 11

12 Create OVS DB and Start ovsdb-server pkill -9 ovs rm -rf /usr/local/var/run/openvswitch rm -rf /usr/local/etc/openvswitch/ rm -f /usr/local/etc/openvswitch/conf.db mkdir -p /usr/local/etc/openvswitch mkdir -p /usr/local/var/run/openvswitch cd $OVS_DIR./ovsdb/ovsdb-tool create /usr/local/etc/openvswitch/conf.db./vswitchd/vswitch.ovsschema./ovsdb/ovsdb-server -- remote=punix:/usr/local/var/run/openvswitch/db.sock -- remote=db:open_vswitch,open_vswitch,manager_options --pidfile --detach./utilities/ovs-vsctl --no-wait init 12

13 Start ovs-vswitchd and configure vhost-user ports modprobe openvswitch $OVS_DIR/vswitchd/ovs-vswitchd --dpdk -c 0x2 -n 4 --socket-mem unix:/usr/local/var/run/openvswitch/db.sock --pidfile --detach $OVS_DIR/utilities/ovs-vsctl show $OVS_DIR/utilities/ovs-vsctl add-br br0 -- set bridge br0 datapath_type=netdev $OVS_DIR/utilities/ovs-vsctl add-port br0 dpdk0 -- set Interface dpdk0 type=dpdk $OVS_DIR/utilities/ovs-vsctl add-port br0 vhost-user1 -- set Interface vhost-user1 type=dpdkvhostuser $OVS_DIR/utilities/ovs-vsctl add-port br0 vhost-user2 -- set Interface vhost-user2 type=dpdkvhostuser 13

14 OVS configuration result: 14

15 Installation and Configuration using system packages

16 Installing and Configuring OVS-DPDK with packages (Ubuntu 16.04*) sudo apt-get install openvswitch-switch-dpdk sudo update-alternatives --set ovs-vswitchd /usr/lib/openvswitchswitch-dpdk/ovs-vswitchd-dpdk 16

17 Configuring Ubuntu OVS-DPDK package The OVS-DPDK package ( ovs-vswitchd-dpdk ) relies on the following config files: /etc/default/openvswitch-switch Passes in DPDK command-line options to ovs-vswitchd /etc/dpdk/dpdk.conf Configures hugepages /etc/dpdk/interfaces Configures/assigns s for DPDK use 17

18 Configuration and ovs-vswitchd process: 18

19 Configure vhost-user ports for Ubuntu OVS-DPDK sudo ovs-vsctl add-br br0 -- set bridge br0 datapath_type=netdev sudo ovs-vsctl add-port br0 vhost-user1 -- set Interface vhost-user1 type=dpdkvhostuser sudo ovs-vsctl add-port br0 vhost-user2 -- set Interface vhost-user2 type=dpdkvhostuser 19

20 Ubuntu OVS-DPDK configuration result 20

21 Using the vhost-user ports with VMs Note: Ubuntu uses /run/openvswitch/ location instead of /usr/local/var/run/openvswitch/ qemu-system-x86_64 -m smp 4 -cpu host -hda ~/f21vm1.qcow2 -boot c -enable-kvm -no-reboot -nographic -net none \ -chardev socket,id=char1,path=/usr/local/var/run/openvswitch/vhostuser1 \ -netdev type=vhost-user,id=mynet1,chardev=char1,vhostforce \ -device virtio-net-pci,mac=00:00:00:00:00:01,netdev=mynet1 \ -object memory-backend-file,id=mem,size=1024m,mempath=/dev/hugepages,share=on \ -numa node,memdev=mem -mem-prealloc 21

22 qemu-system-x86_64 -m smp 4 -cpu host -hda ~/f21vm2.qcow2 -boot c -enable-kvm -noreboot -nographic -net none \ -chardev socket,id=char1,path=/usr/local/var/run/openvswitch/vhost-user2 \ -netdev type=vhost-user,id=mynet1,chardev=char1,vhostforce \ -device virtio-net-pci,mac=00:00:00:00:00:02,netdev=mynet1 \ -object memory-backend-file,id=mem,size=1024m,mem-path=/dev/hugepages,share=on \ -numa node,memdev=mem -mem-prealloc 22

23 Use the virtio inside the VMs 23

24 Need for Optimal and Scalable NFVI

25 VNF A VNF Virtual Network Interface Options Performance VNF B VNF C VNF D VNF E Flexibility, VNF-NFVI Independence VNF F Network App Kernel Stack virtio DPDK Network App virtio DPDK Network App virtio DPDK Network App IVSHME M DPDK Network App VF PMD Network App Kernel Stack VF Driver Stock vswitch Stock vswitch DPDK vswitch DPDK vswitch Any Any SR-IOV SR-IOV vswitch Acceleration is the most optimal solution for a scalable NFVI 25

26 Need for an Efficient Data Plane for NFV NSH Forwarding NSH VXLAN-GPE Encapsulation Server A VNF1 VNF1 VNFn vswitch Server B VNF1 VNF1 VNFn vswitch L2/L3 Routing L2/L3 Forwarding Server C VNF1 VNF1 VNFn vswitch Service Chain #1 Service Chain #2 NSH: Network Services Header VNF: Virtual Network Function A Programmable, Scalable, Efficient & High Performance Data Plane is a key requirement for NFV deployments

27 Plugin (Service) Orchestrator VNF Manager Intel Open Network Platform (ONP) OSS/BSS EMS OpenStack Enhancements OVSDB Open Flow Enhancements Other vcpe vbras vepc Server App vfw vadc Open vswitch with DPDK Open vswitch with DPDK Linux OCP / Node KVM OCP Node ONP Linux OCP / Node KVM OCP Node ONP 27

28 Links and Resources DPDK Open vswitch DPDK : Intel Open Network Platform Reference Architecture: Intel Developer Zone for SDN/NFV: Intel Developer Zone for SDN/NFV: 28

29 Questions 29

30