Open vswitch in Neutron

Transcription

1 Open vswitch in Neutron Performance Challenges and Hardware Offload Date: Hong Kong, 6th Nov Authors: Yongsheng Gong Bo Liang 1

2 197 Deployments Hyper-V 5% Nicira 5% Brocade 3% big switch 2% NEC 2% Source Reference: openstack-user-committee-update-and-survey-results 2

3 Agendas 1 Open vswitch usages in Neutron 2 Open vswitch & Openflow 3 Problem Statement 4 Acceleration Solutions 3

4 Open vswitch usages in Neutron 4

5 Popular Deployment Public Switch /24 CONTROLLER KEYSTONE NOVA-COMPONENTS GLANCE NEUTRON-SERVER CINDER NETWORK NODE OVS-AGENT DHCP-AGENT L3-AGENT METADATA-AGENT COMPUTE NODE NOVA-COMPUTE OVS-AGENT OVS OVS Private Switch /24 5

6 VM Traffic Path COMPUTE NODE COMPUTE NODE COMPUTE NODE OVS OVS phynet gre OVS phynet gre phynet gre 6

7 VLAN Bridges eth1 vlan100 eth1 veth br-eth1 br-eth1 (veth) qr-c0bfa11f-ce(tag=1) tap99c710cc-ce(tag=1) tapcfbfc01f-a1(tag=1) tapa98bfce2c-11(tag=1) qg-9c24ade1c0-c br-ex eth Router 7

8 GRE Bridges br-tun eth gre-2(remote_ip= ) gre-2(remote_ip= ) patch-int (peer=patch-tun) patch-int (peer=patch-tun) patch-int (peer=patch-tun) patch-int (peer=patch-tun) br-ex eth1 qr-c0bfa11f-ce(tag=1) tap99c710cc-ce(tag=1) tapcfbfc01f-a1(tag=1) tapa98bfce2c-11(tag=1) qg-9c24ade1c0-c Router eth br-tun

9 Neutron Workflow 1 Start Neutron-Server dnsmasq set gateway gives ip: Start Open vswitch Agent VM1 3 Start L3-Agent QDHCP 4 Start DHCP-Agent BR-INT BR-EX 5 Start METADATA-Agent QROUTER 6 Create Networks OVS BR-TUN 7 Create Routers 8 Boot VMs ETH1 ETH2 9

10 GRE Tunnel Host1 Tunnel 1-2 Host2 Tunnel 1-3 Tunnel 2-3 Host3 10

11 Open vswitch & Openflow 11

12 Open vswitch & Openflow OVS ovsdb Secure Channel Openflow Protocol Openflow Controller BR L2 switching: in_port=*,actions=output:7 Broadcast: in_port=1,actions=output:flood packet packet packet incoming packet packet packet packet incoming packet packet 12

13 1 Patch in port Flow Tables with L2 Population Table 10 dl_dst=00:00:00:00:00:00/01:00:00:00:00:00 Table 20 LEARN_FROM_TUN UCAST_TO_TUN Table 1 in_port=1 PATCH_LV_TO_TUN Table 2 GRE_TUN_TO_LV in_port=2 Table 0 dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 Table 21 FLOOD_TO_TUN ovs bridge br-tun 2 GRE Tunnel Port 13

14 Problem Statement 14

15 GRE Head OUTER IP HEADER GRE HEADER INNER IP HEADER PAYLOAD C K S Reserved VER Protocol Checksum Reserved Key Sequence Number HTTP Server MTU Compatible Problem 15

16 MTU Comparison mtu1400 mtu

17 GRE Tunnel Extensibility Tunnels: N

18 Flow Match First Packet Subsequent user space Source Destination kernel 18

19 Improved Architecture COMPUTE NODE COMPUTE NODE COMPUTE NODE OVS/LinuxBridge phynet OVS/LinuxBridge phynet OVS/LinuxBridge phynet A Switch Running OVS Tunnel Between Switchs A Switch Running OVS phynet phynet phynet OVS/LinuxBridge COMPUTE NODE OVS/LinuxBridge COMPUTE NODE OVS/LinuxBridge COMPUTE NODE 19

20 Other Solutions Flow Matching DPDK, PF_RING, netmap GRE Tunnel VxLAN 20

21 OVS Hardware Comparison ovs 21 centec v330

22 OVS Debugging Tips Test basic connectivity Use tcpdump to see if expected packets are on the wire Try it without OVS Use ovs-ofctl dump-flows bridge to see if packets hit the flows 22

23 Thanks That s all for today Date: Hong Kong, 6th Nov Authors: Yongsheng Gong, Bo Liang 23