CICN Community Information-Centric Networking

Transcription

1 CICN Community Information-Centric Networking

2 : The Universal Dataplane Project at Linux Foundation Multi-party Multi-project Software Dataplane High throughput Low Latency Feature Rich Resource Efficient Bare Metal/VM/Container Multiplatform Fd.io Scope: Network IO - NIC/vNIC <-> cores/threads Packet Processing Classify/Transform/Prioritize/Forward/Terminate Dataplane Management Agents - ControlPlane Bare Metal/VM/Container Dataplane Management Agent Packet Processing Network IO fd.io Foundation 2

3 Fd.io in the overall stack Application Layer/App Server Orchestration vicn Network Controller Dataplane Management Agent Data Plane Services Packet Processing Network IO Operation System Hardware fd.io Foundation 3

4 Multiparty: Broad Membership Service Providers Network Vendors Chip Vendors Integrators fd.io Foundation 4

5 Multiparty: Broad Contribution Yandex Qiniu Universitat Politècnica de Catalunya (UPC) fd.io Foundation 5

6 Code Activity In the period since its inception, fd.io has more commits than OVS and DPDK combined, and more contributors than OVS to Fd.io OVS DPDK Commits Contributors Organizations Commits Contributors Organizations Commits fd.io OVS DPDK Contributors fd.io OVS DPDK Organizations fd.io OVS DPDK fd.io Foundation 6

7 Multiproject: Fd.io Projects vicn Dataplane Management Agent hc2vpp Honeycomb Testing/Support CSIT Packet Processing ICNET ONE TLDK CICN odp4vpp VPP Sandbox puppet-fdio trex VPP Network IO deb_dpdk rpm_dpdk fd.io Foundation 7

8 Fd.io Integrations Openstack Neutron Integration work done at ODL Plugin Fd.io Plugin Control Plane Lispflowmapping app SFC GBP app VBD app LISP Mapping Protocol Netconf/Yang Netconf/yang REST Data Plane Honeycomb VPP Fd.io ML2 Agent fd.io Foundation 8

9 Vector Packet Processor - VPP Bare Metal/VM/Container Dataplane Management Agent Packet Processing Network IO Packet Processing Platform: High performance Linux User space Run s on commodity CPUs: / / Shipping at volume in server & embedded products since fd.io Foundation 9

10 Packet VPP Architecture: Packet Processing n Vector of n packets dpdk-input vhost-user-input af-packet-input ethernet-input Input Graph Node Graph Node Packet Processing Graph ip6-input ip4-input mpls-input arp-input ip6-lookup ip4-lookup ip6-rewrite ip6-local ip4-local ip4-rewrite ip4-rewrite

11 Packet VPP Architecture: Plugins n Hardware Plugin Vector of n packets hw-accel-input dpdk-input vhost-user-input af-packet-input ethernet-input Input Graph Node Graph Node Packet Processing Graph Skip sftw nodes where work is done by hardware already ip6-input ip6-lookup ip4-input ip4-lookup mpls-input arp-input Plugin /usr/lib/vpp_plugins/cicn-plugin.so icnfwd Plugins are: First class citizens That can: Add graph nodes Add API Rearrange the graph ip6-rewrite ip6-local ip4-local ip4-rewrite custom-2 custom-3 Can be built independently of VPP source tree

12 VPP: How does it work? 1 af-packetinput vhost-userinput dpdk-input 2 Packet 0 graph nodes are optimized to fit inside the instruction cache Packet 1 ethernetinput Packet 2 Packet 3 Packet 4 Microprocessor mpls-input lldp-input arp-input cdp-input l2-input ip4-lookup ip4-input...-nochecksum ip4-lookupmulitcast icnfwd ip6-input Packet 5 Packet 6 Packet 7 Packet 8 Packet 9 Packet Instruction Cache Data Cache mpls-policyencap ip4-rewritetransit ip4-loadbalance ip4- midchain interfaceoutput Packet processing is decomposed into a directed graph node packets moved through graph nodes in vector packets are pre-fetched, into the data cache * approx. 173 nodes in default deployment

13 VPP: How does it work? instruction cache is warm with the instructions from a single graph node while packets in vector 6 Get pointer to vector dispatch fn() 4 5 Microprocessor ethernet-input Packet 1 Packet 2 while 4 or more packets PREFETCH #3 and #4 PROCESS #1 and #2 ASSUME next_node same as last packet Update counters, advance buffers Enqueue the packet to next_node while any packets <as above but single packet> data cache is warm with a small number of packets.. packets are processed in groups of four, any remaining packets are processed on by one

14 VPP: How does it work? while packets in vector dispatch fn() 7 Get pointer to vector Microprocessor ethernet-input while 4 or more packets PREFETCH #1 and #2 PROCESS #1 and #2 ASSUME next_node same as last packet Update counters, advance buffers Packet 1 Packet 2 Enqueue the packet to next_node while any packets <as above but single packet> prefetch packets #1 and #2

15 VPP: How does it work? while packets in vector dispatch fn() 8 Get pointer to vector Microprocessor ethernet-input while 4 or more packets PREFETCH #3 and #4 PROCESS #1 and #2 ASSUME next_node same as last packet Update counters, advance buffers Packet 1 Packet 2 Packet 3 Packet 4 Enqueue the packet to next_node while any packets <as above but single packet> process packet #3 and #4 update counters, enqueue packets to the next node

16 VPP Architecture: Programmability Control Plane Protocol Architecture Request Message 900k request/s Example: vicn Model based configuration/management Request Message Linux Hosts Linux Hosts Shared Memory Shared Memory Agent Request Queue VPP vicn Request Queue CICN VPP Response Queue Response Queue Can use C/Java/Python/or Lua Language bindings Async Response Message Async Response Message fd.io Foundation 16

17 Universal Dataplane: Features Hardware Platforms Pure Userspace - X86,ARM 32/64,Power Raspberry Pi Interfaces DPDK/Netmap/AF_Packet/TunTap Vhost-user - multi-queue, reconnect, Jumbo Frame Support Language Bindings C/Java/Python/Lua Tunnels/Encaps GRE/VXLAN/VXLAN-GPE/LISP-GPE/NSH IPSEC Including HW offload when available MPLS MPLS over Ethernet/GRE Deep label stacks supported Routing IPv4/IPv6 14+ MPPS, single core Hierarchical FIBs Multimillion FIB entries Source RPF Thousands of VRFs Controlled cross-vrf lookups Multipath ECMP and Unequal Cost PIT/CS/FIB Strategy layer ICN Segment Routing SR MPLS/IPv6 Including Multicast LISP LISP xtr/rtr L2 Overlays over LISP and GRE encaps Multitenancy Multihome Map/Resolver Failover Source/Dest control plane support Map-Register/Map-Notify/RLOC-probing Switching VLAN Support Single/ Double tag L2 forwd w/efp/bridgedomain concepts VTR push/pop/translate (1:1,1:2, 2:1,2:2) Mac Learning default limit of 50k addr Bridging Split-horizon group support/efp Filtering Proxy Arp Arp termination IRB - BVI Support with RouterMac assigmt Flooding Input ACLs Interface cross-connect L2 GRE over IPSec tunnels Security Mandatory Input Checks: TTL expiration header checksum L2 length < IP length ARP resolution/snooping ARP proxy SNAT Ingress Port Range Filtering Per interface whitelists Policy/Security Groups/GBP (Classifier) Network Services DHCPv4 client/proxy DHCPv6 Proxy MAP/LW46 IPv4aas MagLev-like Load Identifier Locator Addressing NSH SFC SFF s & NSH Proxy LLDP BFD Policer Multiple million Classifiers Arbitrary N-tuple Inband ioam Telemetry export infra (raw IPFIX) ioam for VXLAN-GPE (NGENA) SRv6 and ioam co-existence ioam proxy mode / caching ioam probe and responder Monitoring Simple Port Analyzer (SPAN) IP Flow Export (IPFIX) Counters for everything Lawful Intercept fd.io Foundation 17

18 Continuous Quality, Performance, Usability Built into the development process patch by patch Submit Automated Verify Code Review Merge Publish Artifacts Build/Unit Testing 120 Tests/Patch System Functional Testing 252 Tests/Patch Performance Testing 144 Tests/Patch, 841 Tests Usability Build binary packaging for Ubuntu Ubuntu Centos 7 Automated Style Checking Unit test : IPFIX BFD Classifier DHCP FIB GRE IPv4 IPv4 IRB IPv4 multi-vrf IPv6 IP Multicast L2 FIB L2 Bridge Domain MPLS SNAT SPAN VXLAN DHCP Client and Proxy L2 Cross Connect Merge-by-merge: GRE Overlay Tunnels L2 Bridging apt installable deb packaging L2BD Ethernet Switching IPv4 Routing yum installable rpm packaging L2 Cross Connect Ethernet Switching IPv6 Routing autogenerated code documentation LISP Overlay Tunnels IPv4 Scale 20k,200k,2M FIB Entries autogenerated cli documentation IPv4-in-IPv6 Softwire Tunnels IPv4 Scale - 20k,200k,2M FIB Entries Per release: Cop Address Security VM with vhost-userr autogenerated testing reports IPSec PHYS-VPP-VM-VPP-PHYS report perf improvements IPv6 Routing NS/ND, RA, ICMPv6 L2 Cross Connect/Bridge Puppet modules urpf Security VXLAN w/l2 Bridge Domain Training/Tutorial videos Tap Interface IPv4 Routing Hands-on-usecase documentation Telemetry IPFIX and Span COP IPv4/IPv6 whiteless VRF Routed Forwarding iacl ingress IPv4/IPv6 ACLs iacl Security Ingress IPv6/IPv6/Mac LISP IPv4-o-IPv6/IPv6-o-IPv4 IPv4 Routing VXLAN QoS Policer Metering QoS Policer Merge-by-merge packaging feeds VLAN Tag Translation L2 Cross over Downstream consumer CI pipelines VXLAN Overlay Tunnels L2 Bridging fd.io Foundation 18 Run on real hardware in fd.io Performance Lab

19 Universal Dataplane: Infrastructure Bare Metal Server Cloud/NFVi Server VM VM VM Container Infra Server Con Con Con Kernel/Hypervisor Kernel/Hypervisor Kernel fd.io Foundation 19

20 Universal Dataplane: VNFs based VNFs based VNFs Server Server VM VM Con Con Kernel/Hypervisor Kernel/Hypervisor fd.io Foundation 20

21 Universal Dataplane: Embedded Embedded Device SmartNic Device Server Kernel/Hypervisor Kernel/Hypervisor Hw Accel SmartNic Hw Accel fd.io Foundation 21

22 Universal Dataplane: CICN Example Physical CICN router CICN in a VM CICN in a Container Device Server Server VM VM docker LXC Kernel/Hypervisor Hw Accel Kernel/Hypervisor Kernel/Hypervisor fd.io Foundation 22

23 Universal Dataplane: communication/api Consumer/Producer Socket API Server 23 LXC MEMIF AF-PACKET DPDK LXD Kernel/Hypervisor Nic LXC MEMIF app Socket API Segmentation/Naming Manifest management Reassembly Flow and Congestion Control Existing drivers for links DPDK AF-PACKET MEMIF (SHARED MEMORY) fd.io Foundation

24 CICN distribution Core libraries Consumer/Producer Socket API, CCNx libs, PARC C libraries Server and Router VPP cicn plugin for Ubuntu 16, CentOS 7 HTTP video server Client Metis Forwarder VIPER MPEG-DASH video player Android 7, MacOS X 10.12, ios 10, Ubuntu 16, CentOS 7 Soon Apple Store and Google Play vicn intent-based networking model driven programmable framework monitoring and streaming for BigData support

25 Opportunities to Contribute Forwarding strategies Mobility management Hardware Accelerators vicn, configuration/management/control Consumer/Producer Socket API Reliable Transport Instrumentation tools HTTP integration We invite you to Participate in fd.io Get the Code, Build the Code, Run the Cod e, install from binaries from binary packages Read/Watch the Tutorials Join the Mailing Lists Join the IRC Channels Explore the wiki Join fd.io as a member fd.io Foundation 25

26