Dataplane Networking journey in Containers

Transcription

1 Dataplane Networking journey in Gary Loughnane Kuralamudhan Ramakrishnan DPDK Summit Userspace - Dublin- 2017

2 Discussion topics Container Deployment Models Container Bare Metal Reference Architecture Container Unified Infrastructure Reference Architecture 2

3 Network Cloudification Multiple Deployment Models CLOUD NATIVE COMPUTING FOUNDATION vepc vnat VNFs vims vrouter vggsn vfirewall NFV Orchestration vcpe vrnc vhlr vsgsn vmme vids NFVi- Network SR-IOV Bare Metal Hybrid Unified 3

4 Network Cloudification Multiple Deployment Models Today Discussion Focus CLOUD NATIVE COMPUTING FOUNDATION vepc vnat VNFs vims vrouter vggsn vfirewall NFV Orchestration vcpe vrnc vhlr vsgsn vmme vids NFVi- Network SR-IOV Bare metal Unified 4

5 Address Container Networking Industry Gaps Intel NFV Reference Architectures (Experience Kits ) Identified Gaps Resolve, Integrate Communicate Compute & Networking Existing Solution MULTUS SW Contributions Demo Integration Container BM Ref. Architecture Rel. 1 Oct Container UI Ref. Architecture Rel. 1 Feb 2017 Multi-network Support SR-IOV CNI PLUGIN Open Source Projects Best Practice Guidelines Experience kits (Examples) Resource Isolation VNF MULTUS Data Plane Scale DPDK CNI PLUGIN Data Plane Support SW NODE FEATURE DISCOVERY Data Center Heterogeneity CPU MANAGER for K8s CPU Core Pinning SW EPA - CMK Kuryr NEW SOLUTIONS: WIP RESOURCE MANAGMENT NUMA Awareness Huge pages QAT 5 5

6 Network Cloudification Multiple Deployment Models Today Discussion Focus vepc vnat VNFs vims vrouter vggsn vfirewall NFV Orchestration vcpe vrnc vhlr vsgsn vmme vids NFVi- Network SR-IOV Bare metal Unified 6

7 Industry challenges in containers Bare Metal Multiple network interfaces for VNFs Support for high performance Data Plane (N-S) Support for high performance Data Plane(E-W) Ability to request/allocate platform capabilities Support for CPU Core-Pinning for K8s pods Dynamic Huge Page allocation SR-IOV VHOST USER Node Feature Discovery CPU Manager for Kubernetes Native Huge page support for Kubernetes 7 7

8 Kubernetes networks via Container Network Interface (CNI) Management Container Orchestration Engines Container Runtime Node - Environment Container Network Interface Container Network Interface Plugins 8

9 Kubernetes networks via Container Network Interface (CNI) Management Container Orchestration Engines Node - Environment Container Runtime Container Network Interface Open Source Projects Container Network Interface Plugins SR-IOV Can mix and match with CNI as the API 9

10 DPDK - SRIOV CNI Plugin PROBLEM Lack of support for physical platform resource isolation No guaranteed network IO performance No support for Data Plane Networking Kubernetes Pod Container VNF Application DPDK SOLUTION Allows SRIOV support in Kubernetes via a CNI plugin Intel contributor and maintainer of SR-IOV CNI plugin Kernel uio_pci_generic/igb_uio/vfio-pci Supports two modes of operation: SR-IOV : SR-IOV VFs are allocated to pod network namespace DPDK : SR-IOV VFs are bounded to DPDK drivers in the userspace REFERENCE VF VF VF SR-IOV Enabled Network Interface 10 10

11 Vhost user CNI Plugin PROBLEM No Container Networking with software acceleration for NFV particularly for East West Traffic Kubernetes Pod Container VNF Application DPDK SOLUTION virtio_user Virtio_user/ vhost_user gives boosted performance than VETH pairs Support VPP as well as DPDK OVS Vhost_user CNI plugin enables K8s to leverage data plane acceleration vhostuser OVS- DPDK / VPP REFERENCE eth0 NIC 11 11

12 Network Cloudification Multiple Deployment Models Today Discussion Focus CLOUD NATIVE COMPUTING FOUNDATION vepc vnat VNFs vims vrouter vggsn vfirewall NFV Orchestration vcpe vrnc vhlr vsgsn vmme vids NFVi- Network SR-IOV Bare metal Unified 12

13 Industry challenges in Nested Network performance penalties for Container in Scaling Data plane networking Kuryr- Kubernetes MASTER Multiple network interfaces for VNFs Support for CPU Core-Pinning for K8s pods CPU Manager for Kubernetes 13 13

14 Master For Enabling DPDK in Nested OBJECTIVES One Virtual Machine to many Target: 1k per Container Data Plane performance USE CASE Elasticity and scalability of containerized VNF application in Virtual Machine Kubernetes DPDK Pod Network Appliance Non DPDK Pod Socket App BSD Sockets API Layer 4 Layer 3 Layer 2 BENEFITS Virt I/O Virt I/O VT-x ring de-privileging to move the and Container into userspace, making it accessible to the userspace vswitch with just a single copy. Nova Standard Virtio interface that supports both interrupt and poll modes, VNF and Cloud based applications. Standard Vhost shared memory interface between DPDK vswitch and VNF. SOLUTIONS Enabling DPDK in containers using VIRTIO Using Kuryr Kurbernetes, orchestrate the Dataplane networking DPDK workload using the vswitch Neutron Master : Co-existence of and Virtual Machines DPDK based vswitch, independent method to accelerate the Container Data Plane

15 Kuryr Kurbernetes with Dataplane Networking with DPDK based vswitch PROBLEM (Current Status) No support for Data Plane Networking for nested containers in Unified Infrastructure RA SOLUTION (WIP) Working on the PoC for the development of DPDK net plugin support in kuryr CNI DPDK: Virtio are bounded to DPDK drivers in the userspace REFERENCE Kernel Virtual Machine virtio Kubernetes Pod Container VNF Application DPDK uio_pci_generic/igb_uio/vfio-pci virtio Neutron virtio 15 15

16 Questions? Gary Loughnane Kuralamudhan Ramakrishnan