Kata Containers The way to run virtualized containers. Sebastien Boeuf, Linux Software Engineer Intel Corporation

Size: px
Start display at page:

Download "Kata Containers The way to run virtualized containers. Sebastien Boeuf, Linux Software Engineer Intel Corporation"

Transcription

1 Kata Containers The way to run virtualized containers Sebastien Boeuf, Linux Software Engineer Intel Corporation

2

3 Containers 101 Process Process Process namespaces namespaces namespaces Host Linux kernel CPU Memory Network Storage

4 Software is not enough! Process Process Process namespaces namespaces namespaces Host Linux kernel CPU Memory Network Storage

5

6 Manual isolation Process Process Process Process Process Process namespaces namespaces namespaces namespaces namespaces namespaces Linux kernel Linux kernel Baremetal server

7

8 Kata Containers legacy Intel Clear Containers * May 2015 Dec 2017 *Other names and brands may be claimed as the property of others.

9 Kata Containers 101 Process Process Process namespaces namespaces namespaces Guest Linux kernel Guest Linux kernel Guest Linux kernel HW virtualization HW virtualization HW virtualization Host Linux kernel

10

11 Container ecosystem OpenStack Docker OCI runc Process Container

12 Container ecosystem Kubernetes CRI OCI runc Process Container

13 Container ecosystem OpenStack Kubernetes Docker CRI OCI runc Process Container

14 Seamless integration OpenStack Kubernetes Docker CRI Process OCI kata-runtime Container Guest Linux kernel

15 Architecture OCI command I/O Shim Shim Runtime Agent proc proc ns ns Guest Linux kernel grpc grpc Proxy Hypervisor grpc over Yamux Hypervisor serial interface

16

17 Architecture over VSOCK I/O OCI command Shim Shim Runtime Agent proc proc ns ns Guest Linux kernel grpc grpc Hypervisor Hypervisor VSOCK interface

18 OCI lifecycle

19 OCI Lifecycle - run kata-runtime run Runtime

20 OCI Lifecycle - run Runtime Guest Linux kernel Start Hypervisor

21 OCI Lifecycle - run Runtime Agent Guest Linux kernel listen to serial Hypervisor

22 OCI Lifecycle - run Runtime Start proxy Proxy Agent Guest Linux kernel Hypervisor

23 OCI Lifecycle - run Runtime Agent Guest Linux kernel Proxy connect Hypervisor

24 OCI Lifecycle - run Runtime Agent Guest Linux kernel connection established Proxy Hypervisor

25 OCI Lifecycle - run proc Runtime run container Proxy Agent ns Guest Linux kernel Hypervisor

26 OCI Lifecycle - run proc Shim start shim Runtime Agent ns Guest Linux kernel Proxy Hypervisor

27 OCI Lifecycle - run I/O Signals proc Shim Agent ns Guest Linux kernel Proxy Hypervisor

28 OCI Lifecycle - exec I/O Signals kata-runtime exec proc Shim Runtime Agent ns Guest Linux kernel Proxy Hypervisor

29 OCI Lifecycle - exec I/O proc Shim Runtime Agent proc ns Guest Linux kernel exec process Proxy Hypervisor

30 OCI Lifecycle - exec I/O proc Shim Shim Runtime Agent proc ns start shim Guest Linux kernel Proxy Hypervisor

31 OCI Lifecycle - exec I/O proc Shim Shim Agent proc ns Guest Linux kernel Proxy Hypervisor

32 More than just OCI Native CRI frakti OCI runtime kata-runtime Kata API Hypervisor Qemu K Xen Network Device CNM CNI block MACV TAP TC mirror SR-IOV Storage vfio block 9p virtcontainers

33

34 OCI compatibility Agent kata-runtime OCI spec libcontainer

35 Lightweight - NVDIMM/DAX 1 2 Guest kernel Guest kernel DAX DAX NVDIMM NVDIMM Host Shared/RO ROOTFS

36 Lightweight - KSM Host Hypervisor 1 pages Merged pages KSM 2 pages

37 Fast - Templating Pool template template template Runtime Guest kernel 1 vcpu 128 MiB RAM

38 Fast - Hotplug Runtime Guest kernel 1 vcpu 128 MiB RAM

39 Fast - Hotplug Runtime Hotplug Guest kernel 3 vcpu 1024 MiB RAM PCI devices

40 Devices - virtio QEMU container Block device emulation /dev/sda Guest kernel virtio-scsi front-end virtio-scsi back-end Host Linux kernel

41 Devices - virtio container eth0 Guest kernel virtio-net front-end vhost-net back-end emulation Host Linux kernel

42 Devices - HW passthrough container eth0 Guest kernel ixgbe driver Host Linux kernel vfio-pci NIC

43 Devices - SR-IOV bonus 1 2 container container eth0 eth0 Guest kernel Guest kernel ixgbe driver ixgbe driver Host Linux kernel vfio-pci NIC PF VF1 VF2 VFN

44 Network - Macvtap Container netns vhost-net veth pair MACVTAP

45 Network - Traffic control Container netns vhost-net TAP veth pair TC mirroring

46 Storage - 9p Host Filesystem container rootfs volumes Guest kernel Coldplug virtio-9p

47 Storage - blk container Block device rootfs volumes Guest kernel Hotplug virtio-blk virtio-scsi

48 Host namespaces Network ns PID ns shim proc Agent shim proc ns Guest Linux kernel

49

50 Multi OS container container container linux GPU module linux-4.16 linux-3.14 Host Linux kernel GPU

51 Time to wrap up!

52 Time to wrap up!

53 Time to wrap up!

54 Play & contribute! Sources: Get started: loper-guide.md Slack: katacontainers.slack.com IRC: Mailing list:

The speed of containers, the security of VMs

The speed of containers, the security of VMs * The speed of containers, the security of VMs Xu Wang, Hyper Samuel Ortiz, Intel *Other names and brands may be claimed as the property of others. Contents Project

More information

The speed of containers, the security of VMs. KataContainers.io

The speed of containers, the security of VMs. KataContainers.io * The speed of containers, the security of VMs KataContainers.io Contents Project Overview Technical Details Governance Get Involved History Intel Clear Containers * May 2015 Dec 2017 *Other names and

More information

Unified Kubernetes CRI runtimes based on Kata Containers. Xu Wang hyper.sh

Unified Kubernetes CRI runtimes based on Kata Containers. Xu Wang hyper.sh Unified Kubernetes CRI runtimes based on Kata s Xu Wang (@gnawux) hyper.sh Agenda Kubernetes CRI Deep Dive The Current CRI Implementations CRI and Kata s A Brief History of K8S CRI Once upon a time rkt

More information

How Container Runtimes matter in Kubernetes?

How Container Runtimes matter in Kubernetes? How Container Runtimes matter in Kubernetes? Kunal Kushwaha NTT OSS Center About me Works @ NTT Open Source Software Center Contributes to containerd and other related projects. Docker community leader,

More information

Red Hat Enterprise Virtualization Hypervisor Roadmap. Bhavna Sarathy Senior Technology Product Manager, Red Hat

Red Hat Enterprise Virtualization Hypervisor Roadmap. Bhavna Sarathy Senior Technology Product Manager, Red Hat Red Hat Enterprise Virtualization Hypervisor Roadmap Bhavna Sarathy Senior Technology Product Manager, Red Hat RHEV Hypervisor 1 RHEV Hypervisor Themes & 2 Architecture & Use cases 3 Q&A 4 Future 5 } HYPERVISOR

More information

A Userspace Packet Switch for Virtual Machines

A Userspace Packet Switch for Virtual Machines SHRINKING THE HYPERVISOR ONE SUBSYSTEM AT A TIME A Userspace Packet Switch for Virtual Machines Julian Stecklina OS Group, TU Dresden jsteckli@os.inf.tu-dresden.de VEE 2014, Salt Lake City 1 Motivation

More information

SR-IOV support in Xen. Yaozu (Eddie) Dong Yunhong Jiang Kun (Kevin) Tian

SR-IOV support in Xen. Yaozu (Eddie) Dong Yunhong Jiang Kun (Kevin) Tian SR-IOV support in Xen Yaozu (Eddie) Dong (Eddie.Dong@intel.com) Yunhong Jiang Kun (Kevin) Tian Agenda SR-IOV specification overview Xen/SR-IOV architecture Discussions 2 SR-IOV specification overview Start

More information

Intel Clear Containers. Amy Leeland Program Manager Clear Linux, Clear Containers And Ciao

Intel Clear Containers. Amy Leeland Program Manager Clear Linux, Clear Containers And Ciao Intel Clear Containers Amy Leeland Program Manager Clear Linux, Clear Containers And Ciao Containers are... Speedy Fast create, update and uninstall cycle. Request and provision in (milli)seconds Manageable

More information

Container Adoption for NFV Challenges & Opportunities. Sriram Natarajan, T-Labs Silicon Valley Innovation Center

Container Adoption for NFV Challenges & Opportunities. Sriram Natarajan, T-Labs Silicon Valley Innovation Center Container Adoption for NFV Challenges & Opportunities Sriram Natarajan, T-Labs Silicon Valley Innovation Center Virtual Machine vs. Container Stack KVM Container-stack Libraries Guest-OS Hypervisor Libraries

More information

Bringing Security and Multitenancy. Lei (Harry) Zhang

Bringing Security and Multitenancy. Lei (Harry) Zhang Bringing Security and Multitenancy to Kubernetes Lei (Harry) Zhang About Me Lei (Harry) Zhang #Microsoft MVP in cloud and datacenter management though I m a Linux guy :/ Previous: VMware, Baidu Feature

More information

Dataplane Networking journey in Containers

Dataplane Networking journey in Containers Dataplane Networking journey in Gary Loughnane gary.loughnane@intel.com Kuralamudhan Ramakrishnan kuralamudhan.ramakrishnan@intel.com DPDK Summit Userspace - Dublin- 2017 Discussion topics Container Deployment

More information

Virtio 1 - why do it? And - are we there yet? Michael S. Tsirkin Red Hat

Virtio 1 - why do it? And - are we there yet? Michael S. Tsirkin Red Hat Virtio 1 - why do it? And - are we there yet? 2015 Michael S. Tsirkin Red Hat 1 Uses material from https://lwn.net/kernel/ldd3/ Gcompris, tuxpaint Distributed under the Creative commons license. Lots of

More information

ViryaOS RFC: Secure Containers for Embedded and IoT. A proposal for a new Xen Project sub-project

ViryaOS RFC: Secure Containers for Embedded and IoT. A proposal for a new Xen Project sub-project ViryaOS RFC: Secure Containers for Embedded and IoT A proposal for a new Xen Project sub-project Stefano Stabellini @stabellinist The problem Package applications for the target Contain all dependencies

More information

KVM on POWER Status update & IO Architecture

KVM on POWER Status update & IO Architecture KVM on POWER Status update & IO Architecture Benjamin Herrenschmidt benh@au1.ibm.com IBM Linux Technology Center November 2012 Linux is a registered trademark of Linus Torvalds. Reminders 2 different virtualization

More information

Accelerating NVMe I/Os in Virtual Machine via SPDK vhost* Solution Ziye Yang, Changpeng Liu Senior software Engineer Intel

Accelerating NVMe I/Os in Virtual Machine via SPDK vhost* Solution Ziye Yang, Changpeng Liu Senior software Engineer Intel Accelerating NVMe I/Os in Virtual Machine via SPDK vhost* Solution Ziye Yang, Changpeng Liu Senior software Engineer Intel @optimistyzy Notices & Disclaimers Intel technologies features and benefits depend

More information

Runtime VM Protection By Intel Multi-Key Total Memory Encryption (MKTME)

Runtime VM Protection By Intel Multi-Key Total Memory Encryption (MKTME) Runtime VM Protection By Intel Multi-Key Total Memory Encryption (MKTME) Kai Huang @ Intel Corporation LINUXCON + CONTAINERCON + CLOUDOPEN Beijing, China, 2018 1 Legal Disclaimer No license (express or

More information

Introduction to Virtualization and Containers Phil Hopkins

Introduction to Virtualization and Containers Phil Hopkins Introduction to Virtualization and Containers Phil Hopkins @twitterhandle Virtualization What is it? Introduction to Virtualization and Containers What the heck is a hypervisor? Why are there so many of

More information

Cisco UCS Manager VM-FEX for KVM CLI Configuration Guide, Release 3.2

Cisco UCS Manager VM-FEX for KVM CLI Configuration Guide, Release 3.2 Cisco UCS Manager VM-FEX for KVM CLI Configuration Guide, Release 3.2 First Published: 2017-08-18 Americas Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 USA http://www.cisco.com

More information

Virtual switching technologies and Linux bridge

Virtual switching technologies and Linux bridge Virtual switching technologies and Linux bridge Toshiaki Makita NTT Open Source Software Center Today's topics Virtual switching technologies in Linux Software switches (bridges) in Linux Switching technologies

More information

Virtio-blk Performance Improvement

Virtio-blk Performance Improvement Virtio-blk Performance Improvement Asias He , Red Hat Nov 8, 2012, Barcelona, Spain KVM FORUM 2012 1 Storage transport choices in KVM Full virtualization : IDE, SATA, SCSI Good guest

More information

Next Generation Tools for container technology. Dan

Next Generation Tools for container technology. Dan Next Generation Tools for container technology Dan Walsh @rhatdan Please Stand Please read out loud all text in RED I Promise To say Container Registries Rather than Docker registries I Promise To say

More information

Achieve Low Latency NFV with Openstack*

Achieve Low Latency NFV with Openstack* Achieve Low Latency NFV with Openstack* Yunhong Jiang Yunhong.Jiang@intel.com *Other names and brands may be claimed as the property of others. Agenda NFV and network latency Why network latency on NFV

More information

Datacenter Network Solutions Group

Datacenter Network Solutions Group 1 Enabling NFV features in kubernetes IVAN COUGHLAN IVAN.COUGHLAN@INTEL.COM Software Architect Kuralamudhan Ramakrishnan kuralamudhan.ramakrishnan@intel.com Senior Software Engineer Data Center Network

More information

Container Security and new container technologies. Dan

Container Security and new container technologies. Dan Container Security and new container technologies Dan Walsh @rhatdan Please Stand Please read out loud all text in RED I Promise To say Container Registries Rather than Docker registries I Promise To say

More information

KVM PERFORMANCE OPTIMIZATIONS INTERNALS. Rik van Riel Sr Software Engineer, Red Hat Inc. Thu May

KVM PERFORMANCE OPTIMIZATIONS INTERNALS. Rik van Riel Sr Software Engineer, Red Hat Inc. Thu May KVM PERFORMANCE OPTIMIZATIONS INTERNALS Rik van Riel Sr Software Engineer, Red Hat Inc. Thu May 5 2011 KVM performance optimizations What is virtualization performance? Optimizations in RHEL 6.0 Selected

More information

Spring 2017 :: CSE 506. Introduction to. Virtual Machines. Nima Honarmand

Spring 2017 :: CSE 506. Introduction to. Virtual Machines. Nima Honarmand Introduction to Virtual Machines Nima Honarmand Virtual Machines & Hypervisors Virtual Machine: an abstraction of a complete compute environment through the combined virtualization of the processor, memory,

More information

COSC6376 Cloud Computing Lecture 15: IO Virtualization

COSC6376 Cloud Computing Lecture 15: IO Virtualization COSC6376 Cloud Computing Lecture 15: IO Virtualization Instructor: Weidong Shi (Larry), PhD Computer Science Department University of Houston IOV Outline PCI-E Sharing Terminology System Image 1 Virtual

More information

KVM Weather Report. Amit Shah SCALE 14x

KVM Weather Report. Amit Shah SCALE 14x KVM Weather Report amit.shah@redhat.com SCALE 14x Copyright 2016, Licensed under the Creative Commons Attribution-ShareAlike License, CC-BY-SA. Virtualization Stack Virtualization Stack 3 QEMU Creates

More information

Accelerating Contrail vrouter

Accelerating Contrail vrouter WHITE PAPER Accelerating Contrail vrouter WHEN DEPLOYED WITH THE JUNIPER NETWORKS CONTRAIL CLOUD NETWORKING PLATFORM, THE NETRONOME AGILIO VROUTER SOLUTION DELIVERS ACCELERATED PERFORMANCE THAT ENABLES

More information

High Performance Containers. Convergence of Hyperscale, Big Data and Big Compute

High Performance Containers. Convergence of Hyperscale, Big Data and Big Compute High Performance Containers Convergence of Hyperscale, Big Data and Big Compute Christian Kniep Technical Account Manager, Docker Brief Recap of Container Technology Brief History of Container Technology

More information

DPDK Summit 2016 OpenContrail vrouter / DPDK Architecture. Raja Sivaramakrishnan, Distinguished Engineer Aniket Daptari, Sr.

DPDK Summit 2016 OpenContrail vrouter / DPDK Architecture. Raja Sivaramakrishnan, Distinguished Engineer Aniket Daptari, Sr. DPDK Summit 2016 OpenContrail vrouter / DPDK Architecture Raja Sivaramakrishnan, Distinguished Engineer Aniket Daptari, Sr. Product Manager CONTRAIL (MULTI-VENDOR) ARCHITECTURE ORCHESTRATOR Interoperates

More information

1. What is Cloud Computing (CC)? What are the Pros and Cons of CC? Technologies of CC 27

1. What is Cloud Computing (CC)? What are the Pros and Cons of CC? Technologies of CC 27 1. What is Cloud Computing (CC)? 3 1.1. Utility Computing First 3 1.2. The New Features of Cloud Computing (CC) 4 1.3. Cloud Service Provider (CSP) 6 1.3.1 Thin Provisioning 7 1.4. CC via a CSP (not via

More information

Changpeng Liu. Senior Storage Software Engineer. Intel Data Center Group

Changpeng Liu. Senior Storage Software Engineer. Intel Data Center Group Changpeng Liu Senior Storage Software Engineer Intel Data Center Group Legal Notices and Disclaimers Intel technologies features and benefits depend on system configuration and may require enabled hardware,

More information

KVM Weather Report. Red Hat Author Gleb Natapov May 29, 2013

KVM Weather Report. Red Hat Author Gleb Natapov May 29, 2013 KVM Weather Report Red Hat Author Gleb Natapov May 29, 2013 Part I What is KVM Section 1 KVM Features KVM Features 4 KVM features VT-x/AMD-V (hardware virtualization) EPT/NPT (two dimensional paging) CPU/memory

More information

Dan Williams Networking Services, Red Hat

Dan Williams Networking Services, Red Hat Networking Containers with Kubernetes and OpenShift Dan Williams Networking Services, Red Hat Kubernetes Components Web UI Pod apiserver etcd Container 1 Container 2 scheduler controller Command-line interface

More information

PCI SR-IOV on FreeBSD. Ryan Stone

PCI SR-IOV on FreeBSD. Ryan Stone PCI SR-IOV on FreeBSD Ryan Stone rstone@freebsd.org Performing I/O from a VM I/O is through (para-)virtualized devices implemented in the hypervisor Additional load on host; less CPU available to guests

More information

Virtualization and Performance

Virtualization and Performance Virtualization and Performance Network Startup Resource Center www.nsrc.org These materials are licensed under the Creative Commons Attribution-NonCommercial 4.0 International license (http://creativecommons.org/licenses/by-nc/4.0/)

More information

How to abstract hardware acceleration device in cloud environment. Maciej Grochowski Intel DCG Ireland

How to abstract hardware acceleration device in cloud environment. Maciej Grochowski Intel DCG Ireland How to abstract hardware acceleration device in cloud environment Maciej Grochowski Intel DCG Ireland Outline Introduction to Hardware Accelerators Intel QuickAssist Technology (Intel QAT) as example of

More information

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4

Cloud & container monitoring , Lars Michelsen Check_MK Conference #4 Cloud & container monitoring 04.05.2018, Lars Michelsen Some cloud definitions Applications Data Runtime Middleware O/S Virtualization Servers Storage Networking Software-as-a-Service (SaaS) Applications

More information

KVM 在 OpenStack 中的应用. Dexin(Mark) Wu

KVM 在 OpenStack 中的应用. Dexin(Mark) Wu KVM 在 OpenStack 中的应用 Dexin(Mark) Wu Agenda Overview CPU Memory Storage Network Architecture Overview nova-api REST API nova-scheduler nova-conductor nova-compute DB RPC Call libvirt driver libvirt Cinder

More information

DPDK Summit China 2017

DPDK Summit China 2017 DPDK Summit China 2017 2 DPDK in container Status Quo and Future Directions Jianfeng Tan, June 2017 3 LEGAL DISCLAIMER No license (express or implied, by estoppel or otherwise) to any intellectual property

More information

VDPA: VHOST-MDEV AS NEW VHOST PROTOCOL TRANSPORT

VDPA: VHOST-MDEV AS NEW VHOST PROTOCOL TRANSPORT VDPA: VHOST-MDEV AS NEW VHOST PROTOCOL TRANSPORT CUNMING(Steve) LIANG, Intel cunming.liang AT intel.com KVM Forum 2018, Edinburgh October, 2018 Background KVM Forum 2018 / Edinburg / 2018 Intel Corporation

More information

I/O and virtualization

I/O and virtualization I/O and virtualization CSE-C3200 Operating systems Autumn 2015 (I), Lecture 8 Vesa Hirvisalo Today I/O management Control of I/O Data transfers, DMA (Direct Memory Access) Buffering Single buffering Double

More information

Passthrough in QEMU/KVM on Linux

Passthrough in QEMU/KVM on Linux Passthrough in QEMU/KVM on Linux G. Lettieri 2 Nov. 2017 Let see how hardware passthrough can be used in practice, using the QEMU hypervisor with the KVM API on Linux. We assume Intel hardware throughout

More information

Using SR-IOV on OpenStack

Using SR-IOV on OpenStack Proceedings of NetDev 1.1: The Technical Conference on Linux Networking (February 10th-12th 2016. Seville, Spain) Using SR-IOV on OpenStack Alexander Duyck www.mirantis.com Agenda Proceedings of NetDev

More information

State of Containers. Convergence of Big Data, AI and HPC

State of Containers. Convergence of Big Data, AI and HPC State of Containers Convergence of Big Data, AI and HPC Technology ReCap Comparison of Hypervisor and Container Virtualization VM1 VM2 appa appb Userland Userland Kernel Kernel Operational Abstraction

More information

Userspace NVMe Driver in QEMU

Userspace NVMe Driver in QEMU Userspace NVMe Driver in QEMU Fam Zheng Senior Software Engineer KVM Form 2017, Prague About NVMe Non-Volatile Memory Express A scalable host interface specification like SCSI and virtio Up to 64k I/O

More information

Replacing Docker With Podman. By Dan

Replacing Docker With Podman. By Dan Replacing Docker With Podman By Dan Walsh @rhatdan dnf install -y podman dnf install -y podman alias docker=podman Questions Blog: https://podman.io/blogs Github: https://github.com/projectatomic/libpod

More information

Course Review. Hui Lu

Course Review. Hui Lu Course Review Hui Lu Syllabus Cloud computing Server virtualization Network virtualization Storage virtualization Cloud operating system Object storage Syllabus Server Virtualization Network Virtualization

More information

Convergence of VM and containers orchestration using KubeVirt. Chunfu Wen

Convergence of VM and containers orchestration using KubeVirt. Chunfu Wen Convergence of VM and containers orchestration using KubeVirt Chunfu Wen chwen@redhat.com Agenda Context Introduction What Is Kubevirt And How It Feel Kubevirt Architecture And Design Demo FIRST A LITTLE

More information

Deploy the ASAv Using KVM

Deploy the ASAv Using KVM You can deploy the ASAv using the Kernel-based Virtual Machine (KVM). About ASAv Deployment Using KVM, on page 1 Prerequisites for the ASAv and KVM, on page 2 Prepare the Day 0 Configuration File, on page

More information

Introduction to the Cisco ASAv

Introduction to the Cisco ASAv Hypervisor Support The Cisco Adaptive Security Virtual Appliance (ASAv) brings full firewall functionality to virtualized environments to secure data center traffic and multitenant environments. You can

More information

INSTALLATION RUNBOOK FOR Netronome Agilio OvS. MOS Version: 8.0 OpenStack Version:

INSTALLATION RUNBOOK FOR Netronome Agilio OvS. MOS Version: 8.0 OpenStack Version: INSTALLATION RUNBOOK FOR Netronome Agilio OvS Product Name: Agilio OvS Driver Version: 2.2-r4603 MOS Version: 8.0 OpenStack Version: Liberty Product Type: Network Offload Driver 1. Introduction 1.1 Target

More information

Accelerating vrouter Contrail

Accelerating vrouter Contrail WHITE PAPER Accelerating vrouter Contrail A VIRTUAL ROUTER (VROUTER) IS A SOFTWARE ONLY IMPLEMENTATION OF LAYER 3 INTERNET PROTOCOL (IP) ROUTING. ROUTING FUNCTIONS THAT ARE TRADITIONALLY DELIVERED AS DEDICATED

More information

Accelerating VM networking through XDP. Jason Wang Red Hat

Accelerating VM networking through XDP. Jason Wang Red Hat Accelerating VM networking through XDP Jason Wang Red Hat Agenda Kernel VS userspace Introduction to XDP XDP for VM Use cases Benchmark and TODO Q&A Kernel Networking datapath TAP A driver to transmit

More information

A Brief Guide to Virtual Switching Franck Baudin (Red Hat) Billy O Mahony (Intel)

A Brief Guide to Virtual Switching Franck Baudin (Red Hat) Billy O Mahony (Intel) A Brief Guide to Virtual Switching Franck Baudin (Red Hat) Billy O Mahony (Intel) vswitching: Different Use Cases Enterprise Data Center Manageability Console Telco Network Infrastructure Larger Packet

More information

Changpeng Liu, Cloud Software Engineer. Piotr Pelpliński, Cloud Software Engineer

Changpeng Liu, Cloud Software Engineer. Piotr Pelpliński, Cloud Software Engineer Changpeng Liu, Cloud Software Engineer Piotr Pelpliński, Cloud Software Engineer Introduction to VirtIO and Vhost SPDK Vhost Architecture Use cases for vhost Benchmarks Next steps QEMU VIRTIO Vhost (KERNEL)

More information

CONTAINERS AND MICROSERVICES WITH CONTRAIL

CONTAINERS AND MICROSERVICES WITH CONTRAIL CONTAINERS AND MICROSERVICES WITH CONTRAIL Scott Sneddon Sree Sarva DP Ayyadevara Sr. Director Sr. Director Director Cloud and SDN Contrail Solutions Product Line Management This statement of direction

More information

libvirt integration and testing for enterprise KVM/ARM Drew Jones, Eric Auger Linaro Connect Budapest 2017 (BUD17)

libvirt integration and testing for enterprise KVM/ARM Drew Jones, Eric Auger Linaro Connect Budapest 2017 (BUD17) libvirt integration and testing for enterprise KVM/ARM Drew Jones, Eric Auger Linaro Connect Budapest 2017 (BUD17) Overview Enterprise guest requirements QEMU/KVM enterprise guest management libvirt A

More information

CLOUD ARCHITECTURE & PERFORMANCE WORKLOADS. Field Activities

CLOUD ARCHITECTURE & PERFORMANCE WORKLOADS. Field Activities CLOUD ARCHITECTURE & PERFORMANCE WORKLOADS Field Activities Matt Smith Senior Solution Architect Red Hat, Inc @rhmjs Jeremy Eder Principal Performance Engineer Red Hat, Inc @jeremyeder CLOUD ARCHITECTURE

More information

vnetwork Future Direction Howie Xu, VMware R&D November 4, 2008

vnetwork Future Direction Howie Xu, VMware R&D November 4, 2008 vnetwork Future Direction Howie Xu, VMware R&D November 4, 2008 Virtual Datacenter OS from VMware Infrastructure vservices and Cloud vservices Existing New - roadmap Virtual Datacenter OS from VMware Agenda

More information

What is KVM? KVM patch. Modern hypervisors must do many things that are already done by OSs Scheduler, Memory management, I/O stacks

What is KVM? KVM patch. Modern hypervisors must do many things that are already done by OSs Scheduler, Memory management, I/O stacks LINUX-KVM The need for KVM x86 originally virtualization unfriendly No hardware provisions Instructions behave differently depending on privilege context(popf) Performance suffered on trap-and-emulate

More information

Can we boost more HPC performance? Integrate IBM POWER servers with GPUs to OpenStack Environment

Can we boost more HPC performance? Integrate IBM POWER servers with GPUs to OpenStack Environment Can we boost more HPC performance? Integrate IBM POWER servers with GPUs to OpenStack Environment Ankit Purohit, Takeaki Matsumoto Transform your business, transcend expectations with our technologically

More information

Linux Clusters Institute: OpenStack Neutron

Linux Clusters Institute: OpenStack Neutron Linux Clusters Institute: OpenStack Neutron Yale, August 13 th 17 th 2018 John Michael Lowe Senior Cloud Engineer Indiana University jomlowe@iu.edu Neutron SDN or not Network Namespaces Components Security

More information

The Post-Cloud. Where Google, DevOps, and Docker Converge

The Post-Cloud. Where Google, DevOps, and Docker Converge The Post-Cloud Where Google, DevOps, and Docker Converge About me Principal Architect, Intel Corporation DevOps, Telemetry, PaaS, Containers, Puppies Former: VMware EMC Nicholas Weaver nicholas.weaver@intel.com

More information

CSC 5930/9010 Cloud S & P: Virtualization

CSC 5930/9010 Cloud S & P: Virtualization CSC 5930/9010 Cloud S & P: Virtualization Professor Henry Carter Fall 2016 Recap Network traffic can be encrypted at different layers depending on application needs TLS: transport layer IPsec: network

More information

VIRTIO: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD. CUNMING LIANG, Intel

VIRTIO: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD. CUNMING LIANG, Intel VIRTIO: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD CUNMING LIANG, Intel Agenda Towards NFV Cloud vhost Data Path Acceleration vdpa Intro vdpa Design vdpa Implementation Summary & Future Work Towards

More information

Container mechanics in Linux and rkt FOSDEM 2016

Container mechanics in Linux and rkt FOSDEM 2016 Container mechanics in Linux and rkt FOSDEM 2016 Alban Crequy github.com/alban Jonathan Boulle github.com/jonboulle @baronboulle a modern, secure, composable container runtime an implementation of appc

More information

Changpeng Liu. Cloud Storage Software Engineer. Intel Data Center Group

Changpeng Liu. Cloud Storage Software Engineer. Intel Data Center Group Changpeng Liu Cloud Storage Software Engineer Intel Data Center Group Notices & Disclaimers Intel technologies features and benefits depend on system configuration and may require enabled hardware, software

More information

Buenos Aires 31 de Octubre de 2018

Buenos Aires 31 de Octubre de 2018 Buenos Aires 31 de Octubre de 2018 VMware NSX Data Center & Containers in the Dell EMC Ecosystem Gonzalo Atienza Sr Systems Engineer, Network & Security Business Unit, VMware Containers are Here to stay!

More information

QLOGIC SRIOV Fuel Plugin Documentation

QLOGIC SRIOV Fuel Plugin Documentation QLOGIC SRIOV Fuel Plugin Documentation Release 1.0-1.0.0-1 QLOGIC Jul 19, 2016 CONTENTS 1 Overview of the QLogic SRIOV Fuel Plugin 1 1.1 Software Prerequisites..........................................

More information

Full Scalable Media Cloud Solution with Kubernetes Orchestration. Zhenyu Wang, Xin(Owen)Zhang

Full Scalable Media Cloud Solution with Kubernetes Orchestration. Zhenyu Wang, Xin(Owen)Zhang Full Scalable Media Cloud Solution with Kubernetes Orchestration Zhenyu Wang, Xin(Owen)Zhang Agenda Media in the Network and Cloud Intel Media Server Reference Software Stack Container with MSS enablement

More information

Accelerating NVMe-oF* for VMs with the Storage Performance Development Kit

Accelerating NVMe-oF* for VMs with the Storage Performance Development Kit Accelerating NVMe-oF* for VMs with the Storage Performance Development Kit Jim Harris Principal Software Engineer Intel Data Center Group Santa Clara, CA August 2017 1 Notices and Disclaimers Intel technologies

More information

Docker All The Things

Docker All The Things OpenStack Services Docker All The Things and Kubernetes and Atomic OpenStack Summit Paris, November 2014 @brentholden @jameslabocki Agenda The Problem Current Solutions Tomorrow s Improvements Demonstration

More information

VIRTIO-NET: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD. CUNMING LIANG, Intel

VIRTIO-NET: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD. CUNMING LIANG, Intel VIRTIO-NET: VHOST DATA PATH ACCELERATION TORWARDS NFV CLOUD CUNMING LIANG, Intel Agenda Towards NFV Cloud Background & Motivation vhost Data Path Acceleration Intro Design Impl Summary & Future Work Towards

More information

1 Virtualization Recap

1 Virtualization Recap 1 Virtualization Recap 2 Recap 1 What is the user part of an ISA? What is the system part of an ISA? What functionality do they provide? 3 Recap 2 Application Programs Libraries Operating System Arrows?

More information

AMD SEV Update Linux Security Summit David Kaplan, Security Architect

AMD SEV Update Linux Security Summit David Kaplan, Security Architect AMD SEV Update Linux Security Summit 2018 David Kaplan, Security Architect WHY NOT TRUST THE HYPERVISOR? Guest Perspective o Hypervisor is code I don t control o I can t tell if the hypervisor is compromised

More information

OPENSTACK + KUBERNETES + HYPERCONTAINER. The Container Platform for NFV

OPENSTACK + KUBERNETES + HYPERCONTAINER. The Container Platform for NFV OPENSTACK + KUBERNETES + HYPERCONTAINER The Container Platform for NFV ABOUT ME Harry Zhang ID: @resouer Coder, Author, Speaker Member of Hyper Feature Maintainer & Project Manager of Kubernetes sig-scheduling,

More information

THE STATE OF CONTAINERS

THE STATE OF CONTAINERS THE STATE OF CONTAINERS Engines & Runtimes in RHEL & OpenShift Scott McCarty Principal Technology Product Manager - Containers 10/15/2018 What if... I told you there is container innovation happening in

More information

Module 1: Virtualization. Types of Interfaces

Module 1: Virtualization. Types of Interfaces Module 1: Virtualization Virtualization: extend or replace an existing interface to mimic the behavior of another system. Introduced in 1970s: run legacy software on newer mainframe hardware Handle platform

More information

Chapter 5 C. Virtual machines

Chapter 5 C. Virtual machines Chapter 5 C Virtual machines Virtual Machines Host computer emulates guest operating system and machine resources Improved isolation of multiple guests Avoids security and reliability problems Aids sharing

More information

Optimizing and Enhancing VM for the Cloud Computing Era. 20 November 2009 Jun Nakajima, Sheng Yang, and Eddie Dong

Optimizing and Enhancing VM for the Cloud Computing Era. 20 November 2009 Jun Nakajima, Sheng Yang, and Eddie Dong Optimizing and Enhancing VM for the Cloud Computing Era 20 November 2009 Jun Nakajima, Sheng Yang, and Eddie Dong Implications of Cloud Computing to Virtualization More computation and data processing

More information

Virtio SCSI. An alternative virtualized storage stack for KVM. Stefan Hajnoczi Paolo Bonzini

Virtio SCSI. An alternative virtualized storage stack for KVM. Stefan Hajnoczi Paolo Bonzini Virtio SCSI An alternative virtualized storage stack for KVM Stefan Hajnoczi stefanha@linux.vnet.ibm.com Paolo Bonzini pbonzini@redhat.com Overview Limitations in QEMU's storage stack virtio-scsi: a new

More information

Raw Packet Capture in the Cloud: PF_RING and Network Namespaces. Alfredo

Raw Packet Capture in the Cloud: PF_RING and Network Namespaces. Alfredo Raw Packet Capture in the Cloud: PF_RING and Network Namespaces Alfredo Cardigliano cardigliano@ntop.org @acardigliano About ntop ntop develops high-performance network traffic monitoring technologies

More information

A comparative analysis of Precision Time Protocol in native, virtual machines and container-based environments for consolidating automotive workloads

A comparative analysis of Precision Time Protocol in native, virtual machines and container-based environments for consolidating automotive workloads A comparative analysis of Precision Time Protocol in native, virtual machines and container-based environments for consolidating automotive workloads Speaker: Co-authors: Ong Boon Leong boon.leong.ong@intel.com

More information

Launching StarlingX. The Journey to Drive Compute to the Edge Pilot Project Supported by the OpenStack

Launching StarlingX. The Journey to Drive Compute to the Edge Pilot Project Supported by the OpenStack Launching StarlingX The Journey to Drive Compute to the Edge Pilot Project Supported by the OpenStack Foundation Ian Jolliffe, WIND RIVER SYSTEMS Director Engineering @ian_jolliffe Project Overview An

More information

Agilio CX 2x40GbE with OVS-TC

Agilio CX 2x40GbE with OVS-TC PERFORMANCE REPORT Agilio CX 2x4GbE with OVS-TC OVS-TC WITH AN AGILIO CX SMARTNIC CAN IMPROVE A SIMPLE L2 FORWARDING USE CASE AT LEAST 2X. WHEN SCALED TO REAL LIFE USE CASES WITH COMPLEX RULES TUNNELING

More information

LXC(Linux Container) Lightweight virtual system mechanism Gao feng

LXC(Linux Container) Lightweight virtual system mechanism Gao feng LXC(Linux Container) Lightweight virtual system mechanism Gao feng gaofeng@cn.fujitsu.com 1 Outline Introduction Namespace System API Libvirt LXC Comparison Problems Future work 2 Introduction Container:

More information

Zhang Tianfei. Rosen Xu

Zhang Tianfei. Rosen Xu Zhang Tianfei Rosen Xu Agenda Part 1: FPGA and OPAE - Intel FPGAs and the Modern Datacenter - Platform Options and the Acceleration Stack - FPGA Hardware overview - Open Programmable Acceleration Engine

More information

I/O virtualization. Jiang, Yunhong Yang, Xiaowei Software and Service Group 2009 虚拟化技术全国高校师资研讨班

I/O virtualization. Jiang, Yunhong Yang, Xiaowei Software and Service Group 2009 虚拟化技术全国高校师资研讨班 I/O virtualization Jiang, Yunhong Yang, Xiaowei 1 Legal Disclaimer INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE,

More information

Container Networking and Openstack. Fernando Sanchez Fawad Khaliq March, 2016

Container Networking and Openstack. Fernando Sanchez Fawad Khaliq March, 2016 Container Networking and Openstack Fernando Sanchez - @fernandosanchez Fawad Khaliq - @fawadkhaliq March, 2016 Agenda Containers, Orchestration and Networking Containers: runtimes Container Orchestration

More information

<Insert Picture Here> LDoms Deep Dive IO Best Practices for Oracle VM Server for SPARC

<Insert Picture Here> LDoms Deep Dive IO Best Practices for Oracle VM Server for SPARC LDoms Deep Dive IO Best Practices for Oracle VM Server for SPARC Stefan Hinker EMEA Hardware Principal Sales Consultant The following is intended to outline our general product direction.

More information

MESOS A State-Of-The-Art Container Orchestrator Mesosphere, Inc. All Rights Reserved. 1

MESOS A State-Of-The-Art Container Orchestrator Mesosphere, Inc. All Rights Reserved. 1 MESOS A State-Of-The-Art Container Orchestrator 2016 Mesosphere, Inc. All Rights Reserved. 1 About me Jie Yu (@jie_yu) Tech Lead at Mesosphere Mesos PMC member and committer Formerly worked at Twitter

More information

Low overhead virtual machines tracing in a cloud infrastructure

Low overhead virtual machines tracing in a cloud infrastructure Low overhead virtual machines tracing in a cloud infrastructure Mohamad Gebai Michel Dagenais Dec 7, 2012 École Polytechnique de Montreal Content Area of research Current tracing: LTTng vs ftrace / virtio

More information

DPDK Summit China 2017

DPDK Summit China 2017 Summit China 2017 Embedded Network Architecture Optimization Based on Lin Hao T1 Networks Agenda Our History What is an embedded network device Challenge to us Requirements for device today Our solution

More information

How to build and run OCI containers

How to build and run OCI containers How to build and run OCI containers A shallow dive on the OCI container configuration and an overview of the available tools whoami Spyros Trigazis Computing Engineer at CERN s cloud team Project Team

More information

Virtualisation: The KVM Way. Amit Shah

Virtualisation: The KVM Way. Amit Shah Virtualisation: The KVM Way Amit Shah amit.shah@qumranet.com foss.in/2007 Virtualisation Simulation of computer system in software Components Processor Management: register state, instructions, exceptions

More information

MesosCon Qian Zhang (IBM China), Jie Yu (Mesosphere) OCI Support in Mesos Mesosphere, Inc. All Rights Reserved. 1

MesosCon Qian Zhang (IBM China), Jie Yu (Mesosphere) OCI Support in Mesos Mesosphere, Inc. All Rights Reserved. 1 MesosCon 2017 - Qian Zhang (IBM China), Jie Yu (Mesosphere) OCI Support in Mesos 2016 Mesosphere, Inc. All Rights Reserved. 1 Qian Zhang Software Engineer Jie Yu Software Engineer zhq527725@gmail.com jie@mesosphere.io

More information

EE 660: Computer Architecture Cloud Architecture: Virtualization

EE 660: Computer Architecture Cloud Architecture: Virtualization EE 660: Computer Architecture Cloud Architecture: Virtualization Yao Zheng Department of Electrical Engineering University of Hawaiʻi at Mānoa Based on the slides of Prof. Roy Campbell & Prof Reza Farivar

More information

Link Virtualization based on Xen

Link Virtualization based on Xen Link Virtualization based on Xen ShinHyoung Lee, Chuck Yoo shlee@os.korea.ac.kr, hxy@os.korea.ac.kr Sponsored by: & Contents Introduction Future Internet Virtual Network Link Virtualization Related Works

More information