Software Transformation for Cloud Video Solutions

Transcription

1

2 BRKSPV-1102 Software Transformation for Cloud Video Solutions Neeve Nikoo, Systems Engineer

3 Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click Join the Discussion 3. Install Spark or go directly to the space 4. Enter messages/questions in the space cs.co/ciscolivebot#brkspv Cisco and/or its affiliates. All rights reserved. Cisco Public

4 When HBO Go crashes during the season premiere of Game of Thrones, it s not because the internet can t handle all the traffic, it s because the software solution can t handle sudden spikes in traffic. Alan Wolk Industry Analyst BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 4

5 Main Message Containers are a great use case for software video applications. BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 5

6 Agenda Where is the Gap in Video Transformation? How did we get here? Rise of Container Technology Application Case Study How to get into the Game Future Video Architecture Conclusion

7 BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 7

8 Focus for Today Many steps to fix. Collapse infrastructure Introduce Cloud strategy Abstract workflows Public and private clouds Deploy and operate tooling Software App Architecture All software the same? Spectrum of Cloudiness Virtualization and Containers Case Study Future Transformed Video Architecture BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 8

9 Speaking the Same Language UCS Unified Computing System COTS Commercial-Off-the-Shelf NMS Network Management System LXC Linux Container COE Container Orchestration Engine CDN Content Distribution Network ABR Adaptive Bit Rate HLS HTTP Live Streaming DASH Dynamic Adaptive Streaming over HTTP SDN Software Defined Networking SLA Service Level Agreement OS Operating System HA High Availability JITP Just-in-Time Packaging vmr Virtual Media Recorder vdcm- Virtual Digital Content Manager BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 9

10 How did we get here?

11 Who Said It? Correct Answer: Marketing, Sales, Engineering, or QA BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 11

12 Infrastructure Systems Example Desired Transition Virtual Architecture Service 1 Service 2 Service N BSS 1 BSS 2 BSS N OSS / BSS NMS 1 NMS 2 NMS 3 Silos VNF 1 VNF 2 VNF 3 App 1 App 2 App 3 Transition Converged Orchestration SDN NFV HW HW HW HW SW x86 BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 12

13 DC vs Media DC Trends Virtualization Programmable Infra Converged Infra Microservices Containerization Any Cloud Future Mixed HW Silos Consolidate Platforms/Apps? Cloud Environment Hybrid Cloud Media DC Guy 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13

14 Application Architecture Progression Silos / Appliances Virtualization Cloud Micro Services PaaS, Container Clusters App 1 App 2 App 3 App 3 App 2 App 1 Hypervisor App 1 App 3 App 1 App 3 App 2 App 2 PaaS Cloud Cloud Hypervisor Hypervisor Hypervisor Containers Independent, dedicated app silos Dependent SW + HW relationship Silos built to peak Not a material driver for app rearchitecture; however enabled app teams to view servers as cheap and expendable IT driven Server consolidation Scale out SW / HW separation HW responsibilities move up the stack All is programmable Shared resources VM as deployment unit Dev centric Lightweight container as deployment unit Similar architectural tenants as cloud BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 14

15 A story of 3 cloud software products Lift and shift = Cloud Tolerant Cloud ready virtualized Cloud Native microservices, stateless and decoupled atomic functions BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 15

16 Emergence of Container Technology for Video

17 All Video roads lead to Virtual Machines? Contribution Studio and Post Production Distribution Control Plane Scheduling NMS MAM CMS Automation Master Control Security Scheduler Billing User Mgmt Middleware Data Plane Encoding Content Factory Routing Switching Editing QC Transcoding Packaging Recording CDN BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 17

18 Spectrum of Software Cloudiness Bespoke Appliance Bare Metal COTS Virtualized Apps Cloud-Native Apps Operational Flexibility Performance? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 18

19 Best of Both Worlds? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 19

20 Benefit Confluence Bare Metal is great because: Able to access HW directly Performant (no HW emulation) Full use of resources VMs are great because: Portability between hosts Elasticity Flexibility and Isolation of Apps CONTAINERS BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 20

21 Sample Test VMs versus Docker vs Physical Image Source and Credits (Hiroki Endo): BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 21

22 Container Technology Primer

23 Virtual Machines and Containers are Fundamentally Different App App App App Bins / libs Operating System Virtual Machine Hypervisor Operating System Hardware Bins / libs Operating System Virtual Machine Each App has its own OS App App App App Bins / libs Container Container Bins / libs Operating System Hardware Apps Share OS Hypervisor Linux Containers BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 23

24 Impact to Application Development Old Way: Applications on Host New Way: Deploy Containers App App App App Libraries Libraries App App App App Libraries Libraries Libraries Kernel Kernel BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 24

25 Virtual Machine vs Container Virtual Machine Container What is Virtualized? Hardware OS Portability Between hardware Software Overhead Medium Low Time to Spin up Slow Very Fast Best for: Design Philosophy of application Persistence Running multiple OS on Host Full application on VM Stateful, coupled with filesystem When performance, web-scale, and density is important Micro-services per container, DevOps friendly Stateless, decoupled with filesystem BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 25

26 Container Fundamentals Control Groups (cgroups) Provides control and limit of available resources Namespaces Provides isolation and virtualization of system resources BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 26

27 Container Fundamentals Control Groups (cgroups) Resource CPU cgroup cpu cpuset Example Runtime Arguments --cpu-shares = proportional CPU allocation --cpus = guaranteed CPU reservation --cpuset-cpus = restrict to specific CPUs Memory Storage Network memory blkio net_cls net_prio --memory = max memory --memory-reservation = reserved minimum --device-read-iops = read IOPS limit --device-write-iops = write IOPS limit Cisco Contiv -bandwidth = bandwidth allocation -dscp = mark DSCP BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 27

28 Container Fundamentals Namespaces (pid) Process ID (net) Network Process Isolation Manages network interfaces (mnt) Mount Manages filesystem mount points (uts) Unix Timesharing (uid) User ID Isolating kernel and version IDs (incl hostname) Independent User ID Space BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 28

29 Linux Container (LXC) Technology Stack LXCs are built on modern kernel features cgroups; limits, prioritization, accounting & control namespaces; process based resource isolation chroot; apparent root FS directory Linux Security Modules (LSM); Mandatory Access Control (MAC) User space interfaces for kernel functions BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 29

30 Linux Containers A Linux container lets you run a Linux system within another Linux system. A container is a group of processes on a Linux machine. Those processes form an isolated environment. Inside the container, it (almost) looks like a VM. Outside the container, it looks like normal processes running on the machine. It looks like a VM, but it is more efficient: Containers = Lightweight Virtualization BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 30

31 Union File System App Layer OS Libraries Host OS Layer BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 31

32 Efficiency of Union File System This means that multiple containers can share a single copy of the image. Image Source and Credits (Hiroki Endo): BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 32

33 What is Docker? Docker is a container technology similar to Linux Containers (LXC) that Provides isolation for application processes from the host processes using Linux namespaces Provides resource caps for the application using Linux cgroups Provides industry preferred packaging model using docker images, docker index, and docker registry concepts Provides the basis for application lifecycle management automation due to good integration with devops automation tools such as Puppet/Chef (not available in 6.1.1) A rich repository of certified docker base images are easily available in public as well as private docker registries to cover a variety of application use cases BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 33

34 Docker over LXC? Docker provides the following advantages over LXC containers Docker packaging is becoming a packaging model of choice for application packaging and delivery in the industry. Standard packaging format provided by docker allows easier integration with devops automation toolchains such as puppet/chef/etc. Docker cli provides a git like workflow for developing containerized applications which is tool-friendly Docker provides image management capabilities using docker image, docker index and docker registry concepts Public and private docker registries provide a repository of starter container images for a variety of application use cases Thin packaging/delivery (Docker application download or upgrade is often a thin download due to sharing of common layers among multiple containers) Lower foot print for the containers. Docker layers, especially, the base layers can be shared among BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 34

35 Momentum for Docker BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 35

36 Docker Architecture Overview BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 36

37 Docker Engine Lifecycle Overview Image Pull Creates a new container Allocates a filesystem Allocates a network and IP Executes Captures and provides output BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 37

38 What Manages Docker containers? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 38

39 Kubernetes Is an open-source platform for automating deployment, scaling, and operations of application containers across clusters of hosts. Written in Go. Can be deployed in private cloud, or public cloud (including GCE Google Compute Engine) Google offers a hosted version called Google Container Engine (GKE, NOT GCE) & uses Google Container Registry (GCR) not DockerHub for storing official images Key Characteristics: Installs & Scales fast and easy (kubeadm, kubectl), lean, portable, self healing, widely adopted by community What is K8S? Short Abbreviation of Kubernetes BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 39

40 Kubernetes (K8s) manages Docker Containers Provides control plane for container environment BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 40

41 Kubernetes (K8s) to Orchestrate Docker Worker Node 1 Docker Pod Container Container Container Pod Container Container Container Pod Container Container Container K8s Master Worker Node 2 Pod Container Container Container Worker Node 3 Pod Container Container Container Docker Pod Container Container Container Docker Pod Container Container Container Pod Container Container Container Pod Container Container Container BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 41

42 Containers, Pods, Nodes Node K8s Master Pod Container BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 42

43 Service and Labels Worker Node Docker Pods Running Containers Service Construct Labels Service ABC Pod App 1 - SQL Pod App 2 - Nginx BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 43

44 Worker Node Worker Node Worker Node Worker Node Replication Controller Maintains Pod Structure Node 1 Node 1 Node 1 Node 1 Pod App 1 - SQL Pod App 1 - SQL Pod App 1 - SQL Pod Pod App 1 - SQL App 2 - Nginx Node 2 Pod App 2 - Nginx Node 2 XPod App 2 - Nginx Node 2 X OR Node 2 X Node 3 Node 3 Node 3 Node 3 Pod App 2 - Nginx BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 44

45 Kubernetes HA Cluster Load-Balanced Nodes Master Node Cluster BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 45

46 COEs, for Example OpenShift User-Friendly K8s Deploy Manage Monitor Visualize Backup/restore CI/CD Pipeline BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 46

47 What does this mean for Apps?

48 Recent Video App Development Trends App teams skip OpenStack/VMs for containers Migration from VMWare to container platforms Multi DC / hybrid / multi provider app deployment Top down approach / App CD tooling Container frameworks as the enabling platform Managed Platforms and Services Vendor solutions have matured Little appetite for DIY (time, talent, cost, risk) Let the app developers drive platform decisions Have an overarching platform to allow orchestration across any platform BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 48

49 Container as Cloud Native Building Block for Apps Requirement Container Answer Web Scale Dynamic Independent scaling Microservices Quickly spin up and down Apps Libs Apps Libs Resiliency Agility Loosely coupled Discovery Load-balanced, stateless design Fits squarely into CI/CD model Micro-services for independent atomic functions Labeling of services Guest OS Guest OS Hypervisor Host OS Infrastructure Apps Libs Docker Engine Host OS Apps Libs Infrastructure Overhead Minimal OS and libraries, no hypervisor layer VM Containers Hybrid solutions Portability, APIs are first class citizens BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 49

50 Redundancy is Now Native to Solution Old way New way BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 50

51 BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 51

52 What about Operations? Scheduling Lifecycle and health Discovery Monitoring Auth Scaling SDN : Where should my containers run? : Keep my containers running despite failures : Where are my containers now? : What s happening with my containers? : Control who can do things to my containers : Making jobs bigger or smaller : How do containers communicate? Int/Ext? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 52

53 Container Infrastructure Challenges Rate of Change Automated deployment process many deploys, short lifespan Ephemeral Containers, Networks, Services Traffic Flows East-West Inter-Microservice Latency Critical Scale Higher density Distributed Scale-Out Architecture Security Isolation and Tenancy Explicit policy definition BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 53

54 Learning Curve Developers Production/Ops HELP! Security QA Discovery SDN Config Changes A/B Testing Rollback Monitoring Docker Docker BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 54

55 DevOps New Normal for App Development? Only replace the micro-service needed Enabled by layered container architecture Fail fast philosophy Deploy, test small scale Rollback Deploy Feature Velocity BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 55

56 CI/CD - Defined Continuous Integration: Process of automating the build and testing of code every time a team member commits changes to version control. Encourages developers to share their code and unit tests by merging their changes after every small task completion. Committing code triggers an automated build system to build, test, and validate the full master branch Continuous Delivery Process to build, test, configure and deploy from a build to a production environment. Multiple testing or staging environments create a Release Pipeline to automate the deployment. Successive environments support progressively longer-running activities of integration, load, and user acceptance testing. BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 56

57 Example CI/CD Pipeline Version Control System 4 CI notified of changes Continuous Integration Server 5 Changes Kick off test Build Test Instance Run Tests Developer pushes commits 7 CI notifies of pass / fail 8 If tests pass: Deploy to Registry 2 9 Production Infrastructure Registry Deploy to Production BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 57

58 How to make it through to CD? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 58

59 Dev-Ops Move Towards Containers Containers enforce micro-service architecture thinking Deployment automation becomes simpler Deployment becomes faster (smaller than VMs) Configuration management becomes easier (less to do) Self-healing becomes easier BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 59

60 Case Study Virtual Media Recorder (VMR)

61 cdvr is Excellent Use Case for Containers Old Way with Virtual Machines or Bare Metal BM or VMs per application Pod dimensioning and deployment model Not Dynamic Recorder bound by multiple constraints Redundancy model Users vs channels Upgrade/Maintenance downtime Scales By Channels Sources Recorder Playout Scales By Users Scales By Channels Storage BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 61

62 cdvr is Excellent Use Case for Containers New Way with Containers Micro-services Granular model Dynamic, On-Demand services Atomic components of cdvr scale independently in stateless, selfhealing container cluster Extreme feature velocity - CI/CD pipeline Scales By Channels Sources Recorder Playout Scales By Users Scales By Channels Storage BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 62

63 cdvr Better with micro-services Sources Manifest Recorder HBO Agent In- Stream1 ESPN Agent Memory DB Stream Agents Agents ZooKeeper (ESB) Archive Arch1 Agent Arch2 Agent Agents Origin Play1 Agent Play2 Agent Agents JITP BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 63

64 VMR cdvr Micro-services Architecture AUX Control Plane INGEST RECORD PLAYBACK RM DO AA CoreOS Container OS DASH Unicast SR RA MA API ZK UI DASH DASH Unicast Kubernetes (K8) Docker Container S3 API BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 64

65 Scaling Out VMR Control Plane Host 1 Host N.... Object Storage BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 65

66 Where are we Going?

67 Video Processing Transformation Virtualized Main Screen Functions Video Hybrid Headend Cloud Orchestration Innovation Live TV VOD IOS VOD cdvr Bandwidth Optimization Encoding Packaging Applications xcode Mux/Stat Mux Service Provider Cloud Orchestration Orchestration DPI IP Video Infrastructure Compute Storage Network Content Provider Cloud Hosted Cloud BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 67

68 ABR Transcoder JITP & JITE Multicast ABR vcmts Content Providers Alternate Content SS ABR TS VOD Pump Statmux Scramble ABR Transcoder Linear Packager ABR TS Linear Future: Fully Converged Micro-services Solution COE Micro-Service Edge ABR Core Unicast via CDN cdvr CDN VOD Library Any Cloud General Purpose Public or Private Cloud Compute BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 68

69 Reality Check: Hurdles Still to Overcome Networking Complexity in Container Environment Security Adoption by Video Vendor Community Skill Set in Market Container Management Platform Evolution BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 69

70 How do I get into the Game?

71 Application Migration Options Start from Scratch or completely refactor application Break functions into logical micro-services Create images for each micro-service Define PODs for deployment Create deployment tooling to assemble PODs into services and application Lift-and-Shift Identify key processes Identify key interfaces Identify key libraries and package to images Map interfaces to container definitions Align runtime environment (OS) BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 71

72 Docker MTA, for Example BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 72

73 Wrap up

74 Summary Not all cloud software is the same! Cloud-native opens up new architecture and business possibilities Containers provide technology for true cloud delivery of services, because of: Web-scale design (resiliency, scale, elasticity) Micro-service apps enable true CI/CD and DevOps Cisco building solutions for orchestrated container-based, hybrid workflows Content Provider Cloud Service Provider Cloud Hosted Cloud BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 74

75 What to do about it? I encourage you to : 1. Focus on software architecture, and not just the feature set. 2. Include SW architecture as a critical part of your decision-making process for future video solutions. 3. Make sure that containers are represented as a key piece of that architecture. 4. Ensure that the architecture will support hybrid cloud architectures.? BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 75

76 Main Message Containers are a great use case for software video applications. BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 76

77 Q&A BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 77

78 Cisco Spark How Questions? Use Cisco Spark to communicate with the speaker after the session 1. Find this session in the Cisco Live Mobile App 2. Click Join the Discussion 3. Install Spark or go directly to the space 4. Enter messages/questions in the space cs.co/ciscolivebot#brkspv Cisco and/or its affiliates. All rights reserved. Cisco Public

79 Please complete your Online Session Evaluations after each session Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt All surveys can be completed via the Cisco Live Mobile App or the Communication Stations Complete Your Online Session Evaluation Don t forget: Cisco Live sessions will be available for viewing on-demand after the event at Cisco and/or its affiliates. All rights reserved. Cisco Public

80 Continue Your Education Demos in the Cisco campus Walk-in Self-Paced Labs Tech Circle Meet the Engineer 1:1 meetings Related sessions BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 80

81 Continue Your Education Related sessions Introduction to Containers and Container Networking [BRKSDN-2115] Kubernetes Container Networking [BRKDCN-2390] Designing Cloud Native Applications with Microservices and Containers [DEVNET-1230] Inside Cisco IT: Containers on Enterprise Compute and Networks [BRKCOC-2016] Introduction to Contiv [LABDCT-2110] Cisco Container Platform complete Kubernetes based stack for containerized apps! [PSOCLD-2316] Deploy a Hybrid, Multi-Cloud Container Environment in Less than an Hour [BRKCLD- 2235] DevNet Workshop - Getting Started with Containers [DEVNET-2042] BRKSPV Cisco and/or its affiliates. All rights reserved. Cisco Public 81

82 Thank you

83