Building a Video Optimized Private Cloud Platform on Cisco Infrastructure Rohit Agarwalla, Technical Leader roagarwa@cisco.com, @rohitagarwalla DEVNET-1106
Agenda Cisco Media Blueprint Media Workflows Cisco Media Data Center Cisco OpenStack Platform End-to-End Workflow and Demo
Cisco Media Blueprint
Media Industry Transitions Transition to IP from SDI 10110101 1001010110 101010101010 Ready for tomorrows new formats and data rates Increased throughput with Ethernet x86 Workloads Move away from specialized, dedicated, expensive HW/appliances Single, unified, general purpose, low cost compute and storage Cloud Architectures Automated provisioning and elastic resource pools Treat the platform as reusable pools of resources
Cisco Media Blueprint What? Solutions Applications and infrastructure for moving, storing, distributing and securing broadcast media content Eco-System Open standards approach, directly supported by the industry s key software providers Industry Flexible solutions for changing market demands, in accord with current and future industry standards
Cisco Media Blueprint Why? Move Faster Quickly and economically deploy flexible production, storage, and distribution capabilities Generate Revenue Sooner Automatically and dynamically adjust to changing market demands for content Prepare for Change Scale globally and securely with proven Cisco performance
Full Stack Media Solution E2E Workflow Orchestration Cisco Virtual Video Processing Controller (V2P-C) 3 rd Party ISV Orchestration Software Applications Cisco Video Applications: vdcm, Infinite Video/Home, cdvr, 3 rd Party ISV Applications Cloud Platform Media Data Center: Media-optimized Cloud Platform Physical Infrastructure Nexus, Unified Computing System, Cisco Scale Out Storage 3 rd Party Software Defined Storage
Media Workflows
SP Linear Channel Logical Typically hundreds of these channels per service provider, in a handful of regions Transcode 10 Mbps multicast MPEG2-TS Multicast Distribution Subs Packager Origin CDN Subs 30 Mbps HTTP PUT
Cloud DVR Workflow Logical Hundreds of thousands of simultaneous recordings per region, less playout Transcode Same as SP Linear Multicast Distribution Subs Packager Origin CDN Subs 10 Mbps HTTP GET Recorder 10 Mbps HTTP PUT Shared Storage 10 Mbps HTTP GET Playout
Broadcast Channel Playout Logical Typically dozens of these channels per broadcaster, in a handful of locations Remote Storage Content Ingest Transcode Quality Control Shared Storage Up to 220 Mbps CIFS read Playout Distribution Live Feed 220 Mbps multicast flows mezzanine compressed live feeds
VoD Library Transcode Logical Millions of assets per library, only a subset transcoded at a time, into 100s of formats Transcode Transcode Transcode Package Encrypt Encrypt Shared Storage Best effort CIFS read Export Distribution
Cisco Media Data Center
What Is Media Data Center? Turnkey solution and future proof next-gen media architecture Optimized cloud platform for running video and media workloads Simplified API driven management High performance, efficient resource utilization On-premises private cloud based on OpenStack
Media Data Center : Not Just OpenStack Media Optimized Bare Metal and Containers VM-FEX Multicast QoS IPVS Support Workflows ISV Certification Video WorkFlows SPVSS Service Provider Workflows SP Linear Channel Cloud DVR Workflow Content Provider Workflows Broadcast Channel Playout VoD Library Transcode
Cisco OpenStack Platform CI / CD Media Data Center Architecture Media Enhancements Bare-Metal Containers VM-FEX Multicast QoS IPVS Installation and Upgradability Highly Available and Scalable Monitoring and Logging Cloud99 Red Hat OpenStack Platform*, Cisco Plugins/Drivers VMTP Red Hat Enterprise Linux* Neutron UCS ML2 Mechanism Driver Ironic UCSM Bare-Metal Driver Network Compute Storage MediaDataCenter Physical Infrastructure Nexus 9000 UCS-C UCS-B FI COS C3160 (Swift) C240 (Ceph) * First version on Cisco hardware and RHEL
Cisco OpenStack Platform
Cisco OpenStack Platform Modularized Deployment Capabilities User input and configuration validation Base host (bare-metal) install OpenStack install Control Plane Capabilities High availability Upgrade/Update Enhanced logging and health monitoring Integrated test and verification tools Data Plane Capabilities Highly available and high throughput network data plane Distributed and highly available storage Automated performance and scale tests
OpenStack Deployment Topology UCS C series Dedicated Build Node 3 x Controller nodes 2 x (or more) Compute nodes 3 x (or more) Block Storage nodes (Ceph) 2 x ToR
OpenStack Deployment Topology UCS B series Dedicated Build Node 3 x Controller nodes 2 x (or more) Compute nodes 3 x (or more) Block Storage nodes (Ceph) 2 X Fabric Interconnect 2 x ToR
OpenStack Node/Service Layout Containerized OpenStack Services Installer MariaDB/Galera RabbitMQ HAProxy/VRRP Nova Compute Neutron Agent Ceph Monitoring on Build node External and Internal VIP addresses 3-way active for stateful services Cobbler ELK Stack VMTP Keystone Glance Nova Neutron Cinder Horizon Heat CloudPulse Logstash Forwarder Logstash Forwarder
OpenStack Networks Networks/Bonds Functions Management/Provision OpenStack control plane traffic Server Management: build node will connect to servers on this network PXE booting servers during baremetal install API Clients connect to API network Dashboard Tenant VM to VM traffic Storage Communication to CEPH backend Provider For external/provider network External For connecting tenant VMs to external networks
OpenStack Deployment Networking External API Tenant (LB VXLAN or OVS VLAN) Provider (VLAN) Storage Management/Provisioning
System Monitoring Monitoring, Logging and Visualization OpenStack Services Logging UCS Hardware Monitoring System Monitoring User Interface Operating System (Linux Health) Alarms
ELK Stack Log Management Platform OpenStack Service logs Logstash Forwarder on all nodes Data Collection and Transformation Agent An Analytics Engine and DataStore Data Exploration Interface
VMTP Tenant data path performance measurement tool VM to VM same network (private fixed IP, flow #1) VM to VM different network using fixed IP (same as intratenant L3 fixed IP, flow #2) VM to VM different network using floating IP and NAT (same as floating IP inter-tenant L3, flow #3) External host/vm download and upload throughput/latency (L3/floating IP, flow #4 and #5)
Light endpoint check Functional check Infra tests CloudPulse OpenStack Health Service Check Tool Nova list Cinder list Glance image-list Neutron net-list Keystone tenantlist Boot VM Create volume Attach volume Detach volume Delete volume Delete VM Database cluster status Rabbit cluster status HAProxy tests Create image Delete image
End-to-End Workflow
From Bare Metal to Video Workflows Rack and Stack ( Days ) Media Data Center Installer ( 2 Hours ) Workflow Template ( 30 Minutes )
Media Data Center and vdcm Demo Topology 172.31.228.13 10.0.13.10 Output (VM3) 172.31.228.15 10.0.13.12 Source (VM2) Sending multicast IP stream vdcm (VM1) Sends IGMP join requests 172.31.228.5 10.0.13.4
Summary - Media Data Center Spin up new revenue opportunities in minutes, not days Transform to a software driven, converged, reusable, infrastructure Provides a Cloud Platform with optimizations for media workloads
Call to Action Visit the World of Solutions for Cisco Campus Walk in Labs Technical Solution Clinics Meet the Engineer Lunch and Learn Topics DevNet zone related sessions
Complete Your Online Session Evaluation Please complete your online session evaluations after each session. Complete 4 session evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt. All surveys can be completed via the Cisco Live Mobile App or the Communication Stations
Thank you