C3: INTERNET-SCALE CONTROL PLANE FOR VIDEO QUALITY OPTIMIZATION
|
|
- Augustine Pope
- 5 years ago
- Views:
Transcription
1 C3: INTERNET-SCALE CONTROL PLANE FOR VIDEO QUALITY OPTIMIZATION Aditya Ganjam, Jibin Zhan, Xi Liu, Faisal Siddiqi, Conviva Junchen Jiang, Vyas Sekar, Carnegie Mellon University Ion Stoica, University of California, Berkeley, Conviva Hui Zhang, Carnegie Mellon University, Conviva
2 HIGH EXPECTATIONS ON VIDEO QUALITY Television High bitrate/resolution Interruption-free Fast start Need to optimize video quality through the lifetime of a session 2
3 WHERE TO IMPLEMENT OPTIMIZATION? Multiple choices for actuation Client-side actuation most favorable to incremental deployment CDN 1" Video Origin " ISP 1" Client CDN 2" Backbone Network" 3
4 MANY CHOICES & NEED QUICK DECISION Optimization parameters Ø Bitrate x CDN (over time) Existing approaches are reactive, apply a probe and update method Ø Too slow to find optimal choice Time CDN Resource Bitrate Bitrate 4
5 CENTRALIZED PREDICTIVE CONTROL Ideal solution Predict outcome of each parameter choice in real-time Continuously select optimal choice Logically Centralized Controller Prediction model based on global view Per-client decisions in real-time Achieving ideal solution requires Collect global quality information Quality Information Sub-second response Decisions Build a prediction model Make per-client predictions and Client parameter decisions at Internet-scale 5
6 CHALLENGE: CLIENT HETEROGENEITY Strawman: implement 100 times Heterogeneous software environments and interfaces Slow software update cycle Prediction model based on global view Quality Information Logically Centralized Controller Sub-second response Per-client decisions in real-time Decisions >100 unique client pla/orms Client 6
7 DESIGN CHOICE: THIN SENSING/ACTUATION LAYER Logically Centralized Controller Minimal client footprint Ø Move computation to controller Define a narrow waist interface Prediction model based on global view Quality Information Sub-second response Per-client decisions in real-time Decisions Client 7
8 CHALLENGE: REAL-TIME PREDICTIONS AT INTERNET SCALE Internet scale? Geographic scale - all continents Network scale - all network types Client scale 10s to 100s of millions concurrent Prediction model based on global view Quality Information Logically Centralized Controller Sub-second response Client Per-client decisions in real-time Decisions 8
9 CHALLENGE: REAL-TIME PREDICTIONS AT INTERNET SCALE Achieving real-time response, with the most recent global view at Internet-scale is not feasible based on today s technologies Strawman solutions Centralized global controller not real-time Partitioned controller no global view Prediction model based on global view Quality Information Logically Centralized Controller Sub-second response Client Per-client decisions in real-time Decisions 9
10 DESIGN CHOICE: SPLIT CONTROL PLANE Create a global prediction model in near real-time (minutes) Make per-client decisions in real-time (sub-second) based on global model and most recent per-client local information Prediction model based on global view Quality Information Logically Centralized Controller Sub-second response Client Per-client decisions in real-time Decisions 10
11 C3 ARCHITECTURE C3 Controller Modeling Layer near real-time global prediction modeling Decision Layer real-time per-client decisions Narrow waist protocol Session Data Model (SDM) Control Decisions Diverse Client Platforms Adaptor C3 Sensing/Actuation Layer Narrow waist device API ConvivaStreamerProxy (CSP) 11
12 C3 ARCHITECTURE C3 Controller Modeling Layer near real-time global prediction modeling Decision Layer real-time per-client decisions Narrow waist protocol Session Data Model (SDM) Control Decisions Diverse Client Platforms Adaptor C3 Sensing/Actuation Layer Narrow waist device API ConvivaStreamerProxy (CSP) 12
13 MOTIVATING EXAMPLE Compute Video Startup Time metric Default Op<on: Compute Video Startup Time in the client, send to controller Session start Ad start Ad end Play start Startup Time 1 = T(play start) T(session start) Startup Time 2 = T(play start) T(session start) (T(Ad end) T(Ad start)) How do we adapt to changes? 13
14 IDEA: EXPOSE LOW-LEVEL ACTIONS Metric calculation pushed to the controller Session Data Model (SDM) Events, States, Measurements States robustness to message loss Player States Joining Playing Buffering Playing Events Player Monitoring time Network/ stream connection established Video buffer filled up Video buffer empty Video download rate, Available bandwidth, Dropped frames, Frame rendering rate, etc. Buffer replenished sufficiently Stopped/ Exit User action 14
15 C3 ARCHITECTURE C3 Controller Modeling Layer near real-time global prediction modeling Decision Layer real-time per-client decisions Narrow waist protocol Session Data Model (SDM) Control Decisions Diverse Client Platforms Adaptor C3 Sensing/Actuation Layer Narrow waist device API ConvivaStreamerProxy (CSP) 15
16 SPLIT CONTROL-PLANE Dual-loop control Client-driven real-time loop (red) Periodic global model learning and dissemination loop (blue) Intelligent Decision Layer Per-client decisions based on global model and client quality info Aggregation across Clients SDM SDM Prediction Model Metric Computation & Per-client Decisions Control Decisions Prediction Model Training Modeling Layer Decision Layer Sensing/ Actuation Layer 16
17 WHY SPLIT CONTROL CAN ACHIEVE NEAR OPTIMAL PERFORMANCE Domain specific insight globally optimal decisions tend to be persistent on minute-level timescales Persistence results do not hold for individual clients - still need per-client up-todate state CDF CP A CP B CP C Persistence(min) Figure shows the distribu<on of persistence of the best CDN for three content providers 17
18 RESPONSIVENESS & SCALE Sub-second response time Geographically distributed decision layer Geo-distribution using cloud Controller scale Horizontally scaled decision layer Burst scaling using cloud Big-data technologies including Spark for modeling layer Physical View of C3 Controller Aggregation/ Compute Cluster Frontend Data Centers Clients 18
19 FAULT TOLERANCE Physical View of C3 Controller Decision layer gracefully degrades due to stale or missing global model Client-side failover and decision layer state reconstruction to handle instance failure Aggregation/ Compute Cluster Frontend Data Centers Clients 19
20 REAL-WORLD DEPLOYMENT & EVOLUTION Earlier phases explored alternate architectures Partitioning Heavy client (client offload of computation and decision logic) C3 platform used by premium video publishers over 8 years Over 1 billion unique devices Over 3 million concurrent devices during major events Ø E.g., World Cup, Super Bowl Significant quality improvement results 20
21 QUALITY IMPROVEMENT: REBUFFERING Premium content publisher One month A/B test Result: Greater then 50% reduction in Buffering Ratio BufRatio (%) Native control 1.5 C3 control /1/14 5/8/14 5/15/14 5/22/14 5/29/14 Time (mm/dd/yy) 21
22 QUALITY IMPROVEMENT: START FAILURES Premium content publisher One month A/B test Result: Greater then 60% reduction in Video Start Failures VSF (%) Native control 1 C3 control 0 5/1/14 5/8/14 5/15/14 5/22/14 5/29/14 TIme (mm/dd/yy) 22
23 QUALITY IMPROVEMENT ACROSS PROVIDERS Rebuffering Ratio improvement consistent results across 5 different content providers BufRatio (%) Native control 2 C3 control Content Providers 23
24 LESSONS Validates centralized control at an unprecedented scale Reinforces the case for centralized control Drivers: client heterogeneity, global policies, real-time monitoring Enablers: big-data, cloud, application-level resilience Unique challenges driving new ideas Split control balances global view and real-time Minimal client critical to handle heterogeneity Broader applicability of C3 architecture Other applications (e.g., gaming, voice, conferencing) Network layer control (e.g., SDN, CDN) 24
25 CONCLUSIONS Television is coming to the Internet, high expectations on quality Large optimization space for video quality Ø Drives the need for a proactive approach C3 is a centralized predictive control approach Solves key challenges: (a) client heterogeneity, (b) Internet-scale Minimal sensing/actuation layer & move all computation to the controller Split control-plane scale-out solution exploiting application-level resilience C3 used by many content providers with quality improvement results 25
Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation
Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation Junchen Jiang, Carnegie Mellon University; Shijie Sun, Tsinghua University; Vyas Sekar, Carnegie
More informationIt s Not the Cost, It s the Quality! Ion Stoica Conviva Networks and UC Berkeley
It s Not the Cost, It s the Quality! Ion Stoica Conviva Networks and UC Berkeley 1 A Brief History! Fall, 2006: Started Conviva with Hui Zhang (CMU)! Initial goal: use p2p technologies to reduce distribution
More informationPractical, Real-time Centralized Control for CDN-based Live Video Delivery
Practical, Real-time Centralized Control for CDN-based Live Video Delivery Matt Mukerjee, David Naylor, Junchen Jiang, Dongsu Han, Srini Seshan, Hui Zhang Combating Latency in Wide Area Control Planes
More informationVideo AI Alerts An Artificial Intelligence-Based Approach to Anomaly Detection and Root Cause Analysis for OTT Video Publishers
Video AI Alerts An Artificial Intelligence-Based Approach to Anomaly Detection and Root Cause Analysis for OTT Video Publishers Live and on-demand programming delivered by over-the-top (OTT) will soon
More informationA Routing Infrastructure for XIA
A Routing Infrastructure for XIA Aditya Akella and Peter Steenkiste Dave Andersen, John Byers, David Eckhardt, Sara Kiesler, Jon Peha, Adrian Perrig, Srini Seshan, Marvin Sirbu, Hui Zhang FIA PI Meeting,
More informationCFA: A Practical Prediction System for Video QoE Optimization
CFA: A Practical Prediction System for Video QoE Optimization Junchen Jiang, Vyas Sekar, Henry Milner, Davis Shepherd +, Ion Stoica +, Hui Zhang + CMU, UC Berkeley, + Conviva, Databricks Abstract Many
More informationQ Conviva s State of the Streaming TV Industry
1 Conviva s State of the Streaming TV Industry Q3 2018 Conviva is the real-time measurement and intelligence platform for streaming TV, with a global footprint of 50 billion streams per year across 3 billion
More informationUpgrade Your MuleESB with Solace s Messaging Infrastructure
The era of ubiquitous connectivity is upon us. The amount of data most modern enterprises must collect, process and distribute is exploding as a result of real-time process flows, big data, ubiquitous
More informationEnabling Data-Driven Optimization of Quality of Experience in Internet Applications. Junchen Jiang
Enabling Data-Driven Optimization of Quality of Experience in Internet Applications Junchen Jiang CMU-CS-17-119 September 11, 217 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213
More informationApache Spark is a fast and general-purpose engine for large-scale data processing Spark aims at achieving the following goals in the Big data context
1 Apache Spark is a fast and general-purpose engine for large-scale data processing Spark aims at achieving the following goals in the Big data context Generality: diverse workloads, operators, job sizes
More informationIQ for DNA. Interactive Query for Dynamic Network Analytics. Haoyu Song. HUAWEI TECHNOLOGIES Co., Ltd.
IQ for DNA Interactive Query for Dynamic Network Analytics Haoyu Song www.huawei.com Motivation Service Provider s pain point Lack of real-time and full visibility of networks, so the network monitoring
More informationCache Management for TelcoCDNs. Daphné Tuncer Department of Electronic & Electrical Engineering University College London (UK)
Cache Management for TelcoCDNs Daphné Tuncer Department of Electronic & Electrical Engineering University College London (UK) d.tuncer@ee.ucl.ac.uk 06/01/2017 Agenda 1. Internet traffic: trends and evolution
More informationJunchen Jiang. 513 N. Neville St. Apt C3, Pittsburgh, PA, URL: https://www.cs.cmu.edu/ junchenj/
Junchen Jiang 513 N. Neville St. Apt C3, Pittsburgh, PA, 15213 Email: junchenj@cs.cmu.edu URL: https://www.cs.cmu.edu/ junchenj/ RESEARCH INTERESTS Computer networks, distributed systems, big data, and
More informationSparrow. Distributed Low-Latency Spark Scheduling. Kay Ousterhout, Patrick Wendell, Matei Zaharia, Ion Stoica
Sparrow Distributed Low-Latency Spark Scheduling Kay Ousterhout, Patrick Wendell, Matei Zaharia, Ion Stoica Outline The Spark scheduling bottleneck Sparrow s fully distributed, fault-tolerant technique
More informationJunchen Jiang. 200 West 16th Street, New York, NY, URL: https://www.cs.cmu.
Junchen Jiang 200 West 16th Street, New York, NY, 10011 Email: junchenj@uchicago.edu, junchenj@cs.cmu.edu URL: https://www.cs.cmu.edu/ junchenj/ RESEARCH INTERESTS Computer networks, large-scale data analytics
More informationThe Edge: Delivering the Quality of Experience of Digital Content
The Edge: Delivering the Quality of Experience of Digital Content 2016 EDITION By Conviva for EdgeConneX As video consumption evolves from single screen to multi-screen, the burden on the Internet and
More informationQuartzV: Bringing Quality of Time to Virtual Machines
QuartzV: Bringing Quality of Time to Virtual Machines Sandeep D souza and Raj Rajkumar Carnegie Mellon University IEEE RTAS @ CPS Week 2018 1 A Shared Notion of Time Coordinated Actions Ordering of Events
More informationThe Guide to Best Practices in PREMIUM ONLINE VIDEO STREAMING
AKAMAI.COM The Guide to Best Practices in PREMIUM ONLINE VIDEO STREAMING PART 3: STEPS FOR ENSURING CDN PERFORMANCE MEETS AUDIENCE EXPECTATIONS FOR OTT STREAMING In this third installment of Best Practices
More informationDatacenter replication solution with quasardb
Datacenter replication solution with quasardb Technical positioning paper April 2017 Release v1.3 www.quasardb.net Contact: sales@quasardb.net Quasardb A datacenter survival guide quasardb INTRODUCTION
More informationTesting & Assuring Mobile End User Experience Before Production Neotys
Testing & Assuring Mobile End User Experience Before Production Neotys Henrik Rexed Agenda Introduction The challenges Best practices NeoLoad mobile capabilities Mobile devices are used more and more At
More informationBayeux: An Architecture for Scalable and Fault Tolerant Wide area Data Dissemination
Bayeux: An Architecture for Scalable and Fault Tolerant Wide area Data Dissemination By Shelley Zhuang,Ben Zhao,Anthony Joseph, Randy Katz,John Kubiatowicz Introduction Multimedia Streaming typically involves
More informationScaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX
Scaling Internet TV Content Delivery ALEX GUTARIN DIRECTOR OF ENGINEERING, NETFLIX Inventing Internet TV Available in more than 190 countries 104+ million subscribers Lots of Streaming == Lots of Traffic
More informationTrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa
TrafficDB: HERE s High Performance Shared-Memory Data Store Ricardo Fernandes, Piotr Zaczkowski, Bernd Göttler, Conor Ettinoffe, and Anis Moussa EPL646: Advanced Topics in Databases Christos Hadjistyllis
More informationInternet Services and Search Engines. Amin Vahdat CSE 123b May 2, 2006
Internet Services and Search Engines Amin Vahdat CSE 123b May 2, 2006 Midterm: May 9 Annoucements Second assignment due May 15 Lessons from Giant-Scale Services Service Replication Service Partitioning
More informationOboe: Auto-tuning Video ABR Algorithms to Network Conditions
Oboe: Auto-tuning Video ABR Algorithms to Network Conditions Zahaib Akhtar, Yun Seong Nam, Ramesh Govindan, Sanjay Rao, Jessica Chen, Ethan Katz-Bassett, Bruno Ribeiro, Jibin Zhan, Hui Zhang : Co-primary
More informationA Cloud Gateway - A Large Scale Company s First Line of Defense. Mikey Cohen Manager - Edge Gateway Netflix
A Cloud - A Large Scale Company s First Line of Defense Mikey Cohen Manager - Edge Netflix Today, more than 36% of North America s internet traffic is controlled by systems in the Amazon Cloud Global
More informationMobile Middleware Course. Mobile Platforms and Middleware. Sasu Tarkoma
Mobile Middleware Course Mobile Platforms and Middleware Sasu Tarkoma Role of Software and Algorithms Software has an increasingly important role in mobile devices Increase in device capabilities Interaction
More informationHPC in Cloud. Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni
HPC in Cloud Presenter: Naresh K. Sehgal Contributors: Billy Cox, John M. Acken, Sohum Sohoni 2 Agenda What is HPC? Problem Statement(s) Cloud Workload Characterization Translation from High Level Issues
More informationTCP WISE: One Initial Congestion Window Is Not Enough
TCP WISE: One Initial Congestion Window Is Not Enough Xiaohui Nie $, Youjian Zhao $, Guo Chen, Kaixin Sui, Yazheng Chen $, Dan Pei $, MiaoZhang, Jiyang Zhang $ 1 Motivation Web latency matters! latency
More informationData Center Performance
Data Center Performance George Porter CSE 124 Feb 15, 2017 *Includes material taken from Barroso et al., 2013, UCSD 222a, and Cedric Lam and Hong Liu (Google) Part 1: Partitioning work across many servers
More informationDesign Patterns for the Cloud. MCSN - N. Tonellotto - Distributed Enabling Platforms 68
Design Patterns for the Cloud 68 based on Amazon Web Services Architecting for the Cloud: Best Practices Jinesh Varia http://media.amazonwebservices.com/aws_cloud_best_practices.pdf 69 Amazon Web Services
More informationebay Marketplace Architecture
ebay Marketplace Architecture Architectural Strategies, Patterns, and Forces Randy Shoup, ebay Distinguished Architect QCon SF 2007 November 9, 2007 What we re up against ebay manages Over 248,000,000
More informationCloud Transcoder: Bridging the Format and Resolution Gap between Internet Videos and Mobile Devices
Cloud Transcoder: Bridging the Format and Resolution Gap between Internet Videos and Mobile Devices Zhenhua Li, Peking University Yan Huang, Gang Liu, Fuchen Wang, Tencent Research Zhi-Li Zhang, University
More informationThe Guide to Best Practices in PREMIUM ONLINE VIDEO STREAMING
AKAMAI.COM The Guide to Best Practices in PREMIUM ONLINE VIDEO STREAMING PART 1: MANAGING THE FIRST MILE True differentiation in quality and consistency can only be achieved through adherence to best practices
More informationSoftware-Defined Networking (SDN) Overview
Reti di Telecomunicazione a.y. 2015-2016 Software-Defined Networking (SDN) Overview Ing. Luca Davoli Ph.D. Student Network Security (NetSec) Laboratory davoli@ce.unipr.it Luca Davoli davoli@ce.unipr.it
More informationDistributed Computation Models
Distributed Computation Models SWE 622, Spring 2017 Distributed Software Engineering Some slides ack: Jeff Dean HW4 Recap https://b.socrative.com/ Class: SWE622 2 Review Replicating state machines Case
More informationNovember 2017 WebRTC for Live Media and Broadcast Second screen and CDN traffic optimization. Author: Jesús Oliva Founder & Media Lead Architect
November 2017 WebRTC for Live Media and Broadcast Second screen and CDN traffic optimization Author: Jesús Oliva Founder & Media Lead Architect Introduction It is not a surprise if we say browsers are
More informationexpressive Internet Architecture:
expressive Internet Architecture: GEC 15 Demo Matt Mukerjee and David Naylor! Peter Steenkiste! Dave Andersen, David Eckhardt, Sara Kiesler, Jon Peha, Adrian Perrig, Srini Seshan, Marvin Sirbu, Hui Zhang
More informationOpen Connect Overview
Open Connect Overview What is Netflix Open Connect? Open Connect is the name of the global network that is responsible for delivering Netflix TV shows and movies to our members world wide. This type of
More informationManaging the Subscriber Experience
Managing the Subscriber Experience Steven Shalita TelcoVision 2013 October 24, 2013 Las Vegas 1 1 Service Delivery Orchestration More Important Than Ever Exponential Growth in Data & Video Traffic Personalized
More informationGreen networking: lessons learned and challenges Prof. Raffaele Bolla CNIT/University of Genoa
Telecommunication s and Telematics Lab Green networking: lessons learned and challenges Prof. Raffaele Bolla raffaele.bolla@unige.it CNIT/University of Genoa Department of Naval, Electrical, Electronics
More informationMultimedia Streaming. Mike Zink
Multimedia Streaming Mike Zink Technical Challenges Servers (and proxy caches) storage continuous media streams, e.g.: 4000 movies * 90 minutes * 10 Mbps (DVD) = 27.0 TB 15 Mbps = 40.5 TB 36 Mbps (BluRay)=
More informationArchitectures for Carrier Network Evolution
Architectures for Carrier Network Evolution Raj Jain Washington University in Saint Louis Saint Louis, MO 63130 Jain@cse.wustl.edu Talk at Docomo USA Labs, Palo Alto, CA, May 14, 2011 Audio/Video Recordings
More informationBUILDING LARGE VOD LIBRARIES WITH NEXT GENERATION ON DEMAND ARCHITECTURE. Weidong Mao Comcast Fellow Office of the CTO Comcast Cable
BUILDING LARGE VOD LIBRARIES WITH NEXT GENERATION ON DEMAND ARCHITECTURE Weidong Mao Comcast Fellow Office of the CTO Comcast Cable Abstract The paper presents an integrated Video On Demand (VOD) content
More informationOverlay networks. Today. l Overlays networks l P2P evolution l Pastry as a routing overlay example
Overlay networks Today l Overlays networks l P2P evolution l Pastry as a routing overlay eample Network virtualization and overlays " Different applications with a range of demands/needs network virtualization
More informationCarrier SDN for Multilayer Control
Carrier SDN for Multilayer Control Savings and Services Víctor López Technology Specialist, I+D Chris Liou Vice President, Network Strategy Dirk van den Borne Solution Architect, Packet-Optical Integration
More informationIBM Data Science Experience White paper. SparkR. Transforming R into a tool for big data analytics
IBM Data Science Experience White paper R Transforming R into a tool for big data analytics 2 R Executive summary This white paper introduces R, a package for the R statistical programming language that
More informationComplex Interactions in Content Distribution Ecosystem and QoE
Complex Interactions in Content Distribution Ecosystem and QoE Zhi-Li Zhang Qwest Chair Professor & Distinguished McKnight University Professor Dept. of Computer Science & Eng., University of Minnesota
More informationCopyright 2016 Pivotal. All rights reserved. Cloud Native Design. Includes 12 Factor Apps
1 Cloud Native Design Includes 12 Factor Apps Topics 12-Factor Applications Cloud Native Design Guidelines 2 http://12factor.net Outlines architectural principles and patterns for modern apps Focus on
More informationVOLTDB + HP VERTICA. page
VOLTDB + HP VERTICA ARCHITECTURE FOR FAST AND BIG DATA ARCHITECTURE FOR FAST + BIG DATA FAST DATA Fast Serve Analytics BIG DATA BI Reporting Fast Operational Database Streaming Analytics Columnar Analytics
More information2/26/2017. Originally developed at the University of California - Berkeley's AMPLab
Apache is a fast and general engine for large-scale data processing aims at achieving the following goals in the Big data context Generality: diverse workloads, operators, job sizes Low latency: sub-second
More informationDynamo. Smruti R. Sarangi. Department of Computer Science Indian Institute of Technology New Delhi, India. Motivation System Architecture Evaluation
Dynamo Smruti R. Sarangi Department of Computer Science Indian Institute of Technology New Delhi, India Smruti R. Sarangi Leader Election 1/20 Outline Motivation 1 Motivation 2 3 Smruti R. Sarangi Leader
More informationImproving Video Quality by Information Sharing!! Ion Stoica, CTO! (also at UC Berkeley and Databricks)!!
Improving Video Quality by Information Sharing!! Ion Stoica, CTO! (also at UC Berkeley and Databricks)!! Across many sites We ve seen 3 patterns While monitoring more than 4 Billion streams per month 1
More informationCloud Native Architecture 300. Copyright 2014 Pivotal. All rights reserved.
Cloud Native Architecture 300 Copyright 2014 Pivotal. All rights reserved. Cloud Native Architecture Why What How Cloud Native Architecture Why What How Cloud Computing New Demands Being Reactive Cloud
More informationirtc: Live Broadcasting
1 irtc: Live Broadcasting Delivering ultra-low-latency media at massive scale with LiveSwitch and WebRTC Introduction In the early days of the Internet and personal computing, it wasn t uncommon to wait
More informationArcGIS Enterprise: An Introduction. Philip Heede
Enterprise: An Introduction Philip Heede Online Enterprise Hosted by Esri (SaaS) - Upgraded automatically (by Esri) - Esri controls SLA Core Web GIS functionality (Apps, visualization, smart mapping, analysis
More informationData Driven Networks. Sachin Katti
Data Driven Networks Sachin Katti Is it possible for to Learn the control planes of networks and applications? Operators specify what they want, and the system learns how to deliver CAN WE LEARN THE CONTROL
More informationMapReduce: Simplified Data Processing on Large Clusters 유연일민철기
MapReduce: Simplified Data Processing on Large Clusters 유연일민철기 Introduction MapReduce is a programming model and an associated implementation for processing and generating large data set with parallel,
More informationIntroduction to Big-Data
Introduction to Big-Data Ms.N.D.Sonwane 1, Mr.S.P.Taley 2 1 Assistant Professor, Computer Science & Engineering, DBACER, Maharashtra, India 2 Assistant Professor, Information Technology, DBACER, Maharashtra,
More informationSelf Programming Networks
Self Programming Networks Is it possible for to Learn the control planes of networks and applications? Operators specify what they want, and the system learns how to deliver CAN WE LEARN THE CONTROL PLANE
More informationProblem Statement of Edge Computing beyond Access Network for Industrial IoT
Problem Statement of Edge Computing beyond Access Network for Industrial IoT draft-geng-iiot-edge-computing-problem-statement-00 Liang Geng, China Mobile Mingui Zhang, Mike McBride (Presenter), Bing Liu,
More informationA Platform for Fine-Grained Resource Sharing in the Data Center
Mesos A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony Joseph, Randy Katz, Scott Shenker, Ion Stoica University of California,
More information@unterstein #bedcon. Operating microservices with Apache Mesos and DC/OS
@unterstein @dcos @bedcon #bedcon Operating microservices with Apache Mesos and DC/OS 1 Johannes Unterstein Software Engineer @Mesosphere @unterstein @unterstein.mesosphere 2017 Mesosphere, Inc. All Rights
More informationData Driven Networks
Data Driven Networks Is it possible for to Learn the control planes of networks and applications? Operators specify what they want, and the system learns how to deliver CAN WE LEARN THE CONTROL PLANE OF
More informationOverview Computer Networking Lecture 16: Delivering Content: Peer to Peer and CDNs Peter Steenkiste
Overview 5-44 5-44 Computer Networking 5-64 Lecture 6: Delivering Content: Peer to Peer and CDNs Peter Steenkiste Web Consistent hashing Peer-to-peer Motivation Architectures Discussion CDN Video Fall
More informationACANO SOLUTION RESILIENT ARCHITECTURE. White Paper. Mark Blake, Acano CTO
ACANO SOLUTION RESILIENT ARCHITECTURE White Paper Mark Blake, Acano CTO September 2014 CONTENTS Introduction... 3 Definition of Resilience... 3 Achieving Resiliency... 4 Managing Your Data Secure from
More informationRaj Jain (Washington University in Saint Louis) Mohammed Samaka (Qatar University)
APPLICATION DEPLOYMENT IN FUTURE GLOBAL MULTI-CLOUD ENVIRONMENT Raj Jain (Washington University in Saint Louis) Mohammed Samaka (Qatar University) GITMA 2015 Conference, St. Louis, June 23, 2015 These
More informationBetter End-to-End Adaptation Using Centralized Predictive Control
Better End-to-End Adaptation Using Centralized Predictive Control Junchen Jiang July 2, 2015 School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 Thesis Committee: Hui Zhang, Co-Chair
More informationJoint Server Selection and Routing for Geo-Replicated Services
Joint Server Selection and Routing for Geo-Replicated Services Srinivas Narayana Joe Wenjie Jiang, Jennifer Rexford and Mung Chiang Princeton University 1 Large-scale online services Search, shopping,
More informationBlended Learning Outline: Developer Training for Apache Spark and Hadoop (180404a)
Blended Learning Outline: Developer Training for Apache Spark and Hadoop (180404a) Cloudera s Developer Training for Apache Spark and Hadoop delivers the key concepts and expertise need to develop high-performance
More informationMikko Ohvo Business Development Manager Nokia
HW Solution for distributed edge data centers Mikko Ohvo Business Development Manager Nokia HW Solution for distributed edge data centers Introduction In this presentation Nokia will share design considerations
More informationHuawei CloudFabric Solution Optimized for High-Availability/Hyperscale/HPC Environments
Huawei CloudFabric Solution Optimized for High-Availability/Hyperscale/HPC Environments CloudFabric Solution Optimized for High-Availability/Hyperscale/HPC Environments Internet Finance HPC VPC Industry
More informationOctoshape. Commercial hosting not cable to home, founded 2003
Octoshape Commercial hosting not cable to home, founded 2003 Broadcasting fee is paid by broadcasters Free for consumers Audio and Video, 32kbps to 800kbps Mesh based, bit-torrent like, Content Server
More informationRecord Placement Based on Data Skew Using Solid State Drives
Record Placement Based on Data Skew Using Solid State Drives Jun Suzuki 1, Shivaram Venkataraman 2, Sameer Agarwal 2, Michael Franklin 2, and Ion Stoica 2 1 Green Platform Research Laboratories, NEC j-suzuki@ax.jp.nec.com
More informationAddressing the Challenges of Web Data Transport
Addressing the Challenges of Web Data Transport Venkata N. Padmanabhan Microsoft Research UW Whistler Retreat December 1998 Outline Challenges Solutions TCP Session Fast Start Ongoing and Future Work The
More informationJAVASCRIPT CHARTING. Scaling for the Enterprise with Metric Insights Copyright Metric insights, Inc.
JAVASCRIPT CHARTING Scaling for the Enterprise with Metric Insights 2013 Copyright Metric insights, Inc. A REVOLUTION IS HAPPENING... 3! Challenges... 3! Borrowing From The Enterprise BI Stack... 4! Visualization
More informationFOUR WAYS TO LOWER THE COST OF REPLICATION
WHITE PAPER I JANUARY 2010 FOUR WAYS TO LOWER THE COST OF REPLICATION How an Ultra-Efficient, Virtualized Storage Platform Brings Disaster Recovery within Reach for Any Organization FOUR WAYS TO LOWER
More informationMore on Testing and Large Scale Web Apps
More on Testing and Large Scale Web Apps Testing Functionality Tests - Unit tests: E.g. Mocha - Integration tests - End-to-end - E.g. Selenium - HTML CSS validation - forms and form validation - cookies
More informationEmbracing Failure. Fault Injec,on and Service Resilience at Ne6lix. Josh Evans Director of Opera,ons Engineering, Ne6lix
Embracing Failure Fault Injec,on and Service Resilience at Ne6lix Josh Evans Director of Opera,ons Engineering, Ne6lix Josh Evans 24 years in technology Tech support, Tools, Test Automa,on, IT & QA Management
More informationEvolving Prometheus for the Cloud Native World. Brian Brazil Founder
Evolving Prometheus for the Cloud Native World Brian Brazil Founder Who am I? Engineer passionate about running software reliably in production. Core developer of Prometheus Studied Computer Science in
More informationIPv6. Akamai. Faster Forward with IPv6. Eric Lei Cao Head, Network Business Development Greater China Akamai Technologies
Akamai Faster Forward with IPv6 IPv6 Eric Lei Cao clei@akamai.com Head, Network Business Development Greater China Agenda What is Akamai? Akamai s IPv6 Capabilities Experiences & Lessons Measuring IPv6
More informationCurrent Trends in IP/Optical Transport Integration
Current Trends in IP/Optical Transport Integration Harald Bock, CTO Technology Strategy, Coriant September 2014 Market Dynamics: A New ed World A New Kind of Business A New Kind Customer of Business Customer
More informationNeural Adaptive Content-aware Internet Video Delivery. Hyunho Yeo, Youngmok Jung, Jaehong Kim, Jinwoo Shin, Dongsu Han
Neural Adaptive Content-aware Internet Video Delivery Hyunho Yeo, Youngmok Jung, Jaehong Kim, Jinwoo Shin, Dongsu Han Observation on Current Video Ecosystem 2 Adaptive streaming has been widely deployed
More informationebay s Architectural Principles
ebay s Architectural Principles Architectural Strategies, Patterns, and Forces for Scaling a Large ecommerce Site Randy Shoup ebay Distinguished Architect QCon London 2008 March 14, 2008 What we re up
More informationTake Risks But Don t Be Stupid! Patrick Eaton, PhD
Take Risks But Don t Be Stupid! Patrick Eaton, PhD preaton@google.com Take Risks But Don t Be Stupid! Patrick R. Eaton, PhD patrick@stackdriver.com Stackdriver A hosted service providing intelligent monitoring
More informationOverview. Prerequisites. Course Outline. Course Outline :: Apache Spark Development::
Title Duration : Apache Spark Development : 4 days Overview Spark is a fast and general cluster computing system for Big Data. It provides high-level APIs in Scala, Java, Python, and R, and an optimized
More informationMobile Edge Computing for 5G: The Communication Perspective
Mobile Edge Computing for 5G: The Communication Perspective Kaibin Huang Dept. of Electrical & Electronic Engineering The University of Hong Kong Hong Kong Joint Work with Yuyi Mao (HKUST), Changsheng
More informationESM Live Broadcast System. Hui Zhang Carnegie Mellon University
ESM Live Broadcast System Hui Zhang Carnegie Mellon University / 1 Agenda Overview of End System Multicast (ESM) Deployment Experience ESM Setup Questions and Answers 2 Support Ubiquitous Broadcast over
More informationVarys. Efficient Coflow Scheduling. Mosharaf Chowdhury, Yuan Zhong, Ion Stoica. UC Berkeley
Varys Efficient Coflow Scheduling Mosharaf Chowdhury, Yuan Zhong, Ion Stoica UC Berkeley Communication is Crucial Performance Facebook analytics jobs spend 33% of their runtime in communication 1 As in-memory
More informationOptimizing Apache Spark with Memory1. July Page 1 of 14
Optimizing Apache Spark with Memory1 July 2016 Page 1 of 14 Abstract The prevalence of Big Data is driving increasing demand for real -time analysis and insight. Big data processing platforms, like Apache
More informationApache Ignite TM - In- Memory Data Fabric Fast Data Meets Open Source
Apache Ignite TM - In- Memory Data Fabric Fast Data Meets Open Source DMITRIY SETRAKYAN Founder, PPMC https://ignite.apache.org @apacheignite @dsetrakyan Agenda About In- Memory Computing Apache Ignite
More informationSwarm at the Edge of the Cloud. John Kubiatowicz UC Berkeley Swarm Lab September 29 th, 2013
Slide 1 John Kubiatowicz UC Berkeley Swarm Lab September 29 th, 2013 Disclaimer: I m not talking about the run- of- the- mill Internet of Things When people talk about the IoT, they often seem to be talking
More informationAWS Lambda: Event-driven Code in the Cloud
AWS Lambda: Event-driven Code in the Cloud Dean Bryen, Solutions Architect AWS Andrew Wheat, Senior Software Engineer - BBC April 15, 2015 London, UK 2015, Amazon Web Services, Inc. or its affiliates.
More informationFrom Single Purpose to Multi Purpose Data Lakes. Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019
From Single Purpose to Multi Purpose Data Lakes Thomas Niewel Technical Sales Director DACH Denodo Technologies March, 2019 Agenda Data Lakes Multiple Purpose Data Lakes Customer Example Demo Takeaways
More informationSMORE: Semi-Oblivious Traffic Engineering
SMORE: Semi-Oblivious Traffic Engineering Praveen Kumar * Yang Yuan* Chris Yu Nate Foster* Robert Kleinberg* Petr Lapukhov # Chiun Lin Lim # Robert Soulé * Cornell CMU # Facebook USI Lugano WAN Traffic
More informationSEER: LEVERAGING BIG DATA TO NAVIGATE THE COMPLEXITY OF PERFORMANCE DEBUGGING IN CLOUD MICROSERVICES
SEER: LEVERAGING BIG DATA TO NAVIGATE THE COMPLEXITY OF PERFORMANCE DEBUGGING IN CLOUD MICROSERVICES Yu Gan, Yanqi Zhang, Kelvin Hu, Dailun Cheng, Yuan He, Meghna Pancholi, and Christina Delimitrou Cornell
More informationCloud-Native Applications. Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0
Cloud-Native Applications Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0 Cloud-Native Characteristics Lean Form a hypothesis, build just enough to validate or disprove it. Learn
More informationInteractive Branched Video Streaming and Cloud Assisted Content Delivery
Interactive Branched Video Streaming and Cloud Assisted Content Delivery Niklas Carlsson Linköping University, Sweden @ Sigmetrics TPC workshop, Feb. 2016 The work here was in collaboration... Including
More informationSOLUTION BRIEF Enterprise WAN Agility, Simplicity and Performance with Software-Defined WAN
S O L U T I O N O V E R V I E W SOLUTION BRIEF Enterprise WAN Agility, Simplicity and Performance with Software-Defined WAN Today s branch office users are consuming more wide area network (WAN) bandwidth
More informationPage 1. Outline / Computer Networking : 1 st Generation Commercial PC/Packet Video Technologies
Outline 15-441/15-641 Computer Networking Lecture 18 Internet Video Delivery Peter Steenkiste Slides by Professor Hui Zhang Background Technologies: - HTTP download - Real-time streaming - HTTP streaming
More information