TV & Video Services Verification Introducing a New Testing Approach. Goce Talaganov Business Unit Manager QoS/QoE

Transcription

1 TV & Video Services Verification Introducing a New Testing Approach Goce Talaganov Business Unit Manager QoS/QoE

2 SIGOS Entire Solutions for Business Optimization Technical Perspective in Business Assurance Active Testing & Monitoring in heterogenous networks Active Testing & Monitoring across countries End User Perspective to Assure Your Business Service Management with Quality of Service End-To-End Service Management with Customer Experience Service Management with App Experience in enterprise and telco Commercial Business Assurance Revenue Assurance with Fraud Management Revenue Assurance with Billing & Tariff Verification Expertise & Know How to Assure Your Business Success Utilization of your tools with SIGOS senior experts Page 2

3 SIGOS Testing & Monitoring for Business Optimization Roaming and Interconnect World s largest roaming test system GSMA 4G reference system #1 roaming rollout and services Interconnect Fraud Detection #1 fraud detection solution used Most innovative & certified solution Fastest fraud detection available End-to-End QoS & QoE Testing SITE: world leading active test system Testing & monitoring QoS and QoE All technologies, all services App Experience Testing & Monitoring Apps Largest global device bank Used by over 600 enterprises and mobile network operators Billing & Tariff Verification Most comprehensive active RA Any stage, any tariff, any promo National and roaming RA OPERATIONS REVENUE Page 3

4 Agenda Part1: Introduction to Video Services at Telcos What are the Challenges Current Video Strategies and Their Impact on Growth SIGOS Video Testing Solution, use cases and benefits Conclusion Part2 The science behind the Video Quality Indicators

5 VIDEO IS CRITICAL TO MOBILE OPERATOR STRATEGIES 37% Video revenues reached 37% between % of Telco traffic is accounted for Video Services Video allows operators to tap into new revenue streams for growth MAJORITY OF MEDIA CONSUMPTION IS MULTI SCREEN BASED Poor quality Good quality Video Quality is a key factor driving customer satisfaction with their mobile operators VIDEO CONSUMPTION TECHNOLOGY ENABLERS 4G 5G FTTH 40% of Telco services are related to video services Page 5 32% 30% Of screen time user spends on TV screen Of screen time user spends on Laptop/Tablets 38% Of screen time user spends on Smartphones

6 Page 6

7 QoE Assessment QoE=f(QoS;user;content) CONTENT Quality of Experience QoE USER Communication Network Quality of Service QoS Operators that demonstrate a high quality video experience (across all services) will have an advantage in attracting users. Page 7

8 Telco Challenges The rise of OTTs, If you cant beat them join them The dump pipe and how to tap into new revenue streams The rise of native video platform IPTV goes multi screen with ABR technology Competition is fierce from OTTs and from other Telcos The main differentiator to retain customer and get new ones will be QUALITY We try to address exactly the quality aspect with our Flexible Video Testing Solution and ensure customer satisfaction on the product offer and promises toward the end subscriber Page 8

9 Video Services Success Factors Page 9 Source: IHS Markit 2018 IHS Markit:

10 The Growth Impact on Different Telcos Video Strategies Page 10

11 Commercial Offers Examples Zero Rated Page 11

12 Commercial Offers Examples Bundled Page 12

13 Video Service Chain and Delivery Telco/Cable OTTs Origin Server CDN Mobile MultiScreen ABR/IPTV SERVICE PROVIDERS Content Packaging Encode/Transcode Capturing/Processing Core Network Transmission WiFI/Broadband STB OTT/Telco CONTENT PREP DELIVERY ACCESS ENDPOINT Display Page 13

14 Video Services Testing Needs and Challenges Primarily the goal is to ensure the customer bundled offer including ZeroRated apps, Mobile Video Services, Fixed Video Services, Voice, Internet etc. Mobile Video Service 1. Zero Rated Apps 2. Telcos Native Video App Residential Video Service 1. Telcos Native IPTV 2. OTTs Video Services Test Platform Needs Premium Smartphones Customer view QoE Easy way to record Customer juorneys and maintain them Any app support Automation Test Platform Needs Set-Top-Box support Customer view QoE Easy way to record Customer juorneys and maintain them Any STB support Automation Page 14 Test Application Needs ZeroRated App Content availability and Billing Menu browsing and availability Live TV Channels availability and verification Video on demand Catalogue availability and verification Live TV Channel switching and content delivery quality Video on demand (pay premium) transaction verification

15 HDMI Based Video Quality Testing One of the most flexible methods for Video Quality Testing is HDMI-based video quality testing, this allows a real flexible QoE testing approach for both Live and VoD content. SITE will introduce a Media Processing Unit (MPU) capable of capturing and analyzing video streams from HDMI input: Video capture via own SIGOS MPU Video analysis via 3 rd party algorithm (standardized KPIs) Main Use Case: Video Quality testing for STBs, Apple TVs, Amazon TVs, etc. HDMI STB Planned Availability: SITE 3.6 Video Test Probe MPU CLU5 Page 15

16 Introducing the Media Processing Unit Tasks: Capture HDMI Signal Split signal into Audio and Video KPI Calculation Supported Video Formats: HD, 4K SDR, HDCP Media Processing Unit Media Processing Unit (MPU) Specifications Power Dimensions Weight Needs 1 HDMI Interface for capturing video and audio 1 IR controller 12V DC (1), 8A, 60W BTU: mm (w) x 44mm (h) x 270mm (d) 5.6/8.5 kg (net/gross) 1 HU in 19 rack, 1 * power supply socket (2) Page 16

17 Media Processing Unit Logical and HW Interfaces Restfull API for Automation and Results IR Interface Video Quality KPIs Audio Quality KPIs HDMI Splitteer 1x2 HDMI Capture Interface IR Transmit Recieve HDMI Input HDMI Output IPTV/OTT Video Services Provider Page 17

18 Testing VoD Content on STB HDMI IR Media Processing Unit Automation Step 1: Browsing through the menu TV Apps Automation Step 2: Browsing through the menu activating Netflix Automation Step 3: Selecting a movie to play Automation Step 4: Play selected movie for X seconds Automation Step 5: Get Audio Video KPIs for Reporting and alarming Page 18

19 Testing Live TV Program Channels on STB HDMI IR Media Processing Unit Automation Step 1: Browsing through the TV Programs Automation Step 2: Switch to channel 1 Automation Step 3: Switch to channel 2 Automation Step 4: Switch to channel 3 etc.. Automation Step 5: Get Audio Video KPIs for Reporting and alarming Page 19

20 Testing OTT STB Apple TV or Roku TV Bluetooth HDMI Appex LU and MPU Apple TV Remote App Apple TV Box Automation Step 1: Navigate to Apps Folder Automation Step 2: Select YouTube Automation Step 3: Play Youtube video Automation Step 5: Get Audio Video KPIs for Reporting and alarming Page 20

21 Zero Rated Service testing Appex LU Easy point-and-click recorder for customer flows Validate success of each step via object, text and image Place timers to measure any step Single and multi-device test cases Creates reference CDR Continuous round the clock Monitoring 1. Select Zero Rated App 2. Record Customer flow per app and set timer KPIs 3. Run Scheduler, get KPIs and performance report/alarming Page 21

22 Relevant Video Quality KPIs Capturing/Processing Transmission Display Menu Blockiness ( ) Blur ( ) Contrast ( ) Exposure ( ) Flickering ( ) Interlacing ( ) Noise ( ) Spatial Activity ( ) Temporal Activity( ) Audio MOS ( ) Commercial Black ( ) Block Loss ( ) Freezing ( ) Slicing ( ) Audio MOS ( ) Commercial Black ( ) Letterboxing ( ) Pillarboxing ( ) Slicing ( ) Audio MOS ( ) Step Verification Success Channel Success rate Time to browse Time between steps The Science behind the Video KPIs will be elaborated in the second part of the workshop Page 22

23 Commercial Offering CU License (SW) Usecase: Video Testing LU License (SW/HW) MPU, one price SITE Page 23

24 Deployment options SITE Platform On-Premises Cloud Based Hardware Virtualized SITE in Cloud On-Demand Central Components are delivered as hardware Classical deployment with Software on COTS Central Components as images for operators virtualization environment Amazon Cloud compatible images Central Components are hosted in SIGOS cloud. Local Units are deployed either with perpetual or subscription based licenses All SITE components managed by SIGOS Designed for short term service quality audits and campaigns Page 24

25 Conclusion Video services are one of the main drivers for Telco's revenue growth Different strategies are used to gain new customers and to increase revenue Many operators start to bundle Video services for both mobile and residential accounts Operators that demonstrate a high quality video experience (across all services) will have an advantage in attracting users. No matter the strategy the Quality plays a key role for customer satisfaction on the product offer and promises toward the end subscriber Therefore the testing platform should provide a unified Flexible Video Service Testing on both Smartphones and on Set-Top-Boxes. Active E2E testing with SITE allows proactive service assurance and monitoring, making the NOC aware of the problem before a customer complain happens CONTACT US FOR AN EVALUATION OF YOUR VIDEO TESTING STRATEGIES Page 25

26 Thank you Page 26