MPEG Workshop. Next Generation Media Services and Technologies. Media Tech. R&D Center. Dr. Jongmin Lee (Center Leader)

Transcription

1 MPEG Workshop Next Generation Media Services and Technologies Media Tech. R&D Center Dr. Jongmin Lee (Center Leader)

2 The time will soon come when everyone can create, deliver and consume video data everywhere based on 5G network infra Mobile video service is now rapidly evolving Main keyword: 4K/8K UHD, AR/VR, 3-D, N-screen Many SKT s multi-media services are developed / developing based on MPEG technologies and systems HEVC, AVC, MMT, etc.

3 Media Service Trend

4 Media Service Trend Mobile video traffic is rapidly increasing Video Traffic Audio, Video Web, Traffic etc. Traffic Daily average T Byte `16 `17 `18 `19 `20 `21 Global Mobile Live Broadcasting Traffic forecast, Cisco 2016 All these devices increase mobile video traffic!

5 Media Service Trend Mobile Media Market Trend Desktop Smart phone / Tablets $ Billion Global Online Media Market Media Devices (%), *Ref. from StatCounter ( ) ,926 2,587 $ Million South Korea Media Market *Ref. from STRABASE ( ) Cord-cutting ratio in US.

6 Media Service Trend Source: Mary Meeker, Internet Trends 2016

7 SKT s Media Services Fixed IPTV ( ), Mobile IPTV ( ), 360 VR VoD / Live, etc 8K UHD IPTV Trial (`15.10), 4K IPTV Commercialization (`14.4) UHD Multi-View (`16.9) Adaptive Oksusu VR Streaming Service(`16.10) AI Voice Recognizer / Speaker 360 VR Real-time Streaming Oksusu Mobile IPTV Commercialization (`17.10)

8 SKT s Global Working Developing the next-generation TV platform for the U.S market Various MPEG technologies were adopted into ATSC 3.0, especially, HEVC, DASH, and MMT. Highly contributed to the MPEG, MMT standard activity. Hybrid media delivery is the core function leads an enhanced UX of media consumption. Adopted the various MPEG technologies in SKT s media services HEVC, and MMT (including mobile MMT) were integrated in Oksusu Leads the MPEG project with global companies for preparing the 5G media infrastructures.

9 SK s Media Integrated Platform and Services for 5G Network

10 Architecture for SK s Media Services SK s Media Service Delivery System is configured as 1Create & Casting, 2Encoding & Value Add, 3Delivery & Publish with live and VoD types Create & Casting [Source] Encoding & Value Add [Head end] Deliver & Publish [CDN- 서초 / 일산 / 분당 IDC] Live Player Cameras Live Up Streaming Baseband Signal Live Controller Live Relay streaming Encoding & Meta Mgmt. (EPG) Live Relay Streaming Streaming Origin/Edge Live Streaming Live Live Services 서비스 VoD서비스 Services Cast & Upload Mgr Control Message Media Process Scheduleer DVR & Transcode FileLive & Ads. Mux Media Delivery Indicator Control Message Media Platform API VoD Player File Upload File Upload VoD Pull Download & VoD Streaming Media Files Upload Controller Storage Cache Origin/Edge

11 API Layer Media Processing Infra Layer Media Delivery Infra Layer T-MIP: SKT Media Integrated Platform Policy Flow Mgr. Ops. Tool Statistics Media Service Functional Architecture Media Services Subscriber Mgmt. Billing & Auth. Media Platform Open API & SDK Orchestrator Media Service Management API IPTV Upload Processing Publisher Security & Analysis Value added Cast Mgr Cast URL Indicator 360 AR/VR Live/VoD Encode/Trans. Broadcast Programming Smart URL Indicator Analytics DRM Ads. Mgmt. & Injector Chatting Injector Mobile TV UpScaler HDR/SR StreamSwitch/ Time Shift One time URL generator Device/Region Detector Media vinfra Management API OTT Media Deliver Indicator vcache vstreamer MLR AV Encoder Media Service App. Container MCN Infrastructure Abstraction Resoure Alloc. App Distributer Multi Commander App Repo. Open H/W (Head End/IDC/AWS) Repository Processor

12 T-MIP: SKT Media Integrated Platform AO reference point PO reference point DO reference point IO reference point MOL (Media Orchestrator Layer) Architectural Model for Media Service Entity Attachment Media Services & Applications (B2B services and B2C services) MAL (Media API Layer) MA reference point MPL (Media Processing Layer) MDL (Media Delivery Layer) MP reference point MD reference point MI reference point MIAL (Media Infra Abstraction Layer) MR reference point Media Resources (Fixed/mobile network + Cloud infra[e.g., AWS, Azure)

13 SKT-MIP based Solutions OVP-Online Video Platform Interworking web admin. tool Open API SDK Doc. Sample Service Contract - CDN Purchase/Install Media system - Storage - Transcoder - Streaming SVR - Media Solution System Load Balancing Tech. Upload Publishing Conversion 360 VR Contents Management Player Delivery Adv. Live Statics Chatting Broadcasting Flexible Operation Cloud Service Development/Install Contents Mgmt. System - Media System Interworking - Contents Mgmt. Resource Server Mass Storage Global CDN 24-HR Monitoring System Monitoring - 24 Hours Service Operation Development/Install Media Services - Actual Service based on Sample App. Or Web SKT Provides Media Services including resource and technology as Cloud Service All Functions are provided with Open API / SDK

14

15 SKT-MIP based Solutions T-Live Streaming Waiting for up to 30s Available to Stream HLS Chunk (23.ts) Chunk (24.ts) Chunk (25.ts) Chunk (26.ts) Chunk (27.ts) t Chunklist.m3u8 Origin Content Source Just 2s delay Available to Stream MPU (Media Processing Unit) - Frame based Transport SKT Live Streaming 0 10 t

16 SKT-MIP based Solutions #5 s) 20 T Live Streaming Ultra Low Latency Guaranteed Mobile Streaming Tech. Latency: <3s, Sync: <0.1s, Bandwidth Saving: 10% To Be Cloud based Personal Broadcasting Platform Individual Participation Possible Low Latency Streaming, Chatting, Ads. Insertion Encoding, DVR, DRM, Schedule, NVoD, CMS Live Casting Broadcasting Platform Publishing Site Mobile IPTV MCN Channel Social Network Tutoring Service T-Live Streaming Ad Injection Seoul Busan Value Proposition Latency decreases for mobile live streaming (15s 3s) Value Proposition Provide Personal Broadcasting Tech. supporting Low Latency / High Visual Quality Supporting User Position Dependent Ads. Insertion High Visual Quality / Low Latency 360 VR Streaming System Live Stitching supporting 4K/60fps 360 VR Live Broadcasting and Provide Player Adaptive View Port based on User Viewpoint Unified Elastic Cache Optimization for Cache Storage and Processing Value Proposition 65% Data Compression with Adaptive View Port Tech. Value Proposition Cache Storage Performance Enhanced (>9 times)

17 SKT-MIP based Solutions Online Video Platform Provide Infra and Solution with PaaS Type for Internet Broadcasting Services UHD Multi-Screen Solution Provide one UHD screen with 4 separate FHD screens HEVC Tile Syntax Used Upload Encoding Contents Mgmt. Streaming Statics Publishing Security Player Ads. Recording Value Proposition Interworking with CDN for B2B (VoD, Live) Service Provides N-screen, Ads. Insertion, Programing, CMS Value Proposition High Visual Quality and STB Resource Saving with HEVC Tile Syntax H/E HDR High Dynamic Range Conversion SDR(Standard Dynamic Range) Contents to HDR Contents at H/E (Head End) Side Super Resolution (H/E Adoption) Video Up-scaling with AI DNN based Algorithm FHD to UHD at H/E with High Performance H/W Value Proposition [non-hdr ] [HDR] Premium HDR IPTV Services Possible for Both VoD/Real-Time Streaming Value Proposition Premium 4K IPTV Services Possible for Both VoD/Real- Time Streaming

18 Network Based Media Processing NBMP will be the dominant technology for future media service of 5G. SKT s 5G Architecture Media Source Network-Based Media Processing w/ 5G infra. Key function : enhance the media quality using N/W resources Media Player

19 SK s AR/VR Platform and Services for 5G Network

20 SKT s AR / VR Platform is Total AR / VR Service Platform

21 SKT s AR / VR Platform is Total AR / VR Service Platform

22 SKT s AR / VR Platform VR Studio. You can create and play VR contents in there Google I/O 2017 (/w Google Daydream)

23 SKT s AR / VR Platform Developed Services Status Social Service Collaboration T real AR 저작도구및 AR Browser 1. 대상이미지촬영 2. 콘텐츠배치 3. AR 서비스실행 AR Mobile Authoring ( 15.1) Google I/O 2015 AR Authoring ( 15.1) Game & Entertainment Remote AR Medical Service ( 15.10) T real Telepresence Remote Design ( 17.1) Marketing & Event T real 3D System Google I/O 2017 T real AR Game ( 16.6) Unity VR Studio( 15.1) Daydream VR Studio ( 17.1) AR Baseball Game Play Adventure ( 17.3) T.um Theater ( 15.3) Education Productivity T real Adventure( 15.3) tvn Event ( 16.10) Mobile Symphony Orchestra AR ( 15.10) EV Visualizer ( 16.3) Education AR/VR ( 16.4) AR City Demo ( 15.8) Remote Assist Prototype ( 16.8)

24 SKT s AR / VR Services AR Entertainment for Baseball Game

25

26 SKT s AR / VR Services 360 VR Live Trial Services (4K, Real-time) High Quality

27

28 SKT AR / VR Services 360 VR Streaming Services (BMW Driving Center) Functional Architecture 360 Camera (T5 Gopro x 6) Stitching & Encoding TLS Streaming (/w 5G N/W) Player (HMD, phone)

29 SKT AR / VR Services 360 VR Streaming Services (Korean Pro Baseball Game) Strong Immersiveness is obtained via 360 VR Video with Multi-Cameras 360 Video Transmission 3 rd Base Camera 1 st Base Camera Home Camera

30 SKT AR / VR Services 360 VR Streaming Services (CES2018) 360 VR Streaming Services (in Collaboration with Kia Motors@CES2018) Real-time Streaming via 5G Submarine Fiber-Optic Cables Between KOR-USA

31 Conclusion SKT is preparing 5G revolution era with innovative service platforms and solutions SKT is especially interested in technology for effective multi-media processing and fast delivery SKT is also proposing these platforms and solutions to MPEG and hoping these solutions to be popularized soon Flexible standardization is required for faster and effective video processing and delivery VR targeted video compression is being standardized in MPEG T-MIP and T-Real can be standardized

32