Streaming and Broadcasting Services for Mobile Handsets

Transcription

1 Streaming and Broadcasting Services for Mobile Handsets Mobile Device Developments 2004 London, UK, September 2-3, 2004 Jukka Helin MediaLab ( 1

2 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 2

3 TeliaSonera in brief Merger between Telia and Sonera: Jan 1, 2003 Leading telecommunications group in the Nordic and Baltic countries Largest mobile operator in Sweden and Finland, 2 nd largest in Norway, 3rd largest in Denmark Operates under the Sonera brand in Finland and the Telia brand in Sweden Headquarters in Stockholm Revenues 9.0 billion EUR and 26,694 employees in

4 Mobile Proportional 1 number of customers: million (Dec 31, 2003) Sweden Subs: 3,838,000 Annual growth: 6% Owner share: 100% Estonia Subs: 234,200 Annual growth: 12% Owner share: 49% Russia Subs: 2,705,000 Annual growth: 104% Owner share: 44% Finland Subs: 2,428,000 Annual growth: -2% Owner share: 100% Latvia Subs: 322,000 Annual growth: 19% Owner share: 60% Norway Subs: 1,195,000 Annual growth: 10% Owner share: 100% Moldavia Subs: 130,200 Annual growth: 33% (73% 2 ) Owner share: 74% Lithuania Subs: 947,000 Annual growth: 24% (103% 3 ) Owner share: 90% Kazakhstan Subs: 374,200 Annual growth: 60% Owner share: 38% Denmark Subs: 525,000 Annual growth: 13% Owner share: 100% Georgia Subs: 189,000 Annual growth: 54% Owner share: 62% Turkey Subs: 7,087,000 Annual growth: 22% Owner share: 37% Azerbaijan Subs: 346,600 Annual growth: 36% Owner share: 38% 1) Owner share x Associated company s total mobile subscriptions = Proportional. 2) Increased ownership from 57% to 74% in Mar ) Increased ownership from 55% to 90% in Dec

5 TeliaSonera Finland s MediaLab An R&D unit focusing on mobile and broadband multimedia technologies and service development Belongs to TeliaSonera s Products and Services unit Main focus areas: Mobile and broadband audio/video services Mobile broadcasting (DVB-H) Digital rights management Mobile/broadband gaming services Content search technologies Main partners: RealNetworks, Nokia, Microsoft, Tampere Univ. of Technology, RTT, Tekes More info: Buy rights? 5

6 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 6

7 Operators plans for streaming services Source: Forrester Research, June

8 Global mobile service revenues Video - Video MMS - Video conf. - Video mail Data and messaging 13% 87% Video - Video ads - Promotional content (movie trailers, music videos ) P2P messaging Infotainment Other (advertising, transactions, ) 11% 11% Video - Monitoring - Training Business data services 5% 2% 71% 2003 Voice Total EUR 400 billion Video - Adult entertainment - Sports clips - News clips - Music videos - Live events 2008 Voice Total EUR 635 billion Source: Nokia, June 2004: Global mobile service revenues. 8

9 Mobile video service revenues in Western Europe Billion EUR Video messaging Information Entertainment Video telephony Source: Yankee Group,

10 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 10

11 Streaming, broadcasting, datacasting, Broadcasting Datacasting Streaming Unicasting Multicasting Webcasting Downloading Point-to-multipoint transmission by wireless means for general reception Broadcasting data, typically streams or files (filecasting) Technique for transferring data such that it can be processed as a steady and continuous stream point-to-point streaming (live or on-demand content) point-to-multipoint streaming (live content) live streaming over Internet Transferring data such that it cannot be processed until it has been completety received 11

12 Delivery methods for mobile phones today Delivery method Downloading Predownloading Streaming On-demand content Yes Yes Yes Live content No No Yes Max content length Phone memory size Phone memory size Infinite Content quality Stored in memory Content repeat Viewing delay Protocol/transport Good (limited by download time) Yes While stored in memory Viewing starts after download complete http (TCP) Good (limited by download time) Yes While stored in memory None (when downloaded) Limited by the network bandwidth No Must be re-streamed Few seconds Off-line viewing No Yes No Server Web/FTP server Web/FTP server Streaming server http (TCP) RTP (UDP) 12

13 Streaming with downloading Search music by browsing Found? Listen by streaming Ok to buy Pay and download Don t want to buy A video service can use many technologies Example: the world s 1 st mobile music service, DoCoMo M-stage Music - Music search, streaming (at 32 kbps for samples), download full high-quality songs, view CD covers, lyrics etc. - Uses 64 kbps PHS network - 21 music companies, including Warner Music Japan and music.co.jp Inc. - Monthly charge 200, /song (1 ~ 115 ) 13

14 Demo: pre-downloaded video content 14

15 Mobile video components and interoperability Basic components for mobile video: encoder server player For interoperability, standard codecs, file formats and protocols must be used Both proprietary and 3GPP compliant codecs, file formats and protocols exist Encoders Codecs File formats Servers Players Protocols Source: rtsp.org. 15

16 Streaming file formats and codecs File Format File Extension Video Codecs Audio Codecs MPEG-4.mp4 MPEG-4 Visuals, H.264* AAC 3GPP.3gp MPEG-4 Visual Simple Profile, H.263 AMR, AAC RealMedia.rm,.ra RealVideo 8 RealAudio Winwows Media.wmv,.wma Windowd Media Video 8 Windows Media Audio QuickTime.mov,.qt MPEG-4 Visuals, Sorenson Video AAC, AMR * H.264 codec is known also as MPEG-4 AVC. 16

17 MPEG-4 mobile licencing Codec Fees Encoder Decoder Content fee MPEG-4 Visual Mobile Video $0.25/unit, first units free, annual cap $1M $0.25/unit, first units free, annual cap $1M $0.25/subscriber or $ /min, first subscribers free, annual cap $1M H.264 (MPEG-4 AVC.) Annual initial fee of $15000 for enterprises with revenues above $2M. $0.25/unit, annual cap $2.5M $0.25/unit, annual cap $2.5M Permanent*: 90 minutes or more $.025, 31 to 89 minutes $.015, 30 minutes or less $.005 Temporary**: $.0025 per title * Permanent" means the end user can use the content or end-user product for more than 20 decodes and/or more than 30 days after the first use. ** Temporary" means that the end user can use the content or end-user product for no more than 20 decodes and/or no more than 30 days after the first use. 17

18 Packet Switched Streaming (PSS) 3GPP s first streaming standard (3GPP Rel4, Mar, 2001) Video: ITU-T H2.63 (req.), MPEG-4 simple visual profile (opt.) Speech: AMR (req.) Audio: MPEG-4 AAC-LC (opt.) Payload formats RTP UDP Scene description: SMIL 2.0 Presentation description Still images Bitmap graphics: GIF, JPEG Vector graphics Text: XHTML http IP TCP Presentation Description RTSP UDP Note:Video, audio and speech must be streamed over UDP protocol (TCP or http cannot be used). 18

19 Mobile streaming roadmap (3GPP PSS) 3GPP specification freeze date PSS Rel5 - device capability exchange PSS Rel6 - end-to-end bitrate adaptation - new codecs: H DRM Rel5 players, encoders and servers PSS Rel4 - basic framework Partially Rel4 compliant players, encoders and servers Rel4 players, encoders and servers H1/01 H2/01 H1/02 H2/02 H1/03 H2/03 H1/04 H2/

20 Mobile broadcasting Today mobile streaming is a unicasting service -> not suitable for heavy mass communications (broadcasting) Two promising technologies exist: DVB-H (Digital Video Broadcasting, Handheld) Specified by ETSI as an extension to DVB-T DVB-T based single-frequence network, 5-12 mbps Needs back-channel, e.g. GPRS for interaction First terminal introduced: Nokia 7700 MBMS (Multimedia Broadcast/Multicast Service) to be specified in 3GPP Rel6 (Jan 2005) Uses existing EDGE/UMTS infrastructure, kbps 20

21 Mobile broadcasting roadmap 3GPP specification freeze date MBMS Rel6 - first definitions MBMS Rel6 capability in players and servers, pre-phases DVB-H - ETSI standardization completed DVB-H pilot phases Commercial DVB-H capable players and servers H1/04 H2/04 H1/05 H2/05 H1/06 H2/06 H1/07 H2/

22 Mobile streaming technology providers Provider Apple Microsoft PacketVideo RealNetworks Server QTSS, Darwin Windows Media Server PVServer RealSystem Mobile Server platform OS X, Unix Windows Unix Unix, Windows Encoder QT Broadcast, QT Pro Windows Media Encoder PVAuthor RealProducer Player --- Mobile Windows Media Player PVPlayer RealOne Mobile, Helix DNA client Player platforms --- Smartphone OS, PPC Phone Ed., Windows Mobile Second Ed. Smartphone OS, Symbian Symbian, PPC Phone Ed. Streaming audio AMR, AAC WMA AMR, AAC RA, AMR, AAC Streaming video MPEG-4, H.263 WMV MPEG-4, H.263 RV, MPEG-4, H.263 Phone vendor partners --- Samsung, HTC, Motorola Sony- Ericsson Nokia, Siemens, Sony-Ericsson Other Darwin: open source Included in Windows server Bitrate adaptation Bitrate adaptation, Helix: open source 22

23 Generic mobile streaming platform Streaming multicasting server/proxy Back-channel Web servers SMIL, text, graphics http UDP audio video Internet DVB-H GGSN Mobile core Mobile core SGSN GPRS/ EDGE Streaming players W-CDMA Authoring -On-demand encoding audio video Live encoders Streaming servers audio video Live sources Optional streaming server/proxy 23

24 TeliaSonera s streaming platform FOR RELEASE TeliaSonera Selects RealNetworks Helix Mobile Solutions as Platform of Choice to Deliver Multimedia Content to Mobile Subscribers RealNetworks Powers TeliaSonera Audio and Video Streaming for GPRS and 3G Networks London, UK January 26, 2004 RealNetworks, Inc. (NASDAQ: RNWK), the leading creator of digital media services and software, and TeliaSonera (NASDAQ: TLSN), the leading telecommunications group in the Nordic and Baltic regions, today announced that TeliaSonera has selected RealNetworks Helix mobile platform to power streaming delivery of audio and video content to GPRS and 3G network mobile subscribers in Finland and Sweden. 24

25 Ecosystem of mobile (video) services Laitteet Devices Laitteet Sovellukset Applications Laitteet Verkko Network Laitteet Sisältö Content Device has any use alone Only when all four parts work together, can we have successful services The quality of a service is determined by the weakest part in the ecosystem 25

26 Requirements for good streaming handsets High-resolution screen, >64K colors Loadspeaker and stereo audio output for headphones Enough processing power for decoding 3G network interface for ~100 kbps video quality (later DVB-H and/or MBMS support) Support for multiple APNs and/or multiple contexts (for separating streaming and WAP traffic) Open SDKs to enable depelopment of various applications and embedding the player Player support for horizontal/landscape fullscreen viewing modes Support for standards (3GPP PSS) 26

27 Streaming requirements for networks EDGE or W-CDMA bearer (GPRS ok for piloting) QoS (priorization and/or streaming class) especially in EDGE networks Enough capacity (both radio and transmission) Traffic differentiation support (for billing, reporting, etc.) Scalable streaming server/proxy platform Later: Multicast support (DVB-H and/or MBMS) 27

28 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 28

29 Streaming tester architecture Future: W-CDMA tester client Streaming Tester server UTRAN Core network GGSN SGSN/3G-SGSN GSM BSS Mobile Internet Edge Internet Series60 tester client Traffic log PC streaming tester client Log converter 29

30 Streaming problems today Usability problems: operators may use separate GPRS access points (APNs) for wap and streaming traffic QoS problems on-the-move (cell changes often cause packet loss) Future: content adaptation problems between GPRS, EDGE and UMTS networks A 23 min trip in a bus at 0-80 km/h using operator X s network Cell change 30

31 Encoding recommendations Network GPRS EDGE W-CDMA Channel coding / bearer Typically CS-2 Varies 64 / 128 kbps Encoding recommendation 18 kbps (2 time slots) 27 kbps (3 time slots) 50 kbps* 50 kbps 100 kbps * Initial recommendation. 31

32 Demo: video quality 32

33 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 33

34 Schedule for video services Investments for GPRS operators No investments needed Video MMS Video clip downloads Currently circuit switched 3G network needed Streaming delivery platform needed Video calls Video streaming over GPRS/EDGE/W-CDMA DVB-H/MBMS network needed Video broadcasting over DVB-H/ MBMS

35 Video MMS Person-to-person (P2P) video MMS is the easiest business case No extra servers needed In TeliaSonera Finland s network the current MMS size limitation is 100 kb, which limits the video length to about 15 sec Some recorders for Symbian/Series 60 phones: Hantro, Philips, Emuzed, Packetvideo Possibility to build extra services such as video archives E.g. TeliaSonera s video MMS service (in Finland: 0.39 EUR/MMS regardless of the content) (Record) and send MMS Receive, store and playback camera phone with video recorder software 3GPP compliant video player 35

36 Video clip download News and weather, movie trailers, cartoons - all non-real time content Business models are basically the same as with ringing tones and logos Video service can be accessed via SMS or WAP Some players: RealOne Mobile, Mobile Windows Media Player, Packetvideo PVPlayer, Hantro E.g. TeliaSonera s Olympic Games highlights service Phone with video player software Download & playback WAP/SMS WAP GW / MMS Content server 36

37 Video streaming All on-demand content All live content e.g. traffic cameras or TV broadcasts Live streaming: currently no multicast support Needs a network with enough bandwidth and capacity Some streaming players: RealOne Mobile, Mobile Windows Media Player, Packetvideo PVPlayer Existing Internet streaming platforms can be used for piloting streaming video services over GPRS E.g. TeliaSonera s live streaming for CNN International WAP Streaming server Phone with streaming video player software Streaming & instant playback 37

38 Video calls Both persons need special camera phones Camera points to the same side as the screen: face-to-face call Camera points to the opposite side of the screen: you-see-what-i-see Needs a low-latency (circuit-switched) network with quaranteed bitrate ~64 kbps Call cannot be switched from 3G GPRS (normal video streaming can work ok in dual mode networks) Possibillity to build extra services such as video conferencing E.g. DoCoMo video call, Hi3G MoVi Camera phone Circuit switched network 38

39 Video broadcasting All live content, multicasted to users via DVB-H or MBMS network DVB-H test network available in Helsinki area TeliaSonera, Nokia, Digita, Elisa, YLE, Nelonen and MTV will start a pilot at Q1/2005 with 500 consumers Currently the only announced mobile terminal: Nokia 7700 (uses RealPlayer for streaming) Back channel streaming server DVB-H media phone IP datacast & with streaming video instant playback player software Broadcast channel 1, 2, 3,... 39

40 Finpilot: video broadcasting trial FOR RELEASE Q1/

41 DVB-H video content service Content service Content provider content DVB-H service operator streams, files DVB-H network operator broadcast (11 mbps) DRM service operator content IDs requests, rights Streaming and download (proxy) servers Mobile service operator requests, rights, payments Mobile network operator back channel (SMS/GPRS) Microbilling 41

42 Demo: video service over DVB-H 42

43 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 43

44 Mobile services at TeliaSonera The Sonera brand used in Finland and the Telia brand in Sweden WAP portals: Sonera Plaza and Telia Go Colour screen required for new services Mobile content comes from 3 rd parties In Finland content comes also from the Sonera Plaza Internet portal 44

45 Mobile video services at TeliaSonera (Aug 2004) In Finland: Video MMS Video on Sonera Plaza WAP portal: sports, entertainment, music, Ellit women channel CNN International live Toto Radio: daily live audio broadcast from trotting race Sony StreamMan music audio service (needs subscription) Sonera mlive hosting service for companies No content fees for streaming, only data transmission charged In Sweden: Video MMS News clip download service Position based wheater forecast by Foreca Pre and post game interviews from Swedish premier football Events, e.g. 20 clips daily + live TV from the Olympics (free) M-USE music audio service Pay-per-clip with zero-charged traffic Most services can be used with Series 60, Series 45 and UIQ devices Clips encoded at GPRS/EDGE/UMTS data rates 45

46 Music video services at Sonera Plaza wap.sonera.net Video services Music videos Play Encoding: 3 fps used for video sharpness. 46

47 Video service statistics (Jan-Aug, 2004) On-demand entertainment Content at Sonera Plaza WAP portal Streams available at GPRS and EDGE qualities (18 and 50 kbps) 3 min 46 sec avg view time Live news streaming Content at Sonera Plaza WAP portal Stream available at GPRS and EDGE qualities (18 and 50 kbps) 4 min 9 sec avg view time 47

48 Content and packet fees at Sonera Plaza Service MMS Mono ring tones Polyphonic ring tones News (Sonera client app.) Locator Games (java & Symbian) Applications (java & Symbian) Video (streamed) Content fee 0.39 EUR 0.95 EUR 1.21 EUR EUR/search EUR 0-20 EUR --- Transmission fee Packet fees Packet fees Packet fees Packet fees Packet fees Packet fees Fun Data Active Data Pro Data Opening EUR 8.21 EUR Monthly charge 5.99 EUR/MB 9.99 EUR/MB (< 20 MB) EUR/MB (> 20 MB) EUR/MB (< 100 MB) EUR/MB (> 100 MB) 48

49 TeliaSonera Finland s content revenue sharing model Consumers Sonera Plaza WAP portal New content services: content fee - 20% commission for Sonera 3 rd party content partner sites - GPRS traffic fee - Content fees - ring tones: ~1 EUR - games: 4-7 EUR - Series 60 applications: 0-20 EUR - video streaming: 0 EUR - etc. No fee Open Internet NOTE: Content charge: currently only transaction based Transmission charge: 100 MB/month included in the basic subscription fee 18,30 EUR/month Content provider pays commission for the link on Sonera s wap menu and micro-billing 49

50 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 50

51 Enabler: content based billing Intelligent GGSN charging filter Service URL Rate WAP, HTTP Streaming wap.sonera.net/helpdesk Any Zero rate Rate 1 Any Any Rate 2 Internet Rate 1 zero rate Rate 2 Content Portal Streaming server Data volume events Transactions Log events Billing system Charging Server 51

52 Content based billing: regulation problem Content Provider Service Operator Network Operator End-User Traffic fee (bits/month) and transaction fees % traffic fee (regulated) % transaction fees In Finland Viestintävirasto regulates the traffic fees. Network Operator must sell the bandwidth (bits) with same price for all Service Operators. Currently, e.g. wap bandwidth must be sold with the same price as streaming bandwidth. 52

53 Enabler: mobile digital rights management (DRM) Protects content owner rights and enables controlled access to content Enables P2P superdistribution of content Requirements: Easy to use (buy content using 1 or 2 clicks) Flexible usage rules (preview, time based, full, etc.) A single system preferred (DRM standard) In order to play you need to buy rights. Want to? OMA DRM R1 (for thin content) released in Sep 2002 OMA DRM R2 (for premium content such as music and videos) to be released in H2/2004 This video clip costs 1 EUR. Purchase? 53

54 Outline TeliaSonera in brief Streaming service forecasts Technology Mobile video quality today Mobile video services Mobile video services at TeliaSonera Enablers for video services Summary 54

55 Summary For GPRS video, use the technology that suits best: streaming, downloading or scheduled downloading Video over GPRS is not a business but rather a piloting environment and market maker for 3G services W-CDMA enables high-quality streamed audio and music services DVB-H and MBMS are promising technologies for mobile broadcasting for For video services to succeed good terminals are not enough, we need also networks, applications and content TeliaSonera has launched many mobile video services Operators offering flexible content enabling services (streaming, DRM, billing, reporting, etc.) to content, application and service providers can accelerate the market Video services need enablers like DRM and content based billing 55

56 56