HTML5 on TV - was fehlt? Cloud-basierte TV apps auf der Basis neuester Webtechnologien

Transcription

1 HTML5 on TV - was fehlt? Cloud-basierte TV apps auf der Basis neuester Webtechnologien Dr.-Ing. Stefan Arbanowski stefan.arbanowski@fokus.fraunhofer.de

2 Outline Trends Cross platform applications Smart Media Service Personalization Cloud computing Web and TV why should this be a special case? HTML5 What is it and where we are? What is missing? Some example apps Conclusion

3 Future Media Internet is interactive, personalized, everywhere FAME - Future Applications and Media

4 Cross-platform applications Extremely fragmented landscape of operating systems and app ecosystems Devices categories are converging and devices are becoming more interconnected. However, operating systems are proliferating and the support of multiple devices is extremely difficult Device and platform fragmentation Application development complexity Development costs Technologies delivering a single application to many device types Increase convergence Reduce development costs Increases the convenience for consumers when using different devices Web technology is a good potential approach to solve terminal/device fragmentation Strong developer community and a fast adoption curve Available on all common operating systems and devices Seamless integration of local applications and the cloud

5 Fixmystadt cross-platform app FAME - Future Applications and Media

6 Smart Media Convergence of media, internet and broadcasting industry is ongoing New interactive kinds of media delivery channels as well as content formats are needed New web based media delivery platforms focusing on Interactive media to be put on various devices new ways to interact with content Content delivery platforms for IPTV and Web TV, and Hybrid TV Converged media solutions combining telco, broadband and internet technologies Web based media clients

7 Smart Content Smart Content technology enables interactive, clickable video experience Objects within the video become interactive and clickable metadata is attached to objects and can be used for product placements, targeted advertisement or just info creates a higher personal involvement and better user experience Content Object Recommendations Interactive & Description clickable content

8 New Media Clients Next Generation feature set FAME - Future Applications and Media

9 Personalization Personalization of services and media is key for current and future applications Social media adds even more complexity Information overload needs automatic filtering and recommendation mechanisms Advanced personalization technologies are needed that focus on: Embedding recommendation systems into various application domains Context-awareness for dynamic application adaptation Semantic data processing and automatic reasoning Intelligent presentation of available information Data analysis and filtering Usually non of the above mentioned functions can be provided without server side processing or at least storage capacity Server is dead, long live the cloud

10 Cloud Computing Not yet well defined and variety of open issues the many faces of cloud computing Clouds are not such a new concept Data centers for data management Telecommunication industry for load balancing Web server hosts for access control and load balancing etc. At the convergence of several trends Virtualization SaaS, On-Demand billing model Thin client, web-based computing A Fake? Everything is being repainted Cloud"... Source: The future of Cloud Computing EU Report

11 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power

12 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power Learn from mobile phones!

13 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG The same way that mobile phones are for making phone calls? Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured That buttonsled to WAP low computing / rendering power

14 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size Are cursor the navigation primary mobile phone coloured buttons low computing / rendering power applications (even the web based ones) currently contact lists and calendars?

15 Web and TV A special case? Phones need to handle different screen sizes Current approaches often attached to the past and TV even is primarily changing for watching videos orientation. Can't be that hard to do... Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power

16 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Phones have full keyboards, cursor keyboards, numeric keyboards, joysticks, pens, touch screens, multi Examples are always the same applications VoD Teletext (News/Weather/Sports touch pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power

17 Web and TV A special case? Current approaches often attached to the past TV is primarily for watching videos Even now TVs offer control by Examples are always the same applications smart phones and pointer devices VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power

18 Web and TV A special case? Current True approaches now often and attached will to the be past true as long as TV better is primarily teletext for watching videos is all there is to offer. Put what if someone sells a TV that can play World of Warcraft (HD)? Or even Farmville (HD)? Users pay for phones that can handle Angry Birds Examples are always the same applications VoD Teletext (News/Weather/Sports pages) EPG Done that on MHEG-5, done that in MHP, in Open TV Standards focus strongly on current input/output devices fixed screen size cursor navigation coloured buttons low computing / rendering power

19 Intermediate Summary (and hopefully fuel for discussion): Don't rely too much on the future being just a nicer looking past Don't take technical criteria too serious The can change quickly They can be covered in profiles or recommendations, not core standards Plan for strong features of the domain TV viewing is often social TV screens can typically be seen by more than one person in most homes with VDSL, TVs are probably the devices with the fastest Internet connection

20 HTML5 core features: Multimedia and UI <canvas> dynamic and scriptable rendering of bitmaps and 2D content designing applications which are looking like native applications becomes easier <video> and <audio> Allows for standardized video playback, e.g., promo videos for application or games No need for Adobe flash plugin anymore but up to now multiple source files with different encoding must be provided to ensure playback on all browser <video> can be connected with <canvas> which allows realtime manipulation of video content DRM is not supported, thus, the content is not protected unless dedicated codecs are used.

21 HTML5 core features: Persistence HTML5 Web Storage new easy to use key-value storage as Cookie replacement permanent or session based e.g. allows for storing client/user dependent and server/backend independent configurations directly on the client to reduce server load (e.g. configurations or preferences) Application Cache makes web site offline executable application parts (sub-pages) which needing internet access and which not is defined using an application cache manifest file e.g, allows the creation of web based portal pages which may link to bought web applications which can then be executed in offline mode additional proprietary extensions may be needed to integrate cached applications into the native OS or into the browser 2

22 HTML5 core features: More features Drag&Drop brings drag & drop functionality to web applications which makes user interactions more intuitive, e.g., for selecting objects and add them to another context. Web Messaging Two approaches, Cross Document Messaging and Channel Messaging, for event based communication (postmessage / addeventlistener) Web Sockets reverse AJAX replacement, no need for polling for server updates Reduces server load for real-time communication with clients Web Workers preforming expensive calculations without blocking the UI

23 W3C Web and TV Special Interest Group use the TV as central hub to control other home devices support for VoD (Video on Demand) delivered through a broadband connection support for video conference, chat and "social" applications the ability to purchase through the Internet items advertised during a commercial HTML5 and TV Feedback from companies/specification groups using or planning to use Web technologies in their products/specifications on potential limitations in current W3C specifications (e.g. support of broadcast video using <video> element) Role of profiling HTML5/CSS for TV sets Methods to enforce compliance and interoperability (testing), e.g. for CE devices Plans to support HTTP adaptive streaming Plans to support Web-based technologies, e.g., HTML5, what kind of additional standards are needed

24 What is missing in HTML5 to fit into the TV environment? Essential: interoperable and open DRM systems that works across devices HTTP adaptive streaming (Micro-) Payment for Web and TV Support for multi screen" scenarios Support for remote controls Nice to have P2P integrating for content distribution Well defined APIs for local device resources

25 HTML 5 based media client FAME - Future Applications and Media

26 ScatterPoker: A Distributed App Interation of location service Distributed application logic Private and shared resources March 2011 Interation of local camera Private and shared resources 2

27 Example: Cross platform gaming using multiple devices FAME - Future Applications and Media

28 Other devices FOKUS MEGASTORE is an application store FAME labs that allows application deployment to several types of devices.

29 Conclusion Many companies are being comitted to make HTML5 a success in the TV domain Web technologies, especially HTML5, provides a good basis for developing advanced feature rich interactive (streaming) applications Standardardization work is still ongoing to really fit to the TV environment It is time to start using what is already there and to influence HTML5 work And that browser will be in your TV set

30 Show it is working - FAME - Future Applications and Media

31 Contact

32 HTML5 and TV scenarios HMTL 5 video object Simple handling (compared to other video players like Flash etc.) No interleaved(+embedded) objects, No different code for different browsers when embedded a video less code complexity > less fault prone code No more Javascript requirement for object transforming No more integration pain (code complexity) when using swfobjects Simple compatibility check mechanisms clear and ease integration Multi device capabel WebSockets Benefit for especially real-time, event-driven web applications. Very small footprint / overhead compared to AJAX or COMET added value for interactive IPTV services like quiz shows, gaming, fast channel switching etc.

33 HTML5 and TV scenarios... for enhanced IPTV GUIs CSS3.0 Web Apps can look like native apps. -> Transitions, Reflections, Shadows... Helps to improve cross browser look and feel (compatibility etc..) Canvas allows fast animations -> enriches GUIs, allows rich IPTV services on top. Embedding SVG / MathML optional. OIPF accepted, SVG as Image format HTML as root grafical based approch for drawing rich interactive grafical user interfaces. Highly scaleable GUIs HTML5 improved error handling reduces time and money required to display things consistently. astimated much less malformed HTML pages compared to HTML4 pages.