2 Convergence of broadcasting and telecommunications

Transcription

1 In NHK s three-year corporate plan of FY , one of the most important pillars of NHK s action is develop and offer new service using the latest technology created by convergence of broadcast and telecommunication. At NHK STRL, We are researching that make full use of the characteristics of different transmission path media such as broadcast wave and broadband to realize new broadcast services that increase the value of programs. In FY2010, we unveiled Hybridcast as a platform for services that integrate broadcasting and telecommunications to increase the convenience and sophistication of broadcast programming. Since then we have advanced toward our goal of deploying this platform. In FY2012, we developed a prototype receiver with function of an HTML 5 browser and worked on standardizing the technical specifications. We also studied examples of services that will be offered starting in the year of We promoted the service and conducted field trials at the NHK STRL Open House and at exhibitions and presentations held in Japan and internationally. In addition, we worked on a new multiplexing scheme that receivers will be available every content without regard to the type of transmission path, and we contributed to the standardization of MPEG Media Transport MMT. In our work on the teleda social TV system, we analyzed data obtained in field trials, confirming its effect on viewers behavior and the effectiveness of linkage with other Social Networking Services SNS in encouraging communication among viewers. We also conducted a field trial of a seniors cloud, built using the teleda service infrastructure to promote activities by the elderly. As part of our work on consumer generated media CGM, we developed a system using TVprogram Making Language TVML that enables SNS users to communicate through video content. We focus on services usage safety and security, developed security technologies for services on combining of broadcasting and telecommunications. We developed security technologies for Hybridcast, including a display control scheme, which gives priority to important broadcasts, and an application authentication scheme, which ensures that services are legitimate. We also developed an authentication / authorization system that implements access control suitable for various services and simplifies their operation on a network. We continued with our development of a downloadable Conditional Access System CAS that updates using broadcast downloads and studied authentication federation technologies that facilitate Digital Rights Management DRM. We continued with our research on IP content delivery technology that can stably deliver live video and other content to many viewers at the same time and at a low cost. We conducted live streaming tests from the London Olympics using a peer to peer P2P content delivery system that we developed and confirmed that the system is effective. 2.1 Technologies for the convergence of broadcasting and telecommunications Hybridcast Hybridcast is a system that will provide services to meet the needs of a new era through the convergence of broadcasting and broadband networks. Our efforts to date have involved a full range of research, standardization, and development of applications for this new system. Hybridcast platform We continue research on Hybridcast which enables the provision of flexible and extensible new services that take advantage of the characteristics of broadcasting and telecommunications. NHK s three-year administrative plan, which started in FY2012, prioritises development of new services suited to the era of integrated broadcasting and telecommunications. In FY2012, we focused on developing prototype receivers for Hybridcast, standardizing the specifications, and practical measures toward a launch of services in We cooperated with five receiver manufacturers in the devel- Figure 1. Hybridcast prototype receivers 16 NHK STRL ANNUAL REPORT 2012

2 opment of prototype receivers based on currently available televisions that are on the market Figure 1, incorporating an HTML5 browser. We also showed a variety of Hybridcast app examples at the NHK STRL Open House. In particular, we exhibited a service linking a TV with a tablet, a service that displays graphic data retrieved over the broadband network with a sports program, and a dynamic service linked to the progression of a program. We also exhibited display control technology to ensure that viewers see important information such as emergency broadcast. In these ways, we promoted Hybridcast and showed that it is ready for practical implementation. We also showed the appeal of Hybridcast by demonstrating synchronized services such as multi-view service and sign-language Computer Graphics CG composition Figure 2 using prototype set-top-boxes, user-preference-based personalized TV spot auto replacing services, authentication federation between TV and mobile terminals, and service examples from commercial broadcasters. In our domestic standardization activities, we worked with the IPTV Forum on the first editions of a system specification and an HTML5 browser specification, and we made revisions to related specifications at the Association of Radio Industries and Businesses ARIB. We also took the lead in drawing up operational specifications with the Association for Promotion of Digital Broadcasting Dpa. On the international front, we promoted the advantages of Hybridcast services and functionalities for smart TV and contributed reports to various standards organizations. In particular, we contributed to technical report and called for Hybridcast functionalities to be reflected in draft requirements recommendations at ITU-R, submitted use-case documents for services that take advantage of broadcasting and telecommunications to the Future of Broadcasting Television Initiative FoBTV, and presented the idea of Hybridcast and use-cases to the Technical Plenary / Advisory Committee meeting TPAC of the W3C, which regulates HTML5 standardization. We are also working with the NHK departments that will deploy Hybridcast in a project that promotes public awareness of the system. We helped them to study the services that can be provided, and complete facilities and operations for the launch of services in We also held exhibitions and demonstrations at the NHK STRL Open House and other events such as the London Olympics, Broadcast Asia 2012, and events celebrating the 60th anniversary of television in Japan to promote Hybridcast. During the London Olympics, we conducted a field trial of Hybrid services covering popular competitions such as swimming and judo. These demonstrations involved the whole process flow, from the creation of content using application authoring tools SDK : Software Development Kit to distribution through a commercial cloud server, and reception at Akihabara as a Super Hi-Vision SHV public viewing venue for the games Figure 3. In other work, we invited members of the public from the Tohoku region to evaluate a Hybridcast service delivering emergency information about a fictional large-scale disaster in the city of Sendai. Participants evaluated the system as effective. This research was commissioned by the Ministry of Internal Affairs and Communications, Japan, as part of the Research and development for disaster-proof strengthening of an information and communications network We will incorporate the results of this study in practical Hybridcast services. We will also continue to improve and standardize Hybridcast, and moreover, develop services that take advantage of the fusing of broadcasting with telecommunications in the age of SHV. Figure 2. Sign-language CG service TV screen Figure 3. Hybridcast service at the London Olympics Applet to cheer Japanese athletes Tablet terminal screen Broadcast Application is not shown when an Earthquake Early Warning is received Broadcaster Signature Legitimate application Application display control technology Application provider Illegitimate application Broadband Application authentication technology Prototype receiver Only legitimate applications run Hybridcast receiver Figure 4. Implementation of a display control scheme and an authentication scheme in a prototype Hybridcast receiver NHK STRL ANNUAL REPORT

3 Security for receivers combining broadcasting and telecommunications We are researching and developing security technology to enable safe and secure use of applications provided through Hybridcast. In FY2012, we implemented a display control scheme that gives priority to displaying important broadcast content, and an authentication scheme that ensures applications are legitimate in a prototype Hybridcast receiver build by commercial TV manufacturers Figure 4. Display control technology ensures that reliable information is presented so that viewers can enjoy programming with safety and security. It gives priority to displaying important broadcast content such as Earthquake Early Warnings even when an app is being used. We implemented it in a prototype receiver based on a commercially available TV. We also expect that Hybridcast will distribute HTML5 apps over the broadband network. For this reason, Hybridcast needs a mechanism to ensure that apps cannot run if they risk compromising the viewer s interests. We implemented an app authentication scheme to control the scope of an app s operation in receivers. The scheme discriminates whether an app is authorized to launch or use receiver resources by attaching an ID and signature to it. We also evaluated the execution time of the scheme. The results showed that apps up to 10 megabytes can be authenticated in a practical amount of processing time 2. We also designed a receiver authentication platform and a comprehensive app security management verification system, covering total processing from registration to controlling the execution of apps on the receiver. Media transport scheme for heterogeneous networks We are researching media transport technologies for nextgeneration broadcasting systems using broadcast and / or broadband media, so that users can enjoy content without awareness of the type of delivery medium and to build a system that can handle the growing diversity of content, viewing terminals, and transmission paths. The results of this research have contributed to the standardization process for MPEG Media Transport MMT, which is a new multimedia transport technology at MPEG, and part of it was incorporated in the ISO/IEC 2nd Committee Draft CD MMT harmonizes the media transport schemes on broadcasting systems with broadband networks, and allows various services to be deployed by using one-to-many broadcasting and one-to-one broadband networks together. Large and high-resolution monitors for Super Hi-Vision will be suited to displaying video and information. Using MMT, high-definition video obtained from broadcasting can be easily presented with video, sound or other data from broadband networks in synchronized manner. Quality of transmission path may be affected by a number of conditions including weather and network congestion. With MMT, it is easy to use a combination of different transmission paths. Service availability can be increased by diversifying transmission paths and substituting lower-bandwidth video and audio for high quality counterparts if the case need be. We have designed control signals describing relation and location of each media and developed control methods to provide such content services 3. This sort of distribution is complex and difficult to implement using conventional media transport schemes such as MPEG-2 TS or RTP ; MMT is suitable for new services that integrate broadcasting and telecommunications. 1 IPTVFJ STD-0010 Integrated broadcast-broadband system specification / IPTVFJ STD-0011 HTML5 Browser Specification, IPTV Forum Japan 2 Y. Hironaka, G. Ohtake, H. Ohmata, K. Otsuki, Y. Endo and K. Majima: Implementation evaluation of application authentication scheme for Hybridcast receiver, ITE Annual Conference, in Japanese 3 K. Otsuki, S. Aoki, S. Mitsuya, K. Aoki, and H. Hamada: A Study of Control Information in IP-based Transport Scheme for Hybrid Delivery using Broadcasting and Communications, ITE Journal, Vol.36, No.42, BCT , pp in Japanese Social Networking Services and Consumer Generated Media We are researching a Social Networking Service SNS and Consumer Generated Media CGM or User Generated Content UGC to help viewers publish their own video content related to broadcasting. Social TV system The teleda social TV platform expands the scope of TV for viewers from that of passively watching programs and encourages communication through a shared viewing experience with others. The teleda platform is equipped with functions to manage services such as program distribution, SNS, simultaneous program viewing, real-time chat, and recommendations. It also has functions to manage resources such as program metadata, user profiles, and behavior history and provides APIs that enable various services to be implemented on PCs, tablets, and smartphones. In FY2012, we analyzed the results of a 1,000-user field trial conducted in FY2011 using the teleda platform. The results of the trial showed that providing trailers affects user viewing behavior and the potential of encouraging communication and expanding the reach of programs by linking teleda with another SNS 1 2. Also, as part of a study on ways to encourage communication among seniors, we prototyped a simple interface with the program provision and SNS functions of teleda, and we conducted a field trial in a senior s community in Kashiwa City, Chiba Prefecture. Part of this research was conducted under contract from the Japan Science and Technology Agency, for the project titled R&D on a Senior s cloud : ICT infrastructure to promote society using the experience, knowledge and skills of the elderly. We also added a program search feature to the teleda platform for classifying and quantifying image frames in program video using image features and making it possible to search programs for images that could not be found using keyword searches unrelated to the user s visual preferences. We also developed the Social Screen system based on the teleda platform, enabling viewers to exchange and share videos, posts, and other information related to a program with friends and family while they are watching the broadcast. We exhibited the system at the NHK STRL Open House Figure 1. This system uses Hybridcast technology to implement a service that links the TV to tablets, and we will continue to study it with an eye to providing practical applications. We also continued our work aimed at providing real services 18 NHK STRL ANNUAL REPORT 2012

4 A shares related information Public space B shares a related video Communication by sharing knowledge * Television supporting Hybridcast Look what someone wrote... Do you know about this program? User A User B Tablet/ Smartphone Tablet/ Smartphone Private space A Private space B teleda server Figure 1. Social Screen concept We continued with our research on using server-side processing to virtualize video content production, so that users can produce video content without having to worry about the performance constraints of their terminals or what software is installed. Utilizing a content generation engine that produces CG video from TVML, we developed a system that allows SNS users to communicate through video content Figure 2 3 and another system that generates and displays a CG animated figure gesturing in sign language about a program. These systems were exhibited at the NHK STRL Open House. We also worked on generating CG video content on the terminal side, by developing core components including a high-speed dedicated TVML player for mobile terminals and a general TVML player using WebGL. We developed our sign-language CG animation further by improving the CG characters and motion data by editing it in units of morphemic movements. This gives the CGs facial and nonmanual expressions. We also helped an Asian Broadcast Union ABU researcher to build a chat system capable of emotional expression. We worked steadily to improve systems using motion capture in program production and exhibitions such as the hands-on booth at the NHK STRL Open House and the NHK Culture Festival. We also worked on a new application for creating video content on the Web. Figure 2. CG video content production system for SNS users through the teleda platform. The 60th anniversary of TV broadcasting archive portal site opened in January 2013 and we used the teleda engine to enable users of the site to read and write program reviews, make personalized recommendations, and share collections. The behavior of users on real services can also be analyzed in detail, so we look forward to using it to develop new services in the future. Virtualization of video content production 1 N.Hamaguchi,M.Miyazaki,S.Nishimura,H.Fujisawa,andR.Yonekura: Investigating trends in social TV services based on user participating experiments, 1st International Workshop on Web Services and Social Media WSSM G. Ohtake, C. Yamamura, K. Otsuki, M. Miyazaki, A. Fujii, and H. Fujisawa: Expansion of communication space by cooperation between SNS site teleda for TV program review and existing SNS sites, The 86th group meeting, Special Interesting Group on Groupware and Network Services, Information Processing Society of Japan, 2013 in Japanese 3 M. Doke, H. Kaneko, N. Hamaguchi, and S. Inoue: CG Based Video Content Production System for SNS Users, ITE Annual Convention 2012, 8-6, 2012 in Japanese NHK STRL ANNUAL REPORT

5 2.1.3 Security platform Integrated authentication federation technology for broadcast and telecommunications We are conducting research and development on an identity management technology that enables a variety of services oriented to individuals to be provided simply and securely to viewers. The technology works across multiple services to manage user attribute information and give usage rights to individual users. We have developed an authentication / authorization system for secure access to protected information and functionalities between services. It controls access to various personalized services through user authentications and authorizations 1. With this system, a user s authentication assertion and access rights to a resource can be used by multiple services linked by a common protocol. A demonstration incorporating this authentication / authorization system was exhibited at the NHK STRL Open House Figure 1. We showed how a user was easily able to use personalized services on a television, which is a shared terminal within the household, without having to login to it, by performing the authentication on his own personal mobile device, and having the access rights to resources for the personalized service transferred between devices to the television. Downloadable CAS technology We are conducting research and development on a downloadable Conditional Access System CAS technology that is able to add and update security functions by using download broadcasts, such as Entitlement Management Messages EMM, Entitlement Control Messages ECM and encryption algorithms, to provide secure and reliable access control and copyright protection. We have developed a mechanism that runs software implementing CAS functions securely within the system LSI. We have also extended the communications functions of the downloadable CAS technology and devised an authentication federation technology that can make connections between CAS and Digital Rights Management DRM. Content-linking technology for device-linked services We have developed a frame-level under 0.03s precision synchronization system for new broadcast-linked services using video cameras built into mobile terminals such as smartphones and tablets 2.Withthissystemitispossibletoprovidecontent such as 3D graphics and other objects linked to the TV image and displayed as overlays on the image from the mobile terminal camera when watching a broadcast program on the TV screen, through the mobile terminal camera. Encryption and authentication Figure 1. Prototype system demonstration exhibited at the NHK STRL Open House We made progress on encryption and authentication technology that will allow hybrid broadcasting and telecommunications services such as Hybridcast to be used securely and reliably. We have been researching a broadcast encryption scheme to protect content distributed through networks. We implemented the scheme with individual messages on a PC, evaluated decryption speed and memory use, and clarified implementation issues. We also studied attribute-based encryption as an improved broadcast encryption scheme. As a result, we developed a twolayer encryption scheme with a shorter decryption time and smaller public key 3. This research was conducted in cooperation with the National Institute of Advanced Industrial Science and Technology. We also continued with our research on an app-authentication technology to prevent use of non-legitimate apps sent to a receiver. In other development, we converted the application authentication program built into the Hybridcast security management test system into a library, and developed a private key update function. 1 C. Yamamura, Y. Nishimoto, and A. Fujii: An Authentication/Authorization Infrastructure for Personalized Services in Hybridcast System, FIT2012, O in Japanese 2 H. Kawakita, Y. Nishimoto, Y. Endo, and A. Fujii: A Synchronization Mechanism for Multi Device Link Service, ITE Annual Convention 2012, in Japanese 3 G. Ohtake, Y. Hironaka, K. Kai, Y. Endo, G. Hanaoka, H. Watanabe, S. Yamada, K. Kasamatsu, T. Yamakawa,H. Imai: Partially Wildcarded Attribute-Based Encryption and Its Efficient Construction, SCIS2013, 3F in Japanese 20 NHK STRL ANNUAL REPORT 2012

6 2.1.4 IP content delivery technology London broadcast center NHK broadcast center Service operation and management International lines P2P stream generator Distribution control Stream distributor Transcoder Client registration server Content distribution server farm Internet connection dual circuits Viewing terminals P2P distribution network Figure 1. P2P live distribution test system IP content delivery technology linking broadcasting and telecommunications We continued research on a stable and low-cost IP content delivery technology that can use the broadband to send live video and other content to many viewers at thesametime. In FY2012, we developed a test system by adding additional functionalities to the peer-to-peer P2P live streaming technology developed in FY2011, including functions to protect content and limit the scope of delivery to within the country, and to provide redundancy Figure 1. We performed live streaming tests in August at the London Olympics 1 2. In these tests, we used the P2P live streaming technology to deliver video of events not covered on TV or radio during the London Olympics, totalling 270 hours, to viewers at a transmission rate of 1.5 Mbps. Video was distributed from late at night to early in the morning, but the total number of connections reached 300,000 during this period. This demonstrated the utility of the system in the field. Figure 2 plots the number of client PCs vs. distribution server load during distribution of the soccer game. The content distribution server load shows the stream volume delivered from that server relative to the total stream volume received by all viewing terminals. When the soccer game began and the number of client PCs increased, the content distribution server load remained stable at approximately 20%. This shows that the load on the content distribution server can be reduced by approximately 80% compared to distributing individual streams from the content distribution server to all client PCs. The P2P distribution technology should thus be able to reduce distribution costs 3. We have also begun to study push-content-distribution technology, to implement services which provide program-related Content distribution server load Content distribution server load Number of viewing terminals 0 0 3:25 3:35 3:45 3:55 4:05 4:15 4:25 4:35 4:45 4:55 5:05 5:15 5:25 5:35 5:45 Time Figure 2. Number of viewing terminals and content distribution server load 2,000 1,800 1,600 1,400 1,200 1,000 information through broadband as the broadcast program progresses. We made progress on fundamental issues such as design methods for push distribution, which can keep the delay within a set range when delivering content to many client PCs at the same time. 1 S. Tanaka, S. Nishimura, and Y. Endo: Design of a P2P live streaming system for contents distribution trial of 2012 London Olympic Games, ITE Winter Annual Conference 2012, in Japanese 2 Y. Endo, S. Nishimura, K. Aoki, T. Nakagawa, and K. Ishikawa Invited Contents distribution trial of 2012 London Olympic Games using P2P live streaming system, IEICE Technical Report IN , pp in Japanese 3 S. Nishimura, K. Aoki, T. Nakagawa, Y. Endo, K. Ishikawa: Development of a P2P Live Streaming System and its Performance Evaluation through Live Streaming Trials in 2012 London Olympics, IEICE Technical Report, CQ , pp In Japanese Number of viewing terminals NHK STRL ANNUAL REPORT