Multiview Generation for 3D Digital Signage

Transcription

1 Multiview Generation for 3D Digital Signage 3D Content for Displays without Glasses based on Standard Stereo Content 3D brings new perspectives to digital signage and other public displays that don t use 3D glasses. Format conversion from stereo to glasses-free 3D display specific multiview formats is a necessary postproduction step to bring existing S3D content into public areas where 3D glasses can t be used. 3D conversion creates the required number of extra views needed to generate autostereoscopic content. The Fraunhofer Heinrich Hertz Institute HHI provides dedicated conversion technology for almost any type of existing autostereoscopic display. Challenges Viewing 3D content at home or on mobile devices poses new challenges for 3D production. Unlike conventional stereo or 3D cinema, basic parameters such as viewing distance, screen size and illumination may vary considerably. What s more, future 3D multimedia displays will no longer necessarily require glasses. By converting standard stereo content to more suitable formats it can be adapted to specific autostereoscopic 3D displays, viewing conditions and user preferences. almost automatically after tuning parameters on a perscene basis. In more complicated cases it is useful to assist the automatic process by feeding it with manually segmented key-frames beforehand or refining critical parts of the depth maps manually afterwards. Starting from this generic depth-based production format, adaptation to any type of 3D display and related viewing conditions can be achieved. The specific display type defines the number of virtual views to be generated by DIBR. The inter-axial distance between the views defines the perceived depth range and can therefore be used to scale depth and adapt it to screen size, viewing distance and user preferences. Conversion of stereo into generic depth-based format. Technical Background One solution is to use a generic depth-based production for- mat where a pixel-by-pixel depth map is added to each stereo view by using dedicated disparity-estimation algorithms. These additional depth maps allow full control of depth scaling and interpolation of intermediate virtual views by means of Depth Image-based Rendering (DIBR). In the simplest case, the additional depth maps are generated Image Processing

2 Rendering of display-specific views from generic depth-based format Technical Features n Automatic extraction of depth information from stereo content n Conversion of stereo content to multiple video+depth (MVD2) n Re-mastering of stereoscopic content by using MVD2 format Solutions and Services In this context Fraunhofer HHI offers a suite of plug-ins for Adobe AfterEffects including sophisticated disparity estimation and rendering solutions. In addition the converssion is continued to be available as a service for most commercial auto-stereoscopic 3D displays. The final results can be delivered individually in full resolution but also interweaved, ready to use for a selected 3D display. n Adaptation of stereoscopic content to different screen sizes) n Generation of dedicated multiview sequences from MVD2 n Specific adaptation of depth range for selected 3D displays n Tuning of multiview parameters for given content and display type n Option of manual refinement to achieve improved 3D quality CONTACT Ralf Tanger Image Processing Fraunhofer Heinrich Hertz Institute Einsteinufer Berlin Germany phone ralf.tanger@hhi.fraunhofer.de /ip Fraunhofer Heinrich Hertz Institute, Berlin 2012 Image Processing

3 Free2C_digital Low Cost High Quality 3D Display with Digital Head Tracking 3D displays for computer gaming used to come with a price tag that took the edge off gaming pleasure. But not any more. With the Free2C display in landscape format we present a solution for low cost computer game screens that puts 3D within the reach of everybody. Plus the Free2C display s generous sweetspot and electronic tracking gives users almost unlimited freedom of movement. Challenges Autostereoscopic display no need for 3D glasses Excellent depth impression Low cost concept, attractive pricing Can be used with almost all stereo-capable applications Range of different sizes available ( inches) Technical Background User Tracking Head tracking enables picture content displayed on the Free2C_digital series of devices series to be precisely aligned to the position of the viewer. The head tracking module tracks the user s eye position with a simple but ultra-rapid camera. The PC evaluates the received images quasi automatically and converts them into control signals sent to the interface box. Users can select between two types of tracking mode and the electronics of the interface box take care of the correct positioning of the image content on the Free2C_digital display. 3D Display: General Specifications Autostereoscopic parallax barrier display with electronic user alignment Stereo Input Formats Full resolution side-by-side with 60 Hz Full resolution frame sequential with 120 Hz DVI-D Video interface Content and user-friendliness comfort are just as important as good image quality and depth impression. And Free2C_ digital s interface box has them all. Because it can process a wide range of stereo image formats, the Free2C_digital display can render stereo applications with widely different resolutions, while its realtime sub-pixel sorter gives fast delivery of content and enables near continuous adaptation of the tracking signal to the user s position. As an extra feature, the interface box allows users to switch between 2D and 3D for the very best presentation of both modes while the integrated anti-alias filter improves textual readability and makes sure that even the finest details can be clearly seen.

4 Free2C_digital Interface Interface Box Dynamic subpixel multiplexer with anti-alias filter Control interface: USB 1.1 Video Interface Input: dual link DVI-D Output: single link DVI-D Switch Functions 2D/3D Fine/Wide (tracking mode) L/R switch Video Head Tracking Tracking detection: integrated video camera Software: HHI video head tracker software Update rate: 60 Hz Camera-PC interface: IEEE1394a Head tracked viewing zone: circa 600 mm lateral, 500 mm vertical CONTACT Dr. René de la Barré Fraunhofer Heinrich Hertz Institute Einsteinufer Berlin Germany Phone Fax /im Fraunhofer Heinrich Hertz Institute 2011

5 More Driving Comfort with 3D The 3D Cockpit Display personalizes data to the driver s own preferences Developed by the Fraunhofer Heinrich Hertz Institute, the Free2C_hybrid autostereoscopic (glasses-free) 3D display is the core of the future car s cockpit. It s the very first display to present all the instruments of the dashboard the speedometer, tachometer, fuel gauge, indicators, satnav system, warning lights and much more as three dimensional objects. This 3D visual information can be arranged on the dashboard in order of its importance and in line with the driver s personal preferences. Challenges To present an ever larger amount of dashboard information in a logical and intuitive manner To cater for the increasing number of instruments needing integration in the dashboard 3D presentations that allow users sufficient freedom of movement and do not restrict them to one ideal sitting position Application Scenario A driver gets into her car and turns the ignition key. The dashboard lights up to show a 3D display that can be configured to suit her own preferences for instance, with features like Select Music or Latest Traffic Reports. Once the satnav is activated, it shows a 3D model of the present location so drivers can find their bearings quickly and easily. Once on the road, the display changes in line with the present situation the warning Please Refuel literally jumps out at her. And she can use the video to check whether the child on the backseat is still asleep or whether the parking space she s aiming at really is big enough. The data needed for this is given by tiny stereo-cameras. The spatial effect unfolds directly in front of the driver s eyes. Three dimensional representations are easier to assimilate as they correspond more closely to natural human vision. Bernd Duckstein, Project Manager

6 Technical Background The Free2C_hybrid cockpit display is based on the autostereoscopic Free2C_digital Display developed by the Fraunhofer Heinrich Hertz Institute. Head & eye tracking systems create connectivity between the driver s eyes and the display with two cockpit-mounted cameras that measure the position and distance of the driver s eyes in realtime. The two superimposed images creating the 3D effect on the display are thus individually configured to the driver s point of gaze so that the 3D effect is rendered from every angle and sitting position. The 10.6 inch screen ( pixels) gives a high resolution stereoscopic presentation of current picture content. Benefits Clearly presented information through offset in depth Integration of all information in one central display Displayed instruments can be supplemented with any other type of information Selection and rating of information and display and shape of instruments according to the driver s personal preferences ContaCt Dr. René de la Barré Fraunhofer Heinrich Hertz Institute Einsteinufer Berlin Germany Phone Fax rene.de_la_barre@hhi.fraunhofer.de /im Fraunhofer Heinrich Hertz Institute 2011