3D Video services. Marco Cagnazzo

Transcription

1 3D Video services Marco Cagnazzo

2 Part III: Advanced services Overview 3D Video systems History Acquisition Transmission (coding) Rendering Future services Super Hi Vision systems High speed cameras High sensibility cameras page 1

3 3D imaging a very old story! The weighing of the heart scene from the Papyrus of Ani, ca B.C. Flat images Perspective and distance fog Masaccio, Trinità ( ), Santa Maria Novella, Firenze Perspective P. Picasso, Les Demoiselles d'avignon, 1907, MOMA, NYC Multiple views Piero della Francesca?, Leon Battista Alberti?, Città ideale ( circa), Galleria Nazionale delle Marche, Urbino. page 2

4 Depth perception Binocular cues Stereoscopic imaging: stereopsis Monocular cues Perspective Motion parallax Depth from motion Distance fog and texture degradation Object sizes page 3

5 Stereoscopic imaging As soon as photography was born, stereoscopic devices were created 1844: Stereoscope by David Brewster, a device that t could take photographic pictures in 3D. 1851: Improvement by Louis Jules Duboscq (picture of Queen Victoria displayed at The Great Exhibition) page 4

6 Example Stereoscopic view of Manhattan, 1909 page 5

7 3D Movies 1855: the Kinematoscope was invented, i.e. the Stereo Animation Camera 1915: The first anaglyph movie was produced 1922: the first public 3D movie was displayed - The Power of Love 1935: the first 3D color movie was produced page 6

8 Anaglyph image page 7

9 3D Television 1947: Soviet Union developed 3D films: Robinson Crusoe 50: many 3D movies were produced: d Bwana Devil, House of Wax, Alfred Hitchcock s Dial M for Murder (the movie was released in 2D because not all cinemas were able to display 3D films) page 8

10 3D Television Quality of Experience : Very good 2D movies vs objectionable 3D (bad color, annoying glasses ) 90s-2000s: 000s New technologies og es in acquisition, compression, o and rendering As of 2008, 3D programming is broadcast on Japanese cable channel BS 11 approximately four times per day. Sky 3D channel in April The system will require a special "3D ready" television and Sky+HD DVR box Starting on June 11th, 2010 ESPN will launch a new channel dedicated to 3D sports with up to 85 live events a year in 3D page 9

11 3D TV Systems Stereo camera Depth camera Multi-camera setup 2D/3D conversion 3D Conten Product tion 3D Vide eo Coding 3D Video Decoder +DIB BR er DVB Decod Multi user 3D TV Single user 3D TV 2D TV Video Depth Meta data page 10

12 3D Video acquisition Stereoscopy 2 cameras mounted side by side, separated by the same distance as between a person's pupils. Multi-view capture uses arrays of many cameras to capture a 3D scene through multiple independent video streams. Color+depth camera: capture normal video and a depth map, estimated with radar-like techniques (uses infrared) Multiview+depth: i th N Color+depth cameras page 11

13 3D Video Acquisition: stereo camera page 12

14 3D Video Acquisition: color + depth page 13

15 3D Video Acquisition: MVD page 14

16 Coding of 3D video Encode separately each view Encode jointly view Use other views to perform prediction of current image Encode a view and a depth map Joint or separate coding of view and depth Scalable coding? page 15

17 3D Rendering: Anaglyph Method page 16

18 3D Rendering: Polarized Method page 17

19 3D Rendering: Alternate-frame sequencing Every second frame is from the left [right] view Video is projected at twice the frame rate Viewers wears glasses that shutter alternatively the left or the right eye page 18

20 3D Rendering: Auto stereoscopic display page 19

21 Non-stereoscopic rendering methods Motion parallax Head tracking No special screen nor glasses! page 20

22 THANKS FOR YOUR ATTENTION!?? \\ (1) (1)Questions or comments Dario Rossi, Télécom-ParisTech Contacts: Marco CAGNAZZO Institut Télécom Télécom ParisTech Dép. Traitement Signal et Image e mail: cagnazzo@telecom-paristech.fr