3D Display and AR. Linda Li, Rokid Rlab Dec. 27, 2016

Transcription

1 3D Display and AR Linda Li, Rokid Rlab Dec. 27,

2 Five OLED Trends of Future Tactile / Haptic Touch Displays Higher Pixel Density Glasses-free 3D Virtue Reality and Augmented Reality 1

3 Stereoscopic 3D (glass-required) Outline Auto-stereoscopic 3D (glass-free) Cues for Depth Perception in Human Vision Light Field The Real 3D Light field camera 3D display Digital Holograph The Ultimate 3D 2

4 Stereoscopic Anaglyph (color) (glassesrequired) Polarization (linear or circular) Active shutters 3

5 (1) Spatial multiplex Autostereoscopic (glasses-free) Multiple projectors Lenticular lenses Parallax barriers Image courtesy: Neil A. Dodgson 4

6 (2) Time sequential multiplex Autostereoscopic Fourier-plane shuttering (glasses-free) (3) Retro-reflective and half-silvered mirrors Image courtesy: Neil A. Dodgson 5

7 Stereoscopic 3D (glass-required) Outline Auto-stereoscopic 3D (glass-free) Cues for Depth Perception in Human Vision Light Field The Real 3D Light field camera 3D display Digital Holograph The Ultimate 3D 6

8 Cues for Psychological Cues Depth Perception Linear perspective in Human Vision Overlapping Shading Texture gradient 7 Image courtesy: J. Hong et. Al.

9 Physiological Cues (what s missing from 2D display) Cues for Depth (1) Stereo parallax / Binocular disparity (solved above) Perception in Human (2) Motion parallax Vision 8 Image courtesy: Neil A. Dodgson

10 Physiological Cues Cues for Depth (3) Ocular accommodation Perception in Human (4) Ocular convergence Vision Accommodation distance = vergence distance Why does the fake 3D make us feel dizzy? 9 Image courtesy: eyetec, sinauer, arvojournals

11 Stereoscopic 3D (glass-required) Outline Auto-stereoscopic 3D (glass-free) Cues for Depth Perception in Human Vision Light Field The Real 3D Light field camera 3D display Digital Holograph The Ultimate 3D 10

12 Light Field Light field - Real 3D The 5D plenoptic function Light radiance (Ω, A) Parameterized by 4D light slabs L(u, v, s, t) 11 Image courtesy: Wikipedia Parameterized by light slab

13 What light sources do these represent? Angular Information (x, θ) space describes many rays at once 12 Image courtesy: Laura Waller

14 Fourier transform = Angular Information angular decomposition Lenslet array measures local angles Light fields are space-multiplexed 4D functions 13 Image courtesy: Laura Waller

15 Light Field - Applications Applications Illumination engineering Light field rendering (computer graphics, filming) Photography Microscopy (brain imaging) The Magic Box 3D display 14 Image courtesy: Xianfeng Gu

16 Light Field Camera 15 Image courtesy: Laura Waller

17 If you can capture both position and angle Light Field You can (sort of) figure out 3D depth Camera You can focus after the fact You can (sort of) extend the depth of field Lytro 16 Image courtesy: Laura Waller

18 Light Field Space-angle sampling tradeoff Camera More pixels/lenslet gives better angular sampling More lenslets overall gives better spatial sampling What problem though? 17 Image courtesy: Laura Waller

19 A custom HMD enclosure 3D Display - Nvidia Research Sony HMZ-T1 driver electronics Sony ECX332A OLED displays Fresnel Technologies #640 microlens array GPU accelerated stereoscopic light field renderer 18 Image courtesy: Nvidia Research

20 Limitations 3D Display - Nvidia Research Tradeoff between spatial and angular resolutions Diffraction limit of lenslet 19 Image courtesy: Nvidia Research

21 3D AR Fiber Optic Projector Magic Leap? Reverse design of fiber endoscope Angular information from piezoelectric actuation 20 Image courtesy: Brain Schowengerdt

22 3D AR Shape from stereo Magic Leap? Each fiber is like a lenslet (reconstruct angular information) Multiple fibers provide continuous motion parallax 21 Image courtesy: Brain Schowengerdt

23 3D AR Shape from focus modulation Magic Leap? Deformable mirror (problem?) Multiple light sources 22 Image courtesy: Brain Schowengerdt

24 3D AR Magic Leap Demo Magic Leap? Rony Abovitz 23 Image courtesy: Kevin Kelly

25 3D AR Challenges Magic Leap? Display: size, accommodation-vergence matching, light field collection Computation: rendering (dark color), focusing refresh rates 24 Image courtesy: Magic Leap

26 Stereoscopic 3D (glass-required) Outline Auto-stereoscopic 3D (glass-free) Cues for Depth Perception in Human Vision Light Field The Real 3D Light field camera 3D display Digital Holograph The Ultimate 3D 25

27 Digital Digital Holography the Ultimate 3D Holography Optical phase information Light cannot stop in the middle of free-space! Image courtesy: Star Wars 26 Image courtesy: Laura Waller

28 Digital Coding and decoding on SLM Holography Diffraction optics (LEIA) Image courtesy: N. Peyghambarian et. al. 27 Image courtesy: LEIA

29 The future is only limited by our imagination 28

30 References Confidential. Rokid Group 2016 Images and information in these slides are adapted from EE290F Computational Optics, EECS course instructed by Prof. Laura Waller, UC Berkeley, Autostereoscopic 3D Displays, N. A. Dodgson, IEEE Computer (2005). Multi-view autostereoscopic 3D display, N. A. Dodgson, Stanford Workshop (2011). Three-dimensional display technologies of recent interest - principles status and issues, J. Hong et. al., Applied Optics (2011). State of the art in stereoscopic and autostereoscopic displays, H. Urey, Proceedings of the IEEE (2011). Vergence-accommodation conflicts hinder visual performance and cause visual fatigue, D. M. Hoffman et. al., J. of Vision (2010). Near-eye light field displays, D. Lanman and D. Luebke, Sigraph (2013). Scanning fiber endoscopy with highly flexible 1-mm catheterscopes for wide-field full-color imaging, C. M. Lee et. al., J. of Biophotonics (2011). True three-dimensional displays that allow viewers to dynamically shift accommodation, bringing objects displayed at different viewing distances into and out of focus, B. T. Schowengerdt and E. J. Seibel, Cyber Psychology & Behavior (2004). 3D displays using scanning laser projection, B. T. Schowengerdt et. al., SID Digest (2012). High-resolution angioscopic imaging during endovascular neurosurgery, P. Z. McVeigh, Neurosurgery (2014). Magic Leap 核心技术揭秘, 顾险峰, 赛先生, biz=mza3otgzmzuzoa==&mid= &idx=1&sn=e9397fd797e4c78b5e1d77a4446aaf3f&s cene=21 (2016). 也来说说 Magic Leap 和 Hololens, Wanmin Wu, 50cb9958f3e2#.m98uop51u (2016). Magic Leap 和微软的 HoloLens 相比有哪些异同点?, Botao Amber Hu, (2015). Magic Leap 再发 Demo, 凯文 - 凯利万字长文揭秘, 杨志芳, (2016). 29