Mobile Influenced Markets Evolution of Camera and Display Uses

Transcription

1 Tom Watzka Satwant Singh Mobile Influenced Markets Evolution of Camera and Display Uses

2 Lattice MIPI D-PHY Applications The PC industry created demand in adjacent markets such as test equipment, POS terminals, and industrial controls Designers leveraged their access to standardized Is and hardware In a similar way, the mobile industry is experiencing demand for high quality, low cost components in mobile influenced markets 2

3 Traditional Display Applications Rear Display Front Display Traditional display applications will include one (maybe two) static displays Split 3

4 Appliances SOC BRIDGING LVDS Bridge Industrial DSI Bridge LVDS Many consumer, automotive, and industrial applications use older LVDS interfaces Automotive 4

5 AR/VR (Displays) Monitor Input Left Eye Right Eye Split HDMI Bridge Merging is the favored method to minimize eyeto-eye latency. Minimum frame rate of 75 Hz is needed to avoid motion sickness. 5

6 Mux vs Merge Video data can be multiplexed through a single MIPI D-PHY port by mux-ing frame by frame, or merging to super frames. Camera 1 Frame 1 Frame 2 Frame 3 Frame 4 Mux Input Output = 1X Input Bandwidth, 1 Frame Latency Camera 2 Frame 1 Frame 2 Frame 3 Frame 4 Output Frame 1 Frame 2 Frame 3 Frame 4 Frame 1 Frame 2 Frame 3 Camera 1 Line 1 Line 2 Merge Input Output = 2X Input Bandwidth, 0 Latency Camera 1 Line 1 Line 2 Output Line 1 Line 2 6

7 Traditional Camera Applications Rear Camera Front Camera Mux Traditional camera applications statically switch from one camera to the other 7

8 AR/VR (Cameras) Requires Environment Awareness IMU Inertial Measurement Unit Performing Sensor Fusion for Accelerometer, Gyrometer & Magnetometer Cameras Distance Measurement Environmental Understanding 8

9 AR/VR Tracking Outside-In System Inside-Out System (such as Microsoft Hololens) Two approaches to positional tracking: Outside-In requires external hardware Inside-out is self contained 9

10 AR/VR Permutations for Inside-Out Inside-out implementations are growing in the number of cameras and sensors Input Output 2X Bandwidth, 0 Latency ~3X Bandwidth, 0 Latency TOF TOF : ~5X Bandwidth, 0 Latency TOF TOF 10

11 360 Cameras Just more cameras Merge Drones Require same things as AR/VR Plus more cameras Merge Automotive Require same things as AR/VR Plus transport Merge Transport GPU 11

12 Everything Else SOC LVDS Bridge DSI CMOS RGB / 24 Bridge CSI-2 DSI LVDS Bridge LVDS DSI Bridge LVDS LVDS Dual LVDS CSI-2 Bridge CMOS RGB / 24 SOC SOC CMOS RGB / 24 Bridge DSI CSI-2 Re-Time CSI-2 12

13 Why FPGAs? Flexibility CrossLink FPGAs have general purpose IOs in addition to specialized IOs such as MIPI D-PHY Programmable I/O Programmable FPGA Fabric MIPI D-PHY FPGAs provide an array of flexible programmable logic cells that can support high speed data flow including splitting and merging functions 13

14 Why FPGAs? Time To Market Product development cycle is much faster than ASIC cycles FPGAs enable innovation Design RTL Features Consumer = 6 12 month dev cycle Simulate Pass Synthesize Days to Weeks Dev Cycle ASICs = 18 month dev cycle Debug Pass Time 14

15 Summary MIPI components have become ubiquitous Cameras, Displays, s, Accelerometers, Gyrometers, Magnetometers Mobile influenced markets are leveraging these components in all sorts of ways and combinations FPGAs have been instrumental in enabling these new (and unforeseen) markets in ways that simple bridges cannot, in terms of time and functionality 15

16