HDRC CMOS-Bildsensorik

Transcription

1 HDRC CMOS-Bildsensorik mit höchster Dynamik Bernd Höfflinger

2 Imaging IMAGING RESPONSE SCENE DYNAMIC COLOR RANGE CONSTANCY Our eyes Logarithmic Very high Yes Painting Eye-like, logarithmic High Depending on the artist Film Pseudo eye-like, pseudo logarithmic High Yes Vidicon Linear Small No CCD Linear Small No Other CMOS Linear Small No HDRC Eye-Like, logarithmic Very high Yes S. 2 HDRC Bildsensorik/BH/Nov_2003

3 The Revolution in Electronic Imaging S. 3 HDRC Bildsensorik/BH/Nov_2003

4 Dynamic Range S. 4 HDRC Bildsensorik/BH/Nov_2003

5 Time-Continuous Log-Compressing Pixel V DD M1 M3 Out M2 V SS V SS Out V DD p+ p+ p+ p+ M1 M2 M3 n n+ p V SS Filed 03/24/1992 International Patents S. 5 HDRC Bildsensorik/BH/Nov_2003

6 HDRC Images HDRC High-Dynamic Range Camera 1996 S. 6 HDRC Bildsensorik/BH/Nov_2003

7 CCD vs. HDRC VGAx CCD HDRC 380 x 470, 25 fps, spotlight mode 380 x 470, 30 fps The video recording of the replica of Michelangelo's "Maria" demonstrates the natural, eye-like response of the HDRC VGAx camera as compared with a high-performance CCD camcorder S. 7 HDRC Bildsensorik/BH/Nov_2003

8 Sobel Operator HDRC vs. CCD CCD HDRC Sobel Operator Original Image Courtesy: OMRON S. 8 HDRC Bildsensorik/BH/Nov_2003

9 CMOS Imager Signal-to-Noise and Dynamic Range 1000 Flat-Field Signal-to-Noise HDRC VGAx 20 C independent of int. time 4T CMOS PPD APS 20 C 10ms 1) XDR CMOS APS 64 C 10ms 1) 1 0,001 0,01 0, Green Lux (555 nm) 1) Janesick 2003 S. 9 HDRC Bildsensorik/BH/Nov_2003

10 Video Recording at the Limit Person at 10 m, 40 mlux CCD HDRC VGAx S. 10 HDRC Bildsensorik/BH/Nov_2003

11 Night Vision: The Challenge Scenario with permanent infrared high beam S. 11 HDRC Bildsensorik/BH/Nov_2003

12 Spectral Sensitivity of Photodiodes S. 12 HDRC Bildsensorik/BH/Nov_2003

13 Hella Light Tunnel I Car with high beams at 80 m and pedestrian at 100 m 140 m 120 m 100 m 80 m 60 m Scenario illuminated with low beam and permanent infrared (NIR) high beam 2001 In cooperation with S. 13 HDRC Bildsensorik/BH/Nov_2003

14 Pedestrians in Absolute Darkness Two pedestrians at 120 m in the 140 m HELLA light tunnel at absolute darkness Scene illuminated with permanent infrared (NIR) high beam 2001 In cooperation with S. 14 HDRC Bildsensorik/BH/Nov_2003

15 More Than You Can See Scene illuminated with (NIR) high beam License plate between headlights and the distant pedestrian are detected clearly. S. 15 HDRC Bildsensorik/BH/Nov_2003

16 HDRC Night Vision Safe In Any Scene CCD HDRC Fast motion at low light levels presents fundamental problems for all imagers, which need exposure (or integration) time to generate an image. HDRC pixels track the photon flux continuously. They produce sharp contours and texture under any lighting and speed conditions. S. 16 HDRC Bildsensorik/BH/Nov_2003

17 HDRC Night Vision Safe In Any Scene CCD HDRC S. 17 HDRC Bildsensorik/BH/Nov_2003

18 Electronic Eyes on Wheels Traffic Signs Night Vision Road Hazard Lane Following Intelligent Cruise Collision Avoidance Intelligent Headlights Parking Aid Dead Angle View Front-Seat Occupation Distraction and Fatigue Warning Driver Identification Cross Traffic and Side Impact Warning Rear View Lane Change 2010 ca. 40 Billion Euro S. 18 HDRC Bildsensorik/BH/Nov_2003

19 Color Constancy Over- or Under-exposeure? No Problem for HDRC F: 1.8, 1/30 s F: 4, 1/30 s Recorded HDRC images displayed after offset adjustment. F: 8, 1/30 s S. 19 HDRC Bildsensorik/BH/Nov_2003

20 Backlighting CCD still camera, 1280 x 960 pixels, automode HDRC 4PC, 512 x 256 pixels, 30 frames/s Dynamic range, color constancy and backlighting performance of the HDRC camera are shown in this more challenging scene (as far as it is printable). This is the direct HDRC image with out post-processing. For comparison, the digital CCD camera has reached its limits in spite of its advantage in resolution and of all its postprocessing power. (A film cannot handle this scene either). S. 20 HDRC Bildsensorik/BH/Nov_2003

21 St. Johann Stuttgart CCD Digital CCD Camcorder (768 x 552 pixels), snapshot mode, auto-matic gain and exposure. CCD: White-saturated glass panels and blacksaturated walls. S. 21 HDRC Bildsensorik/BH/Nov_2003 HDRC HDRC VGA digital video camera, recorded with 120 db dynamic range, 25 frames/s. Challenging for our eyes and out of reach for any other image recorder, the six decades of luminous intensity are captured faithfully by the HDRC camera.

22 Turn-On of Headlight CCD HDRC S. 22 HDRC Bildsensorik/BH/Nov_2003

23 Turn-On of Headlight 3 Frames CCD HDRC 0.0 sec 0.5 sec 1.0 sec S. 23 HDRC Bildsensorik/BH/Nov_2003

24 HDRC Motion Video Imagers Pixels 2M 1M 100k 100k 128k 0.8µm 0.5µm 400k 200k 300k 300k 0.5µm 0.35µm 0.35µm 0.25µm 32k 32k 10k 4k 1.2µm 0.8µm color A / D Rolling Shutter 2µm 1k Year S. 24 HDRC Bildsensorik/BH/Nov_2003

25 Airport Sun, Fog, Night HDRC Camera-Guided Aircraft Docking SUN High Dynamic Range High Sensitivity High Contrast Resolution One Camera Setting for All FOG Billund Brüssel Dresden Hannover Leipzig Beijing Seoul Courtesy: Honeywell Airport Systems and Gevitec NIGHT S. 25 HDRC Bildsensorik/BH/Nov_2003

26 HDRC Partners IMS VISION GmbH hema Elektronik GmbH GEVITEC S. 26 HDRC Bildsensorik/BH/Nov_2003