John Monti Vice President Pixim, Inc.

Size: px

Start display at page:

Download "John Monti Vice President Pixim, Inc."

Allan Fletcher
5 years ago
Views:

1 John Monti Vice President Pixim, Inc. 1 Professional Education for the Security Industry

2 AIA Provider Statement Reed Construction Data is a Registered Provider with The American Institute of Architects Continuing Education Systems (AIA/CES). Credit(s) earned on completion of this program will be reported to AIA/CES for AIA members. Certificates of Completion for both AIA members and non-aia members are available upon request. This program is registered with AIA/CES for continuing professional education. As such, it does not include content that may be deemed or construed to be an approval or endorsement by the AIA of any material of construction or any method or manner of handling, using, distributing, or dealing in any material or product. Questions related to specific materials, methods, and services will be addressed at the conclusion of this presentation. 2 Professional Education for the Security Industry

3 Course Description Surveillance cameras are specified for daytime and/or nighttime performance. Proper specification and application involves a basic understanding of the performance differences between thermal and visible cameras. These performance levels are mainly determined by the imager (chip) technology employed in the camera. This course provides fundamental knowledge of each type of imager technology, their application, and current and future developments. 3 Professional Education for the Security Industry

4 Learning Objectives At the end of this program, participants will be able to: Describe the fundamental sensing mechanisms of thermal imagers. Compare CMOS vs. CCD visible imager chip performance. Determine when thermal cameras should be specified. Compare thermal imagers from visible imagers under varying light and weather conditions. 4 Professional Education for the Security Industry

5 Thermal and Visible Imager Course # CNL1111T1S1 Image Capture Technologies for Video Security John Monti Vice President Pixim, Inc. monti@pixim.com The Best Imaging Night and Day 5 Professional Education for the Security Industry

6 Pixim, Inc. Chip developer based in Silicon Valley Spin off from Stanford University Build chipsets for security cameras Core technologies Image sensors Image processor chips Color science Camera operating system and application firmware Camera system design Several million cameras installed in 100 countries 56 patents issued 6 Professional Education for the Security Industry

7 Image Quality Is Essential What Makes a Quality Image? Scene Characteristics Optical Elements Image Sensor Image Processing Network Impact Common Imaging Problems Camera Construction Summary The intrinsic value of any video security system depends on the quality of the captured images 7 Professional Education for the Security Industry

8 Lighting Challenges Everywhere GAS STATION WAREHOUSE INDUSTRIAL RETAIL BANKING CAMPUS 8 Professional Education for the Security Industry

9 Scene Characteristics Light sources Modulated Fluorescent AC LEDs Un-modulated Sunlight/Moonlight Tungsten/Halogen DC LEDs Illumination level Color temperature Contrast, dynamic range Depth of field Many more 9 Professional Education for the Security Industry

Cleanliness Mounting Infrared cut-off filter Transmission curve Image

10 Optical Considerations Lens MTF Element number and type Lens materials Coatings Optical filters Low pass filter Number of layers Blur axes Cleanliness Mounting Infrared cut-off filter Transmission curve Image sensor Planarity Integrity Back focus 10 Professional Education for the Security Industry

11 Pixel Aperture and Light Collection micro lens color filter Narrow Aperture Thicker CFA & Micro Lens Wider aperture Thinner CFA & Micro lens silicon ~11um ~5um photodiode Refined pixel characteristics make a big difference 11 Professional Education for the Security Industry

Color Filter Array RGBG CMYG RGBG provides better frequency separation Result is truer color when pixel well capacity is limited CMYG improves low light Passes more signal to

12 Color Filter Array RGBG CMYG RGBG provides better frequency separation Result is truer color when pixel well capacity is limited CMYG improves low light Passes more signal to the photodiodes beneath Improves SNR for each pixel The ultimate image sensor provides both accurate color and optimal low light 12 Professional Education for the Security Industry

13 Color Filter Array CFAs separate colors differently which impacts the image processing algorithms 13 Professional Education for the Security Industry

14 Image Quality Starts at the Sensor CCD Charged Coupled Device Invented at Bell Labs in 1969 Silicon photodiode with interlaced shutter & analog read-out CMOS APS Complementary Metal Oxide Semiconductor Active Pixel Sensor Silicon photodiode array with rolling shutter & analog pixel read-out DPS Digital Pixel System technology Silicon photodiode array with global shutter and digital pixel read-out Embeds analog-to-digital converter in each pixel 14 Professional Education for the Security Industry

15 3 Basic Sensor Types CCD - Charged Coupled Device digitized sensor data 15 Professional Education for the Security Industry

16 3 Basic Sensor Types CMOS Active Pixel Sensor digitized sensor data 16 Professional Education for the Security Industry

17 3 Basic Sensor Types Digital Pixel System Architecture Word Row Decoder Digital pixel Digital data is read directly from each pixel Sense Amplifiers and Latches Bit 17 Professional Education for the Security Industry

18 Digital Pixel System Structure Photodiodes ~50% Fill Factor 7 micron pitch 18 Professional Education for the Security Industry

19 Digital Pixel System Structure Polysilicon & Via 1 19 Professional Education for the Security Industry

20 Digital Pixel System Structure Metal 1 20 Professional Education for the Security Industry

21 Digital Pixel System Structure Metal 2 21 Professional Education for the Security Industry

22 Digital Pixel System Structure Metal 3 22 Professional Education for the Security Industry

23 Digital Pixel System Structure Metal 4 23 Professional Education for the Security Industry

24 Digital Pixel System Structure 24 Professional Education for the Security Industry

25 Digital Pixel System 4 Pixel Quad CMY Color Filter Anti-Reflection Metal 4 Metal 3 Metal 2 Metal 1 Substrate 25 Professional Education for the Security Industry

26 Image Sensor Quantum Efficiency QE 1 Seawolf Spectral Response Relative Response Magenta Yellow Cyan Wavelength (nm) Both Visible and IR Sensitivity Matter P Professional Education for the Security Industry

27 Image Sensor & Processor Multi-chip module with image sensor and processor silicon 27 Professional Education for the Security Industry

28 Impact of Optical Format 1/3 2/3 35mm film Pixel Size = Optical Format * Width 2 + Height 2 28 Professional Education for the Security Industry Note this is a rough calculation only

29 Resolution Sensor resolution is less important than system resolution Many variables impact the effective resolution Lens quality Pixel count & size Pixel read-out Demosaic kernel Bit precision in the image processing pipeline Compression standard and quality of implementation Cameras are complex, multi-stage, real-time systems which require qualitative measurement at the output 29 Professional Education for the Security Industry

CCTV Total Resolution Total Resolution = Horizontal x Vertical 300,000 690 HTVL-E 250,000 650 HTVL-E 600 HTVL-E 600 HTVL-E 630 HTVL-E 540 HTVL-E 200,000 150,000 100,000 50,000

30 CCTV Total Resolution Total Resolution = Horizontal x Vertical 300, HTVL-E 250, HTVL-E 600 HTVL-E 600 HTVL-E 630 HTVL-E 540 HTVL-E 200, , ,000 50,000 Clinton CE-VX70 Seawolf Sony 650 HTVL CCD Samsung A1 SCC-B2335 Techwin Winner 5 SDC-435 Panasonic SD5 WV-CP504 Bosch Dinion 2X LTC0490/21 30 Professional Education for the Security Industry

31 CCTV Total Resolution Interline CCD Interlaced Capture DPS Progressive Capture 540 HTVL 540 HTVL 480 lines Total Resolution 360 VTVL 480 VTVL Total Resolution Lost Resolution Interlaced image sensors throw away 25% 31 Professional Education for the Security Industry

32 Global Shutter Advantage Skew is a common rolling shutter artifact 32 Professional Education for the Security Industry

33 Rolling Shutter Artifact-Fluorescent Rolling shutter image sensor banding under modulated light 33 Professional Education for the Security Industry

34 Image Processing Pipeline Sensor Data De-Mosaic Color Correction Exposure Many steps are involved in producing a high quality video stream for both CCTV and IP cameras Gamma Correct CVBS IP Streaming Monitor or DVR Network 34 Professional Education for the Security Industry

35 Pixel Blooming Camera #1 Camera #2 Hot spots caused by pixel blooming in lowlight 35 Professional Education for the Security Industry

36 Mixed Lighting Camera #1 Camera #2 Pixel saturation can cause loss of detail in mixed lighting 36 Professional Education for the Security Industry

37 Slow Shutter Artifacts Camera #1 Camera #2 Slow shutter modes can blur critical detail in dim light 37 Professional Education for the Security Industry

38 Mixed Lighting Camera #1 Camera #2 Image sensor frame subtraction can make mistakes 38 Professional Education for the Security Industry

39 Mixed Lighting Camera #1 Camera #2 Mixed lighting can impact resolution as well as color 39 Professional Education for the Security Industry

40 Indoor Lighting Camera #1 Camera #2 Mixed lighting can confuse auto white balance 40 Professional Education for the Security Industry

41 Dark Scenes Camera #1 Camera #2 Accurate color is difficult to capture in dark scenes 41 Professional Education for the Security Industry

42 Very Dark Scenes Camera #1 Camera #2 Spot lights can cause high contrast in very dark scenes 42 Professional Education for the Security Industry

43 Noise and Compression Improving image quality has a positive affect on image compression Improved recording time on variable bit rate DVRs Reduced bandwidth requirements on IP cameras Image attributes affect compression Noise Edge jitter Random noise pattern Image rendering Differencing between frames Exposure, white balance Artifacts Blooming, smearing, interlacing 43 Professional Education for the Security Industry

compressor thresholds to be exceeded These image artifacts grow

44 Image Artifacts Affect Compression Edge sparkle Sampling errors display as edge sparkles or jitter These distortions cause compressor thresholds to be exceeded These image artifacts grow bit rates and file sizes 44 Professional Education for the Security Industry

45 Compression Advantage Wasted Disk Space Camera #2 Camera #1 45 Professional Education for the Security Industry

46 Costly Noise Camera #1 Camera #2 3,484MB Note: actual compression results will vary. 1,191MB Camera differences can require up to 3x DVR space. 46 Professional Education for the Security Industry

47 Camera Construction More variables to consider: Direct digital-to-digital interface from image processor to compression hardware Power supply design a key noise source! Thermal management Emissions Quality consistency Sensor / filter / lens planarity Etc. 47 Professional Education for the Security Industry

48 Summary Image quality is essential Many factors impact image quality Lighting conditions, optics, image sensor Image processing Bit precision, dynamic range, color, rendering Compression Impact of noise Camera construction Pixel size is not free (smaller is worse) Higher resolution cameras have tradeoffs 48 Professional Education for the Security Industry

49 Recommendation It is critical to test the cameras in the system to ensure desired results 49 Professional Education for the Security Industry

50 50 Professional Education for the Security Industry

51 This concludes Thermal & Visible Imagers CNL1111T1S1 John Monti Pixim, Inc. 51 Professional Education for the Security Industry

MATT BRETOI FLIR Systems, Inc. Ph:

MATT BRETOI FLIR Systems, Inc. Ph: 941.726.8121 Email: matt.bretoi@flir.com 1 Professional Education for the Security Industry AIA Provider Statement FLIR Systems is a Registered Provider with The American