Shape and deformation measurements by high-resolution fringe projection methods February 2018

Similar documents
WORCESTER POLYTECHNIC INSTITUTE

An Innovative Three-dimensional Profilometer for Surface Profile Measurement Using Digital Fringe Projection and Phase Shifting

High-resolution 3D profilometry with binary phase-shifting methods

Accurate projector calibration method by using an optical coaxial camera

Supplementary materials of Multispectral imaging using a single bucket detector

Phase error correction based on Inverse Function Shift Estimation in Phase Shifting Profilometry using a digital video projector

Error analysis for 3D shape measurement with projector defocusing

Robot Vision: Camera calibration

This document contains the draft version of the following paper:

Draft SPOTS Standard Part III (7)

Projector Calibration for Pattern Projection Systems

Dynamic 3-D surface profilometry using a novel color pattern encoded with a multiple triangular model

Metrology and Sensing

Structured Light. Tobias Nöll Thanks to Marc Pollefeys, David Nister and David Lowe

MERGING POINT CLOUDS FROM MULTIPLE KINECTS. Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia

Sensing Deforming and Moving Objects with Commercial Off the Shelf Hardware

Coherent Gradient Sensing Microscopy: Microinterferometric Technique. for Quantitative Cell Detection

A Flexible Fringe Projection Vision System with Extended Mathematical Model for Accurate Three-Dimensional Measurement

Outline. ETN-FPI Training School on Plenoptic Sensing

Full-field optical methods for mechanical engineering: essential concepts to find one way

3D Computer Vision. Structured Light I. Prof. Didier Stricker. Kaiserlautern University.

Camera model and multiple view geometry

Metrology and Sensing

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration

High-speed three-dimensional shape measurement system using a modified two-plus-one phase-shifting algorithm

Vision Review: Image Formation. Course web page:

Improved phase-unwrapping method using geometric constraints

Automated calibration of multi-camera-projector structured light systems for volumetric high-speed 3D surface reconstructions

Agenda. DLP 3D scanning Introduction DLP 3D scanning SDK Introduction Advance features for existing SDK

Optics and Lasers in Engineering

Comparative study on passive and active projector nonlinear gamma calibration

Metrology and Sensing

Natural method for three-dimensional range data compression

Embedded Phase Shifting: Robust Phase Shifting with Embedded Signals

Time-resolved wavelet- based acquisitions using a single pixel camera

Optimal checkerboard selection for structured light system calibration

CIS 580, Machine Perception, Spring 2015 Homework 1 Due: :59AM

Shift estimation method based fringe pattern profilometry and performance comparison

Epipolar Geometry in Stereo, Motion and Object Recognition

Zuo, Chao; Chen, Qian; Feng, Shijie; Gu, Guohua; Asundi, Anand.

Image Formation I Chapter 1 (Forsyth&Ponce) Cameras

Enhanced two-frequency phase-shifting method

3D Shape Acquisition Using an FTP-based Method in Product Modeling

Outline. ETN-FPI Training School on Plenoptic Sensing

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.

Transparent Object Shape Measurement Based on Deflectometry

High-speed, high-accuracy 3D shape measurement based on binary color fringe defocused projection

Coherent digital demodulation of single-camera N-projections for 3D-object shape measurement: Co-phased profilometry

Rigid Body Motion and Image Formation. Jana Kosecka, CS 482

Image Formation I Chapter 1 (Forsyth&Ponce) Cameras

Geometric camera models and calibration

EE795: Computer Vision and Intelligent Systems

3-D D Euclidean Space - Vectors

Outline. Introduction System Overview Camera Calibration Marker Tracking Pose Estimation of Markers Conclusion. Media IC & System Lab Po-Chen Wu 2

ENGN D Photography / Spring 2018 / SYLLABUS

Extracting Sound Information from High-speed Video Using Three-dimensional Shape Measurement Method

Accurate and Simple Calibration of DLP Projector Systems

Dynamic three-dimensional sensing for specular surface with monoscopic fringe reflectometry

Measurement of Thermally Induced Warpage of BGA Packages/Substrates Using Phase-Stepping Shadow Moiré

Improving Vision-Based Distance Measurements using Reference Objects

Pixel-wise absolute phase unwrapping using geometric constraints of structured light system

Three Dimensional Measurements by Deflectometry and Double Hilbert Transform

Instance-level recognition I. - Camera geometry and image alignment

ENGN 2911 I: 3D Photography and Geometry Processing Assignment 2: Structured Light for 3D Scanning

CALIBRATION BETWEEN DEPTH AND COLOR SENSORS FOR COMMODITY DEPTH CAMERAS. Cha Zhang and Zhengyou Zhang

3,000-fps 3-D Shape Measurement Using a High-Speed Camera-Projector System

Image Transformations & Camera Calibration. Mašinska vizija, 2018.

High-resolution, real-time three-dimensional shape measurement

1 Projective Geometry

Pin Hole Cameras & Warp Functions

Camera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration

The real voyage of discovery consists not in seeking new landscapes, but in having new eyes.

Temporally-Consistent Phase Unwrapping for a Stereo-Assisted Structured Light System

Operating Procedure for Horiba Raman Microscope

PARTICLE IMAGE VELOCIMETRY (PIV) AND VOLUMETRIC VELOCIMETRY (V3V) SYSTEMS

A Stereo Machine Vision System for. displacements when it is subjected to elasticplastic

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, VOL. 6, NO. 5, SEPTEMBER

3D Geometry and Camera Calibration

Pin Hole Cameras & Warp Functions

Video Mosaics for Virtual Environments, R. Szeliski. Review by: Christopher Rasmussen

Depth Camera for Mobile Devices

The main problem of photogrammetry

Camera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah

CSCI 5980: Assignment #3 Homography

Scene Reconstruction from Uncontrolled Motion using a Low Cost 3D Sensor

Profilometry for the measurement of three-dimensional object shape using radial basis function, and multi-layer perceptron neural networks

3D data merging using Holoimage

Camera Model and Calibration

DEVELOPMENT OF LARGE SCALE STRUCTURED LIGHT BASED MEASUREMENT SYSTEMS

Phase error compensation for three-dimensional shape measurement with projector defocusing

All human beings desire to know. [...] sight, more than any other senses, gives us knowledge of things and clarifies many differences among them.

DD2423 Image Analysis and Computer Vision IMAGE FORMATION. Computational Vision and Active Perception School of Computer Science and Communication

Design, Development, and Calibration of a 3D Sensory System for Surface Profiling of 3D Micro-Scale Parts

High quality three-dimensional (3D) shape measurement using intensity-optimized dithering technique

Method for improving sinusoidal quality of error diffusion binary encoded fringe used in phase measurement profilometry

Motion Analysis Methods. Gerald Smith

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.

Performance Study of Quaternion and Matrix Based Orientation for Camera Calibration

Eye tracking by image processing for helping disabled people. Alireza Rahimpour

Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner

Transcription:

Shape and deformation measurements by high-resolution fringe projection methods February 2018

Outline Motivation System setup Principles of operation Calibration Applications Conclusions & Future work

Motivation Advance current methods for quantitative data collection using a non-contact, robust technique, applicable to a wide range of applications. Art Conservation Range Mobility Resolution Accuracy Criterion Crack Propagation Versatility Ease-of-Use Time

System Setup 1. Single Frame Fringe Projection (High-speed Fringe Projection) - a near-ir light source, an optical imaging device, and a near infrared sensitive digital charged-couple device (CCD) camera. LED θ A O I PC

Digital Micromirror Device (DMD TM ) Ref. Texas Instruments Close-up of chip surface Ants Foot 20 mm

Digital Micromirror Device

Digital Micromirror Device

Digital Micromirror Device

Digital Micromirror Device

System Setup 2. Structured light projection with phase shifting - A spatial light modulator (SLM) and a digital charged-couple device (CCD) camera. The SLM, packaged by Vialux, contains a digital light processing (DLP ) unit from TI MEMS based Sinusoidal Fringe Projection SLM θ A O I 20 mm PC Actual Pattern Projection 16000 Sinusoidal Fringe Projection 14000 12000 Light Intensity 10000 8000 6000 4000 2000 0 100 200 300 400 500 600 Pixels

Principles of Operation Single Image Analysis DC Component Shape information Ii ( x, Recorded Intensity distribution bi ( x, Image Contrast ai ( x, Image Brightness FFT IMAG( x, ( x, arctan REAL( x, METHOD MATHEMATICS i( x, ( x,, Multiple Image Analysis Ii ( x, ai ( x, bi( x, cos i i( x, ( x, i Random phase Fringe Locus Function Induced phase shift ( x, arctan m m Ii sin[ 2 m k ( i 1) ] i 1 m I m k i cos[ 2 ( i 1)] i 1 Arctangent is a discontinuous function

Principles of Operation - Unwrapping Temporal phase unwrapping: u i1 ( x, i1 ( x, 2N i1

Principles of Operation - Unwrapping Spatial phase unwrapping: Difference between neighboring pixel FFT Base on regions orders Determine 2 Filter Phase information Mod ( x, inverse FFT Wrapped phase arctan Spatial unwrapping IMAG( x, REAL( x, Unwrapping Scale x, ( x, 2k i, j ( i, j

C ), ( 0 u 0 v α z y x M ), ( t R m M t R A m t r r r ~ 3 2 1 0 0 ~ 1 1 0 0 0 1 z y x v u v u s Homography matrices are estimated in MATLAB using nonlinear method of maximum likelihood estimation. 5 intrinsic parameters [A] and extrinsic parameters [R t] are computed. 1. Z. Zhang, A flexible new technique for camera calibration, IEEE Transactions on Pattern analysis and machine intelligence, 2000, pp. 1330-1334 Removing lens distortion by camera calibration Pinhole camera model: Pinhole method is used to obtain intrinsic and extrinsic parameters of camera A planar checkerboard is shown under 20 different orientations and the grid corners of the image are extracted. Extrinsic parameters Error [pixel]

Range Application Sculpture Digitization System Setup Ease-of-Use Resolution Accuracy Versatility Criterion Sculpture titled Funeral of a Young Maiden Casona, South Italy. Late 4 th Century BCE Optimization of setup for sculpture digitization.75 m Schematic of sculpture digitization setup Measurement System Rotational Stage

Representative Results Approximate x resolution =.015 in. Approximate y resolution =.015 in Approximate z resolution = 0.0027 in.. A 0 ⁰ 180 ⁰ A

Application Shape and Deformation Measurements on a Canvas The object under test is a 4150 cm 2 painting on canvas. The painting is subjected to an airflow of a fan at the distance of 0.5 m from the painting Original image Lens distortion removed image Perspective removed image 10 cm 3D Shape 3D Shape 2 mm The distance from projector to object is 1.75 m, and the field of view is 500X500 mm 2. -8

Application Shape and Deformation Measurements on a Canvas The object under test is a 4150 cm 2 painting on canvas. The painting is subjected to an airflow of a fan at the distance of 0.5 m from the painting Canvas under airflow phase (time 1) phase (time 2) 10 cm 3D deformation 1.5 mm phase (time 2) 0 The distance from projector to object is 1.75 m, and the field of view is 500X500 mm 2.

Application of Single Frame Projection- Surface Road Measurements * Courtesy of VOTERS website

SOPRA Surface Optical Profilometry Roadway Analysis Normalized sunlight spectrum under sunny day condition measured on March 10,16:44 EST Projector Cooler system Ronchi ruling grating Near-Infrared light source Camera Near-Infrared sensitive camera Bandpass Interference Filter, Near-IR Normalized Near-Infrared light source spectrum under lab condition measured on March 10,16:57 EST

Time Range Mobility Accuracy Application of Single Frame Projection- Surface Road Measurements Van Setup Primary Criterion Requirement Z resolution: mm Approximate x resolution at distance 1.75 from the system to the ground = 0.38 mm. Approximate z resolution = 0.4 mm.

Dynamic results of measurements of different RI surface The different RI under test at speed of 20 miles/hr, exposure time 253 um, gain value 33, the field of view 455455mm 2. (a), (b) and (c), Fringes projected on the different RI condition objects; (e), (f) and (g), 3D model respectively. (a) (b) (c) (e) (f) (g)

Dynamic results of measurements of road surface Measurement results of consecutive images analyzed using FFT methods. Measurements done at 20 miles/hr Y Z X the video of the dynamic results the image of road