X.media.publishing. 3D Computer Vision. Efficient Methods and Applications. von Christian Wöhler. 1. Auflage

Similar documents
Other approaches to obtaining 3D structure

Depth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth

What is Computer Vision? Introduction. We all make mistakes. Why is this hard? What was happening. What do you see? Intro Computer Vision

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

AIT Inline Computational Imaging: Geometric calibration and image rectification

Announcements. Introduction. Why is this hard? What is Computer Vision? We all make mistakes. What do you see? Class Web Page is up:

Lambertian model of reflectance I: shape from shading and photometric stereo. Ronen Basri Weizmann Institute of Science

The Cinderella.2 Manual

Computer Vision Lecture 17

Computer Vision Lecture 17

Announcements. Stereo Vision Wrapup & Intro Recognition

Inline Computational Imaging: Single Sensor Technology for Simultaneous 2D/3D High Definition Inline Inspection

arxiv: v1 [cs.cv] 28 Sep 2018

Prof. Fanny Ficuciello Robotics for Bioengineering Visual Servoing

Three-Dimensional Computer Vision

A Developer s Guide to the Semantic Web

Passive 3D Photography

Analisi ed approssimazione di alcuni problemi appartenenti alla classe Shape-from-X

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching

LUMS Mine Detector Project

3D Model Acquisition by Tracking 2D Wireframes

Other Reconstruction Techniques

Epipolar geometry contd.

Passive 3D Photography

Direct Methods in Visual Odometry

Camera Drones Lecture 3 3D data generation

General Principles of 3D Image Analysis

Bowling for Calibration: An Undemanding Camera Calibration Procedure Using a Sphere

Dense 3D Reconstruction. Christiano Gava

Image Transformations & Camera Calibration. Mašinska vizija, 2018.

Parallel Programming

Recap: Features and filters. Recap: Grouping & fitting. Now: Multiple views 10/29/2008. Epipolar geometry & stereo vision. Why multiple views?

X.media.publishing. Multimedia Systems. Bearbeitet von Ralf Steinmetz, Klara Nahrstedt

L2 Data Acquisition. Mechanical measurement (CMM) Structured light Range images Shape from shading Other methods

Project 4 Results. Representation. Data. Learning. Zachary, Hung-I, Paul, Emanuel. SIFT and HoG are popular and successful.

DEPTH AND GEOMETRY FROM A SINGLE 2D IMAGE USING TRIANGULATION

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Radiance. Pixels measure radiance. This pixel Measures radiance along this ray

Structure from Motion. Prof. Marco Marcon

Discrete, Continuous, and Hybrid Petri Nets

BIL Computer Vision Apr 16, 2014

Reconstruction of Discrete Surfaces from Shading Images by Propagation of Geometric Features

Multiple View Geometry in Computer Vision Second Edition

Shading and Recognition OR The first Mrs Rochester. D.A. Forsyth, UIUC

Application questions. Theoretical questions

EECS 442 Computer vision. Announcements

Stereo Wrap + Motion. Computer Vision I. CSE252A Lecture 17

Representing the World

3D Sensing and Reconstruction Readings: Ch 12: , Ch 13: ,

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.

Comparison between Motion Analysis and Stereo

Contents I IMAGE FORMATION 1

Optimizing Monocular Cues for Depth Estimation from Indoor Images

Stereo Image Rectification for Simple Panoramic Image Generation

Dense 3D Reconstruction. Christiano Gava

Photometric Stereo.

Lecture 10: Multi-view geometry

Step-by-Step Model Buidling

Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies

Accurate 3D Face and Body Modeling from a Single Fixed Kinect

Camera calibration. Robotic vision. Ville Kyrki

Structure from motion

MERGING POINT CLOUDS FROM MULTIPLE KINECTS. Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia

IEC : Programming Industrial Automation Systems

CEng Computational Vision

CS 4495 Computer Vision A. Bobick. Motion and Optic Flow. Stereo Matching

Outline. ETN-FPI Training School on Plenoptic Sensing

On-line and Off-line 3D Reconstruction for Crisis Management Applications

Multi-View 3D Reconstruction of Highly-Specular Objects

PHOTOMETRIC STEREO SHAPE-AND-ALBEDO-FROM-SHADING FOR PIXEL- LEVEL RESOLUTION LUNAR SURFACE RECONSTRUCTION

Integrated three-dimensional reconstruction using reflectance fields

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

Lecture 9 & 10: Stereo Vision

Image based 3D inspection of surfaces and objects

Announcements. Stereo

Monocular Tracking and Reconstruction in Non-Rigid Environments

Lecture 10: Multi view geometry

Vision Review: Image Formation. Course web page:

Stereoscopic Vision System for reconstruction of 3D objects

Course 23: Multiple-View Geometry For Image-Based Modeling

1 Projective Geometry

ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows

Assignment #2. (Due date: 11/6/2012)

Light source estimation using feature points from specular highlights and cast shadows

Euclidean Reconstruction Independent on Camera Intrinsic Parameters

Finally: Motion and tracking. Motion 4/20/2011. CS 376 Lecture 24 Motion 1. Video. Uses of motion. Motion parallax. Motion field

3D Computer Vision. Dense 3D Reconstruction II. Prof. Didier Stricker. Christiano Gava

Computer Vision. 3D acquisition

3D Modeling of Objects Using Laser Scanning

calibrated coordinates Linear transformation pixel coordinates

Chaplin, Modern Times, 1936

EECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration

Evaluation of Surface Reconstruction Methods

Sashi Kumar Penta COMP Final Project Report Department of Computer Science, UNC at Chapel Hill 13 Dec, 2006

Lecture 8 Active stereo & Volumetric stereo

Three-Dimensional Sensors Lecture 2: Projected-Light Depth Cameras

Planetary Rover Absolute Localization by Combining Visual Odometry with Orbital Image Measurements

Depth from two cameras: stereopsis

Stereo and Epipolar geometry

Transcription:

X.media.publishing 3D Computer Vision Efficient Methods and Applications von Christian Wöhler 1. Auflage 3D Computer Vision Wöhler schnell und portofrei erhältlich bei beck-shop.de DIE FACHBUCHHANDLUNG Thematische Gliederung: 3-D Graphik, Computersimulation & Modelle Springer 2009 Verlag C.H. Beck im Internet: www.beck.de ISBN 978 3 642 01731 5

hotometric Approaches to Three-dimensional Scene Reconstruction 127.1 Shape from Shadow........................................ 127 2.1.1 Extraction of Shadows from Image Pairs................. 128 2.1.2 Shadow-based Surface Reconstruction tents Methods of 3D Computer Vision eometric Approaches to Three-dimensional Scene Reconstruction.. 3.1 The Pinhole Camera Model.................................. 3.2 Bundle Adjustment Methods................................. 7.3 Geometric Aspects of Stereo Image Analysis................... 9 1.3.1 Euclidean Formulation of Stereo Image Analysis.......... 9 1.3.2 Stereo Image Analysis in Terms of Projective Geometry.... 12.4 Geometric Calibration of Single and Multiple Cameras........... 17 1.4.1 Methods for Intrinsic Camera Calibration................ 17 1.4.2 The Direct Linear Transform (DLT) Method............. 18 1.4.3 The Camera Calibration Method by Tsai (1987).......... 21 1.4.4 The Camera Calibration Method by Zhang (1999a)........ 25 1.4.5 The Camera Calibration Method by Bouguet (2007)....... 27 1.4.6 Self-calibration of Camera Systems from Multiple Views of a Static Scene..................................... 28 1.4.7 Semi-automatic Calibration of Multiocular Camera Systems 41 1.4.8 Accurate Localisation of Chequerboard Corners.......... 51.5 Stereo Image Analysis in Standard Geometry................... 62 1.5.1 Image Rectification According to Standard Geometry...... 62 1.5.2 The Determination of Corresponding Points.............. 66.6 Three-dimensional Pose Estimation and Segmentation Methods.... 87 1.6.1 Pose Estimation of Rigid Objects....................... 88 1.6.2 Pose Estimation of Non-rigid and Articulated Objects...... 95 1.6.3 Point Cloud Segmentation Approaches.................. 113

Contents.2 Shape from Shading........................................ 132 2.2.1 The Bidirectional Reflectance Distribution Function (BRDF) 132 2.2.2 Determination of Surface Gradients..................... 137 2.2.3 Reconstruction of Height from Gradients................ 142 2.2.4 Surface Reconstruction Based on Eikonal Equations....... 144.3 Photometric Stereo......................................... 146 2.3.1 Classical Photometric Stereo Approaches................ 147 2.3.2 Photometric Stereo Approaches Based on Ratio Images.... 148.4 Shape from Polarisation..................................... 151 2.4.1 Surface Orientation from Dielectric Polarisation Models... 151 2.4.2 Determination of Polarimetric Properties of Rough Metallic Surfaces for Three-dimensional Reconstruction Purposes........................................... 154 eal-aperture Approaches to Three-dimensional Scene econstruction................................................. 159.1 Depth from Focus.......................................... 161.2 Depth from Defocus........................................ 162 3.2.1 Basic Principles..................................... 162 3.2.2 Determination of Small Depth Differences............... 167 3.2.3 Determination of Absolute Depth Across Broad Ranges.... 170 tegrated Frameworks for Three-dimensional Scene Reconstruction 181.1 Monocular Three-dimensional Scene Reconstruction at Absolute Scale..................................................... 182 4.1.1 Combining Motion, Structure, and Defocus.............. 183 4.1.2 Online Version of the Algorithm........................ 184 4.1.3 Experimental Evaluation Based on Tabletop Scenes....... 185 4.1.4 Discussion.......................................... 195.2 Self-consistent Combination of Shadow and Shading Features..... 196 4.2.1 Selection of a Shape from Shading Solution Based on Shadow Analysis............................ 197 4.2.2 Accounting for the Detailed Shadow Structure in the Shape from Shading Formalism................... 200 4.2.3 Initialisation of the Shape from Shading Algorithm Based on Shadow Analysis............................ 202 4.2.4 Experimental Evaluation Based on Synthetic Data......... 204 4.2.5 Discussion.......................................... 205.3 Shape from Photopolarimetric Reflectance and Depth............ 206 4.3.1 Shape from Photopolarimetric Reflectance............... 207 4.3.2 Estimation of the Surface Albedo....................... 211 4.3.3 Integration of Depth Information....................... 212 4.3.4 Experimental Evaluation Based on Synthetic Data......... 217 4.3.5 Discussion.......................................... 222

ts xv 4.4.1 Iterative Scheme for Disparity Estimation................ 225 4.4.2 Qualitative Behaviour of the Specular Stereo Algorithm.... 229.5 Three-dimensional Pose Estimation Based on Combinations of Monocular Cues........................................... 230 4.5.1 Appearance-based Pose Estimation Relying on Multiple Monocular Cues................... 231 4.5.2 Contour-based Pose Estimation Using Depth from Defocus. 236 I Application Scenarios pplications to Industrial Quality Inspection...................... 243.1 Inspection of Rigid Parts.................................... 244 5.1.1 Object Detection by Pose Estimation.................... 244 5.1.2 Pose Refinement..................................... 248.2 Inspection of Non-rigid Parts................................. 253.3 Inspection of Metallic Surfaces............................... 256 5.3.1 Inspection Based on Integration of Shadow and Shading Features................................. 256 5.3.2 Inspection of Surfaces with Non-uniform Albedo......... 257 5.3.3 Inspection Based on SfPR and SfPRD................... 259 5.3.4 Inspection Based on Specular Stereo.................... 266 5.3.5 Discussion.......................................... 273 pplications to Safe Human Robot Interaction.................... 277.1 Vision-based Human-Robot Interaction........................ 277 6.1.1 The Role of Gestures in Human Robot Interaction........ 278 6.1.2 Safe Human Robot Interaction......................... 279 6.1.3 Pose Estimation of Articulated Objects in the Context of Human Robot Interaction........................... 282.2 Object Detection and Tracking in Three-dimensional Point Clouds. 291.3 Detection and Spatio-temporal Pose Estimation of Human Body Parts..................................................... 293.4 Three-dimensional Tracking of Human Body Parts.............. 296 pplications to Lunar Remote Sensing........................... 303.1 Three-dimensional Surface Reconstruction Methods for Planetary Remote Sensing............................................ 304 7.1.1 Topographic Mapping of Solar System Bodies............ 304 7.1.2 Reflectance Behaviour of Planetary Regolith Surfaces..... 307.2 Three-dimensional Reconstruction of Lunar Impact Craters....... 311 7.2.1 Shadow-based Measurement of Crater Depth............. 311 7.2.2 Three-dimensional Reconstruction of Lunar Impact Craters at High Resolution................................... 314

Contents.4 Three-dimensional Reconstruction of Lunar Domes.............. 325 7.4.1 General Overview of Lunar Mare Domes................ 325 7.4.2 Observations of Lunar Mare Domes..................... 328 7.4.3 Image-based Determination of Morphometric Data........ 331 7.4.4 Geophysical Insights Gained from Topographic Data...... 343 onclusion.................................................... 351 nces......................................................... 359

http://www.springer.com/978-3-642-01731-5