3D Vision Real Objects, Real Cameras. Chapter 11 (parts of), 12 (parts of) Computerized Image Analysis MN2 Anders Brun,
|
|
- Jerome Wilkinson
- 6 years ago
- Views:
Transcription
1 3D Vision Real Objects, Real Cameras Chapter 11 (parts of), 12 (parts of) Computerized Image Analysis MN2 Anders Brun,
2 3D Vision! Philisophy! Image formation " The pinhole camera " Projective geometry " Artefacts and challenges! Camera calibration " GOPRO + homebrew! Stereo vision " Hitta.se! Structured Light " Texture
3 Philosophy: Why 3-D?! Why do we model things in 3-D?! Without a 3-D model of the world, events are more difficult to predict! Movement, grasping, collision estimation, real size estimation,! Example: 2-D: A car on the highway looks bigger and drives faster when it approaches! 3-D: A car on the highway has constant size and speed when it approaches y z x x
4 Philosophy: 3-D cues Shape from: Focus Lighting Stereo Structured light Photo: Greg Keene
5 Philosophy: 3-D cues
6 Philosophy: 3-D cues
7 Philosophy: 3-D cues
8 Philosophy: Marr and 2.5-D! Primal sketch: Edges and areas! 2.5-D sketch: Texture and depth! 3-D model: A hierarchical 3-D model of the world Teddy dataset, from
9 Philosophies! Build accurate 3-D world representation 1. Build a complete 3-D model of the scene 2. Plan the task using the 3-D model 3. Example: Build a model of the scene, then find the teddy bear and send a robot arm to grab it.! Plan as you go, act and react 1. Collect features from the scene 2. Use the features to guide your actions 3. Example: Find the teddy bear using template matching in image, then send the robot hand in that direction. Possibly take more images when halfway.
10 Passive, Active and Dynamic Vision! Passive vision: " The camera has a fixed location! Dynamic vision: " The camera is moving but cannot be steered! Active vision: " The camera can be steered
11 The pinhole camera! The Pinhole camera is an idealized model! A real aperture is not a point.! A real aperture has a non-vanishing area and typically also a lens
12 The pinhole camera model! Where is the point P projected on the image plane inside the camera? P=(X,Y,Z) image plane x = f X Z focal point or origin (the pinhole ) x f
13 The pinhole camera model (alternative)! Imagine an observer is located at the focal point! A screen is placed at distance f from observer.! Where on this screen is P projected P=(X,Y,Z) x = + f X Z screen focal point (the observer ) x f = focal length y = + f Y Z
14 The pinhole camera model! In the pinhole camera, the world appears to be upside down (or 180 rotated).! The alternative interpretation is useful in computer graphics. It tells you exactly where to draw P on a screen, in front of the observer, in order to make it appear real for the observer. (OBS: the change of sign)! The alternative interpretation leads directly to projective geometry.
15 Projective Geometry (Very Briefly)! Points in 2-D are represented by lines in 3-D! The 3-D space is called the embedding space! All points along a line are equivalent! This is analogous to a photography, every point (position) in a photograph (2-D) corresponds to a line or ray in reality (3-D) α x Equivalence class x x
16 Projective Geometry (Very Briefly)! We can convert points in the ordinary plane to the projective plane! 2-D (x,y) # 3-D (x,y,1)! In general: D-dimensional # (D+1)-dimensional! Points x and α x are equivalent, α 0 α x Equivalence class x x 1
17 Projective Geometry (Very Briefly) α # x' & # h 11 h 12 h 13 & % ( % ( % y' ( = % h 21 h 22 h 23 ( $ % 1' ( $ % h 31 h 32 h 33 '( # x& % ( % y ( $ % 1' ( x'= h 11x + h 12 y + h 13 h 31 x + h 32 y + h 33 y'= h 21x + h 22 y + h 23 h 31 x + h 32 y + h 33 (linear) transformation H x x 1 1
18 Projective Geometry (Very Briefly)! Homography, a map from (D+1)-dim to (D+1)-dim! Linear in the (D+1)-dim embedding space! x = H x! Represents a perspective transformation in D-dim space! This is very nice! (linear) transformation H x x 1 1
19 Projective Geometry (Very Briefly)! Using homographies, we can express a rich class of transformations using linear mappings # R Rt& # sr Rt& " A t% H = I % ( % ( $ ' det(h) 0 $ 0 1 ' $ 0 1 ' # 0 1& Identity Isometric Similarity Affine Perspective
20 Perspective Transformations! Remember this example? We wanted to compute the perspective transformation parameters. From Feature based methods for structure and motion estimation by P. H. S. Torr and A. Zisserman
21 Perspective Transformations! Estimating H from point correspondences (simplified version, check the book for a more advanced version)! Each point correspondence translates to 2 linear equations (in the coefficients of H)! Assuming h 33 =1, we need 4 corresponding 2-D point pairs (x,y,x,y ) to solve this equation system (8 unknowns).! This way of solving the for the parameters has severe practical disadvantages, but it shows that it is possible at least... x'= h 11x + h 12 y + h 13 h 31 x + h 32 y + h 33 y'= h 21x + h 22 y + h 23 h 31 x + h 32 y + h 33 h 31 xx'+h 32 yx'+h 33 x' h 11 x h 12 y h 13 = 0 h 31 xy'+h 32 yy'+h 33 y' h 21 x h 22 y h 23 = 0 " P x (x,y, x',y') % $ # P y (x,y, x',y') & ' h = " 0 % $ # 0 ' &
22 Perspective Transformations! A cleaner and more stable solution! Multiply both sides with the cross product matrix $ 0 1 y' ' & ) α& 1 0 x' ) %& y' x' 0 () $ x' ' & ) & y' ) %& 1 () = $ 0 1 y' ' $ h 11 h 12 h 13 ' & )& ) & 1 0 x' )& h 21 h 22 h 23 ) %& y' x' 0 () %& h 31 h 32 h 33 () $ x' & ) & y) %& 1( ) 0 = $ 0 1 y' ' $ h 11 h 12 h 13 ' & )& ) & 1 0 x' )& h 21 h 22 h 23 ) %& y' x' 0 () %& h 31 h 32 h 33 () $ x' & ) & y) %& 1( ) 0 = Q(x, y, x',y')h Now three equations killing two unknowns
23 Single perspective camera X u Internal parameters External parameters O i f " $ αu = $ $ # $ αu = MX f s w 0 0 g v %" ' $ ' $ ' $ &' # % '" ' $ '# $ & R Rt 0 T 1 % ' &' X C M: Projection matrix
24 Single perspective camera! Estimation of M from known coordinates (X,Y,Z, 1) projections in a camera (x,y,1) α # x' & # m 11 m 12 m 13 m 14 & % ( % ( % y' ( = % m 21 m 22 m 23 m 24 ( $ % 1' ( $ % m 31 m 32 m 33 m 34 '( # X& % ( % Y ( % Z( % ( $ 1'! This is analogous to the homographic projection! Algorithms exist to solve this with 6 correspondences
25 Single perspective camera! This enables calibration from 6 known points! M can be factored: You can estimate camera focal length, image coordinate systems, camera position and rotation.! Triangulation: If you known several M i, then you can also estimate a position X (3-D) using several camera projections u i,(2-d).
26 Marker based motion capture Images: courtesy of Lennart Svensson
27 Mocap Images: courtesy of Lennart Svensson
28 External calibration! Rotation + position, 6 DoF, calibration Images: courtesy of Lennart Svensson
29 Motion capture applications! Animation! Biomechanical analysis! Industrial analysis Images: courtesy of Lennart Svensson
30 Image formation Lenses! Thin lens! zz'= f 2 Object plane Image plane Image focal point object focal point z f f z'
31 Image formation Lenses! Magnification, m = x/x! From similarity, x/z = X/f Object plane Image plane Image focal point X x object focal point z f f z' m = x X = f z = z' f
32 Image formation Lenses! Depth of field Δz Object plane Image plane Image focal point Δz ε = size of a pixel object focal point z f f z'! Thus, objects within depth of field, are scattered within an area smaller than a pixel, i.e. they are depicted sharp
33 Image formation Lenses! Depth of field Δz Object plane Image plane Image focal point Δz ε = size of a pixel object focal point z f f z'! Aperture size and focal length both affects the depth of field. A larger aperture will yield a smaller depth of field.
34 Image formation Lenses! Depth of focus Δz' Object plane Image plane Image focal point ε = size of a pixel object focal point Δz' z f f z'! Depth of focus is analogous. How much the image plane can be shifted without scattering light from a point in focus more than a pixel
35 Matlab File Exchange! Matlab code for non-perfect pinhole camera " Set aperture radius and focal length " Set depth of field " Set object distance and aperture radius
36 Image formation Lenses! (systems of) lenses # distortions:! Spherical aberration! Shorter focal length close to edges of lens (Image from wikipedia)
37 Image formation Lenses! (systems of) lenses # distortions:! Coma (Image from wikipedia)
38 Image formation Lenses! (systems of) lenses # distortions:! Chromatic aberration (Image from wikipedia)
39 Image formation Lenses! (systems of) lenses # distortions:! Astigmatism (Image from wikipedia)
40 Image formation Lenses! (systems of) lenses # distortions:! Geometric distortion Barrel distortion Pincushion distortion (Image from wikipedia)
41 Is this really a problem?! In old and cheap cameras, yes! Uppsala From
42 Is this really a problem?! But also for e.g. modern GoPRO cameras!
43 Camera Calibration Toolbox! A Matlab toolbox for camera calibration:! Freely available
44 Camera Toolbox Calibration! Focal length: The focal length in pixels is stored in the 2x1 vector fc.! Principal point: The principal point coordinates are stored in the 2x1 vector cc.! Skew coefficient: The skew coefficient defining the angle between the x and y pixel axes is stored in the scalar alpha_c.! Distortions: The image distortion coefficients (radial and tangential distortions) are stored in the 5x1 vector kc.
45 Stereo Basic equations P=(X,Y,Z) P=(X,Y,Z) z x x 1 x 2 f x 1 = f X Z x 2 = f X B Z Z = fb x 2 x 1 = fb d B B
46 Stereo the general case! It may happen that the relation between the two cameras is not a paralax translation! Then the epipolar constraint applies! By rectification epipolar lines are aligned with scanlines From: Epipolar Rectification by Fusiello et al.
47 Stereo Disparity Estimation! Search horizontally for patch disparity, use e.g. sum of squared differences (SSD) Teddy dataset, from
48 Stereo Depth estimation! A simple formula converting disparity d to distance z when the inter camera distance is B:! Z = fb d Patch based estimate Ground truth
49 Stereo Constraints! Constraints (Marr and Poggio): " Each point in each image is assigned at most one disparity value " The disparity varies smoothly at most locations in the images! However! Different regularization may be applied to the depth function z x x 1 x 2
50 Stereo from Segmentation! Alternative approach: " Make a segmentation of the image first " Apply a linear model in each segmented region " Refine the models in the regions From Segment-based Stereo Matching Using Graph Cuts by Hong and CHen
51 Large Scale 3D Maps (C3/SAAB) d Courtesy of Petter Torle C3 Technologies
52 Large Scale 3D Maps (C3/SAAB)
53 Structured Light! A lightsource helps the stereo algorithm to find matching points.! Often used in industrial applications From:
54 More Structured Light! Microsoft Kinect, using infrared light
55 Other Computer Vision Code! Open CV " Free to use " Supports IPP speedups " " " Intel Integrated Performance Primitives 6.0 " htm " Commercial (but cheap) " Includes Computer Vision, Signal Processing, Data Compression,.
56 Typical Exam Questions! Project this object (points) using a pinhole camera! Can geometric transformation compensate for lens distortions in general?! Explain the parameters building up the projection matrix M # f s w 0 & % ( u = % 0 g v 0 ( $ % '( u = MX # & % ( % ( $ % ' ( # R Rt& % $ 0 T ( X 1 '
57 Thank You!! questions to:
Cameras and Radiometry. Last lecture in a nutshell. Conversion Euclidean -> Homogenous -> Euclidean. Affine Camera Model. Simplified Camera Models
Cameras and Radiometry Last lecture in a nutshell CSE 252A Lecture 5 Conversion Euclidean -> Homogenous -> Euclidean In 2-D Euclidean -> Homogenous: (x, y) -> k (x,y,1) Homogenous -> Euclidean: (x, y,
More informationCamera model and multiple view geometry
Chapter Camera model and multiple view geometry Before discussing how D information can be obtained from images it is important to know how images are formed First the camera model is introduced and then
More informationGeometric camera models and calibration
Geometric camera models and calibration http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2018, Lecture 13 Course announcements Homework 3 is out. - Due October
More informationVision Review: Image Formation. Course web page:
Vision Review: Image Formation Course web page: www.cis.udel.edu/~cer/arv September 10, 2002 Announcements Lecture on Thursday will be about Matlab; next Tuesday will be Image Processing The dates some
More informationCS201 Computer Vision Camera Geometry
CS201 Computer Vision Camera Geometry John Magee 25 November, 2014 Slides Courtesy of: Diane H. Theriault (deht@bu.edu) Question of the Day: How can we represent the relationships between cameras and the
More informationRobot Vision: Camera calibration
Robot Vision: Camera calibration Ass.Prof. Friedrich Fraundorfer SS 201 1 Outline Camera calibration Cameras with lenses Properties of real lenses (distortions, focal length, field-of-view) Calibration
More informationCamera Calibration. Schedule. Jesus J Caban. Note: You have until next Monday to let me know. ! Today:! Camera calibration
Camera Calibration Jesus J Caban Schedule! Today:! Camera calibration! Wednesday:! Lecture: Motion & Optical Flow! Monday:! Lecture: Medical Imaging! Final presentations:! Nov 29 th : W. Griffin! Dec 1
More informationLUMS Mine Detector Project
LUMS Mine Detector Project Using visual information to control a robot (Hutchinson et al. 1996). Vision may or may not be used in the feedback loop. Visual (image based) features such as points, lines
More informationImage formation. Thanks to Peter Corke and Chuck Dyer for the use of some slides
Image formation Thanks to Peter Corke and Chuck Dyer for the use of some slides Image Formation Vision infers world properties form images. How do images depend on these properties? Two key elements Geometry
More informationLaser sensors. Transmitter. Receiver. Basilio Bona ROBOTICA 03CFIOR
Mobile & Service Robotics Sensors for Robotics 3 Laser sensors Rays are transmitted and received coaxially The target is illuminated by collimated rays The receiver measures the time of flight (back and
More informationAgenda. Rotations. Camera models. Camera calibration. Homographies
Agenda Rotations Camera models Camera calibration Homographies D Rotations R Y = Z r r r r r r r r r Y Z Think of as change of basis where ri = r(i,:) are orthonormal basis vectors r rotated coordinate
More informationCV: 3D to 2D mathematics. Perspective transformation; camera calibration; stereo computation; and more
CV: 3D to 2D mathematics Perspective transformation; camera calibration; stereo computation; and more Roadmap of topics n Review perspective transformation n Camera calibration n Stereo methods n Structured
More informationBIL Computer Vision Apr 16, 2014
BIL 719 - Computer Vision Apr 16, 2014 Binocular Stereo (cont d.), Structure from Motion Aykut Erdem Dept. of Computer Engineering Hacettepe University Slide credit: S. Lazebnik Basic stereo matching algorithm
More informationRectification and Distortion Correction
Rectification and Distortion Correction Hagen Spies March 12, 2003 Computer Vision Laboratory Department of Electrical Engineering Linköping University, Sweden Contents Distortion Correction Rectification
More information3D Sensing and Reconstruction Readings: Ch 12: , Ch 13: ,
3D Sensing and Reconstruction Readings: Ch 12: 12.5-6, Ch 13: 13.1-3, 13.9.4 Perspective Geometry Camera Model Stereo Triangulation 3D Reconstruction by Space Carving 3D Shape from X means getting 3D coordinates
More informationIntroduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation
Introduction CMPSCI 591A/691A CMPSCI 570/670 Image Formation Lecture Outline Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic
More informationRectification and Disparity
Rectification and Disparity Nassir Navab Slides prepared by Christian Unger What is Stereo Vision? Introduction A technique aimed at inferring dense depth measurements efficiently using two cameras. Wide
More informationCOSC579: Scene Geometry. Jeremy Bolton, PhD Assistant Teaching Professor
COSC579: Scene Geometry Jeremy Bolton, PhD Assistant Teaching Professor Overview Linear Algebra Review Homogeneous vs non-homogeneous representations Projections and Transformations Scene Geometry The
More informationECE-161C Cameras. Nuno Vasconcelos ECE Department, UCSD
ECE-161C Cameras Nuno Vasconcelos ECE Department, UCSD Image formation all image understanding starts with understanding of image formation: projection of a scene from 3D world into image on 2D plane 2
More informationImage Formation. Antonino Furnari. Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania
Image Formation Antonino Furnari Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania furnari@dmi.unict.it 18/03/2014 Outline Introduction; Geometric Primitives
More informationPin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Motivation Taken from: http://img.gawkerassets.com/img/18w7i1umpzoa9jpg/original.jpg
More informationStereo. 11/02/2012 CS129, Brown James Hays. Slides by Kristen Grauman
Stereo 11/02/2012 CS129, Brown James Hays Slides by Kristen Grauman Multiple views Multi-view geometry, matching, invariant features, stereo vision Lowe Hartley and Zisserman Why multiple views? Structure
More informationCameras and Stereo CSE 455. Linda Shapiro
Cameras and Stereo CSE 455 Linda Shapiro 1 Müller-Lyer Illusion http://www.michaelbach.de/ot/sze_muelue/index.html What do you know about perspective projection? Vertical lines? Other lines? 2 Image formation
More informationOutline. ETN-FPI Training School on Plenoptic Sensing
Outline Introduction Part I: Basics of Mathematical Optimization Linear Least Squares Nonlinear Optimization Part II: Basics of Computer Vision Camera Model Multi-Camera Model Multi-Camera Calibration
More informationThere are many cues in monocular vision which suggests that vision in stereo starts very early from two similar 2D images. Lets see a few...
STEREO VISION The slides are from several sources through James Hays (Brown); Srinivasa Narasimhan (CMU); Silvio Savarese (U. of Michigan); Bill Freeman and Antonio Torralba (MIT), including their own
More informationAgenda. Rotations. Camera calibration. Homography. Ransac
Agenda Rotations Camera calibration Homography Ransac Geometric Transformations y x Transformation Matrix # DoF Preserves Icon translation rigid (Euclidean) similarity affine projective h I t h R t h sr
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Today: dense 3D reconstruction The matching problem
More informationCS4670: Computer Vision
CS467: Computer Vision Noah Snavely Lecture 13: Projection, Part 2 Perspective study of a vase by Paolo Uccello Szeliski 2.1.3-2.1.6 Reading Announcements Project 2a due Friday, 8:59pm Project 2b out Friday
More informationcalibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
More informationPerception II: Pinhole camera and Stereo Vision
Perception II: Pinhole camera and Stereo Vision Davide Scaramuzza Margarita Chli, Paul Furgale, Marco Hutter, Roland Siegwart 1 Mobile Robot Control Scheme knowledge, data base mission commands Localization
More informationImage Rectification (Stereo) (New book: 7.2.1, old book: 11.1)
Image Rectification (Stereo) (New book: 7.2.1, old book: 11.1) Guido Gerig CS 6320 Spring 2013 Credits: Prof. Mubarak Shah, Course notes modified from: http://www.cs.ucf.edu/courses/cap6411/cap5415/, Lecture
More informationSingle View Geometry. Camera model & Orientation + Position estimation. What am I?
Single View Geometry Camera model & Orientation + Position estimation What am I? Vanishing point Mapping from 3D to 2D Point & Line Goal: Point Homogeneous coordinates represent coordinates in 2 dimensions
More informationPin Hole Cameras & Warp Functions
Pin Hole Cameras & Warp Functions Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Pinhole Camera. Homogenous Coordinates. Planar Warp Functions. Example of SLAM for AR Taken from:
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Wide baseline matching (SIFT) Today: dense 3D reconstruction
More informationLecture 6 Stereo Systems Multi-view geometry
Lecture 6 Stereo Systems Multi-view geometry Professor Silvio Savarese Computational Vision and Geometry Lab Silvio Savarese Lecture 6-5-Feb-4 Lecture 6 Stereo Systems Multi-view geometry Stereo systems
More information55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence
More informationComputer Vision Lecture 17
Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester
More informationCamera models and calibration
Camera models and calibration Read tutorial chapter 2 and 3. http://www.cs.unc.edu/~marc/tutorial/ Szeliski s book pp.29-73 Schedule (tentative) 2 # date topic Sep.8 Introduction and geometry 2 Sep.25
More informationComputer Vision Lecture 17
Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week
More informationComputer Vision Projective Geometry and Calibration. Pinhole cameras
Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole
More informationCOMP30019 Graphics and Interaction Perspective Geometry
COMP30019 Graphics and Interaction Perspective Geometry Department of Computing and Information Systems The Lecture outline Introduction to perspective geometry Perspective Geometry Virtual camera Centre
More informationUnit 3 Multiple View Geometry
Unit 3 Multiple View Geometry Relations between images of a scene Recovering the cameras Recovering the scene structure http://www.robots.ox.ac.uk/~vgg/hzbook/hzbook1.html 3D structure from images Recover
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t R 2 3,t 3 Camera 1 Camera
More information1 Projective Geometry
CIS8, Machine Perception Review Problem - SPRING 26 Instructions. All coordinate systems are right handed. Projective Geometry Figure : Facade rectification. I took an image of a rectangular object, and
More informationStereo Image Rectification for Simple Panoramic Image Generation
Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,
More informationLecture 11 MRF s (conbnued), cameras and lenses.
6.869 Advances in Computer Vision Bill Freeman and Antonio Torralba Spring 2011 Lecture 11 MRF s (conbnued), cameras and lenses. remember correction on Gibbs sampling Motion application image patches image
More informationBasilio Bona DAUIN Politecnico di Torino
ROBOTICA 03CFIOR DAUIN Politecnico di Torino Mobile & Service Robotics Sensors for Robotics 3 Laser sensors Rays are transmitted and received coaxially The target is illuminated by collimated rays The
More informationEpipolar Geometry Prof. D. Stricker. With slides from A. Zisserman, S. Lazebnik, Seitz
Epipolar Geometry Prof. D. Stricker With slides from A. Zisserman, S. Lazebnik, Seitz 1 Outline 1. Short introduction: points and lines 2. Two views geometry: Epipolar geometry Relation point/line in two
More information3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.
3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly
More informationChapters 1 7: Overview
Chapters 1 7: Overview Chapter 1: Introduction Chapters 2 4: Data acquisition Chapters 5 7: Data manipulation Chapter 5: Vertical imagery Chapter 6: Image coordinate measurements and refinements Chapter
More informationComputer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.
Computer Vision Coordinates Prof. Flávio Cardeal DECOM / CEFET- MG cardeal@decom.cefetmg.br Abstract This lecture discusses world coordinates and homogeneous coordinates, as well as provides an overview
More informationComputer Vision cmput 428/615
Computer Vision cmput 428/615 Basic 2D and 3D geometry and Camera models Martin Jagersand The equation of projection Intuitively: How do we develop a consistent mathematical framework for projection calculations?
More informationFinal Exam. Today s Review of Optics Polarization Reflection and transmission Linear and circular polarization Stokes parameters/jones calculus
Physics 42200 Waves & Oscillations Lecture 40 Review Spring 206 Semester Matthew Jones Final Exam Date:Tuesday, May 3 th Time:7:00 to 9:00 pm Room: Phys 2 You can bring one double-sided pages of notes/formulas.
More informationComputer Vision Projective Geometry and Calibration. Pinhole cameras
Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole
More informationToday. Stereo (two view) reconstruction. Multiview geometry. Today. Multiview geometry. Computational Photography
Computational Photography Matthias Zwicker University of Bern Fall 2009 Today From 2D to 3D using multiple views Introduction Geometry of two views Stereo matching Other applications Multiview geometry
More informationInstance-level recognition I. - Camera geometry and image alignment
Reconnaissance d objets et vision artificielle 2011 Instance-level recognition I. - Camera geometry and image alignment Josef Sivic http://www.di.ens.fr/~josef INRIA, WILLOW, ENS/INRIA/CNRS UMR 8548 Laboratoire
More informationLecture 14: Basic Multi-View Geometry
Lecture 14: Basic Multi-View Geometry Stereo If I needed to find out how far point is away from me, I could use triangulation and two views scene point image plane optical center (Graphic from Khurram
More informationWaves & Oscillations
Physics 42200 Waves & Oscillations Lecture 40 Review Spring 2016 Semester Matthew Jones Final Exam Date:Tuesday, May 3 th Time:7:00 to 9:00 pm Room: Phys 112 You can bring one double-sided pages of notes/formulas.
More informationSingle View Geometry. Camera model & Orientation + Position estimation. What am I?
Single View Geometry Camera model & Orientation + Position estimation What am I? Vanishing points & line http://www.wetcanvas.com/ http://pennpaint.blogspot.com/ http://www.joshuanava.biz/perspective/in-other-words-the-observer-simply-points-in-thesame-direction-as-the-lines-in-order-to-find-their-vanishing-point.html
More informationCSCI 5980: Assignment #3 Homography
Submission Assignment due: Feb 23 Individual assignment. Write-up submission format: a single PDF up to 3 pages (more than 3 page assignment will be automatically returned.). Code and data. Submission
More informationProjective Geometry and Camera Models
/2/ Projective Geometry and Camera Models Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Note about HW Out before next Tues Prob: covered today, Tues Prob2: covered next Thurs Prob3:
More informationCalibrating an Overhead Video Camera
Calibrating an Overhead Video Camera Raul Rojas Freie Universität Berlin, Takustraße 9, 495 Berlin, Germany http://www.fu-fighters.de Abstract. In this section we discuss how to calibrate an overhead video
More informationUnderstanding Variability
Understanding Variability Why so different? Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic aberration, radial distortion
More informationStereo and Epipolar geometry
Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka
More informationHomogeneous Coordinates. Lecture18: Camera Models. Representation of Line and Point in 2D. Cross Product. Overall scaling is NOT important.
Homogeneous Coordinates Overall scaling is NOT important. CSED44:Introduction to Computer Vision (207F) Lecture8: Camera Models Bohyung Han CSE, POSTECH bhhan@postech.ac.kr (",, ) ()", ), )) ) 0 It is
More informationComputer Vision I - Algorithms and Applications: Multi-View 3D reconstruction
Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Carsten Rother 09/12/2013 Computer Vision I: Multi-View 3D reconstruction Roadmap this lecture Computer Vision I: Multi-View
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera
More information3D Geometry and Camera Calibration
3D Geometry and Camera Calibration 3D Coordinate Systems Right-handed vs. left-handed x x y z z y 2D Coordinate Systems 3D Geometry Basics y axis up vs. y axis down Origin at center vs. corner Will often
More informationHow to achieve this goal? (1) Cameras
How to achieve this goal? (1) Cameras History, progression and comparisons of different Cameras and optics. Geometry, Linear Algebra Images Image from Chris Jaynes, U. Kentucky Discrete vs. Continuous
More informationCS6670: Computer Vision
CS6670: Computer Vision Noah Snavely Lecture 5: Projection Reading: Szeliski 2.1 Projection Reading: Szeliski 2.1 Projection Müller Lyer Illusion http://www.michaelbach.de/ot/sze_muelue/index.html Modeling
More informationDepth from two cameras: stereopsis
Depth from two cameras: stereopsis Epipolar Geometry Canonical Configuration Correspondence Matching School of Computer Science & Statistics Trinity College Dublin Dublin 2 Ireland www.scss.tcd.ie Lecture
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu VisualFunHouse.com 3D Street Art Image courtesy: Julian Beaver (VisualFunHouse.com) 3D
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu Reference Most slides are adapted from the following notes: Some lecture notes on geometric
More informationProjective Geometry and Camera Models
Projective Geometry and Camera Models Computer Vision CS 43 Brown James Hays Slides from Derek Hoiem, Alexei Efros, Steve Seitz, and David Forsyth Administrative Stuff My Office hours, CIT 375 Monday and
More information55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence
More informationOverview. Augmented reality and applications Marker-based augmented reality. Camera model. Binary markers Textured planar markers
Augmented reality Overview Augmented reality and applications Marker-based augmented reality Binary markers Textured planar markers Camera model Homography Direct Linear Transformation What is augmented
More informationVisual Recognition: Image Formation
Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know
More informationMore Mosaic Madness. CS194: Image Manipulation & Computational Photography. Steve Seitz and Rick Szeliski. Jeffrey Martin (jeffrey-martin.
More Mosaic Madness Jeffrey Martin (jeffrey-martin.com) CS194: Image Manipulation & Computational Photography with a lot of slides stolen from Alexei Efros, UC Berkeley, Fall 2018 Steve Seitz and Rick
More informationProject 4 Results. Representation. Data. Learning. Zachary, Hung-I, Paul, Emanuel. SIFT and HoG are popular and successful.
Project 4 Results Representation SIFT and HoG are popular and successful. Data Hugely varying results from hard mining. Learning Non-linear classifier usually better. Zachary, Hung-I, Paul, Emanuel Project
More informationCS5670: Computer Vision
CS5670: Computer Vision Noah Snavely, Zhengqi Li Stereo Single image stereogram, by Niklas Een Mark Twain at Pool Table", no date, UCR Museum of Photography Stereo Given two images from different viewpoints
More informationCS 664 Slides #9 Multi-Camera Geometry. Prof. Dan Huttenlocher Fall 2003
CS 664 Slides #9 Multi-Camera Geometry Prof. Dan Huttenlocher Fall 2003 Pinhole Camera Geometric model of camera projection Image plane I, which rays intersect Camera center C, through which all rays pass
More informationLecture 10: Multi-view geometry
Lecture 10: Multi-view geometry Professor Stanford Vision Lab 1 What we will learn today? Review for stereo vision Correspondence problem (Problem Set 2 (Q3)) Active stereo vision systems Structure from
More informationSingle View Geometry. Camera model & Orientation + Position estimation. Jianbo Shi. What am I? University of Pennsylvania GRASP
Single View Geometry Camera model & Orientation + Position estimation Jianbo Shi What am I? 1 Camera projection model The overall goal is to compute 3D geometry of the scene from just 2D images. We will
More informationPolitecnico di Milano
Politecnico di Milano Industrial Engineering Faculty Master of Science in Mechanical Engineering Stereoscopic measurements uncertainty analysis: a numerical and experimental approach Supervisor: Prof.
More informationDepth from two cameras: stereopsis
Depth from two cameras: stereopsis Epipolar Geometry Canonical Configuration Correspondence Matching School of Computer Science & Statistics Trinity College Dublin Dublin 2 Ireland www.scss.tcd.ie Lecture
More informationLecture 14: Computer Vision
CS/b: Artificial Intelligence II Prof. Olga Veksler Lecture : Computer Vision D shape from Images Stereo Reconstruction Many Slides are from Steve Seitz (UW), S. Narasimhan Outline Cues for D shape perception
More informationVictor S. Grinberg M. W. Siegel. Robotics Institute, School of Computer Science, Carnegie Mellon University 5000 Forbes Ave., Pittsburgh, PA, 15213
Geometry of binocular imaging III : Wide-Angle and Fish-Eye Lenses Victor S. Grinberg M. W. Siegel Robotics Institute, School of Computer Science, Carnegie Mellon University 5000 Forbes Ave., Pittsburgh,
More informationProject report Augmented reality with ARToolKit
Project report Augmented reality with ARToolKit FMA175 Image Analysis, Project Mathematical Sciences, Lund Institute of Technology Supervisor: Petter Strandmark Fredrik Larsson (dt07fl2@student.lth.se)
More informationAnnouncements. Stereo
Announcements Stereo Homework 2 is due today, 11:59 PM Homework 3 will be assigned today Reading: Chapter 7: Stereopsis CSE 152 Lecture 8 Binocular Stereopsis: Mars Given two images of a scene where relative
More informationProject 2 due today Project 3 out today. Readings Szeliski, Chapter 10 (through 10.5)
Announcements Stereo Project 2 due today Project 3 out today Single image stereogram, by Niklas Een Readings Szeliski, Chapter 10 (through 10.5) Public Library, Stereoscopic Looking Room, Chicago, by Phillips,
More informationStructure from Motion. Prof. Marco Marcon
Structure from Motion Prof. Marco Marcon Summing-up 2 Stereo is the most powerful clue for determining the structure of a scene Another important clue is the relative motion between the scene and (mono)
More informationLecture'9'&'10:'' Stereo'Vision'
Lecture'9'&'10:'' Stereo'Vision' Dr.'Juan'Carlos'Niebles' Stanford'AI'Lab' ' Professor'FeiAFei'Li' Stanford'Vision'Lab' 1' Dimensionality'ReducIon'Machine'(3D'to'2D)' 3D world 2D image Point of observation
More informationHumanoid Robotics. Projective Geometry, Homogeneous Coordinates. (brief introduction) Maren Bennewitz
Humanoid Robotics Projective Geometry, Homogeneous Coordinates (brief introduction) Maren Bennewitz Motivation Cameras generate a projected image of the 3D world In Euclidian geometry, the math for describing
More informationIntelligent Robotics
64-424 Intelligent Robotics 64-424 Intelligent Robotics http://tams.informatik.uni-hamburg.de/ lectures/2013ws/vorlesung/ir Jianwei Zhang / Eugen Richter University of Hamburg Faculty of Mathematics, Informatics
More informationAnnouncements. Motion. Structure-from-Motion (SFM) Motion. Discrete Motion: Some Counting
Announcements Motion HW 4 due Friday Final Exam: Tuesday, 6/7 at 8:00-11:00 Fill out your CAPES Introduction to Computer Vision CSE 152 Lecture 20 Motion Some problems of motion 1. Correspondence: Where
More informationStereo II CSE 576. Ali Farhadi. Several slides from Larry Zitnick and Steve Seitz
Stereo II CSE 576 Ali Farhadi Several slides from Larry Zitnick and Steve Seitz Camera parameters A camera is described by several parameters Translation T of the optical center from the origin of world
More informationStereo CSE 576. Ali Farhadi. Several slides from Larry Zitnick and Steve Seitz
Stereo CSE 576 Ali Farhadi Several slides from Larry Zitnick and Steve Seitz Why do we perceive depth? What do humans use as depth cues? Motion Convergence When watching an object close to us, our eyes
More informationAnnouncements. The equation of projection. Image Formation and Cameras
Announcements Image ormation and Cameras Introduction to Computer Vision CSE 52 Lecture 4 Read Trucco & Verri: pp. 5-4 HW will be on web site tomorrow or Saturda. Irfanview: http://www.irfanview.com/ is
More informationEECS 4330/7330 Introduction to Mechatronics and Robotic Vision, Fall Lab 1. Camera Calibration
1 Lab 1 Camera Calibration Objective In this experiment, students will use stereo cameras, an image acquisition program and camera calibration algorithms to achieve the following goals: 1. Develop a procedure
More informationRigid Body Motion and Image Formation. Jana Kosecka, CS 482
Rigid Body Motion and Image Formation Jana Kosecka, CS 482 A free vector is defined by a pair of points : Coordinates of the vector : 1 3D Rotation of Points Euler angles Rotation Matrices in 3D 3 by 3
More information