Multiple View Geometry in Computer Vision
|
|
- Samson Holland
- 5 years ago
- Views:
Transcription
1 Multiple View Geometry in Computer Vision Prasanna Sahoo Department of Mathematics University of Louisville 1
2 Projective 3D Geometry (Back to Chapter 2) Lecture 6 2
3 Singular Value Decomposition Given a square matrix A, the singular value decomposition factors A into three matrices U, D and V such that A = U D V T. In this decomposition U and V are two orthogonal matrices and D is a diagonal matrix with non-negative entries. (A matrix U is orthogonal if U T = U 1.) 3
4 Singular Value Decomposition To solve the matrix equation A x = 0, we use the svd function from matlab by calling [U, D, V] = svd(a) The solution x is the last column of the matrix V. 4
5 Projective 3D geometry In Chapter 2, we will study: Points, lines, planes and quadrics Transformations The absolute conic and absolute dual conic 5
6 2D Homogeneous Coordinates of Points 2D homogeneous coordinates extend the projective space from 1D to 2D. In 2D projective space, P 2 : - From 2D world space (x, y) make - 2D homogeneous coordinates (x 1, x 2, x 3 ) T - 2D projective image space (x, y ) T = ( x1 x, x ) T 2 3 x 3 6
7 3D Homogeneous Coordinates of Points 3D homogeneous coordinates extend the projective space from 2D to 3D: In 3D projective space, P 3 : - From 3D world space (x, y, z) make - 3D homogeneous coordinates (x 1, x 2, x 3, x 4 ) T - 3D projective image space (x, y, z ) T = ( x1 x, x 2 4 x, x ) T 3 4 x 4 7
8 Advantages of Homogeneous Coordinates 3D homogeneous coordinates - Unifies points and planes - (but lines are messy) - Puts perspective projection into matrix form - No divide-by-zero, points at infinity are defined. 8
9 Unifies points and planes (but lines are messy) Puts perspective projection into matrix form 3D Homogeneous Coordinates No divide-by-zero, points at infinity defined in R 3, write point x as x y z y (x,y,z) x z But in P 3, write same point x as: where: x = x 1 / x 4, y = x 2 / x 4, z = x 3 / x 4, x 1 x 2 x 3 x 4 x 4 = anything non-zero! (but usually defaults to 1) R 3 P 3 9
10 P 2 homog. coords: 2D projective map (2D point 3D ray is correct) P 3 homog. coords. 3D projective map ( But 3D point 3D ray is WRONG!) A very common mistake (x,y) (x 1, x 2, x 3 ) (x,y,z) (x 1, x 2, x 3, x 4 ) x 2 x 2 x 3 x 1 x 1 P 2 P 3 A Point in P 2 corresponds to a ray in R 3 10
11 Projective Transformations Definition. A projective transformation on P 3 is a linear transformation on homogeneous 4-vectors represented by a non-singular 4 4 matrix H: x 1 x 2 x 3 x 4 = h 11 h 12 h 13 h 14 h 21 h 22 h 23 h 24 h 31 h 32 h 33 h 34 h 41 h 42 h 43 h 44 x 1 x 2 x 3 x 4. 11
12 The matrix equation on the previous page can be written more briefly as x = H x where H is a 4 4 non-singular matrix. The projective transformation H is a collineation, that is, H maps lines on to lines. This matrix H is homogeneous, and has 15 degrees of freedom. 12
13 Plane Point duality The equation of a plane in R 3 is given by π 1 x + π 2 y + π 3 z + π 4 = 0. This above equation is unaffected by multiplication by a non-zero scalar k since k π 1 x + k π 2 y + k π 3 z + k π 4 = 0. Hence a plane Π in homogeneous coordinates can be written as Π = (π 1, π 2, π 3, π 4 ) T. In P 3, a plane has 3 degrees of freedom. 13
14 Homogenizing the equation π 1 x + π 2 y + π 3 z + π 4 = 0 by replacing x x 1 x 4, y x 2 x 4, z x 3 x 4, we obtain π 1 x 1 + π 2 x 2 + π 3 x 3 + π 4 x 4 = 0. In matrix form, this equation can be written as Π T x = 0 or x T Π = 0. These equations say that the point x is on the plane Π or x is incident with the plane Π. 14
15 The Euclidean representation of the plane is given by n x + d = 0 where n = (π 1, π 2, π 3 ) T, x = (x 1, x 2, x 3 ) T, x 4 = 1, π 4 = d In P 3, there is a duality between points and planes. 15
16 Planes from points It is known that the join of three points uniquely defines a plane. To find the plane Π through the three given points x 1, x 2 and x 3 stack the points and find Π by solving the following matrix equation: x T 1 x T 2 x T 3 Π = x 11 x 12 x 13 x 14 x 21 x 22 x 23 x 24 x 31 x 32 x 33 x 34 Π = A Π = 0. 16
17 If x 1, x 2 and x 3 are linearly independent, then the 3 4 matrix A has a rank of 3 and hence Π can be determined uniquely up to scale. If the matrix A has a rank of 2, then the points are collinear, and define a pencil of planes with the line of Lines in P 3 : Awkward collinear points as axis. etrically, Lines are: Pencil of planes rsection of 2 (or more) planes, axis or pencil of planes, ar combo of 2 points, p 1 + A(p 2 -p 1 ) 17
18 Let M = [X, X 1, X 2, X 3 ] be a 4 4 matrix compose of a general point X and three points X 1, X 2, X 3 which define the plane Π. When the point X lies on the plane Π, the determinant of M becomes zero, that is det M = x 1 D 234 x 2 D x 3 D 124 x 4 D 123 = 0, where D jkl is the determinant formed from the jkl rows of the 4 3 matrix [X 1, X 2, X 3 ]. 18
19 Hence the homogeneous coordinates of the plane Π can be read off from det M = x 1 D 234 x 2 D x 3 D 124 x 4 D 123 = 0 and we have Π = (D 234, D 134, D 124, D 123 ) T. This is the solution vector (that is, the null-space) of the equation A Π = 0 we have discussed earlier. 19
20 Planes from points It is well known that three distinct planes intersect in a unique point. To find the point of intersection x between three planes Π 1, Π 2 and Π 3 stack the planes and find x by solving the matrix equation Π T 1 Π T 2 Π T 3 x = π 11 π 12 π 13 π 14 π 21 π 22 π 23 π 24 π 31 π 32 π 33 π 34 x = B x = 0. 20
21 Let N = [Π, Π 1, Π 2, Π 3 ] be a 4 4 matrix compose of a general plane Π and three planes Π 1, Π 2, Π 3 which define the point x. When the plane Π is incident on the point x, the determinant of N becomes zero, that is det N = π 1 d 234 π 2 d π 3 d 124 π 4 d 123 = 0, where d jkl is the determinant formed from the jkl rows of the 4 3 matrix [Π 1, Π 2, Π 3 ]. 21
22 Hence the homogeneous coordinates of the point x can be read off from det N = π 1 d 234 π 2 d π 3 d 124 π 4 d 123 = 0 and we have x = (d 234, d 134, d 124, d 123 ) T. This is the solution vector (that is, the null-space) of the equation B x = 0 we have discussed earlier. 22
23 Projective Transformation of Planes Under the point transformation x = H x a plane Π transforms as Π = H T Π where H T denotes the transpose of inverse of the matrix H. 23
24 Lines in P 3 A line is defined by the join of two points or intersection of two (or more) planes. A line in P 3 has 4 degrees of freedom. (x 1, 0, x 3, 1) T (x 1, x 2, 0, 1) T The point of intersection on each plane is specified by two parameters, producing a total of 4 degrees of freedom for the line. 24
25 Lines are very awkward to represent in P 3 since an object with 4 degrees of freedom would be a homogeneous 5-vector. The problem is that a homogeneous 5-vector cannot easily be used in mathematical expression together with the 4-vectors representing points and planes. To overcome this problem a number of representations for lines in P 3 have been proposed. 25
26 Representation of Lines We examine three representations of lines using Span: Null Space of matrix W Plücker Matrix Plücker Line Coordinates 26
27 Lines: (Point-Point) Span W This representation is build on the geometric notion that a line is a pencil of collinear points, and is defined by any two of these points. Recall that a point x is on a plane Π if and only if x T Π = 0. 27
28 If two given (non-coincident) points A and B in P 3 intersect with a pencil of planes on a line, then A T B T Π = 0. Define a line in P 3 as that intersection. That is, stack A T and B T to make a 2 4 matrix W, W = A T B T = a 1 a 2 a 3 a 4 b 1 b 2 b 3 b 4 28
29 Then the line joining the points A and B is represented by the span of the row space of the 2 4 matrix W. Example 1. The line x-axis is represented by the span of the matrix where (0, 0, 0, 1) T W = denotes the origin and (1, 0, 0, 0) T denotes the point at infinity in the x-direction. The span of W yields a pencil of collinear points. 29
30 3 Lines: (Plane-Plane) Span W This representation is build on the geometric notion that a line is the axis of a pencil of planes, and is defined by the intersection of any two planes from Lines in P 3 : Awkward the pencil. etrically, Lines are: Pencil of planes rsection of 2 (or more) planes, axis or pencil of planes, ar combo of 2 points, p 1 + A(p 2 -p 1 ) 30
31 If two given planes Π 1 and Π 1 in P 3 intersect at a pencil of points on a line, then x T Π 1 Π 2 = 0. Define a line in P 3 as that intersection. That is, stack Π T 1 and ΠT 1 to make a 2 4 matrix W, W = Π T 1 Π T 2 = π 11 π 12 π 13 π 14 π 21 π 22 π 23 π
32 Then the line obtained by the intersection of two planes Π 1 and Π 2 is represented by the span of the row space of the 2 4 matrix W. Example 2. The line x-axis is represented by the span of the matrix W = where (0, 0, 1, 0) T denotes the xy-plane and (0, 1, 0, 0) T denotes the xz-plane. The span of W yields an axis of a pencil of planes. 32
33 Lines: Plücker Matrix The line joining the two points A and B is represented by a 4 4 skew-symmetric homogeneous matrix L given by L = A B T B A T. L has rank 2 L has 4 degrees of freedom L is a generalization of l = x y L is independent of the choice of A and B Transformation: L = H L H T 33
34 Example 3. Let A = (0, 0, 0, 1) T be the origin, and B = (1, 0, 0, 0) T be the point at infinity (or ideal point) in the x-direction. The the line x-axis can be represented using Plücker matrix as L = ( ) ( ) =
35 Lines: Dual Plücker Matrix A dual Plücker matrix representation L is obtained for a line formed by the intersection of two planes Π 1 and Π 2 L = Π 1 Π T 2 Π 2 Π T 1 and has similar properties to L. Under the point transformation x = H x, the matrix L transforms as L = H T L H 1. 35
36 The matrix L can be obtained directly from L by a simple rewrite rule: l 12 : l 13 : l 14 : l 23 : l 42 : l 34 = l 34 : l 42 : l 23 : l 14 : l 13 : l 12 The correspondence rule is very simple: the indices of the dual and original component always include all the numbers {1, 2, 3, 4}, so if the original if ij then the dual is those numbers of {1, 2, 3, 4} which are not ij. For example
37 Example 4. Given Plücker matrix representation of the line x-axis, L, we can easily find L : L = L = Here l 14 = 1 = l 23 and l 41 = 1 = l
38 Plane defined by a line and a point The plane defined by the join of the point x and the line L is given by Π = L x. L x = 0 if and only if x is on the line L. 38
39 Point defined by a line and a plane The point defined by the intersection of the line L with the plane Π is given by x = L Π. L Π = 0 if and only if L is on the plane Π. 39
40 Example 5. The intersection of the x-axis with the plane x = 1 (in R 3 ) is given by x = L Π = = which is the point (1, 0, 0) T in R 3. 40
41 Lines: Plücker Line Coordinates Given the Plücker matrix L for a line, that is L = l 11 l 12 l 13 l 14 l 21 l 22 l 23 l 24 l 31 l 32 l 33 l 34 l 41 l 42 l 43 l 44 the Plücker line coordinates for the line L is a set of elements of the 4 4 skew-symmetric matrix L, namely L = { l 12, l 13, l 14, l 23, l 42, l 34 }. 41
42 L is a homogeneous 6-vector, and therefore is an element of P 5. If det L = 0, then the Plücker coordinates satisfy the equation l 12 l 34 + l 13 l 42 + l 14 l 23 = 0. A 6-vector L only corresponds to a line in P 3 if satisfies the above equation. The geometric interpretation of this constraint is that the lines of P 3 define a surface in P 5 known as the Klein quadric. 42
Multiple View Geometry in Computer Vision
Multiple View Geometry in Computer Vision Prasanna Sahoo Department of Mathematics University of Louisville 1 More on Single View Geometry Lecture 11 2 In Chapter 5 we introduced projection matrix (which
More informationMultiple View Geometry in Computer Vision
Multiple View Geometry in Computer Vision Prasanna Sahoo Department of Mathematics University of Louisville 1 Structure Computation Lecture 18 March 22, 2005 2 3D Reconstruction The goal of 3D reconstruction
More informationCS-9645 Introduction to Computer Vision Techniques Winter 2019
Table of Contents Projective Geometry... 1 Definitions...1 Axioms of Projective Geometry... Ideal Points...3 Geometric Interpretation... 3 Fundamental Transformations of Projective Geometry... 4 The D
More informationComputer Vision Projective Geometry and Calibration. Pinhole cameras
Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole
More informationRobot Vision: Projective Geometry
Robot Vision: Projective Geometry Ass.Prof. Friedrich Fraundorfer SS 2018 1 Learning goals Understand homogeneous coordinates Understand points, line, plane parameters and interpret them geometrically
More informationComputer Vision. 2. Projective Geometry in 3D. Lars Schmidt-Thieme
Computer Vision 2. Projective Geometry in 3D Lars Schmidt-Thieme Information Systems and Machine Learning Lab (ISMLL) Institute for Computer Science University of Hildesheim, Germany 1 / 26 Syllabus Mon.
More informationCSE 252B: Computer Vision II
CSE 5B: Computer Vision II Lecturer: Ben Ochoa Scribes: San Nguyen, Ben Reineman, Arturo Flores LECTURE Guest Lecture.. Brief bio Ben Ochoa received the B.S., M.S., and Ph.D. degrees in electrical engineering
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribe: Sameer Agarwal LECTURE 1 Image Formation 1.1. The geometry of image formation We begin by considering the process of image formation when a
More information3D Computer Vision II. Reminder Projective Geometry, Transformations
3D Computer Vision II Reminder Projective Geometry, Transformations Nassir Navab" based on a course given at UNC by Marc Pollefeys & the book Multiple View Geometry by Hartley & Zisserman" October 21,
More informationAuto-calibration. Computer Vision II CSE 252B
Auto-calibration Computer Vision II CSE 252B 2D Affine Rectification Solve for planar projective transformation that maps line (back) to line at infinity Solve as a Householder matrix Euclidean Projective
More informationEpipolar Geometry and the Essential Matrix
Epipolar Geometry and the Essential Matrix Carlo Tomasi The epipolar geometry of a pair of cameras expresses the fundamental relationship between any two corresponding points in the two image planes, and
More informationSummer School: Mathematical Methods in Robotics
Summer School: Mathematical Methods in Robotics Part IV: Projective Geometry Harald Löwe TU Braunschweig, Institute Computational Mathematics 2009/07/16 Löwe (TU Braunschweig) Math. robotics 2009/07/16
More informationVector Algebra Transformations. Lecture 4
Vector Algebra Transformations Lecture 4 Cornell CS4620 Fall 2008 Lecture 4 2008 Steve Marschner 1 Geometry A part of mathematics concerned with questions of size, shape, and relative positions of figures
More informationProjective geometry for Computer Vision
Department of Computer Science and Engineering IIT Delhi NIT, Rourkela March 27, 2010 Overview Pin-hole camera Why projective geometry? Reconstruction Computer vision geometry: main problems Correspondence
More informationEpipolar Geometry Prof. D. Stricker. With slides from A. Zisserman, S. Lazebnik, Seitz
Epipolar Geometry Prof. D. Stricker With slides from A. Zisserman, S. Lazebnik, Seitz 1 Outline 1. Short introduction: points and lines 2. Two views geometry: Epipolar geometry Relation point/line in two
More informationHomogeneous Coordinates. Lecture18: Camera Models. Representation of Line and Point in 2D. Cross Product. Overall scaling is NOT important.
Homogeneous Coordinates Overall scaling is NOT important. CSED44:Introduction to Computer Vision (207F) Lecture8: Camera Models Bohyung Han CSE, POSTECH bhhan@postech.ac.kr (",, ) ()", ), )) ) 0 It is
More informationProjective 2D Geometry
Projective D Geometry Multi View Geometry (Spring '08) Projective D Geometry Prof. Kyoung Mu Lee SoEECS, Seoul National University Homogeneous representation of lines and points Projective D Geometry Line
More informationAn idea which can be used once is a trick. If it can be used more than once it becomes a method
An idea which can be used once is a trick. If it can be used more than once it becomes a method - George Polya and Gabor Szego University of Texas at Arlington Rigid Body Transformations & Generalized
More informationPart 0. The Background: Projective Geometry, Transformations and Estimation
Part 0 The Background: Projective Geometry, Transformations and Estimation La reproduction interdite (The Forbidden Reproduction), 1937, René Magritte. Courtesy of Museum Boijmans van Beuningen, Rotterdam.
More informationProjective geometry, camera models and calibration
Projective geometry, camera models and calibration Subhashis Banerjee Dept. Computer Science and Engineering IIT Delhi email: suban@cse.iitd.ac.in January 6, 2008 The main problems in computer vision Image
More informationcalibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
More informationC / 35. C18 Computer Vision. David Murray. dwm/courses/4cv.
C18 2015 1 / 35 C18 Computer Vision David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/4cv Michaelmas 2015 C18 2015 2 / 35 Computer Vision: This time... 1. Introduction; imaging geometry;
More informationConic Duality. yyye
Conic Linear Optimization and Appl. MS&E314 Lecture Note #02 1 Conic Duality Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/
More informationElements of Computer Vision: Multiple View Geometry. 1 Introduction. 2 Elements of Geometry. Andrea Fusiello
Elements of Computer Vision: Multiple View Geometry. Andrea Fusiello http://www.sci.univr.it/~fusiello July 11, 2005 c Copyright by Andrea Fusiello. This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike
More informationEM225 Projective Geometry Part 2
EM225 Projective Geometry Part 2 eview In projective geometry, we regard figures as being the same if they can be made to appear the same as in the diagram below. In projective geometry: a projective point
More informationComputer Vision Projective Geometry and Calibration. Pinhole cameras
Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole
More informationHomogeneous coordinates, lines, screws and twists
Homogeneous coordinates, lines, screws and twists In lecture 1 of module 2, a brief mention was made of homogeneous coordinates, lines in R 3, screws and twists to describe the general motion of a rigid
More informationTwo-view geometry Computer Vision Spring 2018, Lecture 10
Two-view geometry http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 10 Course announcements Homework 2 is due on February 23 rd. - Any questions about the homework? - How many of
More informationMath background. 2D Geometric Transformations. Implicit representations. Explicit representations. Read: CS 4620 Lecture 6
Math background 2D Geometric Transformations CS 4620 Lecture 6 Read: Chapter 2: Miscellaneous Math Chapter 5: Linear Algebra Notation for sets, functions, mappings Linear transformations Matrices Matrix-vector
More informationMETR Robotics Tutorial 2 Week 2: Homogeneous Coordinates
METR4202 -- Robotics Tutorial 2 Week 2: Homogeneous Coordinates The objective of this tutorial is to explore homogenous transformations. The MATLAB robotics toolbox developed by Peter Corke might be a
More informationCS231A Course Notes 4: Stereo Systems and Structure from Motion
CS231A Course Notes 4: Stereo Systems and Structure from Motion Kenji Hata and Silvio Savarese 1 Introduction In the previous notes, we covered how adding additional viewpoints of a scene can greatly enhance
More informationVisual Recognition: Image Formation
Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu Reference Most slides are adapted from the following notes: Some lecture notes on geometric
More informationCamera model and multiple view geometry
Chapter Camera model and multiple view geometry Before discussing how D information can be obtained from images it is important to know how images are formed First the camera model is introduced and then
More informationA Short Introduction to Projective Geometry
A Short Introduction to Projective Geometry Vector Spaces over Finite Fields We are interested only in vector spaces of finite dimension. To avoid a notational difficulty that will become apparent later,
More informationPetShop (BYU Students, SIGGRAPH 2006)
Now Playing: PetShop (BYU Students, SIGGRAPH 2006) My Mathematical Mind Spoon From Gimme Fiction Released May 10, 2005 Geometric Objects in Computer Graphics Rick Skarbez, Instructor COMP 575 August 30,
More informationComputer Vision I - Appearance-based Matching and Projective Geometry
Computer Vision I - Appearance-based Matching and Projective Geometry Carsten Rother 05/11/2015 Computer Vision I: Image Formation Process Roadmap for next four lectures Computer Vision I: Image Formation
More informationCOMP 558 lecture 19 Nov. 17, 2010
COMP 558 lecture 9 Nov. 7, 2 Camera calibration To estimate the geometry of 3D scenes, it helps to know the camera parameters, both external and internal. The problem of finding all these parameters is
More informationCIS 580, Machine Perception, Spring 2014: Assignment 4 Due: Wednesday, April 10th, 10:30am (use turnin)
CIS 580, Machine Perception, Spring 2014: Assignment 4 Due: Wednesday, April 10th, 10:30am (use turnin) Solutions (hand calculations, plots) have to be submitted electronically as a single pdf file using
More informationCamera Model and Calibration
Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the
More informationIndex. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 263
Index 3D reconstruction, 125 5+1-point algorithm, 284 5-point algorithm, 270 7-point algorithm, 265 8-point algorithm, 263 affine point, 45 affine transformation, 57 affine transformation group, 57 affine
More informationCamera models and calibration
Camera models and calibration Read tutorial chapter 2 and 3. http://www.cs.unc.edu/~marc/tutorial/ Szeliski s book pp.29-73 Schedule (tentative) 2 # date topic Sep.8 Introduction and geometry 2 Sep.25
More informationIndex. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 253
Index 3D reconstruction, 123 5+1-point algorithm, 274 5-point algorithm, 260 7-point algorithm, 255 8-point algorithm, 253 affine point, 43 affine transformation, 55 affine transformation group, 55 affine
More informationAlternative interpretation of the Plücker quadric s ambient space and its application
Alternative interpretation of the Plücker quadric s ambient space and its application Georg Nawratil Institute of Discrete Mathematics and Geometry Funded by FWF Project Grant No. P24927-N25 18th ICGG,
More informationLecture 3: Camera Calibration, DLT, SVD
Computer Vision Lecture 3 23--28 Lecture 3: Camera Calibration, DL, SVD he Inner Parameters In this section we will introduce the inner parameters of the cameras Recall from the camera equations λx = P
More informationAH Matrices.notebook November 28, 2016
Matrices Numbers are put into arrays to help with multiplication, division etc. A Matrix (matrices pl.) is a rectangular array of numbers arranged in rows and columns. Matrices If there are m rows and
More informationComputer Vision Projective Geometry and Calibration
Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole
More informationCS 664 Slides #9 Multi-Camera Geometry. Prof. Dan Huttenlocher Fall 2003
CS 664 Slides #9 Multi-Camera Geometry Prof. Dan Huttenlocher Fall 2003 Pinhole Camera Geometric model of camera projection Image plane I, which rays intersect Camera center C, through which all rays pass
More informationN-Views (1) Homographies and Projection
CS 4495 Computer Vision N-Views (1) Homographies and Projection Aaron Bobick School of Interactive Computing Administrivia PS 2: Get SDD and Normalized Correlation working for a given windows size say
More informationInvariance of l and the Conic Dual to Circular Points C
Invariance of l and the Conic Dual to Circular Points C [ ] A t l = (0, 0, 1) is preserved under H = v iff H is an affinity: w [ ] l H l H A l l v 0 [ t 0 v! = = w w] 0 0 v = 0 1 1 C = diag(1, 1, 0) is
More informationTechnische Universität München Zentrum Mathematik
Technische Universität München Zentrum Mathematik Prof. Dr. Dr. Jürgen Richter-Gebert, Bernhard Werner Projective Geometry SS 208 https://www-m0.ma.tum.de/bin/view/lehre/ss8/pgss8/webhome Solutions for
More information3D Reconstruction with two Calibrated Cameras
3D Reconstruction with two Calibrated Cameras Carlo Tomasi The standard reference frame for a camera C is a right-handed Cartesian frame with its origin at the center of projection of C, its positive Z
More informationJorg s Graphics Lecture Notes Coordinate Spaces 1
Jorg s Graphics Lecture Notes Coordinate Spaces Coordinate Spaces Computer Graphics: Objects are rendered in the Euclidean Plane. However, the computational space is better viewed as one of Affine Space
More informationCamera Models and Image Formation. Srikumar Ramalingam School of Computing University of Utah
Camera Models and Image Formation Srikumar Ramalingam School of Computing University of Utah srikumar@cs.utah.edu VisualFunHouse.com 3D Street Art Image courtesy: Julian Beaver (VisualFunHouse.com) 3D
More informationFundamental Matrix & Structure from Motion
Fundamental Matrix & Structure from Motion Instructor - Simon Lucey 16-423 - Designing Computer Vision Apps Today Transformations between images Structure from Motion The Essential Matrix The Fundamental
More information55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence
More informationLecture 9: Epipolar Geometry
Lecture 9: Epipolar Geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Why is stereo useful? Epipolar constraints Essential and fundamental matrix Estimating F (Problem Set 2
More informationInterlude: Solving systems of Equations
Interlude: Solving systems of Equations Solving Ax = b What happens to x under Ax? The singular value decomposition Rotation matrices Singular matrices Condition number Null space Solving Ax = 0 under
More informationLinear Multi View Reconstruction and Camera Recovery Using a Reference Plane
International Journal of Computer Vision 49(2/3), 117 141, 2002 c 2002 Kluwer Academic Publishers. Manufactured in The Netherlands. Linear Multi View Reconstruction and Camera Recovery Using a Reference
More informationShort on camera geometry and camera calibration
Short on camera geometry and camera calibration Maria Magnusson, maria.magnusson@liu.se Computer Vision Laboratory, Department of Electrical Engineering, Linköping University, Sweden Report No: LiTH-ISY-R-3070
More informationColumn and row space of a matrix
Column and row space of a matrix Recall that we can consider matrices as concatenation of rows or columns. c c 2 c 3 A = r r 2 r 3 a a 2 a 3 a 2 a 22 a 23 a 3 a 32 a 33 The space spanned by columns of
More informationAlgebraic Geometry of Segmentation and Tracking
Ma191b Winter 2017 Geometry of Neuroscience Geometry of lines in 3-space and Segmentation and Tracking This lecture is based on the papers: Reference: Marco Pellegrini, Ray shooting and lines in space.
More informationStructure from motion
Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera
More informationMetric Rectification for Perspective Images of Planes
789139-3 University of California Santa Barbara Department of Electrical and Computer Engineering CS290I Multiple View Geometry in Computer Vision and Computer Graphics Spring 2006 Metric Rectification
More informationIntroduction to Homogeneous coordinates
Last class we considered smooth translations and rotations of the camera coordinate system and the resulting motions of points in the image projection plane. These two transformations were expressed mathematically
More informationAdvanced Computer Graphics Transformations. Matthias Teschner
Advanced Computer Graphics Transformations Matthias Teschner Motivation Transformations are used To convert between arbitrary spaces, e.g. world space and other spaces, such as object space, camera space
More information1.5 Equations of Lines and Planes in 3-D
1.5. EQUATIONS OF LINES AND PLANES IN 3-D 55 Figure 1.16: Line through P 0 parallel to v 1.5 Equations of Lines and Planes in 3-D Recall that given a point P = (a, b, c), one can draw a vector from the
More informationStereo Vision. MAN-522 Computer Vision
Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in
More informationThe real voyage of discovery consists not in seeking new landscapes, but in having new eyes.
The real voyage of discovery consists not in seeking new landscapes, but in having new eyes. - Marcel Proust University of Texas at Arlington Camera Calibration (or Resectioning) CSE 4392-5369 Vision-based
More informationRecovering structure from a single view Pinhole perspective projection
EPIPOLAR GEOMETRY The slides are from several sources through James Hays (Brown); Silvio Savarese (U. of Michigan); Svetlana Lazebnik (U. Illinois); Bill Freeman and Antonio Torralba (MIT), including their
More informationHomogeneous Coordinates and Transformations of the Plane
2 Homogeneous Coordinates and Transformations of the Plane 2. Introduction In Chapter planar objects were manipulated by applying one or more transformations. Section.7 identified the problem that the
More informationCHAPTER 5 SYSTEMS OF EQUATIONS. x y
page 1 of Section 5.1 CHAPTER 5 SYSTEMS OF EQUATIONS SECTION 5.1 GAUSSIAN ELIMINATION matrix form of a system of equations The system 2x + 3y + 4z 1 5x + y + 7z 2 can be written as Ax where b 2 3 4 A [
More informationRay-Triangle and Ray-Quadrilateral Intersections in Homogeneous Coordinates
Ray-Triangle and Ray-Quadrilateral Intersections in Homogeneous Coordinates Pat Hanrahan Geometry Computing Group Minnesota Supercomputer Center Minneapolis, MN 55415 hanrahan@princeton.edu Experience
More informationSpecifying Complex Scenes
Transformations Specifying Complex Scenes (x,y,z) (r x,r y,r z ) 2 (,,) Specifying Complex Scenes Absolute position is not very natural Need a way to describe relative relationship: The lego is on top
More information3D Transformations. CS 4620 Lecture 10. Cornell CS4620 Fall 2014 Lecture Steve Marschner (with previous instructors James/Bala)
3D Transformations CS 4620 Lecture 10 1 Translation 2 Scaling 3 Rotation about z axis 4 Rotation about x axis 5 Rotation about y axis 6 Properties of Matrices Translations: linear part is the identity
More informationMAT 3271: Selected Solutions to the Assignment 6
Chapter 2: Major Exercises MAT 3271: Selected Solutions to the Assignment 6 1. Since a projective plan is a model of incidence geometry, Incidence Axioms 1-3 and Propositions 2.1-2.5 (which follow logically
More informationGeometric Transformations
Geometric Transformations CS 4620 Lecture 9 2017 Steve Marschner 1 A little quick math background Notation for sets, functions, mappings Linear and affine transformations Matrices Matrix-vector multiplication
More informationWhat You ll See in This Chapter. Word Cloud. Definitions. Matrix Components. Ian Parberry University of North Texas. Fletcher Dunn
What You ll See in This Chapter Chapter 4: Introduction to Matrices Fletcher Dunn Valve Software Ian Parberry University of North Texas 3D Math Primer for Graphics and Game Development This chapter introduces
More informationToday. Today. Introduction. Matrices. Matrices. Computergrafik. Transformations & matrices Introduction Matrices
Computergrafik Matthias Zwicker Universität Bern Herbst 2008 Today Transformations & matrices Introduction Matrices Homogeneous Affine transformations Concatenating transformations Change of Common coordinate
More informationCamera Model and Calibration. Lecture-12
Camera Model and Calibration Lecture-12 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the
More informationCremona transformations
Synopsis for Tuesday, November 1 Cremona transformations Let N be a net with base-points. It gives a generically one-to-one map of P 2 into N blowing up the base-points and blowing-down the lines joining
More informationInstance-level recognition I. - Camera geometry and image alignment
Reconnaissance d objets et vision artificielle 2011 Instance-level recognition I. - Camera geometry and image alignment Josef Sivic http://www.di.ens.fr/~josef INRIA, WILLOW, ENS/INRIA/CNRS UMR 8548 Laboratoire
More information(Refer Slide Time: 00:04:20)
Computer Graphics Prof. Sukhendu Das Dept. of Computer Science and Engineering Indian Institute of Technology, Madras Lecture 8 Three Dimensional Graphics Welcome back all of you to the lectures in Computer
More information3D Transformations. CS 4620 Lecture Kavita Bala w/ prior instructor Steve Marschner. Cornell CS4620 Fall 2015 Lecture 11
3D Transformations CS 4620 Lecture 11 1 Announcements A2 due tomorrow Demos on Monday Please sign up for a slot Post on piazza 2 Translation 3 Scaling 4 Rotation about z axis 5 Rotation about x axis 6
More informationMULTIPLE VIEW GEOMETRY
Chapter 3 MULTIPLE VIEW GEOMETRY Anders Heyden and Marc Pollefeys 3.1 Introduction There exist intricate geometric relations between multiple views of a 3D scene. These relations are related to the camera
More informationTechnische Universität München Zentrum Mathematik
Question 1. Incidence matrix with gaps Technische Universität München Zentrum Mathematik Prof. Dr. Dr. Jürgen Richter-Gebert, Bernhard Werner Projective Geometry SS 2016 www-m10.ma.tum.de/projektivegeometriess16
More informationCamera calibration. Robotic vision. Ville Kyrki
Camera calibration Robotic vision 19.1.2017 Where are we? Images, imaging Image enhancement Feature extraction and matching Image-based tracking Camera models and calibration Pose estimation Motion analysis
More informationGeometric transformations in 3D and coordinate frames. Computer Graphics CSE 167 Lecture 3
Geometric transformations in 3D and coordinate frames Computer Graphics CSE 167 Lecture 3 CSE 167: Computer Graphics 3D points as vectors Geometric transformations in 3D Coordinate frames CSE 167, Winter
More informationMAPI Computer Vision. Multiple View Geometry
MAPI Computer Vision Multiple View Geometry Geometry o Multiple Views 2- and 3- view geometry p p Kpˆ [ K R t]p Geometry o Multiple Views 2- and 3- view geometry Epipolar Geometry The epipolar geometry
More informationStructure and Motion for Dynamic Scenes - The Case of Points Moving in Planes
Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes Peter Sturm To cite this version: Peter Sturm. Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes.
More informationGeometric transformations assign a point to a point, so it is a point valued function of points. Geometric transformation may destroy the equation
Geometric transformations assign a point to a point, so it is a point valued function of points. Geometric transformation may destroy the equation and the type of an object. Even simple scaling turns a
More informationA Summary of Projective Geometry
A Summary of Projective Geometry Copyright 22 Acuity Technologies Inc. In the last years a unified approach to creating D models from multiple images has been developed by Beardsley[],Hartley[4,5,9],Torr[,6]
More information1 Projective Geometry
CIS8, Machine Perception Review Problem - SPRING 26 Instructions. All coordinate systems are right handed. Projective Geometry Figure : Facade rectification. I took an image of a rectangular object, and
More informationVision Review: Image Formation. Course web page:
Vision Review: Image Formation Course web page: www.cis.udel.edu/~cer/arv September 10, 2002 Announcements Lecture on Thursday will be about Matlab; next Tuesday will be Image Processing The dates some
More informationRigid Body Motion and Image Formation. Jana Kosecka, CS 482
Rigid Body Motion and Image Formation Jana Kosecka, CS 482 A free vector is defined by a pair of points : Coordinates of the vector : 1 3D Rotation of Points Euler angles Rotation Matrices in 3D 3 by 3
More informationMachine vision. Summary # 11: Stereo vision and epipolar geometry. u l = λx. v l = λy
1 Machine vision Summary # 11: Stereo vision and epipolar geometry STEREO VISION The goal of stereo vision is to use two cameras to capture 3D scenes. There are two important problems in stereo vision:
More information1 Affine and Projective Coordinate Notation
CS348a: Computer Graphics Handout #9 Geometric Modeling Original Handout #9 Stanford University Tuesday, 3 November 992 Original Lecture #2: 6 October 992 Topics: Coordinates and Transformations Scribe:
More information2D/3D Geometric Transformations and Scene Graphs
2D/3D Geometric Transformations and Scene Graphs Week 4 Acknowledgement: The course slides are adapted from the slides prepared by Steve Marschner of Cornell University 1 A little quick math background
More informationExponential Maps for Computer Vision
Exponential Maps for Computer Vision Nick Birnie School of Informatics University of Edinburgh 1 Introduction In computer vision, the exponential map is the natural generalisation of the ordinary exponential
More informationComputer Vision I - Algorithms and Applications: Multi-View 3D reconstruction
Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Carsten Rother 09/12/2013 Computer Vision I: Multi-View 3D reconstruction Roadmap this lecture Computer Vision I: Multi-View
More information