Geometry of Single Axis Motions Using Conic Fitting

Size: px
Start display at page:

Download "Geometry of Single Axis Motions Using Conic Fitting"

Transcription

1 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER Geometry of Single Axis Motions Using Conic Fitting Guang Jiang, Hung-tat Tsui, Member, IEEE, Long Quan, Senior Member, IEEE, and Andrew Zisserman Abstract Previous algorithms for recovering 3D geometry from an uncalibrated image sequence of a single axis motion of unknown rotation angles are mainly based on the computation of two-view fundamental matrices and three-view trifocal tensors. In this paper, we propose three new methods that are based on fitting a conic locus to corresponding image points over multiple views. The main advantage is that determining only five parameters of a conic from one corresponding point over at least five views is simpler and more robust than determining a fundamental matrix from two views or a trifocal tensor from three views. It is shown that the geometry of single axis motion can be recovered either by computing one conic locus and one fundamental matrix or by computing at least two conic loci. A maximum likelihood solution based on this parametrization of the single axis motion is also described for optimal estimation using three or more loci. The experiments on real image sequences demonstrate the simplicity, accuracy, and robustness of the new methods. Index Terms Turntable, structure from motion, single axis motion, geometry, conic, fundamental matrix. INTRODUCTION æ ESTIMATING 3D models of objects from image sequences of single axis motion, particularly turntable sequences, has been widely studied by computer vision and graphics researchers. Generally, the whole reconstruction procedure includes the determination of camera positions at different viewpoints, the detection of object boundaries, and the extraction of surface models from the volume representation. The estimation of the camera positions or simply the rotation angles relative to a still camera is the most important and difficult part of the modeling process. Traditionally, rotation angles are obtained by careful calibration [3], [8], [9]. Fitzgibbon et al. [5] extended the single axis approach to recover unknown rotation angles from uncalibrated image sequence based on a projective geometry approach. It has been shown that 3D metric reconstruction up to a two-parameter family can be obtained from uncalibrated sequence with unknown rotation angles. However, fundamental matrices and/or trifocal tensors have to be computed for each pair of images or each triplet of images. Mendonça et al. [], Wong et al. [2] recovered the rotation angles from profiles of surfaces with a calibrated camera. The search for corresponding points is transformed into a search for epipolar tangencies. In the new algorithms, we try to improve the accuracy by avoiding the computation of twoview fundamental matrices, three-view trifocal tensors, and epipolar tangencies. Instead, we fit the corresponding points in the whole sequence to its conic locus. It is then shown that all single axis geometry can be directly computed either from one conic and one fundamental matrix or from at least two conics. The rotation angles. G. Jiang and H.-t. Tsui are with the Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, New Territories, Hong Kong. {gjiang, httsui}@ee.cuhk.edu.hk.. L. Quan is with the Department of Computer Science, Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong. quan@cs.ust.hk.. A. Zisserman is with the Department of Engineering Science, University of Oxford, Parks Road, Oxford OX 3PJ, UK. az@robots.ox.ac.uk. Manuscript received 9 Oct. 22; revised 3 May 23; accepted 25 May 23. Recommended for acceptance by Z. Zhang. For information on obtaining reprints of this article, please send to: tpami@computer.org, and reference IEEECS Log Number can then be calculated directly. The advantage of these new methods over the existing ones is significant. First, it is intrinsically a multiple view approach as all geometric information from the whole sequence is nicely summarized in the conics. This contrasts with the computation of fundamental matrices and trifocal tensors that use only a subsequence of two and three views, respectively. Second, as will be shown in Section 7, the essential single axis geometry may be specified by six parameters and this may be estimated from one conic and one fundamental matrix (a total of 2 parameters) or may be estimated from two conics (a total of parameters). Previous methods have involved estimating more than this number of parameters. For example, 8 tensor parameters from each triplet of images are required. Partial results of our techniques have been published in conferences [7], [8]. The paper is organized as follows: Section 2 gives a review of single axis motion and its associated fixed image entities. Section 3 presents an algorithm for estimating the geometry from one conic and one fundamental matrix. Section 4 presents an algorithm for estimating the geometry from two conics and the proof of unique solution from at least three conics is given in Section 5. An important practical issue of recovering rotation angles with missing points are described in Section 6. A Maximum Likelihood Estimation method for calculating these fixed image entities is given in Section 7. Section 8 describes the 3D reconstruction based on single axis motion. Experimental results are presented in Section 9 and, finally, a short conclusion is given in Section. 2 REVIEW OF SINGLE AXIS MOTION AND ITS ASSOCIATED FIXED IMAGE ENTITIES A typical set up for single axis motion consists of a stationary CCD camera pointing at an object to be modeled on a turntable [3]. The internal parameters of the camera are unknown but assumed fixed. The situation is equivalent to that of a fixed object with a camera rotating around it. It is a special case of the more general planar motion [], [4] as it restricts all motions to be generated from rotation around a single axis. Without loss of generality, following [5], the rotation axis of the turntable is chosen to be the z-axis of the world coordinates. Each point on the object is moving in a plane that is perpendicular to the z-axis and all these planes for different points form a pencil of horizontal parallel planes. These planes intersect at a line at infinity in 3D, which is imaged as the vanishing line of the planes and denoted as l. The line l is fixed in all the images. Since the image of the absolute conic! is fixed under rigid motion, the two intersections of the image of the absolute conic! with the line l, remain fixed in all images. Actually, these two fixed points are the images of the two circular points on the horizontal planes. The fixed image entities of a single axis motion are summarized as follows:. The line l s which is the image of the rotation axis. Note that l s is a line of fixed points for all images. 2. The line l which is the image of the vanishing line of all the horizontal planes. Unlike the image of rotation axis, l is a fixed line, but not a line of fixed points. 3. The images of these two circular points i and j, which are the intersection of the image of the absolute conic! with the image of the vanishing line l. 3 METHOD : SINGLE AXIS MOTION FROM ONE CONIC AND ONE FUNDAMENTAL MATRIX One of the key observations in this paper is that the trajectory of the corresponding points in different images of any given space point, visualized in any image plane, gives a conic locus by the very definition of single axis motion (Fig. ). This has been observed by Sawhney et al. [6], whose approach was developed within the traditional calibrated setting. Their primary goal was to recover the ego-motion parameters of the moving point in space with its conic /3/$7. ß 23 IEEE Published by the IEEE Computer Society

2 344 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER 23 Fig.. Dinosaur sequence and conics. trajectory, but not to recover the camera motion or camera geometry. The intrinsic invariants for uncalibrated camera geometry have been developed more recently in [5]. Our new development is dependent, to a large extent, on the geometry of these invariants. As long as a point can be tracked over at least five images, a conic C can be fitted [4]. Useful geometric information is then extracted from the fitted conic. Our first method consists of an algorithm using one fitted conic and one fundamental matrix [2], [23]. The algorithm is dependent on the fixed image entities described in Section 2 and can be summarized as follows:. Fit a conic C to all tracked image points corresponding to an object point in an image sequence. Only one point is tracked over at least five images as we need only one conic at this stage. 2. Compute only one fundamental matrix F from any two views. Select two views at a large angle in the sequence while sharing enough corresponding points. 3. Compute the matrix F þ F T. In the case of single axis motion, this matrix will be a degenerate conic consisting two lines. One is the image of rotation axis l s and the other is the image of the vanishing line l [7], [5]. 4. Obtain the pole of the conic C with respect the line l : o ¼ C l : 5. Compute i and j as the intersections of the conic C with the line l. 6. Compute the angular motion between two views from the tracked points a and a on the conic using the Laguerre s formula [7]: ¼ 2i logðfl oa; l oa ; l oi ; l oj gþ. The computation of invariants using the fundamental matrix is the same as in Fitzgibbon et al. [5]. In their approach, the three-view trifocal tensor has to be computed to obtain the rotation angles between the three. In our method, one conic is used to replace the information contained in the trifocal tensors for all triplet of images. Further, the estimation of trifocal tensors is known to be difficult, while conic fitting is an accurate and robust procedure. 4 METHOD 2: SINGLE AXIS MOTION FROM TWO CONICS It is easy to prove the fact that the trajectory of a given object point in space from a single axis motion is always a circle and different points give circles of different radii on different horizontal planes. All circles go through their respective circular points of the plane they are lying on by the very definition of the circular points [7]. All these supporting planes are parallel and they intersect at a common line at infinity on which the circular points lie. We may thus conclude that all circles of different radii on different parallel planes from the single axis motion share the common pair of circular points. Because this is a projective property, it remains true for the projection onto any image plane. In any particular image plane, this means that all conic loci of corresponding points meet in the pair of common points i and j. Thus, by just computing the intersection points of at least two conic loci, we can obtain the images of the circular points and the image of the vanishing line of the parallel planes. Consider the intersection of a pair of conics. There are always four intersection points, including complex and infinite points according to Bezout s theorem. In terms of real intersection points, they may be, 2, or 4 according to the configurations.. For the case of two real intersection points, it is straightforward that the only pair of complex conjugate points is the images of the circular points.. For the case of four real intersection points, it is generally impossible if the conics are a real perspective image of the circles from the single axis motion. There must be at least one pair of complex conjugate circular points if the geometry is correct.. The case of no real intersection point is a common case as illustrated by the two conic loci in Fig. 3. In this case, we obtain two pairs of complex conjugate points. There is a reconstruction ambiguity coming from the ambiguity of the two pairs of complex conjugate points. An investigation of this will be made in Section 5. For the other cases, once we have obtained the images of the pair of circular points as described above, the determination of the image of the vanishing line is given by: l ¼ i j. The trajectory of any given object point in space from the single axis motion is a circle with its center lying on the rotation axis. Under projective geometry and within the uncalibrated framework, the pole of the conic locus with respect to the image of the vanishing line will lie on the image of the rotation axis. The poles of the conics C p and C q with respect to the image of the vanishing line l are simply given by o p ¼ C p l and o q ¼ C q l, respectively. The image of the rotation axis is just the image line going through these poles, i.e., l s ¼ o p o q. Up to this point, we have computed all invariant entities resulting from a single axis motion purely from two conic loci without using any multiple-view geometry constraints such as fundamental matrices and trifocal tensors as in the previous approaches [5]. To recover the rotation angles, we could use the Laguerre s formula as in the previous section. The whole geometry of the single axis motion is then obtained from at least two conics if there is only one pair of complex conjugate points. 5 UNIQUE SOLUTION FROM AT LEAST THREE CONICS As it was shown in the previous section that, using at least two conics may still lead to multiple solutions, if the two conics have no real intersection point. It is natural to introduce a third conic to remove this ambiguity. If we have three fitted conics, there are two possible situations. In one situation, there is one pair of common conjugate points in the intersections of three pairs of conics. In this case, these conjugate points are the images of the circular points. In the other possible situation, there are two common pairs of conjugate points in the intersections of three pairs of conics. If the three conics have two common pairs of complex conjugate intersection points, the solution is not unique for the selection of the image of the circular points. The uniqueness of the solution could not be established. If the three conics have four common points, they

3 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER Fig. 2. Invariants deduced from one fundamental matrix and one conic. form a pencil of conics. However, all these conics from a circular motion are related by a special type of projective transformations called homologies, they do not form a pencil. Generally, a unique solution could be expected with at least three conics if these conics are not forming a critical configuration of pencil of conics with common complex conjugate points. What is the exact necessary condition leading to this critical configuration is still unknown to us. Fig. 4. Recovering rotation angles with missing points. In this matrix, the only unknown is the radius r. The image coordinates of the pole of the conic C i with respect to the line l is o ¼ H i ð; ; Þ T ¼ðrh 3 ;rh 23 ;rh 33 Þ T, or in inhomogeneous coordinates o ¼ðh 3 =h 33 ;h 23 =h 33 Þ T. The rotation angle 23 between the view m 2 and m 3 can be obtained as 23 ¼ 2i logðfl o b 2 ; l ob 3 ; l oi; l ojgþ. 6 RECOVERING ROTATION ANGLES WITH MISSING POINTS As mentioned in Section, the key component of the single axis motion is the one-dimensional rotation angles. In practice, some points are often missing in some views along a conic locus. The rotation angles for these views cannot be recovered directly from the fitted conics. In this section, we will discuss how these rotation angles could be recovered when some points cannot be tracked in some views. Fig. 4 illustrates this configuration to help the following development. The conic C corresponding to a circle in the space plane has been obtained from tracking a point over five or more images. The point a is visible in views m and m 2 as a and a 2, but missing in view m 3. So, the point a 3 is not available. However, a point b is available in all three views m, m 2, and m 3 as b, b 2, and b 3. Let us assume its unknown conic locus is the conic C i corresponding to a circle on the space plane i. As we know, the two planes and i are parallel in space, and C and C i will both intersect the image of the vanishing line l at the images of the circular points i and j in the image plane. The rotation angle between the view m and m 2 is known from the conic C. The same rotation angle also fits for the point b on the plane i : 2 ¼ 2i logðfl o b ; l ob 2 ; l oi; l ojgþ. Without loss of generality, let the coordinates of point b in space plane i be ðr; ; Þ T. Then, the coordinates of point b 2 are ðr cosð 2 Þ;rsinð 2 Þ; Þ T. The coordinates of the images of the circular points i and j in this space plane are ð;i;þ T and ð; i; Þ T, respectively. Since there are four pairs of corresponding points between the space plane i and the image plane, the projection matrix H i which maps points in space plane to points in image plane can be obtained. 7 METHOD 3: MAXIMUM LIKELIHOOD ESTIMATION WITH PARAMETRIZATION It has been shown in Section 5 that usually more than two conics have to be tracked along the image sequence to have a unique solution. In this section, a Maximum Likelihood Estimation (MLE) method is given for simultaneous estimation of the fixed geometric entities and n conics, where n 3. As mentioned earlier, each point on the object is moving along a circle on a horizontal plane. For each such plane, there is a plane homography H mapping the conic from the image plane to the circle on the supporting horizontal plane, C cirle ¼ H > C conic H. Without loss of generality, assume the radius of the circle to be unity and its center be at the origin of the plane coordinate frame. The homography can be decomposed into a concatenation of five matrices R, S, T, A, and P u, representing rotation, isotropic scaling, translation, affine, and pure projective transformations, respectively, [9], []: H ¼ RSTAP u. P u A l l 2 l 3 can be determined by the image of the vanishing line l ¼ðl ;l 2 ;l 3 Þ >. = = A A; where ð i; ; Þ T is the pair of the circular points in the affine plane which can be obtained by P u through the points i and j. The Fig. 3. The intersections of two conics.

4 346 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER 23 TABLE Fixed Image Entities Computed from Three Different Methods Fig. 5. Recovered rotation angles for the whole sequence of 36 views. The dotted line with the circle mark is calculated from one fundamental matrix and one conic, the dash dot line with diamond mark is calculated from two conics, and the solid line with the square mark is calculated from MLE. images of the circular points count for 4 degrees of freedom: two for determining the pure projective matrix and two for determining the affine matrix. As shown in Fig. 2, the other fixed image entity is the image of the rotation axis l s, which has 2 degrees of freedom. t T t 2 A; where ðt ;t 2 ; Þ > is the pole of the line l with respect to the conic C n on the metric plane. Since the pole is constrained by the rotation axis l s, only degree of freedom exists in the translation matrix. After having applied the transformations by the matrices of P u, A, and T, the conic is back-projected into a circle with center at the original point. The isotropic scaling matrix s S s A scales the circle to a circle with radius unity. So, another degree of freedom is counted for each conic. Since the rotation matrix leaves the circle centered at the origin invariant, no free degree of freedom for the matrix R. In summary, there are in total 6 degrees of freedom for the fixed entities (4 for the images of the two circular point, 2 for l s ) and 2 for each conic (which correspond to where the center is along the rotation axis and its radius of the corresponding circle). The cost function for the MLE involves minimizing the sum of squared geometric distances (one for each of the m measured points) over all 6 þ 2n parameters for the fixed entities and P m d?ðx; CÞ 2. n conics: C¼ P n This is a classical conic fitting problem whose cost function might be highly nonlinear. One way to tackle this is to take a first order approximation as suggested in [2], [5], [6]. Let d? ðx; CÞ 2 ðx T CxÞ 2 ¼ 4ððCxÞ 2 þðcxþ2 2 Þ ; where ðcxþ i denotes the ith component of the 3-vector Cx. This cost function is minimized using the standard Levenberg- Marquart algorithm. The 6 þ 2n parameters are initialized as follows: First, each conic is fitted to corresponding points from at least five views [2], [5]. Then, the pole of each conic with respect to the image of the vanishing line is calculated and the point on the image of the rotation axis that is nearest to the pole is used to estimate the initial value of t ( degree of freedom). Now, each conic can be transformed into a circle. The radius of this circle determines the initial value of s ( degree of freedom). Finally, each conic is mapped to a unit circle centered at the origin and the points on the conic is mapped to the points near to the optimal unit circle. 8 3DRECONSTRUCTION AND METRIC AMBIGUITY Fitzgibbon et al. [5] have shown that the metric reconstruction can be obtained up to a two parameter family. This means that metric structures in all planes perpendicular to the rotation axis can be perfectly determined, the reconstruction along the rotation axis is only up to a D projective transformation. Let P be the projection matrix of the first view with the rotation axis as the z-axis of the world coordinates. Then, the projective Fig. 6. Two views of the 3D reconstructed dinosaur model from the single axis motion computed by the methods discussed in this paper.

5 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER Fig. 7. (a) Three images captured from the video. (b) The video is a woman in a rotating chair. (c) A vertical line in the background is marked out for searching the vanishing point along the rotation axis. Fig. 8. Recovered rotation angles of 46 images selected from the video sequence. matrix of any view PðÞ is related to P by a rotation ðþ about the z-axis. In other word, PðÞ ¼PR 4 ðþ, where cos sin sin cos R 4 ðþ ¼B A : These projection matrices can be used for 3D reconstruction by Shape-from-Silhouettes methods [3], [3]. The projection matrix P can be parameterized by two fitted conics [7], where p p 2 h ðr k 3 þ r 2 k 32 Þ r k 4 P p 2 p 22 h ðr k 23 þ r 2 k 232 Þ r k 24 A: p 3 p 32 h ðr k 33 þ r 2 k 332 Þ r k 34 Parameters r, r 2, and h are the only unknown left in the matrix. These two conics are mapped from two circles on two different horizontal planes. r and r 2 are radii of these two circles and h is the distance between centers of the circles. Since we are interested only in a similarity reconstruction, there are two unknown parameters remain. As mentioned by Fitzgibbon et al. [5] and other researchers [2], [22], the two-parameter ambiguity may be further removed by specifying the camera aspect ratio and parallel scene lines. Fig. 7 shows three images of the sequence. Vertical lines in the background with the rotation axis (Fig. 7c) are used to locate the vanishing point v along the rotation axis. We also assume the camera aspect ratio is one [5], [7]. Fig. 8 shows the recovered angles and Fig. 9 the final reconstruction. Another example of the rotating chair sequence is a man s head. Fig. shows three images captured from the video. The reconstructed man s head is shown in Fig.. CONCLUSION We have presented three new methods of determining the geometry of single axis motions. The main idea is to use the fitted conic locus of corresponding points to estimate the motions. This makes the proposed methods more concise, robust, and accurate than the traditional ones which are basing on the estimation of 2-view fundamental matrix and 3-view trifocal tensor. The first method is based on the fitting of one conic and the estimation of one fundamental matrix. The second method is based on the fitting of at least two conics. The third one is a global MLE estimation from at least three conics using a minimal parametrization of the single axis motion. The key advantage of the new methods is that they are intrinsically multiple view approaches as either one, two, or three 9 EXPERIMENTAL RESULTS Dinosaur sequence from a turntable. We first tested our methods on the popular dinosaur sequence from University of Hannover. The sequence contains 36 views from a turntable with a constant angular motion of degrees. The angular accuracy is about.5 degrees [3]. Table lists the recovered invariant quantities computed from one conic and one fundamental matrix (denoted as F þ C), two conics (denoted as 2C), and more than two conics with MLE (denoted as nc), respectively. Fig. 5 displays the recovered rotation angles based on these invariant quantities. With a reasonable choice of these two unknown parameters in projection matrix, the reconstruction results are shown in Fig. 6. Sequences from a rotating chair. We captured a couple of video sequences of a student sitting on a normal rotating chair. The chair is rotated manually. Several marked points are used for tracking the conics. One example is a woman sitting in the chair. Fig. 9. Two views of the 3D reconstructed woman computed by the methods discussed in this paper.

6 348 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO., OCTOBER 23 Fig.. Three images captured from video. The video is a man in a rotating chair. Fig.. Four views of the 3D reconstructed man s head computed by the methods discussed in this paper. points are tracked over at least five images. In some of our experiments for the MLE method, we had fitted over conics using information from 36 images. This makes the method very robust. However, for each conic, the point was tracked over 5 to 5 views only. Using a small number of parameters, these methods give very robust computations as have been demonstrated in the examples using real images. ACKNOWLEDGMENTS This project is partially supported by the Hong Kong RGC Grant CUHK 4378/2E. REFERENCES [] M. Armstrong, A. Zisserman, and R. Hartley, Self-Calibration from Image Triplets, Proc. European Conf. Computer Vision, pp. 3-6, 996. [2] F. Bookstein, Fitting Conic Sections to Scattered Data, Computer Vision, Graphics and Image Processing, vol. 9, pp. 56-7, 979. [3] C.H. Chien and J.K. Aggarwal, Identification of 3D Objects from Multiple Silhouettes Using Quadtrees/Octrees, Computer Vision, Graphics, and Image Processing, vol. 36, pp , 986. [4] O.D. Faugeras, L. Quan, and P. Sturm, Self-Calibration of a D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera, Proc. European Conf. Computer Vision, pp , 998. [5] A.W. Fitzgibbon, G. Cross, and A. Zisserman, Automatic 3D Model Construction for Turn-Table Sequences, Proc. European Workshop SMILE 98, pp. 55-7, 998. [6] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2. [7] G. Jiang, H.T. Tsui, L. Quan, and S.Q. Liu, Recovering the Geometry of Single Axis Motions by Conic Fitting, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp , 2. [8] G. Jiang, H.T. Tsui, L. Quan, and A. Zisserman, Single Axis Geometry by Fitting Conics, Proc. European Conf. Computer Vision, pp , 22. [9] J.J. Koenderink and A.J. van Doorn, Affine Structure from Motion, J. Optical Soc. Am., A, vol. 8, no. 2, pp , 99. [] D. Liebowitz and A. Zisserman, Metric Rectification for Perspective Images of Planes, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp , 998. [] P.R.S. Mendonça, K.-Y.K. Wong, and R. Cipolla, Epipolar Geometry from Profiles under Circular Motion, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp , June 2. [2] J. Mundy and A. Zisserman, Repeated Structures: Image Correspondence Constraints and Ambiguity of 3D Reconstruction, Applications of Invariance in Computer Vision, Springer Verlag, 994. [3] W. Niem, Robust and Fast Modelling of 3D Natural Objects from Multiple Views, Proc. SPIE. Image and Video Processing II, vol. 282, pp , 994. [4] L. Quan, Conic Reconstruction and Correspondence from Two Views, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, pp. 5-6, 996. [5] P.D. Sampson, Fitting Conic Sections to Very Scattered Data: An Iterative Refinement of the Bookstein Algorithm, Computer Vision, Graphics, and Image Processing, vol. 8, no. 2, pp. 97-8, 982. [6] H.S. Sawhney, J. Oliensis, and A.R. Hanson, Image Description and 3D Reconstruction from Image Trajectories of Rotational Motion, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 9, pp , Sept [7] J. Semple and G. Kneebone, Algebraic Projective Geometry. Oxford Univ. Press, 952. [8] S. Sullivan and J. Ponce, Automatic Model Construction, Pose Estimation, and Object Recognition from Photographs Using Triangular Splines, IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no., pp. 9-97, Oct [9] R. Szeliski, Shape from Rotation, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp , 99. [2] K.-Y.K. Wong, P.R.S. Mendonça, and R. Cipolla, Structure and Motion Estimation from Apparent Contours Under Circular Motion, Image and Vision Computing, pp [2] Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong, A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry, Artificial Intelligence, vol. 78, pp. 87-9, 995. [22] A. Zisserman, D. Liebowitz, and M. Armstrong, Resolving Ambiguities in Auto-Calibration, Philosophical Trans. Royal Soc. London, A, vol. 356, no. 74, pp. 93-2, 998. [23] T. Vieville and D. Lingrand, Using Specific Displacements to Analyze Motion without Calibration, Int l J. Computer Vision, vol. 3, no., pp. 5-29, For more information on this or any other computing topic, please visit our Digital Library at

Circular Motion Geometry by Minimal 2 Points in 4 Images

Circular Motion Geometry by Minimal 2 Points in 4 Images Circular Motion Geometry by Minimal 2 Points in 4 Images Guang JIANG 1,3, Long QUAN 2, and Hung-tat TSUI 1 1 Dept. of Electronic Engineering, The Chinese University of Hong Kong, New Territory, Hong Kong

More information

Circular Motion Geometry Using Minimal Data. Abstract

Circular Motion Geometry Using Minimal Data. Abstract Circular Motion Geometry Using Minimal Data Guang JIANG, Long QUAN, and Hung-tat TSUI Dept. of Electronic Engineering, The Chinese University of Hong Kong Dept. of Computer Science, The Hong Kong University

More information

1D camera geometry and Its application to circular motion estimation. Creative Commons: Attribution 3.0 Hong Kong License

1D camera geometry and Its application to circular motion estimation. Creative Commons: Attribution 3.0 Hong Kong License Title D camera geometry and Its application to circular motion estimation Author(s Zhang, G; Zhang, H; Wong, KKY Citation The 7th British Machine Vision Conference (BMVC, Edinburgh, U.K., 4-7 September

More information

Detection of Concentric Circles for Camera Calibration

Detection of Concentric Circles for Camera Calibration Detection of Concentric Circles for Camera Calibration Guang JIANG and Long QUAN Department of Computer Science Hong Kong University of Science and Technology Kowloon, Hong Kong {gjiang,quan}@cs.ust.hk

More information

Multiple View Geometry in Computer Vision Second Edition

Multiple View Geometry in Computer Vision Second Edition Multiple View Geometry in Computer Vision Second Edition Richard Hartley Australian National University, Canberra, Australia Andrew Zisserman University of Oxford, UK CAMBRIDGE UNIVERSITY PRESS Contents

More information

Camera Calibration from the Quasi-affine Invariance of Two Parallel Circles

Camera Calibration from the Quasi-affine Invariance of Two Parallel Circles Camera Calibration from the Quasi-affine Invariance of Two Parallel Circles Yihong Wu, Haijiang Zhu, Zhanyi Hu, and Fuchao Wu National Laboratory of Pattern Recognition, Institute of Automation, Chinese

More information

Metric Rectification for Perspective Images of Planes

Metric Rectification for Perspective Images of Planes 789139-3 University of California Santa Barbara Department of Electrical and Computer Engineering CS290I Multiple View Geometry in Computer Vision and Computer Graphics Spring 2006 Metric Rectification

More information

A Desktop 3D Scanner Exploiting Rotation and Visual Rectification of Laser Profiles

A Desktop 3D Scanner Exploiting Rotation and Visual Rectification of Laser Profiles A Desktop 3D Scanner Exploiting Rotation and Visual Rectification of Laser Profiles Carlo Colombo, Dario Comanducci, and Alberto Del Bimbo Dipartimento di Sistemi ed Informatica Via S. Marta 3, I-5139

More information

A General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras

A General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras A General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras Zhengyou Zhang* ATR Human Information Processing Res. Lab. 2-2 Hikari-dai, Seika-cho, Soraku-gun Kyoto 619-02 Japan

More information

Minimal Projective Reconstruction for Combinations of Points and Lines in Three Views

Minimal Projective Reconstruction for Combinations of Points and Lines in Three Views Minimal Projective Reconstruction for Combinations of Points and Lines in Three Views Magnus Oskarsson, Andrew Zisserman and Kalle Åström Centre for Mathematical Sciences Lund University,SE 221 00 Lund,

More information

COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION

COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION Mr.V.SRINIVASA RAO 1 Prof.A.SATYA KALYAN 2 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING PRASAD V POTLURI SIDDHARTHA

More information

Coplanar circles, quasi-affine invariance and calibration

Coplanar circles, quasi-affine invariance and calibration Image and Vision Computing 24 (2006) 319 326 www.elsevier.com/locate/imavis Coplanar circles, quasi-affine invariance and calibration Yihong Wu *, Xinju Li, Fuchao Wu, Zhanyi Hu National Laboratory of

More information

Structure and Motion Estimation from Apparent Contours under Circular Motion

Structure and Motion Estimation from Apparent Contours under Circular Motion Structure and Motion Estimation from Apparent Contours under Circular Motion Kwan-Yee K. Wong a,,paulo R. S. Mendonça b,1,roberto Cipolla b a Department of Computer Science and Information Systems, The

More information

Automatic Estimation of Epipolar Geometry

Automatic Estimation of Epipolar Geometry Robust line estimation Automatic Estimation of Epipolar Geometry Fit a line to 2D data containing outliers c b a d There are two problems: (i) a line fit to the data ;, (ii) a classification of the data

More information

calibrated coordinates Linear transformation pixel coordinates

calibrated coordinates Linear transformation pixel coordinates 1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial

More information

A Case Against Kruppa s Equations for Camera Self-Calibration

A Case Against Kruppa s Equations for Camera Self-Calibration EXTENDED VERSION OF: ICIP - IEEE INTERNATIONAL CONFERENCE ON IMAGE PRO- CESSING, CHICAGO, ILLINOIS, PP. 172-175, OCTOBER 1998. A Case Against Kruppa s Equations for Camera Self-Calibration Peter Sturm

More information

Projective Reconstruction of Surfaces of Revolution

Projective Reconstruction of Surfaces of Revolution Projective Reconstruction of Surfaces of Revolution Sven Utcke 1 and Andrew Zisserman 2 1 Arbeitsbereich Kognitive Systeme, Fachbereich Informatik, Universität Hamburg, Germany utcke@informatik.uni-hamburg.de

More information

Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction

Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Carsten Rother 09/12/2013 Computer Vision I: Multi-View 3D reconstruction Roadmap this lecture Computer Vision I: Multi-View

More information

Structure from Motion. Prof. Marco Marcon

Structure from Motion. Prof. Marco Marcon Structure from Motion Prof. Marco Marcon Summing-up 2 Stereo is the most powerful clue for determining the structure of a scene Another important clue is the relative motion between the scene and (mono)

More information

METR Robotics Tutorial 2 Week 2: Homogeneous Coordinates

METR Robotics Tutorial 2 Week 2: Homogeneous Coordinates METR4202 -- Robotics Tutorial 2 Week 2: Homogeneous Coordinates The objective of this tutorial is to explore homogenous transformations. The MATLAB robotics toolbox developed by Peter Corke might be a

More information

Unit 3 Multiple View Geometry

Unit 3 Multiple View Geometry Unit 3 Multiple View Geometry Relations between images of a scene Recovering the cameras Recovering the scene structure http://www.robots.ox.ac.uk/~vgg/hzbook/hzbook1.html 3D structure from images Recover

More information

Stereo and Epipolar geometry

Stereo and Epipolar geometry Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka

More information

A Stratified Approach for Camera Calibration Using Spheres

A Stratified Approach for Camera Calibration Using Spheres IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. XX, NO. Y, MONTH YEAR 1 A Stratified Approach for Camera Calibration Using Spheres Kwan-Yee K. Wong, Member, IEEE, Guoqiang Zhang, Student-Member, IEEE and Zhihu

More information

Geometric Interpretations of the Relation between the Image of the Absolute Conic and Sphere Images

Geometric Interpretations of the Relation between the Image of the Absolute Conic and Sphere Images IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 8, NO. 1, DECEMBER 006 01 Geometric Interpretations of the Relation between the Image of the Absolute Conic and Sphere Images Xianghua

More information

Structure from motion

Structure from motion Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera

More information

Flexible Calibration of a Portable Structured Light System through Surface Plane

Flexible Calibration of a Portable Structured Light System through Surface Plane Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured

More information

Multiple-View Structure and Motion From Line Correspondences

Multiple-View Structure and Motion From Line Correspondences ICCV 03 IN PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, NICE, FRANCE, OCTOBER 003. Multiple-View Structure and Motion From Line Correspondences Adrien Bartoli Peter Sturm INRIA

More information

Planar pattern for automatic camera calibration

Planar pattern for automatic camera calibration Planar pattern for automatic camera calibration Beiwei Zhang Y. F. Li City University of Hong Kong Department of Manufacturing Engineering and Engineering Management Kowloon, Hong Kong Fu-Chao Wu Institute

More information

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS M. Lefler, H. Hel-Or Dept. of CS, University of Haifa, Israel Y. Hel-Or School of CS, IDC, Herzliya, Israel ABSTRACT Video analysis often requires

More information

Object and Motion Recognition using Plane Plus Parallax Displacement of Conics

Object and Motion Recognition using Plane Plus Parallax Displacement of Conics Object and Motion Recognition using Plane Plus Parallax Displacement of Conics Douglas R. Heisterkamp University of South Alabama Mobile, AL 6688-0002, USA dheister@jaguar1.usouthal.edu Prabir Bhattacharya

More information

Feature Transfer and Matching in Disparate Stereo Views through the Use of Plane Homographies

Feature Transfer and Matching in Disparate Stereo Views through the Use of Plane Homographies IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 25, NO. 2, FEBRUARY 2003 271 Feature Transfer and Matching in Disparate Stereo Views through the Use of Plane Homographies Manolis I.A.

More information

URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES

URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment

More information

Perception and Action using Multilinear Forms

Perception and Action using Multilinear Forms Perception and Action using Multilinear Forms Anders Heyden, Gunnar Sparr, Kalle Åström Dept of Mathematics, Lund University Box 118, S-221 00 Lund, Sweden email: {heyden,gunnar,kalle}@maths.lth.se Abstract

More information

Visual Recognition: Image Formation

Visual Recognition: Image Formation Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know

More information

A stratified approach for camera calibration using spheres. Creative Commons: Attribution 3.0 Hong Kong License

A stratified approach for camera calibration using spheres. Creative Commons: Attribution 3.0 Hong Kong License Title A stratified approach for camera calibration using spheres Author(s) Wong, KYK; Zhang, G; Chen, Z Citation Ieee Transactions On Image Processing, 2011, v. 20 n. 2, p. 305-316 Issued Date 2011 URL

More information

arxiv: v1 [cs.cv] 28 Sep 2018

arxiv: v1 [cs.cv] 28 Sep 2018 Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,

More information

Camera Calibration and Shape Recovery from videos of Two Mirrors

Camera Calibration and Shape Recovery from videos of Two Mirrors Camera Calibration and Shape Recovery from videos of Two Mirrors Quanxin Chen and Hui Zhang Dept. of Computer Science, United International College, 28, Jinfeng Road, Tangjiawan, Zhuhai, Guangdong, China.

More information

University of Southern California, 1590 the Alameda #200 Los Angeles, CA San Jose, CA Abstract

University of Southern California, 1590 the Alameda #200 Los Angeles, CA San Jose, CA Abstract Mirror Symmetry 2-View Stereo Geometry Alexandre R.J. François +, Gérard G. Medioni + and Roman Waupotitsch * + Institute for Robotics and Intelligent Systems * Geometrix Inc. University of Southern California,

More information

Two-View Geometry (Course 23, Lecture D)

Two-View Geometry (Course 23, Lecture D) Two-View Geometry (Course 23, Lecture D) Jana Kosecka Department of Computer Science George Mason University http://www.cs.gmu.edu/~kosecka General Formulation Given two views of the scene recover the

More information

A Factorization Method for Structure from Planar Motion

A Factorization Method for Structure from Planar Motion A Factorization Method for Structure from Planar Motion Jian Li and Rama Chellappa Center for Automation Research (CfAR) and Department of Electrical and Computer Engineering University of Maryland, College

More information

A Linear Dual-Space Approach to 3D Surface Reconstruction from Occluding Contours using Algebraic Surfaces

A Linear Dual-Space Approach to 3D Surface Reconstruction from Occluding Contours using Algebraic Surfaces A Linear Dual-Space Approach to 3D Surface Reconstruction from Occluding Contours using Algebraic Surfaces Kongbin Kang Jean-Philippe Tarel Richard Fishman David Cooper Div. of Eng. LIVIC (INRETS-LCPC)

More information

Linear Auto-Calibration for Ground Plane Motion

Linear Auto-Calibration for Ground Plane Motion Linear Auto-Calibration for Ground Plane Motion Joss Knight, Andrew Zisserman, and Ian Reid Department of Engineering Science, University of Oxford Parks Road, Oxford OX1 3PJ, UK [joss,az,ian]@robots.ox.ac.uk

More information

But First: Multi-View Projective Geometry

But First: Multi-View Projective Geometry View Morphing (Seitz & Dyer, SIGGRAPH 96) Virtual Camera Photograph Morphed View View interpolation (ala McMillan) but no depth no camera information Photograph But First: Multi-View Projective Geometry

More information

Computer Vision Lecture 17

Computer Vision Lecture 17 Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester

More information

Stereo Vision. MAN-522 Computer Vision

Stereo Vision. MAN-522 Computer Vision Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in

More information

Computer Vision Lecture 17

Computer Vision Lecture 17 Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week

More information

Plane-based Calibration Algorithm for Multi-camera Systems via Factorization of Homography Matrices

Plane-based Calibration Algorithm for Multi-camera Systems via Factorization of Homography Matrices Plane-based Calibration Algorithm for Multi-camera Systems via Factorization of Homography Matrices Toshio Ueshiba Fumiaki Tomita National Institute of Advanced Industrial Science and Technology (AIST)

More information

Constrained planar motion analysis by decomposition

Constrained planar motion analysis by decomposition Image and Vision Computing 22 (2004) 379 389 www.elsevier.com/locate/imavis Constrained planar motion analysis by decomposition Long Quan a, *, Yichen Wei a,lelu b,c, Heung-Yeung Shum b a HKUST, Department

More information

Automatic Line Matching across Views

Automatic Line Matching across Views Automatic Line Matching across Views Cordelia Schmid and Andrew Zisserman Department of Engineering Science, University of Oxford Parks Road, Oxford, UK OX1 3PJ Abstract This paper presents a new method

More information

Camera Calibration Using Line Correspondences

Camera Calibration Using Line Correspondences Camera Calibration Using Line Correspondences Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Ph: (518)-387-7333 Fax: (518)-387-6845 Email : hartley@crd.ge.com Abstract In this paper, a method of

More information

Tangency of Conics and Quadrics

Tangency of Conics and Quadrics Proc. of the 6th WSEAS Int. Conf. on Signal Processing, Computational Geometry & Artificial Vision, Elounda, Greece, August 21-23, 26 (pp21-29) Tangency of Conics and Quadrics SUDANTHI N. R. WIJEWICKREMA,

More information

A linear algorithm for Camera Self-Calibration, Motion and Structure Recovery for Multi-Planar Scenes from Two Perspective Images

A linear algorithm for Camera Self-Calibration, Motion and Structure Recovery for Multi-Planar Scenes from Two Perspective Images A linear algorithm for Camera Self-Calibration, Motion and Structure Recovery for Multi-Planar Scenes from Two Perspective Images Gang Xu, Jun-ichi Terai and Heung-Yeung Shum Microsoft Research China 49

More information

Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction

Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 32, NO. X, XXXXXXX 2010 1 Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction Ciarán Hughes, Member, IEEE,

More information

Structure from Motion. Introduction to Computer Vision CSE 152 Lecture 10

Structure from Motion. Introduction to Computer Vision CSE 152 Lecture 10 Structure from Motion CSE 152 Lecture 10 Announcements Homework 3 is due May 9, 11:59 PM Reading: Chapter 8: Structure from Motion Optional: Multiple View Geometry in Computer Vision, 2nd edition, Hartley

More information

Geometric and Algebraic Constraints of Projected Concentric Circles and Their Applications to Camera Calibration

Geometric and Algebraic Constraints of Projected Concentric Circles and Their Applications to Camera Calibration IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 27, NO. 4, APRIL 2005 1 Geometric and Algebraic Constraints of Proected Concentric Circles and Their Applications to Camera Calibration

More information

Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies

Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies M. Lourakis, S. Tzurbakis, A. Argyros, S. Orphanoudakis Computer Vision and Robotics Lab (CVRL) Institute of

More information

Homogeneous Coordinates. Lecture18: Camera Models. Representation of Line and Point in 2D. Cross Product. Overall scaling is NOT important.

Homogeneous Coordinates. Lecture18: Camera Models. Representation of Line and Point in 2D. Cross Product. Overall scaling is NOT important. Homogeneous Coordinates Overall scaling is NOT important. CSED44:Introduction to Computer Vision (207F) Lecture8: Camera Models Bohyung Han CSE, POSTECH bhhan@postech.ac.kr (",, ) ()", ), )) ) 0 It is

More information

Structure and motion in 3D and 2D from hybrid matching constraints

Structure and motion in 3D and 2D from hybrid matching constraints Structure and motion in 3D and 2D from hybrid matching constraints Anders Heyden, Fredrik Nyberg and Ola Dahl Applied Mathematics Group Malmo University, Sweden {heyden,fredrik.nyberg,ola.dahl}@ts.mah.se

More information

Single View Metrology

Single View Metrology International Journal of Computer Vision 40(2), 123 148, 2000 c 2000 Kluwer Academic Publishers. Manufactured in The Netherlands. Single View Metrology A. CRIMINISI, I. REID AND A. ZISSERMAN Department

More information

Fast Outlier Rejection by Using Parallax-Based Rigidity Constraint for Epipolar Geometry Estimation

Fast Outlier Rejection by Using Parallax-Based Rigidity Constraint for Epipolar Geometry Estimation Fast Outlier Rejection by Using Parallax-Based Rigidity Constraint for Epipolar Geometry Estimation Engin Tola 1 and A. Aydın Alatan 2 1 Computer Vision Laboratory, Ecóle Polytechnique Fédéral de Lausanne

More information

Binocular Transfer Methods for Point-Feature Tracking of Image Sequences

Binocular Transfer Methods for Point-Feature Tracking of Image Sequences 392 IEEE TRANSACTIONS ON SYSTEMS, MAN and CYBERNETICS PART C: APPLICATIONS AND REVIEWS, VOL. 32, NO. 4, NOVEMBER 2002 Binocular Transfer Methods for Point-Feature Tracking of Image Sequences Jason Z. Zhang,

More information

Recovering light directions and camera poses from a single sphere.

Recovering light directions and camera poses from a single sphere. Title Recovering light directions and camera poses from a single sphere Author(s) Wong, KYK; Schnieders, D; Li, S Citation The 10th European Conference on Computer Vision (ECCV 2008), Marseille, France,

More information

Camera calibration with spheres: Linear approaches

Camera calibration with spheres: Linear approaches Title Camera calibration with spheres: Linear approaches Author(s) Zhang, H; Zhang, G; Wong, KYK Citation The IEEE International Conference on Image Processing (ICIP) 2005, Genoa, Italy, 11-14 September

More information

Camera calibration with two arbitrary coaxial circles

Camera calibration with two arbitrary coaxial circles Camera calibration with two arbitrary coaxial circles Carlo Colombo, Dario Comanducci, and Alberto Del Bimbo Dipartimento di Sistemi e Informatica Via S. Marta 3, 50139 Firenze, Italy {colombo,comandu,delbimbo}@dsi.unifi.it

More information

Affine Surface Reconstruction By Purposive Viewpoint Control

Affine Surface Reconstruction By Purposive Viewpoint Control Affine Surface Reconstruction By Purposive Viewpoint Control Kiriakos N. Kutulakos kyros@cs.rochester.edu Department of Computer Sciences University of Rochester Rochester, NY 14627-0226 USA Abstract We

More information

Today. Stereo (two view) reconstruction. Multiview geometry. Today. Multiview geometry. Computational Photography

Today. Stereo (two view) reconstruction. Multiview geometry. Today. Multiview geometry. Computational Photography Computational Photography Matthias Zwicker University of Bern Fall 2009 Today From 2D to 3D using multiple views Introduction Geometry of two views Stereo matching Other applications Multiview geometry

More information

Visual Hulls from Single Uncalibrated Snapshots Using Two Planar Mirrors

Visual Hulls from Single Uncalibrated Snapshots Using Two Planar Mirrors Visual Hulls from Single Uncalibrated Snapshots Using Two Planar Mirrors Keith Forbes 1 Anthon Voigt 2 Ndimi Bodika 2 1 Digital Image Processing Group 2 Automation and Informatics Group Department of Electrical

More information

Reconstruction of Surfaces of Revolution from Single Uncalibrated Views

Reconstruction of Surfaces of Revolution from Single Uncalibrated Views Reconstruction of Surfaces of Revolution from Single Uncalibrated Views Kwan-Yee K. Wong a,, Paulo R. S. Mendonça b, Roberto Cipolla c a Dept. of Comp. Science and Info. Systems, The University of Hong

More information

3D Modeling using multiple images Exam January 2008

3D Modeling using multiple images Exam January 2008 3D Modeling using multiple images Exam January 2008 All documents are allowed. Answers should be justified. The different sections below are independant. 1 3D Reconstruction A Robust Approche Consider

More information

Recovering structure from a single view Pinhole perspective projection

Recovering structure from a single view Pinhole perspective projection EPIPOLAR GEOMETRY The slides are from several sources through James Hays (Brown); Silvio Savarese (U. of Michigan); Svetlana Lazebnik (U. Illinois); Bill Freeman and Antonio Torralba (MIT), including their

More information

Guang-Hui Wang et al.: Single View Based Measurement on Space Planes 375 parallelism of lines and planes. In [1, ], a keypoint-based approach to calcu

Guang-Hui Wang et al.: Single View Based Measurement on Space Planes 375 parallelism of lines and planes. In [1, ], a keypoint-based approach to calcu May 004, Vol.19, No.3, pp.374 38 J. Comput. Sci. & Technol. Single View Based Measurement on Space Planes Guang-Hui Wang, Zhan-Yi Hu, and Fu-Chao Wu National Laboratory of Pattern Recognition, Institute

More information

Passive 3D Photography

Passive 3D Photography SIGGRAPH 2000 Course on 3D Photography Passive 3D Photography Steve Seitz Carnegie Mellon University University of Washington http://www.cs cs.cmu.edu/~ /~seitz Visual Cues Shading Merle Norman Cosmetics,

More information

Computing the relations among three views based on artificial neural network

Computing the relations among three views based on artificial neural network Computing the relations among three views based on artificial neural network Ying Kin Yu Kin Hong Wong Siu Hang Or Department of Computer Science and Engineering The Chinese University of Hong Kong E-mail:

More information

The Geometry of Dynamic Scenes On Coplanar and Convergent Linear Motions Embedded in 3D Static Scenes

The Geometry of Dynamic Scenes On Coplanar and Convergent Linear Motions Embedded in 3D Static Scenes EXTENDED VERSION SHORT VERSION APPEARED IN THE 13TH BMVC, CARDIFF, SEPTEMBER 2002. The Geometry of Dynamic Scenes On Coplanar and Convergent Linear Motions Embedded in 3D Static Scenes Adrien Bartoli,

More information

The end of affine cameras

The end of affine cameras The end of affine cameras Affine SFM revisited Epipolar geometry Two-view structure from motion Multi-view structure from motion Planches : http://www.di.ens.fr/~ponce/geomvis/lect3.pptx http://www.di.ens.fr/~ponce/geomvis/lect3.pdf

More information

Critical Motion Sequences for the Self-Calibration of Cameras and Stereo Systems with Variable Focal Length

Critical Motion Sequences for the Self-Calibration of Cameras and Stereo Systems with Variable Focal Length Critical Motion Sequences for the Self-Calibration of Cameras and Stereo Systems with Variable Focal Length Peter F Sturm Computational Vision Group, Department of Computer Science The University of Reading,

More information

A Calibration Algorithm for POX-Slits Camera

A Calibration Algorithm for POX-Slits Camera A Calibration Algorithm for POX-Slits Camera N. Martins 1 and H. Araújo 2 1 DEIS, ISEC, Polytechnic Institute of Coimbra, Portugal 2 ISR/DEEC, University of Coimbra, Portugal Abstract Recent developments

More information

Affine Stereo Calibration

Affine Stereo Calibration Affine Stereo Calibration Peter Sturm, Long Quan To cite this version: Peter Sturm, Long Quan. Affine Stereo Calibration. [Technical Report] LIFIA-29, 1995, pp.19. HAL Id: inria-00525704

More information

1 Projective Geometry

1 Projective Geometry CIS8, Machine Perception Review Problem - SPRING 26 Instructions. All coordinate systems are right handed. Projective Geometry Figure : Facade rectification. I took an image of a rectangular object, and

More information

Mathematics of a Multiple Omni-Directional System

Mathematics of a Multiple Omni-Directional System Mathematics of a Multiple Omni-Directional System A. Torii A. Sugimoto A. Imiya, School of Science and National Institute of Institute of Media and Technology, Informatics, Information Technology, Chiba

More information

A Real-Time Catadioptric Stereo System Using Planar Mirrors

A Real-Time Catadioptric Stereo System Using Planar Mirrors A Real-Time Catadioptric Stereo System Using Planar Mirrors Joshua Gluckman Shree K. Nayar Department of Computer Science Columbia University New York, NY 10027 Abstract By using mirror reflections of

More information

Multiple View Geometry in computer vision

Multiple View Geometry in computer vision Multiple View Geometry in computer vision Chapter 8: More Single View Geometry Olaf Booij Intelligent Systems Lab Amsterdam University of Amsterdam, The Netherlands HZClub 29-02-2008 Overview clubje Part

More information

BIL Computer Vision Apr 16, 2014

BIL Computer Vision Apr 16, 2014 BIL 719 - Computer Vision Apr 16, 2014 Binocular Stereo (cont d.), Structure from Motion Aykut Erdem Dept. of Computer Engineering Hacettepe University Slide credit: S. Lazebnik Basic stereo matching algorithm

More information

Multiple Views Geometry

Multiple Views Geometry Multiple Views Geometry Subhashis Banerjee Dept. Computer Science and Engineering IIT Delhi email: suban@cse.iitd.ac.in January 2, 28 Epipolar geometry Fundamental geometric relationship between two perspective

More information

A Novel Stereo Camera System by a Biprism

A Novel Stereo Camera System by a Biprism 528 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 16, NO. 5, OCTOBER 2000 A Novel Stereo Camera System by a Biprism DooHyun Lee and InSo Kweon, Member, IEEE Abstract In this paper, we propose a novel

More information

Model Based Perspective Inversion

Model Based Perspective Inversion Model Based Perspective Inversion A. D. Worrall, K. D. Baker & G. D. Sullivan Intelligent Systems Group, Department of Computer Science, University of Reading, RG6 2AX, UK. Anthony.Worrall@reading.ac.uk

More information

Compositing a bird's eye view mosaic

Compositing a bird's eye view mosaic Compositing a bird's eye view mosaic Robert Laganiere School of Information Technology and Engineering University of Ottawa Ottawa, Ont KN 6N Abstract This paper describes a method that allows the composition

More information

Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes

Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes Peter Sturm To cite this version: Peter Sturm. Structure and Motion for Dynamic Scenes - The Case of Points Moving in Planes.

More information

Silhouette-based Multiple-View Camera Calibration

Silhouette-based Multiple-View Camera Calibration Silhouette-based Multiple-View Camera Calibration Prashant Ramanathan, Eckehard Steinbach, and Bernd Girod Information Systems Laboratory, Electrical Engineering Department, Stanford University Stanford,

More information

Model Selection for Automated Architectural Reconstruction from Multiple Views

Model Selection for Automated Architectural Reconstruction from Multiple Views Model Selection for Automated Architectural Reconstruction from Multiple Views Tomáš Werner, Andrew Zisserman Visual Geometry Group, University of Oxford Abstract We describe progress in automatically

More information

Stereo Image Rectification for Simple Panoramic Image Generation

Stereo Image Rectification for Simple Panoramic Image Generation Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,

More information

arxiv: v1 [cs.cv] 28 Sep 2018

arxiv: v1 [cs.cv] 28 Sep 2018 Extrinsic camera calibration method and its performance evaluation Jacek Komorowski 1 and Przemyslaw Rokita 2 arxiv:1809.11073v1 [cs.cv] 28 Sep 2018 1 Maria Curie Sklodowska University Lublin, Poland jacek.komorowski@gmail.com

More information

Step-by-Step Model Buidling

Step-by-Step Model Buidling Step-by-Step Model Buidling Review Feature selection Feature selection Feature correspondence Camera Calibration Euclidean Reconstruction Landing Augmented Reality Vision Based Control Sparse Structure

More information

CS231M Mobile Computer Vision Structure from motion

CS231M Mobile Computer Vision Structure from motion CS231M Mobile Computer Vision Structure from motion - Cameras - Epipolar geometry - Structure from motion Pinhole camera Pinhole perspective projection f o f = focal length o = center of the camera z y

More information

Lecture 9: Epipolar Geometry

Lecture 9: Epipolar Geometry Lecture 9: Epipolar Geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Why is stereo useful? Epipolar constraints Essential and fundamental matrix Estimating F (Problem Set 2

More information

Refining Single View Calibration With the Aid of Metric Scene Properties

Refining Single View Calibration With the Aid of Metric Scene Properties Goack Refining Single View Calibration With the Aid of Metric Scene roperties Manolis I.A. Lourakis lourakis@ics.forth.gr Antonis A. Argyros argyros@ics.forth.gr Institute of Computer Science Foundation

More information

Epipolar geometry. x x

Epipolar geometry. x x Two-view geometry Epipolar geometry X x x Baseline line connecting the two camera centers Epipolar Plane plane containing baseline (1D family) Epipoles = intersections of baseline with image planes = projections

More information

Reconstruction of sculpture from its profiles with unknown camera positions

Reconstruction of sculpture from its profiles with unknown camera positions Title Reconstruction of sculpture from its profiles with unknown camera positions Author(s) Wong, KYK; Cipolla, R Citation Ieee Transactions On Image Processing, 2004, v. 13 n. 3, p. 381-389 Issued Date

More information

The Geometry of Multiple Images The Laws That Govern the Formation of Multiple Images of a Scene and Some of Thcir Applications

The Geometry of Multiple Images The Laws That Govern the Formation of Multiple Images of a Scene and Some of Thcir Applications The Geometry of Multiple Images The Laws That Govern the Formation of Multiple Images of a Scene and Some of Thcir Applications Olivier Faugeras QUC1ng-Tuan Luong with contributions from Theo Papadopoulo

More information

Index. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 263

Index. 3D reconstruction, point algorithm, point algorithm, point algorithm, point algorithm, 263 Index 3D reconstruction, 125 5+1-point algorithm, 284 5-point algorithm, 270 7-point algorithm, 265 8-point algorithm, 263 affine point, 45 affine transformation, 57 affine transformation group, 57 affine

More information