Neighborhood Hypothesis Testing for Mean Change on Infinite. Dimensional Lie Groups and 3D Projective Shape Analysis of. Contours

Size: px
Start display at page:

Download "Neighborhood Hypothesis Testing for Mean Change on Infinite. Dimensional Lie Groups and 3D Projective Shape Analysis of. Contours"

Transcription

1 Neighborhood Hypothesis Testing for Mean Change on Infinite Dimensional Lie Groups and 3D Projective Shape Analysis of Contours Vic Patrangenaru, Mingfei Qiu Department of Statistics, Florida State University October 15, 2014 Abstract A two-sample hypothesis testing method on a finite dimensional Lie group was derived by Crane and Patrangenaru [1] by an extrinsic approach. If the dimension of the data is infinite, the equality of two extrinsic means is highly likely to be rejected. Munk el. al. [2] generalized one- and multi-sample neiborhood hypothesis testing in projective shape analysis, which addressed the infinite dimension problem. In this paper, we develop a general nonparametric hypothesis testing method for estimation of the extrinsic mean change for matched samples on a Hilbert manifold that has an infinite dimensional Lie group structure. keywords extrinsic means, infinite dimensional data, neighborhood hypothesis test, nonparametric bootstrap 1 Introduction With our eyes, all we see are 3D projective shapes. However, based on the current technology level, 2D digital images are still the most frequently used resources to test if two objects are the same, while our brains use 3D. Hartley [3] developed the 3D projective reconstruction technology to retrieve the 3D projective shape of an object from the digital 1

2 images obtaining from two views. Ma el. al. [4] provided the MATLAB code to compute the fundamental matrix, which is the basic tool in investigating the 3D projective shape. The real projective space in m dimensions, RP m is the projective space P (R m+1 ). We are interested in the infinite dimensional data in RP m obtained from the digital images. Nowadays, the dimension of the data obtaining from digital images could be very large, however, the statistical hypothesis testing methods work better for finite dimensional data sets. Munk el. al. [2] pointed out that the well known Hotelling T statistic would break down and the equality for each point of the shape would not hold if the dimension of the data extend to infinity. So they introduced the one- and multi-sample neighborhood hypothesis testing methodology, which utilized neighborhood hypothesis to replace the regular null hypothesis defined by equations; and led to simpler asymptotic analyses. While the mean and covariance used in that paper were the regular ones, Ellingson el. al. [5] extended the one-sample neighborhood hypothesis testing method by employing extrinsic parameters. For two random objects (X, Y ), one can test if X and Y are different by estimate the difference vector D = X Y via one-sampe testing methods. Similarly, in the infinite dimensional case, we define the mean change by the quarternion multiplication, then test the difference by one-sample neighborhood hypothesis testing. Motivated by the pioneering works, this paper develops the neighborhood hypothesis testing method to test the random change on infinite dimensional 3D projective shapes by extrinsic approach. In section 2, we introduce the projective geometry, projective shapes and the extrinsic mean, especially the extrinsic mean defined by Veronese- Whitney embedding (VW embeding). The neighborhood hypothesis testing methodology for 3D projective shapes is derived in section 3. To better analyze the small sample size data set, the nonparametric bootstrapping statistic is also displayed. And we apply this method to two sets of images taken from two green leaves in section 4. 2 Projective geometry projective shape, and the extrinsic mean In this section, we briefly review the 3D projective reconstruction. More details are in Hartley and Zisserman [7], Ma el. al. [4] and Patrangenaru el. al. [8]. We also recall the concept of affine coordinate, homogeneous coordinate, and the projective frame given by Mardia and Patrangenaru [6], Munk el. al. [2] and Patrangenaru el. al. [8]. Moreover, we 2

3 suppose the data obtained from the 3D projective reconstructions is on a manifold, and the extrinsic mean guarantees the mean of the data is also on the manifold, so the data is analyzed by extrinsic approach. We are especially interested in the extrinsic mean on a Hilbert manifold defined by the Veronese-Whitney embedding proposed in Patrangenaru el. al. [5]. 2.1 Projective geometry Shape is the residual structure of a configuration with points in R m, when some transformations of R m are filtered out [6]. In the machine vision area, projective transformation are the only important transformations, given the physical process by which the image data are stored. If two images from the same 2D scene are captured by a pinhole camera, the corresponding transformation between the two images is the composition of two central projections, which is a projective transformation. The affine transformation requires the two central projection being able to approximated by parallel projection (the scene pictured is very far from the camera, or very small). And the similarity transformation has even more restrictions, the parallel projections must be orthogonal projections on the plane of the camera. The real projective space RP m is the set of the axes going through the origin of R m+1. Unlike similarities or affine transformations or R m, projective transformations do not have a group structure under composition, since the domain of definition of a projective transformation depends on the transformation, and the maximal domain of a composition has to be restricted accordingly. To avoid such unwanted situations, rather than considering projective shapes of configurations in R m, one may consider configurations in the real projective space RP m, with the projective general linear group (GL) action. The problem of the reconstruction of a configuration of points in 3D from two ideal uncalibrated camera images with unknown camera parameters, is equivalent to the following: given two camera images RP1 2, RP2 2 of unknown relative position and internal camera parameters and two matching sets of labeled points {p a,1,..., p a,k } RPa 2, a = 1, 2, find all the sets of points in space p 1,..., p k in such that there exist two positions of the planes RP1 2, RP2 2 and internal parameters of the two cameras c a, a = 1, 2 with the property that the c a -image of p j is p a,j, a = 1, 2, j = 1,..., k. 3

4 THEOREM 2.1. In absence of occlusions, any two 3D reconstructed configurations R, R obtained from a pair of 2D matched configurations in uncalibrated cameras images of a 3D configuration C, have the same projective shape. Note that the solution of the reconstruction problem, from a pair of 2D images depends on a landmark correspondence. 2.2 Projective frame If x = (x 1,..., x m+1 ) R m+1 \{0}, then (1) [x] = [x 1 : x 2 :... : x m+1 ] = {λx, λ 0} is a projective point in RP m. Alternatively, a point p RP m is given by the normalized form p = [z 1 : z 2 : : z m+1 ], where m+1 i=1 (zi ) 2 = 1. In particular, a projective line l is a set associated with a vector plane V in R m+1, l = {[x], x V \0}. A number of points in RP m are colinear if they lie on a projective line. The Euclidean space R m can be embedded in RP m, preserving colinearity. Such a standard affine embedding, missing only a hyperplane at infinity, is (2) x = (x 1,..., x m ) [x 1 : : x m : 1]. Then for a point p = [X] = [X 1 : : X m : X m+1 ] RP m, X m+1 0, the affine coordinate (imhomogeneous coordinate) is ( X (3) (x 1, x 2,..., x m 1 ) = X m+1,..., X m ) X m+1. Oppositely, the homogeneous coordinate of p is (X 1,..., X m+1 ), which are defined up to a multiplicative constant only. However, the coordinates of interest in projective shape analysis are neither affine nor homogeneous. We need coordinates that are invariant with respect to the group of projective (general linear) transformationp GL(m). A projective transformation α of RP m is defined in terms of an (m + 1) (m + 1) nonsingular matrix A GL(m + 1, R) by (4) α([x 1 : : x m+1 ]) = [A(x 1,..., x m+1 ) T ]. 4

5 There is an nonsingular matrix A = ((a j i ) i,j=1,..., m+1)) (j denotes for row, i for column), the projective transformation in R m is (5) v j = aj m+1 + m i=1 aj i xi a m+1 m+1 + m, j = 1,..., m. i=1 am+1 i xi The linear span of a subset of RP m is the smallest linear variety containing that subset. Note that k points in RP m with k m + 2 are in general position if their linear span is RP m. A projective frame, also known as projective basis, in RP m is an ordered (m + 2) tuple of points π = (p 1,..., p m+2 ), any m + 1 of which are in general position. For example, in RP 2, 4 points consist a projective frame, each 3 of them could not be colinear; for RP 3 case, 5 points could make a projective frame only when each 4 of them are not coplanar. There is one-to-one correspondence between projective frame and projective transformation. Let (e 1,..., e m+1 ) be the standard basis of R m+1, then the standard projective frame is ([e 1 ],..., [e m+1 ], [e e m+1 ]), where the last point is the unit point. Given a projective frame π = (p 1,..., p m+2 ), there is a unique α P GL(m) with α([e j ]) = p j, j = 1,..., m+1, α([e 1 + +e m+1 ]) = p m+2. Suppose x 1,..., x m+2 are points in general position where x = (x 1,..., x m ) is an arbitrary point in R m, set x = (x 1,..., x m, 1). In the notation, the superscripts are reserved for the components of a point, whereas the subscripts are for the labels of points. (x 1,..., x m+2 ) is the projective frame in R m only if ( x 1,..., x m+2 ) is the projective frame in RP m. Consider the (m + 1) (m + 1) matrix U m = [ x 1,..., x m+1 ], whose jth column is x j = (x j, 1) T, j = 1,..., m + 1. Define an intermediate system of homogeneous coordinates (6) v(x) = Um 1 x, and write v(x) = (v 1 (x),..., v m+1 (x)) T. Set (7) y j (x) = v j (x)/v j (x m+2 ), j = 1,..., m + 1, (8) z j (x) = y j (x)/ y(x), j = 1,..., m + 1, where [z 1 (x) : z 2 (x) : : z m+1 ] is the projective axis of a point x. If z m+1 (x) 0, the affine representative of this point with respect to the last coordinate is (ξ 1 (x),..., ξ m (x)), where (9) ξ j (x) = zj (x) z m+1, j = 1,..., m. (x) 5

6 2.3 Extrinsic mean for infinite dimensional data For the points on a manifold, the extrinsic mean point on the manifold is defined in terms of a least expected Fréchet distance property among all the other points on the manifold (Bhattacharya and Patrangenaru [9], [10]). A finite dimensional manifold is a metric space M with the following property: if x M, then there is some neighborhood U of x and some integer n 0 such that U is homeomorphic to R n [11]. Assume J : M R N is an embedding of the d-dimensional complete manifold M. In [9] Bhattacharya and Patrangenaru defined the extrinsic mean µ J of J-nonfocal random object Y on M by (10) µ J =: J 1 (P J (µ)), where µ = E(J(Y )) is the mean vector of J(Y ) and P J : F c J(M) is the otho-projection on J(M) defined on the complement of the set F of focal points of J(M). If f : M 1 M 2 is a differentiable function defined from the manifold M 1 to the manifold M 2 and x M 1, the differential of the function f at x is labeled D x f. Consequently, the extrinsic covariance matrix of Y was defined by Bhattacharya and Patrangenaru [10] also, with respect to a local frame field y (f 1 (y),..., f d (y)) for which (D y J(f 1 (y),..., D y J(f d (y))) are othonormal vectors in R N. The extrinsic covariance mathrix of Y with respect to (f 1 (µ J ),..., f d (µ J )) is [ d ] (11) Σ E = D µ P J (e b ) e a (P J (µ))e a (P J (µ)) [ d Σ D µ P J (e b ) e a (P J (µ))e a (P J (µ)) a=1 b=1,...,n a=1 b=1,...,n where Σ is the covariance matrix of J(Y ); P J is differentialble at µ; (e 1 (p), e 2 (p).... e N (p)) is a local othoframe field defined on an open neighborhood U R N of P J (M), which is adapted to the embedding J if y J 1 (U), e r (J(y)) = D y J(f r (y)), r = 1,..., d. Since P Σ k m is homeomorphic to (RP m ) q, q = k m 2, and RP m is equivariantly embedded in the space S(m + 1) of (m + 1) (m + 1) symmetric matrices via Veronese-Whitney embedding (VW embedding) J : RP m S(m + 1), ] T, (12) J([x]) = xx T. Ellingson el. al. [5] defined the VW embedding from the Hilbert manifold M to the Hilbert space by tensor product. Suppose j is a one-to-one differentialble function embeds a Hilbert manifold M to a Hilbert Space H 6

7 j : M H, (13) j([x]) = x x, x = 1. We call the extrinsic mean defined by the VW embedding as VW mean. Assume X = [Γ], Γ = 1 is a random object on the Hilbert manifold, the VW mean of X exists if and only if E(Γ Γ) has a simple largest eigenvalue, in which case, the distribution is j-nonfocal. Then the VW mean is µ E = [γ], where γ is the eigenvector corresponds to the largest eigenvalue. 3 Two-sample neighborhood hypothesis testing methodology The test for the mean change in paired samples on a Lie group as well as its bootstrap approach were derived by Crane and Patrangenaru [1] in extrinsic way. Patrangenaru el. al. [12] organized this methodology and proposed the bootstrap confidence region in terms of figures other than numbers. This testing method considers the data to be on the finite dimensional Lie group, leaving the research for the one on the infinite dimensional Lie group to be unexploited. Munk el. al. [2] employed the neighborhood hypothesis for analyzing the data on the Hilbert space, whose dimension is infinite. Taking the data on the infinite dimensional Lie group into consideration, in this paper, we will develop the neighborhood hypothesis testing method for detecting the mean change in the way of extrinsic analysis. 3.1 Two sample test for VW means of 3D prjective shapes A group (G, ) that has in addition an m dimensional manifold structure, such that the group multiplication : G G G, and the inversion I : G G, I(g) = g 1 are differentiable maps between manifolds, is called a Lie group. The projective shape manifold P Σ k 3, k 5, has a Lie group structure, derived from the quaternion multiplication. Recall that if a real number x is identified with (0, 0, 0, x) R 4, and if we label the quadruples (1, 0, 0, 0), (0, 1, 0, 0), respectively (0, 0, 1, 0) by i, j, respectively k, then the multiplication table given by 7

8 i j k i -1 k j j k -1 i k j i -1 where a b product of a on the first column with b on the top row, is listed on the row of a and column of b, extends by linearity to a multiplication of R 4. Note that (R 4, +, ) has a structure of a noncommutative field, the field of quaternions, usually labeled by H. Note that if h, h H, then h h = h h, and the three dimensional sphere inherits a group structure, the group of quaternions of norm one. The identity element is given by 1 (RP 3 ) q = ([0 : 0 : 0 : 1],..., [0 : 0 : 0 : 1]). Assume (X r ) r=1,...,n and (Y r ) r=1,...,n are paired r.o. s on a Lie group (G, ). The change from X to Y was defined to be r. o. C r =: Xr 1 Y r = ([c 1 r],..., [c q r]), (c s r) T c s r = 1, s = 1,..., q, r = 1,..., n. A test for no mean change from X to Y is one for the null hypothesis (14) H 0 : µ E = 1 G, where 1 G is the identity of G, and µ E is the extrinsic mean of C. In this paper, we only taking VW mean into account. Let J s be the r.o. given by (15) J s = n 1 Σ n r=1c s r(c s r) T, s = 1,..., q, where d s (a) and g s (a) are the eigenvalues in increasing order and corresponding unit eigenvectors of J s, a = 1,..., m+ 1, then the sample mean VW projective shape, in the multi-axial representation, is given by (16) C Jk,n = ([g 1 (m + 1)],..., [g q (m + 1)]). Notate 1 G = ([0 : 0 : 0 : 1] T,..., [0 : 0 : 0 : 1] T ) = ([γ 1 ],..., [γ q ]), so we can construct the statistic for the test as (17) T s = T s (C s j,n, [γ s ]) = nγ T s D s G 1 s,nd T s γ s, s = 1,..., q, 8

9 where D s = (g s (1)... g s (m)) s = 1,..., q, and G is the sample covariance matrix (18) G n(s,a),(t,b) = n 1 (d s (m + 1) d s (a)) 1 (d t (m + 1) d t (b)) 1 n (g s (a) T c s r)(g t (b) T c t r)(g s (m + 1) T c s r)(g t (m + 1) T c t r). r=1 The corresponding bootstrap distributions are (19) Ts = T s (C s j, C s j,n) = ng s (m + 1) T DsG 1 s,n Ds T g s (m + 1). Patrangenaru et al. [8] showed that T s has asymptotically a χ 2 m distribution. COROLLARY 3.1. For s = 1,..., q let c s,1 β be the upper 100(1 β)% point of the values of T s given by (19). We set (20) C s,n,β := j 1 (U s,n,β) where (21) U s,n,β = {µ s RP m : T s (y s j,n; µ s ) c s,1 β}. Then (22) Rn,α = q s=1 C s,n, α q with Cs,n,β, U s,n,β given by (20)-(21) is a region of approximately at least 100(1 α)% confidence for µ j k. The coverage error is of order O p (n 2 ). 3.2 Neighborhood hypothesis test for the mean change Ellingson el. al. [5] derived the one-sample neighborhood hypothesis testing methodology. Let M 0 be a compact submanifold of M. Let ϕ 0 : M R be the distance function (23) ϕ 0 (p) = min p 0 M 0 j(p) j(p 0 ) 2, and let M δ 0, B δ 0 be given respectively by (24) M δ 0 = {p M, ϕ 0 (p) < δ 2 }, 9

10 (25) B δ 0 = {p M, ϕ 0 (p) = δ 2 }. The neighborhood null and alternative hypothesis test is (26) H δ : µ E M δ 0 B δ,x 0, A δ : µ E (M δ 0 ) c (B δ,x 0 ) c. For v j(p (H)), tan(v) is the tangential component of v with respect to the basis e a (P j (µ)). Consider the neighborhood hypothesis testing for the particular situation in which the submanifold M 0 consists of a point m 0 on M. Set ϕ 0 = ϕ m0, there is the asymptotic distribution THEOREM 3.1. If M 0 = {m 0 }, the test statistic for the hypotheses specified in (26) has an asymptotically standard normal distribution and is given by: (27) T n = n{ϕ m0 (ˆµ E ) δ 2 }/s n, where (28) s 2 n = 4 ˆν, S E,nˆν and (29) S E,n = 1 n (tanˆ µ n d P j(x) j (j(x i ) j(x) n n )) i=1 (tanˆ µ d j(x) n P j (j(x i ) j(x) n )) is the extrinsic sample covariance operator for {X i } n i=1, and (30) ˆν = (dˆµe,n j) 1 tan j(ˆµe,n )(j(m 0 ) j(ˆµ E,n )). Here tan(v) is the tangential component of v H with respect to the othobasis e a (P j (µ)) a = 1, 2,..., as (31) tan(v) = (e a (P j (µ)) v)e a (P j (µ)). a=1 And for each element of S E,n, we could compute it by (32) S E,n,ab = 1 n (d2 1 d 2 a) 1 (d 2 1 d 2 b) 1 < e a, γ r >< e b, γ r > < e 1, γ r > 2, r=1 10

11 then s n is obtained by (33) s 2 n = 4 S E,n,abˆv aˆv b. a,b=2 By plugging S E,n (by (32)) and s n (by (33)) in T n from (27), one could obtain the rejection criterion for µ 0. In order to take the advantages of this one-sample neighborhood hypothesis testing method, we test if two matched pair r.o. are similar by testing their random change. Similarly to section 3.1, we suppose X and Y are paired r.o. s on the infinite dimensional Lie group, which is also a Hilbert manifold. The change from X to Y was defined to be r. o. C = X 1 Y. Let µ E be the extrinsic mean of C, then M 0 = {m 0 } is the identity {1 G } = {([0 : 0 : 0 : 1] T,..., ([0 : 0 : 0 : 1] T )}. Here, for the statistic T n, (34) s 2 n = 4 ˆν, G nˆν, (35) n G n(s,a)(t,b) = n 1 (d s (m+1) d s (a)) 1 (d t (m+1) d t (b)) 1 (g s (a) T Xr s )(g t (b) T Xr)(g t s (m+1) T Xr s )(g t (m+1) T Xr), t where s, t = 1,..., q; a, b = 1,..., m, and r=1 (36) ˆν = (dˆµe,n j) 1 tan j(ˆµe,n )(j(m 0 ) j(ˆµ E,n )). We perform the confidence region through nonparametric nonpivotal bootstrap (Efron (1979)[13]). The nonparametric bootstrap algorithm for constructing a confidence region for extrinsic mean contour is given by Qiu el. al. [14]. Algorithm 3.1. INPUT x: the normalized coordinates of the contours (x is k n complex matrix ); k: number of matched points on contours ; n: number of contours(columns); N: number of bootstraps OUTPUT CR: confidence region Step 1 Compute extrinsic mean of x For i=1:n X i = x i x i 11

12 End X = sum(x)/n µ V W = eigenvector corresponds to the largest eigenvalue of X Step 2 Bootstrap For j=1:n u 1,..., u n = random integer uniform(1,n) y 1:n = x u1,..., x un For i=1:n End Y i = y i y i Ȳ = sum(y )/n µ BV W =eigenvector corresponds to the largest eigenvalue of Ȳ φ BV W =real part of trace((ȳ X)(Ȳ X) T ) End cutoff=95%quantile of φ CR={µ BV W, µ BV W 0 (φ BV W > cutoff) µ BV W, j = 1,..., N} 4 Testing the mean change of two group of images from leaves There are two leaves from the same tree, named as leaf A and leaf B. 20 pictures for each of them are taking from different directions. We are interested in applying the neighborhood hypothesis testing methodology to those images. It is difficult for people to pair the infinite number landmarks by hand. Ellingson el. al. [5] established the algorithm to automatically pair the landmarks along the contour of an object. Following up their work, we are able to obtain 12

13 Figure 1: Leaf A (top 20 figures) and leaf B (bottom 20 figures). Figure 2: Leaf A contours parameterized (top 20 figures) and leaf B contours parameterized (bottom 20 figures). the 1200 paired landmarks for the contour of each leaf. With these 1200 paired landmarks acquired from each leaf images, we applied the 3D projective reconstruction to each two landmark sets obtained from the same leaf. Taking the computation cost into consideration, only 50 randomly selected landmarks (Figure 4) from the D projected reconstructed landmarks are utilized to make the hypothesis test. And before the test, those 50 landmarks are firstly projective transformed with respect to the projective frame. Under the significant level α = 0.05, the minimum Figure 3: Leaf A 3D reconstruction (top 10 figures) and leaf B 3D reconstruction (bottom 10 figures). 13

14 Figure 4: The 50 randomly selected landmarks (red dots). Figure 5: Significant level α vs δ. δ for the test to be significant is , which is quite large taking into account the diameter of the sample space is no more than 2. Figure 5 illustrates how the value of δ changes associated with the decreasing of α, which implies that if we want the type I error to be small, we have to make a loose null hypothesis. The bootstrap confidence region for the extrinsic mean of the random change of 50 landmarks is displayed in Figure 6. The null hypothesis is that the extrinsic mean of the random change of the two data set is close to the identity ([0 : 0 : 0 : 1] T,..., [0 : 0 : 0 : 1] T ), whose affine coordinate is ((0, 0, 0) T,..., (0, 0, 0) T ). The range of the confidence region is very large, which indicates that the two leaves are different. References [1] M. Crane; V. Patrangenaru. (2011). Random Change on a Lie Group and Mean Glaucomatous Projective Shape Change Detection From Stereo Pair Image. Journal of Multivariate Analysis. 102,

15 Figure 6: Bootstrap confidence region for the extrinsic mean of the random change. [2] Munk, A.; Paige, R.; Pang, J. ; Patrangenaru, V. and Ruymgaart, F. H.(2008). The One and Multisample Problem for Functional Data with Applications to Projective Shape Analysis. J. of Multivariate Anal.. 99, [3] Hartley, R. I. (1994). Projective reconstruction and invariants from multiple images. Pattern Analysis and Machine Intelligence, IEEE Transactions on, 16(10), [4] Ma, Y., Soatto, S., Kosecka, J. and Sastry, S.S. (2006). An Invitation to 3-D Vision, Springer, New York. [5] Ellingson, L., Patrangenaru, V., and Ruymgaart, F. (2013). Nonparametric estimation of means on Hilbert manifolds and extrinsic analysis of mean shapes of contours. Journal of Multivariate Analysis, 122, [6] Mardia, K. V.; Patrangenaru, V. (2005). Directions and projective shapes. The Annals of Statistics, 33, [7] Hartley, R.I. and Zisserman A. (2004). Multiple view Geometry in computer vision,; 2 edition Cambridge University Press. [8] Patrangenaru, V; Liu, X. and Sugathadasa, S. (2010). Nonparametric 3D Projective Shape Estimation from Pairs of 2D Images - I, In Memory of W.P. Dayawansa. Journal of Multivariate Analysis. 101,

16 [9] Bhattacharya, R.; Patrangenaru, V. (2003). Large sample theory of intrinsic and extrinsic sample means on manifolds. I. Annals of statistics,31, [10] Bhattacharya, R.; Patrangenaru, V. (2005). Large sample theory of intrinsic and extrinsic sample means on manifolds. II. Annals of statistics,33, [11] Spivak, M. (2005). A comprehensive introduction to differential geometry, Volume I, Third Edition, Publish or perish, Berkeley. [12] Patrangenaru, V., Qiu, M., and Buibas, M. (2014). Two Sample Tests for Mean 3D Projective Shapes from Digital Camera Images. Methodology and Computing in Applied Probability, 16(2), [13] Efron, B. (1979) Bootstrap methods: another look at the jackknife. Ann. Statist. 7, [14] Qiu, M., Patrangenaru, V., Ellingson, L. (2014) How far is the Corpus Callosum of an Average Individual from Albert Einstein s? COMPSTAT 2014, Geneva 16

Illustrations of 3D Projective Shape Reconstructions from Digital Camera Images

Illustrations of 3D Projective Shape Reconstructions from Digital Camera Images Illustrations of 3D Projective Shape Reconstructions from Digital Camera Images Daniel E. Osborne Vic Patrangenaru Chayanne Burey Abstract In the past twenty years, digital images have increasingly becoming

More information

Projective Shape Analysis in Face Recognition from Digital Camera ImagesApril 19 th, / 32

Projective Shape Analysis in Face Recognition from Digital Camera ImagesApril 19 th, / 32 3D Projective Shape Analysis in Face Recognition from Digital Camera Images Seunghee Choi Florida State University, Department of Statistics April 19 th, 2018 Projective Shape Analysis in Face Recognition

More information

Two Sample Tests for Mean 3D Projective Shapes from Digital Camera Images

Two Sample Tests for Mean 3D Projective Shapes from Digital Camera Images Methodol Comput Appl Probab (4) 6:485 56 DOI.7/s9-3-9363-6 Two Sample Tests for Mean 3D Projective Shapes from Digital Camera Images Vic Patrangenaru Mingfei Qiu Marius Buibas Received: 4 July / Revised:

More information

ECE 470: Homework 5. Due Tuesday, October 27 in Seth Hutchinson. Luke A. Wendt

ECE 470: Homework 5. Due Tuesday, October 27 in Seth Hutchinson. Luke A. Wendt ECE 47: Homework 5 Due Tuesday, October 7 in class @:3pm Seth Hutchinson Luke A Wendt ECE 47 : Homework 5 Consider a camera with focal length λ = Suppose the optical axis of the camera is aligned with

More information

Two-view geometry Computer Vision Spring 2018, Lecture 10

Two-view geometry Computer Vision Spring 2018, Lecture 10 Two-view geometry http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 10 Course announcements Homework 2 is due on February 23 rd. - Any questions about the homework? - How many of

More information

Computer Vision Projective Geometry and Calibration. Pinhole cameras

Computer Vision Projective Geometry and Calibration. Pinhole cameras Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole

More information

Descriptive Geometry Meets Computer Vision The Geometry of Two Images (# 82)

Descriptive Geometry Meets Computer Vision The Geometry of Two Images (# 82) Descriptive Geometry Meets Computer Vision The Geometry of Two Images (# 8) Hellmuth Stachel stachel@dmg.tuwien.ac.at http://www.geometrie.tuwien.ac.at/stachel th International Conference on Geometry and

More information

Visual Recognition: Image Formation

Visual Recognition: Image Formation Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know

More information

Stereo Vision. MAN-522 Computer Vision

Stereo Vision. MAN-522 Computer Vision Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in

More information

3D Geometry and Camera Calibration

3D Geometry and Camera Calibration 3D Geometry and Camera Calibration 3D Coordinate Systems Right-handed vs. left-handed x x y z z y 2D Coordinate Systems 3D Geometry Basics y axis up vs. y axis down Origin at center vs. corner Will often

More information

Camera Calibration Using Line Correspondences

Camera Calibration Using Line Correspondences Camera Calibration Using Line Correspondences Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Ph: (518)-387-7333 Fax: (518)-387-6845 Email : hartley@crd.ge.com Abstract In this paper, a method of

More information

The Geometry Behind the Numerical Reconstruction of Two Photos

The Geometry Behind the Numerical Reconstruction of Two Photos The Geometry Behind the Numerical Reconstruction of Two Photos Hellmuth Stachel stachel@dmg.tuwien.ac.at http://www.geometrie.tuwien.ac.at/stachel ICEGD 2007, The 2 nd Internat. Conf. on Eng g Graphics

More information

Week 2: Two-View Geometry. Padua Summer 08 Frank Dellaert

Week 2: Two-View Geometry. Padua Summer 08 Frank Dellaert Week 2: Two-View Geometry Padua Summer 08 Frank Dellaert Mosaicking Outline 2D Transformation Hierarchy RANSAC Triangulation of 3D Points Cameras Triangulation via SVD Automatic Correspondence Essential

More information

Stereo and Epipolar geometry

Stereo and Epipolar geometry Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka

More information

Math 734 Aug 22, Differential Geometry Fall 2002, USC

Math 734 Aug 22, Differential Geometry Fall 2002, USC Math 734 Aug 22, 2002 1 Differential Geometry Fall 2002, USC Lecture Notes 1 1 Topological Manifolds The basic objects of study in this class are manifolds. Roughly speaking, these are objects which locally

More information

CSE 252B: Computer Vision II

CSE 252B: Computer Vision II CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribe: Sameer Agarwal LECTURE 1 Image Formation 1.1. The geometry of image formation We begin by considering the process of image formation when a

More information

Epipolar Geometry and the Essential Matrix

Epipolar Geometry and the Essential Matrix Epipolar Geometry and the Essential Matrix Carlo Tomasi The epipolar geometry of a pair of cameras expresses the fundamental relationship between any two corresponding points in the two image planes, and

More information

Geodesic and parallel models for leaf shape

Geodesic and parallel models for leaf shape Geodesic and parallel models for leaf shape Stephan F. Huckemann and Thomas Hotz Institute for Mathematical Stochastics, Georg-August Universität Göttingen 1 Introduction Since more than a decade, many

More information

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry 55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence

More information

Joint Feature Distributions for Image Correspondence. Joint Feature Distribution Matching. Motivation

Joint Feature Distributions for Image Correspondence. Joint Feature Distribution Matching. Motivation Joint Feature Distributions for Image Correspondence We need a correspondence model based on probability, not just geometry! Bill Triggs MOVI, CNRS-INRIA, Grenoble, France http://www.inrialpes.fr/movi/people/triggs

More information

calibrated coordinates Linear transformation pixel coordinates

calibrated coordinates Linear transformation pixel coordinates 1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial

More information

Mathematics of a Multiple Omni-Directional System

Mathematics of a Multiple Omni-Directional System Mathematics of a Multiple Omni-Directional System A. Torii A. Sugimoto A. Imiya, School of Science and National Institute of Institute of Media and Technology, Informatics, Information Technology, Chiba

More information

The end of affine cameras

The end of affine cameras The end of affine cameras Affine SFM revisited Epipolar geometry Two-view structure from motion Multi-view structure from motion Planches : http://www.di.ens.fr/~ponce/geomvis/lect3.pptx http://www.di.ens.fr/~ponce/geomvis/lect3.pdf

More information

Projective geometry for Computer Vision

Projective geometry for Computer Vision Department of Computer Science and Engineering IIT Delhi NIT, Rourkela March 27, 2010 Overview Pin-hole camera Why projective geometry? Reconstruction Computer vision geometry: main problems Correspondence

More information

Flexible Calibration of a Portable Structured Light System through Surface Plane

Flexible Calibration of a Portable Structured Light System through Surface Plane Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured

More information

Computer Vision Projective Geometry and Calibration. Pinhole cameras

Computer Vision Projective Geometry and Calibration. Pinhole cameras Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole

More information

CS231A Course Notes 4: Stereo Systems and Structure from Motion

CS231A Course Notes 4: Stereo Systems and Structure from Motion CS231A Course Notes 4: Stereo Systems and Structure from Motion Kenji Hata and Silvio Savarese 1 Introduction In the previous notes, we covered how adding additional viewpoints of a scene can greatly enhance

More information

A Summary of Projective Geometry

A Summary of Projective Geometry A Summary of Projective Geometry Copyright 22 Acuity Technologies Inc. In the last years a unified approach to creating D models from multiple images has been developed by Beardsley[],Hartley[4,5,9],Torr[,6]

More information

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry

55:148 Digital Image Processing Chapter 11 3D Vision, Geometry 55:148 Digital Image Processing Chapter 11 3D Vision, Geometry Topics: Basics of projective geometry Points and hyperplanes in projective space Homography Estimating homography from point correspondence

More information

Lecture 3: Camera Calibration, DLT, SVD

Lecture 3: Camera Calibration, DLT, SVD Computer Vision Lecture 3 23--28 Lecture 3: Camera Calibration, DL, SVD he Inner Parameters In this section we will introduce the inner parameters of the cameras Recall from the camera equations λx = P

More information

A GENTLE INTRODUCTION TO THE BASIC CONCEPTS OF SHAPE SPACE AND SHAPE STATISTICS

A GENTLE INTRODUCTION TO THE BASIC CONCEPTS OF SHAPE SPACE AND SHAPE STATISTICS A GENTLE INTRODUCTION TO THE BASIC CONCEPTS OF SHAPE SPACE AND SHAPE STATISTICS HEMANT D. TAGARE. Introduction. Shape is a prominent visual feature in many images. Unfortunately, the mathematical theory

More information

Geometric structures on manifolds

Geometric structures on manifolds CHAPTER 3 Geometric structures on manifolds In this chapter, we give our first examples of hyperbolic manifolds, combining ideas from the previous two chapters. 3.1. Geometric structures 3.1.1. Introductory

More information

Robot Vision: Projective Geometry

Robot Vision: Projective Geometry Robot Vision: Projective Geometry Ass.Prof. Friedrich Fraundorfer SS 2018 1 Learning goals Understand homogeneous coordinates Understand points, line, plane parameters and interpret them geometrically

More information

Agenda. Rotations. Camera models. Camera calibration. Homographies

Agenda. Rotations. Camera models. Camera calibration. Homographies Agenda Rotations Camera models Camera calibration Homographies D Rotations R Y = Z r r r r r r r r r Y Z Think of as change of basis where ri = r(i,:) are orthonormal basis vectors r rotated coordinate

More information

THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS. Alekseí Yu. Chekunov. 1. Introduction

THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS. Alekseí Yu. Chekunov. 1. Introduction MATEMATIQKI VESNIK Corrected proof Available online 01.10.2016 originalni nauqni rad research paper THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS Alekseí Yu. Chekunov Abstract. In this paper

More information

Lower bounds on the barrier parameter of convex cones

Lower bounds on the barrier parameter of convex cones of convex cones Université Grenoble 1 / CNRS June 20, 2012 / High Performance Optimization 2012, Delft Outline Logarithmically homogeneous barriers 1 Logarithmically homogeneous barriers Conic optimization

More information

CHAPTER 3 FUZZY RELATION and COMPOSITION

CHAPTER 3 FUZZY RELATION and COMPOSITION CHAPTER 3 FUZZY RELATION and COMPOSITION The concept of fuzzy set as a generalization of crisp set has been introduced in the previous chapter. Relations between elements of crisp sets can be extended

More information

Perspective Projection in Homogeneous Coordinates

Perspective Projection in Homogeneous Coordinates Perspective Projection in Homogeneous Coordinates Carlo Tomasi If standard Cartesian coordinates are used, a rigid transformation takes the form X = R(X t) and the equations of perspective projection are

More information

Structure and motion in 3D and 2D from hybrid matching constraints

Structure and motion in 3D and 2D from hybrid matching constraints Structure and motion in 3D and 2D from hybrid matching constraints Anders Heyden, Fredrik Nyberg and Ola Dahl Applied Mathematics Group Malmo University, Sweden {heyden,fredrik.nyberg,ola.dahl}@ts.mah.se

More information

CS-9645 Introduction to Computer Vision Techniques Winter 2019

CS-9645 Introduction to Computer Vision Techniques Winter 2019 Table of Contents Projective Geometry... 1 Definitions...1 Axioms of Projective Geometry... Ideal Points...3 Geometric Interpretation... 3 Fundamental Transformations of Projective Geometry... 4 The D

More information

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.

Computer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG. Computer Vision Coordinates Prof. Flávio Cardeal DECOM / CEFET- MG cardeal@decom.cefetmg.br Abstract This lecture discusses world coordinates and homogeneous coordinates, as well as provides an overview

More information

Stereo Matching for Calibrated Cameras without Correspondence

Stereo Matching for Calibrated Cameras without Correspondence Stereo Matching for Calibrated Cameras without Correspondence U. Helmke, K. Hüper, and L. Vences Department of Mathematics, University of Würzburg, 97074 Würzburg, Germany helmke@mathematik.uni-wuerzburg.de

More information

Topological properties of convex sets

Topological properties of convex sets Division of the Humanities and Social Sciences Ec 181 KC Border Convex Analysis and Economic Theory Winter 2018 Topic 5: Topological properties of convex sets 5.1 Interior and closure of convex sets Let

More information

Exponential Maps for Computer Vision

Exponential Maps for Computer Vision Exponential Maps for Computer Vision Nick Birnie School of Informatics University of Edinburgh 1 Introduction In computer vision, the exponential map is the natural generalisation of the ordinary exponential

More information

CS6670: Computer Vision

CS6670: Computer Vision CS6670: Computer Vision Noah Snavely Lecture 7: Image Alignment and Panoramas What s inside your fridge? http://www.cs.washington.edu/education/courses/cse590ss/01wi/ Projection matrix intrinsics projection

More information

3D Computer Vision II. Reminder Projective Geometry, Transformations

3D Computer Vision II. Reminder Projective Geometry, Transformations 3D Computer Vision II Reminder Projective Geometry, Transformations Nassir Navab" based on a course given at UNC by Marc Pollefeys & the book Multiple View Geometry by Hartley & Zisserman" October 21,

More information

Lecture notes for Topology MMA100

Lecture notes for Topology MMA100 Lecture notes for Topology MMA100 J A S, S-11 1 Simplicial Complexes 1.1 Affine independence A collection of points v 0, v 1,..., v n in some Euclidean space R N are affinely independent if the (affine

More information

THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS. Alekseí Yu. Chekunov. 1. Introduction

THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS. Alekseí Yu. Chekunov. 1. Introduction MATEMATIČKI VESNIK MATEMATIQKI VESNIK 69, 1 (2017), 12 22 March 2017 research paper originalni nauqni rad THE COMPUTER MODELLING OF GLUING FLAT IMAGES ALGORITHMS Alekseí Yu. Chekunov Abstract. In this

More information

Rectification and Distortion Correction

Rectification and Distortion Correction Rectification and Distortion Correction Hagen Spies March 12, 2003 Computer Vision Laboratory Department of Electrical Engineering Linköping University, Sweden Contents Distortion Correction Rectification

More information

Introduction to Homogeneous coordinates

Introduction to Homogeneous coordinates Last class we considered smooth translations and rotations of the camera coordinate system and the resulting motions of points in the image projection plane. These two transformations were expressed mathematically

More information

Computer Vision Projective Geometry and Calibration

Computer Vision Projective Geometry and Calibration Computer Vision Projective Geometry and Calibration Professor Hager http://www.cs.jhu.edu/~hager Jason Corso http://www.cs.jhu.edu/~jcorso. Pinhole cameras Abstract camera model - box with a small hole

More information

3D Reconstruction with two Calibrated Cameras

3D Reconstruction with two Calibrated Cameras 3D Reconstruction with two Calibrated Cameras Carlo Tomasi The standard reference frame for a camera C is a right-handed Cartesian frame with its origin at the center of projection of C, its positive Z

More information

Parallel and perspective projections such as used in representing 3d images.

Parallel and perspective projections such as used in representing 3d images. Chapter 5 Rotations and projections In this chapter we discuss Rotations Parallel and perspective projections such as used in representing 3d images. Using coordinates and matrices, parallel projections

More information

Point-Set Topology 1. TOPOLOGICAL SPACES AND CONTINUOUS FUNCTIONS

Point-Set Topology 1. TOPOLOGICAL SPACES AND CONTINUOUS FUNCTIONS Point-Set Topology 1. TOPOLOGICAL SPACES AND CONTINUOUS FUNCTIONS Definition 1.1. Let X be a set and T a subset of the power set P(X) of X. Then T is a topology on X if and only if all of the following

More information

Conic Duality. yyye

Conic Duality.  yyye Conic Linear Optimization and Appl. MS&E314 Lecture Note #02 1 Conic Duality Yinyu Ye Department of Management Science and Engineering Stanford University Stanford, CA 94305, U.S.A. http://www.stanford.edu/

More information

Machine vision. Summary # 11: Stereo vision and epipolar geometry. u l = λx. v l = λy

Machine vision. Summary # 11: Stereo vision and epipolar geometry. u l = λx. v l = λy 1 Machine vision Summary # 11: Stereo vision and epipolar geometry STEREO VISION The goal of stereo vision is to use two cameras to capture 3D scenes. There are two important problems in stereo vision:

More information

3D Modeling using multiple images Exam January 2008

3D Modeling using multiple images Exam January 2008 3D Modeling using multiple images Exam January 2008 All documents are allowed. Answers should be justified. The different sections below are independant. 1 3D Reconstruction A Robust Approche Consider

More information

Unit 3 Multiple View Geometry

Unit 3 Multiple View Geometry Unit 3 Multiple View Geometry Relations between images of a scene Recovering the cameras Recovering the scene structure http://www.robots.ox.ac.uk/~vgg/hzbook/hzbook1.html 3D structure from images Recover

More information

Geometric structures on manifolds

Geometric structures on manifolds CHAPTER 3 Geometric structures on manifolds In this chapter, we give our first examples of hyperbolic manifolds, combining ideas from the previous two chapters. 3.1. Geometric structures 3.1.1. Introductory

More information

Column and row space of a matrix

Column and row space of a matrix Column and row space of a matrix Recall that we can consider matrices as concatenation of rows or columns. c c 2 c 3 A = r r 2 r 3 a a 2 a 3 a 2 a 22 a 23 a 3 a 32 a 33 The space spanned by columns of

More information

Perception and Action using Multilinear Forms

Perception and Action using Multilinear Forms Perception and Action using Multilinear Forms Anders Heyden, Gunnar Sparr, Kalle Åström Dept of Mathematics, Lund University Box 118, S-221 00 Lund, Sweden email: {heyden,gunnar,kalle}@maths.lth.se Abstract

More information

Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction

Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Computer Vision I - Algorithms and Applications: Multi-View 3D reconstruction Carsten Rother 09/12/2013 Computer Vision I: Multi-View 3D reconstruction Roadmap this lecture Computer Vision I: Multi-View

More information

Orientation of manifolds - definition*

Orientation of manifolds - definition* Bulletin of the Manifold Atlas - definition (2013) Orientation of manifolds - definition* MATTHIAS KRECK 1. Zero dimensional manifolds For zero dimensional manifolds an orientation is a map from the manifold

More information

Structure from Motion

Structure from Motion Structure from Motion Outline Bundle Adjustment Ambguities in Reconstruction Affine Factorization Extensions Structure from motion Recover both 3D scene geoemetry and camera positions SLAM: Simultaneous

More information

CHAPTER 3. Single-view Geometry. 1. Consequences of Projection

CHAPTER 3. Single-view Geometry. 1. Consequences of Projection CHAPTER 3 Single-view Geometry When we open an eye or take a photograph, we see only a flattened, two-dimensional projection of the physical underlying scene. The consequences are numerous and startling.

More information

Computer Vision I Name : CSE 252A, Fall 2012 Student ID : David Kriegman Assignment #1. (Due date: 10/23/2012) x P. = z

Computer Vision I Name : CSE 252A, Fall 2012 Student ID : David Kriegman   Assignment #1. (Due date: 10/23/2012) x P. = z Computer Vision I Name : CSE 252A, Fall 202 Student ID : David Kriegman E-Mail : Assignment (Due date: 0/23/202). Perspective Projection [2pts] Consider a perspective projection where a point = z y x P

More information

An Introduction to Belyi Surfaces

An Introduction to Belyi Surfaces An Introduction to Belyi Surfaces Matthew Stevenson December 16, 2013 We outline the basic theory of Belyi surfaces, up to Belyi s theorem (1979, [1]), which characterizes these spaces as precisely those

More information

Structure from motion

Structure from motion Structure from motion Structure from motion Given a set of corresponding points in two or more images, compute the camera parameters and the 3D point coordinates?? R 1,t 1 R 2,t 2 R 3,t 3 Camera 1 Camera

More information

Computer Vision I - Appearance-based Matching and Projective Geometry

Computer Vision I - Appearance-based Matching and Projective Geometry Computer Vision I - Appearance-based Matching and Projective Geometry Carsten Rother 05/11/2015 Computer Vision I: Image Formation Process Roadmap for next four lectures Computer Vision I: Image Formation

More information

Reminder: Lecture 20: The Eight-Point Algorithm. Essential/Fundamental Matrix. E/F Matrix Summary. Computing F. Computing F from Point Matches

Reminder: Lecture 20: The Eight-Point Algorithm. Essential/Fundamental Matrix. E/F Matrix Summary. Computing F. Computing F from Point Matches Reminder: Lecture 20: The Eight-Point Algorithm F = -0.00310695-0.0025646 2.96584-0.028094-0.00771621 56.3813 13.1905-29.2007-9999.79 Readings T&V 7.3 and 7.4 Essential/Fundamental Matrix E/F Matrix Summary

More information

Vision par ordinateur

Vision par ordinateur Epipolar geometry π Vision par ordinateur Underlying structure in set of matches for rigid scenes l T 1 l 2 C1 m1 l1 e1 M L2 L1 e2 Géométrie épipolaire Fundamental matrix (x rank 2 matrix) m2 C2 l2 Frédéric

More information

Chapter 6. Curves and Surfaces. 6.1 Graphs as Surfaces

Chapter 6. Curves and Surfaces. 6.1 Graphs as Surfaces Chapter 6 Curves and Surfaces In Chapter 2 a plane is defined as the zero set of a linear function in R 3. It is expected a surface is the zero set of a differentiable function in R n. To motivate, graphs

More information

Camera calibration. Robotic vision. Ville Kyrki

Camera calibration. Robotic vision. Ville Kyrki Camera calibration Robotic vision 19.1.2017 Where are we? Images, imaging Image enhancement Feature extraction and matching Image-based tracking Camera models and calibration Pose estimation Motion analysis

More information

C / 35. C18 Computer Vision. David Murray. dwm/courses/4cv.

C / 35. C18 Computer Vision. David Murray.   dwm/courses/4cv. C18 2015 1 / 35 C18 Computer Vision David Murray david.murray@eng.ox.ac.uk www.robots.ox.ac.uk/ dwm/courses/4cv Michaelmas 2015 C18 2015 2 / 35 Computer Vision: This time... 1. Introduction; imaging geometry;

More information

Don t just read it; fight it! Ask your own questions, look for your own examples, discover your own proofs. Is the hypothesis necessary?

Don t just read it; fight it! Ask your own questions, look for your own examples, discover your own proofs. Is the hypothesis necessary? Don t just read it; fight it! Ask your own questions, look for your own examples, discover your own proofs. Is the hypothesis necessary? Is the converse true? What happens in the classical special case?

More information

Mosaics Construction from a Sparse Set of Views

Mosaics Construction from a Sparse Set of Views Mosaics Construction from a Sparse Set of Views W. Zhang, J. kosecka and F. Li Abstract In this paper we describe a flexible approach for constructing mosaics of architectural environments from a sparse

More information

To do this the end effector of the robot must be correctly positioned relative to the work piece.

To do this the end effector of the robot must be correctly positioned relative to the work piece. Spatial Descriptions and Transformations typical robotic task is to grasp a work piece supplied by a conveyer belt or similar mechanism in an automated manufacturing environment, transfer it to a new position

More information

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS

METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS M. Lefler, H. Hel-Or Dept. of CS, University of Haifa, Israel Y. Hel-Or School of CS, IDC, Herzliya, Israel ABSTRACT Video analysis often requires

More information

CLASSIFICATION OF SURFACES

CLASSIFICATION OF SURFACES CLASSIFICATION OF SURFACES JUSTIN HUANG Abstract. We will classify compact, connected surfaces into three classes: the sphere, the connected sum of tori, and the connected sum of projective planes. Contents

More information

Parameterization of triangular meshes

Parameterization of triangular meshes Parameterization of triangular meshes Michael S. Floater November 10, 2009 Triangular meshes are often used to represent surfaces, at least initially, one reason being that meshes are relatively easy to

More information

Announcements. Stereo

Announcements. Stereo Announcements Stereo Homework 2 is due today, 11:59 PM Homework 3 will be assigned today Reading: Chapter 7: Stereopsis CSE 152 Lecture 8 Binocular Stereopsis: Mars Given two images of a scene where relative

More information

Assignment 2 : Projection and Homography

Assignment 2 : Projection and Homography TECHNISCHE UNIVERSITÄT DRESDEN EINFÜHRUNGSPRAKTIKUM COMPUTER VISION Assignment 2 : Projection and Homography Hassan Abu Alhaija November 7,204 INTRODUCTION In this exercise session we will get a hands-on

More information

Introduction to Computer Vision

Introduction to Computer Vision Introduction to Computer Vision Michael J. Black Nov 2009 Perspective projection and affine motion Goals Today Perspective projection 3D motion Wed Projects Friday Regularization and robust statistics

More information

Midterm Exam Solutions

Midterm Exam Solutions Midterm Exam Solutions Computer Vision (J. Košecká) October 27, 2009 HONOR SYSTEM: This examination is strictly individual. You are not allowed to talk, discuss, exchange solutions, etc., with other fellow

More information

Coplanar circles, quasi-affine invariance and calibration

Coplanar circles, quasi-affine invariance and calibration Image and Vision Computing 24 (2006) 319 326 www.elsevier.com/locate/imavis Coplanar circles, quasi-affine invariance and calibration Yihong Wu *, Xinju Li, Fuchao Wu, Zhanyi Hu National Laboratory of

More information

MAT 3271: Selected Solutions to the Assignment 6

MAT 3271: Selected Solutions to the Assignment 6 Chapter 2: Major Exercises MAT 3271: Selected Solutions to the Assignment 6 1. Since a projective plan is a model of incidence geometry, Incidence Axioms 1-3 and Propositions 2.1-2.5 (which follow logically

More information

MA651 Topology. Lecture 4. Topological spaces 2

MA651 Topology. Lecture 4. Topological spaces 2 MA651 Topology. Lecture 4. Topological spaces 2 This text is based on the following books: Linear Algebra and Analysis by Marc Zamansky Topology by James Dugundgji Fundamental concepts of topology by Peter

More information

Autonomous Navigation for Flying Robots

Autonomous Navigation for Flying Robots Computer Vision Group Prof. Daniel Cremers Autonomous Navigation for Flying Robots Lecture 3.1: 3D Geometry Jürgen Sturm Technische Universität München Points in 3D 3D point Augmented vector Homogeneous

More information

Topic: Orientation, Surfaces, and Euler characteristic

Topic: Orientation, Surfaces, and Euler characteristic Topic: Orientation, Surfaces, and Euler characteristic The material in these notes is motivated by Chapter 2 of Cromwell. A source I used for smooth manifolds is do Carmo s Riemannian Geometry. Ideas of

More information

Agenda. Rotations. Camera calibration. Homography. Ransac

Agenda. Rotations. Camera calibration. Homography. Ransac Agenda Rotations Camera calibration Homography Ransac Geometric Transformations y x Transformation Matrix # DoF Preserves Icon translation rigid (Euclidean) similarity affine projective h I t h R t h sr

More information

Euclidean Space. Definition 1 (Euclidean Space) A Euclidean space is a finite-dimensional vector space over the reals R, with an inner product,.

Euclidean Space. Definition 1 (Euclidean Space) A Euclidean space is a finite-dimensional vector space over the reals R, with an inner product,. Definition 1 () A Euclidean space is a finite-dimensional vector space over the reals R, with an inner product,. 1 Inner Product Definition 2 (Inner Product) An inner product, on a real vector space X

More information

Dubna 2018: lines on cubic surfaces

Dubna 2018: lines on cubic surfaces Dubna 2018: lines on cubic surfaces Ivan Cheltsov 20th July 2018 Lecture 1: projective plane Complex plane Definition A line in C 2 is a subset that is given by ax + by + c = 0 for some complex numbers

More information

Fano varieties and polytopes

Fano varieties and polytopes Fano varieties and polytopes Olivier DEBARRE The Fano Conference Torino, September 29 October 5, 2002 Smooth Fano varieties A smooth Fano variety (over a fixed algebraically closed field k) is a smooth

More information

Image warping , , Computational Photography Fall 2017, Lecture 10

Image warping , , Computational Photography Fall 2017, Lecture 10 Image warping http://graphics.cs.cmu.edu/courses/15-463 15-463, 15-663, 15-862 Computational Photography Fall 2017, Lecture 10 Course announcements Second make-up lecture on Friday, October 6 th, noon-1:30

More information

Stereo Image Rectification for Simple Panoramic Image Generation

Stereo Image Rectification for Simple Panoramic Image Generation Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,

More information

Camera Model and Calibration

Camera Model and Calibration Camera Model and Calibration Lecture-10 Camera Calibration Determine extrinsic and intrinsic parameters of camera Extrinsic 3D location and orientation of camera Intrinsic Focal length The size of the

More information

Hand-Eye Calibration from Image Derivatives

Hand-Eye Calibration from Image Derivatives Hand-Eye Calibration from Image Derivatives Abstract In this paper it is shown how to perform hand-eye calibration using only the normal flow field and knowledge about the motion of the hand. The proposed

More information

Introduction to Computational Manifolds and Applications

Introduction to Computational Manifolds and Applications IMPA - Instituto de Matemática Pura e Aplicada, Rio de Janeiro, RJ, Brazil Introduction to Computational Manifolds and Applications Part 1 - Foundations Prof. Jean Gallier jean@cis.upenn.edu Department

More information

Self-calibration of a pair of stereo cameras in general position

Self-calibration of a pair of stereo cameras in general position Self-calibration of a pair of stereo cameras in general position Raúl Rojas Institut für Informatik Freie Universität Berlin Takustr. 9, 14195 Berlin, Germany Abstract. This paper shows that it is possible

More information

Recovering structure from a single view Pinhole perspective projection

Recovering structure from a single view Pinhole perspective projection EPIPOLAR GEOMETRY The slides are from several sources through James Hays (Brown); Silvio Savarese (U. of Michigan); Svetlana Lazebnik (U. Illinois); Bill Freeman and Antonio Torralba (MIT), including their

More information