Illustrations of 3D Projective Shape Reconstructions from Digital Camera Images
|
|
- Berenice Fletcher
- 6 years ago
- Views:
Transcription
1 Illustrations of 3D Projective Shape Reconstructions from Digital Camera Images Daniel E. Osborne Vic Patrangenaru Chayanne Burey Abstract In the past twenty years, digital images have increasingly becoming more accessible due to the technological advancements of computers, cellular phones, and digital cameras. Stereo cameras historically were used to simulate human binocular vision. A stereo camera is a type of camera with two or more lenses with a separate image sensor or film frame for each lens. This feature gave stereo cameras the ability to capture three-dimensional images. Human vision and pinhole camera image acquisition are based on a central projection principle. Moreover, two or more images of the same planar scene, in pixel coordinates, acquired by an ideal pinhole digital camera differ by a projective transformation of R 2. In this work, we illustrate some advantages of using two or more images of the same 3D scene for retrieval of the spatial information. This includes capturing the visual shape and texture of the object in the same 3D scene of images. All images were acquired using a basic digital camera. We conclude by outlying an estimation methodology in 3D Projective Shape Analysis problem for estimating the mean projective shapes of k-ads in general position in 3D. Key Words: 1. Introduction Surfaces are commonly found in nature as boundaries of ever-changing 3D scenes. Often time surfaces of interest are studied based on their images in face and object recognition. Collecting 3D surface data used to be a challenging task though, given that the output of a digital camera image, the widest spread type of imaging, is recorded on a flat surface, thus distorting most of the parts of the scene pictured, even in absence of occlusions. The first results in collecting 3D data on the cheap, from digital camera images were due to Longuet- Higgins [9], Faugeras [4], Hartley, Gupta and Chang [7] and others. These results, pointing to the idea that one may reconstruct a 3D scene, up to a 3D projective transformation, led Patrangenaru et. al. (see [17]) to the conclusion that all we see are 3D projective shapes. The 3D reconstruction methodology is summarized in a Computer Vision eight point algorithm given by Hartley and Zisserman ( see [8], [10] ). The problem of the 3D reconstruction of a configuration of points in 3D from two ideal uncalibrated camera images with unknown camera parameters, is equivalent to the following: given two camera images in RP1 2, RP 2 2 of unknown relative position and internal camera parameters and two matching sets of labeled points {p a,1,..., p a,k } RPa 2, a = 1, 2, find all the sets of points in the 3D space p 1,..., p k in such that there exist two positions of the planes RP1 2, RP 2 2 and internal parameters of the two cameras c a, a = 1, 2 with the property that the c a -image of p j is p a,j, a = 1, 2, j = 1,..., k. Department of Mathematics, Florida Agriculture and Mechanical University, Tallahassee, FL Department of Statistics, Florida State University, Tallahassee, FL Department of Mathematics & FAMU-FSU College of Engineering, Florida A&M University, Tallahassee, FL 32307
2 In absence of registration errors, in the uncalibrated case, the solution to the reconstruction problem unique up to a projective transformation (see Faugeras[4] and Hartley et. al. [7]). DEFINITION 1.1. Two sets of labeled points {p a,1,..., p a,k } RP 3 a, a = 1, 2, have the same projective shape if there is a projective transformation β : RP 3 RP 3, such that β(p 1,j ) = p 1,j, j = 1,... k. The reconstruction algorithm was therefore reformulated as follows by Sughatadasa [19] and by Patrangenaru et al. [18]: THEOREM 1.1. In absence of occlusions, any two 3D reconstructed configurations R, R obtained from a pair of 2D matched configurations in uncalibrated cameras images of a 3D configuration C, have the same projective shape. Note that the solution of the reconstruction problem, from a pair of 2D images depends on a landmark correspondence. So the key step in the reconstruction is finding the matched point configurations in the images. This in turn can be achieved easier if we use colored images, since the desired matching can be achieved if the two (or more) images are taken under the same illumination conditions, and then unlabeled points are matched via an RGB - correlation algorithm. Once the configurations are matched, one may attach at each reconstructed point in the resulting point cloud, the average RGB vectors at the corresponding points in the original images of the given scene. Such examples of 3D reconstructions with textures are given in Section Examples of 3D surface data collection In this section we give four examples of multiple images of 3D scenes and, separately, 3D reconstruction of the surfaces of these scenes, including textures. Figure 1: Images of art object by ceramic sculptor James Tanner. Figure 2: 3D reconstruction of art object by James Tanner. Figure 3: Images of porcelain tigers figurine. 2.1 Projective frames and projective shapes A mechanism for quantifying the projective shape data retrieved from images is given briefly in this section. Computations are left for a follow-up undergraduate project. A projective frame in RP 3 is an ordered 5-tuple of points π = (p 1,..., p 5 ), any 4 of which are in general position. The standard projective frame π 0 is the projective frame associated
3 Figure 4: 3D reconstruction of porcelain tigers figurine. Figure 5: Images of basket with solid balls. with the standard vector basis e = (e 1,..., e 4 ), of R 4, in this case π 0 = (p 0,1,..., p 0,4 ), where p 0,j = [e j ], j = 1,..., 4, and p 0,5 = [e e 4 ]. Note that since the action of a projective transformation is uniquely determined by its action on a projective frame (see Mardia and Patrangenaru [12]), given a point p RP m, its projective coordinates p π w.r.t. a projective frame π = (p 1,..., p 5 ) are defined as the image of p under the projective transformation that takes π to π 0. The projective coordinates of a point on the projective space w.r.t. a projective frame, as well as their equations, in terms of the coordinates of the projective frame are given in Patrangenaru [16], Mardia and Patrangenaru [12], Munk et. al.[14], or Patrangenaru et. al.[18]. Such projective coordinates are instrumental in the projective shape analysis of the scenes pictured. Acknowledgements V. Patrangenaru thanks and acknowledges FSU for travel support, and Vlad Patrangenaru for his help with searching for the reconstruction sofware Agisoft. The authors are grateful to the organizers of the 2017 JSM program. D. Osborne and V. Patrangenaru applaud Ms. Chayanne Burey efforts on this project as an Undergraduate Research Assistant. References [1] R. N. Bhattacharya, L. Ellingson, X. Liu and V. Patrangenaru and M. Crane (2012). Extrinsic Analysis on Manifolds is Computationally Faster than Intrinsic Analysis, with Applications to Quality Control by Machine Vision. Applied Stochastic Models in Business and Industry. 28, [2] M. Buibas, M. Crane, L. Ellingson and V. Patrangenaru (2012). A Projective Frame Based Shape Analysis of a Rigid Scene from Noncalibrated Digital Camera Imaging Outputs. In JSM Proceedings, 2011, Miami, FL. Institute of Mathematical Statistics, pp [3] M. Crane; V. Patrangenaru. (2011). Random Change on a Lie Group and Mean Glaucomatous Projective Shape Change Detection From Stereo Pair Image. Journal of Multivariate Analysis. 102, [4] Faugeras O. D. (1992) What can be seen in three dimensions with an uncalibrated stereo rig? In Proc. European Conference on Computer Vision, LNCS 588 pp [5] Ma, Y., Soatto, S., Kosecka, J. and Sastry, S.S. (2006). An Invitation to 3-D Vision, Springer, New York.
4 Figure 6: 3D reconstruction of basket with solid balls. Figure 7: Images of basket with flowers. [6] Goodall,C. and Mardia, K.V. (1999). Projective shape analysis, J. Graphical & Computational Statist., 8, [7] Hartley, R. I. ; Gupta R. ; and Chang T. (1992). Stereo from uncalibrated cameras, in Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp [8] Hartley, R.I. and Zisserman A. (2004). Multiple view Geometry in computer vision,; 2 edition Cambridge University Press. [9] Longuet-Higgins C. (1981). A computer algorithm for reconstructing a scene from two projections, Nature, bf 293, [10] Ma, Y., Soatto, S., Kosecka, J. and Sastry, S.S. (2006). An Invitation to 3-D Vision, Springer, New York. [11] Mardia, K. V.; Goodall, Colin; Walder, Alistair. (1996). Distributions of projective invariants and model-based machine vision. Adv. in Appl. Probab.28, [12] K. V. Mardia and V. Patrangenaru (2005). Directions and Projective Shapes. Annals of Statistics 33, [13] K.V.Mardia, V. Patrangenaru, G. Derado and V. P. Patrangenaru (2003). Reconstruction of Planar Scenes from Multiple Views Using Affine and Projective Shape. In Proceedings of the 2003 Workshop on Statistical Signal Processing [14] Munk, A.; Paige, R.; Pang, J. ; Patrangenaru, V. and Ruymgaart, F. H.(2008). The One and Multisample Problem for Functional Data with Applications to Projective Shape Analysis. J. of Multivariate Anal.. 99, [15] Patrangenaru, V. (1999) Moving projective frames and spatial scene identification, in Proceedings in Spatial-Temporal Modeling and Applications, Edited by K. V. Mardia, R. G. Aykroyd and I.L. Dryden, Leeds University Press, p [16] Patrangenaru, V. (2001). New Large Sample and Bootstrap Methods on Shape Spaces in High Level Analysis of Natural Images. Communications in Statistics Theory and Methods [17] V. Patrangenaru, M. A. Crane, X. Liu, X. Descombes, G. Derado, W. Liu, V. Balan, V. P. Patrangenaru, H. W. Thompson (2012). Methodology for 3D Scene Reconstruction from Digital Camera Images. Proceedings of the International Conference of Differential Geometry and Dynamical Systems (DGDS-2011) October 6-9, 2011, Bucharest, Romania - BSG Proceedings 19,
5 Figure 8: 3D reconstruction of basket with flowers. [18] Patrangenaru, V; Liu, X. and Sugathadasa, S. (2010). Nonparametric 3D Projective Shape Estimation from Pairs of 2D Images - I, In Memory of W.P. Dayawansa. Journal of Multivariate Analysis. 101, [19] Sughatadasa, S. M. (2006) Affine and Projective Shape Analysis with Applications, Ph.D. Dissertation, Texas Tech Univesity.
Neighborhood Hypothesis Testing for Mean Change on Infinite. Dimensional Lie Groups and 3D Projective Shape Analysis of. Contours
Neighborhood Hypothesis Testing for Mean Change on Infinite Dimensional Lie Groups and 3D Projective Shape Analysis of Contours Vic Patrangenaru, Mingfei Qiu Department of Statistics, Florida State University
More informationTwo Sample Tests for Mean 3D Projective Shapes from Digital Camera Images
Methodol Comput Appl Probab (4) 6:485 56 DOI.7/s9-3-9363-6 Two Sample Tests for Mean 3D Projective Shapes from Digital Camera Images Vic Patrangenaru Mingfei Qiu Marius Buibas Received: 4 July / Revised:
More informationProjective Shape Analysis in Face Recognition from Digital Camera ImagesApril 19 th, / 32
3D Projective Shape Analysis in Face Recognition from Digital Camera Images Seunghee Choi Florida State University, Department of Statistics April 19 th, 2018 Projective Shape Analysis in Face Recognition
More informationCamera Calibration Using Line Correspondences
Camera Calibration Using Line Correspondences Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Ph: (518)-387-7333 Fax: (518)-387-6845 Email : hartley@crd.ge.com Abstract In this paper, a method of
More informationStructure and motion in 3D and 2D from hybrid matching constraints
Structure and motion in 3D and 2D from hybrid matching constraints Anders Heyden, Fredrik Nyberg and Ola Dahl Applied Mathematics Group Malmo University, Sweden {heyden,fredrik.nyberg,ola.dahl}@ts.mah.se
More informationComputer Vision Lecture 17
Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester
More informationComputer Vision Lecture 17
Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationPlanar pattern for automatic camera calibration
Planar pattern for automatic camera calibration Beiwei Zhang Y. F. Li City University of Hong Kong Department of Manufacturing Engineering and Engineering Management Kowloon, Hong Kong Fu-Chao Wu Institute
More informationSelf-calibration of a pair of stereo cameras in general position
Self-calibration of a pair of stereo cameras in general position Raúl Rojas Institut für Informatik Freie Universität Berlin Takustr. 9, 14195 Berlin, Germany Abstract. This paper shows that it is possible
More informationStereo Vision. MAN-522 Computer Vision
Stereo Vision MAN-522 Computer Vision What is the goal of stereo vision? The recovery of the 3D structure of a scene using two or more images of the 3D scene, each acquired from a different viewpoint in
More informationThree-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner
Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner F. B. Djupkep Dizeu, S. Hesabi, D. Laurendeau, A. Bendada Computer Vision and
More informationResearch on an Adaptive Terrain Reconstruction of Sequence Images in Deep Space Exploration
, pp.33-41 http://dx.doi.org/10.14257/astl.2014.52.07 Research on an Adaptive Terrain Reconstruction of Sequence Images in Deep Space Exploration Wang Wei, Zhao Wenbin, Zhao Zhengxu School of Information
More informationStereo and Epipolar geometry
Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka
More informationStereo. 11/02/2012 CS129, Brown James Hays. Slides by Kristen Grauman
Stereo 11/02/2012 CS129, Brown James Hays Slides by Kristen Grauman Multiple views Multi-view geometry, matching, invariant features, stereo vision Lowe Hartley and Zisserman Why multiple views? Structure
More informationMERGING POINT CLOUDS FROM MULTIPLE KINECTS. Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia
MERGING POINT CLOUDS FROM MULTIPLE KINECTS Nishant Rai 13th July, 2016 CARIS Lab University of British Columbia Introduction What do we want to do? : Use information (point clouds) from multiple (2+) Kinects
More informationA Real-Time Catadioptric Stereo System Using Planar Mirrors
A Real-Time Catadioptric Stereo System Using Planar Mirrors Joshua Gluckman Shree K. Nayar Department of Computer Science Columbia University New York, NY 10027 Abstract By using mirror reflections of
More informationStereo Image Rectification for Simple Panoramic Image Generation
Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,
More informationLecture 9: Epipolar Geometry
Lecture 9: Epipolar Geometry Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Why is stereo useful? Epipolar constraints Essential and fundamental matrix Estimating F (Problem Set 2
More informationA COMPREHENSIVE TOOL FOR RECOVERING 3D MODELS FROM 2D PHOTOS WITH WIDE BASELINES
A COMPREHENSIVE TOOL FOR RECOVERING 3D MODELS FROM 2D PHOTOS WITH WIDE BASELINES Yuzhu Lu Shana Smith Virtual Reality Applications Center, Human Computer Interaction Program, Iowa State University, Ames,
More informationRecap: Features and filters. Recap: Grouping & fitting. Now: Multiple views 10/29/2008. Epipolar geometry & stereo vision. Why multiple views?
Recap: Features and filters Epipolar geometry & stereo vision Tuesday, Oct 21 Kristen Grauman UT-Austin Transforming and describing images; textures, colors, edges Recap: Grouping & fitting Now: Multiple
More informationA General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras
A General Expression of the Fundamental Matrix for Both Perspective and Affine Cameras Zhengyou Zhang* ATR Human Information Processing Res. Lab. 2-2 Hikari-dai, Seika-cho, Soraku-gun Kyoto 619-02 Japan
More informationGeodesic and parallel models for leaf shape
Geodesic and parallel models for leaf shape Stephan F. Huckemann and Thomas Hotz Institute for Mathematical Stochastics, Georg-August Universität Göttingen 1 Introduction Since more than a decade, many
More informationToday. Stereo (two view) reconstruction. Multiview geometry. Today. Multiview geometry. Computational Photography
Computational Photography Matthias Zwicker University of Bern Fall 2009 Today From 2D to 3D using multiple views Introduction Geometry of two views Stereo matching Other applications Multiview geometry
More informationComputer Vision. Coordinates. Prof. Flávio Cardeal DECOM / CEFET- MG.
Computer Vision Coordinates Prof. Flávio Cardeal DECOM / CEFET- MG cardeal@decom.cefetmg.br Abstract This lecture discusses world coordinates and homogeneous coordinates, as well as provides an overview
More informationEpipolar Geometry in Stereo, Motion and Object Recognition
Epipolar Geometry in Stereo, Motion and Object Recognition A Unified Approach by GangXu Department of Computer Science, Ritsumeikan University, Kusatsu, Japan and Zhengyou Zhang INRIA Sophia-Antipolis,
More informationDepth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth
Common Classification Tasks Recognition of individual objects/faces Analyze object-specific features (e.g., key points) Train with images from different viewing angles Recognition of object classes Analyze
More informationNotes 9: Optical Flow
Course 049064: Variational Methods in Image Processing Notes 9: Optical Flow Guy Gilboa 1 Basic Model 1.1 Background Optical flow is a fundamental problem in computer vision. The general goal is to find
More informationVisual Recognition: Image Formation
Visual Recognition: Image Formation Raquel Urtasun TTI Chicago Jan 5, 2012 Raquel Urtasun (TTI-C) Visual Recognition Jan 5, 2012 1 / 61 Today s lecture... Fundamentals of image formation You should know
More informationFAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES
FAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES Jie Shao a, Wuming Zhang a, Yaqiao Zhu b, Aojie Shen a a State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing
More informationHand-Eye Calibration from Image Derivatives
Hand-Eye Calibration from Image Derivatives Abstract In this paper it is shown how to perform hand-eye calibration using only the normal flow field and knowledge about the motion of the hand. The proposed
More informationENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows
ENGN2911I: 3D Photography and Geometry Processing Assignment 1: 3D Photography using Planar Shadows Instructor: Gabriel Taubin Assignment written by: Douglas Lanman 29 January 2009 Figure 1: 3D Photography
More information3D FACE RECONSTRUCTION BASED ON EPIPOLAR GEOMETRY
IJDW Volume 4 Number January-June 202 pp. 45-50 3D FACE RECONSRUCION BASED ON EPIPOLAR GEOMERY aher Khadhraoui, Faouzi Benzarti 2 and Hamid Amiri 3,2,3 Signal, Image Processing and Patterns Recognition
More informationAnnouncements. Stereo
Announcements Stereo Homework 2 is due today, 11:59 PM Homework 3 will be assigned today Reading: Chapter 7: Stereopsis CSE 152 Lecture 8 Binocular Stereopsis: Mars Given two images of a scene where relative
More informationPassive 3D Photography
SIGGRAPH 2000 Course on 3D Photography Passive 3D Photography Steve Seitz Carnegie Mellon University University of Washington http://www.cs cs.cmu.edu/~ /~seitz Visual Cues Shading Merle Norman Cosmetics,
More informationEpipolar geometry. x x
Two-view geometry Epipolar geometry X x x Baseline line connecting the two camera centers Epipolar Plane plane containing baseline (1D family) Epipoles = intersections of baseline with image planes = projections
More informationLUMS Mine Detector Project
LUMS Mine Detector Project Using visual information to control a robot (Hutchinson et al. 1996). Vision may or may not be used in the feedback loop. Visual (image based) features such as points, lines
More informationAccurate and Dense Wide-Baseline Stereo Matching Using SW-POC
Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp
More informationTwo-view geometry Computer Vision Spring 2018, Lecture 10
Two-view geometry http://www.cs.cmu.edu/~16385/ 16-385 Computer Vision Spring 2018, Lecture 10 Course announcements Homework 2 is due on February 23 rd. - Any questions about the homework? - How many of
More informationAffine and Projective Structure from Motion
Affine and Projective Structure from Motion Sabine Demey* Katholieke Universiteit Leuven Department of Mechanical Engineering, Division PMA Heverlee, Belgium Andrew Zisserman and Paul Beardsleyt Robotics
More informationLocal Image Registration: An Adaptive Filtering Framework
Local Image Registration: An Adaptive Filtering Framework Gulcin Caner a,a.murattekalp a,b, Gaurav Sharma a and Wendi Heinzelman a a Electrical and Computer Engineering Dept.,University of Rochester, Rochester,
More informationEstimation of common groundplane based on co-motion statistics
Estimation of common groundplane based on co-motion statistics Zoltan Szlavik, Laszlo Havasi 2, Tamas Sziranyi Analogical and Neural Computing Laboratory, Computer and Automation Research Institute of
More informationComputer Vision I. Announcement. Stereo Vision Outline. Stereo II. CSE252A Lecture 15
Announcement Stereo II CSE252A Lecture 15 HW3 assigned No class on Thursday 12/6 Extra class on Tuesday 12/4 at 6:30PM in WLH Room 2112 Mars Exploratory Rovers: Spirit and Opportunity Stereo Vision Outline
More informationVisualization 2D-to-3D Photo Rendering for 3D Displays
Visualization 2D-to-3D Photo Rendering for 3D Displays Sumit K Chauhan 1, Divyesh R Bajpai 2, Vatsal H Shah 3 1 Information Technology, Birla Vishvakarma mahavidhyalaya,sumitskc51@gmail.com 2 Information
More informationIntroduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation
Introduction CMPSCI 591A/691A CMPSCI 570/670 Image Formation Lecture Outline Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic
More informationcalibrated coordinates Linear transformation pixel coordinates
1 calibrated coordinates Linear transformation pixel coordinates 2 Calibration with a rig Uncalibrated epipolar geometry Ambiguities in image formation Stratified reconstruction Autocalibration with partial
More informationPerception and Action using Multilinear Forms
Perception and Action using Multilinear Forms Anders Heyden, Gunnar Sparr, Kalle Åström Dept of Mathematics, Lund University Box 118, S-221 00 Lund, Sweden email: {heyden,gunnar,kalle}@maths.lth.se Abstract
More informationExponential Maps for Computer Vision
Exponential Maps for Computer Vision Nick Birnie School of Informatics University of Edinburgh 1 Introduction In computer vision, the exponential map is the natural generalisation of the ordinary exponential
More informationCourse 23: Multiple-View Geometry For Image-Based Modeling
Course 23: Multiple-View Geometry For Image-Based Modeling Jana Kosecka (CS, GMU) Yi Ma (ECE, UIUC) Stefano Soatto (CS, UCLA) Rene Vidal (Berkeley, John Hopkins) PRIMARY REFERENCE 1 Multiple-View Geometry
More informationAnnouncements. Stereo
Announcements Stereo Homework 1 is due today, 11:59 PM Homework 2 will be assigned on Thursday Reading: Chapter 7: Stereopsis CSE 252A Lecture 8 Binocular Stereopsis: Mars Given two images of a scene where
More informationSelf-Calibration of a Camera Equipped SCORBOT ER-4u Robot
Self-Calibration of a Camera Equipped SCORBOT ER-4u Robot Gossaye Mekonnen Alemu and Sanjeev Kumar Department of Mathematics IIT Roorkee Roorkee-247 667, India gossayemekonnen@gmail.com malikfma@iitr.ac.in
More informationRecovering structure from a single view Pinhole perspective projection
EPIPOLAR GEOMETRY The slides are from several sources through James Hays (Brown); Silvio Savarese (U. of Michigan); Svetlana Lazebnik (U. Illinois); Bill Freeman and Antonio Torralba (MIT), including their
More informationTwo-View Geometry (Course 23, Lecture D)
Two-View Geometry (Course 23, Lecture D) Jana Kosecka Department of Computer Science George Mason University http://www.cs.gmu.edu/~kosecka General Formulation Given two views of the scene recover the
More informationMultiple View Geometry
Multiple View Geometry CS 6320, Spring 2013 Guest Lecture Marcel Prastawa adapted from Pollefeys, Shah, and Zisserman Single view computer vision Projective actions of cameras Camera callibration Photometric
More informationAn Overview of Matchmoving using Structure from Motion Methods
An Overview of Matchmoving using Structure from Motion Methods Kamyar Haji Allahverdi Pour Department of Computer Engineering Sharif University of Technology Tehran, Iran Email: allahverdi@ce.sharif.edu
More informationVehicle Dimensions Estimation Scheme Using AAM on Stereoscopic Video
Workshop on Vehicle Retrieval in Surveillance (VRS) in conjunction with 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance Vehicle Dimensions Estimation Scheme Using
More informationTecnologie per la ricostruzione di modelli 3D da immagini. Marco Callieri ISTI-CNR, Pisa, Italy
Tecnologie per la ricostruzione di modelli 3D da immagini Marco Callieri ISTI-CNR, Pisa, Italy Who am I? Marco Callieri PhD in computer science Always had the like for 3D graphics... Researcher at the
More information3D Sensing. 3D Shape from X. Perspective Geometry. Camera Model. Camera Calibration. General Stereo Triangulation.
3D Sensing 3D Shape from X Perspective Geometry Camera Model Camera Calibration General Stereo Triangulation 3D Reconstruction 3D Shape from X shading silhouette texture stereo light striping motion mainly
More informationObject and Motion Recognition using Plane Plus Parallax Displacement of Conics
Object and Motion Recognition using Plane Plus Parallax Displacement of Conics Douglas R. Heisterkamp University of South Alabama Mobile, AL 6688-0002, USA dheister@jaguar1.usouthal.edu Prabir Bhattacharya
More informationFeature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies
Feature Transfer and Matching in Disparate Stereo Views through the use of Plane Homographies M. Lourakis, S. Tzurbakis, A. Argyros, S. Orphanoudakis Computer Vision and Robotics Lab (CVRL) Institute of
More informationContents I IMAGE FORMATION 1
Contents I IMAGE FORMATION 1 1 Geometric Camera Models 3 1.1 Image Formation............................. 4 1.1.1 Pinhole Perspective....................... 4 1.1.2 Weak Perspective.........................
More informationDescriptive Geometry Meets Computer Vision The Geometry of Two Images (# 82)
Descriptive Geometry Meets Computer Vision The Geometry of Two Images (# 8) Hellmuth Stachel stachel@dmg.tuwien.ac.at http://www.geometrie.tuwien.ac.at/stachel th International Conference on Geometry and
More informationStructure from Motion. Introduction to Computer Vision CSE 152 Lecture 10
Structure from Motion CSE 152 Lecture 10 Announcements Homework 3 is due May 9, 11:59 PM Reading: Chapter 8: Structure from Motion Optional: Multiple View Geometry in Computer Vision, 2nd edition, Hartley
More informationToward a Stratification of Helmholtz Stereopsis
Toward a Stratification of Helmholtz Stereopsis Todd E Zickler Electrical Engineering Yale University New Haven CT 652 zickler@yaleedu Peter N Belhumeur Computer Science Columbia University New York NY
More informationImage Formation. Antonino Furnari. Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania
Image Formation Antonino Furnari Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania furnari@dmi.unict.it 18/03/2014 Outline Introduction; Geometric Primitives
More informationProject 4 Results. Representation. Data. Learning. Zachary, Hung-I, Paul, Emanuel. SIFT and HoG are popular and successful.
Project 4 Results Representation SIFT and HoG are popular and successful. Data Hugely varying results from hard mining. Learning Non-linear classifier usually better. Zachary, Hung-I, Paul, Emanuel Project
More informationThe end of affine cameras
The end of affine cameras Affine SFM revisited Epipolar geometry Two-view structure from motion Multi-view structure from motion Planches : http://www.di.ens.fr/~ponce/geomvis/lect3.pptx http://www.di.ens.fr/~ponce/geomvis/lect3.pdf
More informationMiniature faking. In close-up photo, the depth of field is limited.
Miniature faking In close-up photo, the depth of field is limited. http://en.wikipedia.org/wiki/file:jodhpur_tilt_shift.jpg Miniature faking Miniature faking http://en.wikipedia.org/wiki/file:oregon_state_beavers_tilt-shift_miniature_greg_keene.jpg
More informationA New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical
More informationEstimation of 3D Geometry Using Multi-View and Structured Circular Light System
Journal of Image and Graphics, Volume, No., June, 04 Estimation of 3D Geometry Using Multi-View and Structured Circular Light System Deokwoo Lee Samsung Electronics / Camera R&D Lab, Division of Mobile
More informationWeek 2: Two-View Geometry. Padua Summer 08 Frank Dellaert
Week 2: Two-View Geometry Padua Summer 08 Frank Dellaert Mosaicking Outline 2D Transformation Hierarchy RANSAC Triangulation of 3D Points Cameras Triangulation via SVD Automatic Correspondence Essential
More informationA Summary of Projective Geometry
A Summary of Projective Geometry Copyright 22 Acuity Technologies Inc. In the last years a unified approach to creating D models from multiple images has been developed by Beardsley[],Hartley[4,5,9],Torr[,6]
More informationCHAPTER 3. Single-view Geometry. 1. Consequences of Projection
CHAPTER 3 Single-view Geometry When we open an eye or take a photograph, we see only a flattened, two-dimensional projection of the physical underlying scene. The consequences are numerous and startling.
More informationHigh-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond
High-Fidelity Augmented Reality Interactions Hrvoje Benko Researcher, MSR Redmond New generation of interfaces Instead of interacting through indirect input devices (mice and keyboard), the user is interacting
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribe : Martin Stiaszny and Dana Qu LECTURE 0 Camera Calibration 0.. Introduction Just like the mythical frictionless plane, in real life we will
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Today: dense 3D reconstruction The matching problem
More informationLecture 10: Multi-view geometry
Lecture 10: Multi-view geometry Professor Stanford Vision Lab 1 What we will learn today? Review for stereo vision Correspondence problem (Problem Set 2 (Q3)) Active stereo vision systems Structure from
More informationDD2423 Image Analysis and Computer Vision IMAGE FORMATION. Computational Vision and Active Perception School of Computer Science and Communication
DD2423 Image Analysis and Computer Vision IMAGE FORMATION Mårten Björkman Computational Vision and Active Perception School of Computer Science and Communication November 8, 2013 1 Image formation Goal:
More informationCamera Calibration With One-Dimensional Objects
Camera Calibration With One-Dimensional Objects Zhengyou Zhang December 2001 Technical Report MSR-TR-2001-120 Camera calibration has been studied extensively in computer vision and photogrammetry, and
More informationAdaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision
Adaptive Zoom Distance Measuring System of Camera Based on the Ranging of Binocular Vision Zhiyan Zhang 1, Wei Qian 1, Lei Pan 1 & Yanjun Li 1 1 University of Shanghai for Science and Technology, China
More informationMOTION STEREO DOUBLE MATCHING RESTRICTION IN 3D MOVEMENT ANALYSIS
MOTION STEREO DOUBLE MATCHING RESTRICTION IN 3D MOVEMENT ANALYSIS ZHANG Chun-sen Dept of Survey, Xi an University of Science and Technology, No.58 Yantazhonglu, Xi an 710054,China -zhchunsen@yahoo.com.cn
More information12/3/2009. What is Computer Vision? Applications. Application: Assisted driving Pedestrian and car detection. Application: Improving online search
Introduction to Artificial Intelligence V22.0472-001 Fall 2009 Lecture 26: Computer Vision Rob Fergus Dept of Computer Science, Courant Institute, NYU Slides from Andrew Zisserman What is Computer Vision?
More informationNon-Rigid Image Registration
Proceedings of the Twenty-First International FLAIRS Conference (8) Non-Rigid Image Registration Rhoda Baggs Department of Computer Information Systems Florida Institute of Technology. 15 West University
More informationDense 3D Reconstruction. Christiano Gava
Dense 3D Reconstruction Christiano Gava christiano.gava@dfki.de Outline Previous lecture: structure and motion II Structure and motion loop Triangulation Wide baseline matching (SIFT) Today: dense 3D reconstruction
More informationComputing Matched-epipolar Projections
Computing Matched-epipolar Projections Richard I. Hartley G.E. CRD, Schenectady, NY, 12301. Ph: (518)-387-7333 Fax: (518)-387-6845 Email : hartley@crd.ge.com Abstract This paper gives a new method for
More informationMachine vision. Summary # 11: Stereo vision and epipolar geometry. u l = λx. v l = λy
1 Machine vision Summary # 11: Stereo vision and epipolar geometry STEREO VISION The goal of stereo vision is to use two cameras to capture 3D scenes. There are two important problems in stereo vision:
More information5LSH0 Advanced Topics Video & Analysis
1 Multiview 3D video / Outline 2 Advanced Topics Multimedia Video (5LSH0), Module 02 3D Geometry, 3D Multiview Video Coding & Rendering Peter H.N. de With, Sveta Zinger & Y. Morvan ( p.h.n.de.with@tue.nl
More informationCompositing a bird's eye view mosaic
Compositing a bird's eye view mosaic Robert Laganiere School of Information Technology and Engineering University of Ottawa Ottawa, Ont KN 6N Abstract This paper describes a method that allows the composition
More informationFundamental matrix estimation for binocular vision measuring system used in wild field
Fundamental matrix estimation for binocular vision measuring system used in wild field Yan Nian 12 and Wang Xiang-jun 12 and Liu Feng 12 1 State Key Laboratory of Precision Measuring Technology and Instruments,
More informationA 3-D Scanner Capturing Range and Color for the Robotics Applications
J.Haverinen & J.Röning, A 3-D Scanner Capturing Range and Color for the Robotics Applications, 24th Workshop of the AAPR - Applications of 3D-Imaging and Graph-based Modeling, May 25-26, Villach, Carinthia,
More informationIntroduction à la vision artificielle X
Introduction à la vision artificielle X Jean Ponce Email: ponce@di.ens.fr Web: http://www.di.ens.fr/~ponce Planches après les cours sur : http://www.di.ens.fr/~ponce/introvis/lect10.pptx http://www.di.ens.fr/~ponce/introvis/lect10.pdf
More informationfirst order approx. u+d second order approx. (S)
Computing Dierential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models F. Devernay and O. D. Faugeras INRIA. 2004, route des Lucioles. B.P. 93. 06902 Sophia-Antipolis. FRANCE. Abstract
More informationLocal qualitative shape from stereo. without detailed correspondence. Extended Abstract. Shimon Edelman. Internet:
Local qualitative shape from stereo without detailed correspondence Extended Abstract Shimon Edelman Center for Biological Information Processing MIT E25-201, Cambridge MA 02139 Internet: edelman@ai.mit.edu
More informationComputing Matched-epipolar Projections
Computing Matched-epipolar Projections Richard Hartley and Rajiv Gupta GE - Corporate Research and Development, P.O. Box 8, Schenectady, NY, 12301. Ph : (518)-387-7333 Fax : (518)-387-6845 email : hartley@crd.ge.com
More informationTransparent Object Shape Measurement Based on Deflectometry
Proceedings Transparent Object Shape Measurement Based on Deflectometry Zhichao Hao and Yuankun Liu * Opto-Electronics Department, Sichuan University, Chengdu 610065, China; 2016222055148@stu.scu.edu.cn
More informationENGN D Photography / Spring 2018 / SYLLABUS
ENGN 2502 3D Photography / Spring 2018 / SYLLABUS Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized cameras routinely
More informationDepth Measurement and 3-D Reconstruction of Multilayered Surfaces by Binocular Stereo Vision with Parallel Axis Symmetry Using Fuzzy
Depth Measurement and 3-D Reconstruction of Multilayered Surfaces by Binocular Stereo Vision with Parallel Axis Symmetry Using Fuzzy Sharjeel Anwar, Dr. Shoaib, Taosif Iqbal, Mohammad Saqib Mansoor, Zubair
More informationAgenda. Rotations. Camera models. Camera calibration. Homographies
Agenda Rotations Camera models Camera calibration Homographies D Rotations R Y = Z r r r r r r r r r Y Z Think of as change of basis where ri = r(i,:) are orthonormal basis vectors r rotated coordinate
More informationA COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION
XIX IMEKO World Congress Fundamental and Applied Metrology September 6 11, 2009, Lisbon, Portugal A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION David Samper 1, Jorge Santolaria 1,
More informationComputational Photography: Real Time Plenoptic Rendering
Computational Photography: Real Time Plenoptic Rendering Andrew Lumsdaine, Georgi Chunev Indiana University Todor Georgiev Adobe Systems Who was at the Keynote Yesterday? 2 Overview Plenoptic cameras Rendering
More information