Optical flow and depth from motion for omnidirectional images using a TV-L1 variational framework on graphs
|
|
- Everett Wilkerson
- 5 years ago
- Views:
Transcription
1 ICIP Monday, November 9 Optical flow and depth from motion for omnidirectional images using a TV-L1 variational framework on graphs Luigi Bagnato Signal Processing Laboratory - EPFL Advisors: Prof. Pierre Vandergheynst and Prof. Pascal Frossard 1
2 Introduction Problem Formulation Our Solution 2 Motivations Optical flow and dense depth map estimation are typical inverse problems in computer vision. Variational methods: - pro: very good performances - cons: quite heavy BUT efficient (real time) GPU-based implementation is possible for planar images. Omnidirectional vision systems are attractive in many applications (Robotics, 3D reconstruction) - They suffer of rather complex distortions 2
3 Introduction Problem Formulation Our Solution 3 Omnidirectional Vision Systems Catadioptric camera Panoptic camera 104 webcams arranged on a hemispherical aluminum board 3
4 Introduction Problem Formulation Our Solution 4 2-Sphere Representation Every single viewpoint optical system admits a unique mapping on a 2-sphere Omnidirectional image Projection on 2-Sphere Reference: Baker and Nayar. A theory of single-viewpoint catadioptric image formation. Int J Comput Vis (1999) vol. 35 (2) pp
5 Introduction Problem Formulation Our Solution 5 Synthetic Spherical Video Sequence 0 φ 2π θ π 5
6 Introduction Problem Formulation Our Solution 5 Synthetic Spherical Video Sequence 0 φ 2π θ π 5
7 Introduction Problem Formulation Our Solution 6 First Frame I 0 6
8 Introduction Problem Formulation Our Solution 7 Second Frame I 1 7
9 Introduction Problem Formulation Our Solution 8 Image Residual I 1 I 0 8
10 Introduction Problem Formulation Our Solution 9 Optical Flow Field Ground Truth 9
11 Introduction Problem Formulation Our Solution 10 Optical Flow Field - module Ground Truth 10
12 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 u = D 1 t s u(y) D(y) optical flow depth map y D P I : R 3 R (radial function) 11
13 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 t u = D 1 t s u(y) D(y) optical flow depth map y D P I : R 3 R (radial function) 11
14 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 t u = D 1 t s u(y) D(y) optical flow depth map y D P I : R 3 R (radial function) 11
15 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 y D u P t u = D 1 t s I : R 3 R u(y) D(y) (radial function) optical flow depth map 11
16 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 y D u P t u = D 1 t s I : R 3 R u(y) D(y) (radial function) optical flow depth map Brightness consistency I 0 (y) I 1 (y + u) = 0 11
17 Introduction Problem Formulation Our Solution 11 Spherical Optical Flow y S 2 y D u P t u = D 1 t s I : R 3 R u(y) D(y) (radial function) optical flow depth map Brightness consistency I 0 (y) I 1 (y + u) = 0 Linear approximation I 0 (y) ( s I 1 (y)) T u I 1 (y) = 0 11
18 Introduction Problem Formulation Our Solution 12 TV-L1 Inverse Problem J = Ω ψ( u i ) dω + λ Ω ρ(i 0,I 1, u) dω TV Regularization L1 norm fidelity term, robust to outliers ψ( s u i )= i s u i, i {1, 2} ρ(u) =I 1 (y)+( s I 1 (y)) T u I 0 (x) 12
19 Introduction Problem Formulation Our Solution 12 TV-L1 Inverse Problem J = Ω ψ( u i ) dω + λ Ω ρ(i 0,I 1, u) dω TV Regularization L1 norm fidelity term, robust to outliers ψ( s u i )= i s u i, i {1, 2} ρ(u) =I 1 (y)+( s I 1 (y)) T u I 0 (x) Functional Splitting J = Ω ψ( ui )+ 1 2θ u v 2 + λρ(v)dω v is an auxiliary variable close to u 12
20 Introduction Problem Formulation Our Solution 13 Two Step Algorithm J = Ω ψ( ui )+ 1 2θ u v 2 + λρ(v)dω 13
21 Introduction Problem Formulation Our Solution 13 Two Step Algorithm J = Ω ψ( ui )+ 1 2θ u v 2 + λρ(v)dω 1. Fix u and solve min v { Ω } 1 2θ u v 2 + λρ(v)dω Easy to solve, solution can be found pointwise by a soft thresholding scheme 13
22 Introduction Problem Formulation Our Solution 13 Two Step Algorithm J = Ω ψ( ui )+ 1 2θ u v 2 + λρ(v)dω 1. Fix u and solve min v { Ω } 1 2θ u v 2 + λρ(v)dω Easy to solve, solution can be found pointwise by a soft thresholding scheme 2. Fix v and solve min u { Ω ψ( s u i )+ 1 } 2θ u v 2 dω Classical TV denoising problem We need an efficient discretization scheme 13
23 Our Solution Introduction Problem Formulation 14 Graph Discretization Γ =( V, E, w) w : E R w(u, v) =w(v, u) > 0 Spherical geometry embedded in connectivity. Weights are decreasing with the geodesic distance. Can handle irregular sampling grid. Graph differential geometry ( w w(u, v) f)(u, v) = d(u) f(u) w(u, v) d(v) f(v) (div w F )(u) = w(u, v) (F (v, u) F (u, v)) d(v) u v Gradient (value on edges) Divergence at vertex u Local variation at vertex v w f = u v [( ) ] 2 w f (u, v) Degree at vertex v d(v) = u v w(u, v) Reference: Zhou and Scholkopf. Regularization on discrete spaces. Lect Notes Comput Sc (2005) vol pp
24 Our Solution Introduction Problem Formulation 15 Graph Regularization Γ =( V, E, w) w : E R w(u, v) =w(v, u) > 0 Discrete TV subproblem min u i { u i TV w + 12θ ui v i 2 } i {1, 2} Graph based Chambolle iterations v i = u i θdiv w p i i {1, 2}, p n+1 i = pn i + τ w (div w p n i u i/θ) 1+τ w (divp n i u i/θ) i {1, 2} References: Chambolle. An algorithm for total variation minimization and applications. J Math Imaging Vis (2004) vol. 20 (1-2) pp Peyre et al. Non-local Regularization of Inverse Problems. Computer Vision-Eccv (2008) 15
25 Introduction Problem Formulation Our Solution 16 Optical Flow - our solution Ground Truth Estimated optical flow (module) 16
26 Introduction Problem Formulation Our Solution 17 Optical Flow - planar technique Ground Truth Estimated optical flow (module) 17
27 Introduction Problem Formulation Our Solution 18 Planar-TVL1 GrH-TVL1 Error Module (SSE) Angle (AAE) Planar-TVL GrH-TVL
28 Introduction Problem Formulation Our Solution 19 Catadioptric Video Sequence I 0 I 1 19
29 Introduction Problem Formulation Our Solution 20 Catadioptric Video Sequence Image residual after motion compensation Initial Image residual 20
30 Our Solution Introduction Problem Formulation 21 A new inverse problem: Depth Estimation u t y S 2 u = D 1 t s u(y) D(y) optical flow depth map Z = D 1 optimization variable 21
31 Our Solution Introduction Problem Formulation 21 A new inverse problem: Depth Estimation u t y S 2 u = D 1 t s u(y) D(y) optical flow depth map Z = D 1 optimization variable I 1 (y)+z(( I 1 ) T t s ) I 0 (y) = 0 21
32 Our Solution Introduction Problem Formulation 21 A new inverse problem: Depth Estimation u t y S 2 u = D 1 t s u(y) D(y) optical flow depth map Z = D 1 optimization variable J = Ω I 1 (y)+z(( I 1 ) T t s ) I 0 (y) = 0 Z + 1 2θ (Z K)2 + λ I 1 (y)+z(( I 1 ) T t s I 0 (y)) dω K is an auxiliary variable close to D 21
33 Introduction Problem Formulation Our Solution 22 Depth Estimation - synthetic data Ground Truth Estimated depth map 22
34 Introduction Problem Formulation Our Solution 23 Real 3D Reconstruction From depth map to 3D model Estimated depth map 23
35 Introduction Problem Formulation Our Solution 23 Real 3D Reconstruction From depth map to 3D model Estimated depth map 23
36 24 Conclusions Adapted TVL1 algorithm for omnidirectional optical flow - Valid for all single effective viewpoint devices - Graceful handling of irregular sampling grid - Numerically stable Novel algorithm for dense depth map estimation - no correspondences to solve - test on real sequences are convincing Real time implementation (work in progress)! For more details: L.Bagnato,P.Vandergheynst,P.Frossard. A Variational Framework for Structure from Motion in Omnidirectional Video Sequences. Submitted to IEEE Transactions in Image Processing 24
37 25 Thank you! 25
38 26 References Baker and Nayar. A theory of single-viewpoint catadioptric image formation. Int J Comput Vis (1999) vol. 35 (2) pp Peyre et al. Non-local Regularization of Inverse Problems. Computer Vision-Eccv (2008) Chambolle. An algorithm for total variation minimization and applications. J Math Imaging Vis (2004) vol. 20 (1-2) pp Zhou and Scholkopf. Regularization on discrete spaces. Lect Notes Comput Sc (2005) vol pp
39 Introduction Problem Formulation Our Solution 27 Naive Discretization 27
40 Introduction Problem Formulation Our Solution 28 Structure from Motion Omnidirectional image Input: 2 omnidirectional images from a video sequence Algo: Graph based TVL1 variational approach Output: Depth Map and Ego-motion Projection on 2-Sphere 28
41 Introduction Problem Formulation Our Solution 29 Spherical Optical Flow Field Brightness consistency D y I 0 (y) I 1 (y + u) = 0 Linear approximation I 1 (y + u) ( I 1 (y + u 0 )) T (u u 0 ) I 0 (y) =0 29
42 Introduction Problem Formulation Our Solution 30 Result - our solution 30
43 Introduction Problem Formulation Our Solution 31 - planar technique 31
Tracking and Structure from Motion
Master s Thesis Winter Semester 2009/2010 Tracking and Structure from Motion Author: Andreas Weishaupt Supervisor: Prof. Pierre Vandergheynst Assistants: Luigi Bagnato Emmanuel D Angelo Signal Processing
More informationStructure from Small Baseline Motion with Central Panoramic Cameras
Structure from Small Baseline Motion with Central Panoramic Cameras Omid Shakernia René Vidal Shankar Sastry Department of Electrical Engineering & Computer Sciences, UC Berkeley {omids,rvidal,sastry}@eecs.berkeley.edu
More informationRe-rendering from a Dense/Sparse Set of Images
Re-rendering from a Dense/Sparse Set of Images Ko Nishino Institute of Industrial Science The Univ. of Tokyo (Japan Science and Technology) kon@cvl.iis.u-tokyo.ac.jp Virtual/Augmented/Mixed Reality Three
More informationLecture 10 Multi-view Stereo (3D Dense Reconstruction) Davide Scaramuzza
Lecture 10 Multi-view Stereo (3D Dense Reconstruction) Davide Scaramuzza REMODE: Probabilistic, Monocular Dense Reconstruction in Real Time, ICRA 14, by Pizzoli, Forster, Scaramuzza [M. Pizzoli, C. Forster,
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationGabor and Wavelet transforms for signals defined on graphs An invitation to signal processing on graphs
Gabor and Wavelet transforms for signals defined on graphs An invitation to signal processing on graphs Benjamin Ricaud Signal Processing Lab 2, EPFL Lausanne, Switzerland SPLab, Brno, 10/2013 B. Ricaud
More informationPara-catadioptric Camera Auto Calibration from Epipolar Geometry
Para-catadioptric Camera Auto Calibration from Epipolar Geometry Branislav Mičušík and Tomáš Pajdla Center for Machine Perception http://cmp.felk.cvut.cz Department of Cybernetics Faculty of Electrical
More informationLecture 10 Dense 3D Reconstruction
Institute of Informatics Institute of Neuroinformatics Lecture 10 Dense 3D Reconstruction Davide Scaramuzza 1 REMODE: Probabilistic, Monocular Dense Reconstruction in Real Time M. Pizzoli, C. Forster,
More informationPhotometric Stereo. Lighting and Photometric Stereo. Computer Vision I. Last lecture in a nutshell BRDF. CSE252A Lecture 7
Lighting and Photometric Stereo Photometric Stereo HW will be on web later today CSE5A Lecture 7 Radiometry of thin lenses δa Last lecture in a nutshell δa δa'cosα δacos β δω = = ( z' / cosα ) ( z / cosα
More informationOptic Flow and Basics Towards Horn-Schunck 1
Optic Flow and Basics Towards Horn-Schunck 1 Lecture 7 See Section 4.1 and Beginning of 4.2 in Reinhard Klette: Concise Computer Vision Springer-Verlag, London, 2014 1 See last slide for copyright information.
More informationReconstructing Reflective and Transparent Surfaces from Epipolar Plane Images
Sven Wanner and Bastian Goldlücke Heidelberg Collaboratory for Image Processing 1. Light Fields and Epipolar Plane Images 1. Light Fields and Epipolar Plane Images Light Fields as a dense sampling of a
More informationMotion Estimation (II) Ce Liu Microsoft Research New England
Motion Estimation (II) Ce Liu celiu@microsoft.com Microsoft Research New England Last time Motion perception Motion representation Parametric motion: Lucas-Kanade T I x du dv = I x I T x I y I x T I y
More informationReal Time Biologically-Inspired Depth Maps from Spherical Flow
Real Time Biologically-Inspired Depth Maps from Spherical Flow Chris McCarthy, Nick Barnes and Mandyam Srinivasan Abstract We present a strategy for generating real-time relative depth maps of an environment
More informationReal-time Image-based Reconstruction of Pipes Using Omnidirectional Cameras
Real-time Image-based Reconstruction of Pipes Using Omnidirectional Cameras Dipl. Inf. Sandro Esquivel Prof. Dr.-Ing. Reinhard Koch Multimedia Information Processing Christian-Albrechts-University of Kiel
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationMAC2313 Test 3 A E g(x, y, z) dy dx dz
MAC2313 Test 3 A (5 pts) 1. If the function g(x, y, z) is integrated over the cylindrical solid bounded by x 2 + y 2 = 3, z = 1, and z = 7, the correct integral in Cartesian coordinates is given by: A.
More informationComputer Vision I. Dense Stereo Correspondences. Anita Sellent 1/15/16
Computer Vision I Dense Stereo Correspondences Anita Sellent Stereo Two Cameras Overlapping field of view Known transformation between cameras From disparity compute depth [ Bradski, Kaehler: Learning
More informationRange Sensors (time of flight) (1)
Range Sensors (time of flight) (1) Large range distance measurement -> called range sensors Range information: key element for localization and environment modeling Ultrasonic sensors, infra-red sensors
More informationCatadioptric camera model with conic mirror
LÓPEZ-NICOLÁS, SAGÜÉS: CATADIOPTRIC CAMERA MODEL WITH CONIC MIRROR Catadioptric camera model with conic mirror G. López-Nicolás gonlopez@unizar.es C. Sagüés csagues@unizar.es Instituto de Investigación
More informationRecent Advances inelectrical & Electronic Engineering
4 Send Orders for Reprints to reprints@benthamscience.ae Recent Advances in Electrical & Electronic Engineering, 017, 10, 4-47 RESEARCH ARTICLE ISSN: 35-0965 eissn: 35-0973 Image Inpainting Method Based
More informationCOMPUTER AND ROBOT VISION
VOLUME COMPUTER AND ROBOT VISION Robert M. Haralick University of Washington Linda G. Shapiro University of Washington T V ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California
More informationImage Smoothing and Segmentation by Graph Regularization
Image Smoothing and Segmentation by Graph Regularization Sébastien Bougleux 1 and Abderrahim Elmoataz 1 GREYC CNRS UMR 6072, Université de Caen Basse-Normandie ENSICAEN 6 BD du Maréchal Juin, 14050 Caen
More informationCritical Configurations For Radial Distortion Self-Calibration
Critical Configurations For Radial Distortion Self-Calibration Changchang Wu Google Inc. Abstract In this paper, we study the configurations of motion and structure that lead to inherent ambiguities in
More informationLaser sensors. Transmitter. Receiver. Basilio Bona ROBOTICA 03CFIOR
Mobile & Service Robotics Sensors for Robotics 3 Laser sensors Rays are transmitted and received coaxially The target is illuminated by collimated rays The receiver measures the time of flight (back and
More informationVisual Tracking of Planes with an Uncalibrated Central Catadioptric Camera
The 29 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15, 29 St. Louis, USA Visual Tracking of Planes with an Uncalibrated Central Catadioptric Camera A. Salazar-Garibay,
More informationProject Updates Short lecture Volumetric Modeling +2 papers
Volumetric Modeling Schedule (tentative) Feb 20 Feb 27 Mar 5 Introduction Lecture: Geometry, Camera Model, Calibration Lecture: Features, Tracking/Matching Mar 12 Mar 19 Mar 26 Apr 2 Apr 9 Apr 16 Apr 23
More informationA Duality Based Algorithm for TV-L 1 -Optical-Flow Image Registration
A Duality Based Algorithm for TV-L 1 -Optical-Flow Image Registration Thomas Pock 1, Martin Urschler 1, Christopher Zach 2, Reinhard Beichel 3, and Horst Bischof 1 1 Institute for Computer Graphics & Vision,
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW
ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW Thorsten Thormählen, Hellward Broszio, Ingolf Wassermann thormae@tnt.uni-hannover.de University of Hannover, Information Technology Laboratory,
More informationA Survey of Light Source Detection Methods
A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light
More informationAn Evaluation of Robust Cost Functions for RGB Direct Mapping
An Evaluation of Robust Cost Functions for RGB Direct Mapping Alejo Concha and Javier Civera Abstract The so-called direct SLAM methods have shown an impressive performance in estimating a dense 3D reconstruction
More informationFusing Optical Flow and Stereo in a Spherical Depth Panorama Using a Single-Camera Folded Catadioptric Rig
Fusing Optical Flow and Stereo in a Spherical Depth Panorama Using a Single-Camera Folded Catadioptric Rig Igor Labutov, Carlos Jaramillo and Jizhong Xiao, Senior Member, IEEE Abstract We present a novel
More informationAccurate and Dense Wide-Baseline Stereo Matching Using SW-POC
Accurate and Dense Wide-Baseline Stereo Matching Using SW-POC Shuji Sakai, Koichi Ito, Takafumi Aoki Graduate School of Information Sciences, Tohoku University, Sendai, 980 8579, Japan Email: sakai@aoki.ecei.tohoku.ac.jp
More informationImage denoising using TV-Stokes equation with an orientation-matching minimization
Image denoising using TV-Stokes equation with an orientation-matching minimization Xue-Cheng Tai 1,2, Sofia Borok 1, and Jooyoung Hahn 1 1 Division of Mathematical Sciences, School of Physical Mathematical
More informationImplementation of PML in the Depth-oriented Extended Forward Modeling
Implementation of PML in the Depth-oriented Extended Forward Modeling Lei Fu, William W. Symes The Rice Inversion Project (TRIP) April 19, 2013 Lei Fu, William W. Symes (TRIP) PML in Extended modeling
More informationCSE 252A Computer Vision Homework 3 Instructor: Ben Ochoa Due : Monday, November 21, 2016, 11:59 PM
CSE 252A Computer Vision Homework 3 Instructor: Ben Ochoa Due : Monday, November 21, 2016, 11:59 PM Instructions: Homework 3 has to be submitted in groups of 3. Review the academic integrity and collaboration
More informationIntroduction to Computer Graphics. Modeling (3) April 27, 2017 Kenshi Takayama
Introduction to Computer Graphics Modeling (3) April 27, 2017 Kenshi Takayama Solid modeling 2 Solid models Thin shapes represented by single polygons Unorientable Clear definition of inside & outside
More informationPing Tan. Simon Fraser University
Ping Tan Simon Fraser University Photos vs. Videos (live photos) A good photo tells a story Stories are better told in videos Videos in the Mobile Era (mobile & share) More videos are captured by mobile
More informationImage Based Reconstruction II
Image Based Reconstruction II Qixing Huang Feb. 2 th 2017 Slide Credit: Yasutaka Furukawa Image-Based Geometry Reconstruction Pipeline Last Lecture: Multi-View SFM Multi-View SFM This Lecture: Multi-View
More informationRefractive Index Map Reconstruction in Optical Deflectometry Using Total-Variation Regularization
Refractive Index Map Reconstruction in Optical Deflectometry Using Total-Variation Regularization L. Jacques 1, A. González 2, E. Foumouo 2 and P. Antoine 2 1 Institute of Information and Communication
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationTowards a visual perception system for LNG pipe inspection
Towards a visual perception system for LNG pipe inspection LPV Project Team: Brett Browning (PI), Peter Rander (co PI), Peter Hansen Hatem Alismail, Mohamed Mustafa, Joey Gannon Qri8 Lab A Brief Overview
More informationarxiv:cs/ v1 [cs.cv] 24 Mar 2003
Differential Methods in Catadioptric Sensor Design with Applications to Panoramic Imaging Technical Report arxiv:cs/0303024v1 [cs.cv] 24 Mar 2003 R. Andrew Hicks Department of Mathematics Drexel University
More informationNormalized cuts and image segmentation
Normalized cuts and image segmentation Department of EE University of Washington Yeping Su Xiaodan Song Normalized Cuts and Image Segmentation, IEEE Trans. PAMI, August 2000 5/20/2003 1 Outline 1. Image
More informationILLUMINATION ROBUST OPTICAL FLOW ESTIMATION BY ILLUMINATION-CHROMATICITY DECOUPLING. Sungheon Park and Nojun Kwak
ILLUMINATION ROBUST OPTICAL FLOW ESTIMATION BY ILLUMINATION-CHROMATICITY DECOUPLING Sungheon Park and Nojun Kwak Graduate School of Convergence Science and Technology, Seoul National University, Korea
More informationMathematics of a Multiple Omni-Directional System
Mathematics of a Multiple Omni-Directional System A. Torii A. Sugimoto A. Imiya, School of Science and National Institute of Institute of Media and Technology, Informatics, Information Technology, Chiba
More informationPartial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems
Partial Calibration and Mirror Shape Recovery for Non-Central Catadioptric Systems Abstract In this paper we present a method for mirror shape recovery and partial calibration for non-central catadioptric
More informationIMPROVING DISTINCTIVENESS OF BRISK FEATURES USING DEPTH MAPS. Maxim Karpushin, Giuseppe Valenzise, Frédéric Dufaux
IMPROVING DISTINCTIVENESS OF FEATURES USING DEPTH MAPS Maxim Karpushin, Giuseppe Valenzise, Frédéric Dufaux Institut Mines-Télécom; Télécom ParisTech; CNRS LTCI ABSTRACT Binary local descriptors are widely
More informationVideo Mosaics for Virtual Environments, R. Szeliski. Review by: Christopher Rasmussen
Video Mosaics for Virtual Environments, R. Szeliski Review by: Christopher Rasmussen September 19, 2002 Announcements Homework due by midnight Next homework will be assigned Tuesday, due following Tuesday.
More informationReal Time Biologically-Inspired Depth Maps from Spherical Flow
Real Time Biologically-Inspired Depth Maps from Spherical Flow Chris McCarthy, Nick Barnes and Mandyam Srinivasan Abstract We present a strategy for generating real-time relative depth maps of an environment
More informationWESTFÄLISCHE WILHELMS-UNIVERSITÄT MÜNSTER
MÜNSTER Adaptive Discretization of Liftings for Curvature Regularization SIAM Conference on Imaging Science 2016, Albuquerque, NM Ulrich Hartleif, Prof. Dr. Benedikt Wirth May 23, 2016 Outline MÜNSTER
More informationA Patch Prior for Dense 3D Reconstruction in Man-Made Environments
A Patch Prior for Dense 3D Reconstruction in Man-Made Environments Christian Häne 1, Christopher Zach 2, Bernhard Zeisl 1, Marc Pollefeys 1 1 ETH Zürich 2 MSR Cambridge October 14, 2012 A Patch Prior for
More information3D Imaging from Video and Planar Radiography
3D Imaging from Video and Planar Radiography Julien Pansiot and Edmond Boyer Morpheo, Inria Grenoble Rhône-Alpes, France International Conference on Medical Image Computing and Computer Assisted Intervention
More informationOccluded Facial Expression Tracking
Occluded Facial Expression Tracking Hugo Mercier 1, Julien Peyras 2, and Patrice Dalle 1 1 Institut de Recherche en Informatique de Toulouse 118, route de Narbonne, F-31062 Toulouse Cedex 9 2 Dipartimento
More informationVideo Super Resolution using Duality Based TV-L 1 Optical Flow
Video Super Resolution using Duality Based TV-L 1 Optical Flow Dennis Mitzel 1,2, Thomas Pock 3, Thomas Schoenemann 1 Daniel Cremers 1 1 Department of Computer Science University of Bonn, Germany 2 UMIC
More informationMathematics in Orbit
Mathematics in Orbit Dan Kalman American University Slides and refs at www.dankalman.net Outline Basics: 3D geospacial models Keyhole Problem: Related Rates! GPS: space-time triangulation Sensor Diagnosis:
More informationMath 348 Differential Geometry of Curves and Surfaces
Math 348 Differential Geometry of Curves and Surfaces Lecture 3 Curves in Calculus Xinwei Yu Sept. 12, 2017 CAB 527, xinwei2@ualberta.ca Department of Mathematical & Statistical Sciences University of
More information3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.
3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction
More informationIllumination-robust variational optical flow based on cross-correlation
Illumination-robust variational optical flow based on cross-correlation József Molnár 1 and Dmitry Chetverikov 2 1 Computer and Automation Research Institute Hungarian Academy of Sciences, Budapest, Hungary
More informationAnnouncements. Motion. Structure-from-Motion (SFM) Motion. Discrete Motion: Some Counting
Announcements Motion Introduction to Computer Vision CSE 152 Lecture 20 HW 4 due Friday at Midnight Final Exam: Tuesday, 6/12 at 8:00AM-11:00AM, regular classroom Extra Office Hours: Monday 6/11 9:00AM-10:00AM
More informationURBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES
URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment
More informationA Comparative Study & Analysis of Image Restoration by Non Blind Technique
A Comparative Study & Analysis of Image Restoration by Non Blind Technique Saurav Rawat 1, S.N.Tazi 2 M.Tech Student, Assistant Professor, CSE Department, Government Engineering College, Ajmer Abstract:
More informationComputer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier
Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 1. IMAGE PROCESSING Computer Vision 2 Dr. Benjamin Guthier Content of this Chapter Non-linear
More informationDynamic 3D Shape From Multi-viewpoint Images Using Deformable Mesh Model
Dynamic 3D Shape From Multi-viewpoint Images Using Deformable Mesh Model Shohei Nobuhara Takashi Matsuyama Graduate School of Informatics, Kyoto University Sakyo, Kyoto, 606-8501, Japan {nob, tm}@vision.kuee.kyoto-u.ac.jp
More informationCITY UNIVERSITY OF HONG KONG 香港城市大學. Human Detection and Tracking in Central Catadioptric Omnidirectional Camera System 基於中心折反射相機系統下的行人檢測和追蹤
CITY UNIVERSITY OF HONG KONG 香港城市大學 Human Detection and Tracking in Central Catadioptric Omnidirectional Camera System 基於中心折反射相機系統下的行人檢測和追蹤 Submitted to Department of Mechanical and Biomedical Engineering
More informationNonrigid Surface Modelling. and Fast Recovery. Department of Computer Science and Engineering. Committee: Prof. Leo J. Jia and Prof. K. H.
Nonrigid Surface Modelling and Fast Recovery Zhu Jianke Supervisor: Prof. Michael R. Lyu Committee: Prof. Leo J. Jia and Prof. K. H. Wong Department of Computer Science and Engineering May 11, 2007 1 2
More informationOptimality Bounds for a Variational Relaxation of the Image Partitioning Problem
Optimality Bounds for a Variational Relaxation of the Image Partitioning Problem Jan Lellmann, Frank Lenzen, Christoph Schnörr Image and Pattern Analysis Group Universität Heidelberg EMMCVPR 2011 St. Petersburg,
More informationIntroduction to Radiosity
Introduction to Radiosity Produce photorealistic pictures using global illumination Mathematical basis from the theory of heat transfer Enables color bleeding Provides view independent representation Unfortunately,
More informationarxiv: v1 [cs.cv] 18 Sep 2017
Direct Pose Estimation with a Monocular Camera Darius Burschka and Elmar Mair arxiv:1709.05815v1 [cs.cv] 18 Sep 2017 Department of Informatics Technische Universität München, Germany {burschka elmar.mair}@mytum.de
More informationDense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm
Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers
More informationAssignment 3: Path tracing
Assignment 3: Path tracing EDAN30 April 2, 2011 In this assignment you will be asked to extend your ray tracer to support path tracing. In order to pass the assignment you need to complete all tasks. Make
More informationThe p-laplacian on Graphs with Applications in Image Processing and Classification
The p-laplacian on Graphs with Applications in Image Processing and Classification Abderrahim Elmoataz 1,2, Matthieu Toutain 1, Daniel Tenbrinck 3 1 UMR6072 GREYC, Université de Caen Normandie 2 Université
More informationTechnion - Computer Science Department - Tehnical Report CIS
Over-Parameterized Variational Optical Flow Tal Nir Alfred M. Bruckstein Ron Kimmel {taln, freddy, ron}@cs.technion.ac.il Department of Computer Science Technion Israel Institute of Technology Technion
More informationMorphological and Statistical Techniques for the Analysis of 3D Images. Enric Meinhardt-Llopis
Morphological and Statistical Techniques for the Analysis of 3D Images Enric Meinhardt-Llopis 3 3 2011 2 / 57 Outline Motivation: 2D/3D differences The 3D tree of shapes Applications of the tree of shapes
More informationA Framework for 3D Pushbroom Imaging CUCS
A Framework for 3D Pushbroom Imaging CUCS-002-03 Naoyuki Ichimura and Shree K. Nayar Information Technology Research Institute, National Institute of Advanced Industrial Science and Technology (AIST) Tsukuba,
More informationFLaME: Fast Lightweight Mesh Estimation using Variational Smoothing on Delaunay Graphs
FLaME: Fast Lightweight Mesh Estimation using Variational Smoothing on Delaunay Graphs W. Nicholas Greene Robust Robotics Group, MIT CSAIL LPM Workshop IROS 2017 September 28, 2017 with Nicholas Roy 1
More informationDegeneracy of the Linear Seventeen-Point Algorithm for Generalized Essential Matrix
J Math Imaging Vis 00 37: 40-48 DOI 0007/s085-00-09-9 Authors s version The final publication is available at wwwspringerlinkcom Degeneracy of the Linear Seventeen-Point Algorithm for Generalized Essential
More informationGeometric Modeling and Processing
Geometric Modeling and Processing Tutorial of 3DIM&PVT 2011 (Hangzhou, China) May 16, 2011 6. Mesh Simplification Problems High resolution meshes becoming increasingly available 3D active scanners Computer
More information8(x 2) + 21(y 1) + 6(z 3) = 0 8x + 21y + 6z = 55.
MATH 24 -Review for Final Exam. Let f(x, y, z) x 2 yz + y 3 z x 2 + z, and a (2,, 3). Note: f (2xyz 2x, x 2 z + 3y 2 z, x 2 y + y 3 + ) f(a) (8, 2, 6) (a) Find all stationary points (if any) of f. et f.
More informationReview 1. Richard Koch. April 23, 2005
Review Richard Koch April 3, 5 Curves From the chapter on curves, you should know. the formula for arc length in section.;. the definition of T (s), κ(s), N(s), B(s) in section.4. 3. the fact that κ =
More informationSolving Vision Tasks with variational methods on the GPU
Solving Vision Tasks with variational methods on the GPU Horst Bischof Inst. f. Computer Graphics and Vision Graz University of Technology Joint work with Thomas Pock, Markus Unger, Arnold Irschara and
More informationPanoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints
Panoramic 3D Reconstruction Using Rotational Stereo Camera with Simple Epipolar Constraints Wei Jiang Japan Science and Technology Agency 4-1-8, Honcho, Kawaguchi-shi, Saitama, Japan jiang@anken.go.jp
More informationIntroduction to Computer Vision. Introduction CMPSCI 591A/691A CMPSCI 570/670. Image Formation
Introduction CMPSCI 591A/691A CMPSCI 570/670 Image Formation Lecture Outline Light and Optics Pinhole camera model Perspective projection Thin lens model Fundamental equation Distortion: spherical & chromatic
More informationAdaptive Multi-Stage 2D Image Motion Field Estimation
Adaptive Multi-Stage 2D Image Motion Field Estimation Ulrich Neumann and Suya You Computer Science Department Integrated Media Systems Center University of Southern California, CA 90089-0781 ABSRAC his
More informationLearning Two-View Stereo Matching
Learning Two-View Stereo Matching Jianxiong Xiao Jingni Chen Dit-Yan Yeung Long Quan Department of Computer Science and Engineering The Hong Kong University of Science and Technology The 10th European
More informationGeneric Realtime Kernel based Tracking
Generic Realtime Kernel based Tracking Hicham Hadj-Abdelkader and Youcef Mezouar and Thierry Chateau Abstract This paper deals with the design of a generic visual tracking algorithm suitable for a large
More informationOn Iterations and Scales of Nonlinear Filters
O. Drbohlav (ed.): Proc. of the Computer Vision Winter Workshop 3 Valtice, Czech Republic, Feb. 3-, 3, pp. - Czech Pattern Recognition Society On Iterations and Scales of Nonlinear Filters Pavel rázek,
More informationDRC A Multi-Camera System on PC-Cluster for Real-time 3-D Tracking. Viboon Sangveraphunsiri*, Kritsana Uttamang, and Pongsakon Pedpunsri
The 23 rd Conference of the Mechanical Engineering Network of Thailand November 4 7, 2009, Chiang Mai A Multi-Camera System on PC-Cluster for Real-time 3-D Tracking Viboon Sangveraphunsiri*, Kritsana Uttamang,
More informationEfficient decoupled pose estimation from a set of points
Efficient decoupled pose estimation from a set of points Omar Tahri and Helder Araujo and Youcef Mezouar and François Chaumette Abstract This paper deals with pose estimation using an iterative scheme.
More informationAdvanced Image Reconstruction Methods for Photoacoustic Tomography
Advanced Image Reconstruction Methods for Photoacoustic Tomography Mark A. Anastasio, Kun Wang, and Robert Schoonover Department of Biomedical Engineering Washington University in St. Louis 1 Outline Photoacoustic/thermoacoustic
More informationDepth Estimation of Light Field Images by Optical Flow
Depth Estimation of Light Field Images by Optical Flow Marcus an mpanj@stanford.edu Abstract Light field images present a rich, compact, dataset of multiple images of a from slightly shifted viewpoints.
More informationPrecise Omnidirectional Camera Calibration
Precise Omnidirectional Camera Calibration Dennis Strelow, Jeffrey Mishler, David Koes, and Sanjiv Singh Carnegie Mellon University {dstrelow, jmishler, dkoes, ssingh}@cs.cmu.edu Abstract Recent omnidirectional
More informationCritical Configurations For Radial Distortion Self-Calibration. Changchang Wu Google Inc.
Critical Configurations For Radial Distortion Self-Calibration Changchang Wu Google Inc. 1 VisualSFM A Visual Structure from Motion System, 2011 SiftGPU + Multicore BA + Fast SfM + GUI Used in aerial survey,
More informationSung-Eui Yoon ( 윤성의 )
Path Planning for Point Robots Sung-Eui Yoon ( 윤성의 ) Course URL: http://sglab.kaist.ac.kr/~sungeui/mpa Class Objectives Motion planning framework Classic motion planning approaches 2 3 Configuration Space:
More informationRe-live the Movie Matrix : From Harry Nyquist to Image-Based Rendering. Tsuhan Chen Carnegie Mellon University Pittsburgh, USA
Re-live the Movie Matrix : From Harry Nyquist to Image-Based Rendering Tsuhan Chen tsuhan@cmu.edu Carnegie Mellon University Pittsburgh, USA Some History IEEE Multimedia Signal Processing (MMSP) Technical
More informationIntroduction to 3D Machine Vision
Introduction to 3D Machine Vision 1 Many methods for 3D machine vision Use Triangulation (Geometry) to Determine the Depth of an Object By Different Methods: Single Line Laser Scan Stereo Triangulation
More informationAirfoil Design Optimization Using Reduced Order Models Based on Proper Orthogonal Decomposition
Airfoil Design Optimization Using Reduced Order Models Based on Proper Orthogonal Decomposition.5.5.5.5.5.5.5..5.95.9.85.8.75.7 Patrick A. LeGresley and Juan J. Alonso Dept. of Aeronautics & Astronautics
More informationCamera Parameters Estimation from Hand-labelled Sun Sositions in Image Sequences
Camera Parameters Estimation from Hand-labelled Sun Sositions in Image Sequences Jean-François Lalonde, Srinivasa G. Narasimhan and Alexei A. Efros {jlalonde,srinivas,efros}@cs.cmu.edu CMU-RI-TR-8-32 July
More informationCommon-angle processing using reflection angle computed by kinematic pre-stack time demigration
Common-angle processing using reflection angle computed by kinematic pre-stack time demigration Didier Lecerf*, Philippe Herrmann, Gilles Lambaré, Jean-Paul Tourré and Sylvian Legleut, CGGVeritas Summary
More informationRegion Based Image Segmentation using a Modified Mumford-Shah Algorithm
Region Based Image Segmentation using a Modified Mumford-Shah Algorithm Jung-ha An and Yunmei Chen 2 Institute for Mathematics and its Applications (IMA), University of Minnesota, USA, 2 Department of
More information