Using Augmented Measurements to Improve the Convergence of ICP. Jacopo Serafin and Giorgio Grisetti

Size: px
Start display at page:

Download "Using Augmented Measurements to Improve the Convergence of ICP. Jacopo Serafin and Giorgio Grisetti"

Transcription

1 Jacopo Serafin and Giorgio Grisetti

2 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 2

3 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 3

4 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 4

5 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 5

6 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 6

7 Point Cloud Registration We want to find the rotation and the translation that maximize the overlap between two point clouds Page 7

8 Practical Applications Point cloud registration is a crucial building block for many applications: SLAM Object detection and recognition Augmented reality Page 8

9 Iterative Closest Point (ICP) 1 Algorithm ICP iteratively refine an initial transform T by alternating: search of correspondences between the two point clouds and the optimization step to update the current transform 1. Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence (1992) Page 9

10 Iterative Closest Point (ICP) 1 Algorithm ICP iteratively refine an initial transform T by alternating: search of correspondences between the two point clouds and the optimization step to update the current transform 1. Besl, P.J., McKay, N.D.: A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence (1992) Page 10

11 ICP Optimization Function T = argmin T C (p i T p j ) T (p i T p j ) At each iteration, ICP minimizes the squared Euclidean norm starting from the current transform T A point is a vector representing the coordinates in R 3 Page 11

12 ICP Variant: Generalized ICP (GICP) 2 T = argmin T Assumption: points are sampled from a locally continuous and smooth surface It minimizes a Mahalanobis distance As for standard ICP, a point is a vector representing the coordinates in R 3 C (p i T p j ) T Ω ij (p i T p j ) Information Matrix 2. Segal, A.V., Haehnel, D., Thrun, S.: Generalized-ICP. In: Proc. of Robotics: Science ad Systems (SS) (2009) Page 12

13 How to Improve ICP and its Variants The optimization and correspondences search are not independent An optimization step more robust to outliers and with a smoother behavior improves the overall results of the algorithm We need something more than a point to describe a surface element. The normal is a good candidate Page 13

14 Augmented Measurements Our point is a 6D vector representing the Euclidean coordinates and the surface normal p = (p x p y p z n x n y n z ) T Page 14

15 How to Compute the Information Matrix The goal is to have an Ω ij that scales the error so that: The normals of the points align The distance along the tangent plane is neglected The distance along the normal direction is penalized Page 15

16 Point Cloud Registration Examples Page 16

17 Convergence Speed Example Page 17

18 Robustness Example Page 18

19 Experiments We evaluated our algorithm against ICP and Generalized ICP We compared the evolution of the translational and rotational part of the error We performed experiments both on simulated data and on real standard benchmarking datasets 3 Simulated data plots show the evolution of the error under different percentage of outliers in the correspondences search Real data plots show the evolution of the error at different frame skipping rate 3. Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of rgb-d slam systems. In: Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) (2012) Page 19

20 Real Data Experiments Page 20

21 Simulated Data Experiments Page 21

22 Conclusions We achieved the following results: Increased robustness versus outliers and to frame skipping Faster convergence speed Better point cloud alignment Open source implementation available at: Page 22

23 Bibliography 1. Besl, P.J., McKay, N.D.: A method for registration of 3- D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence (1992) 2. Segal, A.V., Haehnel, D., Thrun, S.: Generalized-ICP. In: Proc. of Robotics: Science ad Systems (SS) (2009) 3. Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of rgb-d slam systems. In: Proc. of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS) (2012) Page 23

NICP: Dense Normal Based Point Cloud Registration

NICP: Dense Normal Based Point Cloud Registration NICP: Dense Normal Based Point Cloud Registration Jacopo Serafin 1 and Giorgio Grisetti 1 Abstract In this paper we present a novel on-line method to recursively align point clouds. By considering each

More information

Efficient SLAM Scheme Based ICP Matching Algorithm Using Image and Laser Scan Information

Efficient SLAM Scheme Based ICP Matching Algorithm Using Image and Laser Scan Information Proceedings of the World Congress on Electrical Engineering and Computer Systems and Science (EECSS 2015) Barcelona, Spain July 13-14, 2015 Paper No. 335 Efficient SLAM Scheme Based ICP Matching Algorithm

More information

Multi Channel Generalized-ICP

Multi Channel Generalized-ICP Multi Channel Generalized-ICP James Servos and Steven L. Waslander University of Waterloo, Waterloo, ON, Canada, N2L 3G1 Abstract Current state of the art scan registration algorithms which use only positional

More information

Color Supported Generalized-ICP 0

Color Supported Generalized-ICP 0 Color Supported Generalized-ICP 0 Michael Korn, Martin Holzkothen and Josef Pauli Lehrstuhl Intelligente Systeme, Universität Duisburg-Essen, 47057 Duisburg, Germany michael.korn@uni-due.de Keywords: Abstract:

More information

Incremental Structured ICP Algorithm

Incremental Structured ICP Algorithm Incremental Structured ICP Algorithm Haokun Geng, Johnny Chien, Radu Nicolescu, and Reinhard Klette The.enpeda.. Project, Tamaki Campus The University of Auckland, New Zealand Abstract. Variants of the

More information

Analyzing the Quality of Matched 3D Point Clouds of Objects

Analyzing the Quality of Matched 3D Point Clouds of Objects Analyzing the Quality of Matched 3D Point Clouds of Objects Igor Bogoslavskyi Cyrill Stachniss Abstract 3D laser scanners are frequently used sensors for mobile robots or autonomous cars and they are often

More information

High-speed Three-dimensional Mapping by Direct Estimation of a Small Motion Using Range Images

High-speed Three-dimensional Mapping by Direct Estimation of a Small Motion Using Range Images MECATRONICS - REM 2016 June 15-17, 2016 High-speed Three-dimensional Mapping by Direct Estimation of a Small Motion Using Range Images Shinta Nozaki and Masashi Kimura School of Science and Engineering

More information

Iterative Closest Point Algorithm in the Presence of Anisotropic Noise

Iterative Closest Point Algorithm in the Presence of Anisotropic Noise Iterative Closest Point Algorithm in the Presence of Anisotropic Noise L. Maier-Hein, T. R. dos Santos, A. M. Franz, H.-P. Meinzer German Cancer Research Center, Div. of Medical and Biological Informatics

More information

Integrating Depth and Color Cues for Dense Multi-Resolution Scene Mapping Using RGB-D Cameras

Integrating Depth and Color Cues for Dense Multi-Resolution Scene Mapping Using RGB-D Cameras In Proc. of the IEEE Int. Conf. on Multisensor Fusion and Information Integration (MFI), Hamburg, Germany, 2012 Integrating Depth and Color Cues for Dense Multi-Resolution Scene Mapping Using RGB-D Cameras

More information

Surface Registration. Gianpaolo Palma

Surface Registration. Gianpaolo Palma Surface Registration Gianpaolo Palma The problem 3D scanning generates multiple range images Each contain 3D points for different parts of the model in the local coordinates of the scanner Find a rigid

More information

Introduction to Mobile Robotics Iterative Closest Point Algorithm. Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras

Introduction to Mobile Robotics Iterative Closest Point Algorithm. Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras Introduction to Mobile Robotics Iterative Closest Point Algorithm Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras 1 Motivation 2 The Problem Given: two corresponding point sets: Wanted: translation

More information

Three-Dimensional Sensors Lecture 6: Point-Cloud Registration

Three-Dimensional Sensors Lecture 6: Point-Cloud Registration Three-Dimensional Sensors Lecture 6: Point-Cloud Registration Radu Horaud INRIA Grenoble Rhone-Alpes, France Radu.Horaud@inria.fr http://perception.inrialpes.fr/ Point-Cloud Registration Methods Fuse data

More information

Using RGB Information to Improve NDT Distribution Generation and Registration Convergence

Using RGB Information to Improve NDT Distribution Generation and Registration Convergence Using RGB Information to Improve NDT Distribution Generation and Registration Convergence James Servos and Steven L. Waslander University of Waterloo, Waterloo, ON, Canada, N2L 3G1 Abstract Unmanned vehicles

More information

Visually Bootstrapped Generalized ICP

Visually Bootstrapped Generalized ICP Visually Bootstrapped Generalized ICP Gaurav Pandey Department of Electrical Engineering & Computer Science University of Michigan, Ann Arbor, MI 809 Email: pgaurav@umich.edu Silvio Savarese Department

More information

Registration of Noisy Point Clouds using Virtual Interest Points

Registration of Noisy Point Clouds using Virtual Interest Points Registration of Noisy Point Clouds using Virtual Interest Points Mirza Tahir Ahmed, Mustafa Mohamad, Joshua A. Marshall, and Michael Greenspan Department of Electrical and Computer Engineering School of

More information

Scan Matching. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics

Scan Matching. Pieter Abbeel UC Berkeley EECS. Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Scan Matching Pieter Abbeel UC Berkeley EECS Many slides adapted from Thrun, Burgard and Fox, Probabilistic Robotics Scan Matching Overview Problem statement: Given a scan and a map, or a scan and a scan,

More information

Filtering and mapping systems for underwater 3D imaging sonar

Filtering and mapping systems for underwater 3D imaging sonar Filtering and mapping systems for underwater 3D imaging sonar Tomohiro Koshikawa 1, a, Shin Kato 1,b, and Hitoshi Arisumi 1,c 1 Field Robotics Research Group, National Institute of Advanced Industrial

More information

Registration of Non-Uniform Density 3D Point Clouds using Approximate Surface Reconstruction

Registration of Non-Uniform Density 3D Point Clouds using Approximate Surface Reconstruction Registration of Non-Uniform Density 3D Point Clouds using Approximate Surface Reconstruction Dirk Holz and Sven Behnke Autonomous Intelligent Systems Group, University of Bonn, Germany Abstract 3D laser

More information

Robust Rigid Point Registration based on Convolution of Adaptive Gaussian Mixture Models

Robust Rigid Point Registration based on Convolution of Adaptive Gaussian Mixture Models Robust Rigid Point Registration based on Convolution of Adaptive Gaussian Mixture Models Can Pu *, Nanbo Li *, Robert B Fisher * * University of Edinburgh {canpu999, linanbo2008}@gmail.com rbf@inf.ed.ac.uk

More information

Point Cloud Processing

Point Cloud Processing Point Cloud Processing Has anyone seen the toothpaste? Given a point cloud: how do you detect and localize objects? how do you map terrain? What is a point cloud? Point cloud: a set of points in 3-D space

More information

An Evaluation of the RGB-D SLAM System

An Evaluation of the RGB-D SLAM System An Evaluation of the RGB-D SLAM System Felix Endres 1 Jürgen Hess 1 Nikolas Engelhard 1 Jürgen Sturm 2 Daniel Cremers 2 Wolfram Burgard 1 Abstract We present an approach to simultaneous localization and

More information

3D Environment Reconstruction

3D Environment Reconstruction 3D Environment Reconstruction Using Modified Color ICP Algorithm by Fusion of a Camera and a 3D Laser Range Finder The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15,

More information

Robot Mapping for Rescue Robots

Robot Mapping for Rescue Robots Robot Mapping for Rescue Robots Nagesh Adluru Temple University Philadelphia, PA, USA nagesh@temple.edu Longin Jan Latecki Temple University Philadelphia, PA, USA latecki@temple.edu Rolf Lakaemper Temple

More information

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter

More information

Intensity Augmented ICP for Registration of Laser Scanner Point Clouds

Intensity Augmented ICP for Registration of Laser Scanner Point Clouds Intensity Augmented ICP for Registration of Laser Scanner Point Clouds Bharat Lohani* and Sandeep Sashidharan *Department of Civil Engineering, IIT Kanpur Email: blohani@iitk.ac.in. Abstract While using

More information

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter

More information

Elective in A.I. Robot Programming

Elective in A.I. Robot Programming Elective in A.I. Robot Programming 2014/2015 Prof: Daniele Nardi Perception with RGB D sensors Jacopo Serafin Point Cloud Library (PCL), Surface Normals, Generalized ICP Contact Jacopo Serafin Ph.D. Student

More information

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University. 3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction

More information

A Real-Time RGB-D Registration and Mapping Approach by Heuristically Switching Between Photometric And Geometric Information

A Real-Time RGB-D Registration and Mapping Approach by Heuristically Switching Between Photometric And Geometric Information A Real-Time RGB-D Registration and Mapping Approach by Heuristically Switching Between Photometric And Geometric Information The 17th International Conference on Information Fusion (Fusion 2014) Khalid

More information

Algorithm research of 3D point cloud registration based on iterative closest point 1

Algorithm research of 3D point cloud registration based on iterative closest point 1 Acta Technica 62, No. 3B/2017, 189 196 c 2017 Institute of Thermomechanics CAS, v.v.i. Algorithm research of 3D point cloud registration based on iterative closest point 1 Qian Gao 2, Yujian Wang 2,3,

More information

INFO0948 Fitting and Shape Matching

INFO0948 Fitting and Shape Matching INFO0948 Fitting and Shape Matching Renaud Detry University of Liège, Belgium Updated March 31, 2015 1 / 33 These slides are based on the following book: D. Forsyth and J. Ponce. Computer vision: a modern

More information

From Least-Squares to ICP

From Least-Squares to ICP From Least-Squares to ICP Giorgio Grisetti grisetti@dis.uniroma1.it Dept of Computer Control and Management Engineering Sapienza University of Rome Special thanks to Ulrich Wollath for reporting errors

More information

Range Image Registration with Edge Detection in Spherical Coordinates

Range Image Registration with Edge Detection in Spherical Coordinates Range Image Registration with Edge Detection in Spherical Coordinates Olcay Sertel 1 and Cem Ünsalan2 Computer Vision Research Laboratory 1 Department of Computer Engineering 2 Department of Electrical

More information

RGB-D Edge Detection and Edge-based Registration

RGB-D Edge Detection and Edge-based Registration 23 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) November 3-7, 23. Tokyo, Japan RGB-D Edge Detection and Edge-based Registration Changhyun Choi, Alexander J. B. Trevor, and

More information

Approximate Surface Reconstruction and Registration for RGB-D SLAM

Approximate Surface Reconstruction and Registration for RGB-D SLAM European Conference on Mobile Robotics (ECMR), Lincoln, UK, September 2015 Approximate Surface Reconstruction and Registration for RGB-D SLAM Dirk Holz and Sven Behnke Abstract RGB-D cameras have attracted

More information

Scan-point Planning and 3-D Map Building for a 3-D Laser Range Scanner in an Outdoor Environment

Scan-point Planning and 3-D Map Building for a 3-D Laser Range Scanner in an Outdoor Environment Scan-point Planning and 3-D Map Building for a 3-D Laser Range Scanner in an Outdoor Environment Keiji NAGATANI 1, Takayuki Matsuzawa 1, and Kazuya Yoshida 1 Tohoku University Summary. During search missions

More information

Real Time 3D Environment Modeling for a Mobile Robot by Aligning Range Image Sequences

Real Time 3D Environment Modeling for a Mobile Robot by Aligning Range Image Sequences Real Time 3D Environment Modeling for a Mobile Robot by Aligning Range Image Sequences Ryusuke Sagawa, Nanaho Osawa, Tomio Echigo and Yasushi Yagi Institute of Scientific and Industrial Research, Osaka

More information

Introduction to Mobile Robotics

Introduction to Mobile Robotics Introduction to Mobile Robotics Clustering Wolfram Burgard Cyrill Stachniss Giorgio Grisetti Maren Bennewitz Christian Plagemann Clustering (1) Common technique for statistical data analysis (machine learning,

More information

Tracking an RGB-D Camera Using Points and Planes

Tracking an RGB-D Camera Using Points and Planes MITSUBISHI ELECTRIC RESEARCH LABORATORIES http://www.merl.com Tracking an RGB-D Camera Using Points and Planes Ataer-Cansizoglu, E.; Taguchi, Y.; Ramalingam, S.; Garaas, T. TR2013-106 December 2013 Abstract

More information

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov Shape Matching & Correspondence CS 468 Geometry Processing Algorithms Maks Ovsjanikov Wednesday, October 27 th 2010 Overall Goal Given two shapes, find correspondences between them. Overall Goal Given

More information

Point Clouds Registration with Probabilistic Data Association

Point Clouds Registration with Probabilistic Data Association 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Daejeon Convention Center October 9-14, 2016, Daejeon, Korea Point Clouds Registration with Probabilistic Data Association

More information

Multi-Resolution Surfel Mapping and Real-Time Pose Tracking using a Continuously Rotating 2D Laser Scanner

Multi-Resolution Surfel Mapping and Real-Time Pose Tracking using a Continuously Rotating 2D Laser Scanner In Proceedings of 11th IEEE International Symposium on Safety, Security, and Rescue Robotics \\\(SSRR\\\), Linköping, Sweden, October 13. Multi-Resolution Surfel Mapping and Real-Time Pose Tracking using

More information

A Multi-Resolution ICP with Heuristic Closest Point Search for Fast and Robust 3D Registration of Range Images

A Multi-Resolution ICP with Heuristic Closest Point Search for Fast and Robust 3D Registration of Range Images A Multi-Resolution ICP with Heuristic Closest Point Search for Fast and Robust 3D Registration of Range Images Timothée Jost and Heinz Hügli Institute of Microtechnology, University of Neuchâtel, Breguet

More information

ICRA 2016 Tutorial on SLAM. Graph-Based SLAM and Sparsity. Cyrill Stachniss

ICRA 2016 Tutorial on SLAM. Graph-Based SLAM and Sparsity. Cyrill Stachniss ICRA 2016 Tutorial on SLAM Graph-Based SLAM and Sparsity Cyrill Stachniss 1 Graph-Based SLAM?? 2 Graph-Based SLAM?? SLAM = simultaneous localization and mapping 3 Graph-Based SLAM?? SLAM = simultaneous

More information

EM-BASED POINT TO PLANE ICP FOR 3D SIMULTANEOUS LOCALIZATION AND MAPPING

EM-BASED POINT TO PLANE ICP FOR 3D SIMULTANEOUS LOCALIZATION AND MAPPING International Journal of Robotics and Automation, Vol. 28, No. 3, 2013 EM-BASED POINT TO PLANE ICP FOR 3D SIMULTANEOUS LOCALIZATION AND MAPPING Yue Wang, Rong Xiong, and Qianshan Li Abstract 3D simultaneous

More information

Robust Point Matching for Two-Dimensional Nonrigid Shapes

Robust Point Matching for Two-Dimensional Nonrigid Shapes Robust Point Matching for Two-Dimensional Nonrigid Shapes Yefeng Zheng and David Doermann Language and Media Processing Laboratory Institute for Advanced Computer Studies University of Maryland, College

More information

Robust Online 3D Reconstruction Combining a Depth Sensor and Sparse Feature Points

Robust Online 3D Reconstruction Combining a Depth Sensor and Sparse Feature Points 2016 23rd International Conference on Pattern Recognition (ICPR) Cancún Center, Cancún, México, December 4-8, 2016 Robust Online 3D Reconstruction Combining a Depth Sensor and Sparse Feature Points Erik

More information

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System

Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Improvement and Evaluation of a Time-of-Flight-based Patient Positioning System Simon Placht, Christian Schaller, Michael Balda, André Adelt, Christian Ulrich, Joachim Hornegger Pattern Recognition Lab,

More information

University of Florida CISE department Gator Engineering. Clustering Part 2

University of Florida CISE department Gator Engineering. Clustering Part 2 Clustering Part 2 Dr. Sanjay Ranka Professor Computer and Information Science and Engineering University of Florida, Gainesville Partitional Clustering Original Points A Partitional Clustering Hierarchical

More information

Colored Point Cloud Registration Revisited Supplementary Material

Colored Point Cloud Registration Revisited Supplementary Material Colored Point Cloud Registration Revisited Supplementary Material Jaesik Park Qian-Yi Zhou Vladlen Koltun Intel Labs A. RGB-D Image Alignment Section introduced a joint photometric and geometric objective

More information

3D Shape Registration using Regularized Medial Scaffolds

3D Shape Registration using Regularized Medial Scaffolds 3D Shape Registration using Regularized Medial Scaffolds 3DPVT 2004 Thessaloniki, Greece Sep. 6-9, 2004 Ming-Ching Chang Frederic F. Leymarie Benjamin B. Kimia LEMS, Division of Engineering, Brown University

More information

Robust Laser Scan Matching in Dynamic Environments

Robust Laser Scan Matching in Dynamic Environments Proceedings of the 2009 IEEE International Conference on Robotics and Biomimetics December 19-23, 2009, Guilin, China Robust Laser Scan Matching in Dynamic Environments Hee-Young Kim, Sung-On Lee and Bum-Jae

More information

L17. OCCUPANCY MAPS. NA568 Mobile Robotics: Methods & Algorithms

L17. OCCUPANCY MAPS. NA568 Mobile Robotics: Methods & Algorithms L17. OCCUPANCY MAPS NA568 Mobile Robotics: Methods & Algorithms Today s Topic Why Occupancy Maps? Bayes Binary Filters Log-odds Occupancy Maps Inverse sensor model Learning inverse sensor model ML map

More information

10/03/11. Model Fitting. Computer Vision CS 143, Brown. James Hays. Slides from Silvio Savarese, Svetlana Lazebnik, and Derek Hoiem

10/03/11. Model Fitting. Computer Vision CS 143, Brown. James Hays. Slides from Silvio Savarese, Svetlana Lazebnik, and Derek Hoiem 10/03/11 Model Fitting Computer Vision CS 143, Brown James Hays Slides from Silvio Savarese, Svetlana Lazebnik, and Derek Hoiem Fitting: find the parameters of a model that best fit the data Alignment:

More information

Visual map matching and localization using a global feature map

Visual map matching and localization using a global feature map Visual map matching and localization using a global feature map Oliver Pink Institut für Mess- und Regelungstechnik Universität Karlsruhe (TH), 76128 Karlsruhe, Germany pink@mrt.uka.de Abstract This paper

More information

Least Squares and SLAM Pose-SLAM

Least Squares and SLAM Pose-SLAM Least Squares and SLAM Pose-SLAM Giorgio Grisetti Part of the material of this course is taken from the Robotics 2 lectures given by G.Grisetti, W.Burgard, C.Stachniss, K.Arras, D. Tipaldi and M.Bennewitz

More information

A 3D Point Cloud Registration Algorithm based on Feature Points

A 3D Point Cloud Registration Algorithm based on Feature Points International Conference on Information Sciences, Machinery, Materials and Energy (ICISMME 2015) A 3D Point Cloud Registration Algorithm based on Feature Points Yi Ren 1, 2, a, Fucai Zhou 1, b 1 School

More information

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm

Dense Tracking and Mapping for Autonomous Quadrocopters. Jürgen Sturm Computer Vision Group Prof. Daniel Cremers Dense Tracking and Mapping for Autonomous Quadrocopters Jürgen Sturm Joint work with Frank Steinbrücker, Jakob Engel, Christian Kerl, Erik Bylow, and Daniel Cremers

More information

arxiv: v1 [cs.ro] 24 Nov 2018

arxiv: v1 [cs.ro] 24 Nov 2018 BENCHMARKING AND COMPARING POPULAR VISUAL SLAM ALGORITHMS arxiv:1811.09895v1 [cs.ro] 24 Nov 2018 Amey Kasar Department of Electronics and Telecommunication Engineering Pune Institute of Computer Technology

More information

A VARIANT OF POINT-TO-PLANE REGISTRATION INCLUDING CYCLE MINIMIZATION

A VARIANT OF POINT-TO-PLANE REGISTRATION INCLUDING CYCLE MINIMIZATION A VARIANT OF POINT-TO-PLANE REGISTRATION INCLUDING CYCLE MINIMIZATION Carles Matabosch a, Elisabet Batlle a, David Fofi b and Joaquim Salvi a a Institut d Informatica i Aplicacions, University of Girona

More information

EE795: Computer Vision and Intelligent Systems

EE795: Computer Vision and Intelligent Systems EE795: Computer Vision and Intelligent Systems Spring 2012 TTh 17:30-18:45 FDH 204 Lecture 14 130307 http://www.ee.unlv.edu/~b1morris/ecg795/ 2 Outline Review Stereo Dense Motion Estimation Translational

More information

SIMULTANEOUS REGISTRATION OF MULTIPLE VIEWS OF A 3D OBJECT Helmut Pottmann a, Stefan Leopoldseder a, Michael Hofer a

SIMULTANEOUS REGISTRATION OF MULTIPLE VIEWS OF A 3D OBJECT Helmut Pottmann a, Stefan Leopoldseder a, Michael Hofer a SIMULTANEOUS REGISTRATION OF MULTIPLE VIEWS OF A 3D OBJECT Helmut Pottmann a, Stefan Leopoldseder a, Michael Hofer a a Institute of Geometry, Vienna University of Technology, Wiedner Hauptstr. 8 10, A

More information

Registration D.A. Forsyth, UIUC

Registration D.A. Forsyth, UIUC Registration D.A. Forsyth, UIUC Registration Place a geometric model in correspondence with an image could be 2D or 3D model up to some transformations possibly up to deformation Applications very important

More information

Efficient Estimation of Accurate Maximum Likelihood Maps in 3D

Efficient Estimation of Accurate Maximum Likelihood Maps in 3D Efficient Estimation of Accurate Maximum Likelihood Maps in 3D Giorgio Grisetti Slawomir Grzonka Cyrill Stachniss Patrick Pfaff Wolfram Burgard Abstract Learning maps is one of the fundamental tasks of

More information

of Iterative Closest Point ICP algorithm to

of Iterative Closest Point ICP algorithm to Iterative Closest Point Algorithm. L Error Approach via Linear Programming Yaroslav O. Halchenko PhD Student, CS@NJIT yh42@njit.edu Abstract The original goal of this project was a straightforward implementation

More information

arxiv: v1 [cs.ro] 20 Sep 2017

arxiv: v1 [cs.ro] 20 Sep 2017 Robust and Fast 3D Scan Alignment using Mutual Information Nikhil Mehta 1, James R. McBride 2 and Gaurav Pandey 2 arxiv:1709.06948v1 [cs.ro] 20 Sep 2017 Abstract This paper presents a mutual information

More information

5.2 Surface Registration

5.2 Surface Registration Spring 2018 CSCI 621: Digital Geometry Processing 5.2 Surface Registration Hao Li http://cs621.hao-li.com 1 Acknowledgement Images and Slides are courtesy of Prof. Szymon Rusinkiewicz, Princeton University

More information

Experimental Analysis of Dynamic Covariance Scaling for Robust Map Optimization Under Bad Initial Estimates

Experimental Analysis of Dynamic Covariance Scaling for Robust Map Optimization Under Bad Initial Estimates Experimental Analysis of Dynamic Covariance Scaling for Robust Map Optimization Under Bad Initial Estimates Pratik Agarwal Giorgio Grisetti Gian Diego Tipaldi Luciano Spinello Wolfram Burgard Cyrill Stachniss

More information

#$ % $ $& "$%% " $ '$ " '

#$ % $ $& $%%  $ '$  ' ! " This section of the course covers techniques for pairwise (i.e., scanto-scan) and global (i.e., involving more than 2 scans) alignment, given that the algorithms are constrained to obtain a rigid-body

More information

Geometric Modeling and Processing

Geometric Modeling and Processing Geometric Modeling and Processing Tutorial of 3DIM&PVT 2011 (Hangzhou, China) May 16, 2011 4. Geometric Registration 4.1 Rigid Registration Range Scanning: Reconstruction Set of raw scans Reconstructed

More information

HSM3D: Feature-Less Global 6DOF Scan-Matching in the Hough/Radon Domain

HSM3D: Feature-Less Global 6DOF Scan-Matching in the Hough/Radon Domain HSM3D: Feature-Less Global 6DOF Scan-Matching in the Hough/Radon Domain Andrea Censi Stefano Carpin Caltech 3D data alignment how-to The data is 3D, but the sensor motion is 2D? (e.g., 3D scanner on a

More information

Multi Robot Object-based SLAM

Multi Robot Object-based SLAM Multi Robot Object-based SLAM Siddharth Choudhary 1, Luca Carlone 2, Carlos Nieto 1, John Rogers 3, Zhen Liu 1, Henrik I. Christensen 1, and Frank Dellaert 1 1 Institute for Robotics and Intelligent Machines,

More information

3D Models from Range Sensors. Gianpaolo Palma

3D Models from Range Sensors. Gianpaolo Palma 3D Models from Range Sensors Gianpaolo Palma Who Gianpaolo Palma Researcher at Visual Computing Laboratory (ISTI-CNR) Expertise: 3D scanning, Mesh Processing, Computer Graphics E-mail: gianpaolo.palma@isti.cnr.it

More information

Overlap-based ICP Tuning for Robust Localization of a Humanoid Robot

Overlap-based ICP Tuning for Robust Localization of a Humanoid Robot Overlap-based ICP Tuning for Robust Localization of a Humanoid Robot Simona Nobili, Raluca Scona, Marco Caravagna, Maurice Fallon Abstract State estimation techniques for humanoid robots are typically

More information

Distance Functions 1

Distance Functions 1 Distance Functions 1 Distance function Given: geometric object F (curve, surface, solid, ) Assigns to each point the shortest distance from F Level sets of the distance function are trimmed offsets F p

More information

Improving Simultaneous Mapping and Localization in 3D Using Global Constraints

Improving Simultaneous Mapping and Localization in 3D Using Global Constraints Improving Simultaneous Mapping and Localization in 3D Using Global Constraints Rudolph Triebel and Wolfram Burgard Department of Computer Science, University of Freiburg George-Koehler-Allee 79, 79108

More information

Introduction to Computer Science

Introduction to Computer Science DM534 Introduction to Computer Science Clustering and Feature Spaces Richard Roettger: About Me Computer Science (Technical University of Munich and thesis at the ICSI at the University of California at

More information

3D face recognition based on a modified ICP method

3D face recognition based on a modified ICP method University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2011 3D face recognition based on a modified ICP method Kankan Zhao University

More information

Monocular Tracking and Reconstruction in Non-Rigid Environments

Monocular Tracking and Reconstruction in Non-Rigid Environments Monocular Tracking and Reconstruction in Non-Rigid Environments Kick-Off Presentation, M.Sc. Thesis Supervisors: Federico Tombari, Ph.D; Benjamin Busam, M.Sc. Patrick Ruhkamp 13.01.2017 Introduction Motivation:

More information

Automatic registration of terrestrial laser scans for geological deformation monitoring

Automatic registration of terrestrial laser scans for geological deformation monitoring Automatic registration of terrestrial laser scans for geological deformation monitoring Daniel Wujanz 1, Michael Avian 2, Daniel Krueger 1, Frank Neitzel 1 1 Chair of Geodesy and Adjustment Theory, Technische

More information

User-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott

User-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott User-assisted Segmentation and 3D Motion Tracking Michael Fleder Sudeep Pillai Jeremy Scott 3D Object Tracking Virtual reality and animation Imitation in robotics Autonomous driving Augmented reality Motivation

More information

Dense 3D Reconstruction from Autonomous Quadrocopters

Dense 3D Reconstruction from Autonomous Quadrocopters Dense 3D Reconstruction from Autonomous Quadrocopters Computer Science & Mathematics TU Munich Martin Oswald, Jakob Engel, Christian Kerl, Frank Steinbrücker, Jan Stühmer & Jürgen Sturm Autonomous Quadrocopters

More information

Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior

Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior David C. Schneider and Peter Eisert Fraunhofer Heinrich Hertz Institute Einsteinufer 37, 10587 Berlin, Germany {david.schneider,eisert}@hhi.fraunhofer.de

More information

AUTOMATIC ORIENTATION AND MERGING OF LASER SCANNER ACQUISITIONS THROUGH VOLUMETRIC TARGETS: PROCEDURE DESCRIPTION AND TEST RESULTS

AUTOMATIC ORIENTATION AND MERGING OF LASER SCANNER ACQUISITIONS THROUGH VOLUMETRIC TARGETS: PROCEDURE DESCRIPTION AND TEST RESULTS AUTOMATIC ORIENTATION AND MERGING OF LASER SCANNER ACQUISITIONS THROUGH VOLUMETRIC TARGETS: PROCEDURE DESCRIPTION AND TEST RESULTS G.Artese a, V.Achilli b, G.Salemi b, A.Trecroci a a Dept. of Land Planning,

More information

Evaluation of 3D Registration Reliability and Speed A Comparison of ICP and NDT

Evaluation of 3D Registration Reliability and Speed A Comparison of ICP and NDT Evaluation of 3D Registration Reliability and Speed A Comparison of ICP and NDT Martin Magnusson, Andreas Nüchter, Christopher Lörken, Achim J. Lilienthal, and Joachim Hertzberg Abstract To advance robotic

More information

Introduction to Mobile Robotics SLAM Grid-based FastSLAM. Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Diego Tipaldi, Luciano Spinello

Introduction to Mobile Robotics SLAM Grid-based FastSLAM. Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Diego Tipaldi, Luciano Spinello Introduction to Mobile Robotics SLAM Grid-based FastSLAM Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Diego Tipaldi, Luciano Spinello 1 The SLAM Problem SLAM stands for simultaneous localization

More information

Monocular Camera Localization in 3D LiDAR Maps

Monocular Camera Localization in 3D LiDAR Maps Monocular Camera Localization in 3D LiDAR Maps Tim Caselitz Bastian Steder Michael Ruhnke Wolfram Burgard Abstract Localizing a camera in a given map is essential for vision-based navigation. In contrast

More information

A NEW AUTOMATIC SYSTEM CALIBRATION OF MULTI-CAMERAS AND LIDAR SENSORS

A NEW AUTOMATIC SYSTEM CALIBRATION OF MULTI-CAMERAS AND LIDAR SENSORS A NEW AUTOMATIC SYSTEM CALIBRATION OF MULTI-CAMERAS AND LIDAR SENSORS M. Hassanein a, *, A. Moussa a,b, N. El-Sheimy a a Department of Geomatics Engineering, University of Calgary, Calgary, Alberta, Canada

More information

g2o: A General Framework for Graph Optimization Rainer Kümmerle Giorgio Grisetti Hauke Strasdat Kurt Konolige Wolfram Burgard

g2o: A General Framework for Graph Optimization Rainer Kümmerle Giorgio Grisetti Hauke Strasdat Kurt Konolige Wolfram Burgard g2o: A General Framework for Graph Optimization Rainer Kümmerle Giorgio Grisetti Hauke Strasdat Kurt Konolige Wolfram Burgard Graph-Based SLAM Constraints connect the poses of the robot while it is moving

More information

FEATURE-BASED REGISTRATION OF RANGE IMAGES IN DOMESTIC ENVIRONMENTS

FEATURE-BASED REGISTRATION OF RANGE IMAGES IN DOMESTIC ENVIRONMENTS FEATURE-BASED REGISTRATION OF RANGE IMAGES IN DOMESTIC ENVIRONMENTS Michael Wünstel, Thomas Röfer Technologie-Zentrum Informatik (TZI) Universität Bremen Postfach 330 440, D-28334 Bremen {wuenstel, roefer}@informatik.uni-bremen.de

More information

Probabilistic Robotics

Probabilistic Robotics Probabilistic Robotics FastSLAM Sebastian Thrun (abridged and adapted by Rodrigo Ventura in Oct-2008) The SLAM Problem SLAM stands for simultaneous localization and mapping The task of building a map while

More information

CRF Based Point Cloud Segmentation Jonathan Nation

CRF Based Point Cloud Segmentation Jonathan Nation CRF Based Point Cloud Segmentation Jonathan Nation jsnation@stanford.edu 1. INTRODUCTION The goal of the project is to use the recently proposed fully connected conditional random field (CRF) model to

More information

Tracking system. Danica Kragic. Object Recognition & Model Based Tracking

Tracking system. Danica Kragic. Object Recognition & Model Based Tracking Tracking system Object Recognition & Model Based Tracking Motivation Manipulating objects in domestic environments Localization / Navigation Object Recognition Servoing Tracking Grasping Pose estimation

More information

STRUCTURAL ICP ALGORITHM FOR POSE ESTIMATION BASED ON LOCAL FEATURES

STRUCTURAL ICP ALGORITHM FOR POSE ESTIMATION BASED ON LOCAL FEATURES STRUCTURAL ICP ALGORITHM FOR POSE ESTIMATION BASED ON LOCAL FEATURES Marco A. Chavarria, Gerald Sommer Cognitive Systems Group. Christian-Albrechts-University of Kiel, D-2498 Kiel, Germany {mc,gs}@ks.informatik.uni-kiel.de

More information

Using Vision for Pre- and Post-Grasping Object Localization for Soft Hands

Using Vision for Pre- and Post-Grasping Object Localization for Soft Hands Using Vision for Pre- and Post-Grasping Object Localization for Soft Hands Changhyun Choi, Joseph DelPreto, and Daniela Rus Computer Science & Artificial Intelligence Lab Massachusetts Institute of Technology

More information

DeReEs: Real-Time Registration of RGBD Images Using Image-Based Feature Detection And Robust 3D Correspondence Estimation and Refinement

DeReEs: Real-Time Registration of RGBD Images Using Image-Based Feature Detection And Robust 3D Correspondence Estimation and Refinement DeReEs: Real-Time Registration of RGBD Images Using Image-Based Feature Detection And Robust 3D Correspondence Estimation and Refinement Sahand Seifi Memorial University of Newfoundland sahands[at]mun.ca

More information

Octree-Based Obstacle Representation and Registration for Real-Time

Octree-Based Obstacle Representation and Registration for Real-Time Octree-Based Obstacle Representation and Registration for Real-Time Jaewoong Kim, Daesik Kim, Junghyun Seo, Sukhan Lee and Yeonchool Park* Intelligent System Research Center (ISRC) & Nano and Intelligent

More information

3D Point Cloud Processing

3D Point Cloud Processing 3D Point Cloud Processing The image depicts how our robot Irma3D sees itself in a mirror. The laser looking into itself creates distortions as well as changes in intensity that give the robot a single

More information

k-means A classical clustering algorithm

k-means A classical clustering algorithm k-means A classical clustering algorithm Devert Alexandre School of Software Engineering of USTC 30 November 2012 Slide 1/65 Table of Contents 1 Introduction 2 Visual demo Step by step Voronoi diagrams

More information

PL-SVO: Semi-Direct Monocular Visual Odometry by Combining Points and Line Segments

PL-SVO: Semi-Direct Monocular Visual Odometry by Combining Points and Line Segments 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) Daejeon Convention Center October 9-14, 2016, Daejeon, Korea PL-SVO: Semi-Direct Monocular Visual Odometry by Combining Points

More information