LOCAL AND GLOBAL DESCRIPTORS FOR PLACE RECOGNITION IN ROBOTICS
|
|
- Annis Bryan
- 5 years ago
- Views:
Transcription
1 8th International DAAAM Baltic Conference "INDUSTRIAL ENGINEERING April 2012, Tallinn, Estonia LOCAL AND GLOBAL DESCRIPTORS FOR PLACE RECOGNITION IN ROBOTICS Shvarts, D. & Tamre, M. Abstract: The simultaneous autolocalization and mapping of the environment is one of the most pressing problems of robotics. Among the existing SLAM algorithms, place recognition is a must for several cases. As an example, in multirobot SLAM we have several individual maps created by various robots. In order to combine them into one global map we have to identify common places before merging them. In this paper, two methods that were successfully used for performing scene recognition between different images have been compared. We have considered the advantages and limitations of each method regarding our tasks. Key words: local descriptors, global descriptors, GIST, SIFT, SURF. 1. INTRODUCTION SLAM, standing for Simultaneous Localization and Mapping, tries to locate a mobile robot in its environment and estimate a map of it from sensory information [1]. A wide array of sensors have been used, but nowadays cameras are the preferred ones. At its core, SLAM algorithms apply sequential estimation techniques that estimate a model from noisy data. In a SLAM framework, the ability of recognizing a previously mapped area is useful in several occasions: for correcting the estimation drift when an area is revisited (a problem known as loop closure) [2]; for relocation in an estimated map (the kidnapped robot problem) [3]; or 351 for fusing information between multiple robots that are mapping the same area (multi-robot SLAM) [4]. Place recognition in visual SLAM has been usually addressed by constructing a visual vocabulary of local descriptors [2, 3]. Such vocabulary can be expensive to build and store if a robot performs an exploratory trajectory and accumulates new images. While there exists global descriptors in the computer vision literature, they have never been used in SLAM. This paper proposes the comparison of several local and global descriptors for the purpose of place recognition in robotics, both in terms of performance and computational cost. 2. LOCAL DESCRIPTORS In computer vision, local interest points have been used to solve many problems like object recognition, image registration, 3D reconstruction, and more. The usual approach is based on selecting some points in the image and perform a local analysis on theses ones. For a successfully work of such methods, a sufficient number of such keypoints have to be detected. In addition, these points should be distinguishable and stable features that can be accurately localized. A lot of research on the behavior of several types of feature descriptor and detectors has been done. We compared the results of such investigations to select the appropriate feature descriptor and detector for further work. The best feature detector has to meet the following requirements:
2 The extracted keypoints have to be rotation and scale invariant. Invariance to luminance transformation, at least partly. Invariant to blur and noise. A comparison of six methods that were implemented in OpenCV library was showed in [10]. Five quality and one performance test was done for each kind of descriptor. Fig. 3. The result of lighting test for OpenCV s feature detector algorithms. Based on the materials presented in [10] there are two descriptors that showed the most stable results SIFT and SURF. It should also be noticed that these algorithms are the slowest among all the tested [Fig. 4]. Fig. 1. The result of rotation test for OpenCV s feature detector algorithms. [Fig. 1] shows that almost all algorithms are partially invariant to rotation except BRIEF, presenting SIFT the best repeatability. Close to SIFT are ORB and SURF feature descriptors. [Fig. 2] shows the scale invariance performance of different algorithms. Fig. 2. The Scale test for OpenCV's features detector algorithms. Again, the most stable results showed SURF and SIFT descriptors. Almost all the descriptors have a high degree of invariance to brightness change, as shown in [Fig. 3] Fig. 4. Speed test of OpenCV's implemented algorithms The use of these algorithms in real-time applications could be limited due to these computational cost. However, the high quality of the calculated keypoints makes these algorithms irreplaceable for solving many problems in computer vision. A detailed description of those algorithms is not presented here for the sake of brevity. The reader is referred to the original papers [7] and [13] for a deep understanding of both algorithms. We carried out several additional tests with SIFT and SURF algorithms to determine witch of those has the most suitable performances for our particular purpose. The results are presented in (Fig. 5) and in table
3 Fig. 5. a) A test-image with extracted keypoints by using SIFT descriptor, b) the same image with extracted keypoints by applying SURF descriptor SURF SIFT Image size 480x640x3 480x640x3 Number of points extracted keypoints keypoints The execution time ms ms Table 1. The comparison of two local descriptors. Both SIFT and SURF descriptors have showed similar results and could apply for solving a issue in SLAM application but with certain limitations. The number of extracted keypoints has played a major role by choosing suitable descriptors for further work. 3. GLOBAL DESCRIPTORS In the previous section we have investigated the properties of different local descriptors. There are several descriptors and we can choose the best one to accomplish specific task. But if we use a local descriptor, the representation of a whole image is restricted to the description of a set of points that was successfully extracted from the image. In contrast, global descriptors summarize the whole image in a single descriptor, being GIST the most representative [8]. We are going to highlight the major aspects of global descriptors in this chapter. Investigation in the field of global descriptor is conditional upon that the recognition of the real world scene based on encoding the global configuration, ignoring most of the details and objects information [8]. The abstract description of a scene can be obtained by discrete Fourier transformation of an image:, 1,, is the intensity distribution of the image along a spatial variables,, and are the spatial frequency variables. The complex function, can be decomposed into two terms,,, the amplitude spectrum of the image, and, the phase function of Fourier transformation. The phase function represents the information relative to local properties and amplitude spectrum give unlocalized information about to the image structure. The energy spectrum of Fourier transformation,, is a distribution of signal s energy among the different spatial frequencies. The global description of a scene is encoded in this distribution and provides dimensional representation of the image,. It is impossible to operate with such representation of the image in practice, due to the high dimensionality of energy spectrum. The standard way for data reduction of matrix of energy spectrum is principal components analysis. It is needed to rearrange the matrix representation in a column vector than PCA extracts a subspace spanned by a subset of a KL functions. The direct implementation of this method is impossible in practice. The reliable calculation of the KL basis function required a number of image samples more then. But in practice we don't have them usually. [8] suggests sampling the function, as: 353
4 ,, being are a set of Gaussian functions. We have tested the MATLAB code (created by author) to examine properties of GIST descriptor and the possibility to use it instead of local descriptors for scene matching. 4. EXPERIMENTAL RESULTS In this section we examine two different descriptors, global and local. The aim of the experiment is to prove the ability of the descriptors to match two images of the same scene. The way of solving this problem is well understood. The problem consists of estimation of homography between pairs of images. First we have tested the local descriptor. The algorithm is presented below: Algorithm: Local descriptor in problem of matching of two images. Input: Two putative matched images. 1. Extract SIFT features from first and second image. In this section we use SIFT descriptor based on studies in section Estimation of putative correspondences: Find k nearest-neighbors for each feature. From the featurematching step we have identified images that have a large number of matches between them. Than we consider m images that have a largest number of matched points and use RANSAC to select of inliers that are have an impact on calculation of homography. 3. Fundamental matrix estimation: Find geometrically consistent feature matches using RANSAC to solve for the fundamental matrix computation between pairs of images. We just select the image that has a largest number of inlier points. Output: Two matched images. The better way is presented in [12]. But in our case we have made a simper experiment. In the next experiment we examine the properties of a GIST descriptors for automatic image matching. As input set we use the same set of images. During the experiment we calculate the gist descriptor for each image. The best matching is an image with a smaller distance between GIST vectors. The result of two experiments was obvious. All descriptors are invariant to rotation and scaling. As we said earlier, we don't look at the execution time of methods. We focused more on the properties of methods. Both methods can be successfully applied for the automatic matching of images. But without any additional measurement of performances is obvious that GIST descriptor is faster. Fig. 6. Dynamic of SIFT descriptor by image matching. In the top image the result of matched points is 44. And we show an increase of numbers of matched points from 44 at the top to 158 points in the bottom image. We show in the figure 7 the result of the GIST descriptor. 354
5 global descriptors regarding performance and cost. b) Fig. 7. Image a) is an input image for a GIST descriptor b) output from the GISTtest algorithm. a) Finally, we describe an image set. As input for algorithm we chooses the first image from the 586 sets of images. The set of images is an image sequence created from the moving camera. The image resolution is 568x320 pixels. 5. CONCLUSION In this paper we have tested different image descriptors, several local and a global one, in order to foresee its possible use in a robotic application. From the several local descriptors that have been evaluated we observe a compromise between speed and performance: SIFT and SURF present the higher invariance to different transformations, but are more expensive to compute than the rest of the local descriptors. Regarding the global descriptor GIST, we have observed a good performance for scene recognition, a higher compacity and possibly low cost, which indicates a good potential for image matching in robotics. As future work, our aim is to perform a detailed comparison between local and 5. REFERENCES [1] H. Durrant-Whyte and T. Bailey, Simultaneous localization and mapping (SLAM): Part I the essential algorithms Robotics and Automation Magazine, vol. 13, no. 2, pp , [2] D. Galvez-Lopez and J. D. Tardos, Real-time loop detection with bags of binary words Intelligent Robots and Systems (IROS), 2011 IEEE/RSJ International Conference on, sept. 2011, pp [3] B. Williams, G. Klein, and I. Reid, Real-time SLAM relocalisation in IEEE 11th International Conference on Computer Vision, 2007, p. 1:8. [4] S. Thrun and Y. Liu, Multi-robot slam with sparse extended information filers Robotics Research, pp , [5] K.Mikolajczyk,T.Tuytelaars,C.Schmi,A.Zi sserman,j.matas,f.schaffalitzky, T. Kadir, and L. Gool, A comparison of affine region detectors International Journal of Computer Vision, vol. 65, no. 1, pp , [6] K. Mikolajczyk and C. Schmid, A performance evaluation of local descriptors Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 27, no. 10, pp , [7] D. G. Lowe, Distinctive image features from scale-invariant keypoints Interna- tional Journal of Computer Vision, vol. 60, no. 2, pp , [8] A. Oliva and A. Torralba, Modeling the shape of the scene: A holistic representation of the spatial envelope International Journal of Computer Vision, vol. 42, no. 3, pp , [9] B. Williams, M. Cummins, J. Neira, P. Newman, I. Reid, and J. Tardos, An image to map loop closing method for monocular SLAM in IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2008, 2008, pp
6 [10] Feature descriptor comparison report [11] R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision ISBN: , 2000 [12] M. Brown, D. G. Lowe, Recognising Panoramas. [13] Herbert Bay, Andreas Ess, Tinne Tuytelaars, Luc Van Gool, SURF: Speeded Up Robust Features, Computer Vision and Image Understanding (CVIU), Vol. 110, No. 3, pp ,
Ensemble of Bayesian Filters for Loop Closure Detection
Ensemble of Bayesian Filters for Loop Closure Detection Mohammad Omar Salameh, Azizi Abdullah, Shahnorbanun Sahran Pattern Recognition Research Group Center for Artificial Intelligence Faculty of Information
More informationA Comparison of SIFT, PCA-SIFT and SURF
A Comparison of SIFT, PCA-SIFT and SURF Luo Juan Computer Graphics Lab, Chonbuk National University, Jeonju 561-756, South Korea qiuhehappy@hotmail.com Oubong Gwun Computer Graphics Lab, Chonbuk National
More informationSURF applied in Panorama Image Stitching
Image Processing Theory, Tools and Applications SURF applied in Panorama Image Stitching Luo Juan 1, Oubong Gwun 2 Computer Graphics Lab, Computer Science & Computer Engineering, Chonbuk National University,
More informationBuilding a Panorama. Matching features. Matching with Features. How do we build a panorama? Computational Photography, 6.882
Matching features Building a Panorama Computational Photography, 6.88 Prof. Bill Freeman April 11, 006 Image and shape descriptors: Harris corner detectors and SIFT features. Suggested readings: Mikolajczyk
More informationLecture 10 Detectors and descriptors
Lecture 10 Detectors and descriptors Properties of detectors Edge detectors Harris DoG Properties of detectors SIFT Shape context Silvio Savarese Lecture 10-26-Feb-14 From the 3D to 2D & vice versa P =
More informationImplementation and Comparison of Feature Detection Methods in Image Mosaicing
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-issn: 2278-2834,p-ISSN: 2278-8735 PP 07-11 www.iosrjournals.org Implementation and Comparison of Feature Detection Methods in Image
More informationSURF: Speeded Up Robust Features. CRV Tutorial Day 2010 David Chi Chung Tam Ryerson University
SURF: Speeded Up Robust Features CRV Tutorial Day 2010 David Chi Chung Tam Ryerson University Goals of SURF A fast interest point detector and descriptor Maintaining comparable performance with other detectors
More informationFeature Based Registration - Image Alignment
Feature Based Registration - Image Alignment Image Registration Image registration is the process of estimating an optimal transformation between two or more images. Many slides from Alexei Efros http://graphics.cs.cmu.edu/courses/15-463/2007_fall/463.html
More informationDeterminant of homography-matrix-based multiple-object recognition
Determinant of homography-matrix-based multiple-object recognition 1 Nagachetan Bangalore, Madhu Kiran, Anil Suryaprakash Visio Ingenii Limited F2-F3 Maxet House Liverpool Road Luton, LU1 1RS United Kingdom
More informationObject Recognition with Invariant Features
Object Recognition with Invariant Features Definition: Identify objects or scenes and determine their pose and model parameters Applications Industrial automation and inspection Mobile robots, toys, user
More informationSalient Visual Features to Help Close the Loop in 6D SLAM
Visual Features to Help Close the Loop in 6D SLAM Lars Kunze, Kai Lingemann, Andreas Nüchter, and Joachim Hertzberg University of Osnabrück, Institute of Computer Science Knowledge Based Systems Research
More informationIII. VERVIEW OF THE METHODS
An Analytical Study of SIFT and SURF in Image Registration Vivek Kumar Gupta, Kanchan Cecil Department of Electronics & Telecommunication, Jabalpur engineering college, Jabalpur, India comparing the distance
More informationK-Means Based Matching Algorithm for Multi-Resolution Feature Descriptors
K-Means Based Matching Algorithm for Multi-Resolution Feature Descriptors Shao-Tzu Huang, Chen-Chien Hsu, Wei-Yen Wang International Science Index, Electrical and Computer Engineering waset.org/publication/0007607
More informationA Novel Extreme Point Selection Algorithm in SIFT
A Novel Extreme Point Selection Algorithm in SIFT Ding Zuchun School of Electronic and Communication, South China University of Technolog Guangzhou, China zucding@gmail.com Abstract. This paper proposes
More informationComparison of Feature Detection and Matching Approaches: SIFT and SURF
GRD Journals- Global Research and Development Journal for Engineering Volume 2 Issue 4 March 2017 ISSN: 2455-5703 Comparison of Detection and Matching Approaches: SIFT and SURF Darshana Mistry PhD student
More informationMotion Estimation and Optical Flow Tracking
Image Matching Image Retrieval Object Recognition Motion Estimation and Optical Flow Tracking Example: Mosiacing (Panorama) M. Brown and D. G. Lowe. Recognising Panoramas. ICCV 2003 Example 3D Reconstruction
More informationLocal Image Features
Local Image Features Ali Borji UWM Many slides from James Hayes, Derek Hoiem and Grauman&Leibe 2008 AAAI Tutorial Overview of Keypoint Matching 1. Find a set of distinctive key- points A 1 A 2 A 3 B 3
More informationAppearance-Based Place Recognition Using Whole-Image BRISK for Collaborative MultiRobot Localization
Appearance-Based Place Recognition Using Whole-Image BRISK for Collaborative MultiRobot Localization Jung H. Oh, Gyuho Eoh, and Beom H. Lee Electrical and Computer Engineering, Seoul National University,
More informationMulti-modal Registration of Visual Data. Massimiliano Corsini Visual Computing Lab, ISTI - CNR - Italy
Multi-modal Registration of Visual Data Massimiliano Corsini Visual Computing Lab, ISTI - CNR - Italy Overview Introduction and Background Features Detection and Description (2D case) Features Detection
More informationVK Multimedia Information Systems
VK Multimedia Information Systems Mathias Lux, mlux@itec.uni-klu.ac.at Dienstags, 16.oo Uhr This work is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Agenda Evaluations
More informationLocal features and image matching. Prof. Xin Yang HUST
Local features and image matching Prof. Xin Yang HUST Last time RANSAC for robust geometric transformation estimation Translation, Affine, Homography Image warping Given a 2D transformation T and a source
More informationLecture 4.1 Feature descriptors. Trym Vegard Haavardsholm
Lecture 4.1 Feature descriptors Trym Vegard Haavardsholm Feature descriptors Histogram of Gradients (HoG) descriptors Binary descriptors 2 Histogram of Gradients (HOG) descriptors Scale Invariant Feature
More informationEvaluation and comparison of interest points/regions
Introduction Evaluation and comparison of interest points/regions Quantitative evaluation of interest point/region detectors points / regions at the same relative location and area Repeatability rate :
More informationSIFT: Scale Invariant Feature Transform
1 / 25 SIFT: Scale Invariant Feature Transform Ahmed Othman Systems Design Department University of Waterloo, Canada October, 23, 2012 2 / 25 1 SIFT Introduction Scale-space extrema detection Keypoint
More informationarxiv: v1 [cs.cv] 1 Jan 2019
Mapping Areas using Computer Vision Algorithms and Drones Bashar Alhafni Saulo Fernando Guedes Lays Cavalcante Ribeiro Juhyun Park Jeongkyu Lee University of Bridgeport. Bridgeport, CT, 06606. United States
More informationAutomatic Image Alignment
Automatic Image Alignment Mike Nese with a lot of slides stolen from Steve Seitz and Rick Szeliski 15-463: Computational Photography Alexei Efros, CMU, Fall 2010 Live Homography DEMO Check out panoramio.com
More informationProf. Feng Liu. Spring /26/2017
Prof. Feng Liu Spring 2017 http://www.cs.pdx.edu/~fliu/courses/cs510/ 04/26/2017 Last Time Re-lighting HDR 2 Today Panorama Overview Feature detection Mid-term project presentation Not real mid-term 6
More informationA Framework for Multiple Radar and Multiple 2D/3D Camera Fusion
A Framework for Multiple Radar and Multiple 2D/3D Camera Fusion Marek Schikora 1 and Benedikt Romba 2 1 FGAN-FKIE, Germany 2 Bonn University, Germany schikora@fgan.de, romba@uni-bonn.de Abstract: In this
More informationImage Features: Local Descriptors. Sanja Fidler CSC420: Intro to Image Understanding 1/ 58
Image Features: Local Descriptors Sanja Fidler CSC420: Intro to Image Understanding 1/ 58 [Source: K. Grauman] Sanja Fidler CSC420: Intro to Image Understanding 2/ 58 Local Features Detection: Identify
More informationAn image to map loop closing method for monocular SLAM
An image to map loop closing method for monocular SLAM Brian Williams, Mark Cummins, José Neira, Paul Newman, Ian Reid and Juan Tardós Universidad de Zaragoza, Spain University of Oxford, UK Abstract In
More informationVisual localization using global visual features and vanishing points
Visual localization using global visual features and vanishing points Olivier Saurer, Friedrich Fraundorfer, and Marc Pollefeys Computer Vision and Geometry Group, ETH Zürich, Switzerland {saurero,fraundorfer,marc.pollefeys}@inf.ethz.ch
More informationAutomatic Image Alignment
Automatic Image Alignment with a lot of slides stolen from Steve Seitz and Rick Szeliski Mike Nese CS194: Image Manipulation & Computational Photography Alexei Efros, UC Berkeley, Fall 2018 Live Homography
More informationFast Image Matching Using Multi-level Texture Descriptor
Fast Image Matching Using Multi-level Texture Descriptor Hui-Fuang Ng *, Chih-Yang Lin #, and Tatenda Muindisi * Department of Computer Science, Universiti Tunku Abdul Rahman, Malaysia. E-mail: nghf@utar.edu.my
More informationLecture 12 Recognition
Institute of Informatics Institute of Neuroinformatics Lecture 12 Recognition Davide Scaramuzza 1 Lab exercise today replaced by Deep Learning Tutorial Room ETH HG E 1.1 from 13:15 to 15:00 Optional lab
More informationA NEW FEATURE BASED IMAGE REGISTRATION ALGORITHM INTRODUCTION
A NEW FEATURE BASED IMAGE REGISTRATION ALGORITHM Karthik Krish Stuart Heinrich Wesley E. Snyder Halil Cakir Siamak Khorram North Carolina State University Raleigh, 27695 kkrish@ncsu.edu sbheinri@ncsu.edu
More informationMonocular SLAM for a Small-Size Humanoid Robot
Tamkang Journal of Science and Engineering, Vol. 14, No. 2, pp. 123 129 (2011) 123 Monocular SLAM for a Small-Size Humanoid Robot Yin-Tien Wang*, Duen-Yan Hung and Sheng-Hsien Cheng Department of Mechanical
More informationObject Recognition Algorithms for Computer Vision System: A Survey
Volume 117 No. 21 2017, 69-74 ISSN: 1311-8080 (printed version); ISSN: 1314-3395 (on-line version) url: http://www.ijpam.eu ijpam.eu Object Recognition Algorithms for Computer Vision System: A Survey Anu
More informationLecture 12 Recognition. Davide Scaramuzza
Lecture 12 Recognition Davide Scaramuzza Oral exam dates UZH January 19-20 ETH 30.01 to 9.02 2017 (schedule handled by ETH) Exam location Davide Scaramuzza s office: Andreasstrasse 15, 2.10, 8050 Zurich
More informationWAVELET TRANSFORM BASED FEATURE DETECTION
WAVELET TRANSFORM BASED FEATURE DETECTION David Bařina Doctoral Degree Programme (1), DCGM, FIT BUT E-mail: ibarina@fit.vutbr.cz Supervised by: Pavel Zemčík E-mail: zemcik@fit.vutbr.cz ABSTRACT This paper
More informationImage Features: Detection, Description, and Matching and their Applications
Image Features: Detection, Description, and Matching and their Applications Image Representation: Global Versus Local Features Features/ keypoints/ interset points are interesting locations in the image.
More informationStereoscopic Images Generation By Monocular Camera
Stereoscopic Images Generation By Monocular Camera Swapnil Lonare M. tech Student Department of Electronics Engineering (Communication) Abha Gaikwad - Patil College of Engineering. Nagpur, India 440016
More informationInternational Journal of Advanced Research in Computer Science and Software Engineering
ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: Fingerprint Recognition using Robust Local Features Madhuri and
More informationIMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES
IMAGE RETRIEVAL USING VLAD WITH MULTIPLE FEATURES Pin-Syuan Huang, Jing-Yi Tsai, Yu-Fang Wang, and Chun-Yi Tsai Department of Computer Science and Information Engineering, National Taitung University,
More informationSemantic Kernels Binarized A Feature Descriptor for Fast and Robust Matching
2011 Conference for Visual Media Production Semantic Kernels Binarized A Feature Descriptor for Fast and Robust Matching Frederik Zilly 1, Christian Riechert 1, Peter Eisert 1,2, Peter Kauff 1 1 Fraunhofer
More informationDepartment of Electrical and Electronic Engineering, University of Peradeniya, KY 20400, Sri Lanka
WIT: Window Intensity Test Detector and Descriptor T.W.U.Madhushani, D.H.S.Maithripala, J.V.Wijayakulasooriya Postgraduate and Research Unit, Sri Lanka Technological Campus, CO 10500, Sri Lanka. Department
More informationVideo Google: A Text Retrieval Approach to Object Matching in Videos
Video Google: A Text Retrieval Approach to Object Matching in Videos Josef Sivic, Frederik Schaffalitzky, Andrew Zisserman Visual Geometry Group University of Oxford The vision Enable video, e.g. a feature
More informationURBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES
URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment
More informationAutomatic Image Alignment (feature-based)
Automatic Image Alignment (feature-based) Mike Nese with a lot of slides stolen from Steve Seitz and Rick Szeliski 15-463: Computational Photography Alexei Efros, CMU, Fall 2006 Today s lecture Feature
More informationSUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS
SUMMARY: DISTINCTIVE IMAGE FEATURES FROM SCALE- INVARIANT KEYPOINTS Cognitive Robotics Original: David G. Lowe, 004 Summary: Coen van Leeuwen, s1460919 Abstract: This article presents a method to extract
More informationImage Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images
Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Images Ebrahim Karami, Siva Prasad, and Mohamed Shehata Faculty of Engineering and Applied Sciences, Memorial University,
More informationSIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014
SIFT: SCALE INVARIANT FEATURE TRANSFORM SURF: SPEEDED UP ROBUST FEATURES BASHAR ALSADIK EOS DEPT. TOPMAP M13 3D GEOINFORMATION FROM IMAGES 2014 SIFT SIFT: Scale Invariant Feature Transform; transform image
More informationApplication questions. Theoretical questions
The oral exam will last 30 minutes and will consist of one application question followed by two theoretical questions. Please find below a non exhaustive list of possible application questions. The list
More informationICICS-2011 Beijing, China
An Efficient Finger-knuckle-print based Recognition System Fusing SIFT and SURF Matching Scores G S Badrinath, Aditya Nigam and Phalguni Gupta Indian Institute of Technology Kanpur INDIA ICICS-2011 Beijing,
More informationPatch Descriptors. CSE 455 Linda Shapiro
Patch Descriptors CSE 455 Linda Shapiro How can we find corresponding points? How can we find correspondences? How do we describe an image patch? How do we describe an image patch? Patches with similar
More informationACEEE Int. J. on Information Technology, Vol. 02, No. 01, March 2012
Feature Tracking of Objects in Underwater Video Sequences Prabhakar C J & Praveen Kumar P U Department of P.G. Studies and Research in Computer Science Kuvempu University, Shankaraghatta - 577451 Karnataka,
More informationReal-Time Loop Detection with Bags of Binary Words
Real-Time Loop Detection with Bags of Binary Words Dorian Gálvez-López, Juan D. Tardós Abstract We present a method for detecting revisited places in a image sequence in real time by using efficient features.
More informationROBUST SCENE CLASSIFICATION BY GIST WITH ANGULAR RADIAL PARTITIONING. Wei Liu, Serkan Kiranyaz and Moncef Gabbouj
Proceedings of the 5th International Symposium on Communications, Control and Signal Processing, ISCCSP 2012, Rome, Italy, 2-4 May 2012 ROBUST SCENE CLASSIFICATION BY GIST WITH ANGULAR RADIAL PARTITIONING
More informationLocal Features Tutorial: Nov. 8, 04
Local Features Tutorial: Nov. 8, 04 Local Features Tutorial References: Matlab SIFT tutorial (from course webpage) Lowe, David G. Distinctive Image Features from Scale Invariant Features, International
More informationPanoramic Image Stitching
Mcgill University Panoramic Image Stitching by Kai Wang Pengbo Li A report submitted in fulfillment for the COMP 558 Final project in the Faculty of Computer Science April 2013 Mcgill University Abstract
More informationInstance-level recognition
Instance-level recognition 1) Local invariant features 2) Matching and recognition with local features 3) Efficient visual search 4) Very large scale indexing Matching of descriptors Matching and 3D reconstruction
More informationA Comparison of SIFT and SURF
A Comparison of SIFT and SURF P M Panchal 1, S R Panchal 2, S K Shah 3 PG Student, Department of Electronics & Communication Engineering, SVIT, Vasad-388306, India 1 Research Scholar, Department of Electronics
More informationViewpoint Invariant Features from Single Images Using 3D Geometry
Viewpoint Invariant Features from Single Images Using 3D Geometry Yanpeng Cao and John McDonald Department of Computer Science National University of Ireland, Maynooth, Ireland {y.cao,johnmcd}@cs.nuim.ie
More informationOutline 7/2/201011/6/
Outline Pattern recognition in computer vision Background on the development of SIFT SIFT algorithm and some of its variations Computational considerations (SURF) Potential improvement Summary 01 2 Pattern
More informationA hardware design of optimized ORB algorithm with reduced hardware cost
, pp.58-62 http://dx.doi.org/10.14257/astl.2013 A hardware design of optimized ORB algorithm with reduced hardware cost Kwang-yeob Lee 1, Kyung-jin Byun 2 1 Dept. of Computer Engineering, Seokyenog University,
More informationPatch Descriptors. EE/CSE 576 Linda Shapiro
Patch Descriptors EE/CSE 576 Linda Shapiro 1 How can we find corresponding points? How can we find correspondences? How do we describe an image patch? How do we describe an image patch? Patches with similar
More informationSURF. Lecture6: SURF and HOG. Integral Image. Feature Evaluation with Integral Image
SURF CSED441:Introduction to Computer Vision (2015S) Lecture6: SURF and HOG Bohyung Han CSE, POSTECH bhhan@postech.ac.kr Speed Up Robust Features (SURF) Simplified version of SIFT Faster computation but
More informationA Comparison and Matching Point Extraction of SIFT and ISIFT
A Comparison and Matching Point Extraction of SIFT and ISIFT A. Swapna A. Geetha Devi M.Tech Scholar, PVPSIT, Vijayawada Associate Professor, PVPSIT, Vijayawada bswapna.naveen@gmail.com geetha.agd@gmail.com
More informationMidterm Examination CS 534: Computational Photography
Midterm Examination CS 534: Computational Photography November 3, 2016 NAME: Problem Score Max Score 1 6 2 8 3 9 4 12 5 4 6 13 7 7 8 6 9 9 10 6 11 14 12 6 Total 100 1 of 8 1. [6] (a) [3] What camera setting(s)
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationHomographies and RANSAC
Homographies and RANSAC Computer vision 6.869 Bill Freeman and Antonio Torralba March 30, 2011 Homographies and RANSAC Homographies RANSAC Building panoramas Phototourism 2 Depth-based ambiguity of position
More informationVideo Processing for Judicial Applications
Video Processing for Judicial Applications Konstantinos Avgerinakis, Alexia Briassouli, Ioannis Kompatsiaris Informatics and Telematics Institute, Centre for Research and Technology, Hellas Thessaloniki,
More informationColorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.
Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Object Recognition in Large Databases Some material for these slides comes from www.cs.utexas.edu/~grauman/courses/spring2011/slides/lecture18_index.pptx
More informationFeature Detection and Matching
and Matching CS4243 Computer Vision and Pattern Recognition Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore Leow Wee Kheng (CS4243) Camera Models 1 /
More informationLocal features: detection and description May 12 th, 2015
Local features: detection and description May 12 th, 2015 Yong Jae Lee UC Davis Announcements PS1 grades up on SmartSite PS1 stats: Mean: 83.26 Standard Dev: 28.51 PS2 deadline extended to Saturday, 11:59
More informationThe SIFT (Scale Invariant Feature
The SIFT (Scale Invariant Feature Transform) Detector and Descriptor developed by David Lowe University of British Columbia Initial paper ICCV 1999 Newer journal paper IJCV 2004 Review: Matt Brown s Canonical
More informationCEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt.
CEE598 - Visual Sensing for Civil Infrastructure Eng. & Mgmt. Section 10 - Detectors part II Descriptors Mani Golparvar-Fard Department of Civil and Environmental Engineering 3129D, Newmark Civil Engineering
More informationEvaluation of GIST descriptors for web scale image search
Evaluation of GIST descriptors for web scale image search Matthijs Douze Hervé Jégou, Harsimrat Sandhawalia, Laurent Amsaleg and Cordelia Schmid INRIA Grenoble, France July 9, 2009 Evaluation of GIST for
More informationUnified Loop Closing and Recovery for Real Time Monocular SLAM
Unified Loop Closing and Recovery for Real Time Monocular SLAM Ethan Eade and Tom Drummond Machine Intelligence Laboratory, Cambridge University {ee231, twd20}@cam.ac.uk Abstract We present a unified method
More informationLocal invariant features
Local invariant features Tuesday, Oct 28 Kristen Grauman UT-Austin Today Some more Pset 2 results Pset 2 returned, pick up solutions Pset 3 is posted, due 11/11 Local invariant features Detection of interest
More informationSpecular 3D Object Tracking by View Generative Learning
Specular 3D Object Tracking by View Generative Learning Yukiko Shinozuka, Francois de Sorbier and Hideo Saito Keio University 3-14-1 Hiyoshi, Kohoku-ku 223-8522 Yokohama, Japan shinozuka@hvrl.ics.keio.ac.jp
More informationEE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm
EE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm Group 1: Mina A. Makar Stanford University mamakar@stanford.edu Abstract In this report, we investigate the application of the Scale-Invariant
More informationKeypoint-based Recognition and Object Search
03/08/11 Keypoint-based Recognition and Object Search Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem Notices I m having trouble connecting to the web server, so can t post lecture
More informationFeature Detection. Raul Queiroz Feitosa. 3/30/2017 Feature Detection 1
Feature Detection Raul Queiroz Feitosa 3/30/2017 Feature Detection 1 Objetive This chapter discusses the correspondence problem and presents approaches to solve it. 3/30/2017 Feature Detection 2 Outline
More informationComputer vision: models, learning and inference. Chapter 13 Image preprocessing and feature extraction
Computer vision: models, learning and inference Chapter 13 Image preprocessing and feature extraction Preprocessing The goal of pre-processing is to try to reduce unwanted variation in image due to lighting,
More informationImproving feature based object recognition in service robotics by disparity map based segmentation.
The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems October 18-22, 2010, Taipei, Taiwan Improving feature based object recognition in service robotics by disparity map based segmentation.
More informationA System of Image Matching and 3D Reconstruction
A System of Image Matching and 3D Reconstruction CS231A Project Report 1. Introduction Xianfeng Rui Given thousands of unordered images of photos with a variety of scenes in your gallery, you will find
More informationInstance-level recognition
Instance-level recognition 1) Local invariant features 2) Matching and recognition with local features 3) Efficient visual search 4) Very large scale indexing Matching of descriptors Matching and 3D reconstruction
More informationLocal Patch Descriptors
Local Patch Descriptors Slides courtesy of Steve Seitz and Larry Zitnick CSE 803 1 How do we describe an image patch? How do we describe an image patch? Patches with similar content should have similar
More informationFiltering and mapping systems for underwater 3D imaging sonar
Filtering and mapping systems for underwater 3D imaging sonar Tomohiro Koshikawa 1, a, Shin Kato 1,b, and Hitoshi Arisumi 1,c 1 Field Robotics Research Group, National Institute of Advanced Industrial
More informationPerformance Evaluation of Scale-Interpolated Hessian-Laplace and Haar Descriptors for Feature Matching
Performance Evaluation of Scale-Interpolated Hessian-Laplace and Haar Descriptors for Feature Matching Akshay Bhatia, Robert Laganière School of Information Technology and Engineering University of Ottawa
More informationKey properties of local features
Key properties of local features Locality, robust against occlusions Must be highly distinctive, a good feature should allow for correct object identification with low probability of mismatch Easy to etract
More informationRobotics Programming Laboratory
Chair of Software Engineering Robotics Programming Laboratory Bertrand Meyer Jiwon Shin Lecture 8: Robot Perception Perception http://pascallin.ecs.soton.ac.uk/challenges/voc/databases.html#caltech car
More informationVisual Recognition and Search April 18, 2008 Joo Hyun Kim
Visual Recognition and Search April 18, 2008 Joo Hyun Kim Introduction Suppose a stranger in downtown with a tour guide book?? Austin, TX 2 Introduction Look at guide What s this? Found Name of place Where
More informationLecture 12 Recognition
Institute of Informatics Institute of Neuroinformatics Lecture 12 Recognition Davide Scaramuzza http://rpg.ifi.uzh.ch/ 1 Lab exercise today replaced by Deep Learning Tutorial by Antonio Loquercio Room
More informationVisual Bearing-Only Simultaneous Localization and Mapping with Improved Feature Matching
Visual Bearing-Only Simultaneous Localization and Mapping with Improved Feature Matching Hauke Strasdat, Cyrill Stachniss, Maren Bennewitz, and Wolfram Burgard Computer Science Institute, University of
More informationA Hybrid Feature Extractor using Fast Hessian Detector and SIFT
Technologies 2015, 3, 103-110; doi:10.3390/technologies3020103 OPEN ACCESS technologies ISSN 2227-7080 www.mdpi.com/journal/technologies Article A Hybrid Feature Extractor using Fast Hessian Detector and
More informationTensor Decomposition of Dense SIFT Descriptors in Object Recognition
Tensor Decomposition of Dense SIFT Descriptors in Object Recognition Tan Vo 1 and Dat Tran 1 and Wanli Ma 1 1- Faculty of Education, Science, Technology and Mathematics University of Canberra, Australia
More informationScale Invariant Feature Transform
Scale Invariant Feature Transform Why do we care about matching features? Camera calibration Stereo Tracking/SFM Image moiaicing Object/activity Recognition Objection representation and recognition Image
More informationLocal features: detection and description. Local invariant features
Local features: detection and description Local invariant features Detection of interest points Harris corner detection Scale invariant blob detection: LoG Description of local patches SIFT : Histograms
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribes: Jeremy Pollock and Neil Alldrin LECTURE 14 Robust Feature Matching 14.1. Introduction Last lecture we learned how to find interest points
More information