Robust Horizontal Line Detection and Tracking in Occluded Environment for Infrared Cameras
|
|
- Garry Short
- 6 years ago
- Views:
Transcription
1 Robust Horizontal Line Detection and Tracking in Occluded Environment for Infrared Cameras Sungho Kim 1, Soon Kwon 2, and Byungin Choi 3 1 LED-IT Fusion Technology Research Center and Department of Electronic Engineering, Yeungnam University, Gyeongsan, Gyeongbuk, Korea 2 Daegu Gyeongbuk Institute of Science and Technology, Daegu, Korea 3 Electro-Optics Laboratory, Samsung Thales Company, Yongin, Korea Abstract Detecting a horizontal line in an infrared image is an important component of automatic surveillance applications such as detecting ships, missiles on the horizon, unmanned aerial vehicle control, flight navigation, and port security. Most of the existing solutions for the problems only use single image to detect horizon line. Although this results in good accuracy for some images, it often fails to detect horizons in foggy, occluded environments. In this paper, we propose a novel horizon detection and tracking method that is robust to sensor vibrations and occlusions using an infrared camera for 24 hour running. An initial horizon is detected by a sensor geometry-based method for the robustness. Local horizon optimization and tracking produce stable horizons in occluded environments. The experimental results validate the feasibility of the proposed method in real infrared images. Keywords: IRST, horizontal line, detection, tracking, clutter 1. INTRODUCTION It is important to detect horizon for a number of applications such as sea-based infrared search and track (IRST) [1], vision-guided flight stability and control for micro air vehicles [2], surveillance for coast security [3]. Fig. 1 shows an infrared image example of sea-based environment for horizon detection. One of the previous approaches using only image processing methods performed very well in some cases [4]. Liu et al. presented an improved linear fit method, in which an effective preprocessing step is employed and those points fitted by line are reconfirmed [5]. Nevertheless, the improved linear fit method was proved poor applicability in cloud or sea clutter background. Having analyzed the weakness of the improved linear fit method, Yang et al. put forward a variance weighted information entropy (VWIE) based algorithm, but this algorithm is not fit for the complicated background infrared images [6]. Wen et al. proposed an Otsuąŕs threshold method, and it uses morphological opening and closing to smooth the segmented image but can only process the simple background infrared images [7]. Another method combining machine learning methods with morphol- Sky line Horion/coast line Fig. 1: Example of infrared image and location of horizon/cost line. ogy based operations, the Hough Transform and Expectation Maximization function to separate pixel distributions [8]. However, their performance in identifying a horizon suffers when images are complicated with clutter such as a very cloudy or foggy environment, an uneven horizon line, and varying lighting conditions. In addition, horizon detection can be fragile if there is strong occlusion by islands or some targets. In this paper, we present a robust horizon detection and tracking method in infrared sequences by introduction hybrid horizon initialization and outlier identification-based optimal tracking. In Section II, we introduce the overall horizon detection system. Geometry-based horizon initialization method is explained in Section III and optimal horizon tracking method is presented in Section IV. In In Section V, various performance evaluations and experimental results are explained by using real infrared sequences. We conclude and discuss this paper in Section VI. 2. Overview of the proposed system The proposed system consists of three components: sensor line of sight (LOS), horizon prediction, and horizon optimization in infrared video as shown in Fig. 2. We consider a sea-based IRST system as a test environment. Infrared search and track (IRST) systems are
2 Sensor LOS h α - Height ( ) - Elevation ( ) Horizon Prediction Provided by IRST system Signal Processing - Geometric analysis. Horizon position ( H prior ). Horizon tilt ( ) θ prior Horizon Optimization - Local horizon search. Horizon position ( H opt ). Horizon tilt ( ) θ opt Fig. 2: Proposed horizon initialization and optimization in infrared sequences. developed for autonomous searching, detection, acquisition, tracking and designation of potential incoming targets [9], [10]. Related research was actively conducted in the late 1980 s. In these applications, targets including missiles and ships are typically small and they appear in the sea background. An infrared camera is mounted on the top of a ship, which provides sensor height (h) and elevation (α) information. Based on these pose information, we can predict horizon location using geometric analysis. In the optimization block, occluded horizon is detected by RANSAC (RANdom SAmple Consensus) algorithm followed by local optimization. Horizon tracking is conducted on the inlier horizon with local search. Horizon is initialized statistically to adapt environmental changes. 3. Geometry-based horizon initialization 3.1 Geometrical model of horizon prediction In the sea-based IRST systems, infrared images consist of sky, horizon and sea regions. The horizontal region has a strong boundary line that divides heterogeneous backgrounds such as sky and sea region. The sea surface region contains many sun-glints and the ship targets are close to a sensor. So, an image segmentation scheme is necessary for a successful detection system. Image based region segmentation can be made possible by using clustering algorithms. However, this approach is unstable to environmental changes. The horizontal lines can be ambiguous when there is a strong sea fog. So, we use more stable approach based on the geometric analysis using the sensor pose information. As the pose information of an IRST sensor is recorded in the image header, we can estimate the horizontal line. The horizontal information is very important as it can provide a region segmentation cue. If we assume that an IR camera has height (h), elevation angle (α, assume 0 for easy analysis), and earth radius (R) then, we can depict the geometric relations as shown in Fig. 3 (a). The projected horizontal line in any image can be found by calculating the angle (θ H ) as in equation (1). In fact, a real IRST sensor can change the elevation angle, which changes the location of the horizontal line in the image domain. If the elevation angle of a camera is given as α and the field of view (FOV) of the sensor is given as β then, the angle of a sky region (θ sky ) is determined by the equation (2). If elevation angle (α) is smaller than θ H β/2 then, the sensor can observe only the sea region. So, the angle of the sky region (θ sky ) is 0. Similarly, we can also analyze other cases. The angle of the sea region (θ sea ) is determined as, θ sea = β θ sky. As the sky-sea region segmentation ratio is determined by tanθ sea /tanθ sky, the final horizontal line (H prior ) is calculated by using equation (3). If we assume the image height is 1,280 pixels, vertical field of view is 20 then, the sensor height is 20m, the elevation angle is 5, then the prediction horizontal line (H prior ) is located at 974 pixels as shown in Fig. 4. ( ) R θ H = cos 1 R + h 0 if α < θ H β/2 θ sky = β if α > θ H + β/2 α θ H + β/2 else H prior = ImageHeight (1) (2) tanθ sky tanθ sky + tanθ sea (3) 3.2 Analysis of horizon prediction error In ideal cases, the horizon prediction using above method can be accurate. However, there are several noise factors such as uncertainty of the sensor height caused by waves, uncertainty of the sensor elevation and roll angle after after mechanical stabilization. In the first case, we consider the noise of sensor height as 0 10m. 10m can be possible if there is strong hurricane. Fig. 5(a) shows the horizon prediction error or offset [pixel] according to the noise of sensor height. We can predict maximum 2 pixel offset of horizon location if the sensor height noise is 10m. In the second case, we consider the noise of sensor elevation angle. Normal mechanical stabilization can provide the angle error of ±0.005, which cause horizontal offset of 0.3 pixel. If we assume the noise as ±0.5 by considering 100 times stability margin, the horizon offset can be predicted
3 (a) Fig. 3: Geometry of sea-based IRST system. (a) Relationship between sensor height and horizontal line, (b) camera geometry with the field of view and elevation angle (α = 0), (c) approximated position of horizontal line when the elevation angle is α. (b) Fig. 5: Noise analysis of horizon prediction error: (a) Horizon offset caused by sensor height noise, (b) horizon offset caused by sensor elevation noise. Fig. 4: Synthetic horizon prediction using geometric analysis of sensor pose. as shown in Fig. 5(b). The maximal horizontal offset can be ± pixels. According to the results of noise analysis, sensor elevation noise is more critical than the sensor height noise. There can be additional sensor noise of roll stabilization. In normal roll stabilization error of 0.005, there is almost no horizontal tilt (θ prior ). If we consider the stabilization error of 0.5, the maximal horizontal tilt is 10 pixels in image. By summarizing above noise analysis, we can conclude that the maximal horizon offset boundary is ±30 pixels including horizontal tilt. 4. Optimal horizon tracking From the previous sensor LOS, we can predict horizontal location with pre-defined search boundary. The next step is optimal horizon tracking in video sequence as shown in Fig. 6. Given an input frame, horixels (horizontal pixels) are extracted using column directional gradient and max
4 Input frame Horixel Extraction - Column directional gradient filtering within local search space (use sampling interval) - Locating horixel (horizon pixel) by max gradient Inlier index Initialization mode Tracking mode Inlier Detection - RANSAC (RANdom SAmple Consensus). Robust to outliers. Identifying inlier index Total Least Square Optimization - SVD-based line fitting for inlier index. Closed form solution. Fast and stable Extracted horixels Fig. 6: Horizon optimization and tracking flow in infrared sequence. selection. Then, inlier horixels are identified using robust line fitting method of RANSAC [11]. The important role of RANSAC is to find inlier indices of true horixels. Based on the inlier index, total least square optimization can detect final horizon stably. Since inlier horixels are identified through the process, horizon tracking is conducted using horixel extraction and optimization. Inlier detection block is activated in the beginning and statistically to adapt environmental changes. Horizon prediction using sensor LOS Fig. 7: Example of the predicted horizon and detected horixels. 4.1 Horixel extraction Given a predicted horizon as shown in Fig. 7(dotted blue line), a search boundary is set. Then, sampling interval is defined to reduce the computational complexity. For each sample position, column direction gradient filter is conducted using derivative of Gaussian kernel. Then horixels close to a predicted horizon are extracted by max selection. Fig. 7(dotted black line) shows the extracted horixels. 4.2 Inlier detection using RANSAC In a sea environment, horizon is frequently occluded by islands, coasts, and cloud. So, we need a robust horizon estimation method such as RANSAC. Basically, RANSAC algorithm picks two horixels and predict horizon line. Then, it checks line fitting and inliers. After a number of iterations, horizon line parameter is selected that has largest inliers. Fig. 8 shows the inlier detection results using a RANSAC method. Note that inliers and outliers are classified almost correctly. The inlier indices are used in the optimization of line fitting and horizon tracking. outlier inlier Fig. 8: Example of inlier horixels found by a RANSAC.
5 Optimized horizontal line Set1: Occluded by cloud Set 2: Occluded by near island Set3: Occluded by near/remote island Set4: Occluded by near coast Prediction Initialization Optimization Fig. 9: Example of horizontal line optimization in occluded environments. 4.3 SVD-based optimization and tracking The last step is to refine horizon parameters using total least square fitting given a set of inlier horixels. The fitting process is as follows. First, we normalize inlier horixels and then conduct a singular value decomposition (SVD) [12]. Horizon direction is selected by an eigenvector with the smallest eigenvalue. Figure 9 shows the horizon optimization results for an image occluded by near island and remote island. Horizontal area is enlarged to show the results. Horizon tracking is done by the horixel extraction and SVDbased optimization with the inlier indices. RANSAC-based initialization is activated statistically. 5. Experimental results We prepared four kinds of test sequences as shown in Fig. 10 to validate the robustness of the proposed method. The Set 1 is remote sea images occluded by strong cloud. Horizons in Detected horizon is decided as correct if the line fitting error is the Set 2 are occluded by near island which occupies 1/3 of the horizon length. Set 3 has a near islands and a remote island. The last Set 4 has near coast in which boats and buildings occlude horizons. A detected horizon is declared as correct detection if a line fitting error is within 1 pixel in average. The ground truth of horizon location is prepared by manual inspection. The original test sets has almost no sensor noise. So, we add artificial sensor tilt noise by ±0.5 and horizon location noise by ±3.0 pixels generated by uniform for that range. Table 1 summarizes the overall experimental results. Our method detected horizons correctly for the noiseless sequence data. In the case of noisy data, only one frame of Set 4 shows incorrect horizon detection. Fig. 11, 12, 13, and 14 show the sampled horizontal detection results for the noise added sequences. Dotted blue lines denotes horizon prediction by sensor LOS, solid black or white line denotes optimal horizon, and magenta dots denote inlier horixels extracted by RANSAC. Note that horizon lines are detected robustly regardless to occlusion types under sensor noise. Fig. 10: Composition of the test database. Table 1: Detection rate (DR) of horizon for the noiseless data and noisy data. Test set Set 1 Set 2 Set 3 Set 4 DR w/o noise [%] 100 (20/20) 100 (30/30) DR with noise 100 (20/20) 97 (29/30) 6. Conclusions In this paper, we present a robust horizon detection and tracking method using sensor geometry and optimization. Through the analysis of sensor geometry, we can predict the search range of horizon. Inlier indices are found by RANSAC and these indices are utilized in the SVD-based line fitting and tracking. Experimental results for the various infrared sequences validate the robustness of the proposed method. Acknowledgement This research was supported by the DGIST R&D Program (12-BD-0202) and by a grant-in-aid of Samsung Thales. It was also supported by the Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education, Science and Technology (No ).
6 Fig. 11: Examples of horizon detection for the noise added test Set 1. Fig. 12: Examples of horizon detection for the noise added test Set 2. References [1] S. Kim and J. Lee, Scale invariant small target detection by optimizing signal-to-clutter ratio in heterogeneous background for infrared search and track, Pattern Recognition, vol. 45, no. 1, pp , [Online]. Available: [2] S. M. Ettinger, M. C. Nechyba, P. G. Ifju, and M. Waszak, Visionguided flight stability and control for micro air vehicles, Advanced Robotics, vol. 17, no. 7, pp , [3] S. P. van den Broek, H. Bouma, M. A. Degache, and G. Burghouts, Discrimination of classes of ships for aided recognition in a coastal environment, in Proc. of SPIE, vol. 7335, 2009, p W. [4] T. G. McGee, R. Sengupta, and J. K. Hedrick, Obstacle detection for small autonomous aircraft using sky segmentation, in ICRA. IEEE, 2005, pp [5] S. tao Liu, T. sheng Shen, Y. li Han, and X. dong Zhou, Research on locating the horizontal region of ship target, Infrared and Laser Engineering, vol. 33, no. 1, pp , [6] L. Yang, Y. Zhou, and L. Chen, Variance wie based infrared images processing, Electron. Lett., vol. 42, no. 15, pp , [7] P. zhi Wen, Z. lin Shi, and H. bin Yu, Automatic detection method of ir small target in complex sea background, Infrared and Laser Engineering, vol. 32, no. 6, pp , [8] S. Todorivic and M. Nechyba, Sky/ground modelling for autonomous mav flight, in ICRA. IEEE, 2003, pp [9] S. B. Campana, The infrared and electro-optical systems handbook, SPIE Optical Engineering Press, vol. 5, no. 4, [10] A. N. de Jong, IRST and perspective, in Proc. of SPIE, vol. 2552, 1995, pp [11] R. I. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, 2nd ed. Cambridge University Press, ISBN: , [12] R. Hanson and M. Norris, Analysis of measurements based on the singular value decomposition, SIAM J. Sci. Stat. Comput., vol. 2, pp , 1981.
7 Fig. 13: Examples of horizon detection for the noise added test Set 3. Fig. 14: Examples of horizon detection for the noise added test Set 4.
CS 231A Computer Vision (Winter 2014) Problem Set 3
CS 231A Computer Vision (Winter 2014) Problem Set 3 Due: Feb. 18 th, 2015 (11:59pm) 1 Single Object Recognition Via SIFT (45 points) In his 2004 SIFT paper, David Lowe demonstrates impressive object recognition
More informationHuman Detection. A state-of-the-art survey. Mohammad Dorgham. University of Hamburg
Human Detection A state-of-the-art survey Mohammad Dorgham University of Hamburg Presentation outline Motivation Applications Overview of approaches (categorized) Approaches details References Motivation
More informationSubpixel Corner Detection Using Spatial Moment 1)
Vol.31, No.5 ACTA AUTOMATICA SINICA September, 25 Subpixel Corner Detection Using Spatial Moment 1) WANG She-Yang SONG Shen-Min QIANG Wen-Yi CHEN Xing-Lin (Department of Control Engineering, Harbin Institute
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationImplementation of a Face Recognition System for Interactive TV Control System
Implementation of a Face Recognition System for Interactive TV Control System Sang-Heon Lee 1, Myoung-Kyu Sohn 1, Dong-Ju Kim 1, Byungmin Kim 1, Hyunduk Kim 1, and Chul-Ho Won 2 1 Dept. IT convergence,
More informationCOMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION
COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION Mr.V.SRINIVASA RAO 1 Prof.A.SATYA KALYAN 2 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING PRASAD V POTLURI SIDDHARTHA
More information2 Proposed Methodology
3rd International Conference on Multimedia Technology(ICMT 2013) Object Detection in Image with Complex Background Dong Li, Yali Li, Fei He, Shengjin Wang 1 State Key Laboratory of Intelligent Technology
More informationPOME A mobile camera system for accurate indoor pose
POME A mobile camera system for accurate indoor pose Paul Montgomery & Andreas Winter November 2 2016 2010. All rights reserved. 1 ICT Intelligent Construction Tools A 50-50 joint venture between Trimble
More informationSky Segmentation by Fusing Clustering with Neural Networks
Sky Segmentation by Fusing Clustering with Neural Networks Ali Pour Yazdanpanah 1, Emma E. Regentova 1, Ajay Kumar Mandava 1, Touqeer Ahmad 2, and George Bebis 2 1 Dept. of Electrical and Computer Engineering,
More informationA Summary of Projective Geometry
A Summary of Projective Geometry Copyright 22 Acuity Technologies Inc. In the last years a unified approach to creating D models from multiple images has been developed by Beardsley[],Hartley[4,5,9],Torr[,6]
More informationCS 223B Computer Vision Problem Set 3
CS 223B Computer Vision Problem Set 3 Due: Feb. 22 nd, 2011 1 Probabilistic Recursion for Tracking In this problem you will derive a method for tracking a point of interest through a sequence of images.
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationRobot localization method based on visual features and their geometric relationship
, pp.46-50 http://dx.doi.org/10.14257/astl.2015.85.11 Robot localization method based on visual features and their geometric relationship Sangyun Lee 1, Changkyung Eem 2, and Hyunki Hong 3 1 Department
More informationObject Tracking using Superpixel Confidence Map in Centroid Shifting Method
Indian Journal of Science and Technology, Vol 9(35), DOI: 10.17485/ijst/2016/v9i35/101783, September 2016 ISSN (Print) : 0974-6846 ISSN (Online) : 0974-5645 Object Tracking using Superpixel Confidence
More informationAuto-focusing Technique in a Projector-Camera System
2008 10th Intl. Conf. on Control, Automation, Robotics and Vision Hanoi, Vietnam, 17 20 December 2008 Auto-focusing Technique in a Projector-Camera System Lam Bui Quang, Daesik Kim and Sukhan Lee School
More informationTransactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN
ransactions on Information and Communications echnologies vol 6, 996 WI Press, www.witpress.com, ISSN 743-357 Obstacle detection using stereo without correspondence L. X. Zhou & W. K. Gu Institute of Information
More informationOptical Flow-Based Person Tracking by Multiple Cameras
Proc. IEEE Int. Conf. on Multisensor Fusion and Integration in Intelligent Systems, Baden-Baden, Germany, Aug. 2001. Optical Flow-Based Person Tracking by Multiple Cameras Hideki Tsutsui, Jun Miura, and
More informationHomographies and RANSAC
Homographies and RANSAC Computer vision 6.869 Bill Freeman and Antonio Torralba March 30, 2011 Homographies and RANSAC Homographies RANSAC Building panoramas Phototourism 2 Depth-based ambiguity of position
More information3D object recognition used by team robotto
3D object recognition used by team robotto Workshop Juliane Hoebel February 1, 2016 Faculty of Computer Science, Otto-von-Guericke University Magdeburg Content 1. Introduction 2. Depth sensor 3. 3D object
More informationOctree-Based Obstacle Representation and Registration for Real-Time
Octree-Based Obstacle Representation and Registration for Real-Time Jaewoong Kim, Daesik Kim, Junghyun Seo, Sukhan Lee and Yeonchool Park* Intelligent System Research Center (ISRC) & Nano and Intelligent
More informationLearning the Three Factors of a Non-overlapping Multi-camera Network Topology
Learning the Three Factors of a Non-overlapping Multi-camera Network Topology Xiaotang Chen, Kaiqi Huang, and Tieniu Tan National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy
More informationA Road Marking Extraction Method Using GPGPU
, pp.46-54 http://dx.doi.org/10.14257/astl.2014.50.08 A Road Marking Extraction Method Using GPGPU Dajun Ding 1, Jongsu Yoo 1, Jekyo Jung 1, Kwon Soon 1 1 Daegu Gyeongbuk Institute of Science and Technology,
More informationDEVELOPMENT OF A ROBUST IMAGE MOSAICKING METHOD FOR SMALL UNMANNED AERIAL VEHICLE
DEVELOPMENT OF A ROBUST IMAGE MOSAICKING METHOD FOR SMALL UNMANNED AERIAL VEHICLE J. Kim and T. Kim* Dept. of Geoinformatic Engineering, Inha University, Incheon, Korea- jikim3124@inha.edu, tezid@inha.ac.kr
More informationAn Angle Estimation to Landmarks for Autonomous Satellite Navigation
5th International Conference on Environment, Materials, Chemistry and Power Electronics (EMCPE 2016) An Angle Estimation to Landmarks for Autonomous Satellite Navigation Qing XUE a, Hongwen YANG, Jian
More informationStereo and Epipolar geometry
Previously Image Primitives (feature points, lines, contours) Today: Stereo and Epipolar geometry How to match primitives between two (multiple) views) Goals: 3D reconstruction, recognition Jana Kosecka
More informationA Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation
, pp.162-167 http://dx.doi.org/10.14257/astl.2016.138.33 A Novel Image Super-resolution Reconstruction Algorithm based on Modified Sparse Representation Liqiang Hu, Chaofeng He Shijiazhuang Tiedao University,
More informationDevelopment of 3D Positioning Scheme by Integration of Multiple Wiimote IR Cameras
Proceedings of the 5th IIAE International Conference on Industrial Application Engineering 2017 Development of 3D Positioning Scheme by Integration of Multiple Wiimote IR Cameras Hui-Yuan Chan *, Ting-Hao
More informationEstimation of Camera Pose with Respect to Terrestrial LiDAR Data
Estimation of Camera Pose with Respect to Terrestrial LiDAR Data Wei Guan Suya You Guan Pang Computer Science Department University of Southern California, Los Angeles, USA Abstract In this paper, we present
More informationURBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES
URBAN STRUCTURE ESTIMATION USING PARALLEL AND ORTHOGONAL LINES An Undergraduate Research Scholars Thesis by RUI LIU Submitted to Honors and Undergraduate Research Texas A&M University in partial fulfillment
More informationSensory Augmentation for Increased Awareness of Driving Environment
Sensory Augmentation for Increased Awareness of Driving Environment Pranay Agrawal John M. Dolan Dec. 12, 2014 Technologies for Safe and Efficient Transportation (T-SET) UTC The Robotics Institute Carnegie
More informationCS 231A Computer Vision (Fall 2012) Problem Set 3
CS 231A Computer Vision (Fall 2012) Problem Set 3 Due: Nov. 13 th, 2012 (2:15pm) 1 Probabilistic Recursion for Tracking (20 points) In this problem you will derive a method for tracking a point of interest
More informationAn Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow
, pp.247-251 http://dx.doi.org/10.14257/astl.2015.99.58 An Improvement of the Occlusion Detection Performance in Sequential Images Using Optical Flow Jin Woo Choi 1, Jae Seoung Kim 2, Taeg Kuen Whangbo
More informationMETRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS
METRIC PLANE RECTIFICATION USING SYMMETRIC VANISHING POINTS M. Lefler, H. Hel-Or Dept. of CS, University of Haifa, Israel Y. Hel-Or School of CS, IDC, Herzliya, Israel ABSTRACT Video analysis often requires
More informationImage-based Ship Pose Estimation for AR Sea Navigation
, pp.14-20 http://dx.doi.org/10.14257/astl.2014.58.04 Image-based Ship Pose Estimation for AR Sea Navigation JungMin Lee 1,1, KyungHo Lee 1, DaeSeok Kim 1, ByeongWook Nam 1, Runqi Li 1 1 Dept. Of Naval
More informationCRF Based Point Cloud Segmentation Jonathan Nation
CRF Based Point Cloud Segmentation Jonathan Nation jsnation@stanford.edu 1. INTRODUCTION The goal of the project is to use the recently proposed fully connected conditional random field (CRF) model to
More informationRobotic Grasping Based on Efficient Tracking and Visual Servoing using Local Feature Descriptors
INTERNATIONAL JOURNAL OF PRECISION ENGINEERING AND MANUFACTURING Vol. 13, No. 3, pp. 387-393 MARCH 2012 / 387 DOI: 10.1007/s12541-012-0049-8 Robotic Grasping Based on Efficient Tracking and Visual Servoing
More informationSoftware toolkit for evaluating infrared imaging seeker
Software toolkit for evaluating infrared imaging seeker Marianne A. C. Degache a a TNO, P.O. Box 96864, 2509 JG The Hague, The Netherlands ABSTRACT Modern infrared imaging seekers can nowadays deal with
More informationPath Planning for a Robot Manipulator based on Probabilistic Roadmap and Reinforcement Learning
674 International Journal Jung-Jun of Control, Park, Automation, Ji-Hun Kim, and and Systems, Jae-Bok vol. Song 5, no. 6, pp. 674-680, December 2007 Path Planning for a Robot Manipulator based on Probabilistic
More informationGlobally Stabilized 3L Curve Fitting
Globally Stabilized 3L Curve Fitting Turker Sahin and Mustafa Unel Department of Computer Engineering, Gebze Institute of Technology Cayirova Campus 44 Gebze/Kocaeli Turkey {htsahin,munel}@bilmuh.gyte.edu.tr
More informationA Method of Annotation Extraction from Paper Documents Using Alignment Based on Local Arrangements of Feature Points
A Method of Annotation Extraction from Paper Documents Using Alignment Based on Local Arrangements of Feature Points Tomohiro Nakai, Koichi Kise, Masakazu Iwamura Graduate School of Engineering, Osaka
More informationSimultaneous Vanishing Point Detection and Camera Calibration from Single Images
Simultaneous Vanishing Point Detection and Camera Calibration from Single Images Bo Li, Kun Peng, Xianghua Ying, and Hongbin Zha The Key Lab of Machine Perception (Ministry of Education), Peking University,
More informationResearch on QR Code Image Pre-processing Algorithm under Complex Background
Scientific Journal of Information Engineering May 207, Volume 7, Issue, PP.-7 Research on QR Code Image Pre-processing Algorithm under Complex Background Lei Liu, Lin-li Zhou, Huifang Bao. Institute of
More informationSea-Based Infrared Scene Interpretation by Background Type Classification and Coastal Region Detection for Small Target Detection
Sensors 2015, 15, 24487-24513; doi:10.3390/s150924487 OPEN ACCESS sensors ISSN 1424-8220 www.mdpi.com/journal/sensors Article Sea-Based Infrared Scene Interpretation by Background Type Classification and
More informationStudy on the Signboard Region Detection in Natural Image
, pp.179-184 http://dx.doi.org/10.14257/astl.2016.140.34 Study on the Signboard Region Detection in Natural Image Daeyeong Lim 1, Youngbaik Kim 2, Incheol Park 1, Jihoon seung 1, Kilto Chong 1,* 1 1567
More informationMeasurement of Pedestrian Groups Using Subtraction Stereo
Measurement of Pedestrian Groups Using Subtraction Stereo Kenji Terabayashi, Yuki Hashimoto, and Kazunori Umeda Chuo University / CREST, JST, 1-13-27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan terabayashi@mech.chuo-u.ac.jp
More informationEfficient SLAM Scheme Based ICP Matching Algorithm Using Image and Laser Scan Information
Proceedings of the World Congress on Electrical Engineering and Computer Systems and Science (EECSS 2015) Barcelona, Spain July 13-14, 2015 Paper No. 335 Efficient SLAM Scheme Based ICP Matching Algorithm
More informationVisual Attention Control by Sensor Space Segmentation for a Small Quadruped Robot based on Information Criterion
Visual Attention Control by Sensor Space Segmentation for a Small Quadruped Robot based on Information Criterion Noriaki Mitsunaga and Minoru Asada Dept. of Adaptive Machine Systems, Osaka University,
More informationHOUGH TRANSFORM CS 6350 C V
HOUGH TRANSFORM CS 6350 C V HOUGH TRANSFORM The problem: Given a set of points in 2-D, find if a sub-set of these points, fall on a LINE. Hough Transform One powerful global method for detecting edges
More informationAUTOMATIC EXTRACTION OF LARGE COMPLEX BUILDINGS USING LIDAR DATA AND DIGITAL MAPS
AUTOMATIC EXTRACTION OF LARGE COMPLEX BUILDINGS USING LIDAR DATA AND DIGITAL MAPS Jihye Park a, Impyeong Lee a, *, Yunsoo Choi a, Young Jin Lee b a Dept. of Geoinformatics, The University of Seoul, 90
More informationA novel point matching method for stereovision measurement using RANSAC affine transformation
A novel point matching method for stereovision measurement using RANSAC affine transformation Naiguang Lu, Peng Sun, Wenyi Deng, Lianqing Zhu, Xiaoping Lou School of Optoelectronic Information & Telecommunication
More informationA Robust Two Feature Points Based Depth Estimation Method 1)
Vol.31, No.5 ACTA AUTOMATICA SINICA September, 2005 A Robust Two Feature Points Based Depth Estimation Method 1) ZHONG Zhi-Guang YI Jian-Qiang ZHAO Dong-Bin (Laboratory of Complex Systems and Intelligence
More informationAutomatic Shadow Removal by Illuminance in HSV Color Space
Computer Science and Information Technology 3(3): 70-75, 2015 DOI: 10.13189/csit.2015.030303 http://www.hrpub.org Automatic Shadow Removal by Illuminance in HSV Color Space Wenbo Huang 1, KyoungYeon Kim
More informationDEPTH AND GEOMETRY FROM A SINGLE 2D IMAGE USING TRIANGULATION
2012 IEEE International Conference on Multimedia and Expo Workshops DEPTH AND GEOMETRY FROM A SINGLE 2D IMAGE USING TRIANGULATION Yasir Salih and Aamir S. Malik, Senior Member IEEE Centre for Intelligent
More informationProceedings of the 6th Int. Conf. on Computer Analysis of Images and Patterns. Direct Obstacle Detection and Motion. from Spatio-Temporal Derivatives
Proceedings of the 6th Int. Conf. on Computer Analysis of Images and Patterns CAIP'95, pp. 874-879, Prague, Czech Republic, Sep 1995 Direct Obstacle Detection and Motion from Spatio-Temporal Derivatives
More informationPerceptual Quality Improvement of Stereoscopic Images
Perceptual Quality Improvement of Stereoscopic Images Jong In Gil and Manbae Kim Dept. of Computer and Communications Engineering Kangwon National University Chunchon, Republic of Korea, 200-701 E-mail:
More informationAn efficient face recognition algorithm based on multi-kernel regularization learning
Acta Technica 61, No. 4A/2016, 75 84 c 2017 Institute of Thermomechanics CAS, v.v.i. An efficient face recognition algorithm based on multi-kernel regularization learning Bi Rongrong 1 Abstract. A novel
More informationA threshold decision of the object image by using the smart tag
A threshold decision of the object image by using the smart tag Chang-Jun Im, Jin-Young Kim, Kwan Young Joung, Ho-Gil Lee Sensing & Perception Research Group Korea Institute of Industrial Technology (
More informationCanny Edge Based Self-localization of a RoboCup Middle-sized League Robot
Canny Edge Based Self-localization of a RoboCup Middle-sized League Robot Yoichi Nakaguro Sirindhorn International Institute of Technology, Thammasat University P.O. Box 22, Thammasat-Rangsit Post Office,
More informationViewpoint Invariant Features from Single Images Using 3D Geometry
Viewpoint Invariant Features from Single Images Using 3D Geometry Yanpeng Cao and John McDonald Department of Computer Science National University of Ireland, Maynooth, Ireland {y.cao,johnmcd}@cs.nuim.ie
More information2. TARGET PHOTOS FOR ANALYSIS
Proceedings of the IIEEJ Image Electronics and Visual Computing Workshop 2012 Kuching, Malaysia, November 21-24, 2012 QUANTITATIVE SHAPE ESTIMATION OF HIROSHIMA A-BOMB MUSHROOM CLOUD FROM PHOTOS Masashi
More informationQuality Guided Image Denoising for Low-Cost Fundus Imaging
Quality Guided Image Denoising for Low-Cost Fundus Imaging Thomas Köhler1,2, Joachim Hornegger1,2, Markus Mayer1,2, Georg Michelson2,3 20.03.2012 1 Pattern Recognition Lab, Ophthalmic Imaging Group 2 Erlangen
More informationCSE 527: Introduction to Computer Vision
CSE 527: Introduction to Computer Vision Week 5 - Class 1: Matching, Stitching, Registration September 26th, 2017 ??? Recap Today Feature Matching Image Alignment Panoramas HW2! Feature Matches Feature
More informationROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW
ROBUST LINE-BASED CALIBRATION OF LENS DISTORTION FROM A SINGLE VIEW Thorsten Thormählen, Hellward Broszio, Ingolf Wassermann thormae@tnt.uni-hannover.de University of Hannover, Information Technology Laboratory,
More informationFeature Detectors and Descriptors: Corners, Lines, etc.
Feature Detectors and Descriptors: Corners, Lines, etc. Edges vs. Corners Edges = maxima in intensity gradient Edges vs. Corners Corners = lots of variation in direction of gradient in a small neighborhood
More informationDepth Propagation with Key-Frame Considering Movement on the Z-Axis
, pp.131-135 http://dx.doi.org/10.1457/astl.014.47.31 Depth Propagation with Key-Frame Considering Movement on the Z-Axis Jin Woo Choi 1, Taeg Keun Whangbo 1 Culture Technology Institute, Gachon University,
More informationChapter 3 Image Registration. Chapter 3 Image Registration
Chapter 3 Image Registration Distributed Algorithms for Introduction (1) Definition: Image Registration Input: 2 images of the same scene but taken from different perspectives Goal: Identify transformation
More informationCalibration of Inertial Measurement Units Using Pendulum Motion
Technical Paper Int l J. of Aeronautical & Space Sci. 11(3), 234 239 (2010) DOI:10.5139/IJASS.2010.11.3.234 Calibration of Inertial Measurement Units Using Pendulum Motion Keeyoung Choi* and Se-ah Jang**
More informationRecognizing Buildings in Urban Scene of Distant View ABSTRACT
Recognizing Buildings in Urban Scene of Distant View Peilin Liu, Katsushi Ikeuchi and Masao Sakauchi Institute of Industrial Science, University of Tokyo, Japan 7-22-1 Roppongi, Minato-ku, Tokyo 106, Japan
More informationA real-time Road Boundary Detection Algorithm Based on Driverless Cars Xuekui ZHU. , Meijuan GAO2, b, Shangnian LI3, c
4th National Conference on Electrical, Electronics and Computer Engineering (NCEECE 2015) A real-time Road Boundary Detection Algorithm Based on Driverless Cars Xuekui ZHU 1, a, Meijuan GAO2, b, Shangnian
More informationEECS 442: Final Project
EECS 442: Final Project Structure From Motion Kevin Choi Robotics Ismail El Houcheimi Robotics Yih-Jye Jeffrey Hsu Robotics Abstract In this paper, we summarize the method, and results of our projective
More informationExploitation of GPS-Control Points in low-contrast IR-imagery for homography estimation
Exploitation of GPS-Control Points in low-contrast IR-imagery for homography estimation Patrick Dunau 1 Fraunhofer-Institute, of Optronics, Image Exploitation and System Technologies (IOSB), Gutleuthausstr.
More informationReal-time target tracking using a Pan and Tilt platform
Real-time target tracking using a Pan and Tilt platform Moulay A. Akhloufi Abstract In recent years, we see an increase of interest for efficient tracking systems in surveillance applications. Many of
More informationVision par ordinateur
Epipolar geometry π Vision par ordinateur Underlying structure in set of matches for rigid scenes l T 1 l 2 C1 m1 l1 e1 M L2 L1 e2 Géométrie épipolaire Fundamental matrix (x rank 2 matrix) m2 C2 l2 Frédéric
More informationPractical Camera Auto-Calibration Based on Object Appearance and Motion for Traffic Scene Visual Surveillance
Practical Camera Auto-Calibration Based on Object Appearance and Motion for Traffic Scene Visual Surveillance Zhaoxiang Zhang, Min Li, Kaiqi Huang and Tieniu Tan National Laboratory of Pattern Recognition,
More informationTowards the completion of assignment 1
Towards the completion of assignment 1 What to do for calibration What to do for point matching What to do for tracking What to do for GUI COMPSCI 773 Feature Point Detection Why study feature point detection?
More informationUnmanned Vehicle Technology Researches for Outdoor Environments. *Ju-Jang Lee 1)
Keynote Paper Unmanned Vehicle Technology Researches for Outdoor Environments *Ju-Jang Lee 1) 1) Department of Electrical Engineering, KAIST, Daejeon 305-701, Korea 1) jjlee@ee.kaist.ac.kr ABSTRACT The
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationAn Approach for Real Time Moving Object Extraction based on Edge Region Determination
An Approach for Real Time Moving Object Extraction based on Edge Region Determination Sabrina Hoque Tuli Department of Computer Science and Engineering, Chittagong University of Engineering and Technology,
More informationA Survey of Light Source Detection Methods
A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light
More informationCS 664 Image Matching and Robust Fitting. Daniel Huttenlocher
CS 664 Image Matching and Robust Fitting Daniel Huttenlocher Matching and Fitting Recognition and matching are closely related to fitting problems Parametric fitting can serve as more restricted domain
More informationINCREMENTAL DISPLACEMENT ESTIMATION METHOD FOR VISUALLY SERVOED PARIED STRUCTURED LIGHT SYSTEM (ViSP)
Blucher Mechanical Engineering Proceedings May 2014, vol. 1, num. 1 www.proceedings.blucher.com.br/evento/10wccm INCREMENAL DISPLACEMEN ESIMAION MEHOD FOR VISUALLY SERVOED PARIED SRUCURED LIGH SYSEM (ViSP)
More informationRegion Based Image Fusion Using SVM
Region Based Image Fusion Using SVM Yang Liu, Jian Cheng, Hanqing Lu National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences ABSTRACT This paper presents a novel
More informationSelf Lane Assignment Using Smart Mobile Camera For Intelligent GPS Navigation and Traffic Interpretation
For Intelligent GPS Navigation and Traffic Interpretation Tianshi Gao Stanford University tianshig@stanford.edu 1. Introduction Imagine that you are driving on the highway at 70 mph and trying to figure
More informationObject Recognition with Invariant Features
Object Recognition with Invariant Features Definition: Identify objects or scenes and determine their pose and model parameters Applications Industrial automation and inspection Mobile robots, toys, user
More informationRobust and Accurate Detection of Object Orientation and ID without Color Segmentation
0 Robust and Accurate Detection of Object Orientation and ID without Color Segmentation Hironobu Fujiyoshi, Tomoyuki Nagahashi and Shoichi Shimizu Chubu University Japan Open Access Database www.i-techonline.com
More informationStereo-Based Obstacle Avoidance in Indoor Environments with Active Sensor Re-Calibration
Stereo-Based Obstacle Avoidance in Indoor Environments with Active Sensor Re-Calibration Darius Burschka, Stephen Lee and Gregory Hager Computational Interaction and Robotics Laboratory Johns Hopkins University
More informationVISION-BASED UAV FLIGHT CONTROL AND OBSTACLE AVOIDANCE. Zhihai He, Ram Venkataraman Iyer, and Phillip R. Chandler
VISION-BASED UAV FLIGHT CONTROL AND OBSTACLE AVOIDANCE Zhihai He, Ram Venkataraman Iyer, and Phillip R Chandler ABSTRACT In this work, we explore various ideas and approaches to deal with the inherent
More informationComputing the relations among three views based on artificial neural network
Computing the relations among three views based on artificial neural network Ying Kin Yu Kin Hong Wong Siu Hang Or Department of Computer Science and Engineering The Chinese University of Hong Kong E-mail:
More informationFitting. Fitting. Slides S. Lazebnik Harris Corners Pkwy, Charlotte, NC
Fitting We ve learned how to detect edges, corners, blobs. Now what? We would like to form a higher-level, more compact representation of the features in the image by grouping multiple features according
More informationTitle: Vanishing Hull: A Geometric Concept for Vanishing Points Detection and Analysis
Pattern Recognition Manuscript Draft Manuscript Number: Title: Vanishing Hull: A Geometric Concept for Vanishing Points Detection and Analysis Article Type: Full Length Article Section/Category: Keywords:
More informationTri-modal Human Body Segmentation
Tri-modal Human Body Segmentation Master of Science Thesis Cristina Palmero Cantariño Advisor: Sergio Escalera Guerrero February 6, 2014 Outline 1 Introduction 2 Tri-modal dataset 3 Proposed baseline 4
More informationEE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm
EE368 Project Report CD Cover Recognition Using Modified SIFT Algorithm Group 1: Mina A. Makar Stanford University mamakar@stanford.edu Abstract In this report, we investigate the application of the Scale-Invariant
More informationFace Recognition Using Vector Quantization Histogram and Support Vector Machine Classifier Rong-sheng LI, Fei-fei LEE *, Yan YAN and Qiu CHEN
2016 International Conference on Artificial Intelligence: Techniques and Applications (AITA 2016) ISBN: 978-1-60595-389-2 Face Recognition Using Vector Quantization Histogram and Support Vector Machine
More informationRANSAC and some HOUGH transform
RANSAC and some HOUGH transform Thank you for the slides. They come mostly from the following source Dan Huttenlocher Cornell U Matching and Fitting Recognition and matching are closely related to fitting
More informationColour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation
ÖGAI Journal 24/1 11 Colour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation Michael Bleyer, Margrit Gelautz, Christoph Rhemann Vienna University of Technology
More informationMatching Evaluation of 2D Laser Scan Points using Observed Probability in Unstable Measurement Environment
Matching Evaluation of D Laser Scan Points using Observed Probability in Unstable Measurement Environment Taichi Yamada, and Akihisa Ohya Abstract In the real environment such as urban areas sidewalk,
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationReal-Time Document Image Retrieval for a 10 Million Pages Database with a Memory Efficient and Stability Improved LLAH
2011 International Conference on Document Analysis and Recognition Real-Time Document Image Retrieval for a 10 Million Pages Database with a Memory Efficient and Stability Improved LLAH Kazutaka Takeda,
More informationOcclusion Detection of Real Objects using Contour Based Stereo Matching
Occlusion Detection of Real Objects using Contour Based Stereo Matching Kenichi Hayashi, Hirokazu Kato, Shogo Nishida Graduate School of Engineering Science, Osaka University,1-3 Machikaneyama-cho, Toyonaka,
More informationIris Recognition for Eyelash Detection Using Gabor Filter
Iris Recognition for Eyelash Detection Using Gabor Filter Rupesh Mude 1, Meenakshi R Patel 2 Computer Science and Engineering Rungta College of Engineering and Technology, Bhilai Abstract :- Iris recognition
More information