Pedestrian Detection Using Multi-layer LIDAR
|
|
- Gregory Poole
- 5 years ago
- Views:
Transcription
1 1 st International Conference on Transportation Infrastructure and Materials (ICTIM 2016) ISBN: Pedestrian Detection Using Multi-layer LIDAR Mingfang Zhang 1, Yuping Lu 2 and Tong Liu 3 1 School of Automobile, Chang an University, Xi an, China, ; @qq.com 2 School of Automobile, Chang an University, Xi an, China, ; @qq.com 3 School of Automobile, Chang an University, Xi an, China, ; willie1020@163.com ABSTRACT: To avoid the potential ris of collision between pedestrians and egovehicle, we propose a new pedestrian detection algorithm based on multi-layer LIDAR. First, the points are clustered based on point-distance segmentation, and non-pedestrian clusters are eliminated with physical attributes of pedestrian. Then pedestrian probability is calculated using Bayes rules, and non-parametric ernel density lielihood function estimation model is established to estimate the pose of pedestrian. Moreover, linear Kalman filter is utilized to trac the pedestrian which improves the detection accuracy at part occlusion situation. The experiment validates that our algorithm can accurately detect pedestrians in front of ego-vehicle, and the recognition results based on the fusion of detection and tracing processes is better than those from single pedestrian attribute detection. INTRODUCTION Efficient pedestrian detection method is beneficial to reduce the collision probability among the pedestrians and vehicles in urban environment, thus developing robust pedestrian protection system is an urgent tas in the active safety area. Now the main sensors applied for pedestrian detection are vision and Lidar. The image provides rich depth information, but it is susceptible to be disturbed by the light and bad weather (Cheng 2013; Garcia 2014). Lidar has the advantages of fast processing ability and high measurement level, especially insusceptible to bad environmental condition. The algorithm of pedestrian detection using Lidar includes three categories: the detection based on geometry feature (Gidel 2008; Grassi 2011), the detection based on occupancy grid (Schutz 2012), and the detection based on behavior (Fayad 2007; Gate 2009). The detection algorithm based on geometrical model uses the specific bounding box to match with the target measurement for target recognition, but the constraint is that pedestrians with part occlusion is hard to detect, and the recognition accuracy is uncertain when the point distribution of the observed target changes. Although the detection algorithm based on occupancy grid detect the moving object fast, the category of the target is hard to determine. The detection algorithm based on behavior can not recognize every object in the scene, thus this heuristic method is employed to classify the static or moving objects before the occlusion happened. To detect the pedestrian robustly, even in the occlusion situations, in this paper we utilizes multi-layer Lidar to detect the pedestrians in close range, and uses object tracing to ensure the consistency of the occluded pedestrian detection result. First, all the discrete points are clustered, pedestrians and non-pedestrians are segmented based on the physical attribute of motion parameters. The pedestrian probability is calculated using Bayes rules in combination with the width and velocity information. Second, non-parametric unsupervised estimation model is built to mae the information fusion of four scanning 575
2 surfaces, and linear Kalman filer is employed to trac the pedestrian and further enhance the detection accuracy. The pitching compensation of four scanning surfaces can effectively solve the bump and vibration problems. Finally, the test in real scenario is conducted to demonstrate the performance of our method with multi-layer Lidar. PEDESTRIAN DETECTION IBEO LUX multi-layer Lidar (Figure 1) is installed on the front of test car at the height of 60cm for pedestrian detection. Its scanning frequency is 12.5Hz and angle resolution is 0.1 degree. It scans the front sector region on four different surfaces. Figure 2 shows the laser points on four surfaces in Cartesian coordinate system during one scan. The general structure of pedestrian detection in this paper is shown in Figure 3. In the module of clustering and segmentation, interest region is extracted based on the distance rule and the origin scattered points are filtered to improve the acquisition of the target object. In feature extraction module, we segment pedestrian from non-pedestrian objects coarsely and estimate the pedestrian probability as well as the pose with pedestrian physical property. In the classification module, we use the tracing result to correct the detection accuracy further. Figure 1. LUX multilayer Lidar. Figure 2. Scan data from four layers. Raw data from LUX Clustering and segmentation Feature extraction Pedestrian classification Figure 3. Framewor of pedestrian detection. Data Pre-processing Multi-layer Lidar emits the laser points along four scan surfaces vertically. In order to extract the candidate pedestrian clusters, we project the raw point cloud onto 2D plane and remove noise points. The candidate pedestrians are extracted with distance-based clustering method. Then we tacle with the individual cluster which belongs to the same object. The details for clustering are as follows: Step 1: The raw point cloud set is denoted as P1 ( m, n) ( xm, n, ym, n), where m is the index of scanning surface, n is the number of laser points on each surface, m 1,2,3,4. 576
3 And ( xm, n, ym, n) is Cartesian coordinate of the n th point located in the m th plane. Project all the points onto 2D horizontal plane. Step 2: Segment the point cloud on horizontal plane into several cluster based on Euclidean distance D( ri, ri 1) between two consecutive points. According to the cosine law, D( ri, ri 1) is calculated as D( r, r ) r r 2r r cos (1) 2 2 i i 1 i i 1 i i 1 If D( ri, ri 1) D0, these two points belong to the same cluster, otherwise two cluster. D is set as (Mendes 2004): 0 D 2(1 cos ) min{ ri, ri 1} C cot [cos( 2) sin( 2)] 0 0 where ri 1 and r i are respectively the distance between the projective point and Lidar for two adjacent scanning points, denotes the parameter to reduce the effect of segmentation, denotes the angle resolution of Lidar, and C 0 denotes the vertical error of Lidar. Course Detection Mixed traffic exists in urban environment with multiple participants (bus, car, bicycle and pedestrian) and we obtained the clusters including different objects from the preprocessing. We need to extract the interest region containing the target objects with the feature of pedestrian. If the motion of two legs is only employed, it is difficult to detect the pedestrian from complex outdoor environment. Therefore, we combine the motion feature with the shape characteristics and mae a box model for pedestrian. Consider inherent attribute of the fitting rectangle, such as the height, width and moving range of legs, we remove the unmatched clusters and retain the cluster which has the approximate shape feature of pedestrian. Assumed pedestrian wals with the normal speed, the maximum range of legs in waling state should be that the width is shorter than 75cm and longer than 10cm. when laser points on four scanning surfaces project on the pedestrian, the top two plane mainly focus on the top of pedestrian while the lower two surfaces scan the legs of pedestrian. The largest width of two middle scanning surfaces during each frame is regarded as the width of pedestrian. For the inetic characteristics, the width of pedestrian presents normal distribution, while the speed shows discrete uniform distribution. Next, Bayesian discriminant analysis method is utilized for coarse detection of pedestrian. At time t, set the feature vector as Z (, ) T t W V. Width W and velocity V are independent variables, the prior probabilities of pedestrian and non-pedestrian are respectively P( ped ) and P( noped ), and the class-conditional probability are P( Zt ped ) and P( Zt noped ). Set P( noped Zt) P( ped Zt) 1 and P( Zt ped ) P( W ped ) P( V ped ). The preliminary pedestrian detection problem is formulated as maximizing a posterior P( ped Z t ) of an interpretation for both shape and motion features, which denotes the (2) 577
4 probability that the detected object possesses the feature Z t. Given the set of feature vector Zt over T frames: 1 P( ped Zt) P( Zt ped ) P( ped ) (3) where P( Z ped ) P( ped ) P( Z noped ) P( noped ). For each sample, if t t P( ped Z t ) is larger than the predefined threshold, it will be classified as pedestrian. The threshold is decided by the expectation of the classification result. Pose Estimation The main advantage of multi-layer Lidar is that the raw point cloud from three scanning surfaces help filter the wrong detection data on the other single surface, and also help improve the detection accuracy as a whole. The multi-layer pitching compensation technology provides the possibility of correct detection in the case of part occlusion. After coarse segmentation of pedestrian and non-pedestrian is conducted, we employ ernel probability density function method to estimate the pose of the detected pedestrian and calculate the pedestrian probability density on each scanning surface. The objective of pose estimation is to determine whether each laser point is the center of pose or not and prepare for the tracing tas. Set each laser point of the pedestrian cluster as discrete random variable 1, 2, where 1 and 2 are Bernoulli variables. If the laser point is the center of pose, 1 ; otherwise, 2. The lielihood function of the probability that the laser point is the center of pose pp ( m ) in mth scanning surface is determined by both the sensor characteristics and the distance between the sensor and the target objects, and the formula is as follows: N 1 pp ( m ) (, 1) (4) N m i 1 where (, 1) is ernel function of Parzen window model to estimate the affected region using neighboring points to correct the current point; N denotes the total number of laser points in the scene; N m denotes the total number of laser points located in the pedestrian cluster on the m th scanning surface. The laser point with the maximum probability pp ( m ) is selected as the center of pose on the m th scanning surface. All the points belonging to the center of pose on different scanning surface are projected to the horizontal surface and integrated to get the final fusion pose of the pedestrian. Pedestrian Tracing During the pedestrian detection process, the measurement error of Lidar sensor cannot be avoided. Note that pedestrian occlusion frequently occurs in real road environment, and the measurement error of the gravity center exists. Therefore, the pose of moving pedestrian should be filtered and traced to improve the detection accuracy. Assumed the prior nowledge of pedestrian s trajectory is unnown, the direction of motion and the velocity are also unnown. Consider the occlusion situation in the detection process, the 578
5 inetic state at last moment is utilized to predict the next moment, so we use linear Kalman filter to cope with pedestrian tracing problem. Define state vector X (O, x,..., x ) contains the number of pedestrians and the feature information. 1, N, O denotes the discrete random variable, xn, ( pn,, vn,, IN, ) denotes the state of pedestrian N, pn, denotes the pose of pedestrian, v N, denotes the velocity of pedestrian, and IN, denotes the classification frames as well as the number of reflected points. The state equation for pedestrian is: X AX v (5) where system matrix is A 1 0, state noise v is Gaussian function sequence with mean 0, and its variance is determined by the maximum range of legs. Observation function is Z BX w, where Z denotes the observation vector at time, observation matrix is B [1 0], state noise w is Gaussian function measurement sequence with mean 0, and its variance is determined by maximum measurement error of the Lidar. Observation update equation is as follows: Xˆ ˆ ˆ 1 X H 1(Z 1 B X ) T T 1 H 1 P 1B [ BP 1B r] (6) P 1 (I H 1B) P 1 where Xˆ 1 is the estimated value for system state vector, H 1 is Kalman filter gain, P is the covariance of Kalman filter. 1 EXPERIMENT RESULT To evaluate the effectiveness of the proposed algorithm, we conduct several tests in campus of Chang an University from 9:00am to 3:00pm, including the intersection and main street scenes. More than 7200 frames of the collected data are employed to test our algorithm. Figure 4 shows one test scenario at the street in front of School of automobile building, as well as actual scan measurement from Lidar. We compare the usual pedestrian detection method in (Naatsubo 2010) with our algorithm, and the result is shown in Figure 5. The proposed pedestrian model combines the specific physical attributes with the change of the point cloud distribution, and the fusion process of coarse detection and tracing correction maes a better detection accuracy than the method using simple physical attributes in (Naatsubo 2010). The reason for false detection from the method in (Naatsubo 2010) can be interpreted as the part occlusion from the neighboring objects or the misclassification of slowly moving bicycles. In our algorithm, both the motion information and shape feature are employed for pedestrian detection, and the tracing process figures out the part occlusion to improve the detection accuracy. Furthermore, the pitching compensation technology of multi-layer Lidar overcomes the bump and vibration of moving ego-vehicle, as well as the occasional occlusion situations. 579
6 (a) Real scenario with camera (b) Scan point measurement, 1 roadside green belt,2 deceleration strip,3 pedestrian A and its trajectory,4 vehicle stopping at roadside Figure 4. Lidar Scan Measurement Scenario. 580
7 Figure 5. ROC curve for the test result comparison between the proposed method and the pedestrian detection method in (Naatsubo 2010). CONCLUSIONS In this paper, we propose a new pedestrian detection method using multi-layer Lidar. Distance-based segmentation is used for clustering process of all the raw point cloud. According to the basic attributes of pedestrian, non-pedestrian objects are removed with ernel probability density model. The laser point information from four surfaces is integrated for pose estimation and pedestrian tracing to figure out the occlusion problem. The experiment results demonstrate that pedestrian can be detected effectively with our algorithm using multi-layer Lidar. Moreover, the tracing process can improve the detection accuracy. In the future, we will use the fusion of camera and Lidar to improve the detection result further. REFERENCES Cheng W, Jhan D. A self-constructing cascade classifier with AdaBoost and SVM for pedestriandetection. Engineering Applications of Artificial Intelligence, 2013, 26(3): Fayad F, Cherfaoui V. Tracing objects using a laser scanner in driving situation based on modeling target shape. Intelligent Vehicles Symposium, IEEE: Gidel S, Checchin P, Blanc C, et al. Parzen method for fusion of laserscanner data: Application to pedestrian detection. Intelligent Vehicles Symposium, IEEE: Gate G, Nashashibi F. Fast algorithm for pedestrian and group of pedestrians detection using a laser scanner. Intelligent Vehicles Symposium, IEEE: Garcia, Fernando, et al. Context aided pedestrian detection for danger estimation based on laser scanner and computer vision. Expert Systems with Applications, 2014, 41(15): Grassi A, Frolov V, León F. Information fusion to detect and classify pedestrians using invariant features. Information fusion, 2011, 12(4):
8 Mendes A, Nunes U. Situation based multi target detection and tracing with laserscanner in outdoor semi-structured environment. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. Sendai, Japan: IEEE, 2004: Naatsubo K, Yamada K. Detecting unusual pedestrian behavior toward own vehicle for vehicle-to-pedestrian collision avoidance. Intelligent Vehicles Symposium (IV), 2010 IEEE. IEEE, Schutz, Marus, et al. Laser-based hierarchical grid mapping for detection and tracing of moving objects. Advanced Microsystems for Automotive Applications Tian H, Duan Z, Abraham A. A novel multiplex cascade classifier for pedestrian detection. Pattern Recognition Letters, 2013, 34(14),
W4. Perception & Situation Awareness & Decision making
W4. Perception & Situation Awareness & Decision making Robot Perception for Dynamic environments: Outline & DP-Grids concept Dynamic Probabilistic Grids Bayesian Occupancy Filter concept Dynamic Probabilistic
More informationLaserscanner Based Cooperative Pre-Data-Fusion
Laserscanner Based Cooperative Pre-Data-Fusion 63 Laserscanner Based Cooperative Pre-Data-Fusion F. Ahlers, Ch. Stimming, Ibeo Automobile Sensor GmbH Abstract The Cooperative Pre-Data-Fusion is a novel
More informationCLASSIFICATION FOR ROADSIDE OBJECTS BASED ON SIMULATED LASER SCANNING
CLASSIFICATION FOR ROADSIDE OBJECTS BASED ON SIMULATED LASER SCANNING Kenta Fukano 1, and Hiroshi Masuda 2 1) Graduate student, Department of Intelligence Mechanical Engineering, The University of Electro-Communications,
More information3D LIDAR Point Cloud based Intersection Recognition for Autonomous Driving
3D LIDAR Point Cloud based Intersection Recognition for Autonomous Driving Quanwen Zhu, Long Chen, Qingquan Li, Ming Li, Andreas Nüchter and Jian Wang Abstract Finding road intersections in advance is
More informationExtended target tracking using PHD filters
Ulm University 2014 01 29 1(35) With applications to video data and laser range data Division of Automatic Control Department of Electrical Engineering Linöping university Linöping, Sweden Presentation
More informationA Street Scene Surveillance System for Moving Object Detection, Tracking and Classification
A Street Scene Surveillance System for Moving Object Detection, Tracking and Classification Huei-Yung Lin * and Juang-Yu Wei Department of Electrical Engineering National Chung Cheng University Chia-Yi
More information2 OVERVIEW OF RELATED WORK
Utsushi SAKAI Jun OGATA This paper presents a pedestrian detection system based on the fusion of sensors for LIDAR and convolutional neural network based image classification. By using LIDAR our method
More informationPedestrian Recognition Using High-definition LIDAR
20 IEEE Intelligent Vehicles Symposium (IV) Baden-Baden, Germany, June 5-9, 20 Pedestrian Recognition Using High-definition LIDAR Kiyosumi Kidono, Takeo Miyasaka, Akihiro Watanabe, Takashi Naito, and Jun
More informationReal-Time Human Detection using Relational Depth Similarity Features
Real-Time Human Detection using Relational Depth Similarity Features Sho Ikemura, Hironobu Fujiyoshi Dept. of Computer Science, Chubu University. Matsumoto 1200, Kasugai, Aichi, 487-8501 Japan. si@vision.cs.chubu.ac.jp,
More informationConstruction Progress Management and Interior Work Analysis Using Kinect 3D Image Sensors
33 rd International Symposium on Automation and Robotics in Construction (ISARC 2016) Construction Progress Management and Interior Work Analysis Using Kinect 3D Image Sensors Kosei Ishida 1 1 School of
More informationA DATA DRIVEN METHOD FOR FLAT ROOF BUILDING RECONSTRUCTION FROM LiDAR POINT CLOUDS
A DATA DRIVEN METHOD FOR FLAT ROOF BUILDING RECONSTRUCTION FROM LiDAR POINT CLOUDS A. Mahphood, H. Arefi *, School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran,
More informationDetection and Tracking of Moving Objects Using 2.5D Motion Grids
Detection and Tracking of Moving Objects Using 2.5D Motion Grids Alireza Asvadi, Paulo Peixoto and Urbano Nunes Institute of Systems and Robotics, University of Coimbra September 2015 1 Outline: Introduction
More informationUncertainties: Representation and Propagation & Line Extraction from Range data
41 Uncertainties: Representation and Propagation & Line Extraction from Range data 42 Uncertainty Representation Section 4.1.3 of the book Sensing in the real world is always uncertain How can uncertainty
More informationSensory Augmentation for Increased Awareness of Driving Environment
Sensory Augmentation for Increased Awareness of Driving Environment Pranay Agrawal John M. Dolan Dec. 12, 2014 Technologies for Safe and Efficient Transportation (T-SET) UTC The Robotics Institute Carnegie
More informationCover Page. Abstract ID Paper Title. Automated extraction of linear features from vehicle-borne laser data
Cover Page Abstract ID 8181 Paper Title Automated extraction of linear features from vehicle-borne laser data Contact Author Email Dinesh Manandhar (author1) dinesh@skl.iis.u-tokyo.ac.jp Phone +81-3-5452-6417
More informationEfficient L-Shape Fitting for Vehicle Detection Using Laser Scanners
Efficient L-Shape Fitting for Vehicle Detection Using Laser Scanners Xiao Zhang, Wenda Xu, Chiyu Dong, John M. Dolan, Electrical and Computer Engineering, Carnegie Mellon University Robotics Institute,
More informationTowards Fully-automated Driving. tue-mps.org. Challenges and Potential Solutions. Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA
Towards Fully-automated Driving Challenges and Potential Solutions Dr. Gijs Dubbelman Mobile Perception Systems EE-SPS/VCA Mobile Perception Systems 6 PhDs, 1 postdoc, 1 project manager, 2 software engineers
More informationIntelligent Robotics
64-424 Intelligent Robotics 64-424 Intelligent Robotics http://tams.informatik.uni-hamburg.de/ lectures/2013ws/vorlesung/ir Jianwei Zhang / Eugen Richter Faculty of Mathematics, Informatics and Natural
More informationResearch on Recognition and Classification of Moving Objects in Mixed Traffic Based on Video Detection
Hu, Qu, Li and Wang 1 Research on Recognition and Classification of Moving Objects in Mixed Traffic Based on Video Detection Hongyu Hu (corresponding author) College of Transportation, Jilin University,
More informationSpatio temporal Segmentation using Laserscanner and Video Sequences
Spatio temporal Segmentation using Laserscanner and Video Sequences Nico Kaempchen, Markus Zocholl and Klaus C.J. Dietmayer Department of Measurement, Control and Microtechnology University of Ulm, D 89081
More informationVision-based Frontal Vehicle Detection and Tracking
Vision-based Frontal and Tracking King Hann LIM, Kah Phooi SENG, Li-Minn ANG and Siew Wen CHIN School of Electrical and Electronic Engineering The University of Nottingham Malaysia campus, Jalan Broga,
More information차세대지능형자동차를위한신호처리기술 정호기
차세대지능형자동차를위한신호처리기술 008.08. 정호기 E-mail: hgjung@mando.com hgjung@yonsei.ac.kr 0 . 지능형자동차의미래 ) 단위 system functions 운전자상황인식 얼굴방향인식 시선방향인식 졸음운전인식 운전능력상실인식 차선인식, 전방장애물검출및분류 Lane Keeping System + Adaptive Cruise
More informationEE565:Mobile Robotics Lecture 3
EE565:Mobile Robotics Lecture 3 Welcome Dr. Ahmad Kamal Nasir Today s Objectives Motion Models Velocity based model (Dead-Reckoning) Odometry based model (Wheel Encoders) Sensor Models Beam model of range
More informationProcessing of distance measurement data
7Scanprocessing Outline 64-424 Intelligent Robotics 1. Introduction 2. Fundamentals 3. Rotation / Motion 4. Force / Pressure 5. Frame transformations 6. Distance 7. Scan processing Scan data filtering
More informationPedestrian Detection Using Correlated Lidar and Image Data EECS442 Final Project Fall 2016
edestrian Detection Using Correlated Lidar and Image Data EECS442 Final roject Fall 2016 Samuel Rohrer University of Michigan rohrer@umich.edu Ian Lin University of Michigan tiannis@umich.edu Abstract
More informationContext Aided Multilevel Pedestrian Detection
Context Aided Multilevel Pedestrian Detection Fernando García, Arturo de la Escalera and José María Armingol Intelligent Systems Lab. Universidad Carlos III of Madrid fegarcia@ing.uc3m.es Abstract The
More informationRobot Simultaneous Localization and Mapping Based on Self-Detected Waypoint
BULGARIAN ACADEMY OF SCIENCES CYBERNETICS AND INFORMATION TECHNOLOGIES Volume 16, No 2 Sofia 2016 Print ISSN: 1311-9702; Online ISSN: 1314-4081 DOI: 10.1515/cait-2016-0031 Robot Simultaneous Localization
More information[2008] IEEE. Reprinted, with permission, from [Yan Chen, Qiang Wu, Xiangjian He, Wenjing Jia,Tom Hintz, A Modified Mahalanobis Distance for Human
[8] IEEE. Reprinted, with permission, from [Yan Chen, Qiang Wu, Xiangian He, Wening Jia,Tom Hintz, A Modified Mahalanobis Distance for Human Detection in Out-door Environments, U-Media 8: 8 The First IEEE
More informationComputer Vision with MATLAB MATLAB Expo 2012 Steve Kuznicki
Computer Vision with MATLAB MATLAB Expo 2012 Steve Kuznicki 2011 The MathWorks, Inc. 1 Today s Topics Introduction Computer Vision Feature-based registration Automatic image registration Object recognition/rotation
More informationResearch on-board LIDAR point cloud data pretreatment
Acta Technica 62, No. 3B/2017, 1 16 c 2017 Institute of Thermomechanics CAS, v.v.i. Research on-board LIDAR point cloud data pretreatment Peng Cang 1, Zhenglin Yu 1, Bo Yu 2, 3 Abstract. In view of the
More informationDYNAMIC STEREO VISION FOR INTERSECTION ASSISTANCE
FISITA 2008 World Automotive Congress Munich, Germany, September 2008. DYNAMIC STEREO VISION FOR INTERSECTION ASSISTANCE 1 Franke, Uwe *, 2 Rabe, Clemens, 1 Gehrig, Stefan, 3 Badino, Hernan, 1 Barth, Alexander
More informationBus Detection and recognition for visually impaired people
Bus Detection and recognition for visually impaired people Hangrong Pan, Chucai Yi, and Yingli Tian The City College of New York The Graduate Center The City University of New York MAP4VIP Outline Motivation
More informationAn indirect tire identification method based on a two-layered fuzzy scheme
Journal of Intelligent & Fuzzy Systems 29 (2015) 2795 2800 DOI:10.3233/IFS-151984 IOS Press 2795 An indirect tire identification method based on a two-layered fuzzy scheme Dailin Zhang, Dengming Zhang,
More informationLoop detection and extended target tracking using laser data
Licentiate seminar 1(39) Loop detection and extended target tracking using laser data Karl Granström Division of Automatic Control Department of Electrical Engineering Linköping University Linköping, Sweden
More informationGeometrical Feature Extraction Using 2D Range Scanner
Geometrical Feature Extraction Using 2D Range Scanner Sen Zhang Lihua Xie Martin Adams Fan Tang BLK S2, School of Electrical and Electronic Engineering Nanyang Technological University, Singapore 639798
More informationMoving Objects Detection and Classification Based on Trajectories of LRF Scan Data on a Grid Map
Moving Objects Detection and Classification Based on Trajectories of LRF Scan Data on a Grid Map Taketoshi Mori, Takahiro Sato, Hiroshi Noguchi, Masamichi Shimosaka, Rui Fukui and Tomomasa Sato Abstract
More informationLast week. Multi-Frame Structure from Motion: Multi-View Stereo. Unknown camera viewpoints
Last week Multi-Frame Structure from Motion: Multi-View Stereo Unknown camera viewpoints Last week PCA Today Recognition Today Recognition Recognition problems What is it? Object detection Who is it? Recognizing
More informationTightly-Coupled LIDAR and Computer Vision Integration for Vehicle Detection
Tightly-Coupled LIDAR and Computer Vision Integration for Vehicle Detection Lili Huang, Student Member, IEEE, and Matthew Barth, Senior Member, IEEE Abstract In many driver assistance systems and autonomous
More informationDomain Adaptation For Mobile Robot Navigation
Domain Adaptation For Mobile Robot Navigation David M. Bradley, J. Andrew Bagnell Robotics Institute Carnegie Mellon University Pittsburgh, 15217 dbradley, dbagnell@rec.ri.cmu.edu 1 Introduction An important
More informationIntersection Safety using Lidar and Stereo Vision sensors
Intersection Safety using Lidar and Stereo Vision sensors Olivier Aycard, Qadeer Baig, Siviu Bota, Fawzi Nashashibi, Sergiu Nedevschi, Cosmin Pantilie, Michel Parent, Paulo Resende, Trung-Dung Vu University
More information6D-Vision: Fusion of Stereo and Motion for Robust Environment Perception
6D-Vision: Fusion of Stereo and Motion for Robust Environment Perception Uwe Franke, Clemens Rabe, Hernán Badino, and Stefan Gehrig DaimlerChrysler AG, 70546 Stuttgart, Germany {uwe.franke,clemens.rabe,hernan.badino,stefan.gehrig}@daimlerchrysler.com
More informationDefinition, Detection, and Evaluation of Meeting Events in Airport Surveillance Videos
Definition, Detection, and Evaluation of Meeting Events in Airport Surveillance Videos Sung Chun Lee, Chang Huang, and Ram Nevatia University of Southern California, Los Angeles, CA 90089, USA sungchun@usc.edu,
More informationHuman Detection. A state-of-the-art survey. Mohammad Dorgham. University of Hamburg
Human Detection A state-of-the-art survey Mohammad Dorgham University of Hamburg Presentation outline Motivation Applications Overview of approaches (categorized) Approaches details References Motivation
More informationProf. Fanny Ficuciello Robotics for Bioengineering Visual Servoing
Visual servoing vision allows a robotic system to obtain geometrical and qualitative information on the surrounding environment high level control motion planning (look-and-move visual grasping) low level
More informationProc. 14th Int. Conf. on Intelligent Autonomous Systems (IAS-14), 2016
Proc. 14th Int. Conf. on Intelligent Autonomous Systems (IAS-14), 2016 Outdoor Robot Navigation Based on View-based Global Localization and Local Navigation Yohei Inoue, Jun Miura, and Shuji Oishi Department
More informationVerification: is that a lamp? What do we mean by recognition? Recognition. Recognition
Recognition Recognition The Margaret Thatcher Illusion, by Peter Thompson The Margaret Thatcher Illusion, by Peter Thompson Readings C. Bishop, Neural Networks for Pattern Recognition, Oxford University
More informationVehicle Occupant Posture Analysis Using Voxel Data
Ninth World Congress on Intelligent Transport Systems, Chicago, Illinois, October Vehicle Occupant Posture Analysis Using Voxel Data Ivana Mikic, Mohan Trivedi Computer Vision and Robotics Research Laboratory
More informationQUASI-3D SCANNING WITH LASERSCANNERS
QUASI-3D SCANNING WITH LASERSCANNERS V. Willhoeft, K. Ch. Fuerstenberg, IBEO Automobile Sensor GmbH, vwi@ibeo.de INTRODUCTION: FROM 2D TO 3D Laserscanners are laser-based range-finding devices. They create
More informationWhat do we mean by recognition?
Announcements Recognition Project 3 due today Project 4 out today (help session + photos end-of-class) The Margaret Thatcher Illusion, by Peter Thompson Readings Szeliski, Chapter 14 1 Recognition What
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationAUTOMATIC PARKING OF SELF-DRIVING CAR BASED ON LIDAR
AUTOMATIC PARKING OF SELF-DRIVING CAR BASED ON LIDAR Bijun Lee a, Yang Wei a, I. Yuan Guo a a State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University,
More informationOn Board 6D Visual Sensors for Intersection Driving Assistance Systems
On Board 6D Visual Sensors for Intersection Driving Assistance Systems S. Nedevschi, T. Marita, R. Danescu, F. Oniga, S. Bota, I. Haller, C. Pantilie, M. Drulea, C. Golban Sergiu.Nedevschi@cs.utcluj.ro
More informationOptical Flow-Based Person Tracking by Multiple Cameras
Proc. IEEE Int. Conf. on Multisensor Fusion and Integration in Intelligent Systems, Baden-Baden, Germany, Aug. 2001. Optical Flow-Based Person Tracking by Multiple Cameras Hideki Tsutsui, Jun Miura, and
More informationModel-based Visual Tracking:
Technische Universität München Model-based Visual Tracking: the OpenTL framework Giorgio Panin Technische Universität München Institut für Informatik Lehrstuhl für Echtzeitsysteme und Robotik (Prof. Alois
More informationReal-Time Detection of Road Markings for Driving Assistance Applications
Real-Time Detection of Road Markings for Driving Assistance Applications Ioana Maria Chira, Ancuta Chibulcutean Students, Faculty of Automation and Computer Science Technical University of Cluj-Napoca
More informationC. Premsai 1, Prof. A. Kavya 2 School of Computer Science, School of Computer Science Engineering, Engineering VIT Chennai, VIT Chennai
Traffic Sign Detection Via Graph-Based Ranking and Segmentation Algorithm C. Premsai 1, Prof. A. Kavya 2 School of Computer Science, School of Computer Science Engineering, Engineering VIT Chennai, VIT
More informationPRECEDING VEHICLE TRACKING IN STEREO IMAGES VIA 3D FEATURE MATCHING
PRECEDING VEHICLE TRACKING IN STEREO IMAGES VIA 3D FEATURE MATCHING Daniel Weingerl, Wilfried Kubinger, Corinna Engelhardt-Nowitzki UAS Technikum Wien: Department for Advanced Engineering Technologies,
More informationInteracting Object Tracking in Crowded Urban Areas
Interacting Object Tracing in Crowded Urban Areas Chieh-Chih Wang, Tzu-Chien Lo and Shao-Wen Yang Department of Computer Science and Information Engineering National Taiwan University, Taipei, Taiwan Email:
More informationDETECTION AND ROBUST ESTIMATION OF CYLINDER FEATURES IN POINT CLOUDS INTRODUCTION
DETECTION AND ROBUST ESTIMATION OF CYLINDER FEATURES IN POINT CLOUDS Yun-Ting Su James Bethel Geomatics Engineering School of Civil Engineering Purdue University 550 Stadium Mall Drive, West Lafayette,
More informationFusion Between Laser and Stereo Vision Data For Moving Objects Tracking In Intersection Like Scenario
Fusion Between Laser and Stereo Vision Data For Moving Objects Tracking In Intersection Like Scenario Qadeer Baig, Olivier Aycard, Trung Dung Vu and Thierry Fraichard Abstract Using multiple sensors in
More informationTraffic Flow Prediction Based on the location of Big Data. Xijun Zhang, Zhanting Yuan
5th International Conference on Civil Engineering and Transportation (ICCET 205) Traffic Flow Prediction Based on the location of Big Data Xijun Zhang, Zhanting Yuan Lanzhou Univ Technol, Coll Elect &
More informationDetection and Classification of Vehicles
Detection and Classification of Vehicles Gupte et al. 2002 Zeeshan Mohammad ECG 782 Dr. Brendan Morris. Introduction Previously, magnetic loop detectors were used to count vehicles passing over them. Advantages
More informationFAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES
FAST REGISTRATION OF TERRESTRIAL LIDAR POINT CLOUD AND SEQUENCE IMAGES Jie Shao a, Wuming Zhang a, Yaqiao Zhu b, Aojie Shen a a State Key Laboratory of Remote Sensing Science, Institute of Remote Sensing
More informationScene Text Detection Using Machine Learning Classifiers
601 Scene Text Detection Using Machine Learning Classifiers Nafla C.N. 1, Sneha K. 2, Divya K.P. 3 1 (Department of CSE, RCET, Akkikkvu, Thrissur) 2 (Department of CSE, RCET, Akkikkvu, Thrissur) 3 (Department
More informationAutonomous Mobile Robot Design
Autonomous Mobile Robot Design Topic: EKF-based SLAM Dr. Kostas Alexis (CSE) These slides have partially relied on the course of C. Stachniss, Robot Mapping - WS 2013/14 Autonomous Robot Challenges Where
More information3D object recognition used by team robotto
3D object recognition used by team robotto Workshop Juliane Hoebel February 1, 2016 Faculty of Computer Science, Otto-von-Guericke University Magdeburg Content 1. Introduction 2. Depth sensor 3. 3D object
More informationA New Curb Detection Method for Unmanned Ground Vehicles Using 2D Sequential Laser Data
Sensors 2013, 13, 1102-1120; doi:10.3390/s130101102 Article OPEN ACCESS sensors ISSN 1424-8220 www.mdpi.com/journal/sensors A New Curb Detection Method for Unmanned Ground Vehicles Using 2D Sequential
More informationEE631 Cooperating Autonomous Mobile Robots
EE631 Cooperating Autonomous Mobile Robots Lecture: Multi-Robot Motion Planning Prof. Yi Guo ECE Department Plan Introduction Premises and Problem Statement A Multi-Robot Motion Planning Algorithm Implementation
More informationSensor Fusion-Based Parking Assist System
Sensor Fusion-Based Parking Assist System 2014-01-0327 Jaeseob Choi, Eugene Chang, Daejoong Yoon, and Seongsook Ryu Hyundai & Kia Corp. Hogi Jung and Jaekyu Suhr Hanyang Univ. Published 04/01/2014 CITATION:
More informationDetection and Motion Planning for Roadside Parked Vehicles at Long Distance
2015 IEEE Intelligent Vehicles Symposium (IV) June 28 - July 1, 2015. COEX, Seoul, Korea Detection and Motion Planning for Roadside Parked Vehicles at Long Distance Xue Mei, Naoki Nagasaka, Bunyo Okumura,
More informationParticle Filtering. CS6240 Multimedia Analysis. Leow Wee Kheng. Department of Computer Science School of Computing National University of Singapore
Particle Filtering CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS6240) Particle Filtering 1 / 28 Introduction Introduction
More information3D Convolutional Neural Networks for Landing Zone Detection from LiDAR
3D Convolutional Neural Networks for Landing Zone Detection from LiDAR Daniel Mataruna and Sebastian Scherer Presented by: Sabin Kafle Outline Introduction Preliminaries Approach Volumetric Density Mapping
More informationEnsemble of Bayesian Filters for Loop Closure Detection
Ensemble of Bayesian Filters for Loop Closure Detection Mohammad Omar Salameh, Azizi Abdullah, Shahnorbanun Sahran Pattern Recognition Research Group Center for Artificial Intelligence Faculty of Information
More informationTask analysis based on observing hands and objects by vision
Task analysis based on observing hands and objects by vision Yoshihiro SATO Keni Bernardin Hiroshi KIMURA Katsushi IKEUCHI Univ. of Electro-Communications Univ. of Karlsruhe Univ. of Tokyo Abstract In
More informationPedestrian counting in video sequences using optical flow clustering
Pedestrian counting in video sequences using optical flow clustering SHIZUKA FUJISAWA, GO HASEGAWA, YOSHIAKI TANIGUCHI, HIROTAKA NAKANO Graduate School of Information Science and Technology Osaka University
More informationTransactions on Information and Communications Technologies vol 16, 1996 WIT Press, ISSN
ransactions on Information and Communications echnologies vol 6, 996 WI Press, www.witpress.com, ISSN 743-357 Obstacle detection using stereo without correspondence L. X. Zhou & W. K. Gu Institute of Information
More informationLIGHT STRIPE PROJECTION-BASED PEDESTRIAN DETECTION DURING AUTOMATIC PARKING OPERATION
F2008-08-099 LIGHT STRIPE PROJECTION-BASED PEDESTRIAN DETECTION DURING AUTOMATIC PARKING OPERATION 1 Jung, Ho Gi*, 1 Kim, Dong Suk, 1 Kang, Hyoung Jin, 2 Kim, Jaihie 1 MANDO Corporation, Republic of Korea,
More informationMobile Robotics. Mathematics, Models, and Methods. HI Cambridge. Alonzo Kelly. Carnegie Mellon University UNIVERSITY PRESS
Mobile Robotics Mathematics, Models, and Methods Alonzo Kelly Carnegie Mellon University HI Cambridge UNIVERSITY PRESS Contents Preface page xiii 1 Introduction 1 1.1 Applications of Mobile Robots 2 1.2
More informationResearch of Traffic Flow Based on SVM Method. Deng-hong YIN, Jian WANG and Bo LI *
2017 2nd International onference on Artificial Intelligence: Techniques and Applications (AITA 2017) ISBN: 978-1-60595-491-2 Research of Traffic Flow Based on SVM Method Deng-hong YIN, Jian WANG and Bo
More informationPattern Recognition for Autonomous. Pattern Recognition for Autonomous. Driving. Freie Universität t Berlin. Raul Rojas
Pattern Recognition for Autonomous Pattern Recognition for Autonomous Driving Raul Rojas Freie Universität t Berlin FU Berlin Berlin 3d model from Berlin Partner Freie Universitaet Berlin Outline of the
More informationCan We Detect Pedestrians using Low-resolution LIDAR? Integration of Multi-frame Point-clouds
Can We Detect Pedestrians using Low-resolution LIDAR? Integration of Multi-frame Point-clouds Yoshiki Tatebe, Daisuke Deguchi 2, Yasutomo Kawanishi,IchiroIde, Hiroshi Murase and Utsushi Sakai 3 Graduate
More informationVehicle Localization. Hannah Rae Kerner 21 April 2015
Vehicle Localization Hannah Rae Kerner 21 April 2015 Spotted in Mtn View: Google Car Why precision localization? in order for a robot to follow a road, it needs to know where the road is to stay in a particular
More informationRadar Detection Improvement by Integration of Multi- Object Tracking
Radar Detection Improvement by Integration of Multi- Object Tracing Lingmin Meng Research and Technology Center Robert Bosch Corp. Pittsburgh, PA, U.S.A. lingmin.meng@rtc.bosch.com Wolfgang Grimm Research
More informationCSc Topics in Computer Graphics 3D Photography
CSc 83010 Topics in Computer Graphics 3D Photography Tuesdays 11:45-1:45 1:45 Room 3305 Ioannis Stamos istamos@hunter.cuny.edu Office: 1090F, Hunter North (Entrance at 69 th bw/ / Park and Lexington Avenues)
More informationHuman Motion Detection and Tracking for Video Surveillance
Human Motion Detection and Tracking for Video Surveillance Prithviraj Banerjee and Somnath Sengupta Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur,
More informationRobot Localization based on Geo-referenced Images and G raphic Methods
Robot Localization based on Geo-referenced Images and G raphic Methods Sid Ahmed Berrabah Mechanical Department, Royal Military School, Belgium, sidahmed.berrabah@rma.ac.be Janusz Bedkowski, Łukasz Lubasiński,
More informationOn Road Vehicle Detection using Shadows
On Road Vehicle Detection using Shadows Gilad Buchman Grasp Lab, Department of Computer and Information Science School of Engineering University of Pennsylvania, Philadelphia, PA buchmag@seas.upenn.edu
More informationA Robust Two Feature Points Based Depth Estimation Method 1)
Vol.31, No.5 ACTA AUTOMATICA SINICA September, 2005 A Robust Two Feature Points Based Depth Estimation Method 1) ZHONG Zhi-Guang YI Jian-Qiang ZHAO Dong-Bin (Laboratory of Complex Systems and Intelligence
More informationSpatial Outlier Detection
Spatial Outlier Detection Chang-Tien Lu Department of Computer Science Northern Virginia Center Virginia Tech Joint work with Dechang Chen, Yufeng Kou, Jiang Zhao 1 Spatial Outlier A spatial data point
More informationPerception. Autonomous Mobile Robots. Sensors Vision Uncertainties, Line extraction from laser scans. Autonomous Systems Lab. Zürich.
Autonomous Mobile Robots Localization "Position" Global Map Cognition Environment Model Local Map Path Perception Real World Environment Motion Control Perception Sensors Vision Uncertainties, Line extraction
More informationAlgorithm research of 3D point cloud registration based on iterative closest point 1
Acta Technica 62, No. 3B/2017, 189 196 c 2017 Institute of Thermomechanics CAS, v.v.i. Algorithm research of 3D point cloud registration based on iterative closest point 1 Qian Gao 2, Yujian Wang 2,3,
More informationLarge-Scale Traffic Sign Recognition based on Local Features and Color Segmentation
Large-Scale Traffic Sign Recognition based on Local Features and Color Segmentation M. Blauth, E. Kraft, F. Hirschenberger, M. Böhm Fraunhofer Institute for Industrial Mathematics, Fraunhofer-Platz 1,
More informationFunctional Discretization of Space Using Gaussian Processes for Road Intersection Crossing
Functional Discretization of Space Using Gaussian Processes for Road Intersection Crossing M A T H I E U B A R B I E R 1,2, C H R I S T I A N L A U G I E R 1, O L I V I E R S I M O N I N 1, J A V I E R
More informationEvaluation of a laser-based reference system for ADAS
23 rd ITS World Congress, Melbourne, Australia, 10 14 October 2016 Paper number ITS- EU-TP0045 Evaluation of a laser-based reference system for ADAS N. Steinhardt 1*, S. Kaufmann 2, S. Rebhan 1, U. Lages
More informationAccelerometer Gesture Recognition
Accelerometer Gesture Recognition Michael Xie xie@cs.stanford.edu David Pan napdivad@stanford.edu December 12, 2014 Abstract Our goal is to make gesture-based input for smartphones and smartwatches accurate
More informationSpatio-Temporal Stereo Disparity Integration
Spatio-Temporal Stereo Disparity Integration Sandino Morales and Reinhard Klette The.enpeda.. Project, The University of Auckland Tamaki Innovation Campus, Auckland, New Zealand pmor085@aucklanduni.ac.nz
More informationEfficient Techniques for Dynamic Vehicle Detection
Efficient Techniques for Dynamic Vehicle Detection Anna Petrovskaya and Sebastian Thrun Computer Science Department Stanford University Stanford, California 94305, USA { anya, thrun }@cs.stanford.edu Summary.
More informationRECOGNIZING humanoid shape is very easy for humans,
380 IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, VOL. 10, NO. 3, SEPTEMBER 2009 Stereo-Based Pedestrian Detection for Collision-Avoidance Applications Sergiu Nedevschi, Member, IEEE, Silviu
More informationProbabilistic Robotics
Probabilistic Robotics Probabilistic Motion and Sensor Models Some slides adopted from: Wolfram Burgard, Cyrill Stachniss, Maren Bennewitz, Kai Arras and Probabilistic Robotics Book SA-1 Sensors for Mobile
More informationFingertips Tracking based on Gradient Vector
Int. J. Advance Soft Compu. Appl, Vol. 7, No. 3, November 2015 ISSN 2074-8523 Fingertips Tracking based on Gradient Vector Ahmad Yahya Dawod 1, Md Jan Nordin 1, and Junaidi Abdullah 2 1 Pattern Recognition
More information