Vehicle Tracking using Optical Features Songlin Piao Robotics Research Lab University of Kaiserslautern, Germany
Outline Motivation State-of-Art Proposed System Experiments Conclusion
Motivation Autonomous Universal Autonomous Car will benefit from this algorithm. The algorithm can be adapted to other types of rigid object tracking easily. (e.g. Face Tracking)
State-of-Art I Long-term Tracking Methods TLD (Tracking-Learning-Detection ) Drawbacks: 1. Not able to estimate the rotation of object. 2. Inaccurate scaling estimation. 3. Unable to locate the object when the object out of the image partially CMT (Consensus-based Matching and Tracking of Keypoints for Object Tracking ) Drawbacks: 1. The original object model will not be updated. 2. Inaccurate matching with BRISK descriptor when new appearance of object appears.
Vehicle Tracking System Structure Detector Tracker Dynamic Update Module Tracking Rotation, Scaling Estimation Detection Model Update
Contribution C-BRISK descriptor C-BRISK is based on BRISK keypoints detection method. C-BRISK adds color information in binary BRISK descriptor to improve the performance of BRISK. Dynamic update module for object Dynamically updates object model to instead of the static object model. Comparison between various kinds of descriptors SIFT, SURF, ORB, BRISK, C-BRISK Applying various detection methods and corresponding descriptors in this tracking system and comparing the performance of detector, tracker and updating module with these descriptors.
Matching Based Detection I Detector
Matching Based Detection II Detector flow chart Keypoints Detection
BRISK Keypoints Detection FAST keypoints detection BRISK keypoints detection -BRIEF,ORB -Threshold are needed to control the number of keypoints produced. -Combined the advantages of SIFT,SURF and ORB detection methods.
Matching Based Detection Detector flow chart Generating descriptors
BRISK Descriptor The local gradient of keypoint pair (Pi, Pj ) can be represented as g : Each bit of the binary BRISK descriptor can be determined as following:
C-BRISK Descriptor For color image: 3 by 3 pattern m(r,g,b): Median value of R,G,B value For gray image: C-BRISK change the m(r,g,b) to the median value of gray values of the 3 by 3 pattern and keep the length of C-BRISK at 536 bits.
BRISK VS C-BRISK BRISK C-BRISK
Matching Based Detection Detector flow chart Object model initialization 1 2 3 n-1 n 0
Tracking Module Tracker
Tracking Module L-K Tracking Method & Forward-Backward Error Method - d is the image velocity of point x - u is the previous position of x - v is the current position of x Forward-Backward Error Method
Dynamic Updating Module I Dynamic Updating Module
Dynamic Updating Module II Dynamic Updating Module VS Learning Module in TLD Similarity: Updating of both methods are based on the tracking result. Dynamic updating module structure Difference: TLD updates the the training data (patchs) for cascade classifiers while DUM updates the descriptors of keypoints in the object model for better matching of keypoints belongs to object.
Dynamic Updating Module III Object Model Update Model
Experiments I Keypoints detection test SIFT SURF BRISK ORB
Experiments I Number of Keypoint and time
Experiments II Recall Precision C-BRISK C-BRISK BRISK BRISK ORB ORB SURF SURF SIFT SIFT 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
Experiments III Update Update
Experiments III
Experiments IV C-BRISK method with rotation
Conclusion and Outlook -C-BRISK is more accurate to describe the keypoints than BRISK. -Tracker improves the performance of system for most descriptors. -Comparing with the other descriptors in the experiments proves that C-BRISK and dynamic updating module improve performance of this system. -C-BRISK also can be improved by optimizing weightings of color information in this descriptor. -The timing of updating the descriptor could be a dynamic processing according to different situations. -The dynamic updating module used in this thesis could be improved by updating the background model.
Thank you! Questions?