Low Cost Motion Capture
|
|
- Beatrix Murphy
- 6 years ago
- Views:
Transcription
1 Low Cost Motion Capture R. Budiman M. Bennamoun D.Q. Huynh School of Computer Science and Software Engineering The University of Western Australia Crawley WA 6009 AUSTRALIA Abstract Traditionally, computer animation techniques were used to create movements of an object. Unfortunately, these techniques require much human intervention to work out the different joint angles for each movement. Not only is the task a very time-consuming one, the movements created are often not realistic either. Modern motion capture techniques overcome those problems by capturing the actual movements of a performer (e.g. human being) from the detected positions or angles of the sensors or optical markers on the subject. Despite their advantages, motion capture has always been considered to be an expensive technology. In this paper, we describe a low cost motion capture system that uses two low cost webcams. We also demonstrate our experimental results of 3D reconstruction of the lower body part of a human subject. Keywords: Motion capture, Mean-shift algorithm, Camera calibration, 3D reconstruction 1 Introduction Motion capture, or mocap, is a technique of digitally recording the movements of real beings, usually humans or animals. Traditionally, computer animation techniques are used to create movements of a being. However, this technique is proven to be time consuming and difficult. Motion capture is considered to be a better technique for accurately generating movements for computer animation. There are three types of motion capture techniques [1]. The first technique is called the optical motion capture in which photogrammetry is used to establish the position of an object in 3D space based on its observed location within the 2D fields of a number of cameras. The second technique is called the Magnetic motion capture, where the position and orientation of magnetic sensors are calculated with respect to a transmitter. The last technique is called electro-mechanical motion capture and it involves modelling movements using body suit with sensors attached. The need for optical motion capture can be justified by the fact that this technique is able to cover a large active area and, due to the lightness in weight of the markers, provides more freedom of movement for the subject. Despite these advantages, optical motion capture technologies have been known to be expensive. The high cost is mainly contributed by the cost of hardware components (i.e. high speed cameras). In this paper, we describe the design and implementation of a low cost optical motion capture system that requires two low cost calibrated webcams. This low cost system falls under the optical motion capture category as advanced computer vision techniques are employed to establish the joint positions of a subject. As all motion capture systems involve a tracking phase, we adopt the Mean-shift algorithm as the basis of object tracking. While our current system is constrained by several limitations such as the inability to handle occlusion, it is still able to demonstrate the fundamental idea of motion capture and provides input to animation applications, such as Poser [2]. The outline of this paper is as follows. In Section 2, a brief overview of the Mean-shift algorithm will be explained. In Section 3, the hardware components and the setup of our system will be described. Experiments and results are reported in Section 4. Finally, conclusion and future work are given in Section 5. 2 Mean-shift: An overview The mean-shift algorithm [3, 4, 5] is one of the tracking techniques commonly used in computer vision research when the motion of the object to be tracked cannot be described by a motion model, such as one required by the Kalman filter [6]. The colour and texture information that characterizes the object can be grouped together to form the feature vector in the tracking process. The algo-
2 rithm requires only a small number of iterations to converge and can easily adapt to the change of scale of the tracked object. The key notion in the mean-shift algorithm is the definition of a multivariate density function with a kernel function K(x) over a region in the image: n x xi 1 X K, f (x) = nhd i=1 h where {xi i = 1,, n} is a set of points falling inside a window of radius h centred at x. There are a number of kernel functions that one can choose from. The commonly used ones are the Normal, Uniform, and Epanechnikov kernel functions. At each iteration the algorithm produces the meanshift vector that describes the movement of the region that encloses the tracked target. As the mean-shift vector is defined in terms of the negative gradient of the kernel profile, a kernel function that has the simplest profile gradient is preferred. Amongst the commonly used kernel function above, the Epanechnikov kernel, which has its kernel profile as a uniform distribution, is preferrable than the other two. Comaniciu et al. [3, 4] formulate the target estimation problem as the derivation of the estimate that maximizes the Bayes error associated with the target model and target candidate distributions. This approach suggest that the larger is the probability of error, the more similar are the distributions. Based on this assumption, the Bhattacharyya coefficient [7] is used to calculate the similarity measure between the two distributions. 3 System description The setup of our motion capture system is intended to be low-cost. The necessary pieces of equipment required are two low-cost webcams, two tripods, and a calibration frame. The block diagram in Fig. 1 shows all the components of the system. Each of these components will be described in detail later. The system uses two low cost webcams for motion capture. Each webcam mounted on a tripod must be calibrated prior to any experiments. The current version of our system focuses on the capture of movements on the lower part of the body only. This requires a total of 9 white circular markers to be put on the following joints (see Fig. 2): the hip (1), two upper legs (2), knees (2), ankles (2), and feet (2). To simplify the tracking process, we darken the background by putting in a black curtain and instruct the subject to wear a dark non-glossy tight Figure 1: System block diagram. (a) (b) Figure 2: (a) Setup of the system. (b) A subject with white circular markers on the lower part of his body. suit so that the white circular markers can be easily detected. This requirement is not considered to be a limitation of the system as most movie editing systems would require the background to be of a certain colour (often in blue) for easy segmentation. The two webcams are directly connected to a PC via two USB ports. This allows video images captured by the webcams to be immediately transferred to a PC for processing. We currently use functions under the Matlab Image Acquisition Toolbox for image acquisition; however, any other equivalent functions from other application software can be used also. 3.1 Camera calibration Camera calibration is a step for determining the 3 4 matrix that maps coordinates in the 3D world into the 2D image. The matrix can be recovered linearly via a method commonly referred to as DLT (Direct Linear Transform) [8, 9] using at least 6 known non-coplanar reference scene points and their corresponding image points. In our system, we use a calibration target with two orthogonal faces, each of which has 6 reference points. The calibration target also implicitly defines in the scene a global coordinate system that can be referenced to in some other applications, such as Poser [2], for graphics rendering.
3 Without moving the calibration target, each webcam was calibrated in turn. The calibration process produces two 3 4 matrices, one for each webcam. 3.2 Detection of markers The nine markers were detected via a thresholding process. This thresholding process involves choosing a threshold value t from the pixel intensity range of 0 to 255. Using a specific threshold value t, the system converts all intensity values within a gray scale image that are greater than t into 1 and all intensity values less than t into 0, and hence produces a binary image. Since we have a much simplified scene for marker detection, we can inspect the intensity histogram to automatically compute the threshold value. As expected, our intensity histogram is bi-modal. Consecutive frequency values in the intensity histogram can be examined to determine the flat region that separates the two modes. The threshold value can then be estimated from the flat region in the intensity value histogram. 3.3 Automatic labellings of markers The 9 markers are automatically labelled using a heuristic method. At the start of each experiment, the subject must adopt the standing pose position as show in Fig. 3. After all nine markers have been detected, the system labels the top middle marker as marker #1. The initial standing pose shows that there are four markers on each leg. Hence, the four markers that are positioned to the left of marker #1 are labelled as marker #2 to #5 and the four markers to the right of marker #1 are labelled as marker #6 to #9. The assignment of marker number depends on the y component of the marker coordinates. So, for the four markers on the left side, marker #2 is given to the marker which has the smallest y value compared to those of the other three markers. The same labelling algorithm is applied to the four markers to the right side of marker # Mean-shift tracking and 3D reconstruction of markers The mean-shift algorithm is employed to track the nine white markers independently. The system setup described above allows the tracking to be done on grey level images rather than colour. The feature that we used for tracking is therefore simply the pixels intensity values and the density function is the intensity histogram inside the kernel window. Note that, as defined by the Epanechnikov kernel function, the weighting factors for points near the centre of the kernel are higher, the intensity histogram is computed with these different weighting factors incorporated. There are 3 free parameters that can be set to finetune the performance of the mean-shift algorithm: 1. The radius, h, of the kernel window. 2. The threshold value, ɛ, which is used for terminating the tracking iteration between consecutive images. 3. The number of histogram bins, 1 < m < 255, for storing the frequencies of pixels intensity values inside the kernel window. We will describe in the following section what values these parameters were set to in our experiments. For the computation of the 3D coordinates of each marker, the two 3 4 matrices obtained above are combined to give 4 linear equations for the detected image coordinates of the marker in the two images. The 3D coordinates of each marker, relative to the implicit global coordinate system defined by the calibration frame, can be estimated using leastsquares. 4 Results Many experiments have been conducted to test the tracking algorithm and the 3D reconstruction of markers. We also evaluated the performance of the mean-shift algorithm using different values of the free parameters discussed in Section 3.4 above. In most of our experiments, we found that h = 6 ± 1 pixels, ɛ = 10 4, and m = 128 gave the best performance. The result of tracking and 3D reconstruction using these parameters in one of our experiments is presented in Fig. 3. In every experiment, we tested our system to track the movement of markers over 200 frames. Each webcam took an image in sequence and performed mean-shift tracking of the markers. It is not possible to use software to synchronize the two webcams on-line. This is due to the fact that we are only using a single processor computer and therefore the execution of instructions has to be interleaved. Hence, the system instructions for acquiring two images from the two webcams cannot be executed simultaneously. We found that there is a seconds delay between the acquisition of an image by the first webcam and the second webcam. The human subject can perform small movements from the initial standing position while the system attempts to track the markers movements.
4 (a) seq. 1 (b) seq. 2 From our experiments, we found that the radius of the kernel windows is a crucial parameter to the performance of the mean-shift algorithm. Indeed, this issue has also been reported in [5] that a window size that is too large can cause the tracker to become more easily distracted by background clutter and a window size that is too small can cause the kernel to roam around on a likelihood plateau around the mode, leading to poor object localization. In Fig. 4, we show the result of tracking using a h value of 10 pixels in another experiment. We found that this h value is too large to be used as a radius value as it is able to sometimes encapsulate two markers within a kernel window. As shown in Fig. 4(a) and 4(b), a kernel window that is too large allows the white markers to drift slightly away from the centre of, yet still being enclosed within, the kernel window. (c) front view (d) side view 5 Conclusion and future Work Figure 3: (a) and (b) show the tracking results of the mean-shift algorithm on the 9 white markers using a h value of 6 pixels; (c) and (d) the result of reconstruction. (a) seq. 1 (b) seq. 2 We have presented a low cost motion capture system using two webcams. While the current version of our system only captures movement of the lower part of the subject s body, it can be further extended to include the upper part, and hence allows full body movements to be animated. The current labelling algorithm can also be modified in order to cater for the other initial poses other than the standing one. Furthermore, since the h value is an important parameter to the meanshift algorithm and it affects the overall performance of our motion capture system, instead of relying on human intervention to provide an initial h value, the system can be further improved by automatically determining this value and adapting to scale changes during tracking. The notion of low cost motion capture is important for demonstrating the fundamental idea of motion capture and for providing inputs for various advanced animation applications. References [1] Meta Motion, /motion-capture/motion-capture.htm, Motion Capture - What is it?, (c) front view (d) side view Figure 4: (a) and (b) show the tracking results of the mean-shift algorithm on the 9 white markers using a h value of 10 pixels. (c) and (d) the result of 3D reconstruction. [2] e-frontier America, Inc, hpl, Poser 6, [3] D. Comaniciu, V. Ramesh, and P. Meer, Real- Time Tracking of Non-Rigid Objects using Mean Shift, in Computer Vision and Pattern Recognition, Proceedings. IEEE Conference on, vol. 2, pp. pp , 2000.
5 [4] D. Comaniciu and P. Meer, Mean Shft Analysis and Applications, in Computer Vision, The Proceedings of the Seventh IEEE International Conference on, vol. 2, pp. pp , [5] R. T. Collins, Mean-Shift Blob Tracking through Scale Space, in Computer Vision and Pattern Recognition, Proceedings IEEE Computer Society Conference on, vol. 2, pp. pp 18 20, [6] G. Welch and G. Bishop, An Introduction to the Kalman Filter, Tech. Rep , Department of Computer Science, University of North Carolina, Chapel Hill, [7] T. Kailath, The Divergence and Bhattacharyya Distance Measures in Signal Selection, IEEE Trans. on Communications, vol. 15, pp , Feb [8] Y. I. Abdel-Aziz and H. M. Karara, Direct Linear Transformation from Comparator to Object Space Coordinates in Close-Range Photogrammetry, in ASP Symposium on Close- Range Photogrammetry (H. Karara, ed.), (Urbana, Illinois), pp. 1 18, [9] C. C. Slama, C. Theurer, and S. W. Henriksen, eds., Manual of Photogrammetry. Falls Church, Virginia, USA: American Society of Photogrammetry and Remote Sensing, 1980.
Target Tracking Using Mean-Shift And Affine Structure
Target Tracking Using Mean-Shift And Affine Structure Chuan Zhao, Andrew Knight and Ian Reid Department of Engineering Science, University of Oxford, Oxford, UK {zhao, ian}@robots.ox.ac.uk Abstract Inthispaper,wepresentanewapproachfortracking
More informationTarget Tracking Based on Mean Shift and KALMAN Filter with Kernel Histogram Filtering
Target Tracking Based on Mean Shift and KALMAN Filter with Kernel Histogram Filtering Sara Qazvini Abhari (Corresponding author) Faculty of Electrical, Computer and IT Engineering Islamic Azad University
More informationVisual Tracking. Image Processing Laboratory Dipartimento di Matematica e Informatica Università degli studi di Catania.
Image Processing Laboratory Dipartimento di Matematica e Informatica Università degli studi di Catania 1 What is visual tracking? estimation of the target location over time 2 applications Six main areas:
More informationAn Adaptive Background Model for Camshift Tracking with a Moving Camera. convergence.
261 An Adaptive Background Model for Camshift Tracking with a Moving Camera R. Stolkin,I.Florescu,G.Kamberov Center for Maritime Systems, Dept. of Mathematical Sciences, Dept. of Computer Science Stevens
More informationReal Time Motion Detection Using Background Subtraction Method and Frame Difference
Real Time Motion Detection Using Background Subtraction Method and Frame Difference Lavanya M P PG Scholar, Department of ECE, Channabasaveshwara Institute of Technology, Gubbi, Tumkur Abstract: In today
More informationVisual Tracking. Antonino Furnari. Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania
Visual Tracking Antonino Furnari Image Processing Lab Dipartimento di Matematica e Informatica Università degli Studi di Catania furnari@dmi.unict.it 11 giugno 2015 What is visual tracking? estimation
More informationMean shift based object tracking with accurate centroid estimation and adaptive Kernel bandwidth
Mean shift based object tracking with accurate centroid estimation and adaptive Kernel bandwidth ShilpaWakode 1, Dr. Krishna Warhade 2, Dr. Vijay Wadhai 3, Dr. Nitin Choudhari 4 1234 Electronics department
More informationComputer Vision II Lecture 4
Computer Vision II Lecture 4 Color based Tracking 29.04.2014 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Course Outline Single-Object Tracking Background modeling
More informationA COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION
XIX IMEKO World Congress Fundamental and Applied Metrology September 6 11, 2009, Lisbon, Portugal A COMPREHENSIVE SIMULATION SOFTWARE FOR TEACHING CAMERA CALIBRATION David Samper 1, Jorge Santolaria 1,
More informationCHAPTER 5 MOTION DETECTION AND ANALYSIS
CHAPTER 5 MOTION DETECTION AND ANALYSIS 5.1. Introduction: Motion processing is gaining an intense attention from the researchers with the progress in motion studies and processing competence. A series
More informationSegmentation and Tracking of Partial Planar Templates
Segmentation and Tracking of Partial Planar Templates Abdelsalam Masoud William Hoff Colorado School of Mines Colorado School of Mines Golden, CO 800 Golden, CO 800 amasoud@mines.edu whoff@mines.edu Abstract
More informationECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall Midterm Examination
ECE 172A: Introduction to Intelligent Systems: Machine Vision, Fall 2008 October 29, 2008 Notes: Midterm Examination This is a closed book and closed notes examination. Please be precise and to the point.
More informationHand-Eye Calibration from Image Derivatives
Hand-Eye Calibration from Image Derivatives Abstract In this paper it is shown how to perform hand-eye calibration using only the normal flow field and knowledge about the motion of the hand. The proposed
More informationTracking of Human Body using Multiple Predictors
Tracking of Human Body using Multiple Predictors Rui M Jesus 1, Arnaldo J Abrantes 1, and Jorge S Marques 2 1 Instituto Superior de Engenharia de Lisboa, Postfach 351-218317001, Rua Conselheiro Emído Navarro,
More informationThree-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner
Three-dimensional nondestructive evaluation of cylindrical objects (pipe) using an infrared camera coupled to a 3D scanner F. B. Djupkep Dizeu, S. Hesabi, D. Laurendeau, A. Bendada Computer Vision and
More informationPattern Feature Detection for Camera Calibration Using Circular Sample
Pattern Feature Detection for Camera Calibration Using Circular Sample Dong-Won Shin and Yo-Sung Ho (&) Gwangju Institute of Science and Technology (GIST), 13 Cheomdan-gwagiro, Buk-gu, Gwangju 500-71,
More informationMobile Human Detection Systems based on Sliding Windows Approach-A Review
Mobile Human Detection Systems based on Sliding Windows Approach-A Review Seminar: Mobile Human detection systems Njieutcheu Tassi cedrique Rovile Department of Computer Engineering University of Heidelberg
More informationMean Shift Tracking. CS4243 Computer Vision and Pattern Recognition. Leow Wee Kheng
CS4243 Computer Vision and Pattern Recognition Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS4243) Mean Shift Tracking 1 / 28 Mean Shift Mean Shift
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationRobert Collins CSE598G. Robert Collins CSE598G
Recall: Kernel Density Estimation Given a set of data samples x i ; i=1...n Convolve with a kernel function H to generate a smooth function f(x) Equivalent to superposition of multiple kernels centered
More informationObject Detection in Video Using Sequence Alignment and Joint Color & Texture Histogram
Object Detection in Video Using Sequence Alignment and Joint Color & Texture Histogram Ms. Pallavi M. Sune 1 Prof. A. P. Thakare2 Abstract an object tracking algorithm is presented in this paper by using
More informationObject tracking in a video sequence using Mean-Shift Based Approach: An Implementation using MATLAB7
International Journal of Computational Engineering & Management, Vol. 11, January 2011 www..org 45 Object tracking in a video sequence using Mean-Shift Based Approach: An Implementation using MATLAB7 Madhurima
More informationParticle Filtering. CS6240 Multimedia Analysis. Leow Wee Kheng. Department of Computer Science School of Computing National University of Singapore
Particle Filtering CS6240 Multimedia Analysis Leow Wee Kheng Department of Computer Science School of Computing National University of Singapore (CS6240) Particle Filtering 1 / 28 Introduction Introduction
More informationObject detection using non-redundant local Binary Patterns
University of Wollongong Research Online Faculty of Informatics - Papers (Archive) Faculty of Engineering and Information Sciences 2010 Object detection using non-redundant local Binary Patterns Duc Thanh
More informationDESIGN AND IMPLEMENTATION OF VISUAL FEEDBACK FOR AN ACTIVE TRACKING
DESIGN AND IMPLEMENTATION OF VISUAL FEEDBACK FOR AN ACTIVE TRACKING Tomasz Żabiński, Tomasz Grygiel, Bogdan Kwolek Rzeszów University of Technology, W. Pola 2, 35-959 Rzeszów, Poland tomz, bkwolek@prz-rzeszow.pl
More informationReal-Time Human Detection using Relational Depth Similarity Features
Real-Time Human Detection using Relational Depth Similarity Features Sho Ikemura, Hironobu Fujiyoshi Dept. of Computer Science, Chubu University. Matsumoto 1200, Kasugai, Aichi, 487-8501 Japan. si@vision.cs.chubu.ac.jp,
More informationHOG-Based Person Following and Autonomous Returning Using Generated Map by Mobile Robot Equipped with Camera and Laser Range Finder
HOG-Based Person Following and Autonomous Returning Using Generated Map by Mobile Robot Equipped with Camera and Laser Range Finder Masashi Awai, Takahito Shimizu and Toru Kaneko Department of Mechanical
More informationTowards the completion of assignment 1
Towards the completion of assignment 1 What to do for calibration What to do for point matching What to do for tracking What to do for GUI COMPSCI 773 Feature Point Detection Why study feature point detection?
More informationReal Time Unattended Object Detection and Tracking Using MATLAB
Real Time Unattended Object Detection and Tracking Using MATLAB Sagar Sangale 1, Sandip Rahane 2 P.G. Student, Department of Electronics Engineering, Amrutvahini College of Engineering, Sangamner, Maharashtra,
More informationReduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems
Reduced Image Noise on Shape Recognition Using Singular Value Decomposition for Pick and Place Robotic Systems Angelo A. Beltran Jr. 1, Christian Deus T. Cayao 2, Jay-K V. Delicana 3, Benjamin B. Agraan
More informationA New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction
A New Image Based Ligthing Method: Practical Shadow-Based Light Reconstruction Jaemin Lee and Ergun Akleman Visualization Sciences Program Texas A&M University Abstract In this paper we present a practical
More informationA Vision System for Automatic State Determination of Grid Based Board Games
A Vision System for Automatic State Determination of Grid Based Board Games Michael Bryson Computer Science and Engineering, University of South Carolina, 29208 Abstract. Numerous programs have been written
More informationNonparametric Clustering of High Dimensional Data
Nonparametric Clustering of High Dimensional Data Peter Meer Electrical and Computer Engineering Department Rutgers University Joint work with Bogdan Georgescu and Ilan Shimshoni Robust Parameter Estimation:
More informationUsing Optical Flow for Stabilizing Image Sequences. Peter O Donovan
Using Optical Flow for Stabilizing Image Sequences Peter O Donovan 502425 Cmpt 400 Supervisor: Dr. Mark Eramian April 6,2005 1 Introduction In the summer of 1999, the small independent film The Blair Witch
More informationFingertips Tracking based on Gradient Vector
Int. J. Advance Soft Compu. Appl, Vol. 7, No. 3, November 2015 ISSN 2074-8523 Fingertips Tracking based on Gradient Vector Ahmad Yahya Dawod 1, Md Jan Nordin 1, and Junaidi Abdullah 2 1 Pattern Recognition
More informationEECS150 - Digital Design Lecture 14 FIFO 2 and SIFT. Recap and Outline
EECS150 - Digital Design Lecture 14 FIFO 2 and SIFT Oct. 15, 2013 Prof. Ronald Fearing Electrical Engineering and Computer Sciences University of California, Berkeley (slides courtesy of Prof. John Wawrzynek)
More informationUsing temporal seeding to constrain the disparity search range in stereo matching
Using temporal seeding to constrain the disparity search range in stereo matching Thulani Ndhlovu Mobile Intelligent Autonomous Systems CSIR South Africa Email: tndhlovu@csir.co.za Fred Nicolls Department
More informationA Simple Automated Void Defect Detection for Poor Contrast X-ray Images of BGA
Proceedings of the 3rd International Conference on Industrial Application Engineering 2015 A Simple Automated Void Defect Detection for Poor Contrast X-ray Images of BGA Somchai Nuanprasert a,*, Sueki
More informationDetection of a Single Hand Shape in the Foreground of Still Images
CS229 Project Final Report Detection of a Single Hand Shape in the Foreground of Still Images Toan Tran (dtoan@stanford.edu) 1. Introduction This paper is about an image detection system that can detect
More informationEfficient Acquisition of Human Existence Priors from Motion Trajectories
Efficient Acquisition of Human Existence Priors from Motion Trajectories Hitoshi Habe Hidehito Nakagawa Masatsugu Kidode Graduate School of Information Science, Nara Institute of Science and Technology
More informationComputer Vision 2. SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung. Computer Vision 2 Dr. Benjamin Guthier
Computer Vision 2 SS 18 Dr. Benjamin Guthier Professur für Bildverarbeitung Computer Vision 2 Dr. Benjamin Guthier 3. HIGH DYNAMIC RANGE Computer Vision 2 Dr. Benjamin Guthier Pixel Value Content of this
More informationComputer Vision II Lecture 4
Course Outline Computer Vision II Lecture 4 Single-Object Tracking Background modeling Template based tracking Color based Tracking Color based tracking Contour based tracking Tracking by online classification
More informationCOMPUTER AND ROBOT VISION
VOLUME COMPUTER AND ROBOT VISION Robert M. Haralick University of Washington Linda G. Shapiro University of Washington T V ADDISON-WESLEY PUBLISHING COMPANY Reading, Massachusetts Menlo Park, California
More informationA Modified Mean Shift Algorithm for Visual Object Tracking
A Modified Mean Shift Algorithm for Visual Object Tracking Shu-Wei Chou 1, Chaur-Heh Hsieh 2, Bor-Jiunn Hwang 3, Hown-Wen Chen 4 Department of Computer and Communication Engineering, Ming-Chuan University,
More informationA 3-D Scanner Capturing Range and Color for the Robotics Applications
J.Haverinen & J.Röning, A 3-D Scanner Capturing Range and Color for the Robotics Applications, 24th Workshop of the AAPR - Applications of 3D-Imaging and Graph-based Modeling, May 25-26, Villach, Carinthia,
More informationImage Segmentation. Shengnan Wang
Image Segmentation Shengnan Wang shengnan@cs.wisc.edu Contents I. Introduction to Segmentation II. Mean Shift Theory 1. What is Mean Shift? 2. Density Estimation Methods 3. Deriving the Mean Shift 4. Mean
More informationBSB663 Image Processing Pinar Duygulu. Slides are adapted from Selim Aksoy
BSB663 Image Processing Pinar Duygulu Slides are adapted from Selim Aksoy Image matching Image matching is a fundamental aspect of many problems in computer vision. Object or scene recognition Solving
More informationFundamental Matrices from Moving Objects Using Line Motion Barcodes
Fundamental Matrices from Moving Objects Using Line Motion Barcodes Yoni Kasten (B), Gil Ben-Artzi, Shmuel Peleg, and Michael Werman School of Computer Science and Engineering, The Hebrew University of
More informationCS 223B Computer Vision Problem Set 3
CS 223B Computer Vision Problem Set 3 Due: Feb. 22 nd, 2011 1 Probabilistic Recursion for Tracking In this problem you will derive a method for tracking a point of interest through a sequence of images.
More informationAuto-focusing Technique in a Projector-Camera System
2008 10th Intl. Conf. on Control, Automation, Robotics and Vision Hanoi, Vietnam, 17 20 December 2008 Auto-focusing Technique in a Projector-Camera System Lam Bui Quang, Daesik Kim and Sukhan Lee School
More informationCamera Calibration with a Simulated Three Dimensional Calibration Object
Czech Pattern Recognition Workshop, Tomáš Svoboda (Ed.) Peršlák, Czech Republic, February 4, Czech Pattern Recognition Society Camera Calibration with a Simulated Three Dimensional Calibration Object Hynek
More informationAn Introduction to PDF Estimation and Clustering
Sigmedia, Electronic Engineering Dept., Trinity College, Dublin. 1 An Introduction to PDF Estimation and Clustering David Corrigan corrigad@tcd.ie Electrical and Electronic Engineering Dept., University
More informationCentre for Digital Image Measurement and Analysis, School of Engineering, City University, Northampton Square, London, ECIV OHB
HIGH ACCURACY 3-D MEASUREMENT USING MULTIPLE CAMERA VIEWS T.A. Clarke, T.J. Ellis, & S. Robson. High accuracy measurement of industrially produced objects is becoming increasingly important. The techniques
More informationRemoving Shadows from Images
Removing Shadows from Images Zeinab Sadeghipour Kermani School of Computing Science Simon Fraser University Burnaby, BC, V5A 1S6 Mark S. Drew School of Computing Science Simon Fraser University Burnaby,
More information3D Reconstruction of a Hopkins Landmark
3D Reconstruction of a Hopkins Landmark Ayushi Sinha (461), Hau Sze (461), Diane Duros (361) Abstract - This paper outlines a method for 3D reconstruction from two images. Our procedure is based on known
More informationCosine Transform Priors for Enhanced Decoding of Compressed Images.
Cosine Transform Priors for Enhanced Decoding of Compressed Images. Amos Storkey and Michael Allan School of Informatics University of Edinburgh Forrest Hill, Edinburgh, EH QL Abstract. Image compression
More informationElliptical Head Tracker using Intensity Gradients and Texture Histograms
Elliptical Head Tracker using Intensity Gradients and Texture Histograms Sriram Rangarajan, Dept. of Electrical and Computer Engineering, Clemson University, Clemson, SC 29634 srangar@clemson.edu December
More informationAn Approach for Real Time Moving Object Extraction based on Edge Region Determination
An Approach for Real Time Moving Object Extraction based on Edge Region Determination Sabrina Hoque Tuli Department of Computer Science and Engineering, Chittagong University of Engineering and Technology,
More informationIterative Estimation of 3D Transformations for Object Alignment
Iterative Estimation of 3D Transformations for Object Alignment Tao Wang and Anup Basu Department of Computing Science, Univ. of Alberta, Edmonton, AB T6G 2E8, Canada Abstract. An Iterative Estimation
More informationIMAGE-BASED 3D ACQUISITION TOOL FOR ARCHITECTURAL CONSERVATION
IMAGE-BASED 3D ACQUISITION TOOL FOR ARCHITECTURAL CONSERVATION Joris Schouteden, Marc Pollefeys, Maarten Vergauwen, Luc Van Gool Center for Processing of Speech and Images, K.U.Leuven, Kasteelpark Arenberg
More informationFlexible Calibration of a Portable Structured Light System through Surface Plane
Vol. 34, No. 11 ACTA AUTOMATICA SINICA November, 2008 Flexible Calibration of a Portable Structured Light System through Surface Plane GAO Wei 1 WANG Liang 1 HU Zhan-Yi 1 Abstract For a portable structured
More informationSynchronized Ego-Motion Recovery of Two Face-to-Face Cameras
Synchronized Ego-Motion Recovery of Two Face-to-Face Cameras Jinshi Cui, Yasushi Yagi, Hongbin Zha, Yasuhiro Mukaigawa, and Kazuaki Kondo State Key Lab on Machine Perception, Peking University, China {cjs,zha}@cis.pku.edu.cn
More informationCSE 252B: Computer Vision II
CSE 252B: Computer Vision II Lecturer: Serge Belongie Scribes: Jeremy Pollock and Neil Alldrin LECTURE 14 Robust Feature Matching 14.1. Introduction Last lecture we learned how to find interest points
More informationUnsupervised learning in Vision
Chapter 7 Unsupervised learning in Vision The fields of Computer Vision and Machine Learning complement each other in a very natural way: the aim of the former is to extract useful information from visual
More informationObject Tracking Algorithm based on Combination of Edge and Color Information
Object Tracking Algorithm based on Combination of Edge and Color Information 1 Hsiao-Chi Ho ( 賀孝淇 ), 2 Chiou-Shann Fuh ( 傅楸善 ), 3 Feng-Li Lian ( 連豊力 ) 1 Dept. of Electronic Engineering National Taiwan
More informationMotion Capture & Simulation
Motion Capture & Simulation Motion Capture Character Reconstructions Joint Angles Need 3 points to compute a rigid body coordinate frame 1 st point gives 3D translation, 2 nd point gives 2 angles, 3 rd
More informationPlanar homographies. Can we reconstruct another view from one image? vgg/projects/singleview/
Planar homographies Goal: Introducing 2D Homographies Motivation: What is the relation between a plane in the world and a perspective image of it? Can we reconstruct another view from one image? Readings:
More informationCORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM
CORRELATION BASED CAR NUMBER PLATE EXTRACTION SYSTEM 1 PHYO THET KHIN, 2 LAI LAI WIN KYI 1,2 Department of Information Technology, Mandalay Technological University The Republic of the Union of Myanmar
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationMeasurement of Pedestrian Groups Using Subtraction Stereo
Measurement of Pedestrian Groups Using Subtraction Stereo Kenji Terabayashi, Yuki Hashimoto, and Kazunori Umeda Chuo University / CREST, JST, 1-13-27 Kasuga, Bunkyo-ku, Tokyo 112-8551, Japan terabayashi@mech.chuo-u.ac.jp
More informationObject Tracking with an Adaptive Color-Based Particle Filter
Object Tracking with an Adaptive Color-Based Particle Filter Katja Nummiaro 1, Esther Koller-Meier 2, and Luc Van Gool 1,2 1 Katholieke Universiteit Leuven, ESAT/VISICS, Belgium {knummiar,vangool}@esat.kuleuven.ac.be
More informationCS 231. Inverse Kinematics Intro to Motion Capture. 3D characters. Representation. 1) Skeleton Origin (root) Joint centers/ bones lengths
CS Inverse Kinematics Intro to Motion Capture Representation D characters ) Skeleton Origin (root) Joint centers/ bones lengths ) Keyframes Pos/Rot Root (x) Joint Angles (q) Kinematics study of static
More informationIRIS SEGMENTATION OF NON-IDEAL IMAGES
IRIS SEGMENTATION OF NON-IDEAL IMAGES William S. Weld St. Lawrence University Computer Science Department Canton, NY 13617 Xiaojun Qi, Ph.D Utah State University Computer Science Department Logan, UT 84322
More informationCurling Stone Tracking by an Algorithm Using Appearance and Colour Features
Proceedings of the World Congress on Electrical Engineering and Computer Systems and Science (EECSS 2015) Barcelona, Spain July 13-14, 2015 Paper No. 334 Curling Stone Tracing by an Algorithm Using Appearance
More informationCs : Computer Vision Final Project Report
Cs 600.461: Computer Vision Final Project Report Giancarlo Troni gtroni@jhu.edu Raphael Sznitman sznitman@jhu.edu Abstract Given a Youtube video of a busy street intersection, our task is to detect, track,
More informationHuman Motion Detection and Tracking for Video Surveillance
Human Motion Detection and Tracking for Video Surveillance Prithviraj Banerjee and Somnath Sengupta Department of Electronics and Electrical Communication Engineering Indian Institute of Technology, Kharagpur,
More informationCOMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION
COMPARATIVE STUDY OF DIFFERENT APPROACHES FOR EFFICIENT RECTIFICATION UNDER GENERAL MOTION Mr.V.SRINIVASA RAO 1 Prof.A.SATYA KALYAN 2 DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING PRASAD V POTLURI SIDDHARTHA
More informationMotion. 1 Introduction. 2 Optical Flow. Sohaib A Khan. 2.1 Brightness Constancy Equation
Motion Sohaib A Khan 1 Introduction So far, we have dealing with single images of a static scene taken by a fixed camera. Here we will deal with sequence of images taken at different time intervals. Motion
More informationStereo Image Rectification for Simple Panoramic Image Generation
Stereo Image Rectification for Simple Panoramic Image Generation Yun-Suk Kang and Yo-Sung Ho Gwangju Institute of Science and Technology (GIST) 261 Cheomdan-gwagiro, Buk-gu, Gwangju 500-712 Korea Email:{yunsuk,
More informationInternational Journal of Advance Engineering and Research Development
Scientific Journal of Impact Factor (SJIF): 4.72 International Journal of Advance Engineering and Research Development Volume 4, Issue 11, November -2017 e-issn (O): 2348-4470 p-issn (P): 2348-6406 Comparative
More informationFeature Tracking and Optical Flow
Feature Tracking and Optical Flow Prof. D. Stricker Doz. G. Bleser Many slides adapted from James Hays, Derek Hoeim, Lana Lazebnik, Silvio Saverse, who 1 in turn adapted slides from Steve Seitz, Rick Szeliski,
More informationProgramming assignment 3 Mean-shift
Programming assignment 3 Mean-shift 1 Basic Implementation The Mean Shift algorithm clusters a d-dimensional data set by associating each point to a peak of the data set s probability density function.
More informationShort Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
More information3D from Photographs: Automatic Matching of Images. Dr Francesco Banterle
3D from Photographs: Automatic Matching of Images Dr Francesco Banterle francesco.banterle@isti.cnr.it 3D from Photographs Automatic Matching of Images Camera Calibration Photographs Surface Reconstruction
More informationMeasurement of 3D Foot Shape Deformation in Motion
Measurement of 3D Foot Shape Deformation in Motion Makoto Kimura Masaaki Mochimaru Takeo Kanade Digital Human Research Center National Institute of Advanced Industrial Science and Technology, Japan The
More informationColour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation
ÖGAI Journal 24/1 11 Colour Segmentation-based Computation of Dense Optical Flow with Application to Video Object Segmentation Michael Bleyer, Margrit Gelautz, Christoph Rhemann Vienna University of Technology
More informationMultiple View Reconstruction of Calibrated Images using Singular Value Decomposition
Multiple View Reconstruction of Calibrated Images using Singular Value Decomposition Ayan Chaudhury, Abhishek Gupta, Sumita Manna, Subhadeep Mukherjee, Amlan Chakrabarti Abstract Calibration in a multi
More informationOcclusion Detection of Real Objects using Contour Based Stereo Matching
Occlusion Detection of Real Objects using Contour Based Stereo Matching Kenichi Hayashi, Hirokazu Kato, Shogo Nishida Graduate School of Engineering Science, Osaka University,1-3 Machikaneyama-cho, Toyonaka,
More informationModel-Based Human Motion Capture from Monocular Video Sequences
Model-Based Human Motion Capture from Monocular Video Sequences Jihun Park 1, Sangho Park 2, and J.K. Aggarwal 2 1 Department of Computer Engineering Hongik University Seoul, Korea jhpark@hongik.ac.kr
More informationInterpolation and extrapolation of motion capture data
Interpolation and extrapolation of motion capture data Kiyoshi Hoshino Biological Cybernetics Lab, University of the Ryukyus and PRESTO-SORST, Japan Science and Technology Corporation Nishihara, Okinawa
More informationCar tracking in tunnels
Czech Pattern Recognition Workshop 2000, Tomáš Svoboda (Ed.) Peršlák, Czech Republic, February 2 4, 2000 Czech Pattern Recognition Society Car tracking in tunnels Roman Pflugfelder and Horst Bischof Pattern
More informationAUTONOMOUS IMAGE EXTRACTION AND SEGMENTATION OF IMAGE USING UAV S
AUTONOMOUS IMAGE EXTRACTION AND SEGMENTATION OF IMAGE USING UAV S Radha Krishna Rambola, Associate Professor, NMIMS University, India Akash Agrawal, Student at NMIMS University, India ABSTRACT Due to the
More informationAN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES
AN ALGORITHM FOR BLIND RESTORATION OF BLURRED AND NOISY IMAGES Nader Moayeri and Konstantinos Konstantinides Hewlett-Packard Laboratories 1501 Page Mill Road Palo Alto, CA 94304-1120 moayeri,konstant@hpl.hp.com
More informationCapturing, Modeling, Rendering 3D Structures
Computer Vision Approach Capturing, Modeling, Rendering 3D Structures Calculate pixel correspondences and extract geometry Not robust Difficult to acquire illumination effects, e.g. specular highlights
More informationGuided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging
Guided Image Super-Resolution: A New Technique for Photogeometric Super-Resolution in Hybrid 3-D Range Imaging Florin C. Ghesu 1, Thomas Köhler 1,2, Sven Haase 1, Joachim Hornegger 1,2 04.09.2014 1 Pattern
More informationOverview. Augmented reality and applications Marker-based augmented reality. Camera model. Binary markers Textured planar markers
Augmented reality Overview Augmented reality and applications Marker-based augmented reality Binary markers Textured planar markers Camera model Homography Direct Linear Transformation What is augmented
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More information3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.
3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction
More informationComparison of Some Motion Detection Methods in cases of Single and Multiple Moving Objects
Comparison of Some Motion Detection Methods in cases of Single and Multiple Moving Objects Shamir Alavi Electrical Engineering National Institute of Technology Silchar Silchar 788010 (Assam), India alavi1223@hotmail.com
More informationHuman body animation. Computer Animation. Human Body Animation. Skeletal Animation
Computer Animation Aitor Rovira March 2010 Human body animation Based on slides by Marco Gillies Human Body Animation Skeletal Animation Skeletal Animation (FK, IK) Motion Capture Motion Editing (retargeting,
More information