3D Hand and Fingers Reconstruction from Monocular View
|
|
- Madeleine Cain
- 6 years ago
- Views:
Transcription
1 3D Hand and Fingers Reconstruction rom Monocular View 1. Research Team Project Leader: Graduate Students: Pro. Isaac Cohen, Computer Science Sung Uk Lee 2. Statement o Project Goals The needs or an accurate hand motion tracking have been increasing in HCI and applications requiring an understanding o user motions. Hand gestures can be used as a convenient user interace or various computer applications in which the state and the action o the users are automatically inerred rom a set o video cameras. The objective is to extend the current mousekeyboard interaction techniques in order to allow the user to behave naturally in the immersed environment, as the system perceives and responds appropriately to user actions. HCI related applications remains the most requent however; we have ocused our eort on the accurate detection and tracking o un-instrumented hands or assessing user perormance in accomplishing a speciic task. 3. Project Role in Support o IMSC Strategic Plan Multimodal communications rely on speech, haptics and visual sensing o the user in order to characterize the user s emotional and/or physical state. The proposed research ocuses on augmenting the interaction capabilities o a multimodal system by providing an automatic tracking o hands motion and recognizing the corresponding hands gestures. The objective here is to augment or replace the mouse and keyboard paradigm with unctionalities relying on natural hands motion or driving a speciic application. 4. Discussion o Methodology Used Inerring hand motion rom monocular view is challenging, as the detected 2D silhouette is not suicient to depict a complicated hand pose. Thereore, several studies introduce respective hand model and model-based approach. Although these methods can track the articulated hand motion rom monocular view, many o them are computationally too expensive and have diiculties in addressing hand s sel-occlusions. We revised the articulated hand model proposed previous year to deal with natural hand motion constraints, and it allows tracking detected hand eiciently in the presence o sel-occlusions and has a low computational cost. Ater the segmentation o the hand silhouette rom the video stream, an articulated hand model is itted onto the 2D mask o a hand. For initialization, 3D hand model coniguration such as joint oset and size are reined by the avorable stretched-out pose. Section 4.2 describes the initialization process in detail. First joints connecting palm and each inger orm a rigid shape. Once a 3D model is reined, global hand pose is computed using this rigid orm constraint and then estimation o each inger motion is perormed. To reconstruct accurate pose, 3D model is updated by re-projecting it on 2D detected silhouette in the tracking process. An overview o the proposed approach is shown in igure
2 Figure 1. Overview o the proposed approach. 4.1 Modeling Hand Constraints Without any constraints, it is a very exhaustive task to analyze human hand motion. However, joints in a hand are interrelated and their motions are related by physical constraints. Huang et al [4] showed in detail that human hand motion is highly constrained. A learning approach was proposed to model the hand coniguration space directly sensed rom a CyberGlove. In this project, three types o constraints are deined or natural hand motion. Figure 2 shows the articulated hand model proposed to model hand motion constraints. Figure 2. The articulated hand model. Each joint ji is a revolute joint where is the index o ingers enumerated rom thumb to little inger ( = ~ 4). All the irst joints (where i = ) connecting palm and each inger have 2 degrees o reedom and other joints have a single rotational axis. Thereore, the suggested model has 2 DOF. Intra-Finger Constraints. In this category, the main constraint considered is o inger joints during a bending. The number o rotational axes in a joint is constrained. By using the planar 3- joint-arm inger model, DOF o a inger is reduced to 4. j, the irst joint o a inger, has 2 rotation axes one or bending motion and another is or abduction/adduction motion but other joints have single rotation axis. Table 1 shows the range o each joint angle or bending motion. Table 1. Joint angle constraints or bending motion ji i = i = 1 i = 2 = -1 o ~ +45 o + o ~ +9 o -5 o ~ +9 o = 1~4-15 o ~ +9 o -5 o ~ +9 o -5 o ~ +9 o Each contiguous joint has the ollowing constraint: = a (1) j i i ji
3 where inger index =1 to 4 and joint index i = 1, 2. a i is deined by (limit angle o j i ) / (limit angle o ji - 1 ). This type o constraint is not strictly applied, but is an eicient guide o joint oset estimation. Inter-Finger Constraints. Proposed model has ixed geometric proportion among j (osets o all irst joint o a inger). No joint can overlap each other in 3D coordinates. Interrelated motion constraints or abduction/adduction motion between adjacent ingers are deined in this category. Adjacent inger tends to ollow the dominant articulated motion. Global Motion Constraints. This category includes some restrictions on target motion. Tracking objective is natural hand motion, begins with avorable pose or initialization. No external torque on a joint is expected. Motion should be smooth. By these constraints, we address the problem o tracking articulated hand motion with sel-occlusion, rotation and translation, but the proposed approach does not address the scaling and depth estimation rom monocular view. Some recent studies introduce similar constraints to the above mentioned ones. However, they are hardly modeled as an explicit orm o equations. Figure 3. Model initialization. (a) Distance map. (b), (c) Approaching median axis (minimum distance) along the gradient o distance map. (d) Joint position reinement. (e) Coarse 2D model with ellipsoid itting. () An example ater reinement. Figure 4. Kinematics inger model 4.2 Hand Model Fitting with Hand Constraints A sequence o hand motion begins with a avorable initial pose as shown in igure 3. By using an ellipsoid itting [12] on top o the segmented hand silhouette, brie scale and orientation o a hand are computed. Borgeors two-pass algorithm [12] is used to compute the distance map d(x,y) o a hand image or the model reinement. D ( x, y) = Ï- d( x, y), ( x, y) Œ Silhouette (2) Ì Ó d( x, y), Otherwise By minimizing the distance D(x,y) along the gradient D( x, y), each joint oset can be reined. Each joint width (thickness) can be also estimated with D(x,y). Figure 3 shows an example o model initialization in 2D. Based on this inormation, the initial coniguration o 3D hand model is reined. 233
4 Using inter-inger constraints and global motion constraints, a hand motion can be divided into 1 global pose and individual inger motion. At time t, irst joints o j, j, and j 4 orm a palmtriangle PT(t) which has three sides o w 1 t, w 2 t w t. In the two consecutive palm-triangle PT(t) and PT(t+1), the proportion o corresponding sides o each palm-triangle provides the global pose. By the global motion constraint, j is the origin o a hand coniguration. Thus, the translation vector T g can be estimated by two consecutive 2D position o j detected rom hand silhouette. p p By the rigid motion constraint, w t / wt + 1 gives the angle or rotation vector R g. In Figure 5, a palm-triangle o bright violet shows the estimation results o global pose. Figure 5. 3D hand reconstruction 1: 1 st row show the result o the global pose estimation with palm-triangle. Re-projected hand model 2 nd row shows the reconstructed 3D hand model. Figure 6. 3D hand reconstruction 2: 1 st Row shows the original hand pose. 2 nd row represents the reconstructed pose. 3 rd row is dierent angle view. Ater estimating the global rotation and translation [R g, T g ], each joint angle o a inger can be estimated rom the equations in Figure 4. Each length o links in a inger was ixed in the initialization. Thereore, joint angle qi or the bending motion is explicated. The proposed tracking technique is based on tracking by synthesis. To maximize the likelihood, possible sets o coniguration is tested. The adjustment o a hand model is guided by the motion constraints and the coniguration o previous rame. Disparity vector o the closest boundary between the model segment and the detected silhouette is computed or estimating the position o a joint angle. The adjusted 3D hand coniguration is projected back onto the 2D image and updated rom 2D image measurements back and orth. Figure 5 shows some results o motion tracking. Reconstructed 3D hand model and its re-projected 2D model are correctly matched with the detected silhouette. Various hand poses including sel-occlusion and the corresponding results are shown in Figure Short Description o Achievements in Previous Years The 3D shape o the hands is reconstructed rom 2D hands silhouettes extracted rom two calibrated cameras using GC-based approach. Hand pose inormation can be computed by matching these synthesized shapes to pre-deined hand model or learning hands postures using a 3D shape description. The previous ramework we have developed or 3D body reconstruction 234
5 [14] has been modiied or 3D hands reconstruction. The detected silhouettes are segmented into separate ingers: we compute edge inormation in the segmented hand region (inside the silhouettes) to reconstruct each inger as a cylindrical orm. This local edge analysis allows us to reconstruct the 3D hand shape accurately when the ingers are splayed or when they are not. 5a. Detail o Accomplishments During the Past Year The goal o this project is to understand and reconstruct human hand motion with natural articulation and occlusion in real time. The objective o this research eort is to augment or replace the mouse and keyboard paradigm with unctionalities relying on natural hands motion or driving a speciic application. During this year we have ocused on inerring accurate hand motion rom monocular view. An articulated model is itted accurately by the proposed model reinement technique and global pose o the hand can be computed by characterizing the orientation o the palm. Individual inger motion is modeled and tracked as a planar arm. We have mainly addressed the problem o tracking the simultaneous motion o rotation, translation, and sel-occlusion in monocular view. Proposed approach is easy to extend or real-time and multi-view ramework, although the target motion is somewhat restrictive. 6. Other Relevant Work Being Conducted and How this Project is Dierent A large number o studies have been proposed or capturing human hand motion. Some o them have ocused on very speciic domain and thus have a large number o restrictive assumptions. In [9.1.11], trajectories o hand motion are considered or classiying human gestures and are suicient or the studied domain. Several rameworks have been proposed we can distinguish two types: appearance-based and model-based methods. In [7] an appearance-based method is proposed or characterizing the various hand coniguration and inger pose. This relies on a learning-based approach and requires training the algorithm on a large data set that depicts all possible conigurations. Similarly in [8], articulated pose o a hand is ormulated as a database indexing problem. From a large set o synthetic hand images, the closest matches o an input hand image are retrieved as an estimated pose. Model based approaches rely on the physical properties o the hand and inger motion [1.2.3] in order to iner it rom a single or multiple views. Huang et al. [5] proposed a model-based approach that integrates constraints o natural hand motion. They also proposed a learning approach to model the kinematics constraints directly rom a real input device such as the CyberGlove [4]. They ocused on the analysis o local inger motion and constraints rom observed data. For articulated motion tracking, a Sequential Monte Carlo algorithm based on importance sampling is employed. In a ixed viewpoint, this produces good results; however, global hand position and motion are not dealt with. Recently, some studies o integrating various cues such as motion, shading and edges were proposed. Metaxas et al [6] computes the model driving orces using gradient-based optical low constraint and edges. A orward recursive dynamic model is introduced to track the motion in response to 3D data derived orces applied to the model. They assumed that global hand motion is rigid motion. No simultaneous articulated motion is expected. When the ingers are in motion o signiicant relative motion with occlusions, they hardly drive the hand model. 235
6 7. Plan or the Next Year We plan to extent the capabilities o the current system to multi-view ramework. We will also ocus the development o an eicient joint angle tracking technique or both o the real-time inger motion tracking and the hand localization in 3D. 8. Expected Milestones and Deliverables For the next ive-years, we will ocus on expanding current method or recognition o hands gestures, as well as tracking hands motion o a person manipulating objects Articulated model itting and tracking Eicient tracking technique or real time perormances Gesture recognition rom the inerred articulated model Computer interaction using basic hand gestures Multimodal interaction using hand motion 9. Member Company Beneits We are investigating two potential applications: manipulation o 3D objects displayed on a 3D LCD and evaluation o handwriting deiciencies. We initiated a collaboration with occupational therapy specialists that identiy this technology to be very important or characterizing handwriting deiciencies among persons alicted with ADD syndrome. A potential use o the technology or monitoring operators perorming maintenance tasks on expensive machinery. 1. Reerences [1] J.M. Rehg and T. Kanade, "Model-Based Tracking o Sel-Occluding Articulated Objects", ICCV95 [2] Q. Delamarre and O. Faugeras, Finding pose o hand in video images: a stereo-based approach, In IEEE International Conerence on Automatic Face and Gesture Recognition, Japan, 1998 [3] B. Stenger, P. R. S. Mendonça, and R. Cipolla, Model-Based 3D Tracking o an Articulated Hand, In CVPR, Volume II, pages , Kauai, USA, December 21. [4] J. Lin, Y. Wu and Thomas S. Huang, "Modeling Human Hand Constraints", In. Workshop on Human Motion, Austin, Dec., 2. [5] Y. Wu, J. Lin and T. S. Huang, "Capturing Natural Hand Articulation", in ICCV 1, pp [6] S. Lu, G. Huang, D. Samaras and D. Metaxas, Model-based Integration o Visual Cues or Hand Tracking In Proc. WMVC 22 [7] R. Rosales, V. Athitsos, L. Sigal, and S. Sclaro, "3D Hand Pose Reconstruction Using Specialized Mappings" IEEE ICCV. Canada. Jul. 21. [8] V. Athitsos and S. Sclaro, "Estimating 3D Hand Pose rom a Cluttered Image", In CVPR 23. [9] R. Cutler and M. Turk, View-based interpretation o realtime optical low or gesture recognition, In Proc. Face and Gesture Recognition, pp ,
7 [1] A. Nishikawa, A. Ohnishi, and F. Miyazaki. Description and recognition o human gestures based on the transition o curvature rom motion images, In Proc. Face and Gesture Recognition, pp , [11] Y. Xiong and F. Quek, Gestural Hand Motion Oscillation and Symmetries or Multimodal Discourse: Detection and Analysis, In Proc. Workshop on Computer Vision and Pattern Recognition or HCI. June, 23. [12] Intel Corp. Open Source Computer Vision Library Reerence Manual, 1999 [13] L. Sciavicco, B. Siciliano, Modeling and control o robot manipulators MacGraw-Hill, NY, [14] Isaac Cohen and Mun Wai Lee, "3D Body Reconstruction or Immersive Interaction", Second International Workshop on Articulated Motion and Deormable Objects Palma de Mallorca, Spain, November,
8 238
Human Upper Body Pose Estimation in Static Images
1. Research Team Human Upper Body Pose Estimation in Static Images Project Leader: Graduate Students: Prof. Isaac Cohen, Computer Science Mun Wai Lee 2. Statement of Project Goals This goal of this project
More informationGesture Recognition using a Probabilistic Framework for Pose Matching
Gesture Recognition using a Probabilistic Framework or Pose Matching Ahmed Elgammal Vinay Shet Yaser Yacoob Larry S. Davis Computer Vision Laboratory University o Maryland College Park MD 20742 USA elgammalvinayyaserlsd
More informationRoad Sign Analysis Using Multisensory Data
Road Sign Analysis Using Multisensory Data R.J. López-Sastre, S. Lauente-Arroyo, P. Gil-Jiménez, P. Siegmann, and S. Maldonado-Bascón University o Alcalá, Department o Signal Theory and Communications
More informationGrasp Recognition using a 3D Articulated Model and Infrared Images
Grasp Recognition using a 3D Articulated Model and Infrared Images Koichi Ogawara Institute of Industrial Science, Univ. of Tokyo, Tokyo, Japan Jun Takamatsu Institute of Industrial Science, Univ. of Tokyo,
More informationMulti-view Appearance-based 3D Hand Pose Estimation
Multi-view Appearance-based 3D Hand Pose Estimation Haiying Guan, Jae Sik Chang, Longbin Chen, Rogerio S. Feris, and Matthew Turk Computer Science Department University of California at Santa Barbara,
More informationDynamic Time Warping for Binocular Hand Tracking and Reconstruction
Dynamic Time Warping for Binocular Hand Tracking and Reconstruction Javier Romero, Danica Kragic Ville Kyrki Antonis Argyros CAS-CVAP-CSC Dept. of Information Technology Institute of Computer Science KTH,
More informationMonocular 3D human pose estimation with a semi-supervised graph-based method
Monocular 3D human pose estimation with a semi-supervised graph-based method Mahdieh Abbasi Computer Vision and Systems Laboratory Department o Electrical Engineering and Computer Engineering Université
More informationModeling the Constraints of Human Hand Motion
I Modeling the Constraints of Human Hand Motion John Lin, Ying Wu, Thomas S. Huang Beckman Institute University of Illinois at Urbana-Champaign Urbana, IL 61 801 { jy-lin, yingwu, huang }@ifp.uiuc.edu
More informationMOVING CAMERA ROTATION ESTIMATION USING HORIZON LINE FEATURES MOTION FIELD
MOVING CAMERA ROTATION ESTIMATION USING HORION LINE FEATURES MOTION FIELD S. Nedevschi, T. Marita, R. Danescu, F. Oniga, C. Pocol Computer Science Department Technical University o Cluj-Napoca Cluj-Napoca,
More informationThe Isometric Self-Organizing Map for 3D Hand Pose Estimation
The Isometric Self-Organizing Map for 3D Hand Pose Estimation Haiying Guan, Rogerio S. Feris, and Matthew Turk Computer Science Department University of California, Santa Barbara {haiying,rferis,mturk}@cs.ucsb.edu
More informationHand Gesture Recognition. By Jonathan Pritchard
Hand Gesture Recognition By Jonathan Pritchard Outline Motivation Methods o Kinematic Models o Feature Extraction Implemented Algorithm Results Motivation Virtual Reality Manipulation of virtual objects
More informationMAPI Computer Vision. Multiple View Geometry
MAPI Computer Vision Multiple View Geometry Geometry o Multiple Views 2- and 3- view geometry p p Kpˆ [ K R t]p Geometry o Multiple Views 2- and 3- view geometry Epipolar Geometry The epipolar geometry
More informationMotion based 3D Target Tracking with Interacting Multiple Linear Dynamic Models
Motion based 3D Target Tracking with Interacting Multiple Linear Dynamic Models Zhen Jia and Arjuna Balasuriya School o EEE, Nanyang Technological University, Singapore jiazhen@pmail.ntu.edu.sg, earjuna@ntu.edu.sg
More informationA Survey of Light Source Detection Methods
A Survey of Light Source Detection Methods Nathan Funk University of Alberta Mini-Project for CMPUT 603 November 30, 2003 Abstract This paper provides an overview of the most prominent techniques for light
More informationReal-Time Multi-Body Vehicle Dynamics Using A Modular Modeling Methodology
2003-01-1286 Real-Time Multi-ody Vehicle Dynamics Using Modular Modeling Methodology Copyright 2003 Society o utomotive Engineers, nc. Richard Romano Realtime Technologies, nc. STRCT Simulations o ground
More informationHand Gesture Recognition Based On The Parallel Edge Finger Feature And Angular Projection
Hand Gesture Recognition Based On The Parallel Edge Finger Feature And Angular Projection Zhou Yimin 1,2, Jiang Guolai 1, Xu Guoqing 1 and Lin Yaorong 3 1 Shenzhen Institutes of Advanced Technology, Chinese
More information3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views
3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views Vassilis Athitsos and Stan Sclaroff Computer Science Department Boston University 111 Cummington Street
More information3D Face and Hand Tracking for American Sign Language Recognition
3D Face and Hand Tracking for American Sign Language Recognition NSF-ITR (2004-2008) D. Metaxas, A. Elgammal, V. Pavlovic (Rutgers Univ.) C. Neidle (Boston Univ.) C. Vogler (Gallaudet) The need for automated
More informationSUPER RESOLUTION IMAGE BY EDGE-CONSTRAINED CURVE FITTING IN THE THRESHOLD DECOMPOSITION DOMAIN
SUPER RESOLUTION IMAGE BY EDGE-CONSTRAINED CURVE FITTING IN THE THRESHOLD DECOMPOSITION DOMAIN Tsz Chun Ho and Bing Zeng Department o Electronic and Computer Engineering The Hong Kong University o Science
More information3-D TERRAIN RECONSTRUCTION WITH AERIAL PHOTOGRAPHY
3-D TERRAIN RECONSTRUCTION WITH AERIAL PHOTOGRAPHY Bin-Yih Juang ( 莊斌鎰 ) 1, and Chiou-Shann Fuh ( 傅楸善 ) 3 1 Ph. D candidate o Dept. o Mechanical Engineering National Taiwan University, Taipei, Taiwan Instructor
More informationMachine Vision and Gesture Recognition Machine Vision Term Paper
Machine Vision and Gesture Recognition 6.866 Machine Vision Term Paper Ying Yin (986278392) yingyin@csail.mit.edu December 9, 2008 1 Introduction Gesture recognition allows the computer to understand human
More informationReflection and Refraction
Relection and Reraction Object To determine ocal lengths o lenses and mirrors and to determine the index o reraction o glass. Apparatus Lenses, optical bench, mirrors, light source, screen, plastic or
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More informationAn object-based approach to plenoptic videos. Proceedings - Ieee International Symposium On Circuits And Systems, 2005, p.
Title An object-based approach to plenoptic videos Author(s) Gan, ZF; Chan, SC; Ng, KT; Shum, HY Citation Proceedings - Ieee International Symposium On Circuits And Systems, 2005, p. 3435-3438 Issued Date
More informationA Quantitative Comparison of 4 Algorithms for Recovering Dense Accurate Depth
A Quantitative Comparison o 4 Algorithms or Recovering Dense Accurate Depth Baozhong Tian and John L. Barron Dept. o Computer Science University o Western Ontario London, Ontario, Canada {btian,barron}@csd.uwo.ca
More informationAC : DEVELOPMENT OF A ROBOTIC PLATFORM FOR TEACH- ING MODEL-BASED DESIGN TECHNIQUES IN DYNAMICS AND CON- TROL PROGRAM
AC 011-714: DEVELOPMENT OF A ROBOTIC PLATFORM FOR TEACH- ING MODEL-BASED DESIGN TECHNIQUES IN DYNAMICS AND CON- TROL PROGRAM Bingen Yang, University o Southern Caliornia Dr. Bingen Yang is Proessor o Aerospace
More informationGesture Recognition Technique:A Review
Gesture Recognition Technique:A Review Nishi Shah 1, Jignesh Patel 2 1 Student, Indus University, Ahmedabad 2 Assistant Professor,Indus University,Ahmadabad Abstract Gesture Recognition means identification
More informationHand Pose Estimation Using Expectation-Constrained-Maximization From Voxel Data
Hand Pose Estimation Technical Report, CVRR Laboratory, November 2004. 1 Hand Pose Estimation Using Expectation-Constrained-Maximization From Voxel Data Shinko Y. Cheng and Mohan M. Trivedi {sycheng, mtrivedi}@ucsd.edu
More informationAn Interactive Technique for Robot Control by Using Image Processing Method
An Interactive Technique for Robot Control by Using Image Processing Method Mr. Raskar D. S 1., Prof. Mrs. Belagali P. P 2 1, E&TC Dept. Dr. JJMCOE., Jaysingpur. Maharashtra., India. 2 Associate Prof.
More informationKANGAL REPORT
Individual Penalty Based Constraint handling Using a Hybrid Bi-Objective and Penalty Function Approach Rituparna Datta Kalyanmoy Deb Mechanical Engineering IIT Kanpur, India KANGAL REPORT 2013005 Abstract
More informationPerceptual Grouping from Motion Cues Using Tensor Voting
Perceptual Grouping from Motion Cues Using Tensor Voting 1. Research Team Project Leader: Graduate Students: Prof. Gérard Medioni, Computer Science Mircea Nicolescu, Changki Min 2. Statement of Project
More informationMulti-View Omni-Directional Imaging
Multi-View Omni-Directional Imaging Tuesday, December 19, 2000 Moshe Ben-Ezra, Shmuel Peleg Abstract This paper describes a novel camera design or the creation o multiple panoramic images, such that each
More informationDense 3D Motion Capture for Human Faces
Dense 3D Motion Capture or Human Faces Yasutaka Furukawa University o Washington, Seattle, USA urukawa@cs.washington.edu Jean Ponce Ecole Normale Supérieure, Paris, France Jean.Ponce@ens.r Abstract This
More informationPATH PLANNING OF UNMANNED AERIAL VEHICLE USING DUBINS GEOMETRY WITH AN OBSTACLE
Proceeding o International Conerence On Research, Implementation And Education O Mathematics And Sciences 2015, Yogyakarta State University, 17-19 May 2015 PATH PLANNING OF UNMANNED AERIAL VEHICLE USING
More informationROBUST FACE DETECTION UNDER CHALLENGES OF ROTATION, POSE AND OCCLUSION
ROBUST FACE DETECTION UNDER CHALLENGES OF ROTATION, POSE AND OCCLUSION Phuong-Trinh Pham-Ngoc, Quang-Linh Huynh Department o Biomedical Engineering, Faculty o Applied Science, Hochiminh University o Technology,
More informationHUMAN COMPUTER INTERFACE BASED ON HAND TRACKING
Proceedings of MUSME 2011, the International Symposium on Multibody Systems and Mechatronics Valencia, Spain, 25-28 October 2011 HUMAN COMPUTER INTERFACE BASED ON HAND TRACKING Pedro Achanccaray, Cristian
More informationDETC COMPARING KINEMATIC AND DYNAMIC HAND MODELS FOR INTERACTIVE GRASPING SIMULATION
Proceedings o o the the ASME 29 International Design Engineering Technical Conerences & and Computers and Inormation in in Engineering Conerence IDETC/CIE 29 August 33-September - 2, 2, 29, San Diego,
More informationOn the Geometry of Visual Correspondence
International Journal o Computer Vision 21(3), 223 247 (1997) c 1997 Kluwer Academic Publishers. Manuactured in The Netherlands. On the Geometry o Visual Correspondence CORNELIA FERMÜLLER AND YIANNIS ALOIMONOS
More informationThink-Pair-Share. What visual or physiological cues help us to perceive 3D shape and depth?
Think-Pair-Share What visual or physiological cues help us to perceive 3D shape and depth? [Figure from Prados & Faugeras 2006] Shading Focus/defocus Images from same point of view, different camera parameters
More information3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views
Technical Report BU-CS-TR-2001-021 A shorter version of this paper is published in the proceedings of IEEE Workshop on Cues in Communication, 2001 3D Hand Pose Estimation by Finding Appearance-Based Matches
More informationReal-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera
Real-time 3-D Hand Posture Estimation based on 2-D Appearance Retrieval Using Monocular Camera Nobutaka Shimada, Kousuke Kimura and Yoshiaki Shirai Dept. of Computer-Controlled Mechanical Systems, Osaka
More informationA Real Time System for Detecting and Tracking People. Ismail Haritaoglu, David Harwood and Larry S. Davis. University of Maryland
W 4 : Who? When? Where? What? A Real Time System for Detecting and Tracking People Ismail Haritaoglu, David Harwood and Larry S. Davis Computer Vision Laboratory University of Maryland College Park, MD
More informationImitation of Hand Postures with Particle Based Fluidics Method
, October 20-22, 2010, San Francisco, USA Imitation o Hand Postures with Particle Based Fluidics Method Umut ilki, Ismet Erkmen, and Aydan M. Erkmen Abstract he correspondence problem is an important problem
More informationInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXIV-5/W10
BUNDLE ADJUSTMENT FOR MARKERLESS BODY TRACKING IN MONOCULAR VIDEO SEQUENCES Ali Shahrokni, Vincent Lepetit, Pascal Fua Computer Vision Lab, Swiss Federal Institute of Technology (EPFL) ali.shahrokni,vincent.lepetit,pascal.fua@epfl.ch
More informationHand Tracking Miro Enev UCDS Cognitive Science Department 9500 Gilman Dr., La Jolla CA
Hand Tracking Miro Enev UCDS Cognitive Science Department 9500 Gilman Dr., La Jolla CA menev@ucsd.edu Abstract: Tracking the pose of a moving hand from a monocular perspective is a difficult problem. In
More informationA Proposed Approach for Solving Rough Bi-Level. Programming Problems by Genetic Algorithm
Int J Contemp Math Sciences, Vol 6, 0, no 0, 45 465 A Proposed Approach or Solving Rough Bi-Level Programming Problems by Genetic Algorithm M S Osman Department o Basic Science, Higher Technological Institute
More informationApplying Synthetic Images to Learning Grasping Orientation from Single Monocular Images
Applying Synthetic Images to Learning Grasping Orientation from Single Monocular Images 1 Introduction - Steve Chuang and Eric Shan - Determining object orientation in images is a well-established topic
More informationCS485/685 Computer Vision Spring 2012 Dr. George Bebis Programming Assignment 2 Due Date: 3/27/2012
CS8/68 Computer Vision Spring 0 Dr. George Bebis Programming Assignment Due Date: /7/0 In this assignment, you will implement an algorithm or normalizing ace image using SVD. Face normalization is a required
More informationA Fault Model Centered Modeling Framework for Self-healing Computing Systems
A Fault Model Centered Modeling Framework or Sel-healing Computing Systems Wei Lu 1, Yian Zhu 1, Chunyan Ma 1, and Longmei Zhang 2 1 Department o Sotware and Microelectronics, Northwestern Polytechnical
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More informationAutomatic Video Segmentation for Czech TV Broadcast Transcription
Automatic Video Segmentation or Czech TV Broadcast Transcription Jose Chaloupka Laboratory o Computer Speech Processing, Institute o Inormation Technology and Electronics Technical University o Liberec
More informationComputer Vision Lecture 17
Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics 13.01.2015 Bastian Leibe RWTH Aachen http://www.vision.rwth-aachen.de leibe@vision.rwth-aachen.de Announcements Seminar in the summer semester
More informationComputer Vision Lecture 17
Announcements Computer Vision Lecture 17 Epipolar Geometry & Stereo Basics Seminar in the summer semester Current Topics in Computer Vision and Machine Learning Block seminar, presentations in 1 st week
More informationModel-based Gait Representation via Spatial Point Reconstruction
J. hanghai Jiaotong Univ. (ci.), 2009, 4(3): 293-298 DO: 0.007/s2204-009-0293- Model-based Gait Representation via patial Point Reconstruction HANG uan-uan ( ), WU iao-juan ( ), RUAN Qiu-qi,2 ( ) (. nstitute
More informationMIME: A Gesture-Driven Computer Interface
MIME: A Gesture-Driven Computer Interface Daniel Heckenberg a and Brian C. Lovell b a Department of Computer Science and Electrical Engineering, The University of Queensland, Brisbane, Australia, 4072
More informationProjection Model, 3D Reconstruction and Rigid Motion Estimation from Non-central Catadioptric Images
Projection Model, 3D Reconstruction and Rigid Motion Estimation rom Non-central Catadioptric Images Nuno Gonçalves and Helder Araújo Institute o Systems and Robotics - Coimbra University o Coimbra Polo
More informationLexical Gesture Interface
Lexical Gesture Interface Zhenyao Mo, Ulrich Neumann CGIT Lab, University of Southern California {zmo, uneumann}@graphics.usc.edu Abstract Gesture interfaces have long been pursued in the context of portable
More informationMATRIX ALGORITHM OF SOLVING GRAPH CUTTING PROBLEM
UDC 681.3.06 MATRIX ALGORITHM OF SOLVING GRAPH CUTTING PROBLEM V.K. Pogrebnoy TPU Institute «Cybernetic centre» E-mail: vk@ad.cctpu.edu.ru Matrix algorithm o solving graph cutting problem has been suggested.
More informationRecap: Features and filters. Recap: Grouping & fitting. Now: Multiple views 10/29/2008. Epipolar geometry & stereo vision. Why multiple views?
Recap: Features and filters Epipolar geometry & stereo vision Tuesday, Oct 21 Kristen Grauman UT-Austin Transforming and describing images; textures, colors, edges Recap: Grouping & fitting Now: Multiple
More information2. Design Planning with the Quartus II Software
November 2013 QII51016-13.1.0 2. Design Planning with the Quartus II Sotware QII51016-13.1.0 This chapter discusses key FPGA design planning considerations, provides recommendations, and describes various
More informationHow to Make a Simple and Robust 3D Hand Tracking Device Using a Single Camera
Proceedings of the 11th WSEAS International Conference on COMPUTERS, Agios Nikolaos, Crete Island, Greece, July 26-28, 2007 414 How to Make a Simple and Robust 3D Hand Tracking Device Using a Single Camera
More informationResearch on Image Splicing Based on Weighted POISSON Fusion
Research on Image Splicing Based on Weighted POISSO Fusion Dan Li, Ling Yuan*, Song Hu, Zeqi Wang School o Computer Science & Technology HuaZhong University o Science & Technology Wuhan, 430074, China
More informationA Cylindrical Surface Model to Rectify the Bound Document Image
A Cylindrical Surace Model to Rectiy the Bound Document Image Huaigu Cao, Xiaoqing Ding, Changsong Liu Department o Electronic Engineering, Tsinghua University State Key Laboratory o Intelligent Technology
More information521466S Machine Vision Exercise #1 Camera models
52466S Machine Vision Exercise # Camera models. Pinhole camera. The perspective projection equations or a pinhole camera are x n = x c, = y c, where x n = [x n, ] are the normalized image coordinates,
More informationVirtual Interaction System Based on Optical Capture
Sensors & Transducers 203 by IFSA http://www.sensorsportal.com Virtual Interaction System Based on Optical Capture Peng CHEN, 2 Xiaoyang ZHOU, 3 Jianguang LI, Peijun WANG School of Mechanical Engineering,
More informationDepth. Common Classification Tasks. Example: AlexNet. Another Example: Inception. Another Example: Inception. Depth
Common Classification Tasks Recognition of individual objects/faces Analyze object-specific features (e.g., key points) Train with images from different viewing angles Recognition of object classes Analyze
More informationAbstract. I. Introduction
46th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics & Materials Conerence 8 - April 005, Austin, Texas AIAA 005-83 M Intuitive Design Selection Using Visualized n-dimensional Pareto Frontier G.
More informationEE 264: Image Processing and Reconstruction. Image Motion Estimation II. EE 264: Image Processing and Reconstruction. Outline
Peman Milanar Image Motion Estimation II Peman Milanar Outline. Introduction to Motion. Wh Estimate Motion? 3. Global s. Local Motion 4. Block Motion Estimation 5. Optical Flow Estimation Basics 6. Optical
More informationASIAGRAPH 2008 The Intermediate View Synthesis System For Soccer Broadcasts
ASIAGRAPH 2008 The Intermediate View Synthesis System For Soccer Broadcasts Songkran Jarusirisawad, Kunihiko Hayashi, Hideo Saito (Keio Univ.), Naho Inamoto (SGI Japan Ltd.), Tetsuya Kawamoto (Chukyo Television
More informationarxiv: v1 [cs.cv] 16 Aug 2016
arxiv:1608.04642v1 [cs.cv] 16 Aug 2016 Temporally Consistent Motion Segmentation rom RGB-D Video P. Bertholet 1, A. Ichim 2, M. Zwicker 1 1 University o Bern, Switzerland 2 École polytechnique édérale
More informationEye tracking assisted extraction of attentionally important objects from videos
Eye tracking assisted extraction o attentionally important objects rom videos S. Karthikeyan, Thuyen Ngo, Miguel Eckstein, B.S. Manjunath Department o Electrical and Computer Engineering Department o Psychological
More informationA Novel Stereo Camera System by a Biprism
528 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 16, NO. 5, OCTOBER 2000 A Novel Stereo Camera System by a Biprism DooHyun Lee and InSo Kweon, Member, IEEE Abstract In this paper, we propose a novel
More informationOcclusion Detection of Real Objects using Contour Based Stereo Matching
Occlusion Detection of Real Objects using Contour Based Stereo Matching Kenichi Hayashi, Hirokazu Kato, Shogo Nishida Graduate School of Engineering Science, Osaka University,1-3 Machikaneyama-cho, Toyonaka,
More informationClassifier Evasion: Models and Open Problems
Classiier Evasion: Models and Open Problems Blaine Nelson 1, Benjamin I. P. Rubinstein 2, Ling Huang 3, Anthony D. Joseph 1,3, and J. D. Tygar 1 1 UC Berkeley 2 Microsot Research 3 Intel Labs Berkeley
More informationModel-Based Face Computation
Model-Based Face Computation 1. Research Team Project Leader: Post Doc(s): Graduate Students: Prof. Ulrich Neumann, IMSC and Computer Science John P. Lewis Hea-juen Hwang, Zhenyao Mo, Gordon Thomas 2.
More informationSection II. Nios II Software Development
Section II. Nios II Sotware Development This section o the Embedded Design Handbook describes how to most eectively use the Altera tools or embedded system sotware development, and recommends design styles
More informationOcclusion Robust Multi-Camera Face Tracking
Occlusion Robust Multi-Camera Face Tracking Josh Harguess, Changbo Hu, J. K. Aggarwal Computer & Vision Research Center / Department of ECE The University of Texas at Austin harguess@utexas.edu, changbo.hu@gmail.com,
More informationA Bayesian Framework for Real-Time 3D Hand Tracking in High Clutter Background
A Bayesian Framework for Real-Time 3D Hand Tracking in High Clutter Background Hanning Zhou, Thomas S. Huang University of Illinois at Urbana-Champaign 45 N. Mathews, Urbana, IL 6181, U.S.A hzhou,huang@ifp.uiuc.edu
More informationBinary Morphological Model in Refining Local Fitting Active Contour in Segmenting Weak/Missing Edges
0 International Conerence on Advanced Computer Science Applications and Technologies Binary Morphological Model in Reining Local Fitting Active Contour in Segmenting Weak/Missing Edges Norshaliza Kamaruddin,
More informationUsing a Projected Subgradient Method to Solve a Constrained Optimization Problem for Separating an Arbitrary Set of Points into Uniform Segments
Using a Projected Subgradient Method to Solve a Constrained Optimization Problem or Separating an Arbitrary Set o Points into Uniorm Segments Michael Johnson May 31, 2011 1 Background Inormation The Airborne
More informationDynamic Shape Tracking via Region Matching
Dynamic Shape Tracking via Region Matching Ganesh Sundaramoorthi Asst. Professor of EE and AMCS KAUST (Joint work with Yanchao Yang) The Problem: Shape Tracking Given: exact object segmentation in frame1
More informationUnsupervised Human Members Tracking Based on an Silhouette Detection and Analysis Scheme
Unsupervised Human Members Tracking Based on an Silhouette Detection and Analysis Scheme Costas Panagiotakis and Anastasios Doulamis Abstract In this paper, an unsupervised, automatic video human members(human
More information3D Modeling of Objects Using Laser Scanning
1 3D Modeling of Objects Using Laser Scanning D. Jaya Deepu, LPU University, Punjab, India Email: Jaideepudadi@gmail.com Abstract: In the last few decades, constructing accurate three-dimensional models
More informationAutomated Planning for Feature Model Configuration based on Functional and Non-Functional Requirements
Automated Planning or Feature Model Coniguration based on Functional and Non-Functional Requirements Samaneh Soltani 1, Mohsen Asadi 1, Dragan Gašević 2, Marek Hatala 1, Ebrahim Bagheri 2 1 Simon Fraser
More informationFingertips Tracking based on Gradient Vector
Int. J. Advance Soft Compu. Appl, Vol. 7, No. 3, November 2015 ISSN 2074-8523 Fingertips Tracking based on Gradient Vector Ahmad Yahya Dawod 1, Md Jan Nordin 1, and Junaidi Abdullah 2 1 Pattern Recognition
More informationObject Tracking with Dynamic Feature Graph
Object Tracking with Dynamic Feature Graph Feng Tang and Hai Tao Department o Computer Engineering, University o Caliornia, Santa Cruz {tang,tao}@soe.ucsc.edu Abstract Two major problems or model-based
More informationTERRAIN-ADAPTIVE GENERATION OF OPTIMAL CONTINUOUS TRAJECTORIES FOR MOBILE ROBOTS
ERRAIN-ADAPIVE GENERAION OF OPIMAL CONINUOUS RAJECORIES FOR MOBILE ROBOS homas M. Howard (1, Alonzo Kelly ( (1 Carnegie Mellon University, Robotics Institute, 5 Forbes Ave., Pittsburgh, PA 1513, USA, thoward@cs.cmu.edu
More informationVisual Tracking of Human Body with Deforming Motion and Shape Average
Visual Tracking of Human Body with Deforming Motion and Shape Average Alessandro Bissacco UCLA Computer Science Los Angeles, CA 90095 bissacco@cs.ucla.edu UCLA CSD-TR # 020046 Abstract In this work we
More informationIntelligent knowledge-based system for the automated screwing process control
Intelligent knowledge-based system or the automated screwing process control YULIYA LEBEDYNSKA yuliya.lebedynska@tu-cottbus.de ULRICH BERGER Chair o automation Brandenburg University o Technology Cottbus
More informationVehicle Occupant Posture Analysis Using Voxel Data
Ninth World Congress on Intelligent Transport Systems, Chicago, Illinois, October Vehicle Occupant Posture Analysis Using Voxel Data Ivana Mikic, Mohan Trivedi Computer Vision and Robotics Research Laboratory
More informationContinuous Multi-View Tracking using Tensor Voting
Continuous Multi-View Tracking using Tensor Voting Jinman Kang, Isaac Cohen and Gerard Medioni Institute for Robotics and Intelligent Systems University of Southern California {jinmanka, icohen, medioni}@iris.usc.edu
More information2 DETERMINING THE VANISHING POINT LOCA- TIONS
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL.??, NO.??, DATE 1 Equidistant Fish-Eye Calibration and Rectiication by Vanishing Point Extraction Abstract In this paper we describe
More informationFeature Tracking Evaluation for Pose Estimation in Underwater Environments
Feature Tracking Evaluation or Pose Estimation in Underwater Environments Florian Shkurti, Ioannis Rekleitis, and Gregory Dudek School o Computer Science McGill University, Montreal, QC, Canada {lorian,
More informationMulti-camera Tracking of Articulated Human Motion Using Motion and Shape Cues
Multi-camera Tracking of Articulated Human Motion Using Motion and Shape Cues Aravind Sundaresan and Rama Chellappa Department of Electrical and Computer Engineering, University of Maryland, College Park,
More informationAutomatic mesh generation for LES in complex geometries
Center or Turbulence Research Annual Research Bries 2005 19 Automatic mesh generation or LES in complex geometries By G. Iaccarino AND F. Ham 1. Motivation and objectives Immersed Boundary (IB) methods
More informationBalanced Multiresolution for Symmetric/Antisymmetric Filters
Balanced Multiresolution or Symmetric/Antisymmetric Filters Mahmudul Hasan Faramarz F. Samavati Mario C. Sousa Department o Computer Science University o Calgary Alberta Canada {mhasan samavati smcosta}@ucalgary.ca
More informationShape Descriptor using Polar Plot for Shape Recognition.
Shape Descriptor using Polar Plot for Shape Recognition. Brijesh Pillai ECE Graduate Student, Clemson University bpillai@clemson.edu Abstract : This paper presents my work on computing shape models that
More informationEstimating 3D Hand Pose from a Cluttered Image
Boston University Computer Science Tech. Report No. 2003-009, April 1, 2003. To appear in Proc. IEEE CVPR, June 2003. Estimating 3D Hand Pose from a Cluttered Image Vassilis Athitsos and Stan Sclaroff
More informationA Classification System and Analysis for Aspect-Oriented Programs
A Classiication System and Analysis or Aspect-Oriented Programs Martin Rinard, Alexandru Sălcianu, and Suhabe Bugrara Massachusetts Institute o Technology Cambridge, MA 02139 ABSTRACT We present a new
More informationTorque-Position Transformer for Task Control of Position Controlled Robots
28 IEEE International Conference on Robotics and Automation Pasadena, CA, USA, May 19-23, 28 Torque-Position Transformer for Task Control of Position Controlled Robots Oussama Khatib, 1 Peter Thaulad,
More information