Dynamic Human Shape Description and Characterization
|
|
- Clarissa Reed
- 6 years ago
- Views:
Transcription
1 Dynamic Human Shape Description and Characterization Z. Cheng*, S. Mosher, Jeanne Smith H. Cheng, and K. Robinette Infoscitex Corporation, Dayton, Ohio, USA 711 th Human Performance Wing, Air Force Research Laboratory, Dayton, Ohio, USA Abstract Dynamic human shape description and characterization was investigated in this paper. The dynamic shapes of a subject in four activities (jogging, limping, shooting, and walking) were generated via 3-D motion replication. The Paquet Shape Descriptor (PSD) was used to describe the shape of the subject in each frame. The unique features of dynamic human shapes were revealed from the observations of the 3-D plots of PSDs. The principal component analysis was performed on the calculated PSDs and principal components (PCs) were used to characterize the PSDs. The PSD calculation was then reasonably approximated by its first few projections in the eigenspace formed by PCs and represented by the corresponding projection coefficients. As such, the dynamic human shapes for each activity were described by these projection coefficients. Based on projection coefficients, data mining technology was employed for activity classification. Case studies were performed to validate the methodology developed. Keywords: Human Modeling, Dynamic Shape, Shape Descriptor, Principal Component Analysis, Activity Recognition 1. Introduction While a human is moving or performing an action, his body shape is changing dynamically. In other words, the shape change and motion are tied together during a human action (activity). However, human shape and motion are often treated separately in activity recognition. The shape dynamics describe the spatial-temporal shape deformation of an object during its movement and thus provide important information about the identity of a subject and the motions performed by the subject (Jin and Mokhtarian, 26). A few researchers utilized shape dynamics for human activity recognition. In (Kilner et al, 29), the authors addressed the problem of human action matching in outdoor sports broadcast environments by analyzing 3-D data from a recorded human activity and retrieving the most appropriate proxy action from a motion capture library. In (Niebles and Li 27), a video sequence was represented as a collection of spatial and spatial-temporal features by extracting static and dynamic interest points; then a hierarchical model was proposed that can be characterized as a constellation of bags-of-features, both spatial and temporal. In (Jin and Mokhtarian 26), a system was proposed for recognizing object motions based on their shape dynamics. The spatial-temporal shape deformation in motions was captured by hidden Markov models. In (Blank et al 25), human action in video sequences was seen as silhouettes of a moving torso and protruding limbs undergoing articulated motion. Human actions were regarded as three dimensional shapes induced by the silhouettes in the space-time volume. Dynamic human shapes can be described by a dynamic 3-D human shape model which, in turn, can be extracted from 2-D video imagery or 3-D sensor data or created by 3-D replication/animation. A dynamic 3-D shape model usually contains tens of thousands of graphic elements (vertices or polygons). In order to use the information coded in dynamic shapes for human identification and activity recognition, it is necessary to find an effective method for dynamic shape description and characterization. 2. Dynamic Shape Creation Since the technologies that are capable of capturing 3-D dynamic shapes of a subject during motion are still very limited in terms of their maturity and availability, there is very little data available at this time for human dynamic shapes. However, as a motion capture system can be used to capture human motion and a laser scanner can be used to *Corresponding author. Zhiqing.cheng@wpafb.af.mil 1
2 capture human body shape, various techniques have been developed to replicate/animate human motion in a 3-D space, thus generating dynamic shapes of a subject in an action. In this paper, Blender ( an open source software tool was used to animate the motion of a human subject in a 3-D space during four different activities. The four activities were walking, jogging, limping and shooting. The data that were used as a basis for the animation were acquired in the Human Signatures Laboratory of the US Air Force, including scan data and motion capture (MoCap) data. The human subject, with markers attached, was scanned using the Cyberware whole body scanner. Motion capture data were acquired for the same subject with the same markers attached. The markers allowed the joint centers to be determined for both the scan and the MoCap data. The scan was imported into Blender and the joint centers were used to define the skeleton in BVH (Bio-vision Hierarchical) file format. Euler angles for the different body segments were computed from the joint centers and other markers and used to set up BVH files for the four different activities. The BVH files were imported into Blender and used to animate the whole body scan of the subject. Figure 1 shows the images captured from the animation within Blender for the four activities. From Blender animation, a 3-D mesh can be output at each frame of motion, as shown in Fig. 2 for limping, which can be used to represent the 3-D dynamic body shape of the subject at this instant of motion. Thus, the output of the 3-D mesh in each frame can be used as the simulation data of dynamic human shapes for training the algorithms developed for activity recognition. 3. Dynamic Shape Description and Characterization Dynamic shapes shown in Figs. 1 and 2 are represented by 3-D meshes. Each mesh may contain as many as tens of thousands of graphical elements (vertices or polygons). It is not feasible to use the vertices or polygons directly for the analysis of human shape dynamics. One way to effectively describe dynamic shapes and to enable further analysis is by using a shape descriptor (Cohen & Li 23; Chu & Cohen 25). In this paper, the Paquet Shape Descriptor (PSD) (Paquet et al 2; Robinette 23) with certain modifications is used to describe dynamic shapes and to analyze shape dynamics. As illustrated in Fig. 3, the PSD uses 12 bins (discrete parameters) to characterize shape variation. Among these 12 bins, 4 are related to the radius r, 4 to the first angle (cos(θ)), and 4 to the second angle (cos(δ)). The details of the PSD calculation are omitted here. The 3-D plots of the time histories of PSD for four activities are illustrated in Fig. 4 where the first 4 bins corresponding to radius are show on the top, the second 4 bins of cos(θ) in the middle, and the last 4 bins of cos(δ) at the bottom. Figure 1. Replication of a subject in four activities: limping, jogging, shooting, and walking. Figure 2. Dynamics shapes of a subject during limping. Example Cord (,,) P1 θ ) δ P3 r P2 Chest Left Arm Figure 3. Paquet shape descriptor and its coordinate system. By visually looking at these plots, one can find that: The variation of each bin over time is different: the variations of some bins over time are larger and significant, but others are not. Periodic features are exhibited by the plots for the activities of jogging, limping, and walking. The 3-D plot for each activity is unique. There are visible and significant differences among the plots for four activities. These observations from the PSD reveal some unique features of shape dynamics. However, directly using PSD to analyze shape dynamics is still not feasible, since it has 12 bins (variables) which form a space of 12-dimension. Further treatment becomes necessary to characterize the shape descriptor and to reduce the dimension of the problem space. 2
3 Figure 4. The time histories of 12 bins of PSD for four activities 3
4 Magnitude Magnitude Magnitude Magnitude Z. Cheng, Dynamic Human Shape Description and Characterization Therefore, the principal component analysis (PCA) is used to characterize the high-dimensional space defined by the PSD. Denote T p p p p }, (1) ijk { ijk as the PSD shape descriptor for the i-th subject in j- th activity at k-th frame. For the data collected, denote P { pijk }, i 1,..., I; j 1,..., J; k 1,..., K. (2) where I represents the number of subjects, J is the number of actions, and K is the number of frames for each action. However note that the number of activities that each subject performs can be different and the number of frames for each activity can be different also. By performing PCA of P one can find the principal components that characterize the space defined by the shape descriptor. In this paper, dynamic shapes were created for the four activities at the frame rate of.2 /s, with 85 frames for jogging, 352 frames for limping, 554 frames for shooting, and 227 frames for walking. The percentage of variance of each principal component (PC) is shown in Fig. 5, and the first four PCs are show in Fig. 6. The original PSD vector can be projected onto the space (eigenspace) formed by PCs, that is, it can be expanded in terms of PCs. As shown in Fig. 5, among all 12 PCs, only the first 1~2 are significant. This means that the original PSD can be reasonably approximated by its first few projections in the eigenspace and represented by the projection coefficients corresponding to these significant PCs. Figure 7 illustrates the time histories of the first and second projection coefficients for four activities. Figure 5. Percentage of variance of each principal component Principal Component 1 Principal Component Principal Component 3 Principal Component Figure 6. First four principal components of PSD. 4
5 Z. Cheng, Dynamic Human Shape Description and Characterization jog1 Principal component 1 jog1 Principal component limp1 Principal component 1 limp1 Principal component shoot1 Principal component 1 shoot1 Principal component walk1 Principal component 1 walk1 Principal component Figure 7. Time histories of the first and second projection coefficients for four activities. Denote W v v v }, (3) M where { 1 2 M v m is the m-th principal component (eigenvector) of P. The original observations (data) can be projected onto the space defined by W, that is, T T YM P W, (4) M Where YM Y[ M, N] is the matrix of projection coefficients, each column of which corresponds to each original record, M is the dimension of a shape descriptor (M=12 for PSD), and N is the number of total shapes observed (N=1218 for the case of this paper). From Fig. 5 we can see that among the total of 12 principal components, the significant ones are less than 2. This means that instead of using the full space of dimension of M, one can construct a new space with only the significant principal components, that is, WL { v1 v2 vl}, L M, (5) which would substantially reduce the dimension of the space. As for the case investigated in this paper, 5
6 L 2, which is much less than M 12. Then the projection in this space is given by T T YL P W, (6) L where YL : Y[ L, N]. Each original record can be either fully reconstructed by Eq. (4) or partially reconstructed (approximated) by Eq. (6). Usually an original record can be well approximated by its partial construction with significant principal components. This means that the original data with dimension of M can be represented by its projection coefficients with dimension of L ( L M ). In the space of reduced dimension, the problem becomes tractable, as the number of variables becomes much smaller. In fact, for the case in this paper, the two projection coefficients corresponding to the first two most significant principal components are sufficient to represent the shape dynamics for action recognition. The sequence of a projection coefficient at each frame for a particular subject in a particular action constitutes a time series, as shown in Fig. 7 for example. It is shown that the time histories of the first and second coefficient are unique with respect to each action, which can be used as the discriminators for activity recognition. 4. Activity Recognition Based on Shape Dynamics The shape dynamics of a subject during motion, as described in Section 3, can be used for activity recognition. In this paper, a data mining tool was employed to classify four activities (jog, limp, shoot, walk) based on 85 frames from each activity. Note that in the classification, each frame was treated independently rather than being placed in sequence as a time series. Five attributes were used in classification: (a) Pelvis_Velocity, the resultant velocity at the mid-pelvis location; (b) PC1, the first projection coefficient; (c) PC2, the second projection coefficient; (d) PC1_Velocity, the derivative of PC1; and (e) PC2_Velocity, the derivative of PC2. The significance of each attribute can be assessed in terms of gain ratio as given in Table 1. While Pelvis_Velocity is most significant, all five attributes are selected for classification. Various classification methods are available, such as those provided by Weka Among them, five conventional methods listed in Table 2 were chosen to use in the case study. All of them achieved classification accuracy greater than 95%, as shown in Table 2. Table 1. Attributes ranking results Table 2. Classification accuracy 5. Conclusion Based on the study of this paper, the following conclusions are in order. Shape dynamics contain the information about both body motion and shape changes and have great potential for human identification and activity recognition. Shape dynamics can be well-captured by a shape descriptor and further characterized by principal components. Human motion/action in 3-D space can be replicated or animated with high bio-fidelity, 6
7 which can be used to generate the data for training a model or to evaluate the performance of a tool. Using a dynamic 3-D human shape model for human activity recognition is plausible. This approach is unique as it differs from other conventional techniques based on 2-D imagery or models. It is effective as it can overcome the shortcomings inherent in 2-D methods. As a shape descriptor, the PSD is not reversible. This means that while it can be used for analysis, as it was used in this paper, it cannot be used for shape reconstruction. Also, spatial information may not be uniquely represented in the original definition of the PSD, which can be remedied by certain treatments or modifications. 18th International Conference on Pattern Recognition (ICPR'6). Kilner J, Guillemaut J-Y, and Hilton A, D Action Matching with Key-Pose Detection. In: 29 IEEE 12th International Conference on Computer Vision Workshops. Niebles J-C and Li F-F, 27. A Hierarchical Model of Shape and Appearance for Human Action Classification. In: IEEE Computer Vision and Pattern Recognition (CVPR 27). Paquet E, Rioux M, Murching A, Naveen T, and Tabatabai A, 2. Description of shape information for 2-D and 3-D objects. Signal Processing: Image Communication 16 (2), pp It should be pointed out that the dynamic shape models used in this study were created from 3-D surface scan data and motion capture data using OpenSim and Blender. While these models provide high biofidelic description of body shape during motion, the body surface deformation may not be fully or accurately represented by these models. However, since the body shape variation induced by the articulated motion is much larger than the surface deformation, most observations and results from this paper can be reasonably postulated to be true even if the surface deformation is more precisely represented. More investigations are needed to validate this assumption. Robinette K, 23. An Investigation of 3-D Anthropometric Shape Descriptors for Database Mining. Ph.D. Thesis, University of Cincinnati. Acknowledgement This study was carried out under the support of a SBIR Phase I funding (FA865-1-M-692) provided by the US Air Force. References Blank M, Gorelick L, Shechtman E, Irani M, and Basri R, 25. Actions as Space-Time Shapes. In: Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV 5). Cohen I and Li H, 23. Inference of Human Posture by Classification of 3-D Human Body Shape, IEEE International Workshop on Analysis and Modeling of Faces and Gestures, ICCV 23. Chu C-W and Cohen I, 25. Posture and Gesture Recognition using 3-D Body Shapes Decomposition. In: Proceedings of the 25 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 5). Jin N and Mokhtarian F, 26. A Non-Parametric HMM Learning Method for Shape Dynamics with Application to Human Motion Recognition. In: The 7
From 3-D Scans to Design Tools
From 3-D Scans to Design Tools Chang SHU* a, Pengcheng XI a, Stefanie WUHRER b a National Research Council, Ottawa, Canada; b Saarland University, Saarbrücken, Germany http://dx.doi.org/10.15221/13.151
More information3D Human Motion Analysis and Manifolds
D E P A R T M E N T O F C O M P U T E R S C I E N C E U N I V E R S I T Y O F C O P E N H A G E N 3D Human Motion Analysis and Manifolds Kim Steenstrup Pedersen DIKU Image group and E-Science center Motivation
More informationCombined Shape Analysis of Human Poses and Motion Units for Action Segmentation and Recognition
Combined Shape Analysis of Human Poses and Motion Units for Action Segmentation and Recognition Maxime Devanne 1,2, Hazem Wannous 1, Stefano Berretti 2, Pietro Pala 2, Mohamed Daoudi 1, and Alberto Del
More informationLecture 18: Human Motion Recognition
Lecture 18: Human Motion Recognition Professor Fei Fei Li Stanford Vision Lab 1 What we will learn today? Introduction Motion classification using template matching Motion classification i using spatio
More informationBody Trunk Shape Estimation from Silhouettes by Using Homologous Human Body Model
Body Trunk Shape Estimation from Silhouettes by Using Homologous Human Body Model Shunta Saito* a, Makiko Kochi b, Masaaki Mochimaru b, Yoshimitsu Aoki a a Keio University, Yokohama, Kanagawa, Japan; b
More informationInternal Organ Modeling and Human Activity Analysis
Internal Organ Modeling and Human Activity Analysis Dimitris Metaxas dnm@cs.rutgers.edu CBIM Center Division of Computer and Information Sciences Rutgers University 3D Motion Reconstruction and Analysis
More informationDiscriminative human action recognition using pairwise CSP classifiers
Discriminative human action recognition using pairwise CSP classifiers Ronald Poppe and Mannes Poel University of Twente, Dept. of Computer Science, Human Media Interaction Group P.O. Box 217, 7500 AE
More informationHuman Upper Body Pose Estimation in Static Images
1. Research Team Human Upper Body Pose Estimation in Static Images Project Leader: Graduate Students: Prof. Isaac Cohen, Computer Science Mun Wai Lee 2. Statement of Project Goals This goal of this project
More informationA three-dimensional shape database from a large-scale anthropometric survey
A three-dimensional shape database from a large-scale anthropometric survey Peng Li, Brian Corner, Jeremy Carson, Steven Paquette US Army Natick Soldier Research Development & Engineering Center, Natick,
More informationA Dynamic Human Model using Hybrid 2D-3D Representations in Hierarchical PCA Space
A Dynamic Human Model using Hybrid 2D-3D Representations in Hierarchical PCA Space Eng-Jon Ong and Shaogang Gong Department of Computer Science, Queen Mary and Westfield College, London E1 4NS, UK fongej
More informationof human activities. Our research is motivated by considerations of a ground-based mobile surveillance system that monitors an extended area for
To Appear in ACCV-98, Mumbai-India, Material Subject to ACCV Copy-Rights Visual Surveillance of Human Activity Larry Davis 1 Sandor Fejes 1 David Harwood 1 Yaser Yacoob 1 Ismail Hariatoglu 1 Michael J.
More informationShort Survey on Static Hand Gesture Recognition
Short Survey on Static Hand Gesture Recognition Huu-Hung Huynh University of Science and Technology The University of Danang, Vietnam Duc-Hoang Vo University of Science and Technology The University of
More informationObject and Action Detection from a Single Example
Object and Action Detection from a Single Example Peyman Milanfar* EE Department University of California, Santa Cruz *Joint work with Hae Jong Seo AFOSR Program Review, June 4-5, 29 Take a look at this:
More informationBIOFIDELIC HUMAN ACTIVITY MODELING AND SIMULATION WITH LARGE VARIABILITY. John Camp Darrell Lochtefeld Human Signatures Branch
AFRL-RH-WP-TR-2014-0137 BIOFIDELIC HUMAN ACTIVITY MODELING AND SIMULATION WITH LARGE VARIABILITY John Camp Darrell Lochtefeld Human Signatures Branch Zhiqing Cheng Isiah Davenport Tim MtCastle Steve Mosher
More informationLecture 8 Object Descriptors
Lecture 8 Object Descriptors Azadeh Fakhrzadeh Centre for Image Analysis Swedish University of Agricultural Sciences Uppsala University 2 Reading instructions Chapter 11.1 11.4 in G-W Azadeh Fakhrzadeh
More informationA Validation Study of a Kinect Based Body Imaging (KBI) Device System Based on ISO 20685:2010
A Validation Study of a Kinect Based Body Imaging (KBI) Device System Based on ISO 20685:2010 Sara BRAGANÇA* 1, Miguel CARVALHO 1, Bugao XU 2, Pedro AREZES 1, Susan ASHDOWN 3 1 University of Minho, Portugal;
More informationLOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM
LOCAL APPEARANCE BASED FACE RECOGNITION USING DISCRETE COSINE TRANSFORM Hazim Kemal Ekenel, Rainer Stiefelhagen Interactive Systems Labs, University of Karlsruhe Am Fasanengarten 5, 76131, Karlsruhe, Germany
More informationPredicting 3D People from 2D Pictures
Predicting 3D People from 2D Pictures Leonid Sigal Michael J. Black Department of Computer Science Brown University http://www.cs.brown.edu/people/ls/ CIAR Summer School August 15-20, 2006 Leonid Sigal
More informationHuman Action Recognition Using Dynamic Time Warping and Voting Algorithm (1)
VNU Journal of Science: Comp. Science & Com. Eng., Vol. 30, No. 3 (2014) 22-30 Human Action Recognition Using Dynamic Time Warping and Voting Algorithm (1) Pham Chinh Huu *, Le Quoc Khanh, Le Thanh Ha
More informationFully Automatic Methodology for Human Action Recognition Incorporating Dynamic Information
Fully Automatic Methodology for Human Action Recognition Incorporating Dynamic Information Ana González, Marcos Ortega Hortas, and Manuel G. Penedo University of A Coruña, VARPA group, A Coruña 15071,
More informationLearning Human Motion Models from Unsegmented Videos
In IEEE International Conference on Pattern Recognition (CVPR), pages 1-7, Alaska, June 2008. Learning Human Motion Models from Unsegmented Videos Roman Filipovych Eraldo Ribeiro Computer Vision and Bio-Inspired
More informationSTOP: Space-Time Occupancy Patterns for 3D Action Recognition from Depth Map Sequences
STOP: Space-Time Occupancy Patterns for 3D Action Recognition from Depth Map Sequences Antonio W. Vieira 1,2,EricksonR.Nascimento 1, Gabriel L. Oliveira 1, Zicheng Liu 3,andMarioF.M.Campos 1, 1 DCC - Universidade
More informationPrincipal motion: PCA-based reconstruction of motion histograms
Principal motion: PCA-based reconstruction of motion histograms Hugo Jair Escalante a and Isabelle Guyon b a INAOE, Puebla, 72840, Mexico, b CLOPINET, Berkeley, CA 94708, USA http://chalearn.org May 2012
More informationGame Programming. Bing-Yu Chen National Taiwan University
Game Programming Bing-Yu Chen National Taiwan University Character Motion Hierarchical Modeling Character Animation Motion Editing 1 Hierarchical Modeling Connected primitives 2 3D Example: A robot arm
More informationPart I: HumanEva-I dataset and evaluation metrics
Part I: HumanEva-I dataset and evaluation metrics Leonid Sigal Michael J. Black Department of Computer Science Brown University http://www.cs.brown.edu/people/ls/ http://vision.cs.brown.edu/humaneva/ Motivation
More informationColorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.
Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Statistical Models for Shape and Appearance Note some material for these slides came from Algorithms
More informationCreating Custom Human Avatars for Ergonomic Analysis using Depth Cameras
Creating Custom Human Avatars for Ergonomic Analysis using Depth Cameras Matthew P. Reed, Byoung-Keon Park, K. Han Kim University of Michigan Transportation Research Institute Ulrich Raschke Siemens PLM
More informationTask analysis based on observing hands and objects by vision
Task analysis based on observing hands and objects by vision Yoshihiro SATO Keni Bernardin Hiroshi KIMURA Katsushi IKEUCHI Univ. of Electro-Communications Univ. of Karlsruhe Univ. of Tokyo Abstract In
More information3D Tracking for Gait Characterization and Recognition
3D Tracking for Gait Characterization and Recognition Raquel Urtasun and Pascal Fua Computer Vision Laboratory EPFL Lausanne, Switzerland raquel.urtasun, pascal.fua@epfl.ch Abstract We propose an approach
More informationRigging / Skinning. based on Taku Komura, Jehee Lee and Charles B.Own's slides
Rigging / Skinning based on Taku Komura, Jehee Lee and Charles B.Own's slides Skeletal Animation Victoria 2 CSE 872 Dr. Charles B. Owen Advanced Computer Graphics Skinning http://www.youtube.com/watch?
More informationNon-rigid body Object Tracking using Fuzzy Neural System based on Multiple ROIs and Adaptive Motion Frame Method
Proceedings of the 2009 IEEE International Conference on Systems, Man, and Cybernetics San Antonio, TX, USA - October 2009 Non-rigid body Object Tracking using Fuzzy Neural System based on Multiple ROIs
More informationHuman Action Recognition Using Independent Component Analysis
Human Action Recognition Using Independent Component Analysis Masaki Yamazaki, Yen-Wei Chen and Gang Xu Department of Media echnology Ritsumeikan University 1-1-1 Nojihigashi, Kusatsu, Shiga, 525-8577,
More informationGRAPH-BASED APPROACH FOR MOTION CAPTURE DATA REPRESENTATION AND ANALYSIS. Jiun-Yu Kao, Antonio Ortega, Shrikanth S. Narayanan
GRAPH-BASED APPROACH FOR MOTION CAPTURE DATA REPRESENTATION AND ANALYSIS Jiun-Yu Kao, Antonio Ortega, Shrikanth S. Narayanan University of Southern California Department of Electrical Engineering ABSTRACT
More informationA Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras
A Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras Abstract Byoung-Keon D. PARK*, Matthew P. REED University of Michigan, Transportation Research Institute,
More informationCOSC160: Detection and Classification. Jeremy Bolton, PhD Assistant Teaching Professor
COSC160: Detection and Classification Jeremy Bolton, PhD Assistant Teaching Professor Outline I. Problem I. Strategies II. Features for training III. Using spatial information? IV. Reducing dimensionality
More informationStatistical Learning of Human Body through Feature Wireframe
Statistical Learning of Human Body through Feature Wireframe Jida HUANG 1, Tsz-Ho KWOK 2*, Chi ZHOU 1 1 Industrial and Systems Engineering, University at Buffalo, SUNY, Buffalo NY, USA; 2 Mechanical, Industrial
More informationHuman Activity Recognition Using Multidimensional Indexing
Human Activity Recognition Using Multidimensional Indexing By J. Ben-Arie, Z. Wang, P. Pandit, S. Rajaram, IEEE PAMI August 2002 H. Ertan Cetingul, 07/20/2006 Abstract Human activity recognition from a
More informationEigenJoints-based Action Recognition Using Naïve-Bayes-Nearest-Neighbor
EigenJoints-based Action Recognition Using Naïve-Bayes-Nearest-Neighbor Xiaodong Yang and YingLi Tian Department of Electrical Engineering The City College of New York, CUNY {xyang02, ytian}@ccny.cuny.edu
More informationVisual Learning and Recognition of 3D Objects from Appearance
Visual Learning and Recognition of 3D Objects from Appearance (H. Murase and S. Nayar, "Visual Learning and Recognition of 3D Objects from Appearance", International Journal of Computer Vision, vol. 14,
More information3D Mesh Sequence Compression Using Thin-plate Spline based Prediction
Appl. Math. Inf. Sci. 10, No. 4, 1603-1608 (2016) 1603 Applied Mathematics & Information Sciences An International Journal http://dx.doi.org/10.18576/amis/100440 3D Mesh Sequence Compression Using Thin-plate
More informationAn Adaptive Eigenshape Model
An Adaptive Eigenshape Model Adam Baumberg and David Hogg School of Computer Studies University of Leeds, Leeds LS2 9JT, U.K. amb@scs.leeds.ac.uk Abstract There has been a great deal of recent interest
More informationEpitomic Analysis of Human Motion
Epitomic Analysis of Human Motion Wooyoung Kim James M. Rehg Department of Computer Science Georgia Institute of Technology Atlanta, GA 30332 {wooyoung, rehg}@cc.gatech.edu Abstract Epitomic analysis is
More informationEXPANDED ACCOMMODATION ANALYSIS AND RAPID PROTOTYPING TECHNIQUE FOR THE DESIGN OF A CREW STATION COCKPIT
ICAS 2002 CONGRESS EXPANDED ACCOMMODATION ANALYSIS AND RAPID PROTOTYPING TECHNIQUE FOR THE DESIGN OF A CREW STATION COCKPIT Edward Winkler 1, Landon Onyebueke 2, and Olusesan Ameye 2. 1 The Boeing Company
More informationHuman Activity Recognition Using a Dynamic Texture Based Method
Human Activity Recognition Using a Dynamic Texture Based Method Vili Kellokumpu, Guoying Zhao and Matti Pietikäinen Machine Vision Group University of Oulu, P.O. Box 4500, Finland {kello,gyzhao,mkp}@ee.oulu.fi
More informationAnnotation of Human Motion Capture Data using Conditional Random Fields
Annotation of Human Motion Capture Data using Conditional Random Fields Mert Değirmenci Department of Computer Engineering, Middle East Technical University, Turkey mert.degirmenci@ceng.metu.edu.tr Anıl
More informationSCAPE: Shape Completion and Animation of People
SCAPE: Shape Completion and Animation of People By Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, James Davis From SIGGRAPH 2005 Presentation for CS468 by Emilio Antúnez
More informationRecognition of Human Body Movements Trajectory Based on the Three-dimensional Depth Data
Preprints of the 19th World Congress The International Federation of Automatic Control Recognition of Human Body s Trajectory Based on the Three-dimensional Depth Data Zheng Chang Qing Shen Xiaojuan Ban
More informationProbabilistic Tracking and Reconstruction of 3D Human Motion in Monocular Video Sequences
Probabilistic Tracking and Reconstruction of 3D Human Motion in Monocular Video Sequences Presentation of the thesis work of: Hedvig Sidenbladh, KTH Thesis opponent: Prof. Bill Freeman, MIT Thesis supervisors
More informationStatic Gesture Recognition with Restricted Boltzmann Machines
Static Gesture Recognition with Restricted Boltzmann Machines Peter O Donovan Department of Computer Science, University of Toronto 6 Kings College Rd, M5S 3G4, Canada odonovan@dgp.toronto.edu Abstract
More informationEvaluating Example-based Pose Estimation: Experiments on the HumanEva Sets
Evaluating Example-based Pose Estimation: Experiments on the HumanEva Sets Ronald Poppe Human Media Interaction Group, Department of Computer Science University of Twente, Enschede, The Netherlands poppe@ewi.utwente.nl
More informationGait-based person identification method using shadow biometrics for robustness to changes in the walking direction
2015 IEEE Winter Conference on Applications of Computer Vision Gait-based person identification method using shadow biometrics for robustness to changes in the walking direction Makoto Shinzaki 1, Yumi
More information3D Gait Recognition Using Spatio-Temporal Motion Descriptors
3D Gait Recognition Using Spatio-Temporal Motion Descriptors Bogdan Kwolek 1, Tomasz Krzeszowski 3, Agnieszka Michalczuk 2, Henryk Josinski 2 1 AGH University of Science and Technology 30 Mickiewicza Av.,
More informationMULTIVARIATE TEXTURE DISCRIMINATION USING A PRINCIPAL GEODESIC CLASSIFIER
MULTIVARIATE TEXTURE DISCRIMINATION USING A PRINCIPAL GEODESIC CLASSIFIER A.Shabbir 1, 2 and G.Verdoolaege 1, 3 1 Department of Applied Physics, Ghent University, B-9000 Ghent, Belgium 2 Max Planck Institute
More informationRecognizing Human Activities in Video by Multi-resolutional Optical Flows
Recognizing Human Activities in Video by Multi-resolutional Optical Flows Toru Nakata Digital Human Research Center, National Institute of Advanced Industrial Science and Technology (AIST). Also Core Research
More informationA Hierarchical Model of Shape and Appearance for Human Action Classification
A Hierarchical Model of Shape and Appearance for Human Action Classification Juan Carlos Niebles Universidad del Norte, Colombia University of Illinois at Urbana-Champaign, USA jnieble2@uiuc.edu Li Fei-Fei
More informationHuman Action Recognition Using Silhouette Histogram
Human Action Recognition Using Silhouette Histogram Chaur-Heh Hsieh, *Ping S. Huang, and Ming-Da Tang Department of Computer and Communication Engineering Ming Chuan University Taoyuan 333, Taiwan, ROC
More informationAutomatic Generation of Animatable 3D Personalized Model Based on Multi-view Images
Automatic Generation of Animatable 3D Personalized Model Based on Multi-view Images Seong-Jae Lim, Ho-Won Kim, Jin Sung Choi CG Team, Contents Division ETRI Daejeon, South Korea sjlim@etri.re.kr Bon-Ki
More informationThe Novel Approach for 3D Face Recognition Using Simple Preprocessing Method
The Novel Approach for 3D Face Recognition Using Simple Preprocessing Method Parvin Aminnejad 1, Ahmad Ayatollahi 2, Siamak Aminnejad 3, Reihaneh Asghari Abstract In this work, we presented a novel approach
More informationThiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00. Topic (Research Paper):
Thiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00 Topic (Research Paper): Jinxian Chai and Jessica K. Hodgins, Performance Animation
More informationTopics for thesis. Automatic Speech-based Emotion Recognition
Topics for thesis Bachelor: Automatic Speech-based Emotion Recognition Emotion recognition is an important part of Human-Computer Interaction (HCI). It has various applications in industrial and commercial
More informationHuman pose estimation using Active Shape Models
Human pose estimation using Active Shape Models Changhyuk Jang and Keechul Jung Abstract Human pose estimation can be executed using Active Shape Models. The existing techniques for applying to human-body
More informationImage Coding with Active Appearance Models
Image Coding with Active Appearance Models Simon Baker, Iain Matthews, and Jeff Schneider CMU-RI-TR-03-13 The Robotics Institute Carnegie Mellon University Abstract Image coding is the task of representing
More informationTai Chi Motion Recognition Using Wearable Sensors and Hidden Markov Model Method
Tai Chi Motion Recognition Using Wearable Sensors and Hidden Markov Model Method Dennis Majoe 1, Lars Widmer 1, Philip Tschiemer 1 and Jürg Gutknecht 1, 1 Computer Systems Institute, ETH Zurich, Switzerland
More informationThesis Proposal : Switching Linear Dynamic Systems with Higher-order Temporal Structure. Sang Min Oh
Thesis Proposal : Switching Linear Dynamic Systems with Higher-order Temporal Structure Sang Min Oh sangmin@cc.gatech.edu 28th May 2008 Contents 1 Introduction 1 1.1 Automated Temporal Sequence Analysis.................................
More informationA novel approach to motion tracking with wearable sensors based on Probabilistic Graphical Models
A novel approach to motion tracking with wearable sensors based on Probabilistic Graphical Models Emanuele Ruffaldi Lorenzo Peppoloni Alessandro Filippeschi Carlo Alberto Avizzano 2014 IEEE International
More informationHAND-GESTURE BASED FILM RESTORATION
HAND-GESTURE BASED FILM RESTORATION Attila Licsár University of Veszprém, Department of Image Processing and Neurocomputing,H-8200 Veszprém, Egyetem u. 0, Hungary Email: licsara@freemail.hu Tamás Szirányi
More informationA Method of Hyper-sphere Cover in Multidimensional Space for Human Mocap Data Retrieval
Journal of Human Kinetics volume 28/2011, 133-139 DOI: 10.2478/v10078-011-0030-0 133 Section III Sport, Physical Education & Recreation A Method of Hyper-sphere Cover in Multidimensional Space for Human
More informationAFRL-RH-WP-TR
AFRL-RH-WP-TR-2011-0023 Static and Dynamic Human Shape Modeling Concept Formation and Technology Development Zhiqing Cheng Infoscitex Corporation Julia Parakkat Melody Darby Kathleen Robinette Vulnerability
More informationAnalyzing and Segmenting Finger Gestures in Meaningful Phases
2014 11th International Conference on Computer Graphics, Imaging and Visualization Analyzing and Segmenting Finger Gestures in Meaningful Phases Christos Mousas Paul Newbury Dept. of Informatics University
More informationUnsupervised Human Members Tracking Based on an Silhouette Detection and Analysis Scheme
Unsupervised Human Members Tracking Based on an Silhouette Detection and Analysis Scheme Costas Panagiotakis and Anastasios Doulamis Abstract In this paper, an unsupervised, automatic video human members(human
More informationDetermination of 3-D Image Viewpoint Using Modified Nearest Feature Line Method in Its Eigenspace Domain
Determination of 3-D Image Viewpoint Using Modified Nearest Feature Line Method in Its Eigenspace Domain LINA +, BENYAMIN KUSUMOPUTRO ++ + Faculty of Information Technology Tarumanagara University Jl.
More informationHuman Gait Recognition Using Bezier Curves
Human Gait Recognition Using Bezier Curves Pratibha Mishra Samrat Ashok Technology Institute Vidisha, (M.P.) India Shweta Ezra Dhar Polytechnic College Dhar, (M.P.) India Abstract-- Gait recognition refers
More informationHuman Activity Recognition Based on Weighted Sum Method and Combination of Feature Extraction Methods
International Journal of Intelligent Information Systems 2018; 7(1): 9-14 http://www.sciencepublishinggroup.com/j/ijiis doi: 10.11648/j.ijiis.20180701.13 ISSN: 2328-7675 (Print); ISSN: 2328-7683 (Online)
More information3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images
3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images presented by Tran Cong Thien Qui PhD Candidate School of Computer Engineering & Institute for Media Innovation Supervisor:
More informationRecognition Rate. 90 S 90 W 90 R Segment Length T
Human Action Recognition By Sequence of Movelet Codewords Xiaolin Feng y Pietro Perona yz y California Institute of Technology, 36-93, Pasadena, CA 925, USA z Universit a dipadova, Italy fxlfeng,peronag@vision.caltech.edu
More informationEVENT DETECTION AND HUMAN BEHAVIOR RECOGNITION. Ing. Lorenzo Seidenari
EVENT DETECTION AND HUMAN BEHAVIOR RECOGNITION Ing. Lorenzo Seidenari e-mail: seidenari@dsi.unifi.it What is an Event? Dictionary.com definition: something that occurs in a certain place during a particular
More informationExpanding gait identification methods from straight to curved trajectories
Expanding gait identification methods from straight to curved trajectories Yumi Iwashita, Ryo Kurazume Kyushu University 744 Motooka Nishi-ku Fukuoka, Japan yumi@ieee.org Abstract Conventional methods
More informationFace detection and recognition. Detection Recognition Sally
Face detection and recognition Detection Recognition Sally Face detection & recognition Viola & Jones detector Available in open CV Face recognition Eigenfaces for face recognition Metric learning identification
More informationSketchable Histograms of Oriented Gradients for Object Detection
Sketchable Histograms of Oriented Gradients for Object Detection No Author Given No Institute Given Abstract. In this paper we investigate a new representation approach for visual object recognition. The
More informationVehicle Occupant Posture Analysis Using Voxel Data
Ninth World Congress on Intelligent Transport Systems, Chicago, Illinois, October Vehicle Occupant Posture Analysis Using Voxel Data Ivana Mikic, Mohan Trivedi Computer Vision and Robotics Research Laboratory
More informationPART-LEVEL OBJECT RECOGNITION
PART-LEVEL OBJECT RECOGNITION Jaka Krivic and Franc Solina University of Ljubljana Faculty of Computer and Information Science Computer Vision Laboratory Tržaška 25, 1000 Ljubljana, Slovenia {jakak, franc}@lrv.fri.uni-lj.si
More informationStatistics and Information Technology
Statistics and Information Technology Werner Stuetzle Professor and Chair, Statistics Adjunct Professor, Computer Science and Engineering University of Washington Prepared for NSF Workshop on Statistics:
More informationHuman Action Classification
Human Action Classification M. G. Pallewar & M. M. Sardeshmukh E & TC Department, SAE Kondhwa, Pune, India E-mail : msyannawar@gmail.com & manojsar@rediffmail.com Abstract - Human action analysis is a
More informationRobust Classification of Human Actions from 3D Data
Robust Classification of Human s from 3D Data Loc Huynh, Thanh Ho, Quang Tran, Thang Ba Dinh, Tien Dinh Faculty of Information Technology University of Science Ho Chi Minh City, Vietnam hvloc@apcs.vn,
More informationHuman Hand Gesture Recognition Using Motion Orientation Histogram for Interaction of Handicapped Persons with Computer
Human Hand Gesture Recognition Using Motion Orientation Histogram for Interaction of Handicapped Persons with Computer Maryam Vafadar and Alireza Behrad Faculty of Engineering, Shahed University Tehran,
More informationM I RA Lab. Speech Animation. Where do we stand today? Speech Animation : Hierarchy. What are the technologies?
MIRALab Where Research means Creativity Where do we stand today? M I RA Lab Nadia Magnenat-Thalmann MIRALab, University of Geneva thalmann@miralab.unige.ch Video Input (face) Audio Input (speech) FAP Extraction
More informationArm-hand Action Recognition Based on 3D Skeleton Joints Ling RUI 1, Shi-wei MA 1,a, *, Jia-rui WEN 1 and Li-na LIU 1,2
1 International Conference on Control and Automation (ICCA 1) ISBN: 97-1-9-39- Arm-hand Action Recognition Based on 3D Skeleton Joints Ling RUI 1, Shi-wei MA 1,a, *, Jia-rui WEN 1 and Li-na LIU 1, 1 School
More informationQMUL-ACTIVA: Person Runs detection for the TRECVID Surveillance Event Detection task
QMUL-ACTIVA: Person Runs detection for the TRECVID Surveillance Event Detection task Fahad Daniyal and Andrea Cavallaro Queen Mary University of London Mile End Road, London E1 4NS (United Kingdom) {fahad.daniyal,andrea.cavallaro}@eecs.qmul.ac.uk
More informationThe Analysis of Animate Object Motion using Neural Networks and Snakes
The Analysis of Animate Object Motion using Neural Networks and Snakes Ken Tabb, Neil Davey, Rod Adams & Stella George e-mail {K.J.Tabb, N.Davey, R.G.Adams, S.J.George}@herts.ac.uk http://www.health.herts.ac.uk/ken/vision/
More informationA Two-stage Scheme for Dynamic Hand Gesture Recognition
A Two-stage Scheme for Dynamic Hand Gesture Recognition James P. Mammen, Subhasis Chaudhuri and Tushar Agrawal (james,sc,tush)@ee.iitb.ac.in Department of Electrical Engg. Indian Institute of Technology,
More informationHuman Activity Recognition using the 4D Spatiotemporal Shape Context Descriptor
Human Activity Recognition using the 4D Spatiotemporal Shape Context Descriptor Natasha Kholgade and Andreas Savakis Department of Computer Engineering Rochester Institute of Technology, Rochester NY 14623
More informationA Novel Extreme Point Selection Algorithm in SIFT
A Novel Extreme Point Selection Algorithm in SIFT Ding Zuchun School of Electronic and Communication, South China University of Technolog Guangzhou, China zucding@gmail.com Abstract. This paper proposes
More informationA Unified Spatio-Temporal Articulated Model for Tracking
A Unified Spatio-Temporal Articulated Model for Tracking Xiangyang Lan Daniel P. Huttenlocher {xylan,dph}@cs.cornell.edu Cornell University Ithaca NY 14853 Abstract Tracking articulated objects in image
More informationRealistic Synthesis of Novel Human Movements from a Database of Motion Capture Examples
Realistic Synthesis of Novel Human Movements from a Database of Motion Capture Examples Appeared in Proceedings of the IEEE Workshop on Human Motion HUMO 2000 Luis Molina Tanco Adrian Hilton Centre for
More informationEvaluation of Local Space-time Descriptors based on Cuboid Detector in Human Action Recognition
International Journal of Innovation and Applied Studies ISSN 2028-9324 Vol. 9 No. 4 Dec. 2014, pp. 1708-1717 2014 Innovative Space of Scientific Research Journals http://www.ijias.issr-journals.org/ Evaluation
More informationLearnt Inverse Kinematics for Animation Synthesis
VVG (5) (Editors) Inverse Kinematics for Animation Synthesis Anonymous Abstract Existing work on animation synthesis can be roughly split into two approaches, those that combine segments of motion capture
More informationPrototype-based Intraclass Pose Recognition of Partial 3D Scans
Prototype-based Intraclass Pose Recognition of Partial 3D Scans Jacob MONTIEL Hamid LAGA Masayuki NAKAJIMA Graduate School of Information Science and Engineering, Tokyo Institute of Technology Global Edge
More informationBeyond Bags of Features
: for Recognizing Natural Scene Categories Matching and Modeling Seminar Instructed by Prof. Haim J. Wolfson School of Computer Science Tel Aviv University December 9 th, 2015
More informationCS 231A Computer Vision (Winter 2014) Problem Set 3
CS 231A Computer Vision (Winter 2014) Problem Set 3 Due: Feb. 18 th, 2015 (11:59pm) 1 Single Object Recognition Via SIFT (45 points) In his 2004 SIFT paper, David Lowe demonstrates impressive object recognition
More informationResearch Subject. Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group)
Research Subject Dynamics Computation and Behavior Capture of Human Figures (Nakamura Group) (1) Goal and summary Introduction Humanoid has less actuators than its movable degrees of freedom (DOF) which
More information