3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images
|
|
- Lorin Manning
- 5 years ago
- Views:
Transcription
1 3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images presented by Tran Cong Thien Qui PhD Candidate School of Computer Engineering & Institute for Media Innovation Supervisor: Co-Supervisor: Prof. Seah Hock Soon Prof. Nadia Magnenat Thalmann 9 November 2010
2 Outline Motivation Research Objectives Literature Review Proposed Research Method Current Work Further Work
3 Motivation Ability to clone human body is necessary for many different applications Animation & movies Avatars for games Crowd simulation Medical applications Sport Analysis Fashion (Beowulf 2007) (Crowd Simulation -VRlab, EPFL)
4 Motivation Traditional Laser Scanners Incomplete surface data Tedious, manual process Do not have skeleton information Expensive Multi-camera setup (Cyberware Scanner) Difficult to setup Calibrate and synchronize Lighting condition Limit its applications (D. Vlasic et. al. Siggraph Asia 09)
5 Research Objectives 3D Reconstruction of Human Bodies with Clothes from Un-calibrated Monocular Video Images Video Images from A Single Camera 3D Geometry of human body (Animatable) 3D Geometry of Clothes
6 Literature Review Human Body Reconstruction Has been an open research for a long time Can be categorized into 3 groups Approaches with no body template Shape-from-silhouette Approaches with a human model template Sample-based approaches
7 Literature Review Reconstruction with a human model template VRML H-Anim 1.1 [W. Lee, J. Gu and N.M. Thalmann 2000] VRML model [Hilton 2000] Soft models using metaball representation [Fua 2003] Generic template [D. Grest 2005] Generic template with B-spline curves [Theobalt 2005] ( J. Shen and D. Thalmann 1995) ( D. Grest 2005) (W. Lee, J. Gu and N.M. Thalmann 2000 )
8 Literature Review Sample-based Reconstruction Using many 3D body scans to learn the space of human body shape [H. Seo and N.M. Thalmann 2003] (57 females subjects in one posture) [Allen and Popovic 2003] (250 male and female subjects in one posture) [Anguelov 2005] (37 subjects in A pose + 1 subject in 70 postures) [Hasler 2009] (114 male and female subjects in 34 postures)
9 Literature Review 3D Reconstruction of human body from a single camera P. Guan, A. Weiss, A. O. Bălan, M. J. Black, Estimating Human Shape and Pose from a Single Image, ICCV 2009 Limited to naked-like subjects Only applied to one single image N. Hasler, H. Ackermann, B. Rosenhahn, T. Thormaḧlen, H. P. Seidel,: Multilinear pose and body shape estimation of dressed subjects from image sets, CVPR 2010 Manual input is needed for each image to detect posture Only uses image silhouette Loose clothes have not been fully addressed (Guan - ICCV 09) (Hasler- CVPR 10)
10 Literature Review 3D Reconstruction of human body from a single camera N. Hasler, H. Ackermann, B. Rosenhahn, T. Thormaḧlen, H. P. Seidel,: Multilinear pose and body shape estimation of dressed subjects from image sets, CVPR 2010 Loose clothes have not been fully addressed
11 Proposed Research Method Using video as input Increase the accuracy Help in separating human body and clothes Cloth deformation by motion can be used to verify the body geometry How to determine postures for each image frame? User will annotate some markers on keyframe images In-between posture will be interpolated
12 Proposed Research Method Manual Input in key frames Body Database Video Image s Keyframe Annotation Postures Fitting Body Model Estimated Body Geometry Silhouette Segmentation Silhouette Body Geometry Extract Garments Garment Database Bundle adjustment across the video sequence Cloth Geometry Body Geometry Cloth Geometry
13 Proposed Research Method Bundle Adjustment to adjust all the parameters Parameters: Postures, Body Sizes, Cloth Sizes Silhouette Error Function: the differences between silhouettes and the projection images of the model ( pos, bodysizes, clothsizes) Arg min ( f ( pos, bodysizes, clothsizes) sil ) pos : 3D positions, joint angles in frame i i i i i i bodysizes: sizing parameters of human body clothsizes: sizing parameters of clothes sil : silhouettes extracted from frame i i 2
14 Current Work Silhouette Segmentation C. Rother, V. Kolmogorov, A. Blake. - SIGGRAPH 04 GrabCut: Interactive Foreground Extraction using Iterated Graph Cuts.
15 Further Work Keyframe annotation and interpolation Resizing human model to fit the extracted silhouette Extracting garments
16 Thank you!
Markerless Motion Capture from Single or Multi-Camera Video Sequence
Markerless Motion Capture from Single or Multi-Camera Video Sequence F. Remondino IGP - ETH Zurich, CH fabio@geod.baug.ethz.ch www.photogrammetry.ethz..ch N. D Apuzzo Homometrica Consulting nda@homometrica.ch
More informationHuman Motion Reconstruction and Animation from Video Sequences
Human Motion Reconstruction and Animation from Video Sequences Fabio Remondino Institute for Geodesy and Photogrammetry ETH Zurich, Switzerland E-mail: fabio@geod.baug.ethz.ch Web: http://www.photogrammetry.ethz.ch
More informationHuman Body Shape Deformation from. Front and Side Images
Human Body Shape Deformation from Front and Side Images Yueh-Ling Lin 1 and Mao-Jiun J. Wang 2 Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan
More informationAutomatic Generation of Animatable 3D Personalized Model Based on Multi-view Images
Automatic Generation of Animatable 3D Personalized Model Based on Multi-view Images Seong-Jae Lim, Ho-Won Kim, Jin Sung Choi CG Team, Contents Division ETRI Daejeon, South Korea sjlim@etri.re.kr Bon-Ki
More informationClothed and Naked Human Shapes Estimation from a Single Image
Clothed and Naked Human Shapes Estimation from a Single Image Yu Guo, Xiaowu Chen, Bin Zhou, and Qinping Zhao State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and
More informationStatistical Learning of Human Body through Feature Wireframe
Statistical Learning of Human Body through Feature Wireframe Jida HUANG 1, Tsz-Ho KWOK 2*, Chi ZHOU 1 1 Industrial and Systems Engineering, University at Buffalo, SUNY, Buffalo NY, USA; 2 Mechanical, Industrial
More informationTHREE-dimensional models of human body are widely
SPECIAL ISSUE ON DEPTH CAMERAS BASED TECHNIQUES AND APPLICATIONS IN DESIGN, MANUFACTURING AND SERVICES 1 Volumetric Template Fitting for Human Body Reconstruction from Incomplete Data Tsz-Ho Kwok, Kwok-Yun
More informationInternational Conference on Communication, Media, Technology and Design. ICCMTD May 2012 Istanbul - Turkey
VISUALIZING TIME COHERENT THREE-DIMENSIONAL CONTENT USING ONE OR MORE MICROSOFT KINECT CAMERAS Naveed Ahmed University of Sharjah Sharjah, United Arab Emirates Abstract Visualizing or digitization of the
More informationCapturing Skeleton-based Animation Data from a Video
Capturing Skeleton-based Animation Data from a Video Liang-Yu Shih, Bing-Yu Chen National Taiwan University E-mail: xdd@cmlab.csie.ntu.edu.tw, robin@ntu.edu.tw ABSTRACT This paper presents a semi-automatic
More informationSingle-View Dressed Human Modeling via Morphable Template
Single-View Dressed Human Modeling via Morphable Template Lin Wang 1, Kai Jiang 2, Bin Zhou 1, Qiang Fu 1, Kan Guo 1, Xiaowu Chen 1 1 State Key Laboratory of Virtual Reality Technology and Systems School
More informationAutomatic Modeling of Virtual Humans and Body Clothing
Automatic Modeling of Virtual Humans and Body Clothing Nadia Magnenat-Thalmann, Hyewon Seo, Frederic Cordier MIRALab - University of Geneva 24 rue du General Dufour, CH-1211 Geneva, Switzerland E-mail:
More informationEstimation of Human Body Shape in Motion with Wide Clothing
Estimation of Human Body Shape in Motion with Wide Clothing Jinlong Yang, Jean-Sébastien Franco, Franck Hétroy-Wheeler, Stefanie Wuhrer To cite this version: Jinlong Yang, Jean-Sébastien Franco, Franck
More informationPersonalization and Evaluation of a Real-time Depth-based Full Body Tracker
Personalization and Evaluation of a Real-time Depth-based Full Body Tracker Thomas Helten 1 Andreas Baak 1 Gaurav Bharaj 2 Meinard Müller 3 Hans-Peter Seidel 1 Christian Theobalt 1 1 MPI Informatik 2 Harvard
More informationarxiv: v2 [cs.cv] 3 Mar 2017
Building Statistical Shape Spaces for 3D Human Modeling Leonid Pishchulin a,, Stefanie Wuhrer b, Thomas Helten c, Christian Theobalt a, Bernt Schiele a arxiv:153.586v2 [cs.cv] 3 Mar 217 Abstract a Max
More informationTopics in Computer Animation
Topics in Computer Animation Animation Techniques Artist Driven animation The artist draws some frames (keyframing) Usually in 2D The computer generates intermediate frames using interpolation The old
More informationEstimating 3D Human Shapes from Measurements
Estimating 3D Human Shapes from Measurements Stefanie Wuhrer Chang Shu March 19, 2012 arxiv:1109.1175v2 [cs.cv] 16 Mar 2012 Abstract The recent advances in 3-D imaging technologies give rise to databases
More information3D Modeling of Humans with Skeletons from Uncalibrated Wide Baseline Views
3D Modeling of Humans with Skeletons from Uncalibrated Wide Baseline Views Chee Kwang Quah, Andre Gagalowicz 2, Richard Roussel 2, and Hock Soon Seah 3 Nanyang Technological University, School of Computer
More informationSCAPE: Shape Completion and Animation of People
SCAPE: Shape Completion and Animation of People By Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, James Davis From SIGGRAPH 2005 Presentation for CS468 by Emilio Antúnez
More informationResearch Article Human Model Adaptation for Multiview Markerless Motion Capture
Mathematical Problems in Engineering Volume 2013, Article ID 564214, 7 pages http://dx.doi.org/10.1155/2013/564214 Research Article Human Model Adaptation for Multiview Markerless Motion Capture Dianyong
More informationHuman hand adaptation using sweeps: generating animatable hand models ...
COMPUTER ANIMATION AND VIRTUAL WORLDS Comp. Anim. Virtual Worlds 2007; 18: 505 516 Published online 16 July 2007 in Wiley InterScience (www.interscience.wiley.com).193 Human hand adaptation using sweeps:
More informationMotion Graphs for Character Animation
Parag Chaudhuri Indian Institute of Technology Bombay Research Promotion Workshop on Introduction to Graph and Geometric Algorithms Thapar University Patiala October 30, 2010 Outline Introduction The Need
More informationRapid Skin: Estimating the 3D Human Pose and Shape in Real-Time
Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time Matthias Straka, Stefan Hauswiesner, Matthias Rüther, and Horst Bischof Institute for Computer Graphics and Vision Graz University of Technology,
More informationShape Customisation of Human Subjects Based on Human Parsing Technology
Shape Customisation of Human Subjects Based on Human Parsing Technology Shuaiyin ZHU 2, Yanghong ZHOU 2, K.P. CHAU 2, P.Y. MOK* 1,2 1 The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen,
More informationParametric Editing of Clothed 3D Avatars
The Visual Computer manuscript No. (will be inserted by the editor) Parametric Editing of Clothed 3D Avatars Yin Chen Zhi-Quan Cheng Ralph R. Martin Abstract Easy editing of a clothed 3D human avatar is
More informationTo Do. Advanced Computer Graphics. The Story So Far. Course Outline. Rendering (Creating, shading images from geometry, lighting, materials)
Advanced Computer Graphics CSE 190 [Spring 2015], Lecture 16 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir To Do Assignment 3 milestone due May 29 Should already be well on way Contact us for difficulties
More informationCourse Outline. Advanced Computer Graphics. Animation. The Story So Far. Animation. To Do
Advanced Computer Graphics CSE 163 [Spring 2017], Lecture 18 Ravi Ramamoorthi http://www.cs.ucsd.edu/~ravir 3D Graphics Pipeline Modeling (Creating 3D Geometry) Course Outline Rendering (Creating, shading
More informationComparison of Default Patient Surface Model Estimation Methods
Comparison of Default Patient Surface Model Estimation Methods Xia Zhong 1, Norbert Strobel 2, Markus Kowarschik 2, Rebecca Fahrig 2, Andreas Maier 1,3 1 Pattern Recognition Lab, Friedrich-Alexander-Universität
More informationA Data-Driven Approach for 3D Human Body Pose Reconstruction from a Kinect Sensor
Journal of Physics: Conference Series PAPER OPEN ACCESS A Data-Driven Approach for 3D Human Body Pose Reconstruction from a Kinect Sensor To cite this article: Li Yao et al 2018 J. Phys.: Conf. Ser. 1098
More informationA Validation Study of a Kinect Based Body Imaging (KBI) Device System Based on ISO 20685:2010
A Validation Study of a Kinect Based Body Imaging (KBI) Device System Based on ISO 20685:2010 Sara BRAGANÇA* 1, Miguel CARVALHO 1, Bugao XU 2, Pedro AREZES 1, Susan ASHDOWN 3 1 University of Minho, Portugal;
More informationTo Do. History of Computer Animation. These Lectures. 2D and 3D Animation. Computer Animation. Foundations of Computer Graphics (Spring 2010)
Foundations of Computer Graphics (Spring 2010) CS 184, Lecture 24: Animation http://inst.eecs.berkeley.edu/~cs184 To Do Submit HW 4 (today) Start working on HW 5 (can be simple add-on) Many slides courtesy
More informationAnimations. Hakan Bilen University of Edinburgh. Computer Graphics Fall Some slides are courtesy of Steve Marschner and Kavita Bala
Animations Hakan Bilen University of Edinburgh Computer Graphics Fall 2017 Some slides are courtesy of Steve Marschner and Kavita Bala Animation Artistic process What are animators trying to do? What tools
More informationMarkerless Motion Capture with Multi-view Structured Light
Markerless Motion Capture with Multi-view Structured Light Ricardo R. Garcia, Avideh Zakhor; UC Berkeley; Berkeley, CA (a) (c) Figure 1: Using captured partial scans of (a) front and (b) back to generate
More informationCalibrated Image Acquisition for Multi-view 3D Reconstruction
Calibrated Image Acquisition for Multi-view 3D Reconstruction Sriram Kashyap M S Guide: Prof. Sharat Chandran Indian Institute of Technology, Bombay April 2009 Sriram Kashyap 3D Reconstruction 1/ 42 Motivation
More informationCSE452 Computer Graphics
CSE452 Computer Graphics Lecture 19: From Morphing To Animation Capturing and Animating Skin Deformation in Human Motion, Park and Hodgins, SIGGRAPH 2006 CSE452 Lecture 19: From Morphing to Animation 1
More informationDynamic Human Shape Description and Characterization
Dynamic Human Shape Description and Characterization Z. Cheng*, S. Mosher, Jeanne Smith H. Cheng, and K. Robinette Infoscitex Corporation, Dayton, Ohio, USA 711 th Human Performance Wing, Air Force Research
More informationMotion Synthesis and Editing. Yisheng Chen
Motion Synthesis and Editing Yisheng Chen Overview Data driven motion synthesis automatically generate motion from a motion capture database, offline or interactive User inputs Large, high-dimensional
More informationA Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras
A Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras Abstract Byoung-Keon D. PARK*, Matthew P. REED University of Michigan, Transportation Research Institute,
More informationGraphics, Vision, HCI. K.P. Chan Wenping Wang Li-Yi Wei Kenneth Wong Yizhou Yu
Graphics, Vision, HCI K.P. Chan Wenping Wang Li-Yi Wei Kenneth Wong Yizhou Yu Li-Yi Wei Background Stanford (95-01), NVIDIA (01-05), MSR (05-11) Research Nominal: Graphics, HCI, parallelism Actual: Computing
More informationData-driven Depth Inference from a Single Still Image
Data-driven Depth Inference from a Single Still Image Kyunghee Kim Computer Science Department Stanford University kyunghee.kim@stanford.edu Abstract Given an indoor image, how to recover its depth information
More informationComputer Vision at Cambridge: Reconstruction,Registration and Recognition
Computer Vision at Cambridge: Reconstruction,Registration and Recognition Roberto Cipolla Research team http://www.eng.cam.ac.uk/~cipolla/people.html Cognitive Systems Engineering Cognitive Systems Engineering
More informationMaking Machines See. Roberto Cipolla Department of Engineering. Research team
Making Machines See Roberto Cipolla Department of Engineering Research team http://www.eng.cam.ac.uk/~cipolla/people.html Cognitive Systems Engineering Cognitive Systems Engineering Introduction Making
More informationKeyframe Animation. Computer Animation. Outline. Computer Animation. Keyframe Animation. Keyframe Animation
Computer Animation What is animation? o Make objects change over time according to scripted actions What is simulation? Pixar o Predict how objects change over time according to physical laws Adam Finkelstein
More information3D Human Motion Analysis and Manifolds
D E P A R T M E N T O F C O M P U T E R S C I E N C E U N I V E R S I T Y O F C O P E N H A G E N 3D Human Motion Analysis and Manifolds Kim Steenstrup Pedersen DIKU Image group and E-Science center Motivation
More informationA Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets
A Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets Kyungha Min and Moon-Ryul Jung Dept. of Media Technology, Graduate School of Media Communications, Sogang Univ., Seoul,
More informationThiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00. Topic (Research Paper):
Thiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00 Topic (Research Paper): Jinxian Chai and Jessica K. Hodgins, Performance Animation
More informationMonocular Tracking and Reconstruction in Non-Rigid Environments
Monocular Tracking and Reconstruction in Non-Rigid Environments Kick-Off Presentation, M.Sc. Thesis Supervisors: Federico Tombari, Ph.D; Benjamin Busam, M.Sc. Patrick Ruhkamp 13.01.2017 Introduction Motivation:
More informationInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Vol. XXXIV-5/W10
BUNDLE ADJUSTMENT FOR MARKERLESS BODY TRACKING IN MONOCULAR VIDEO SEQUENCES Ali Shahrokni, Vincent Lepetit, Pascal Fua Computer Vision Lab, Swiss Federal Institute of Technology (EPFL) ali.shahrokni,vincent.lepetit,pascal.fua@epfl.ch
More informationDeformation Transfer for Triangle Meshes
Deformation Transfer for Triangle Meshes a Paper (SIGGRAPH 2004) by Robert W. Sumner & Jovan Popovic presented by Roni Oeschger Deformation Transfer Source deformed Target deformed 1 Outline of my presentation
More informationProbabilistic Tracking and Reconstruction of 3D Human Motion in Monocular Video Sequences
Probabilistic Tracking and Reconstruction of 3D Human Motion in Monocular Video Sequences Presentation of the thesis work of: Hedvig Sidenbladh, KTH Thesis opponent: Prof. Bill Freeman, MIT Thesis supervisors
More informationKinematics & Motion Capture
Lecture 27: Kinematics & Motion Capture Computer Graphics and Imaging UC Berkeley CS184/284A, Spring 2017 Forward Kinematics (Slides with James O Brien) Forward Kinematics Articulated skeleton Topology
More informationEPFL. When an animator species an animation sequence, it privileges when animating the Virtual. body, the privileged information to be manipulated
Realistic Human Body Modeling P. Fua, R. Plankers, and D. Thalmann Computer Graphics Lab (LIG) EPFL CH-1015 Lausanne, Switzerland 1 Introduction Synthetic modeling of human bodies and the simulation of
More informationFuture Studios Research Lab
GPU TECHNOLOGY WORKSHOP SOUTH EAST ASIA 2014 Future Studios Research Lab The Boy and His Robot Film Case Study Prof SEAH Hock Soon Director Multi-plAtform Game Innovation Centre (MAGIC) Nanyang Technological
More informationReverse Engineering Garments
Reverse Engineering Garments Nils Hasler, Bodo Rosenhahn, and Hans-Peter Seidel Max-Planck-Institut für Informatik, 66123 Saarbrücken, Germany, hasler@mpi-inf.mpg.de Abstract. Segmenting garments from
More informationFrom 3-D Scans to Design Tools
From 3-D Scans to Design Tools Chang SHU* a, Pengcheng XI a, Stefanie WUHRER b a National Research Council, Ottawa, Canada; b Saarland University, Saarbrücken, Germany http://dx.doi.org/10.15221/13.151
More informationClothes Size Prediction from Dressed-human Silhouettes
Clothes Size Prediction from Dressed-human Silhouettes Dan Song 1, Ruofeng Tong 1, Jian Chang 2, Tongtong Wang 1, Jiang Du 1, Min Tang 1 and Jian Jun Zhang 2 1 State Key Lab of CAD&CG, Zhejiang University,
More informationAnimating Characters in Pictures
Animating Characters in Pictures Shih-Chiang Dai jeffrey@cmlab.csie.ntu.edu.tw Chun-Tse Hsiao hsiaochm@cmlab.csie.ntu.edu.tw Bing-Yu Chen robin@ntu.edu.tw ABSTRACT Animating pictures is an interesting
More informationA Novel Illumination-Invariant Loss for Monocular 3D Pose Estimation
A Novel Illumination-Invariant Loss for Monocular 3D Pose Estimation Srimal Jayawardena Marcus Hutter Nathan Brewer Australian National University srimal(dot)jayawardena(at)anu(dot)edu(dot)au http://users.cecs.anu.edu.au/~srimalj
More informationA Data-driven Approach to Human-body Cloning Using a Segmented Body Database
15th Pacific Conference on Computer Graphics and Applications A Data-driven Approach to Human-body Cloning Using a Segmented Body Database Pengcheng Xi National Research Council of Canada pengcheng.xi@nrc-cnrc.gc.ca
More informationAN ONTOLOGY OF VIRTUAL HUMANS: INCORPORATING SEMANTICS INTO HUMAN SHAPES
AN ONTOLOGY OF VIRTUAL HUMANS: INCORPORATING SEMANTICS INTO HUMAN SHAPES A. García-Rojas, D. Thalmann, F. Vexo 1, L. Moccozet, N. Magnenat-Thalmann 2, M. Mortara, M. Spagnuolo 3 and M. Gutiérrez 4 1 VRlab
More informationComputer Animation Visualization. Lecture 5. Facial animation
Computer Animation Visualization Lecture 5 Facial animation Taku Komura Facial Animation The face is deformable Need to decide how all the vertices on the surface shall move Manually create them Muscle-based
More informationThe 3D rendering pipeline (our version for this class)
The 3D rendering pipeline (our version for this class) 3D models in model coordinates 3D models in world coordinates 2D Polygons in camera coordinates Pixels in image coordinates Scene graph Camera Rasterization
More informationMotion Capture Using Joint Skeleton Tracking and Surface Estimation
Motion Capture Using Joint Skeleton Tracking and Surface Estimation Juergen Gall 1,2, Carsten Stoll 2, Edilson de Aguiar 2, Christian Theobalt 3, Bodo Rosenhahn 4, and Hans-Peter Seidel 2 1 BIWI, ETH Zurich
More informationStatistics and Information Technology
Statistics and Information Technology Werner Stuetzle Professor and Chair, Statistics Adjunct Professor, Computer Science and Engineering University of Washington Prepared for NSF Workshop on Statistics:
More informationHuman Upper Body Pose Estimation in Static Images
1. Research Team Human Upper Body Pose Estimation in Static Images Project Leader: Graduate Students: Prof. Isaac Cohen, Computer Science Mun Wai Lee 2. Statement of Project Goals This goal of this project
More informationarxiv: v1 [cs.cv] 28 Jul 2016
arxiv:1607.08659v1 [cs.cv] 28 Jul 2016 General Automatic Human Shape and Motion Capture Using Volumetric Contour Cues Helge Rhodin 1 Nadia Robertini 1, 2 Dan Casas 1 Christian Richardt 1, 2 Hans-Peter
More informationAutomatic Animation of High Resolution Images
2012 IEEE 27 th Convention of Electrical and Electronics Engineers in Israel Automatic Animation of High Resolution Images Dmitry Batenkov, Gregory Dinkin, Yosef Yomdin Department of Mathematics The Weizmann
More informationIm2Fit: Fast 3D Model Fitting and Anthropometrics using Single Consumer Depth Camera and Synthetic Data
ImFit: Fast 3D Model Fitting and Anthropometrics using Single Consumer Depth Camera and Synthetic Data Qiaosong Wang 1, Vignesh Jagadeesh, Bryan Ressler and Robinson Piramuthu 1 University of Delaware,
More informationCreating Custom Human Avatars for Ergonomic Analysis using Depth Cameras
Creating Custom Human Avatars for Ergonomic Analysis using Depth Cameras Matthew P. Reed, Byoung-Keon Park, K. Han Kim University of Michigan Transportation Research Institute Ulrich Raschke Siemens PLM
More informationMotion Capture, Motion Edition
Motion Capture, Motion Edition 2013-14 Overview Historical background Motion Capture, Motion Edition Motion capture systems Motion capture workflow Re-use of motion data Combining motion data and physical
More informationSpace-time Body Pose Estimation in Uncontrolled Environments
Space-time Body Pose Estimation in Uncontrolled Environments Marcel Germann ETH Zurich germann@inf.ethz.ch Tiberiu Popa ETH Zurich tpopa@inf.ethz.ch Remo Ziegler LiberoVision AG ziegler@liberovision.com
More information3D Production Pipeline
Overview 3D Production Pipeline Story Character Design Art Direction Storyboarding Vocal Tracks 3D Animatics Modeling Animation Rendering Effects Compositing Basics : OpenGL, transformation Modeling :
More informationAnimation of Refitted 3D Garment Models for Reshaped Bodies
2014 International Conference on Virtual Reality and Visualization Animation of Refitted 3D Garment Models for Reshaped Bodies Yifan Yan 1 Juntao Ye 1 Xiaoyang Zhu 1 Jituo Li 2 1 National Laboratory of
More informationA Pose Invariant Statistical Shape Model for Human Bodies
Abstract A Pose Invariant Statistical Shape Model for Human Bodies Matteo COLAIANNI* 1, Michael ZOLLHÖFER 1, Jochen SÜßMUTH 2, Bettina SEIDER 2, Günther GREINER 1 1 Computer Graphics Group, University
More information3D Modeling for Capturing Human Motion from Monocular Video
3D Modeling for Capturing Human Motion from Monocular Video 1 Weilun Lao, 1 Jungong Han 1,2 Peter H.N. de With 1 Eindhoven University of Technology 2 LogicaCMG Netherlands P.O. Box 513 P.O. Box 7089 5600MB
More informationContinuous and Discrete Optimization Methods in Computer Vision. Daniel Cremers Department of Computer Science University of Bonn
Continuous and Discrete Optimization Methods in Computer Vision Daniel Cremers Department of Computer Science University of Bonn Oxford, August 16 2007 Segmentation by Energy Minimization Given an image,
More informationCOMP 175 COMPUTER GRAPHICS. Lecture 10: Animation. COMP 175: Computer Graphics March 12, Erik Anderson 08 Animation
Lecture 10: Animation COMP 175: Computer Graphics March 12, 2018 1/37 Recap on Camera and the GL Matrix Stack } Go over the GL Matrix Stack 2/37 Topics in Animation } Physics (dynamics, simulation, mechanics)
More informationCS 231. Motion Capture Data I. The Pipeline. Bodenheimer et al
CS 231 Motion Capture Data I The Pipeline Bodenheimer et al 1 Marker Magnetic Optical Marker placement On limbs vs joints neither is ideal Over tight clothing or thin skin In repeatable 'landmarks' Using
More informationAn Investigation on the Framework of Dressing Virtual Humans
An Investigation on the Framework of Dressing Virtual Humans A thesis submitted for the Doctor of Philosophy By Hui Yu School of Engineering and Design, Brunel University February 2010 Author s Declaration
More informationMotion Control with Strokes
Motion Control with Strokes Masaki Oshita Kyushu Institute of Technology oshita@ces.kyutech.ac.jp Figure 1: Examples of stroke-based motion control. Input strokes (above) and generated motions (below).
More information3D reconstruction of static human body with a digital camera
Research Collection Conference Paper 3D reconstruction of static human body with a digital camera Author(s): Remondino, Fabio Publication Date: 2003 Permanent Link: https://doi.org/10.3929/ethz-a-004664890
More informationSemi-Automatic Prediction of Landmarks on Human Models in Varying Poses
Semi-Automatic Prediction of Landmarks on Human Models in Varying Poses Stefanie Wuhrer Zouhour Ben Azouz Chang Shu National Research Council of Canada, Ottawa, Ontario, Canada {stefanie.wuhrer, zouhour.benazouz,
More informationASIAGRAPH 2008 The Intermediate View Synthesis System For Soccer Broadcasts
ASIAGRAPH 2008 The Intermediate View Synthesis System For Soccer Broadcasts Songkran Jarusirisawad, Kunihiko Hayashi, Hideo Saito (Keio Univ.), Naho Inamoto (SGI Japan Ltd.), Tetsuya Kawamoto (Chukyo Television
More information3D model-based human face modeling
3D model-based human face modeling André Gagalowicz Projet MIRAGES INRIA - Rocquencourt - Domaine de Voluceau 78153 Le Chesnay Cedex E-Mail : Andre.Gagalowicz@inria.fr II-I - INTRODUCTION II-II FIRST STEP
More informationBody Scanning and Modeling for Custom Fit Garments. B. Xu, Y. Huang, W. Yu and T. Chen
Body Scanning and Modeling for Custom Fit Garments B. Xu, Y. Huang, W. Yu and T. Chen The University of Texas at Austin Department of Human Ecology Austin, TX78712 ABSTRACT Mass customization is a new
More informationComputer Vision : Exercise 4 Labelling Problems
Computer Vision Exercise 4 Labelling Problems 13/01/2014 Computer Vision : Exercise 4 Labelling Problems Outline 1. Energy Minimization (example segmentation) 2. Iterated Conditional Modes 3. Dynamic Programming
More informationRegistration of Deformable Objects
Registration of Deformable Objects Christopher DeCoro Includes content from: Consistent Mesh Parameterizations, Praun et. al, Siggraph 2001 The Space of Human Body Shapes, Allen et. al, Siggraph 2003 Shape-based
More informationAnimation. CS 465 Lecture 22
Animation CS 465 Lecture 22 Animation Industry production process leading up to animation What animation is How animation works (very generally) Artistic process of animation Further topics in how it works
More informationDeep Learning for Virtual Shopping. Dr. Jürgen Sturm Group Leader RGB-D
Deep Learning for Virtual Shopping Dr. Jürgen Sturm Group Leader RGB-D metaio GmbH Augmented Reality with the Metaio SDK: IKEA Catalogue App Metaio: Augmented Reality Metaio SDK for ios, Android and Windows
More informationMeasurement of 3D Foot Shape Deformation in Motion
Measurement of 3D Foot Shape Deformation in Motion Makoto Kimura Masaaki Mochimaru Takeo Kanade Digital Human Research Center National Institute of Advanced Industrial Science and Technology, Japan The
More information05 Mesh Animation. Steve Marschner CS5625 Spring 2016
05 Mesh Animation Steve Marschner CS5625 Spring 2016 Basic surface deformation methods Blend shapes: make a mesh by combining several meshes Mesh skinning: deform a mesh based on an underlying skeleton
More informationComputer Vision and Virtual Reality. Introduction
Computer Vision and Virtual Reality Introduction Tomáš Svoboda, svoboda@cmp.felk.cvut.cz Czech Technical University in Prague, Center for Machine Perception http://cmp.felk.cvut.cz Last update: October
More informationMotion Capture using Body Mounted Cameras in an Unknown Environment
Motion Capture using Body Mounted Cameras in an Unknown Environment Nam Vo Taeyoung Kim Siddharth Choudhary 1. The Problem Motion capture has been recently used to provide much of character motion in several
More informationFree-Form Mesh Tracking: a Patch-Based Approach
Free-Form Mesh Tracking: a Patch-Based Approach Cedric Cagniart 1, Edmond Boyer 2, Slobodan Ilic 1 1 Department of Computer Science, Technical University of Munich 2 Grenoble Universités, INRIA Rhône-Alpes
More informationCS-184: Computer Graphics
CS-184: Computer Graphics Lecture #19: Motion Capture!!! Prof. James O Brien! University of California, Berkeley!! V2015-S-18-1.0 Today 1 18-MoCap.key - April 8, 2015 Motion Capture 2 2 18-MoCap.key -
More informationarxiv: v2 [cs.cv] 19 Nov 2014
ImFit: Fast 3D Model Fitting and Anthropometrics using Single Consumer Depth Camera and Synthetic Data Qiaosong Wang, Vignesh Jagadeesh, Bryan Ressler, Robinson Piramuthu University of Delaware ebay Research
More informationM I RA Lab. Speech Animation. Where do we stand today? Speech Animation : Hierarchy. What are the technologies?
MIRALab Where Research means Creativity Where do we stand today? M I RA Lab Nadia Magnenat-Thalmann MIRALab, University of Geneva thalmann@miralab.unige.ch Video Input (face) Audio Input (speech) FAP Extraction
More informationDynamic Shape Tracking via Region Matching
Dynamic Shape Tracking via Region Matching Ganesh Sundaramoorthi Asst. Professor of EE and AMCS KAUST (Joint work with Yanchao Yang) The Problem: Shape Tracking Given: exact object segmentation in frame1
More informationModeling of Bodies and Clothes for Virtual Environments
Modeling of Bodies and Clothes for Virtual Environments Nadia Magnenat-Thalmann, Frederic Cordier, Hyewon Seo, George Papagianakis MIRALab, University of Geneva Centre Universitaire d Informatique 24 rue
More informationVirtual Try-0N System
International Journal of Research in Advent Technology (E-ISSN: 2321-9637) Special Issue National Conference NCPCI-2016, 19 March 2016 Available online at www.ijrat.org Virtual Try-0N System Abrar I Shaikh,Suraj
More informationanimation projects in digital art animation 2009 fabio pellacini 1
animation projects in digital art animation 2009 fabio pellacini 1 animation shape specification as a function of time projects in digital art animation 2009 fabio pellacini 2 how animation works? flip
More information