SCAPE: Shape Completion and Animation of People

Size: px
Start display at page:

Download "SCAPE: Shape Completion and Animation of People"

Transcription

1 SCAPE: Shape Completion and Animation of People By Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, James Davis From SIGGRAPH 2005 Presentation for CS468 by Emilio Antúnez nez 1

2 Motivation It is difficult to get high resolution body scans It is even harder at video rates By building up a human model, you could synthesize a high resolution scan from sparse/incomplete data Accurate model is most easily created by learning from sample scans 2

3 Pre existing Work in Deformable Human Models I Deformations described relative to a template shape Pose deformations given relative to local joints in an articulated model Body shape deformations described using displacement vectors from PCA 3

4 Pre existing Work in Deformable Human Models II Pose and shape deformations rarely addressed together Most similar work by Sumner and Popović Retargets pose deformation to another mesh Does not learn a model 4

5 Paper Contributions Learning an affine deformation model for both pose and shape Shape completion for scan of an arbitrary human target Body shape manipulation for motion capture animation 5

6 Presentation Overview Data Acquisition Learning the Human Model Applications Shape Completion Motion Capture Animation Limitations 6

7 Data Format / Assumptions Each input model is a deformation of a fixed topology triangle mesh Models divided into three categories One template model Template subject in different poses Different people in (roughly) same pose Articulated skeleton assigned to each mesh 7

8 Data Acquisition and Processing 8

9 Learning the Human Model Pose and shape deformations described per triangle using linear transformations Pose transformations learned from template subject in different poses Body shape transformations learned by comparing different subjects to template 9

10 Pose Deformation I Rigid (skeletal) deformations are represented separately from non rigid ones Transformations are given in relative coordinate system where one of the corners is fixed at the origin final triangle O R l[k] template triangle Q k 10

11 Pose Deformation II Triangle edges are not forced to be consistent Final synthesized mesh reduces the least squares error between mesh points and triangle deformations final triangle O R l[k] template triangle Q k 11

12 Learning Pose Deformation Model I Rigid rotation is known from skeleton Non rigid transformation is underdefined Q matrix is computed by requiring adjacent triangles non rigid transformations to be similar 12

13 Learning Pose Deformation Model II Non rigid deformation modeled as an affine function of adjacent joint angles In practice, some of the degrees of freedom are removed for constrained joings 13

14 Pose Deformation Learning Results 14

15 Body Shape Deformation Body shape is modeled as an additional linear transform, S S is underdetermined (like Q) Again, solved using a smoothness constraint 15

16 Learning the Shape Deformation Model The matrix coefficients for all body shape transformations are vectorized Principal component analysis is used to parameterize the shape transform vectors 16

17 Shape Deformation Learning Results 17

18 Shape Completion I Assuming you know some of the node positions, estimate the others Must estimate pose and body shape This optimization is highly nonlinear in the pose Empirically found that optimizing over all variables at once produces bad results Instead, SCAPE iterates solving 18

19 Shape Completion II Empirically found that optimizing over all variables at once produces bad results Instead, SCAPE iterates, solving each of these in order: Pose Mesh estimate Body shape Results in a completed mesh and a predicted mesh 19

20 Partial View Completion Skeletal and point correspondences may be off if too much data is missing Iterate between the shape completion algorithm previously described and remapping the point correspondences 20

21 Partial View Completion Results 21

22 Motion Capture Animation Motion capture data provides the pose data Body shape parameters can be set arbitrarily Since markers are generally placed on body surface (not in the bones), mesh is constrained to lie in the space of body shapes encoded by the model 22

23 Motion Capture Animation Results 23

24 Limitations Assumes that pose deformation and body shape are mostly independent Models only pose deformations from skeletal motion 24

25 Conclusion SCAPE learns simple body model which distinguishes pose and body shape deformations Creates reasonable shape completions, even when large features are missing Allows for flexible reconstruction of moving model from motion capture data 25

Deformation Transfer for Triangle Meshes

Deformation Transfer for Triangle Meshes Deformation Transfer for Triangle Meshes a Paper (SIGGRAPH 2004) by Robert W. Sumner & Jovan Popovic presented by Roni Oeschger Deformation Transfer Source deformed Target deformed 1 Outline of my presentation

More information

CS 523: Computer Graphics, Spring Shape Modeling. Skeletal deformation. Andrew Nealen, Rutgers, /12/2011 1

CS 523: Computer Graphics, Spring Shape Modeling. Skeletal deformation. Andrew Nealen, Rutgers, /12/2011 1 CS 523: Computer Graphics, Spring 2011 Shape Modeling Skeletal deformation 4/12/2011 1 Believable character animation Computers games and movies Skeleton: intuitive, low-dimensional subspace Clip courtesy

More information

SCAPE: Shape Completion and Animation of People

SCAPE: Shape Completion and Animation of People SCAPE: Shape Completion and Animation of People Dragomir Anguelov Praveen Srinivasan Daphne Koller Sebastian Thrun Jim Rodgers Stanford University James Davis University of California, Santa Cruz Figure

More information

Skeletal deformation

Skeletal deformation CS 523: Computer Graphics, Spring 2009 Shape Modeling Skeletal deformation 4/22/2009 1 Believable character animation Computers games and movies Skeleton: intuitive, low dimensional subspace Clip courtesy

More information

Example-Based Skeleton Extraction. Scott Schaefer Can Yuksel

Example-Based Skeleton Extraction. Scott Schaefer Can Yuksel Example-Based Skeleton Extraction Scott Schaefer Can Yuksel Example-Based Deformation Examples Previous Work Mesh-based Inverse Kinematics [Sumner et al. 2005], [Der et al. 2006] Example-based deformation

More information

Statistical Learning of Human Body through Feature Wireframe

Statistical Learning of Human Body through Feature Wireframe Statistical Learning of Human Body through Feature Wireframe Jida HUANG 1, Tsz-Ho KWOK 2*, Chi ZHOU 1 1 Industrial and Systems Engineering, University at Buffalo, SUNY, Buffalo NY, USA; 2 Mechanical, Industrial

More information

Mesh-Based Inverse Kinematics

Mesh-Based Inverse Kinematics CS468, Wed Nov 9 th 2005 Mesh-Based Inverse Kinematics R. W. Sumner, M. Zwicker, C. Gotsman, J. Popović SIGGRAPH 2005 The problem 1 General approach Learn from experience... 2 As-rigid-as-possible shape

More information

Human-body modeling Xi et al. [3] used non-numerical attributes like gender, age, race, marital status, and occupation to predict body shapes and buil

Human-body modeling Xi et al. [3] used non-numerical attributes like gender, age, race, marital status, and occupation to predict body shapes and buil HUMAN-BODY MODELING AND POSITION SPECIFICATION FOR FORENSIC AUTOPSY DATA VISUALIZATION Junki Mano Masahiro Toyoura Xiaoyang Mao Hideki Shojo Noboru Adachi Issei Fujishiro University of Yamanashi Keio University

More information

Skinning Mesh Animations

Skinning Mesh Animations Doug L. James, Christopher D. Twigg Carnegie Mellon University presented by Johannes Schmid 1 Outline Introduction & Motivation Overview & Details Results Discussion 2 Introduction Mesh sequence: 3 General

More information

Animation. CS 465 Lecture 22

Animation. CS 465 Lecture 22 Animation CS 465 Lecture 22 Animation Industry production process leading up to animation What animation is How animation works (very generally) Artistic process of animation Further topics in how it works

More information

Clothed and Naked Human Shapes Estimation from a Single Image

Clothed and Naked Human Shapes Estimation from a Single Image Clothed and Naked Human Shapes Estimation from a Single Image Yu Guo, Xiaowu Chen, Bin Zhou, and Qinping Zhao State Key Laboratory of Virtual Reality Technology and Systems School of Computer Science and

More information

CSE452 Computer Graphics

CSE452 Computer Graphics CSE452 Computer Graphics Lecture 19: From Morphing To Animation Capturing and Animating Skin Deformation in Human Motion, Park and Hodgins, SIGGRAPH 2006 CSE452 Lecture 19: From Morphing to Animation 1

More information

Free-Form Deformation and Other Deformation Techniques

Free-Form Deformation and Other Deformation Techniques Free-Form Deformation and Other Deformation Techniques Deformation Deformation Basic Definition Deformation: A transformation/mapping of the positions of every particle in the original object to those

More information

Inverse Kinematics for Reduced Deformable Models

Inverse Kinematics for Reduced Deformable Models To appear in SIGGRAPH 2006. Inverse Kinematics for Reduced Deformable Models Robert W. Sumner Kevin G. Der ETH Zu rich Examples Computer Science and Artificial Intelligence Laboratory Massachusetts Institute

More information

Inverse Kinematics for Reduced Deformable Models

Inverse Kinematics for Reduced Deformable Models Inverse Kinematics for Reduced Deformable Models Kevin G. Der Robert W. Sumner Jovan Popović Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology ETH Zürich Examples

More information

Animations. Hakan Bilen University of Edinburgh. Computer Graphics Fall Some slides are courtesy of Steve Marschner and Kavita Bala

Animations. Hakan Bilen University of Edinburgh. Computer Graphics Fall Some slides are courtesy of Steve Marschner and Kavita Bala Animations Hakan Bilen University of Edinburgh Computer Graphics Fall 2017 Some slides are courtesy of Steve Marschner and Kavita Bala Animation Artistic process What are animators trying to do? What tools

More information

Dynamic Geometry Processing

Dynamic Geometry Processing Dynamic Geometry Processing EG 2012 Tutorial Will Chang, Hao Li, Niloy Mitra, Mark Pauly, Michael Wand Tutorial: Dynamic Geometry Processing 1 Articulated Global Registration Introduction and Overview

More information

Announcements: Quiz. Animation, Motion Capture, & Inverse Kinematics. Last Time? Today: How do we Animate? Keyframing. Procedural Animation

Announcements: Quiz. Animation, Motion Capture, & Inverse Kinematics. Last Time? Today: How do we Animate? Keyframing. Procedural Animation Announcements: Quiz Animation, Motion Capture, & Inverse Kinematics On Friday (3/1), in class One 8.5x11 sheet of notes allowed Sample quiz (from a previous year) on website Focus on reading comprehension

More information

Deformation Transfer for Triangle Meshes

Deformation Transfer for Triangle Meshes Deformation Transfer for Triangle Meshes Robert W. Sumner Jovan Popović Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Figure 1: Deformation transfer copies

More information

Computational Design. Stelian Coros

Computational Design. Stelian Coros Computational Design Stelian Coros Schedule for presentations February 3 5 10 12 17 19 24 26 March 3 5 10 12 17 19 24 26 30 April 2 7 9 14 16 21 23 28 30 Send me: ASAP: 3 choices for dates + approximate

More information

Animation. Motion over time

Animation. Motion over time Animation Animation Motion over time Animation Motion over time Usually focus on character animation but environment is often also animated trees, water, fire, explosions, Animation Motion over time Usually

More information

Animation. Keyframe animation. CS4620/5620: Lecture 30. Rigid motion: the simplest deformation. Controlling shape for animation

Animation. Keyframe animation. CS4620/5620: Lecture 30. Rigid motion: the simplest deformation. Controlling shape for animation Keyframe animation CS4620/5620: Lecture 30 Animation Keyframing is the technique used for pose-to-pose animation User creates key poses just enough to indicate what the motion is supposed to be Interpolate

More information

Markerless Motion Capture with Multi-view Structured Light

Markerless Motion Capture with Multi-view Structured Light Markerless Motion Capture with Multi-view Structured Light Ricardo R. Garcia, Avideh Zakhor; UC Berkeley; Berkeley, CA (a) (c) Figure 1: Using captured partial scans of (a) front and (b) back to generate

More information

Articulated Characters

Articulated Characters Articulated Characters Skeleton A skeleton is a framework of rigid body bones connected by articulated joints Used as an (invisible?) armature to position and orient geometry (usually surface triangles)

More information

CS 775: Advanced Computer Graphics. Lecture 4: Skinning

CS 775: Advanced Computer Graphics. Lecture 4: Skinning CS 775: Advanced Computer Graphics Lecture 4: http://www.okino.com/conv/skinning.htm Binding Binding Always done in a standard rest or bind pose. Binding Always done in a standard rest or bind pose. Associate

More information

Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior

Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior Fast Nonrigid Mesh Registration with a Data-Driven Deformation Prior David C. Schneider and Peter Eisert Fraunhofer Heinrich Hertz Institute Einsteinufer 37, 10587 Berlin, Germany {david.schneider,eisert}@hhi.fraunhofer.de

More information

Template Based Mesh Completion

Template Based Mesh Completion Template Based Mesh Completion Vladislav Kraevoy Alla Sheffer Department of Computer Science Problem Given mesh with holes (& multiple components) complete holes and gaps Topology Connectivity Geometry

More information

COMP 175 COMPUTER GRAPHICS. Lecture 10: Animation. COMP 175: Computer Graphics March 12, Erik Anderson 08 Animation

COMP 175 COMPUTER GRAPHICS. Lecture 10: Animation. COMP 175: Computer Graphics March 12, Erik Anderson 08 Animation Lecture 10: Animation COMP 175: Computer Graphics March 12, 2018 1/37 Recap on Camera and the GL Matrix Stack } Go over the GL Matrix Stack 2/37 Topics in Animation } Physics (dynamics, simulation, mechanics)

More information

Homework 2 Questions? Animation, Motion Capture, & Inverse Kinematics. Velocity Interpolation. Handing Free Surface with MAC

Homework 2 Questions? Animation, Motion Capture, & Inverse Kinematics. Velocity Interpolation. Handing Free Surface with MAC Homework 2 Questions? Animation, Motion Capture, & Inverse Kinematics Velocity Interpolation Original image from Foster & Metaxas, 1996 In 2D: For each axis, find the 4 closest face velocity samples: Self-intersecting

More information

Video based Animation Synthesis with the Essential Graph. Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes

Video based Animation Synthesis with the Essential Graph. Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes Video based Animation Synthesis with the Essential Graph Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes Goal Given a set of 4D models, how to generate realistic motion from user specified

More information

Animation of 3D surfaces.

Animation of 3D surfaces. Animation of 3D surfaces Motivations When character animation is controlled by skeleton set of hierarchical joints joints oriented by rotations the character shape still needs to be visible: visible =

More information

Human body animation. Computer Animation. Human Body Animation. Skeletal Animation

Human body animation. Computer Animation. Human Body Animation. Skeletal Animation Computer Animation Aitor Rovira March 2010 Human body animation Based on slides by Marco Gillies Human Body Animation Skeletal Animation Skeletal Animation (FK, IK) Motion Capture Motion Editing (retargeting,

More information

Learning Articulated Skeletons From Motion

Learning Articulated Skeletons From Motion Learning Articulated Skeletons From Motion Danny Tarlow University of Toronto, Machine Learning with David Ross and Richard Zemel (and Brendan Frey) August 6, 2007 Point Light Displays It's easy for humans

More information

Pose Space Deformation A unified Approach to Shape Interpolation and Skeleton-Driven Deformation

Pose Space Deformation A unified Approach to Shape Interpolation and Skeleton-Driven Deformation Pose Space Deformation A unified Approach to Shape Interpolation and Skeleton-Driven Deformation J.P. Lewis Matt Cordner Nickson Fong Presented by 1 Talk Outline Character Animation Overview Problem Statement

More information

Surface Registration. Gianpaolo Palma

Surface Registration. Gianpaolo Palma Surface Registration Gianpaolo Palma The problem 3D scanning generates multiple range images Each contain 3D points for different parts of the model in the local coordinates of the scanner Find a rigid

More information

A Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras

A Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras A Model-based Approach to Rapid Estimation of Body Shape and Postures Using Low-Cost Depth Cameras Abstract Byoung-Keon D. PARK*, Matthew P. REED University of Michigan, Transportation Research Institute,

More information

Last Time? Animation, Motion Capture, & Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation

Last Time? Animation, Motion Capture, & Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation Last Time? Animation, Motion Capture, & Inverse Kinematics Navier-Stokes Equations Conservation of Momentum & Mass Incompressible Flow Today How do we animate? Keyframing Procedural Animation Physically-Based

More information

Animation. CS 4620 Lecture 32. Cornell CS4620 Fall Kavita Bala

Animation. CS 4620 Lecture 32. Cornell CS4620 Fall Kavita Bala Animation CS 4620 Lecture 32 Cornell CS4620 Fall 2015 1 What is animation? Modeling = specifying shape using all the tools we ve seen: hierarchies, meshes, curved surfaces Animation = specifying shape

More information

To Do. History of Computer Animation. These Lectures. 2D and 3D Animation. Computer Animation. Foundations of Computer Graphics (Spring 2010)

To Do. History of Computer Animation. These Lectures. 2D and 3D Animation. Computer Animation. Foundations of Computer Graphics (Spring 2010) Foundations of Computer Graphics (Spring 2010) CS 184, Lecture 24: Animation http://inst.eecs.berkeley.edu/~cs184 To Do Submit HW 4 (today) Start working on HW 5 (can be simple add-on) Many slides courtesy

More information

Animation. CS 4620 Lecture 33. Cornell CS4620 Fall Kavita Bala

Animation. CS 4620 Lecture 33. Cornell CS4620 Fall Kavita Bala Animation CS 4620 Lecture 33 Cornell CS4620 Fall 2015 1 Announcements Grading A5 (and A6) on Monday after TG 4621: one-on-one sessions with TA this Friday w/ prior instructor Steve Marschner 2 Quaternions

More information

Animation Lecture 10 Slide Fall 2003

Animation Lecture 10 Slide Fall 2003 Animation Lecture 10 Slide 1 6.837 Fall 2003 Conventional Animation Draw each frame of the animation great control tedious Reduce burden with cel animation layer keyframe inbetween cel panoramas (Disney

More information

Registration of Dynamic Range Images

Registration of Dynamic Range Images Registration of Dynamic Range Images Tan-Chi Ho 1,2 Jung-Hong Chuang 1 Wen-Wei Lin 2 Song-Sun Lin 2 1 Department of Computer Science National Chiao-Tung University 2 Department of Applied Mathematics National

More information

Chapter 9 Animation System

Chapter 9 Animation System Chapter 9 Animation System 9.1 Types of Character Animation Cel Animation Cel animation is a specific type of traditional animation. A cel is a transparent sheet of plastic on which images can be painted

More information

Synthesizing Realistic Facial Expressions from Photographs

Synthesizing Realistic Facial Expressions from Photographs Synthesizing Realistic Facial Expressions from Photographs 1998 F. Pighin, J Hecker, D. Lischinskiy, R. Szeliskiz and D. H. Salesin University of Washington, The Hebrew University Microsoft Research 1

More information

Animation, Motion Capture, & Inverse Kinematics. Announcements: Quiz

Animation, Motion Capture, & Inverse Kinematics. Announcements: Quiz Animation, Motion Capture, & Inverse Kinematics Announcements: Quiz On Tuesday (3/10), in class One 8.5x11 sheet of notes allowed Sample quiz (from a previous year) on website Focus on reading comprehension

More information

CS201: Computer Vision Introduction to Tracking

CS201: Computer Vision Introduction to Tracking CS201: Computer Vision Introduction to Tracking John Magee 18 November 2014 Slides courtesy of: Diane H. Theriault Question of the Day How can we represent and use motion in images? 1 What is Motion? Change

More information

Topics in Computer Animation

Topics in Computer Animation Topics in Computer Animation Animation Techniques Artist Driven animation The artist draws some frames (keyframing) Usually in 2D The computer generates intermediate frames using interpolation The old

More information

Last Time? Animation, Motion Capture, & Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation

Last Time? Animation, Motion Capture, & Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation Last Time? Animation, Motion Capture, & Inverse Kinematics Navier-Stokes Equations Conservation of Momentum & Mass Incompressible Flow Today How do we animate? Keyframing Procedural Animation Physically-Based

More information

Animation of 3D surfaces

Animation of 3D surfaces Animation of 3D surfaces 2013-14 Motivations When character animation is controlled by skeleton set of hierarchical joints joints oriented by rotations the character shape still needs to be visible: visible

More information

04 - Normal Estimation, Curves

04 - Normal Estimation, Curves 04 - Normal Estimation, Curves Acknowledgements: Olga Sorkine-Hornung Normal Estimation Implicit Surface Reconstruction Implicit function from point clouds Need consistently oriented normals < 0 0 > 0

More information

Analyzing Muscle Activity and Force with Skin Shape Captured by Non-contact Visual Sensor

Analyzing Muscle Activity and Force with Skin Shape Captured by Non-contact Visual Sensor Analyzing Muscle Activity and Force with Skin Shape Captured by Non-contact Visual Sensor Ryusuke Sagawa 1, Yusuke Yoshiyasu 1, Alexander Alspach 2, Ko Ayusawa 1, Katsu Yamane 2,3, and Adrian Hilton 4

More information

Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time

Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time Rapid Skin: Estimating the 3D Human Pose and Shape in Real-Time Matthias Straka, Stefan Hauswiesner, Matthias Rüther, and Horst Bischof Institute for Computer Graphics and Vision Graz University of Technology,

More information

TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA

TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi 1, Francois de Sorbier 1 and Hideo Saito 1 1 Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi,

More information

Articulated Structure from Motion through Ellipsoid Fitting

Articulated Structure from Motion through Ellipsoid Fitting Int'l Conf. IP, Comp. Vision, and Pattern Recognition IPCV'15 179 Articulated Structure from Motion through Ellipsoid Fitting Peter Boyi Zhang, and Yeung Sam Hung Department of Electrical and Electronic

More information

Animation, Motion Capture, & Inverse Kinematics

Animation, Motion Capture, & Inverse Kinematics Animation, Motion Capture, & Inverse Kinematics Pop Worksheet! Teams of 2. SOMEONE YOU HAVEN T ALREADY WORKED WITH Enumerate all cases (including rotations) of the 2D version of Marching Cubes, labeling

More information

Real-Time Enveloping with Rotational Regression. Robert Yuanbo Wang

Real-Time Enveloping with Rotational Regression. Robert Yuanbo Wang Real-Time Enveloping with Rotational Regression by Robert Yuanbo Wang Submitted to the Department of Electrical Engineering and Computer Science in partial fulfillment of the requirements for the degree

More information

Last Time? Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation

Last Time? Inverse Kinematics. Today. Keyframing. Physically-Based Animation. Procedural Animation Last Time? Inverse Kinematics Navier-Stokes Equations Conservation of Momentum & Mass Incompressible Flow Today How do we animate? Keyframing Procedural Animation Physically-Based Animation Forward and

More information

The Line of Action: an Intuitive Interface for Expressive Character Posing. Martin Guay, Marie-Paule Cani, Rémi Ronfard

The Line of Action: an Intuitive Interface for Expressive Character Posing. Martin Guay, Marie-Paule Cani, Rémi Ronfard The Line of Action: an Intuitive Interface for Expressive Character Posing Martin Guay, Marie-Paule Cani, Rémi Ronfard LJK, INRIA, Université de Grenoble [S.Lee and J. Buscema, Drawing Comics the Marvel

More information

3D Modeling techniques

3D Modeling techniques 3D Modeling techniques 0. Reconstruction From real data (not covered) 1. Procedural modeling Automatic modeling of a self-similar objects or scenes 2. Interactive modeling Provide tools to computer artists

More information

Robust Human Body Shape and Pose Tracking

Robust Human Body Shape and Pose Tracking Robust Human Body Shape and Pose Tracking Chun-Hao Huang 1 Edmond Boyer 2 Slobodan Ilic 1 1 Technische Universität München 2 INRIA Grenoble Rhône-Alpes Marker-based motion capture (mocap.) Adventages:

More information

Grasp Recognition using a 3D Articulated Model and Infrared Images

Grasp Recognition using a 3D Articulated Model and Infrared Images Grasp Recognition using a 3D Articulated Model and Infrared Images Koichi Ogawara Institute of Industrial Science, Univ. of Tokyo, Tokyo, Japan Jun Takamatsu Institute of Industrial Science, Univ. of Tokyo,

More information

Character animation Christian Miller CS Fall 2011

Character animation Christian Miller CS Fall 2011 Character animation Christian Miller CS 354 - Fall 2011 Exam 2 grades Avg = 74.4, std. dev. = 14.4, min = 42, max = 99 Characters Everything is important in an animation But people are especially sensitive

More information

Subdivision Surfaces. Course Syllabus. Course Syllabus. Modeling. Equivalence of Representations. 3D Object Representations

Subdivision Surfaces. Course Syllabus. Course Syllabus. Modeling. Equivalence of Representations. 3D Object Representations Subdivision Surfaces Adam Finkelstein Princeton University COS 426, Spring 2003 Course Syllabus I. Image processing II. Rendering III. Modeling IV. Animation Image Processing (Rusty Coleman, CS426, Fall99)

More information

Introduction to Computer Graphics. Animation (1) May 19, 2016 Kenshi Takayama

Introduction to Computer Graphics. Animation (1) May 19, 2016 Kenshi Takayama Introduction to Computer Graphics Animation (1) May 19, 2016 Kenshi Takayama Skeleton-based animation Simple Intuitive Low comp. cost https://www.youtube.com/watch?v=dsonab58qva 2 Representing a pose using

More information

Data-Driven Human Model Estimation for Realtime Motion Capture

Data-Driven Human Model Estimation for Realtime Motion Capture Data-Driven Human Model Estimation for Realtime Motion Capture Le Su b,1, Lianjun Liao a,c,d,1, Wenpeng Zhai b, Shihong Xia a, a Institute of Computing Technology, CAS, Beijing, 100190 b Civil Aviation

More information

6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, :05-12pm Two hand-written sheet of notes (4 pages) allowed 1 SSD [ /17]

6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, :05-12pm Two hand-written sheet of notes (4 pages) allowed 1 SSD [ /17] 6.837 Introduction to Computer Graphics Final Exam Tuesday, December 20, 2011 9:05-12pm Two hand-written sheet of notes (4 pages) allowed NAME: 1 / 17 2 / 12 3 / 35 4 / 8 5 / 18 Total / 90 1 SSD [ /17]

More information

Rigging / Skinning. based on Taku Komura, Jehee Lee and Charles B.Own's slides

Rigging / Skinning. based on Taku Komura, Jehee Lee and Charles B.Own's slides Rigging / Skinning based on Taku Komura, Jehee Lee and Charles B.Own's slides Skeletal Animation Victoria 2 CSE 872 Dr. Charles B. Owen Advanced Computer Graphics Skinning http://www.youtube.com/watch?

More information

This week. CENG 732 Computer Animation. Warping an Object. Warping an Object. 2D Grid Deformation. Warping an Object.

This week. CENG 732 Computer Animation. Warping an Object. Warping an Object. 2D Grid Deformation. Warping an Object. CENG 732 Computer Animation Spring 2006-2007 Week 4 Shape Deformation Animating Articulated Structures: Forward Kinematics/Inverse Kinematics This week Shape Deformation FFD: Free Form Deformation Hierarchical

More information

Single-View Dressed Human Modeling via Morphable Template

Single-View Dressed Human Modeling via Morphable Template Single-View Dressed Human Modeling via Morphable Template Lin Wang 1, Kai Jiang 2, Bin Zhou 1, Qiang Fu 1, Kan Guo 1, Xiaowu Chen 1 1 State Key Laboratory of Virtual Reality Technology and Systems School

More information

Registration of Deformable Objects

Registration of Deformable Objects Registration of Deformable Objects Christopher DeCoro Includes content from: Consistent Mesh Parameterizations, Praun et. al, Siggraph 2001 The Space of Human Body Shapes, Allen et. al, Siggraph 2003 Shape-based

More information

A Pose Invariant Statistical Shape Model for Human Bodies

A Pose Invariant Statistical Shape Model for Human Bodies Abstract A Pose Invariant Statistical Shape Model for Human Bodies Matteo COLAIANNI* 1, Michael ZOLLHÖFER 1, Jochen SÜßMUTH 2, Bettina SEIDER 2, Günther GREINER 1 1 Computer Graphics Group, University

More information

Comparison of Default Patient Surface Model Estimation Methods

Comparison of Default Patient Surface Model Estimation Methods Comparison of Default Patient Surface Model Estimation Methods Xia Zhong 1, Norbert Strobel 2, Markus Kowarschik 2, Rebecca Fahrig 2, Andreas Maier 1,3 1 Pattern Recognition Lab, Friedrich-Alexander-Universität

More information

Introduction and Overview

Introduction and Overview CS 523: Computer Graphics, Spring 2009 Shape Modeling Introduction and Overview 1/28/2009 1 Geometric Modeling To describe any reallife object on the computer must start with shape (2D/3D) Geometry processing

More information

Speech Driven Synthesis of Talking Head Sequences

Speech Driven Synthesis of Talking Head Sequences 3D Image Analysis and Synthesis, pp. 5-56, Erlangen, November 997. Speech Driven Synthesis of Talking Head Sequences Peter Eisert, Subhasis Chaudhuri,andBerndGirod Telecommunications Laboratory, University

More information

Nonrigid Registration using Free-Form Deformations

Nonrigid Registration using Free-Form Deformations Nonrigid Registration using Free-Form Deformations Hongchang Peng April 20th Paper Presented: Rueckert et al., TMI 1999: Nonrigid registration using freeform deformations: Application to breast MR images

More information

Skeleton Based As-Rigid-As-Possible Volume Modeling

Skeleton Based As-Rigid-As-Possible Volume Modeling Skeleton Based As-Rigid-As-Possible Volume Modeling Computer Science Department, Rutgers University As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There

More information

How Much Geometry Lies in The Laplacian?

How Much Geometry Lies in The Laplacian? How Much Geometry Lies in The Laplacian? Encoding and recovering the discrete metric on triangle meshes Distance Geometry Workshop in Bad Honnef, November 23, 2017 Maks Ovsjanikov Joint with: E. Corman,

More information

Fast and precise kinematic skeleton extraction of 3D dynamic meshes

Fast and precise kinematic skeleton extraction of 3D dynamic meshes Fast and precise kinematic skeleton extraction of 3D dynamic meshes Julien Tierny, Jean-Philippe Vandeborre, Mohamed Daoudi To cite this version: Julien Tierny, Jean-Philippe Vandeborre, Mohamed Daoudi.

More information

CS354 Computer Graphics Character Animation and Skinning

CS354 Computer Graphics Character Animation and Skinning Slide Credit: Don Fussell CS354 Computer Graphics Character Animation and Skinning Qixing Huang April 9th 2018 Instance Transformation Start with a prototype object (a symbol) Each appearance of the object

More information

Estimating 3D Human Shapes from Measurements

Estimating 3D Human Shapes from Measurements Estimating 3D Human Shapes from Measurements Stefanie Wuhrer Chang Shu March 19, 2012 arxiv:1109.1175v2 [cs.cv] 16 Mar 2012 Abstract The recent advances in 3-D imaging technologies give rise to databases

More information

Thiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00. Topic (Research Paper):

Thiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00. Topic (Research Paper): Thiruvarangan Ramaraj CS525 Graphics & Scientific Visualization Spring 2007, Presentation I, February 28 th 2007, 14:10 15:00 Topic (Research Paper): Jinxian Chai and Jessica K. Hodgins, Performance Animation

More information

PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO

PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO Stefan Krauß, Juliane Hüttl SE, SoSe 2011, HU-Berlin PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO 1 Uses of Motion/Performance Capture movies games, virtual environments biomechanics, sports science,

More information

MOTION CAPTURE DATA PROCESSING - MOTION EDITING / RETARGETING - MOTION CONTROL / GRAPH - INVERSE KINEMATIC. Alexandre Meyer Master Informatique

MOTION CAPTURE DATA PROCESSING - MOTION EDITING / RETARGETING - MOTION CONTROL / GRAPH - INVERSE KINEMATIC. Alexandre Meyer Master Informatique 1 MOTION CAPTURE DATA PROCESSING - MOTION EDITING / RETARGETING - MOTION CONTROL / GRAPH - INVERSE KINEMATIC Alexandre Meyer Master Informatique Overview: Motion data processing In this course Motion editing

More information

TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA

TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi, Francois de Sorbier and Hideo Saito Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi, Kohoku-ku,

More information

Morphable model of quadrupeds skeletons for animating 3D animals

Morphable model of quadrupeds skeletons for animating 3D animals Eurographics/ACM SIGGRAPH Symposium on Computer Animation (2005) K. Anjyo, P. Faloutsos (Editors) Morphable model of quadrupeds skeletons for animating 3D animals Lionel Reveret, Laurent Favreau, Christine

More information

Shape and Expression Space of Real istic Human Faces

Shape and Expression Space of Real istic Human Faces 8 5 2006 5 Vol8 No5 JOURNAL OF COMPU TER2AIDED DESIGN & COMPU TER GRAPHICS May 2006 ( 0087) (peiyuru @cis. pku. edu. cn) : Canny ; ; ; TP394 Shape and Expression Space of Real istic Human Faces Pei Yuru

More information

Advances in Forensic Anthropology

Advances in Forensic Anthropology Advances in Forensic Anthropology Technology Transition Workshop Improving Forensic Facial Reproduction Using Empirical Modeling During this session, attendees will learn of an approach for forensic facial

More information

Shape Matching. Michael Kazhdan ( /657)

Shape Matching. Michael Kazhdan ( /657) Shape Matching Michael Kazhdan (601.457/657) Overview Intro General Approach Minimum SSD Descriptor Goal Given a database of 3D models, and given a query shape, find the database models that are most similar

More information

CS 231. Deformation simulation (and faces)

CS 231. Deformation simulation (and faces) CS 231 Deformation simulation (and faces) Deformation BODY Simulation Discretization Spring-mass models difficult to model continuum properties Simple & fast to implement and understand Finite Element

More information

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science.

Colorado School of Mines. Computer Vision. Professor William Hoff Dept of Electrical Engineering &Computer Science. Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Statistical Models for Shape and Appearance Note some material for these slides came from Algorithms

More information

CS-184: Computer Graphics. Today. Forward kinematics Inverse kinematics. Wednesday, November 12, Pin joints Ball joints Prismatic joints

CS-184: Computer Graphics. Today. Forward kinematics Inverse kinematics. Wednesday, November 12, Pin joints Ball joints Prismatic joints CS-184: Computer Graphics Lecture #18: Forward and Prof. James O Brien University of California, Berkeley V2008-F-18-1.0 1 Today Forward kinematics Inverse kinematics Pin joints Ball joints Prismatic joints

More information

3D Models from Range Sensors. Gianpaolo Palma

3D Models from Range Sensors. Gianpaolo Palma 3D Models from Range Sensors Gianpaolo Palma Who Gianpaolo Palma Researcher at Visual Computing Laboratory (ISTI-CNR) Expertise: 3D scanning, Mesh Processing, Computer Graphics E-mail: gianpaolo.palma@isti.cnr.it

More information

A Data-Driven Approach for 3D Human Body Pose Reconstruction from a Kinect Sensor

A Data-Driven Approach for 3D Human Body Pose Reconstruction from a Kinect Sensor Journal of Physics: Conference Series PAPER OPEN ACCESS A Data-Driven Approach for 3D Human Body Pose Reconstruction from a Kinect Sensor To cite this article: Li Yao et al 2018 J. Phys.: Conf. Ser. 1098

More information

Advanced Graphics and Animation

Advanced Graphics and Animation Advanced Graphics and Animation Character Marco Gillies and Dan Jones Goldsmiths Aims and objectives By the end of the lecture you will be able to describe How 3D characters are animated Skeletal animation

More information

A Data-driven Approach to Human-body Cloning Using a Segmented Body Database

A Data-driven Approach to Human-body Cloning Using a Segmented Body Database 15th Pacific Conference on Computer Graphics and Applications A Data-driven Approach to Human-body Cloning Using a Segmented Body Database Pengcheng Xi National Research Council of Canada pengcheng.xi@nrc-cnrc.gc.ca

More information

Advanced Computer Graphics

Advanced Computer Graphics G22.2274 001, Fall 2009 Advanced Computer Graphics Project details and tools 1 Project Topics Computer Animation Geometric Modeling Computational Photography Image processing 2 Optimization All projects

More information

Game Programming. Bing-Yu Chen National Taiwan University

Game Programming. Bing-Yu Chen National Taiwan University Game Programming Bing-Yu Chen National Taiwan University Character Motion Hierarchical Modeling Character Animation Motion Editing 1 Hierarchical Modeling Connected primitives 2 3D Example: A robot arm

More information

Animation II: Soft Object Animation. Watt and Watt Ch.17

Animation II: Soft Object Animation. Watt and Watt Ch.17 Animation II: Soft Object Animation Watt and Watt Ch.17 Soft Object Animation Animation I: skeletal animation forward kinematics x=f(φ) inverse kinematics φ=f -1 (x) Curves and Surfaces I&II: parametric

More information

CS 231. Deformation simulation (and faces)

CS 231. Deformation simulation (and faces) CS 231 Deformation simulation (and faces) 1 Cloth Simulation deformable surface model Represent cloth model as a triangular or rectangular grid Points of finite mass as vertices Forces or energies of points

More information

Matching and Recognition in 3D. Based on slides by Tom Funkhouser and Misha Kazhdan

Matching and Recognition in 3D. Based on slides by Tom Funkhouser and Misha Kazhdan Matching and Recognition in 3D Based on slides by Tom Funkhouser and Misha Kazhdan From 2D to 3D: Some Things Easier No occlusion (but sometimes missing data instead) Segmenting objects often simpler From

More information