Skeleton Based As-Rigid-As-Possible Volume Modeling

Similar documents
Graphical Models. Robust mesh editing using Laplacian coordinates. Shaoting Zhang, Junzhou Huang, Dimitris N. Metaxas. abstract

Computational Design. Stelian Coros

Def De orma f tion orma Disney/Pixar

10 - ARAP and Linear Blend Skinning

Skeletal deformation

CS 523: Computer Graphics, Spring Shape Modeling. Skeletal deformation. Andrew Nealen, Rutgers, /12/2011 1

CSE452 Computer Graphics

Easy modeling generate new shapes by deforming existing ones

Scanning Real World Objects without Worries 3D Reconstruction

Advanced Computer Graphics

2D Shape Deformation Using Nonlinear Least Squares Optimization

Large Mesh Deformation Using the Volumetric Graph Laplacian

Laplacian Meshes. COS 526 Fall 2016 Slides from Olga Sorkine and Yaron Lipman

Mesh-Based Inverse Kinematics

Geometric Modeling and Processing

Locally Injective Mappings

L10 Layered Depth Normal Images. Introduction Related Work Structured Point Representation Boolean Operations Conclusion

05 Mesh Animation. Steve Marschner CS5625 Spring 2016

Surface Reconstruction. Gianpaolo Palma

CS 523: Computer Graphics, Spring Shape Modeling. Differential Geometry of Surfaces

DeepSketch2Face: A Deep Learning Based Sketching System for 3D Face and Caricature Modeling. Part I: User Studies on the Interface

Texturing and Deforming Meshes with Casual Images. I-Chao Shen Yi-Hau Wang Yu-Mei Chen Bing-Yu Chen. National Taiwan University

PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO

SCAPE: Shape Completion and Animation of People

Skeleton-Based Shape Deformation using Simplex Transformations

Animation of 3D surfaces.

Example-Based Skeleton Extraction. Scott Schaefer Can Yuksel

04 - Normal Estimation, Curves

Flexible Fitting of Atomic Models into Cryo-EM Density Maps Guided by

05 - Surfaces. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Daniele Panozzo

Hand-Tracking Based Interactive 3D Modeling using Mesh Deformation

Shape Optimization for Consumer-Level 3D Printing

Encoding Meshes in Differential Coordinates

CageIK: Dual-Laplacian Cage-Based Inverse Kinematics

Morphing of Triangular Meshes in Shape Space

CS 523: Computer Graphics, Spring Differential Geometry of Surfaces

Registration of Dynamic Range Images

Ping Tan. Simon Fraser University

As-Rigid-As-Possible Shape Manipulation

Deformation II. Disney/Pixar

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

Sketch Based Image Deformation

Animation of 3D surfaces

Introduction to Computer Graphics. Image Processing (1) June 8, 2017 Kenshi Takayama

Introduction to Computer Graphics. Modeling (3) April 27, 2017 Kenshi Takayama

calibrated coordinates Linear transformation pixel coordinates

Local patch blind spectral watermarking method for 3D graphics

Example-Based Retargeting of Human Motion to Arbitrary Mesh Models

Mesh Repairing and Simplification. Gianpaolo Palma

The Future of Natural User Interaction

Capture of Arm-Muscle deformations using a Depth Camera

Deformation Transfer for Triangle Meshes

Monocular Tracking and Reconstruction in Non-Rigid Environments

Manifold Parameterization

Dynamic Geometry Processing

A Developer s Survey of Polygonal Simplification algorithms. CS 563 Advanced Topics in Computer Graphics Fan Wu Mar. 31, 2005

Surface Topology ReebGraph

Mesh Processing Pipeline

03 - Reconstruction. Acknowledgements: Olga Sorkine-Hornung. CSCI-GA Geometric Modeling - Spring 17 - Daniele Panozzo

Skinning Mesh Animations

Surface Registration. Gianpaolo Palma

Geometric Modeling and Processing

Robust Moving Least-squares Fitting with Sharp Features

Human pose estimation using Active Shape Models

Dynamic 2D/3D Registration for the Kinect

Special Topics in Visualization

Computing and Processing Correspondences with Functional Maps

Learning Articulated Skeletons From Motion

Interactive Mesh Deformation Using Equality-Constrained Least Squares

Construction of Left Ventricle 3D Shape Atlas from Cardiac MRI

Generating 3D Meshes from Range Data

Deformation Transfer for Detail-Preserving Surface Editing

Preparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers

Rectangling Panoramic Images via Warping

APPLICATION OF INTERACTIVE DEFORMATION TO ASSEMBLED MESH MODELS FOR CAE ANALYSIS

Simple Formulas for Quasiconformal Plane Deformations

Dynamic 3D Shape From Multi-viewpoint Images Using Deformable Mesh Model

SCIENCE CHINA Information Sciences. Received October 24, 2011; accepted January 6, 2012; published online March 16, 2012

Direct Computation of Minimal Rotation for Support Slimming

Final Project, Digital Geometry Processing

Metamorphosis of Planar Parametric Curves via Curvature Interpolation

Time Varying Surface Reconstruction from Multiview Video

Skeleton Driven Laplacian Volumetric Deformation

Clothed and Naked Human Shapes Estimation from a Single Image

arxiv: v1 [cs.gr] 14 Aug 2014

Development of 3D Model-based Morphometric Method for Assessment of Human Weight-bearing Joint. Taeho Kim

Robust Simulation of Sparsely Sampled Thin Features in SPH-Based Free Surface Flows

Deformable and Fracturing Objects

3D Photography: Epipolar geometry

A Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets

Introduction and Overview

Clustering in Registration of 3D Point Clouds

Animating Characters in Pictures

Shape Modeling with Point-Sampled Geometry

CSE 554 Lecture 7: Deformation II

Intrinsic Morphing of Compatible Triangulations. VITALY SURAZHSKY CRAIG GOTSMAN

Accurate Reconstruction by Interpolation

A Laplacian Based Approach for Free-Form Deformation of Sparse Low-degree IMplicit Surfaces

Geodesics in heat: A new approach to computing distance

Processing 3D Surface Data

Transcription:

Skeleton Based As-Rigid-As-Possible Volume Modeling Computer Science Department, Rutgers University

As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There have been many excellent methods. Olga Sorkine, et al,: Laplacian Surface Editing. SGP2004

As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There have been many excellent methods. Olga Sorkine, et al,: Laplacian Surface Editing. SGP2004 Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007

As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There have been many excellent methods. We are interested in the volume preservation. Olga Sorkine, et al,: Laplacian Surface Editing. SGP2004 Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007

As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There have been many excellent methods. We are interested in the volume preservation. VGL is a good approach. However, we do not want to break the manifoldness of ARAP surface modeling or sacrificing the speed. Olga Sorkine, et al,: Laplacian Surface Editing. SGP2004 Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Kun Zhou, et al,: Large mesh deformation using the volumetric graph Laplacian. SIGGRAPH 2005

As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There have been many excellent methods. We are interested in the volume preservation. VGL is a good approach. However, we do not want to break the manifoldness of ARAP surface modeling or sacrificing the speed. We do it by leveraging the skeleton information. Olga Sorkine, et al,: Laplacian Surface Editing. SGP2004 Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Kun Zhou, et al,: Large mesh deformation using the volumetric graph Laplacian. SIGGRAPH 2005

with C 0 continuity Laplacian coordinates represent each point as the weighted difference between such point and its neighborhoods.

with C 0 continuity Laplacian coordinates represent each point as the weighted difference between such point and its neighborhoods. Given original coordinates V, the connectivity, and m control points, the reconstructed object V can be obtained by minimizing: LV δ 2 2 + Σm i=1 v c i v ci 2 2

with C 0 continuity Laplacian coordinates represent each point as the weighted difference between such point and its neighborhoods. Given original coordinates V, the connectivity, and m control points, the reconstructed object V can be obtained by minimizing: LV δ 2 2 + Σm i=1 v c i v ci 2 2 [ ] L V I = c [ ] δ V c

with C 0 continuity Laplacian coordinates represent each point as the weighted difference between such point and its neighborhoods. Given original coordinates V, the connectivity, and m control points, the reconstructed object V can be obtained by minimizing: LV δ 2 2 + Σm i=1 v c i v ci 2 2 [ ] L V I = c [ ] δ V c When rotations are large, the deformation may not be natural.

with C 0 continuity Laplacian coordinates represent each point as the weighted difference between such point and its neighborhoods. Given original coordinates V, the connectivity, and m control points, the reconstructed object V can be obtained by minimizing: LV δ 2 2 + Σm i=1 v c i v ci 2 2 [ ] L V I = c [ ] δ V c When rotations are large, the deformation may not be natural.

Iterate two steps to recover rotations: Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Olga Sorkine: Least-Squares Rigid Motion Using SVD

Iterate two steps to recover rotations: Step1: Initial guess from solving naive LSE. Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Olga Sorkine: Least-Squares Rigid Motion Using SVD

Iterate two steps to recover rotations: Step1: Initial guess from solving naive LSE. Step2: Find optimal rotations, then update the linear system (edge length preserving). Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Olga Sorkine: Least-Squares Rigid Motion Using SVD

Iterate two steps to recover rotations: Step1: Initial guess from solving naive LSE. Step2: Find optimal rotations, then update the linear system (edge length preserving). Robustness, simplicity, efficiency. Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Olga Sorkine: Least-Squares Rigid Motion Using SVD

Iterate two steps to recover rotations: Step1: Initial guess from solving naive LSE. Step2: Find optimal rotations, then update the linear system (edge length preserving). Robustness, simplicity, efficiency. However, there is no volume preserving constraint. Olga Sorkine and Marc Alexa: As-Rigid-As-Possible Surface Modeling. Eurographics SGP2007 Olga Sorkine: Least-Squares Rigid Motion Using SVD

Use volumetric mesh? Manifoldness, computational complexity, etc.

Use volumetric mesh? Manifoldness, computational complexity, etc. Use both the skeleton and edge length constraint to roughly preserve the volume, without breaking the manifoldness of ARAP or increasing the computation complexity. α Wij β

Use volumetric mesh? Manifoldness, computational complexity, etc. Use both the skeleton and edge length constraint to roughly preserve the volume, without breaking the manifoldness of ARAP or increasing the computation complexity. I c 0 L 0 L s [ V V s ] = δ V c δ s α Wij β

Use volumetric mesh? Manifoldness, computational complexity, etc. Use both the skeleton and edge length constraint to roughly preserve the volume, without breaking the manifoldness of ARAP or increasing the computation complexity. I c 0 L 0 L s [ V V s One-way coupling property. ] = δ V c δ s α Wij β

Mesh editing framework Manually define the skeleton.

Mesh editing framework Manually define the skeleton.

Mesh editing framework Manually define the skeleton. Evenly generate skeleton points, and connect them with surface vertices automatically.

Mesh editing framework Manually define the skeleton. Evenly generate skeleton points, and connect them with surface vertices automatically.

Mesh editing framework Manually define the skeleton. Evenly generate skeleton points, and connect them with surface vertices automatically. Manually select anchor points (bottom) and control points (top).

Mesh editing framework Manually define the skeleton. Evenly generate skeleton points, and connect them with surface vertices automatically. Manually select anchor points (bottom) and control points (top). Interactively deform the shape.

Experimental settings Experimental settings Results The C++ implementation was run on a Intel Core2 Quad 2.40GHz CPU with 8G RAM. We compare the linear LSE, ARAP surface modeling and our method. We tested on the cactus model (620 vertices, 1, 236 polygons) and the horse model (2, 482 vertices, 4, 960 polygons). The relative root mean square errors of edge lengths and volume magnitudes are reported.

Results Experimental settings Results Model RRMS-E RE-V Times (b) 0.126 0.453 0.017 (c) 0.074 0.131 0.024 (d) 0.075 0.056 0.025

Results Experimental settings Results Model RRMS-E RE-V Times (b) 0.068 0.356 0.117 (c) 0.040 0.125 0.121

Conclusions Experimental settings Results We proposed an approach to approximately preserve the volume without breaking the manifoldness of traditional ARAP or increasing the computational complexity. Our method is easy-to-implement and may be useful to systems relying on ARAP techniques. Limitations: Skeleton generation; complex skeletons; self intersection.

Experimental settings Results Thanks for listening.