Registration of Dynamic Range Images
|
|
- Aldous Jennings
- 5 years ago
- Views:
Transcription
1 Registration of Dynamic Range Images Tan-Chi Ho 1,2 Jung-Hong Chuang 1 Wen-Wei Lin 2 Song-Sun Lin 2 1 Department of Computer Science National Chiao-Tung University 2 Department of Applied Mathematics National Chiao-Tung University Abstract With the recent advances in shape acquisition devices, range images of high quality can be captured at video frame rate. The key ingredient in the reconstruction of 3D model from the image sequence is the registration process that finds the point correspondence between range images. In this paper, we will review recent advances in the registration of dynamic range images and discuss some open problems. 1 Introduction Describing the shape of 3D object using mathematical formulations is a fundamental task in the computer graphics. Such modeling process is traditionally tackled by artists using some 3D modeling tools in the computer. However, even with the most experienced artists, creating a virtual object to mimic a real world object is still a great challenge. With the recent advances in the shape acquisition devices, the modeling of 3D object can be done by capturing the range images of real world object from the camera, and reconstructs the mesh directly from the range images. Several problems arise in the modeling process using the range acquisition devices. Range images captured from the camera may not always cover all the surface regions of the 3D object due to the occlusion. Such missing regions will lead to holes in the reconstructed mesh. Multiple range images are usually acquired to overcome such problem. The registration of range images is the process of aligning all the range images into a common 3D space, so that a complete mesh can be reconstructed from these range images. In this paper, we review recent advances in the registration of dynamic range images. We denote the range image as the 2D image which each pixel is associated with a depth value from the captured camera to the object. We also denote the point cloud to be the set of 3D points corresponding to the pixels in the range image. The dynamic range images are the sequences of range image captured from a camera dynamically. The acquired real world object can be either rigid (object shape will not change) or deformable (object shape changes during acquisition). 2 Registration of Dynamic Range Images For the rigid object, the registration process can be formulated as the rigid transformation between point clouds. The rigid transformation can be computed using the Iterative Closet Point (ICP) algorithm [1] which iteratively minimizes the square 1
2 distance between the two point clouds until converged. The registration process for deformable object, however, cannot be described by simply a rigid transformation since the object shape is changed during acquisition. Each point in the point cloud may have its own transformation to other point clouds, and how the correspondence is established from each point in one point cloud to the other point clouds is the major challenge. The object surface deformed during time can be described as a kinematic space-time surface in 4D space, defined by the 3D position and the time. Each acquired point cloud will partially fit a slice along the time axis on the kinematic space-time surface, and may be incomplete due to the occlusion at acquisition. The correspondence can be traced on the continuous 4D space-time surface. One simple way is based on the image tracking technique such as optical flow [2]. The correspondences of pixels in the range image between consecutive frames are established by tracing the colors or some intrinsic surface properties derived from the point clouds. However, the tracking process does not take the 3D surface information into account, missing surface regions due to the occlusion are unable to be interpreted. The most widely used method in tracing the correspondence is based on the surface deformation model [3]. In such method, a template mesh similar to the acquired object is usually required, and fits the acquired point cloud in each time step using the surface deformation method. The deformation method used to guide the template mesh should minimize the shape difference between the template mesh and the acquired point cloud, while preserve the rigidity of the template mesh and the smoothness of motion. Once we have the deformation sequence of the template mesh through the range image sequence, the correspondence can be established through the deformed template mesh. With the consideration of shape rigidity and motion smoothness during deformation, invisible surface regions in the single point cloud can be revealed in the template mesh. Some recent researches focus on finding the correspondence between range images through a common parameterization domain. The work by Popa et al. [4] tried to establish the correspondence between point clouds of a deformable object using a common parameterization domain. Their work is based on the observation that the reconstructed meshes between two consecutive frames are almost isometric. When applying a stretch minimizing parameterization to these meshes, their parameterizations are likely to be identical. Thus, surface correspondence can be established in the common parameterization domain. To achieve such goal, they first find some feature points in the image space and trace them through the entire sequence using optical flow [2]. These feature points are served as hard constraints during the registration process. Then, cross parameterization are established by fixing these feature points in the parameterization domain and minimizing the stretch for the rest points. Another issue in the registration of dynamic range images for deformable object is the global consistency. The methods we described above trace the deformable object locally between two consecutive frames. However, the consistency may not be preserved if we look at the entire acquired sequence. Each of the locally matching may introduce some correspondence error, such error will be accumulated through the sequence. Another more serious problem is the topological inconsistency. For example, two separate object parts may be welded into a connected region in the reconstructed mesh in some frames and separated in others due to the occlusion. The registration method based on the surface deformation model and template mesh [3] are usually immuned to the topological inconsistency since the topology of object is restricted to the tem- 2
3 plate mesh. However, template mesh similar to the acquired object may be difficult to be obtained. Several researches focused on preserve the topological consistency without the aid of template mesh [4, 5]. The key idea is to compare the topology of the reconstructed meshes in different time steps in a hierarchical manner. The process begins by checking and fixing the topological inconsistency between two consecutive frames, and merges them into a common sequence. Then, neighboring sequences are checked and fixed for topological inconsistency, and then merged into a biger common sequence. This process is performed iteratively until all the frames in the acquired range image sequence are merged. 3 Discussion and Future Work We conclude some problems in the current registration of the dynamic range images. The current range acquisition hardware can achieve 60 frames per second or above. However, the time for registration still takes minutes to hours for just a few seconds of sequence. Most of the time is spent on the tracing of dependence between frames. The gap between the time for data acquisition and processing limits the usability of such device in some time critical applications. Another problem is the global consistency. The template mesh approach is effective and robust to preserve the consistency of topology. However, the requirement of template mesh similar to the acquired object is a challenge for user especially when the acquired object has complex topological structure. Approaches without template mesh have problem in robustness, and require lots of time in the hierarchical processing. We are devoted to speed up the registration process for the dynamic range images. Several possible approaches may achieve such goal. First, the coherence between consecutive frames can be assumed to be strong in modern acquisition devices. Computing time can be saved under such assumption since the space for searching the correspondence is relative smaller. Another possible approach is to reduce the computational complexity of general registration method to some specific target applications. For example, the motion of the articulated models can be described by a small set of rigid transformations, which highly reduce the complexity of the correspondence tracing process. References [1] G. Turk and M. Levoy, Zippered polygon meshes from range images, in ACM SIG- GRAPH, [2] J.-Y. Bouguet, Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm, in Tech Report, Intel Corp. Microsoft Research Lab., Intel Corporation, Microsoft Research Lab., [3] H. Li, B. Adams, L. J. Guibas, and M. Pauly, Robust single-view geometry and motion reconstruction, ACM Transactions on Graphics (Proc. SIGGRAPH ASIA), vol. 28, p. 1, Dec [4] T. Popa, I. South-Dickinson, D. Bradley, A. Sheffer, and W. Heidrich, Globally Consistent Space-Time Reconstruction, Computer Graphics Forum (Proc. Eurographics Symposium on Geometry Processing), vol. 29, pp , Sept [5] M. Wand, B. Adams, M. Ovsjanikov, A. Berner, M. Bokeloh, P. Jenke, L. Guibas, H.-P. Seidel, and A. Schilling, Efficient reconstruction of nonrigid shape and motion from real-time 3D scanner data, ACM Transactions on Graphics, vol. 28, pp. 1 15, Apr
4 Registration of Dynamic Range Images Tan-Chi Ho 1,2 Jung-Hong Chuang 1 Wen-Wei Lin 2 Song-Sun Lin 2 1Department of Computer Science 2Department of Applied Mathematics National Chiao Tung University
5 Recent Advance in 3D Model Acquisition Capture the 3D object surface directly from camera with distance information. Range image Structured light scanner Microsoft Kinect Light Stage [Vlasic et al. 2009]
6 Problems of Single View Holes & missing parts Self occlusion
7 Practical Solution Capture multiple views to cover all missing parts. Fix object, rotate camera Fix camera, rotate object
8 Registration of Range Images To align the point sets in different range images to a common 3D space.?
9 Rigid Registration The object will not deform Rigid transformation between point sets of two range images. α ( p) = Rp + T α ( p) R : rotation matrix T : translation vector
10 Rigid Registration Find the rigid transformation that minimizes the distances between matched points. min R,T ( ) q i 2 w α p i i p i i qi wi : confidence of point pi
11 Iterative Closet Point (ICP) 1.For each point pi, finds the closest point qi as the match pair. 2.Discard match pairs that are too far apart. 3.Find the rigid transformation. 4.Iterate until converge. p i q i [Turk & Levoy 1994]
12 Global Registration Problem of ICP Converge only if the start positions of two frames are closed. Global Registration 4 PCS (Point Congruent Sets) [Aiger et al. 2008] Shape descriptors [Gelfand et al. 2005]
13 Dynamic Range Images Single view, capture dynamically Deformable object Assumptions Single view Orientation of two point sets are globally aligned.
14 Difficulty Shape changes during acquisition. Correspondence between two frames is not just a rigid transformation
15 Space-Time Surface The surface is deformed with respect to the time. sample spacing (s) Surface in 4D space (x, y, z, t) t j+1 t j t j 1 t j time spacing [Mitra et al. 2007]
16 Space-Time Registration Trace the correspondence on the space-time surface. Image tracking (optical flow) Surface deformation Cross parameterization [Mitra et al. 2007]
17 Optical Flow The point sets are acquired from camera. Trace the pixel correspondence between range images.
18 Optical Flow Problems Standard optical flow method assumes the pixel color is invariant during deformation. Lack of knowledge about the 3D shape. Unable to interpret the missing surface information due to occlusion.
19 Surface Deformation Observation The acquired target is an object with deformation. Trace the correspondence between frames using surface deformation methods.
20 Surface Deformation Deformation model Control mesh. For a surface point p, its position after deformation is m j =1 p = w j p gj : control nodes surrounding p Rj : rotation matrix Tj : translation vector ( ) R j p g j ( ) + g j + T j [Sumner et al. 2007]
21 Surface Deformation Surface tracking Fit the control mesh of frame i to i+1 by finding the Rj and Tj that minimize the error E = E fit + α smooth E smooth + α rigid E rigid [Li et al. 2009] fitting error deformation energy
22 deformation graph source target 798 nodes deformation graph 44,233 vts. source 44,360 vts. target Figure 5: Registration of a facial expression. The 5: deformation and E Figure Registrationenergies of a facialesmooth expression. T is concentrated on the cheeks. This example also contains a substantial ro is concentrated on the cheeks. Thisglobal example optimization. optimization. Surface Deformation deformation graph 336 nodes Deformation process source 120,555 vts. target 119,518 vts. Figure 6: Registration of a human torso. As indicated by Econf, large 1. Construct the control mesh (or template deformation graph mesh). deformation graph 336 nodes source target 336 nodes 120,555 vts. source 120,555 vts. initial alignment 119,518 vts. 11 fin Figure 6: Registration of a human torso. As in 2. Fit the Figure point 6: set of the first Registration of a frame. human torso. As indicated by E 3. Deform to the next frame by minimizing deformation graph source 138 nodes 37,773 vts. the energy function. 4. Establish initial conf, target 36,693 vts. large regions in the f initial alignment Control Figure 7: Registration of a bending arm. The poor quality of the con mesh correspondence. map of the fist explains why few reliable correspondences are found 5. Repeat 3-4 until final frame. deformation graph 138 nodes source 37,773 vts. source deformation graph 138 nodes source 37,773 vts. target 36,693 vts. input data N-ICP 1 target alignment of a bending final registration Figureinitial 7: Registration arm. The 36,693 vts. [Li et al. 2008] map of the fist explains why few reliable corre
23 Cross Parameterization Assumption If two near isometric surfaces are mapped to the same domain using stretch minimizing parameterization, their maps are likely to be identical. [Popa et al. 2010] Trace the correspondence in a common parameterization domain.
24 Cross Parameterization Registration process 1. Construct meshes for all frames. 2. Find the consistent patch pairs in two frames. 3. Consistent parameterization for each pair. 4. Pack the patches to achieve global mapping.
25 Cross Parameterization How to find common patches Trace feature points using optical flow. Hard constraint Consistently grow patches in both frames from a matched feature point pair. How to achieve consistent parameterization Align the matched feature point pairs in parameterization domain. [Popa et al. 2010]
26 Global Consistency Problems of local registration The matching error will be accumulated. Topological inconsistency [Popa et al. 2010]
27 Template Mesh Fit template to the models in the captured sequence using the surface deformation methods. input late wrapped template reconstruction [Li et al. 2009]
28 Template-Free Approach Bottom up approach Fix the inconsistency between two consecutive frames. Repeat until all frames are matched. [Popa et al. 2010]
29 Problems Computing time 60~ frames per second for acquisition. Minutes to hours for registration. Global consistency Template-based approaches. Template-free approaches.
30 Possible Solutions Reduce the fitting time by Assuming strong spatial coherence between frames. Applying optical flow as the initial guess. Restrict the registration to specific targets Facial animation - no topological inconsistency problem Articulated model - piecewise rigid transformation
31 References [Vlasic et al. 2009] Dynamic shape capture using multi-view photometric stereo, ACM SIGGRAPH Asia, [Turk & Levoy 1994] Zippered polygon meshes from range images, ACM SIGGRAPH, [Aiger et al. 2008] 4-points congruent sets for robust pairwise surface registration, ACM SIGGRAPH, [Gelfand et al. 2005] Robust Global Registration, Eurographics Symposium on Geometry Processing, [Mitra et al. 2007] [Li et al. 2008] Dynamic geometry registration, Eurographics Symposium on Geometry Processing, Global Correspondence Optimization for Non-Rigid Registration of Depth Scans, Eurographics Symposium on Geometry Processing, [Sumner et al. 2007] Embedded deformation for shape manipulation, ACM SIGGRAPH, [Li et al. 2009] [Popa et al. 2010] Robust single-view geometry and motion reconstruction, ACM SIGGRAPH Asia, Globally Consistent Space-Time Reconstruction, Eurographics Symposium on Geometry Processing, 2010.
Surface Registration. Gianpaolo Palma
Surface Registration Gianpaolo Palma The problem 3D scanning generates multiple range images Each contain 3D points for different parts of the model in the local coordinates of the scanner Find a rigid
More informationCorrespondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov
Shape Matching & Correspondence CS 468 Geometry Processing Algorithms Maks Ovsjanikov Wednesday, October 27 th 2010 Overall Goal Given two shapes, find correspondences between them. Overall Goal Given
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationDynamic Geometry Processing
Dynamic Geometry Processing EG 2012 Tutorial Will Chang, Hao Li, Niloy Mitra, Mark Pauly, Michael Wand Tutorial: Dynamic Geometry Processing 1 Articulated Global Registration Introduction and Overview
More informationStructured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov
Structured Light II Johannes Köhler Johannes.koehler@dfki.de Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov Introduction Previous lecture: Structured Light I Active Scanning Camera/emitter
More informationAccurate 3D Face and Body Modeling from a Single Fixed Kinect
Accurate 3D Face and Body Modeling from a Single Fixed Kinect Ruizhe Wang*, Matthias Hernandez*, Jongmoo Choi, Gérard Medioni Computer Vision Lab, IRIS University of Southern California Abstract In this
More information3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.
3D Computer Vision Structured Light II Prof. Didier Stricker Kaiserlautern University http://ags.cs.uni-kl.de/ DFKI Deutsches Forschungszentrum für Künstliche Intelligenz http://av.dfki.de 1 Introduction
More information3D Models from Range Sensors. Gianpaolo Palma
3D Models from Range Sensors Gianpaolo Palma Who Gianpaolo Palma Researcher at Visual Computing Laboratory (ISTI-CNR) Expertise: 3D scanning, Mesh Processing, Computer Graphics E-mail: gianpaolo.palma@isti.cnr.it
More informationGeometric Registration for Deformable Shapes 1.1 Introduction
Geometric Registration for Deformable Shapes 1.1 Introduction Overview Data Sources and Applications Problem Statement Overview Presenters Will Chang University of California at San Diego, USA Hao Li ETH
More informationMarkerless Motion Capture with Multi-view Structured Light
Markerless Motion Capture with Multi-view Structured Light Ricardo R. Garcia, Avideh Zakhor; UC Berkeley; Berkeley, CA (a) (c) Figure 1: Using captured partial scans of (a) front and (b) back to generate
More informationDynamic Human Surface Reconstruction Using a Single Kinect
2013 13th International Conference on Computer-Aided Design and Computer Graphics Dynamic Human Surface Reconstruction Using a Single Kinect Ming Zeng Jiaxiang Zheng Xuan Cheng Bo Jiang Xinguo Liu Software
More informationStructured light 3D reconstruction
Structured light 3D reconstruction Reconstruction pipeline and industrial applications rodola@dsi.unive.it 11/05/2010 3D Reconstruction 3D reconstruction is the process of capturing the shape and appearance
More informationDynamic 2D/3D Registration for the Kinect
Dynamic 2D/3D Registration for the Kinect Sofien Bouaziz Mark Pauly École Polytechnique Fédérale de Lausanne Abstract Image and geometry registration algorithms are an essential component of many computer
More informationDeposited on: 1 st May 2012
Xiang, G., Ju, X., and Holt, P. (2010) Automatic facial expression tracking for 4D range scans. In: 2010 International Conference on Computer Graphics and Virtual Reality, 12-15 July 2010, Las Vegas, Nevada,
More informationChaplin, Modern Times, 1936
Chaplin, Modern Times, 1936 [A Bucket of Water and a Glass Matte: Special Effects in Modern Times; bonus feature on The Criterion Collection set] Multi-view geometry problems Structure: Given projections
More informationGeometric Registration for Deformable Shapes 3.3 Advanced Global Matching
Geometric Registration for Deformable Shapes 3.3 Advanced Global Matching Correlated Correspondences [ASP*04] A Complete Registration System [HAW*08] In this session Advanced Global Matching Some practical
More informationProgressive Shape Models
Progressive Shape Models Antoine Letouzey, Edmond Boyer To cite this version: Antoine Letouzey, Edmond Boyer. Progressive Shape Models. CVPR - Computer Vision and Patern Recognition - 2012, Jun 2012, Providence,
More informationGenerating 3D Meshes from Range Data
Princeton University COS598B Lectures on 3D Modeling Generating 3D Meshes from Range Data Robert Kalnins Robert Osada Overview Range Images Optical Scanners Error sources and solutions Range Surfaces Mesh
More informationJoint Alignment and Stitching of Non Overlapping Meshes
Joint Alignment and Stitching of Non Overlapping Meshes Susana Brandão 1 and João P. Costeira 2 and Manuela Veloso 3 Abstract We contribute a novel algorithm for aligning and stitching non-overlapping
More informationComputational Design. Stelian Coros
Computational Design Stelian Coros Schedule for presentations February 3 5 10 12 17 19 24 26 March 3 5 10 12 17 19 24 26 30 April 2 7 9 14 16 21 23 28 30 Send me: ASAP: 3 choices for dates + approximate
More informationCompu&ng Correspondences in Geometric Datasets. 4.2 Symmetry & Symmetriza/on
Compu&ng Correspondences in Geometric Datasets 4.2 Symmetry & Symmetriza/on Symmetry Invariance under a class of transformations Reflection Translation Rotation Reflection + Translation + global vs. partial
More informationReconstruction of complete 3D object model from multi-view range images.
Header for SPIE use Reconstruction of complete 3D object model from multi-view range images. Yi-Ping Hung *, Chu-Song Chen, Ing-Bor Hsieh, Chiou-Shann Fuh Institute of Information Science, Academia Sinica,
More informationAbstract We present a system which automatically generates a 3D face model from a single frontal image of a face. Our system consists of two component
A Fully Automatic System To Model Faces From a Single Image Zicheng Liu Microsoft Research August 2003 Technical Report MSR-TR-2003-55 Microsoft Research Microsoft Corporation One Microsoft Way Redmond,
More informationSCAPE: Shape Completion and Animation of People
SCAPE: Shape Completion and Animation of People By Dragomir Anguelov, Praveen Srinivasan, Daphne Koller, Sebastian Thrun, Jim Rodgers, James Davis From SIGGRAPH 2005 Presentation for CS468 by Emilio Antúnez
More informationScanning Real World Objects without Worries 3D Reconstruction
Scanning Real World Objects without Worries 3D Reconstruction 1. Overview Feng Li 308262 Kuan Tian 308263 This document is written for the 3D reconstruction part in the course Scanning real world objects
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 12 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationPhysical based Rigging
Physical based Rigging Dinghuang Ji Introduction Computer animation has been a popular research topic since 1970s, when the first parametric facial model is proposed[0]. In the recent few years, a lot
More information3D Scanning. Qixing Huang Feb. 9 th Slide Credit: Yasutaka Furukawa
3D Scanning Qixing Huang Feb. 9 th 2017 Slide Credit: Yasutaka Furukawa Geometry Reconstruction Pipeline This Lecture Depth Sensing ICP for Pair-wise Alignment Next Lecture Global Alignment Pairwise Multiple
More information3D Photography: Active Ranging, Structured Light, ICP
3D Photography: Active Ranging, Structured Light, ICP Kalin Kolev, Marc Pollefeys Spring 2013 http://cvg.ethz.ch/teaching/2013spring/3dphoto/ Schedule (tentative) Feb 18 Feb 25 Mar 4 Mar 11 Mar 18 Mar
More information5.2 Surface Registration
Spring 2018 CSCI 621: Digital Geometry Processing 5.2 Surface Registration Hao Li http://cs621.hao-li.com 1 Acknowledgement Images and Slides are courtesy of Prof. Szymon Rusinkiewicz, Princeton University
More informationMotion Capture using Body Mounted Cameras in an Unknown Environment
Motion Capture using Body Mounted Cameras in an Unknown Environment Nam Vo Taeyoung Kim Siddharth Choudhary 1. The Problem Motion capture has been recently used to provide much of character motion in several
More informationACQUIRING 3D models of deforming objects in real-life is
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 1 Robust Non-rigid Motion Tracking and Surface Reconstruction Using L 0 Regularization Kaiwen Guo, Feng Xu, Yangang Wang, Yebin Liu, Member, IEEE
More informationLandmark Detection on 3D Face Scans by Facial Model Registration
Landmark Detection on 3D Face Scans by Facial Model Registration Tristan Whitmarsh 1, Remco C. Veltkamp 2, Michela Spagnuolo 1 Simone Marini 1, Frank ter Haar 2 1 IMATI-CNR, Genoa, Italy 2 Dept. Computer
More informationProcessing 3D Surface Data
Processing 3D Surface Data Computer Animation and Visualisation Lecture 17 Institute for Perception, Action & Behaviour School of Informatics 3D Surfaces 1 3D surface data... where from? Iso-surfacing
More informationTEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA
TEXTURE OVERLAY ONTO NON-RIGID SURFACE USING COMMODITY DEPTH CAMERA Tomoki Hayashi 1, Francois de Sorbier 1 and Hideo Saito 1 1 Graduate School of Science and Technology, Keio University, 3-14-1 Hiyoshi,
More informationRigid ICP registration with Kinect
Rigid ICP registration with Kinect Students: Yoni Choukroun, Elie Semmel Advisor: Yonathan Aflalo 1 Overview.p.3 Development of the project..p.3 Papers p.4 Project algorithm..p.6 Result of the whole body.p.7
More informationFace Tracking. Synonyms. Definition. Main Body Text. Amit K. Roy-Chowdhury and Yilei Xu. Facial Motion Estimation
Face Tracking Amit K. Roy-Chowdhury and Yilei Xu Department of Electrical Engineering, University of California, Riverside, CA 92521, USA {amitrc,yxu}@ee.ucr.edu Synonyms Facial Motion Estimation Definition
More informationTexturing and Deforming Meshes with Casual Images. I-Chao Shen Yi-Hau Wang Yu-Mei Chen Bing-Yu Chen. National Taiwan University
Volume xx (200y), Number z, pp. 1 6 Texturing and Deforming Meshes with Casual Images I-Chao Shen Yi-Hau Wang Yu-Mei Chen Bing-Yu Chen National Taiwan University arxiv:1809.03144v1 [cs.gr] 10 Sep 2018
More informationRotation Invariant Image Registration using Robust Shape Matching
International Journal of Electronic and Electrical Engineering. ISSN 0974-2174 Volume 7, Number 2 (2014), pp. 125-132 International Research Publication House http://www.irphouse.com Rotation Invariant
More information#$ % $ $& "$%% " $ '$ " '
! " This section of the course covers techniques for pairwise (i.e., scanto-scan) and global (i.e., involving more than 2 scans) alignment, given that the algorithms are constrained to obtain a rigid-body
More informationMotion Estimation. There are three main types (or applications) of motion estimation:
Members: D91922016 朱威達 R93922010 林聖凱 R93922044 謝俊瑋 Motion Estimation There are three main types (or applications) of motion estimation: Parametric motion (image alignment) The main idea of parametric motion
More informationShape and Appearance from Images and Range Data
SIGGRAPH 2000 Course on 3D Photography Shape and Appearance from Images and Range Data Brian Curless University of Washington Overview Range images vs. point clouds Registration Reconstruction from point
More informationENGN D Photography / Spring 2018 / SYLLABUS
ENGN 2502 3D Photography / Spring 2018 / SYLLABUS Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized cameras routinely
More informationRobust Single-View Geometry and Motion Reconstruction
Robust Single-View Geometry and Motion Reconstruction Hao Li ETH Zurich Bart Adams KU Leuven Leonidas J. Guibas Stanford University Mark Pauly ETH Zurich Figure 1: Reconstruction of complex deforming objects
More information3D object recognition used by team robotto
3D object recognition used by team robotto Workshop Juliane Hoebel February 1, 2016 Faculty of Computer Science, Otto-von-Guericke University Magdeburg Content 1. Introduction 2. Depth sensor 3. 3D object
More informationA novel 3D torso image reconstruction procedure using a pair of digital stereo back images
Modelling in Medicine and Biology VIII 257 A novel 3D torso image reconstruction procedure using a pair of digital stereo back images A. Kumar & N. Durdle Department of Electrical & Computer Engineering,
More information3D Photography: Stereo
3D Photography: Stereo Marc Pollefeys, Torsten Sattler Spring 2016 http://www.cvg.ethz.ch/teaching/3dvision/ 3D Modeling with Depth Sensors Today s class Obtaining depth maps / range images unstructured
More informationPosture Invariant Surface Description and Feature Extraction
Posture Invariant Surface Description and Feature Extraction Stefanie Wuhrer 1 Zouhour Ben Azouz 2 Chang Shu 1 Abstract We propose a posture invariant surface descriptor for triangular meshes. Using intrinsic
More informationFinding Structure in Large Collections of 3D Models
Finding Structure in Large Collections of 3D Models Vladimir Kim Adobe Research Motivation Explore, Analyze, and Create Geometric Data Real Virtual Motivation Explore, Analyze, and Create Geometric Data
More informationComputer Vision/Graphics -- Dr. Chandra Kambhamettu for SIGNEWGRAD 11/24/04
Computer Vision/Graphics -- Dr. Chandra Kambhamettu for SIGNEWGRAD 11/24/04 Computer Vision : Understanding of images Computer Graphics : Creation of images Courses offered: CISC4/640, CISC4/689, CISC849,
More informationGeometric Modeling Summer Semester 2012 Point-Based Modeling
Geometric Modeling Summer Semester 2012 Point-Based Modeling 3D Scanning MLS-Surfaces Reconstruction & Registration Overview... Topics: Subdivision Surfaces Implicit Functions Variational Modeling Point-Based
More informationSurface Reconstruction. Gianpaolo Palma
Surface Reconstruction Gianpaolo Palma Surface reconstruction Input Point cloud With or without normals Examples: multi-view stereo, union of range scan vertices Range scans Each scan is a triangular mesh
More informationSemi-Supervised Hierarchical Models for 3D Human Pose Reconstruction
Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction Atul Kanaujia, CBIM, Rutgers Cristian Sminchisescu, TTI-C Dimitris Metaxas,CBIM, Rutgers 3D Human Pose Inference Difficulties Towards
More informationAn Abstraction Technique for Producing 3D Visual Contents
, pp.353-360 http://dx.doi.org/10.14257/ijmue.2013.8.5.35 An Abstraction Technique for Producing 3D Visual Contents Kyungha Min Dept. of Digital Media, Sangmyung Univ., Seoul, Korea minkyungha@gmail.com
More informationMobility Fitting using 4D RANSAC
Eurographics Symposium on Geometry Processing 2016 Maks Ovsjanikov and Daniele Panozzo (Guest Editors) Volume 35 (2016), Number 5 Mobility Fitting using 4D RANSAC Hao Li 1 Guowei Wan 1 Honghua Li 1 Andrei
More informationINFO0948 Fitting and Shape Matching
INFO0948 Fitting and Shape Matching Renaud Detry University of Liège, Belgium Updated March 31, 2015 1 / 33 These slides are based on the following book: D. Forsyth and J. Ponce. Computer vision: a modern
More informationUser-assisted Segmentation and 3D Motion Tracking. Michael Fleder Sudeep Pillai Jeremy Scott
User-assisted Segmentation and 3D Motion Tracking Michael Fleder Sudeep Pillai Jeremy Scott 3D Object Tracking Virtual reality and animation Imitation in robotics Autonomous driving Augmented reality Motivation
More informationSpring 2010: Lecture 9. Ashutosh Saxena. Ashutosh Saxena
CS 4758/6758: Robot Learning Spring 2010: Lecture 9 Why planning and control? Video Typical Architecture Planning 0.1 Hz Control 50 Hz Does it apply to all robots and all scenarios? Previous Lecture: Potential
More informationLATEST TRENDS on APPLIED MATHEMATICS, SIMULATION, MODELLING
3D surface reconstruction of objects by using stereoscopic viewing Baki Koyuncu, Kurtuluş Küllü bkoyuncu@ankara.edu.tr kkullu@eng.ankara.edu.tr Computer Engineering Department, Ankara University, Ankara,
More informationFree-form 3D object reconstruction from range images. C. Schütz, T. Jost, H. Hügli
Free-form 3D object reconstruction from range images C. Schütz, T. Jost, H. Hügli Institute for Microtechnology University of Neuchatel, rue Breguet 2 CH-2000 Neuchatel, Switzerland email: christian.schutz@imt.unine.ch
More informationAlgorithm research of 3D point cloud registration based on iterative closest point 1
Acta Technica 62, No. 3B/2017, 189 196 c 2017 Institute of Thermomechanics CAS, v.v.i. Algorithm research of 3D point cloud registration based on iterative closest point 1 Qian Gao 2, Yujian Wang 2,3,
More informationGeometric Registration for Deformable Shapes 2.2 Deformable Registration
Geometric Registration or Deormable Shapes 2.2 Deormable Registration Variational Model Deormable ICP Variational Model What is deormable shape matching? Example? What are the Correspondences? Eurographics
More informationDynamic Time Warping for Binocular Hand Tracking and Reconstruction
Dynamic Time Warping for Binocular Hand Tracking and Reconstruction Javier Romero, Danica Kragic Ville Kyrki Antonis Argyros CAS-CVAP-CSC Dept. of Information Technology Institute of Computer Science KTH,
More informationGlobal Non-Rigid Alignment. Benedict J. Brown Katholieke Universiteit Leuven
Global Non-Rigid Alignment Benedict J. Brown Katholieke Universiteit Leuven 3-D Scanning Pipeline Acquisition Scanners acquire data from a single viewpoint 3-D Scanning Pipeline Acquisition Alignment 3-D
More informationApplying Synthetic Images to Learning Grasping Orientation from Single Monocular Images
Applying Synthetic Images to Learning Grasping Orientation from Single Monocular Images 1 Introduction - Steve Chuang and Eric Shan - Determining object orientation in images is a well-established topic
More informationPrototype-based Intraclass Pose Recognition of Partial 3D Scans
Prototype-based Intraclass Pose Recognition of Partial 3D Scans Jacob MONTIEL Hamid LAGA Masayuki NAKAJIMA Graduate School of Information Science and Engineering, Tokyo Institute of Technology Global Edge
More informationarxiv: v1 [cs.cv] 28 Sep 2018
Camera Pose Estimation from Sequence of Calibrated Images arxiv:1809.11066v1 [cs.cv] 28 Sep 2018 Jacek Komorowski 1 and Przemyslaw Rokita 2 1 Maria Curie-Sklodowska University, Institute of Computer Science,
More information3D Environment Reconstruction
3D Environment Reconstruction Using Modified Color ICP Algorithm by Fusion of a Camera and a 3D Laser Range Finder The 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems October 11-15,
More information3D Modeling from Range Images
1 3D Modeling from Range Images A Comprehensive System for 3D Modeling from Range Images Acquired from a 3D ToF Sensor Dipl.-Inf. March 22th, 2007 Sensor and Motivation 2 3D sensor PMD 1k-S time-of-flight
More informationEfficient 3D Shape Acquisition and Registration Using Hybrid Scanning Data
Efficient 3D Shape Acquisition and Registration Using Hybrid Scanning Data Hongwei Zheng, Dietmar Saupe, Markus Roth, Andreas Böhler and Peter Opuchlik Computer and Information Science, University of Konstanz,
More informationUse of Shape Deformation to Seamlessly Stitch Historical Document Images
Use of Shape Deformation to Seamlessly Stitch Historical Document Images Wei Liu Wei Fan Li Chen Jun Sun Satoshi Naoi In China, efforts are being made to preserve historical documents in the form of digital
More informationA Volumetric Method for Building Complex Models from Range Images
A Volumetric Method for Building Complex Models from Range Images Brian Curless Marc Levoy Computer Graphics Laboratory Stanford University Introduction Goal Given a set of aligned, dense range images,
More informationComplex Models from Range Images. A Volumetric Method for Building. Brian Curless. Marc Levoy. Computer Graphics Laboratory. Stanford University
A Volumetric Method for Building Complex Models from Range Images Computer Graphics Laboratory Stanford University Brian Curless Marc Levoy Introduction Goal Given a set of aligned, dense range images,
More informationPERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO
Stefan Krauß, Juliane Hüttl SE, SoSe 2011, HU-Berlin PERFORMANCE CAPTURE FROM SPARSE MULTI-VIEW VIDEO 1 Uses of Motion/Performance Capture movies games, virtual environments biomechanics, sports science,
More informationCSE 554 Lecture 7: Deformation II
CSE 554 Lecture 7: Deformation II Fall 2011 CSE554 Deformation II Slide 1 Review Rigid-body alignment Non-rigid deformation Intrinsic methods: deforming the boundary points An optimization problem Minimize
More informationResearch Proposal: Computational Geometry with Applications on Medical Images
Research Proposal: Computational Geometry with Applications on Medical Images MEI-HENG YUEH yueh@nctu.edu.tw National Chiao Tung University 1 Introduction My research mainly focuses on the issues of computational
More informationA Volumetric Method for Building Complex Models from Range Images
A Volumetric Method for Building Complex Models from Range Images 1. Briefly summarize the paper s contributions. Does it address a new problem? Does it present a new approach? Does it show new types of
More informationStereo vision. Many slides adapted from Steve Seitz
Stereo vision Many slides adapted from Steve Seitz What is stereo vision? Generic problem formulation: given several images of the same object or scene, compute a representation of its 3D shape What is
More information3D Modeling using multiple images Exam January 2008
3D Modeling using multiple images Exam January 2008 All documents are allowed. Answers should be justified. The different sections below are independant. 1 3D Reconstruction A Robust Approche Consider
More informationGeometric Modeling and Processing
Geometric Modeling and Processing Tutorial of 3DIM&PVT 2011 (Hangzhou, China) May 16, 2011 6. Mesh Simplification Problems High resolution meshes becoming increasingly available 3D active scanners Computer
More informationNon-Experts Shape Modeling for Dummies
Non-Experts Shape Modeling for Dummies (Modeling with Interchangeable Parts) Alla Sheffer (joint work with Vladislav Kraevoy & Dan Julius) Motivation - Easy creation of 3D Content Currently 3D modeling
More informationGeometric Modeling and Processing
Geometric Modeling and Processing Tutorial of 3DIM&PVT 2011 (Hangzhou, China) May 16, 2011 4. Geometric Registration 4.1 Rigid Registration Range Scanning: Reconstruction Set of raw scans Reconstructed
More informationSemi-Automatic Prediction of Landmarks on Human Models in Varying Poses
Semi-Automatic Prediction of Landmarks on Human Models in Varying Poses Stefanie Wuhrer Zouhour Ben Azouz Chang Shu National Research Council of Canada, Ottawa, Ontario, Canada {stefanie.wuhrer, zouhour.benazouz,
More informationLecture 16: Computer Vision
CS4442/9542b: Artificial Intelligence II Prof. Olga Veksler Lecture 16: Computer Vision Motion Slides are from Steve Seitz (UW), David Jacobs (UMD) Outline Motion Estimation Motion Field Optical Flow Field
More informationLecture 16: Computer Vision
CS442/542b: Artificial ntelligence Prof. Olga Veksler Lecture 16: Computer Vision Motion Slides are from Steve Seitz (UW), David Jacobs (UMD) Outline Motion Estimation Motion Field Optical Flow Field Methods
More informationRepresenting Moving Images with Layers. J. Y. Wang and E. H. Adelson MIT Media Lab
Representing Moving Images with Layers J. Y. Wang and E. H. Adelson MIT Media Lab Goal Represent moving images with sets of overlapping layers Layers are ordered in depth and occlude each other Velocity
More informationCS233: The Shape of Data Handout # 3 Geometric and Topological Data Analysis Stanford University Wednesday, 9 May 2018
CS233: The Shape of Data Handout # 3 Geometric and Topological Data Analysis Stanford University Wednesday, 9 May 2018 Homework #3 v4: Shape correspondences, shape matching, multi-way alignments. [100
More informationPersonal Navigation and Indoor Mapping: Performance Characterization of Kinect Sensor-based Trajectory Recovery
Personal Navigation and Indoor Mapping: Performance Characterization of Kinect Sensor-based Trajectory Recovery 1 Charles TOTH, 1 Dorota BRZEZINSKA, USA 2 Allison KEALY, Australia, 3 Guenther RETSCHER,
More informationAN ADAPTIVE MESH METHOD FOR OBJECT TRACKING
AN ADAPTIVE MESH METHOD FOR OBJECT TRACKING Mahdi Koohi 1 and Abbas Shakery 2 1 Department of Computer Engineering, Islamic Azad University, Shahr-e-Qods Branch,Tehran,Iran m.kohy@yahoo.com 2 Department
More informationRecognizing Deformable Shapes. Salvador Ruiz Correa (CSE/EE576 Computer Vision I)
Recognizing Deformable Shapes Salvador Ruiz Correa (CSE/EE576 Computer Vision I) Input 3-D Object Goal We are interested in developing algorithms for recognizing and classifying deformable object shapes
More information3D Editing System for Captured Real Scenes
3D Editing System for Captured Real Scenes Inwoo Ha, Yong Beom Lee and James D.K. Kim Samsung Advanced Institute of Technology, Youngin, South Korea E-mail: {iw.ha, leey, jamesdk.kim}@samsung.com Tel:
More informationMonocular Tracking and Reconstruction in Non-Rigid Environments
Monocular Tracking and Reconstruction in Non-Rigid Environments Kick-Off Presentation, M.Sc. Thesis Supervisors: Federico Tombari, Ph.D; Benjamin Busam, M.Sc. Patrick Ruhkamp 13.01.2017 Introduction Motivation:
More informationA Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets
A Multiresolutional Approach for Facial Motion Retargetting Using Subdivision Wavelets Kyungha Min and Moon-Ryul Jung Dept. of Media Technology, Graduate School of Media Communications, Sogang Univ., Seoul,
More informationSkeleton Based As-Rigid-As-Possible Volume Modeling
Skeleton Based As-Rigid-As-Possible Volume Modeling Computer Science Department, Rutgers University As-rigid-as-possible (ARAP) shape modeling is a popular technique to obtain natural deformations. There
More informationOctree-Based Obstacle Representation and Registration for Real-Time
Octree-Based Obstacle Representation and Registration for Real-Time Jaewoong Kim, Daesik Kim, Junghyun Seo, Sukhan Lee and Yeonchool Park* Intelligent System Research Center (ISRC) & Nano and Intelligent
More informationDeformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video
Deformable Mesh Model for Complex Multi-Object 3D Motion Estimation from Multi-Viewpoint Video Shohei NOBUHARA Takashi MATSUYAMA Graduate School of Informatics, Kyoto University Sakyo, Kyoto, 606-8501,
More informationExample-Based Skeleton Extraction. Scott Schaefer Can Yuksel
Example-Based Skeleton Extraction Scott Schaefer Can Yuksel Example-Based Deformation Examples Previous Work Mesh-based Inverse Kinematics [Sumner et al. 2005], [Der et al. 2006] Example-based deformation
More informationCGAL. Mesh Simplification. (Slides from Tom Funkhouser, Adam Finkelstein)
CGAL Mesh Simplification (Slides from Tom Funkhouser, Adam Finkelstein) Siddhartha Chaudhuri http://www.cse.iitb.ac.in/~cs749 In a nutshell Problem: Meshes have too many polygons for storage, rendering,
More informationSpatio-Temporal Fusion of Multiple View Video Rate 3D Surfaces
Spatio-Temporal Fusion of Multiple View Video Rate 3D Surfaces Gordon Collins and Adrian Hilton Centre for Speech Vision and Signal Processing University of Surrey A.Hilton@surrey.ac.uk Abstract We consider
More informationOverview. Augmented reality and applications Marker-based augmented reality. Camera model. Binary markers Textured planar markers
Augmented reality Overview Augmented reality and applications Marker-based augmented reality Binary markers Textured planar markers Camera model Homography Direct Linear Transformation What is augmented
More information