Preparation Meeting. Recent Advances in the Analysis of 3D Shapes. Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers

Similar documents
Geodesics in heat: A new approach to computing distance

Non-rigid shape correspondence by matching semi-local spectral features and global geodesic structures

Computing and Processing Correspondences with Functional Maps

Shape Classification and Cell Movement in 3D Matrix Tutorial (Part I)

Topology-Invariant Similarity and Diffusion Geometry

Data fusion and multi-cue data matching using diffusion maps

Geometric Data. Goal: describe the structure of the geometry underlying the data, for interpretation or summary

Semi-Supervised Hierarchical Models for 3D Human Pose Reconstruction

Manifold Learning Theory and Applications

STATISTICS AND ANALYSIS OF SHAPE

Correspondence. CS 468 Geometry Processing Algorithms. Maks Ovsjanikov

Survey of the Mathematics of Big Data

Detection and Characterization of Intrinsic Symmetry of 3D Shapes

Discrete Differential Geometry. Differential Geometry

Stable and Multiscale Topological Signatures

Shape Matching for 3D Retrieval and Recognition. Agenda. 3D collections. Ivan Sipiran and Benjamin Bustos

Dense Non-Rigid Shape Correspondence using Random Forests

Computational QC Geometry: A tool for Medical Morphometry, Computer Graphics & Vision

MPEG-7 Visual shape descriptors

RELATIVE SCALE ESTIMATION AND 3D REGISTRATION OF MULTI-MODAL GEOMETRY USING GROWING LEAST SQUARES

Computing and Processing Correspondences with Functional Maps

A Segmentation of Non-rigid Shape with Heat Diffuse

Mathematical Tools for 3D Shape Analysis and Description

Towards Multi-scale Heat Kernel Signatures for Point Cloud Models of Engineering Artifacts

Review for the Final

The correspondence problem. A classic problem. A classic problem. Deformation-Drive Shape Correspondence. Fundamental to geometry processing

Justin Solomon MIT, Spring

Computing and Processing Correspondences with Functional Maps

Discovering Similarities in 3D Data

Algorithms for 3D Isometric Shape Correspondence

Polygonal Meshes. Thomas Funkhouser Princeton University COS 526, Fall 2016

Deformation II. Disney/Pixar

Functional Maps: A Flexible Representation of Maps Between Shapes

Def De orma f tion orma Disney/Pixar

Writing a good seminar paper Seminar in Software and Service Engineering

Shape Modeling with Point-Sampled Geometry

Geometric Registration for Deformable Shapes 1.1 Introduction

Geometric Registration for Deformable Shapes 3.3 Advanced Global Matching

Computational Design. Stelian Coros

A Fully Hierarchical Approach for Finding Correspondences in Non-rigid Shapes

A Primer on Laplacians. Max Wardetzky. Institute for Numerical and Applied Mathematics Georg-August Universität Göttingen, Germany

Research in Computational Differential Geomet

Announcements. Recognition. Recognition. Recognition. Recognition. Homework 3 is due May 18, 11:59 PM Reading: Computer Vision I CSE 152 Lecture 14

Structured Light II. Thanks to Ronen Gvili, Szymon Rusinkiewicz and Maks Ovsjanikov

PHOG:Photometric and geometric functions for textured shape retrieval. Presentation by Eivind Kvissel

3D Deep Learning on Geometric Forms. Hao Su

Finding Structure in Large Collections of 3D Models

Computer Graphics Curves and Surfaces. Matthias Teschner

Su et al. Shape Descriptors - III

Bounded Distortion Mapping and Shape Deformation

Invariant shape similarity. Invariant shape similarity. Invariant similarity. Equivalence. Equivalence. Equivalence. Equal SIMILARITY TRANSFORMATION

Geometric Registration for Deformable Shapes 2.2 Deformable Registration

arxiv: v1 [cs.gr] 28 Sep 2013

ECS289: Scalable Machine Learning

An Evaluation of Volumetric Interest Points

Introduc1on to Computa1onal Manifolds and Applica1ons

3D Computer Vision. Structured Light II. Prof. Didier Stricker. Kaiserlautern University.

Specification and Computation of Warping and Morphing Transformations. Bruno Costa da Silva Microsoft Corp.

Topological Data Analysis

CS233: The Shape of Data Handout # 3 Geometric and Topological Data Analysis Stanford University Wednesday, 9 May 2018

Representing 3D models for alignment and recognition

Hierarchical matching of non-rigid shapes

PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Charles R. Qi* Hao Su* Kaichun Mo Leonidas J. Guibas

Seeing the unseen. Data-driven 3D Understanding from Single Images. Hao Su

Improving Shape retrieval by Spectral Matching and Meta Similarity

Homeomorphic Manifold Analysis (HMA): Generalized Separation of Style and Content on Manifolds

Video based Animation Synthesis with the Essential Graph. Adnane Boukhayma, Edmond Boyer MORPHEO INRIA Grenoble Rhône-Alpes

Recognizing Deformable Shapes. Salvador Ruiz Correa Ph.D. UW EE

1. Compare and order real numbers.

Efficient 3D shape co-segmentation from single-view point clouds using appearance and isometry priors

Simulation in Computer Graphics. Introduction. Matthias Teschner. Computer Science Department University of Freiburg

Mirror-symmetry in images and 3D shapes

Motivation. Parametric Curves (later Surfaces) Outline. Tangents, Normals, Binormals. Arclength. Advanced Computer Graphics (Fall 2010)

Shape analysis through geometric distributions

A Gromov-Hausdorff framework with diffusion geometry for topologically-robust non-rigid shape matching

The p-laplacian on Graphs with Applications in Image Processing and Classification

Surfaces: notes on Geometry & Topology

Digital Image Processing

Non-rigid shape correspondence using pointwise surface descriptors and metric structures

Face Recognition At-a-Distance Based on Sparse-Stereo Reconstruction

Research Article Polygon Morphing and Its Application in Orebody Modeling

VISUALIZING INTRINSIC ISOSURFACE VARIATION DUE TO UNCERTAINTY THROUGH HEAT KERNEL SIGNATURES

Gaussian and Mean Curvature Planar points: Zero Gaussian curvature and zero mean curvature Tangent plane intersects surface at infinity points Gauss C

Learning High-Level Feature by Deep Belief Networks for 3-D Model Retrieval and Recognition

Assoc. Prof. Yusuf Sahillioğlu

Learning Similarities for Rigid and Non-Rigid Object Detection

Characterizing Shape Using Conformal Factors

CS 534: Computer Vision Segmentation and Perceptual Grouping

Morphometric Analysis of Biomedical Images. Sara Rolfe 10/9/17

Module: 2 Finite Element Formulation Techniques Lecture 3: Finite Element Method: Displacement Approach

Intrinsic3D: High-Quality 3D Reconstruction by Joint Appearance and Geometry Optimization with Spatially-Varying Lighting

12 - Spatial And Skeletal Deformations. CSCI-GA Computer Graphics - Fall 16 - Daniele Panozzo

Modeling and Analyzing 3D Shapes using Clues from 2D Images. Minglun Gong Dept. of CS, Memorial Univ.

Statistics and Information Technology

Multi-Scale Free-Form Surface Description

Kernel Methods for Topological Data Analysis

CHAPTER 6 PERCEPTUAL ORGANIZATION BASED ON TEMPORAL DYNAMICS

Parameterization of Meshes

Matching and Recognition in 3D. Based on slides by Tom Funkhouser and Misha Kazhdan

Finding Surface Correspondences With Shape Analysis

Transcription:

Preparation Meeting Recent Advances in the Analysis of 3D Shapes Emanuele Rodolà Matthias Vestner Thomas Windheuser Daniel Cremers

What You Will Learn in the Seminar Get an overview on state of the art research in 3D shape analysis Be able to read and understand scientific publications Prepare and give a talk Write a scientific report

Preparation Please do not work on your topic completely alone Meet at least twice with your supervisor 2 x Deliver the report and discuss the slides with your supervisor

Presentation 30 40 slides (ca. 1-2 minutes per slide) Do not put too much information on the slides Recommended structure 1. Introduction, problem motivation, outline 2. Approach [3. Experimental Results] 4. Discussion 5. Summary (of scientific contributions)

Report Overview and main contributions of the assigned topic 6-10 pages Latex template available on the web page

Evaluation Criteria Attendance at each appointment is necessary Notice that many papers are not completely self-contained It may be important to check related articles or text books Report should be more detailed than original paper Own implementations and graphics (where feasible) are appreciated

Typical Problems in 3D shape analysis

Typical problems Correspondence Partial similarity Symmetry Representation

Typical problems Analysis of shape collections Feature detection Segmentation Description

Tools Linear algebra Metric spaces Optimization Differential geometry

Overview of Available Topics

Laplace-Beltrami Operator One of the key tools for 3D shape analysis Mathematical Background and Discretizations Two talks

Robust Region Detection via Consensus Segmentation of Deformable Shapes Detection of regions that are stable under many deformations Semantically meaningful segmentation Based on unsupervised learning

Probably approximately symmetric: Fast rigid symmetry detection with global guarantees Global symmetry detection in 3D shapes Theoretical guarantees to find the best (approximate) symmetry Uses a volumetric representation of the shapes

Global intrinsic symmetries of shapes Global symmetry detection when the shapes are allowed to deform Based on properties of the Laplace- Beltrami operator Formulated as a matching problem between the shape and itself

Scale-invariant heat kernel signatures for nonrigid shape recognition Pointwise feature descriptor Invariant to big class of deformations Based on heat diffusion and Fourier transform of the descriptor space

Geodesics in heat: A new approach to computing distance based on heat flow A method to compute geodesic distances based on heat diffusion An order of magnitude faster than state of the art Applicable to polygonal meshes, point clouds, as well as other representations

Intrinsic metric (distance function) More robust to noise than geodesic distance Biharmonic Distance

Functional Maps: A Flexible Representation of Maps Between Shapes Consider correspondences as linear operators Compact representation Related to Fourier analysis on manifolds =

Coupled quasi-harmonic bases Interclass matching Learning the best functional bases for a given pair of shapes

Compressed manifold modes for mesh processing Locally supported quasi-harmonic bases Allows to identify key features of the shape Shapes as collections of parts Enables several applications (segmentation, etc.)

Dense non-rigid shape correspondence using random forests Apply random forests to perform shape matching Allows faster matching times General framework for inter-class matching

Supervised learning of bag-of-features shape descriptors using sparse coding Dictionary learning for shape retrieval (supervised learning) Provides a global shape descriptor that is fast to evaluate and compare State of the art retrieval

Consistent Shape Maps via Semidefinite Programming Analysis of shape collections Consistently matching all shapes in a given collection starting from input maps Theoretical guarantees in presence of noisy input

Cross-Collection Map Inference by Intrinsic Alignment of Shape Spaces Analysis of shape collections Given two shape collections with similar structure, match the two collections Uses functional maps

Bilateral Maps for Partial Matching Define shape descriptors for pairs of points instead of individual points Allows to do partial matching Robustness to topological changes

Optimal Intrinsic Descriptors for Non-Rigid Shape Analysis Supervised learning of optimal point descriptor Optimizing in infinitedimensional space Best possible parametrization for existing descriptors

Exploring the geometry of the space of shells Shapes as points in a space of shapes Geodesics in this space correspond to deformations between shapes Possible to interpolate / extrapolate shapes by walking on geodesics

A Low-Dimensional Representation for Robust Partial Isometric Correspondences Computation Partial isometric matching Matching points and local coordinate system Robust to topological noise State of the art on real world data